2024-09-13T17:01:41.653 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:01:41.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:01:41.773 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} email: null first_in_suite: false job_id: '7903874' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - client session with non-allowable root sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8B3K5SKSz/tYAUMHjiiYBHwTwQK+ay+lzNbJQBXoIVxXLIAzECQq9rRHzlTMKPvIq8ru96SxzPmBkL9DaFNyQ= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:01:41.773 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:01:41.774 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:01:41.774 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:01:41.776 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:01:41.799 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:01:41.799 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:01:41.799 INFO:teuthology.packaging:ref: None 2024-09-13T17:01:41.799 INFO:teuthology.packaging:tag: None 2024-09-13T17:01:41.799 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:01:41.799 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:01:41.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:01:41.953 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T17:01:41.955 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:01:41.961 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:01:41.961 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:01:41.977 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:01:41.993 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:01:42.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:01:42.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:56:47.904310', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8B3K5SKSz/tYAUMHjiiYBHwTwQK+ay+lzNbJQBXoIVxXLIAzECQq9rRHzlTMKPvIq8ru96SxzPmBkL9DaFNyQ='} 2024-09-13T17:01:42.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:56:47.902636', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8='} 2024-09-13T17:01:42.063 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:01:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T17:01:42.069 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T17:01:42.069 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:01:42.151 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6758c93be0>, signals=[15]) 2024-09-13T17:01:42.151 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:01:42.630 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:01:42.632 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:01:42.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:01:42.721 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:01:42.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:01:42.806 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:01:42.900 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-09-13T17:01:42.919 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-09-13T17:01:42.919 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-09-13T17:01:42.976 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:01:42.977 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:01:42.978 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-09-13T17:01:43.021 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-13T17:01:43.040 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-13T17:01:43.040 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-13T17:01:43.098 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-09-13T17:01:43.098 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:01:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:01:43.100 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:01:43.100 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:01:43.100 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:01:43.100 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-13T17:01:43.129 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:01:43.141 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:01:43.153 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:01:43.153 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:01:43.155 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:01:43.172 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:01:43.180 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:01:43.181 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:01:43.212 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:01:43.237 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:01:43.313 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:01:43.332 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:01:43.332 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T17:01:43.332 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:01:43.333 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:01:43.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:01:43.350 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-13T17:01:43.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:01:43.351 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-13T17:01:43.408 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-09-13T17:01:43.408 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-09-13T17:01:43.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-09-13T17:01:43.410 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-503.el9.x86_64 2024-09-13T17:01:43.410 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.14.0-503.el9.x86_64 2024-09-13T17:01:43.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2024-09-13T17:01:46.408 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-09-13T17:01:47.472 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-13T17:01:49.350 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-13T17:01:52.684 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-09-13T17:01:55.034 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T17:01:57.084 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-13T17:01:57.510 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-13T17:01:58.685 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-13T17:01:59.122 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-13T17:01:59.730 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-13T17:02:04.578 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-13T17:02:05.378 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T17:02:06.567 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T17:02:06.568 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T17:02:06.644 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout: Package Architecture Version Repository Size 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T17:02:06.652 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout:Install 4 Packages 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:02:06.653 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 79 M 2024-09-13T17:02:06.654 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 126 M 2024-09-13T17:02:06.654 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-13T17:02:07.321 INFO:teuthology.orchestra.run.smithi179.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-13T17:02:07.493 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T17:02:07.493 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T17:02:07.594 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-13T17:02:07.606 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-13T17:02:07.607 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-13T17:02:07.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:02:07.608 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 79 M 2024-09-13T17:02:07.608 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 126 M 2024-09-13T17:02:07.608 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-13T17:02:08.029 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-13T17:02:11.487 INFO:teuthology.orchestra.run.smithi179.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.9 MB/s | 29 MB 00:04 2024-09-13T17:02:12.171 INFO:teuthology.orchestra.run.smithi179.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-13T17:02:12.854 INFO:teuthology.orchestra.run.smithi179.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.7 MB/s | 35 MB 00:06 2024-09-13T17:02:12.854 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:02:12.855 INFO:teuthology.orchestra.run.smithi179.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-13T17:02:13.536 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-13T17:02:13.867 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-13T17:02:13.867 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-13T17:02:14.859 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-13T17:02:14.859 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-13T17:02:17.318 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-13T17:02:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T17:02:18.113 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:02:20.137 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.4 MB/s | 29 MB 00:12 2024-09-13T17:02:20.981 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:02:21.115 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:02:21.845 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-09-13T17:02:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:02:26.065 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:02:30.920 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:02:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 813 kB/s | 35 MB 00:43 2024-09-13T17:02:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:02:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.8 MB/s | 79 MB 00:43 2024-09-13T17:02:51.965 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-13T17:02:52.347 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-13T17:02:52.347 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-13T17:02:53.339 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-13T17:02:53.340 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-13T17:02:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-13T17:02:56.593 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T17:02:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:02:59.476 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:02:59.603 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:03:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:03:04.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:09.312 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:09.685 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:09.685 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T17:03:09.685 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:03:09.685 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:03:09.928 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T17:03:10.579 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T17:03:10.580 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:03:10.580 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-13T17:03:10.960 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T17:03:11.045 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:11.046 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T17:03:11.046 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T17:03:11.046 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:03:11.046 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:03:11.046 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T17:03:11.046 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:03:11.047 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T17:03:11.105 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:11.105 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T17:03:11.105 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-09-13T17:03:11.141 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-09-13T17:03:11.141 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 82.el9 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-09-13T17:03:11.142 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8274670 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T17:03:11.143 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:03:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T17:03:11.145 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T17:03:11.145 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T17:03:11.145 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-09-13T17:03:11.145 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:03:11.145 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T17:03:11.147 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T17:03:11.147 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 5.14.0-505.el9.x86_64 2024-09-13T17:03:11.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T17:03:11.800 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-09-13T17:03:13.149 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T17:03:13.189 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-09-13T17:03:13.190 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-13T17:03:13.206 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.QQgnFyL0dO 2024-09-13T17:03:13.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QQgnFyL0dO 2024-09-13T17:03:13.283 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.QQgnFyL0dO 2024-09-13T17:03:13.427 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.QQgnFyL0dO is 6KB 2024-09-13T17:03:13.476 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.QQgnFyL0dO 2024-09-13T17:03:13.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T17:03:13.553 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T17:03:13.553 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T17:03:13.554 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T17:03:13.554 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T17:03:13.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T17:03:13.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-09-13T17:03:43.711 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T17:03:43.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-13T17:03:43.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:03:48.758 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:48.798 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:49.149 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:49.149 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T17:03:49.149 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T17:03:49.149 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T17:03:49.988 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T17:03:49.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:03:49.988 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:03:49.989 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-13T17:03:50.406 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T17:03:50.497 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:50.498 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T17:03:50.498 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T17:03:50.498 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:03:50.498 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:03:50.498 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T17:03:50.498 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:03:50.498 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T17:03:50.557 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T17:03:50.557 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T17:03:50.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 82.el9 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-09-13T17:03:50.588 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8274670 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T17:03:50.589 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T17:03:50.590 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T17:03:50.590 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-09-13T17:03:50.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:03:50.590 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T17:03:50.591 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T17:03:50.591 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-505.el9.x86_64 2024-09-13T17:03:50.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T17:03:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-09-13T17:03:52.610 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T17:03:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-09-13T17:03:52.653 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-13T17:03:52.667 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.S2kaom6voq 2024-09-13T17:03:52.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.S2kaom6voq 2024-09-13T17:03:52.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.S2kaom6voq 2024-09-13T17:03:52.879 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.S2kaom6voq is 6KB 2024-09-13T17:03:52.928 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.S2kaom6voq 2024-09-13T17:03:52.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T17:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T17:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T17:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T17:03:53.013 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T17:03:53.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T17:03:53.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-09-13T17:03:59.150 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-13T17:04:03.233 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-13T17:04:10.323 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-13T17:04:23.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T17:04:23.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:04:23.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:04:35.771 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-13T17:04:41.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-09-13T17:04:48.852 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-13T17:04:50.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:04:50.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:05:04.910 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ZtWqcQmiGHJF5xzk06TwUWHHfZwLQ6z7NZoBkbRF1Oo), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-13T17:05:23.940 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ZtWqcQmiGHJF5xzk06TwUWHHfZwLQ6z7NZoBkbRF1Oo), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-13T17:05:45.988 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ZtWqcQmiGHJF5xzk06TwUWHHfZwLQ6z7NZoBkbRF1Oo), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-13T17:05:50.545 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T17:06:02.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:06:02.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:06:02.845 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-13T17:06:03.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:06:03.194 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T17:06:03.194 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-13T17:06:03.210 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-505.el9.x86_64 2024-09-13T17:06:03.211 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T17:06:03.211 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:06:03.211 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T17:06:04.211 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T17:06:04.212 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:06:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-09-13T17:06:04.312 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:11.015 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ZtWqcQmiGHJF5xzk06TwUWHHfZwLQ6z7NZoBkbRF1Oo), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-13T17:06:39.043 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:ZtWqcQmiGHJF5xzk06TwUWHHfZwLQ6z7NZoBkbRF1Oo), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-13T17:06:39.044 DEBUG:teuthology.orchestra.remote:'connect to smithi179.front.sepia.ceph.com' reached maximum tries (10) after waiting for 145 seconds 2024-09-13T17:06:48.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-13T17:06:48.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:06:48.352 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-13T17:06:48.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-13T17:06:48.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T17:06:48.714 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-13T17:06:48.730 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-505.el9.x86_64 2024-09-13T17:06:48.730 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T17:06:48.730 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:06:48.730 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T17:06:49.731 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T17:06:49.731 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:06:49.819 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-09-13T17:06:49.843 DEBUG:teuthology.parallel:result is None 2024-09-13T17:06:49.843 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:06:49.851 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:06:49.851 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:06:49.854 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:06:49.871 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:06:49.883 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:06:49.896 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:06:49.896 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:06:49.913 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:06:49.946 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:06:49.957 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:06:49.957 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:06:49.975 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:06:50.005 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:06:50.017 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:06:50.018 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:06:50.029 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:06:50.031 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:06:50.039 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:06:50.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:06:50.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:06:50.099 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:06:50.110 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:06:50.110 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:06:50.132 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:06:50.157 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:06:50.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:06:50.281 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:06:50.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:06:50.408 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:06:50.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:06:50.475 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:06:50.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:06:50.581 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:06:50.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:06:50.668 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:06:50.669 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:06:50.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-09-13T17:06:50.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-13T17:06:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:06:50.817 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:06:51.353 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:06:51.362 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:06:51.362 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:06:51.391 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:06:51.407 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T17:06:51.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-09-13T17:06:51.474 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-09-13T17:06:51.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-09-13T17:06:51.532 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-09-13T17:06:51.534 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:06:51.534 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-09-13T17:06:51.560 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-09-13T17:06:51.560 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-09-13T17:06:51.583 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-09-13T17:06:51.583 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-09-13T17:06:51.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:06:51.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:51.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:06:51.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:06:51.661 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:06:51.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:06:51.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:06:51.740 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:06:51.751 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:06:51.763 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:06:51.764 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:10:37.487 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-13T17:10:37.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:10:37.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:10:37.580 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-13T17:10:37.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-13T17:10:37.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-13T17:10:37.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:10:37.706 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-13T17:10:37.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-13T17:10:37.785 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:10:37.799 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:10:37.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:10:37.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:10:37.802 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:10:37.802 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:10:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:10:37.846 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:10:37.855 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:10:37.869 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:10:37.872 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-09-13T17:10:37.883 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-09-13T17:10:37.898 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-09-13T17:10:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:10:37.904 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-09-13T17:10:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:10:37.919 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:10:37.933 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:10:37.981 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.985 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.987 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.991 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:10:37.991 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:10:38.001 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:10:38.001 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:10:38.001 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:10:38.001 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:10:38.007 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:10:38.007 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:10:38.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:10:38.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:10:38.011 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:10:38.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:10:38.164 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:10:38.164 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:10:38.177 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:10:38.177 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:10:38.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:10:38.284 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:10:38.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:10:38.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:10:38.295 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:10:38.295 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:10:38.310 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:10:38.311 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:10:38.321 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:10:38.322 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:10:38.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:10:38.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:10:38.455 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:10:38.463 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:10:38.520 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-09-13T17:10:38.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-09-13T17:10:38.527 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-09-13T17:10:38.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-09-13T17:10:38.754 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-09-13T17:10:38.759 INFO:teuthology.orchestra.run.smithi179.stdout:45 files removed 2024-09-13T17:10:38.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:10:38.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:10:39.340 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 288 kB/s | 78 kB 00:00 2024-09-13T17:10:39.344 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 295 kB/s | 78 kB 00:00 2024-09-13T17:10:39.607 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 51 kB/s | 11 kB 00:00 2024-09-13T17:10:39.636 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 47 kB/s | 11 kB 00:00 2024-09-13T17:10:39.882 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T17:10:39.912 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-13T17:10:40.329 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 22 MB/s | 8.2 MB 00:00 2024-09-13T17:10:40.774 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-09-13T17:10:42.488 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-13T17:10:42.759 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T17:10:47.589 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.5 MB 00:01 2024-09-13T17:10:49.315 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-13T17:10:49.518 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-13T17:10:50.410 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T17:10:51.044 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 19 kB 00:00 2024-09-13T17:10:52.131 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T17:10:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T17:10:57.603 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T17:10:58.513 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:10:58.514 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:10:58.527 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:10:58.528 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:10:58.529 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:10:58.530 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:10:58.532 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:10:58.535 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:10:58.536 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:10:58.602 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:10:58.615 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:10:58.616 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:10:58.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:10:58.618 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:10:58.619 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:10:58.620 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:10:58.621 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:10:58.622 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:10:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:10:58.624 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:10:58.625 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:Install 130 Packages 2024-09-13T17:10:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 8 Packages 2024-09-13T17:10:58.627 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:10:58.627 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 203 M 2024-09-13T17:10:58.627 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-13T17:10:58.976 INFO:teuthology.orchestra.run.smithi005.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-13T17:10:59.193 INFO:teuthology.orchestra.run.smithi005.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.8 MB/s | 852 kB 00:00 2024-09-13T17:10:59.285 INFO:teuthology.orchestra.run.smithi005.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 5.1 MB 00:00 2024-09-13T17:10:59.311 INFO:teuthology.orchestra.run.smithi005.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 1.2 MB/s | 142 kB 00:00 2024-09-13T17:10:59.436 INFO:teuthology.orchestra.run.smithi005.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 14 MB/s | 2.1 MB 00:00 2024-09-13T17:10:59.477 INFO:teuthology.orchestra.run.smithi005.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 8.8 MB/s | 1.5 MB 00:00 2024-09-13T17:10:59.711 INFO:teuthology.orchestra.run.smithi005.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-13T17:10:59.912 INFO:teuthology.orchestra.run.smithi005.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 17 MB/s | 18 MB 00:01 2024-09-13T17:10:59.953 INFO:teuthology.orchestra.run.smithi005.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 607 kB/s | 25 kB 00:00 2024-09-13T17:10:59.981 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:10:59.981 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:10:59.992 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:10:59.993 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:10:59.993 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:10:59.994 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:10:59.996 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:11:00.001 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:11:00.002 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:11:00.059 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:11:00.078 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:11:00.079 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:11:00.080 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:11:00.081 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:11:00.082 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:11:00.083 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:11:00.084 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:11:00.085 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:11:00.086 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:11:00.087 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:11:00.088 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-13T17:11:00.089 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-13T17:11:00.090 INFO:teuthology.orchestra.run.smithi179.stdout:Install 130 Packages 2024-09-13T17:11:00.090 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 8 Packages 2024-09-13T17:11:00.090 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:00.090 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 203 M 2024-09-13T17:11:00.090 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-13T17:11:00.212 INFO:teuthology.orchestra.run.smithi005.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 15 MB/s | 7.7 MB 00:00 2024-09-13T17:11:00.270 INFO:teuthology.orchestra.run.smithi005.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.8 MB/s | 224 kB 00:00 2024-09-13T17:11:00.345 INFO:teuthology.orchestra.run.smithi005.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 414 kB/s | 31 kB 00:00 2024-09-13T17:11:00.596 INFO:teuthology.orchestra.run.smithi179.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-13T17:11:00.612 INFO:teuthology.orchestra.run.smithi005.stdout:(13/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 15 MB/s | 17 MB 00:01 2024-09-13T17:11:00.646 INFO:teuthology.orchestra.run.smithi005.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 2.3 MB/s | 712 kB 00:00 2024-09-13T17:11:00.698 INFO:teuthology.orchestra.run.smithi005.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.9 MB/s | 166 kB 00:00 2024-09-13T17:11:00.724 INFO:teuthology.orchestra.run.smithi005.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 1.6 MB/s | 127 kB 00:00 2024-09-13T17:11:00.758 INFO:teuthology.orchestra.run.smithi005.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 8.0 MB/s | 478 kB 00:00 2024-09-13T17:11:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 601 kB/s | 45 kB 00:00 2024-09-13T17:11:00.880 INFO:teuthology.orchestra.run.smithi179.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 2.9 MB/s | 852 kB 00:00 2024-09-13T17:11:00.925 INFO:teuthology.orchestra.run.smithi005.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.4 MB/s | 129 kB 00:00 2024-09-13T17:11:01.000 INFO:teuthology.orchestra.run.smithi005.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.1 MB/s | 162 kB 00:00 2024-09-13T17:11:01.075 INFO:teuthology.orchestra.run.smithi005.stdout:(21/138): python3-rados-18.2.4-860.g6c6b083f.el 4.2 MB/s | 321 kB 00:00 2024-09-13T17:11:01.088 INFO:teuthology.orchestra.run.smithi179.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 7.9 MB/s | 5.1 MB 00:00 2024-09-13T17:11:01.151 INFO:teuthology.orchestra.run.smithi005.stdout:(22/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 3.9 MB/s | 301 kB 00:00 2024-09-13T17:11:01.226 INFO:teuthology.orchestra.run.smithi005.stdout:(23/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.3 MB/s | 99 kB 00:00 2024-09-13T17:11:01.301 INFO:teuthology.orchestra.run.smithi005.stdout:(24/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.1 MB/s | 87 kB 00:00 2024-09-13T17:11:01.497 INFO:teuthology.orchestra.run.smithi179.stdout:(4/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 5.1 MB/s | 2.1 MB 00:00 2024-09-13T17:11:01.585 INFO:teuthology.orchestra.run.smithi005.stdout:(25/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 3.0 MB 00:00 2024-09-13T17:11:01.606 INFO:teuthology.orchestra.run.smithi179.stdout:(5/138): ceph-immutable-object-cache-18.2.4-860 196 kB/s | 142 kB 00:00 2024-09-13T17:11:01.681 INFO:teuthology.orchestra.run.smithi179.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 8.0 MB/s | 1.5 MB 00:00 2024-09-13T17:11:01.865 INFO:teuthology.orchestra.run.smithi179.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 18 MB 00:01 2024-09-13T17:11:01.935 INFO:teuthology.orchestra.run.smithi005.stdout:(26/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 20 MB/s | 40 MB 00:01 2024-09-13T17:11:01.960 INFO:teuthology.orchestra.run.smithi005.stdout:(27/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 459 kB/s | 172 kB 00:00 2024-09-13T17:11:02.027 INFO:teuthology.orchestra.run.smithi005.stdout:(28/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 4.5 MB 00:01 2024-09-13T17:11:02.044 INFO:teuthology.orchestra.run.smithi005.stdout:(29/138): ceph-grafana-dashboards-18.2.4-860.g6 225 kB/s | 24 kB 00:00 2024-09-13T17:11:02.069 INFO:teuthology.orchestra.run.smithi005.stdout:(30/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.2 MB/s | 139 kB 00:00 2024-09-13T17:11:02.145 INFO:teuthology.orchestra.run.smithi005.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 3.2 MB/s | 246 kB 00:00 2024-09-13T17:11:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 659 kB/s | 49 kB 00:00 2024-09-13T17:11:02.262 INFO:teuthology.orchestra.run.smithi005.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 395 kB/s | 16 kB 00:00 2024-09-13T17:11:02.265 INFO:teuthology.orchestra.run.smithi179.stdout:(8/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9. 19 MB/s | 7.7 MB 00:00 2024-09-13T17:11:02.323 INFO:teuthology.orchestra.run.smithi179.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 433 kB/s | 25 kB 00:00 2024-09-13T17:11:02.337 INFO:teuthology.orchestra.run.smithi005.stdout:(34/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 3.5 MB/s | 264 kB 00:00 2024-09-13T17:11:02.421 INFO:teuthology.orchestra.run.smithi005.stdout:(35/138): ceph-mgr-diskprediction-local-18.2.4- 20 MB/s | 7.4 MB 00:00 2024-09-13T17:11:02.423 INFO:teuthology.orchestra.run.smithi179.stdout:(10/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86 5.7 MB/s | 4.7 MB 00:00 2024-09-13T17:11:02.446 INFO:teuthology.orchestra.run.smithi005.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 2.0 MB/s | 226 kB 00:00 2024-09-13T17:11:02.471 INFO:teuthology.orchestra.run.smithi005.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 366 kB/s | 18 kB 00:00 2024-09-13T17:11:02.509 INFO:teuthology.orchestra.run.smithi179.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 2.6 MB/s | 224 kB 00:00 2024-09-13T17:11:02.558 INFO:teuthology.orchestra.run.smithi179.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 649 kB/s | 31 kB 00:00 2024-09-13T17:11:02.597 INFO:teuthology.orchestra.run.smithi005.stdout:(38/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 6.2 MB/s | 3.5 MB 00:00 2024-09-13T17:11:02.622 INFO:teuthology.orchestra.run.smithi005.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-13T17:11:02.655 INFO:teuthology.orchestra.run.smithi005.stdout:(40/138): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-13T17:11:02.674 INFO:teuthology.orchestra.run.smithi179.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 6.0 MB/s | 712 kB 00:00 2024-09-13T17:11:02.680 INFO:teuthology.orchestra.run.smithi005.stdout:(41/138): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-13T17:11:02.723 INFO:teuthology.orchestra.run.smithi005.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T17:11:02.733 INFO:teuthology.orchestra.run.smithi179.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.8 MB/s | 166 kB 00:00 2024-09-13T17:11:02.765 INFO:teuthology.orchestra.run.smithi005.stdout:(43/138): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-13T17:11:02.792 INFO:teuthology.orchestra.run.smithi179.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 2.1 MB/s | 127 kB 00:00 2024-09-13T17:11:02.798 INFO:teuthology.orchestra.run.smithi005.stdout:(44/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-13T17:11:02.824 INFO:teuthology.orchestra.run.smithi005.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-13T17:11:02.849 INFO:teuthology.orchestra.run.smithi005.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-13T17:11:02.892 INFO:teuthology.orchestra.run.smithi005.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-13T17:11:02.892 INFO:teuthology.orchestra.run.smithi179.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 4.7 MB/s | 478 kB 00:00 2024-09-13T17:11:03.159 INFO:teuthology.orchestra.run.smithi179.stdout:(17/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 11 MB/s | 17 MB 00:01 2024-09-13T17:11:03.209 INFO:teuthology.orchestra.run.smithi179.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 906 kB/s | 45 kB 00:00 2024-09-13T17:11:03.260 INFO:teuthology.orchestra.run.smithi179.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 2.5 MB/s | 129 kB 00:00 2024-09-13T17:11:03.318 INFO:teuthology.orchestra.run.smithi179.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.7 MB/s | 162 kB 00:00 2024-09-13T17:11:03.349 INFO:teuthology.orchestra.run.smithi005.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-13T17:11:03.377 INFO:teuthology.orchestra.run.smithi179.stdout:(21/138): python3-rados-18.2.4-860.g6c6b083f.el 5.4 MB/s | 321 kB 00:00 2024-09-13T17:11:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:(22/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.1 MB/s | 301 kB 00:00 2024-09-13T17:11:03.458 INFO:teuthology.orchestra.run.smithi005.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-13T17:11:03.519 INFO:teuthology.orchestra.run.smithi179.stdout:(23/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 7.1 MB/s | 4.5 MB 00:00 2024-09-13T17:11:03.544 INFO:teuthology.orchestra.run.smithi179.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 916 kB/s | 99 kB 00:00 2024-09-13T17:11:03.578 INFO:teuthology.orchestra.run.smithi179.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.4 MB/s | 87 kB 00:00 2024-09-13T17:11:03.583 INFO:teuthology.orchestra.run.smithi005.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 907 kB/s | 689 kB 00:00 2024-09-13T17:11:03.645 INFO:teuthology.orchestra.run.smithi179.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T17:11:03.667 INFO:teuthology.orchestra.run.smithi005.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-13T17:11:03.692 INFO:teuthology.orchestra.run.smithi005.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-13T17:11:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 420 kB/s | 24 kB 00:00 2024-09-13T17:11:03.751 INFO:teuthology.orchestra.run.smithi005.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-13T17:11:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.3 MB/s | 139 kB 00:00 2024-09-13T17:11:03.801 INFO:teuthology.orchestra.run.smithi005.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-13T17:11:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:(29/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 3.0 MB 00:00 2024-09-13T17:11:03.860 INFO:teuthology.orchestra.run.smithi005.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-13T17:11:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-13T17:11:03.968 INFO:teuthology.orchestra.run.smithi005.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-13T17:11:04.086 INFO:teuthology.orchestra.run.smithi005.stdout:(58/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.1 MB/s | 3.0 MB 00:00 2024-09-13T17:11:04.196 INFO:teuthology.orchestra.run.smithi179.stdout:(30/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 21 MB/s | 40 MB 00:01 2024-09-13T17:11:04.211 INFO:teuthology.orchestra.run.smithi005.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-13T17:11:04.228 INFO:teuthology.orchestra.run.smithi005.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 173 kB/s | 24 kB 00:00 2024-09-13T17:11:04.246 INFO:teuthology.orchestra.run.smithi179.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.8 MB/s | 246 kB 00:00 2024-09-13T17:11:04.262 INFO:teuthology.orchestra.run.smithi005.stdout:(61/138): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-13T17:11:04.312 INFO:teuthology.orchestra.run.smithi005.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-13T17:11:04.321 INFO:teuthology.orchestra.run.smithi179.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 660 kB/s | 49 kB 00:00 2024-09-13T17:11:04.345 INFO:teuthology.orchestra.run.smithi005.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-13T17:11:04.362 INFO:teuthology.orchestra.run.smithi005.stdout:(64/138): openblas-0.3.26-2.el9.x86_64.rpm 382 kB/s | 38 kB 00:00 2024-09-13T17:11:04.397 INFO:teuthology.orchestra.run.smithi179.stdout:(33/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 5.6 MB/s | 3.5 MB 00:00 2024-09-13T17:11:04.414 INFO:teuthology.orchestra.run.smithi179.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 179 kB/s | 16 kB 00:00 2024-09-13T17:11:04.447 INFO:teuthology.orchestra.run.smithi179.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 5.2 MB/s | 264 kB 00:00 2024-09-13T17:11:04.473 INFO:teuthology.orchestra.run.smithi179.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T17:11:04.490 INFO:teuthology.orchestra.run.smithi179.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 435 kB/s | 18 kB 00:00 2024-09-13T17:11:04.579 INFO:teuthology.orchestra.run.smithi005.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-13T17:11:04.590 INFO:teuthology.orchestra.run.smithi179.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 9.6 MB/s | 7.4 MB 00:00 2024-09-13T17:11:04.621 INFO:teuthology.orchestra.run.smithi005.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-13T17:11:04.699 INFO:teuthology.orchestra.run.smithi179.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-13T17:11:04.705 INFO:teuthology.orchestra.run.smithi005.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-13T17:11:04.738 INFO:teuthology.orchestra.run.smithi005.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-13T17:11:04.757 INFO:teuthology.orchestra.run.smithi179.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T17:11:04.782 INFO:teuthology.orchestra.run.smithi179.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-13T17:11:04.841 INFO:teuthology.orchestra.run.smithi179.stdout:(42/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T17:11:04.891 INFO:teuthology.orchestra.run.smithi179.stdout:(43/138): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-13T17:11:04.942 INFO:teuthology.orchestra.run.smithi179.stdout:(44/138): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-13T17:11:05.017 INFO:teuthology.orchestra.run.smithi179.stdout:(45/138): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-13T17:11:05.051 INFO:teuthology.orchestra.run.smithi179.stdout:(46/138): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-09-13T17:11:05.055 INFO:teuthology.orchestra.run.smithi005.stdout:(69/138): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-13T17:11:05.172 INFO:teuthology.orchestra.run.smithi005.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-13T17:11:05.201 INFO:teuthology.orchestra.run.smithi179.stdout:(47/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-13T17:11:05.226 INFO:teuthology.orchestra.run.smithi179.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-13T17:11:05.268 INFO:teuthology.orchestra.run.smithi179.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-13T17:11:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-13T17:11:05.310 INFO:teuthology.orchestra.run.smithi179.stdout:(50/138): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-13T17:11:05.335 INFO:teuthology.orchestra.run.smithi179.stdout:(51/138): boost-program-options-1.75.0-8.el9.x8 798 kB/s | 107 kB 00:00 2024-09-13T17:11:05.360 INFO:teuthology.orchestra.run.smithi179.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-13T17:11:05.386 INFO:teuthology.orchestra.run.smithi179.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-13T17:11:05.398 INFO:teuthology.orchestra.run.smithi005.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-13T17:11:05.411 INFO:teuthology.orchestra.run.smithi179.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-13T17:11:05.436 INFO:teuthology.orchestra.run.smithi179.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-13T17:11:05.461 INFO:teuthology.orchestra.run.smithi179.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-13T17:11:05.487 INFO:teuthology.orchestra.run.smithi179.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-13T17:11:05.515 INFO:teuthology.orchestra.run.smithi005.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-13T17:11:05.570 INFO:teuthology.orchestra.run.smithi179.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-13T17:11:05.612 INFO:teuthology.orchestra.run.smithi179.stdout:(59/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 587 kB/s | 24 kB 00:00 2024-09-13T17:11:05.624 INFO:teuthology.orchestra.run.smithi005.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-13T17:11:05.654 INFO:teuthology.orchestra.run.smithi179.stdout:(60/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T17:11:05.696 INFO:teuthology.orchestra.run.smithi179.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-13T17:11:05.732 INFO:teuthology.orchestra.run.smithi005.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-13T17:11:05.738 INFO:teuthology.orchestra.run.smithi179.stdout:(62/138): openblas-0.3.26-2.el9.x86_64.rpm 925 kB/s | 38 kB 00:00 2024-09-13T17:11:05.763 INFO:teuthology.orchestra.run.smithi179.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T17:11:05.914 INFO:teuthology.orchestra.run.smithi179.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.2 MB/s | 3.0 MB 00:00 2024-09-13T17:11:06.007 INFO:teuthology.orchestra.run.smithi005.stdout:(76/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-13T17:11:06.083 INFO:teuthology.orchestra.run.smithi005.stdout:(77/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-09-13T17:11:06.116 INFO:teuthology.orchestra.run.smithi005.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-13T17:11:06.234 INFO:teuthology.orchestra.run.smithi005.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-13T17:11:06.348 INFO:teuthology.orchestra.run.smithi179.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-13T17:11:06.350 INFO:teuthology.orchestra.run.smithi005.stdout:(80/138): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-13T17:11:06.467 INFO:teuthology.orchestra.run.smithi005.stdout:(81/138): python3-oauthlib-3.1.1-5.el9.noarch.r 578 kB/s | 222 kB 00:00 2024-09-13T17:11:06.492 INFO:teuthology.orchestra.run.smithi005.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-13T17:11:06.601 INFO:teuthology.orchestra.run.smithi005.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-13T17:11:06.614 INFO:teuthology.orchestra.run.smithi179.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-13T17:11:06.689 INFO:teuthology.orchestra.run.smithi179.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-13T17:11:06.710 INFO:teuthology.orchestra.run.smithi005.stdout:(84/138): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-13T17:11:06.943 INFO:teuthology.orchestra.run.smithi005.stdout:(85/138): python3-pyasn1-modules-0.4.8-6.el9.no 586 kB/s | 279 kB 00:00 2024-09-13T17:11:07.040 INFO:teuthology.orchestra.run.smithi179.stdout:(68/138): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-13T17:11:07.052 INFO:teuthology.orchestra.run.smithi005.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-13T17:11:07.115 INFO:teuthology.orchestra.run.smithi179.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-13T17:11:07.207 INFO:teuthology.orchestra.run.smithi179.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-13T17:11:07.299 INFO:teuthology.orchestra.run.smithi179.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-13T17:11:07.332 INFO:teuthology.orchestra.run.smithi179.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 775 kB/s | 26 kB 00:00 2024-09-13T17:11:07.366 INFO:teuthology.orchestra.run.smithi179.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 575 kB/s | 19 kB 00:00 2024-09-13T17:11:07.433 INFO:teuthology.orchestra.run.smithi179.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-13T17:11:07.467 INFO:teuthology.orchestra.run.smithi179.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-13T17:11:07.510 INFO:teuthology.orchestra.run.smithi005.stdout:(87/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-13T17:11:07.552 INFO:teuthology.orchestra.run.smithi005.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 608 kB/s | 304 kB 00:00 2024-09-13T17:11:07.644 INFO:teuthology.orchestra.run.smithi005.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 433 kB/s | 58 kB 00:00 2024-09-13T17:11:07.753 INFO:teuthology.orchestra.run.smithi005.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-13T17:11:07.779 INFO:teuthology.orchestra.run.smithi005.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 476 kB/s | 64 kB 00:00 2024-09-13T17:11:07.829 INFO:teuthology.orchestra.run.smithi005.stdout:(92/138): fmt-8.1.1-5.el9.x86_64.rpm 2.2 MB/s | 111 kB 00:00 2024-09-13T17:11:07.862 INFO:teuthology.orchestra.run.smithi005.stdout:(93/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 411 kB/s | 45 kB 00:00 2024-09-13T17:11:07.887 INFO:teuthology.orchestra.run.smithi005.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 5.1 MB/s | 308 kB 00:00 2024-09-13T17:11:07.921 INFO:teuthology.orchestra.run.smithi005.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:11:07.946 INFO:teuthology.orchestra.run.smithi005.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T17:11:07.963 INFO:teuthology.orchestra.run.smithi005.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-13T17:11:08.038 INFO:teuthology.orchestra.run.smithi005.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-13T17:11:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-09-13T17:11:08.114 INFO:teuthology.orchestra.run.smithi005.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:11:08.148 INFO:teuthology.orchestra.run.smithi005.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 957 kB/s | 32 kB 00:00 2024-09-13T17:11:08.173 INFO:teuthology.orchestra.run.smithi005.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-13T17:11:08.232 INFO:teuthology.orchestra.run.smithi005.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-13T17:11:08.242 INFO:teuthology.orchestra.run.smithi179.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-13T17:11:08.274 INFO:teuthology.orchestra.run.smithi005.stdout:(104/138): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-13T17:11:08.333 INFO:teuthology.orchestra.run.smithi005.stdout:(105/138): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-13T17:11:08.342 INFO:teuthology.orchestra.run.smithi179.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-13T17:11:08.349 INFO:teuthology.orchestra.run.smithi005.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-13T17:11:08.375 INFO:teuthology.orchestra.run.smithi005.stdout:(107/138): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-13T17:11:08.392 INFO:teuthology.orchestra.run.smithi005.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-13T17:11:08.409 INFO:teuthology.orchestra.run.smithi005.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-13T17:11:08.425 INFO:teuthology.orchestra.run.smithi005.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2024-09-13T17:11:08.442 INFO:teuthology.orchestra.run.smithi179.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-13T17:11:08.451 INFO:teuthology.orchestra.run.smithi005.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-09-13T17:11:08.476 INFO:teuthology.orchestra.run.smithi005.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T17:11:08.501 INFO:teuthology.orchestra.run.smithi179.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T17:11:08.518 INFO:teuthology.orchestra.run.smithi005.stdout:(113/138): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-13T17:11:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:(80/138): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-13T17:11:08.544 INFO:teuthology.orchestra.run.smithi005.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-13T17:11:08.569 INFO:teuthology.orchestra.run.smithi005.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T17:11:08.594 INFO:teuthology.orchestra.run.smithi005.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-13T17:11:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:(81/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-13T17:11:08.619 INFO:teuthology.orchestra.run.smithi005.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T17:11:08.645 INFO:teuthology.orchestra.run.smithi005.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T17:11:08.670 INFO:teuthology.orchestra.run.smithi005.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-13T17:11:08.695 INFO:teuthology.orchestra.run.smithi005.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:11:08.710 INFO:teuthology.orchestra.run.smithi179.stdout:(82/138): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-13T17:11:08.720 INFO:teuthology.orchestra.run.smithi005.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T17:11:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-13T17:11:08.752 INFO:teuthology.orchestra.run.smithi179.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T17:11:08.771 INFO:teuthology.orchestra.run.smithi005.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T17:11:08.794 INFO:teuthology.orchestra.run.smithi179.stdout:(84/138): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-13T17:11:08.796 INFO:teuthology.orchestra.run.smithi005.stdout:(124/138): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-13T17:11:08.821 INFO:teuthology.orchestra.run.smithi005.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T17:11:08.847 INFO:teuthology.orchestra.run.smithi005.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-13T17:11:08.872 INFO:teuthology.orchestra.run.smithi005.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-13T17:11:08.897 INFO:teuthology.orchestra.run.smithi005.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T17:11:08.902 INFO:teuthology.orchestra.run.smithi179.stdout:(85/138): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-13T17:11:08.944 INFO:teuthology.orchestra.run.smithi179.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T17:11:08.989 INFO:teuthology.orchestra.run.smithi005.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T17:11:09.061 INFO:teuthology.orchestra.run.smithi179.stdout:(87/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-13T17:11:09.104 INFO:teuthology.orchestra.run.smithi179.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-13T17:11:09.129 INFO:teuthology.orchestra.run.smithi179.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 867 kB/s | 58 kB 00:00 2024-09-13T17:11:09.148 INFO:teuthology.orchestra.run.smithi005.stdout:(130/138): librados2-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 3.3 MB 00:00 2024-09-13T17:11:09.171 INFO:teuthology.orchestra.run.smithi179.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-09-13T17:11:09.213 INFO:teuthology.orchestra.run.smithi179.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-09-13T17:11:09.238 INFO:teuthology.orchestra.run.smithi179.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-13T17:11:09.280 INFO:teuthology.orchestra.run.smithi179.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T17:11:09.315 INFO:teuthology.orchestra.run.smithi005.stdout:(131/138): NetworkManager-1.49.90-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-09-13T17:11:09.330 INFO:teuthology.orchestra.run.smithi179.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T17:11:09.355 INFO:teuthology.orchestra.run.smithi179.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:11:09.389 INFO:teuthology.orchestra.run.smithi179.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-13T17:11:09.390 INFO:teuthology.orchestra.run.smithi005.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-13T17:11:09.423 INFO:teuthology.orchestra.run.smithi179.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T17:11:09.449 INFO:teuthology.orchestra.run.smithi005.stdout:(133/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 6.6 MB/s | 3.0 MB 00:00 2024-09-13T17:11:09.474 INFO:teuthology.orchestra.run.smithi005.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 487 kB/s | 41 kB 00:00 2024-09-13T17:11:09.531 INFO:teuthology.orchestra.run.smithi179.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-09-13T17:11:09.541 INFO:teuthology.orchestra.run.smithi005.stdout:(135/138): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-13T17:11:09.566 INFO:teuthology.orchestra.run.smithi005.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-13T17:11:09.598 INFO:teuthology.orchestra.run.smithi179.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 8.0 MB/s | 548 kB 00:00 2024-09-13T17:11:09.623 INFO:teuthology.orchestra.run.smithi179.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:11:09.633 INFO:teuthology.orchestra.run.smithi005.stdout:(137/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-13T17:11:09.649 INFO:teuthology.orchestra.run.smithi179.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T17:11:09.674 INFO:teuthology.orchestra.run.smithi179.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-13T17:11:09.741 INFO:teuthology.orchestra.run.smithi179.stdout:(103/138): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-13T17:11:09.766 INFO:teuthology.orchestra.run.smithi179.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-13T17:11:09.792 INFO:teuthology.orchestra.run.smithi179.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-13T17:11:09.825 INFO:teuthology.orchestra.run.smithi179.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-13T17:11:09.842 INFO:teuthology.orchestra.run.smithi179.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-13T17:11:09.859 INFO:teuthology.orchestra.run.smithi179.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 525 kB/s | 18 kB 00:00 2024-09-13T17:11:09.876 INFO:teuthology.orchestra.run.smithi179.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-13T17:11:09.893 INFO:teuthology.orchestra.run.smithi179.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-13T17:11:09.910 INFO:teuthology.orchestra.run.smithi179.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-13T17:11:09.927 INFO:teuthology.orchestra.run.smithi179.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-13T17:11:09.960 INFO:teuthology.orchestra.run.smithi179.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T17:11:09.994 INFO:teuthology.orchestra.run.smithi179.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-13T17:11:10.036 INFO:teuthology.orchestra.run.smithi179.stdout:(115/138): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-13T17:11:10.061 INFO:teuthology.orchestra.run.smithi179.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-13T17:11:10.087 INFO:teuthology.orchestra.run.smithi179.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-13T17:11:10.112 INFO:teuthology.orchestra.run.smithi179.stdout:(118/138): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-13T17:11:10.137 INFO:teuthology.orchestra.run.smithi179.stdout:(119/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-13T17:11:10.163 INFO:teuthology.orchestra.run.smithi179.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:11:10.188 INFO:teuthology.orchestra.run.smithi179.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T17:11:10.213 INFO:teuthology.orchestra.run.smithi179.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-13T17:11:10.247 INFO:teuthology.orchestra.run.smithi179.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-13T17:11:10.272 INFO:teuthology.orchestra.run.smithi179.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T17:11:10.297 INFO:teuthology.orchestra.run.smithi179.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T17:11:10.323 INFO:teuthology.orchestra.run.smithi179.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-13T17:11:10.348 INFO:teuthology.orchestra.run.smithi179.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-13T17:11:10.373 INFO:teuthology.orchestra.run.smithi179.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T17:11:10.440 INFO:teuthology.orchestra.run.smithi179.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T17:11:10.699 INFO:teuthology.orchestra.run.smithi179.stdout:(130/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 3.0 MB 00:00 2024-09-13T17:11:10.799 INFO:teuthology.orchestra.run.smithi179.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 7.8 MB/s | 3.3 MB 00:00 2024-09-13T17:11:11.108 INFO:teuthology.orchestra.run.smithi179.stdout:(132/138): NetworkManager-1.49.90-1.el9.x86_64. 5.7 MB/s | 2.3 MB 00:00 2024-09-13T17:11:11.166 INFO:teuthology.orchestra.run.smithi179.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 699 kB/s | 41 kB 00:00 2024-09-13T17:11:11.225 INFO:teuthology.orchestra.run.smithi179.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-13T17:11:11.392 INFO:teuthology.orchestra.run.smithi179.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 3.0 MB/s | 1.8 MB 00:00 2024-09-13T17:11:11.442 INFO:teuthology.orchestra.run.smithi005.stdout:(138/138): python3-babel-2.9.1-2.el9.noarch.rpm 911 kB/s | 6.0 MB 00:06 2024-09-13T17:11:11.447 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:11:11.447 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 203 MB 00:12 2024-09-13T17:11:11.460 INFO:teuthology.orchestra.run.smithi179.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-13T17:11:11.701 INFO:teuthology.orchestra.run.smithi179.stdout:(137/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-09-13T17:11:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-13T17:11:12.710 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-13T17:11:12.710 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-13T17:11:14.217 INFO:teuthology.orchestra.run.smithi179.stdout:(138/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-13T17:11:14.223 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:11:14.223 INFO:teuthology.orchestra.run.smithi179.stdout:Total 14 MB/s | 203 MB 00:14 2024-09-13T17:11:14.894 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-13T17:11:14.894 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-13T17:11:15.294 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-13T17:11:15.438 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-13T17:11:15.438 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-13T17:11:17.550 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-13T17:11:17.550 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-13T17:11:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-13T17:11:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:11:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:11:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:11:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:11:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:11:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:11:21.593 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:11:21.715 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:11:21.837 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:11:21.874 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:11:21.967 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:11:22.004 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:11:22.172 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:11:22.229 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:11:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:11:22.359 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:11:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:11:22.574 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:11:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:11:22.825 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:22.897 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:23.182 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:23.219 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:11:23.253 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:11:23.273 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-13T17:11:23.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:11:23.361 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:11:23.388 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:11:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:11:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:11:23.514 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:11:23.520 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:11:23.546 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:11:23.550 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:11:23.572 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:11:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:11:23.627 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:11:23.670 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:11:23.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:11:23.748 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:11:23.824 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:11:23.954 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:11:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:11:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:11:24.065 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:11:24.175 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:11:24.199 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:11:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:11:24.320 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:11:24.485 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:11:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:11:24.663 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:11:24.717 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:11:24.729 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:11:24.754 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:11:24.755 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:11:24.797 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:11:24.855 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:11:24.880 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:11:24.956 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:11:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:11:25.110 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:11:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:11:25.167 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:11:25.223 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:11:25.252 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:11:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:11:25.351 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:11:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:25.387 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:11:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:11:25.445 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:25.479 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:11:25.523 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:11:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:11:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:11:25.728 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:11:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:11:25.775 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:11:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:11:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:11:25.891 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:11:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:11:25.925 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:11:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:11:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:11:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:11:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:11:26.031 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:11:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:11:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:11:26.083 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:11:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:11:26.114 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:11:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:11:26.150 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:11:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:11:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:11:26.226 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:11:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:11:26.260 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:11:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:11:26.304 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:11:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:11:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:11:26.377 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:11:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:11:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:11:26.520 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:11:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:11:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:11:27.092 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:11:27.175 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:11:27.236 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:11:27.268 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:11:27.310 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:11:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:11:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:11:27.544 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:11:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:11:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:11:27.652 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:11:27.689 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:11:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:11:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:11:27.743 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:11:27.817 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:11:27.848 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:11:27.884 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:11:27.931 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:11:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:11:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:11:27.976 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:11:28.018 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:11:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:11:28.153 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:11:28.203 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:11:28.245 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:11:28.347 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:11:28.379 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:11:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:11:28.452 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:11:28.488 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:11:28.521 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:11:28.549 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:11:28.583 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:11:28.632 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:11:28.666 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:11:28.701 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:11:28.729 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:11:28.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:11:28.776 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:11:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:11:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:11:28.857 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:11:28.884 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:11:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:11:29.039 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:11:29.758 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:11:29.811 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:11:29.844 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:11:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:11:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:11:30.162 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:11:30.173 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:11:30.184 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:11:30.263 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:11:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:11:30.291 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:11:30.324 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:11:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:11:30.696 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:11:30.770 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:11:30.800 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:11:30.837 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:11:30.915 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:11:31.035 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:11:31.287 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:11:31.315 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:11:31.370 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:11:31.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:11:32.270 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:11:32.358 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:11:32.386 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:11:32.411 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:11:32.709 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:11:32.749 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:11:32.838 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:11:32.870 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:11:32.907 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:11:33.310 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:11:33.335 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:11:33.406 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:11:33.437 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:11:33.540 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:33.574 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:11:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:11:34.266 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:11:34.266 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:11:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:11:35.467 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:35.503 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:11:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:11:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:11:36.165 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:11:36.165 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:11:36.165 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:36.208 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:11:46.433 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-09-13T17:11:46.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:46.599 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:11:46.615 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:11:46.616 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:46.616 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:11:46.616 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:47.952 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:11:47.952 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-09-13T17:11:47.952 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-09-13T17:11:47.952 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-09-13T17:11:47.952 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-09-13T17:11:47.953 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-09-13T17:11:47.953 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-09-13T17:11:47.953 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-09-13T17:11:47.953 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:48.119 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:11:48.119 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:11:48.134 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:11:48.134 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:48.134 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:11:48.135 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:48.147 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:11:48.147 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:48.147 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:11:48.148 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:11:48.148 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:11:48.148 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:48.362 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:11:48.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:48.854 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:11:48.879 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:11:48.879 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:48.879 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:11:48.879 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:11:48.880 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:11:48.880 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:48.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:11:49.051 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:11:49.123 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:11:49.317 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:11:49.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:11:49.463 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:11:49.551 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:11:49.588 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:11:49.614 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:11:49.614 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:49.614 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:11:49.614 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:11:49.614 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:11:49.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:11:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:11:49.789 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:11:49.821 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:11:49.825 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:11:49.844 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:11:49.844 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:49.844 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:11:49.845 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:11:49.845 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:11:49.845 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:11:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:11:50.245 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:11:50.280 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:11:50.304 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:50.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:11:50.339 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:11:50.410 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:11:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:11:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:11:50.733 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:11:50.831 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:11:50.900 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:11:50.997 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:11:51.136 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:11:51.173 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:11:51.205 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:11:51.232 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:11:51.439 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:11:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:11:51.614 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:11:51.639 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:11:51.668 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:11:51.731 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:11:51.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:11:52.495 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:11:52.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:11:52.633 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:11:52.796 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:11:52.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:11:52.831 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:11:52.834 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:11:52.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:52.919 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:11:52.931 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:11:53.029 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:11:53.094 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:11:53.795 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:11:53.823 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:11:53.854 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:11:53.888 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:11:53.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:53.922 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:11:53.964 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:11:53.987 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:11:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:54.039 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:11:54.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:54.094 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:11:54.125 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:11:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:11:54.148 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:54.149 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:11:54.149 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:11:54.149 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:11:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:54.192 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:11:54.203 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:11:54.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:11:54.353 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:11:54.373 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:11:54.398 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:11:55.071 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:11:55.103 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:11:55.126 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:55.170 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:11:55.193 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:11:55.193 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:55.193 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:11:55.193 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:55.240 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:11:55.260 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:11:55.260 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:55.261 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:11:55.261 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:11:55.261 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:11:55.261 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:55.555 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:11:58.312 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:11:58.353 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:11:58.395 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:11:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:11:58.623 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:11:58.674 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:11:58.705 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:11:58.742 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:11:58.797 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:11:59.242 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:11:59.283 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:11:59.324 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:11:59.356 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:11:59.401 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:11:59.445 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:11:59.467 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:11:59.540 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:11:59.587 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:11:59.618 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:11:59.655 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:11:59.701 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:12:00.273 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:12:00.317 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:12:00.337 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:12:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:12:00.475 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:12:00.527 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:12:00.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:12:00.662 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:12:00.687 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:12:00.713 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:12:00.714 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:12:00.798 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:12:00.798 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:12:00.890 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:12:00.915 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:12:00.921 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:00.922 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:01.117 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:01.118 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:12:01.157 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:12:01.202 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:12:01.238 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:12:01.278 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:01.286 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:12:01.370 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:12:01.399 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:12:01.425 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:12:01.459 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:12:01.459 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:12:01.526 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:12:01.527 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:12:01.594 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:12:01.627 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:12:01.633 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:01.633 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:01.813 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:12:01.813 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:12:01.897 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:12:01.961 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:06.436 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:06.436 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:12:06.436 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:12:06.437 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:12:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:12:06.439 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:12:06.440 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:12:06.441 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:12:06.442 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:12:06.443 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:12:06.444 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:12:06.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:12:06.446 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:12:06.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:12:06.448 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:12:06.448 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:12:06.448 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:12:06.448 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:12:07.219 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:12:07.220 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:12:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:12:07.231 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:12:07.232 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:12:07.233 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:12:07.234 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:12:07.235 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:12:07.236 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:12:07.237 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:12:07.238 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:12:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:12:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:12:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:12:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:12:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:12:07.240 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:12:07.241 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:12:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:09.389 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-13T17:12:09.390 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.391 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.393 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:12:09.394 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:12:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:12:09.396 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:12:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:12:09.398 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:12:09.399 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:12:09.400 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:12:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:12:09.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:09.401 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-13T17:12:09.778 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:12:09.867 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.868 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.869 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:12:09.870 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:12:09.871 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:12:09.872 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:12:09.873 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:12:09.874 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:12:09.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:12:09.876 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:12:09.878 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:12:09.879 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:12:09.879 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:12:09.879 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:12:09.879 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:12:09.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:09.880 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-13T17:12:10.262 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:10.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:12:10.424 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:12:10.447 INFO:teuthology.orchestra.run.smithi005.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:12:10.448 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:12:10.448 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:12:10.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:12:10.600 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:12:10.624 INFO:teuthology.orchestra.run.smithi179.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:12:10.625 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:12:10.625 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:12:10.627 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:12:10.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:10.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:12:10.655 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:10.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:12:10.694 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:12:10.694 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:10.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:12:10.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:12:10.787 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:10.788 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:12:10.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:12:10.881 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:12:10.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:10.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:12:10.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:12:10.974 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:10.974 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:12:10.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:12:11.065 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:12:11.066 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:11.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:12:11.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:12:11.157 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:11.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:12:11.183 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:12:11.247 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T17:12:11.335 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T17:12:11.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-09-13T17:12:11.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-09-13T17:12:11.362 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T17:12:11.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:12:11.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:12:11.430 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T17:12:11.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:12:11.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:12:11.500 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T17:12:11.500 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T17:12:11.501 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T17:12:11.501 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:11.501 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:12:11.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:11.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:11.698 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:11.698 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:12:11.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:11.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:11.864 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T17:12:11.864 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T17:12:11.864 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap}', 'email': None, 'first_in_suite': False, 'job_id': '7903874', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8B3K5SKSz/tYAUMHjiiYBHwTwQK+ay+lzNbJQBXoIVxXLIAzECQq9rRHzlTMKPvIq8ru96SxzPmBkL9DaFNyQ=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmq/xDvf6p8x5wsXWMbVwoFh2ICG5p32dE1qoxzvADKqkXnNvN3jfEouOnGEjVABGttHaWsvS9dl16npzxIxv8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T17:12:11.865 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:12:11.867 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:12:11.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:12:11.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:12:11.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:11.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:12:12.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:12:12.006 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-13 17:12:01.638430487 +0000 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-13 17:10:18.135454502 +0000 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-13 17:10:18.135454502 +0000 2024-09-13T17:12:12.062 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-13 17:10:18.135454502 +0000 2024-09-13T17:12:12.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:12:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-13T17:12:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-13T17:12:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 8.2542e-05 s, 6.2 MB/s 2024-09-13T17:12:12.127 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:12:12.183 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-13 17:12:01.639430468 +0000 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-13 17:10:18.455448310 +0000 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-13 17:10:18.455448310 +0000 2024-09-13T17:12:12.240 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-13 17:10:18.455448310 +0000 2024-09-13T17:12:12.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:12:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-13T17:12:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-13T17:12:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000101605 s, 5.0 MB/s 2024-09-13T17:12:12.305 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:12:12.362 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-09-13T17:12:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-13 17:12:01.639430468 +0000 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-13 17:10:18.786441904 +0000 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-13 17:10:18.786441904 +0000 2024-09-13T17:12:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-13 17:10:18.786441904 +0000 2024-09-13T17:12:12.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:12:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-13T17:12:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-13T17:12:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000102238 s, 5.0 MB/s 2024-09-13T17:12:12.484 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:12:12.541 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-13 17:12:01.640430448 +0000 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-13 17:10:19.118435480 +0000 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-13 17:10:19.118435480 +0000 2024-09-13T17:12:12.598 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-13 17:10:19.118435480 +0000 2024-09-13T17:12:12.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:12:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-13T17:12:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-13T17:12:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 8.3497e-05 s, 6.1 MB/s 2024-09-13T17:12:12.663 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:12:12.719 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:12.720 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:12.720 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:12:12.741 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:12:12.741 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-13T17:12:12.800 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:12:12.800 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.800 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T17:12:12.800 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.801 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.801 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-13 17:12:02.319840407 +0000 2024-09-13T17:12:12.801 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-13 17:10:14.605103150 +0000 2024-09-13T17:12:12.801 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-13 17:10:14.605103150 +0000 2024-09-13T17:12:12.801 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-13 17:10:14.605103150 +0000 2024-09-13T17:12:12.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:12:12.867 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-13T17:12:12.867 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-13T17:12:12.867 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000361773 s, 1.4 MB/s 2024-09-13T17:12:12.868 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:12:12.928 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-13T17:12:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:12:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:12.985 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-13 17:12:02.320840385 +0000 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-13 17:10:14.932095645 +0000 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-13 17:10:14.932095645 +0000 2024-09-13T17:12:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-13 17:10:14.932095645 +0000 2024-09-13T17:12:12.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:12:13.051 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-13T17:12:13.051 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-13T17:12:13.052 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000308502 s, 1.7 MB/s 2024-09-13T17:12:13.053 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:12:13.112 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-13T17:12:13.168 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:12:13.169 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:13.170 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T17:12:13.170 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:13.170 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:13.170 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-13 17:12:02.320840385 +0000 2024-09-13T17:12:13.170 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-13 17:10:15.381085340 +0000 2024-09-13T17:12:13.171 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-13 17:10:15.381085340 +0000 2024-09-13T17:12:13.171 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-13 17:10:15.381085340 +0000 2024-09-13T17:12:13.172 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:12:13.233 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-13T17:12:13.233 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-13T17:12:13.233 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000225291 s, 2.3 MB/s 2024-09-13T17:12:13.235 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:12:13.292 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-13 17:12:02.320840385 +0000 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-13 17:10:15.698078065 +0000 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-13 17:10:15.698078065 +0000 2024-09-13T17:12:13.348 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-13 17:10:15.698078065 +0000 2024-09-13T17:12:13.349 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:12:13.412 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-13T17:12:13.412 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-13T17:12:13.412 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000214392 s, 2.4 MB/s 2024-09-13T17:12:13.413 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:12:13.470 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:13.470 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:12:13.471 INFO:tasks.ceph:Generating config... 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] pid file = 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T17:12:13.472 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T17:12:13.472 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T17:12:13.472 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T17:12:13.472 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T17:12:13.473 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T17:12:13.474 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T17:12:13.474 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T17:12:13.475 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T17:12:13.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T17:12:13.533 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T17:12:13.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T17:12:13.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:12:13.611 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-09-13T17:12:13.611 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T17:12:13.612 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:13.612 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:12:13.667 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:13.756 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:13.756 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:12:13.756 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2024-09-13T17:12:13.756 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-09-13T17:12:13.756 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-09-13T17:12:13.755944+0000 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-13T17:12:13.755944+0000 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-09-13T17:12:13.757 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T17:12:13.758 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:12:13.774 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b63ea2f-5230-4468-aa58-3481f4f99558... 2024-09-13T17:12:13.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:12:13.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:12:13.859 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:12:13.860 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:12:13.861 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.861 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:12:13.861 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:12:13.861 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:12:13.862 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:12:13.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:12:13.864 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:12:13.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:12:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:12:13.867 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:12:13.868 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:12:13.869 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:12:13.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:12:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:12:13.872 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:12:13.873 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:12:13.875 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:12:13.875 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:12:13.875 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:12:13.876 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:12:13.877 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:12:13.878 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:12:13.879 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:12:13.880 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:12:13.881 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:12:13.882 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:12:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:12:13.884 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:12:13.886 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:12:13.887 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:12:13.888 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:12:13.889 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:12:13.890 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:12:13.890 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:12:13.890 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T17:12:13.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T17:12:13.970 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T17:12:13.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:13.970 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T17:12:13.986 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:13.986 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T17:12:14.043 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:12:14.043 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:14.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:12:14.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:12:14.119 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:14.119 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:14.175 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:12:14.175 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:14.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:12:14.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:12:14.211 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:14.211 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:14.267 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T17:12:14.268 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T17:12:14.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:12:14.321 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:12:14.325 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:12:14.383 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:12:14.386 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T17:12:14.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:12:14.438 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:12:14.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T17:12:14.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:12:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:12:14.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T17:12:14.588 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:12:14.640 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:12:14.642 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T17:12:14.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:12:14.757 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:12:14.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T17:12:14.784 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T17:12:14.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:12:14.826 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T17:12:14.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T17:12:14.922 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T17:12:14.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T17:12:14.975 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T17:12:14.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T17:12:15.072 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T17:12:15.082 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T17:12:15.082 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:12:15.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T17:12:15.109 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:15.109 INFO:tasks.ceph:role: osd.0 2024-09-13T17:12:15.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:12:15.109 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:15.175 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:15.175 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:15.175 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:15.206 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-13T17:12:15.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-13T17:12:15.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T17:12:15.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T17:12:15.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T17:12:15.415 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:15.415 INFO:tasks.ceph:role: osd.1 2024-09-13T17:12:15.415 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:12:15.415 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:15.481 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:15.513 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-13T17:12:15.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-13T17:12:15.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T17:12:15.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T17:12:15.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T17:12:15.721 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:15.721 INFO:tasks.ceph:role: osd.2 2024-09-13T17:12:15.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:12:15.721 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:15.787 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:15.787 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:15.787 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:15.818 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-13T17:12:15.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-13T17:12:15.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T17:12:15.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T17:12:15.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T17:12:16.029 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:16.029 INFO:tasks.ceph:role: osd.3 2024-09-13T17:12:16.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:12:16.030 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:16.098 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:16.128 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-13T17:12:16.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-13T17:12:16.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T17:12:16.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T17:12:16.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T17:12:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T17:12:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:12:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:12:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:12:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:16.366+0000 7f5dde343640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T17:12:19.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:12:19.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T17:12:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T17:12:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:12:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:12:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:12:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:19.336+0000 7f99f3e40640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T17:12:22.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:12:22.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.304+0000 7f43a4cef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T17:12:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.304+0000 7f43a4cef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T17:12:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.304+0000 7f43a4cef640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:12:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.304+0000 7f43a4cef640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:12:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.304+0000 7f43a4cef640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:12:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:22.305+0000 7f43a4cef640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T17:12:25.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:12:25.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.284+0000 7f418c214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.284+0000 7f418c214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.284+0000 7f418c214640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.284+0000 7f418c214640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.284+0000 7f418c214640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:12:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:25.285+0000 7f418c214640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T17:12:28.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:12:28.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:28.197 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:28.197 INFO:tasks.ceph:role: osd.4 2024-09-13T17:12:28.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:12:28.197 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:12:28.274 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:28.275 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:28.276 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:28.774 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-13T17:12:28.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-13T17:12:28.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:28.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:28.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:28.986 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:28.987 INFO:tasks.ceph:role: osd.5 2024-09-13T17:12:28.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:12:28.987 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:29.069 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:29.070 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:29.070 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:29.070 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:29.527 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-13T17:12:29.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-13T17:12:29.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:29.619 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:29.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T17:12:29.712 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:29.712 INFO:tasks.ceph:role: osd.6 2024-09-13T17:12:29.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:12:29.713 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:12:29.785 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:29.785 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:29.785 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:29.785 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:29.785 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:29.786 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:29.786 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:29.786 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:29.786 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:29.786 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:30.277 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-13T17:12:30.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-13T17:12:30.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T17:12:30.399 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T17:12:30.431 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T17:12:30.496 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:12:30.496 INFO:tasks.ceph:role: osd.7 2024-09-13T17:12:30.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:12:30.496 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:12:30.567 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:12:30.568 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:12:31.084 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-13T17:12:31.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-13T17:12:31.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T17:12:31.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T17:12:31.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:31.361 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T17:12:31.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T17:12:31.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:12:31.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:12:31.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:12:31.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:31.360+0000 7f2c6cfc5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T17:12:34.213 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:12:34.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:34.334 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.332+0000 7f135ea0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T17:12:34.334 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.333+0000 7f135ea0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T17:12:34.334 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.333+0000 7f135ea0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:12:34.334 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.333+0000 7f135ea0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:12:34.334 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.333+0000 7f135ea0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:12:34.335 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:34.333+0000 7f135ea0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T17:12:37.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:12:37.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:37.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.294+0000 7f3f6da2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T17:12:37.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.295+0000 7f3f6da2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T17:12:37.296 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.295+0000 7f3f6da2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:12:37.297 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.295+0000 7f3f6da2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:12:37.297 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.295+0000 7f3f6da2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:12:37.297 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:37.295+0000 7f3f6da2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T17:12:40.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T17:12:40.166 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.249+0000 7fb3f4620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.250+0000 7fb3f4620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.250+0000 7fb3f4620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.250+0000 7fb3f4620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.250+0000 7fb3f4620640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:12:40.252 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:40.250+0000 7fb3f4620640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T17:12:41.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:41.869 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:12:43.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T17:12:43.131 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T17:12:43.131 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T17:12:43.163 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T17:12:43.233 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T17:12:43.302 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T17:12:43.370 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T17:12:43.439 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T17:12:43.507 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:43.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T17:12:43.575 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.575 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T17:12:43.605 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.605 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T17:12:43.675 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T17:12:43.743 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T17:12:43.811 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T17:12:43.878 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T17:12:43.945 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:43.946 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T17:12:44.012 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:44.012 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T17:12:44.031 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:44.031 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T17:12:44.090 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:44.090 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T17:12:44.106 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:44.106 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T17:12:44.162 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T17:12:44.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:12:44.165 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:12:44.206 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-09-13T17:12:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w== 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-09-13T17:12:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA== 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A== 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg== 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ== 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw== 2024-09-13T17:12:44.208 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ== 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ== 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg== 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q== 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg== 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-09-13T17:12:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA== 2024-09-13T17:12:44.210 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2024-09-13T17:12:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ== 2024-09-13T17:12:44.226 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w== 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-09-13T17:12:44.227 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ== 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-09-13T17:12:44.228 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg== 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q== 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg== 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA== 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2024-09-13T17:12:44.229 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ== 2024-09-13T17:12:44.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:12:44.253 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:12:44.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.322 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.382 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.439 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:12:44.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:12:44.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:12:44.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.813 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:44.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:12:45.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.025 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.081 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:12:45.244 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T17:12:45.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T17:12:45.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:12:45.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T17:12:45.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T17:12:45.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:12:45.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T17:12:45.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T17:12:45.604 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:12:45.699 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T17:12:45.724 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:45.727 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:12:45.780 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T17:12:45.784 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T17:12:45.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T17:12:45.787 INFO:tasks.ceph.mon.a:Started 2024-09-13T17:12:45.787 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T17:12:45.787 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T17:12:45.823 INFO:tasks.ceph.mon.b:Started 2024-09-13T17:12:45.824 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T17:12:45.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T17:12:45.826 INFO:tasks.ceph.mon.c:Started 2024-09-13T17:12:45.826 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T17:12:45.826 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T17:12:45.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T17:12:45.828 INFO:tasks.ceph.mgr.y:Started 2024-09-13T17:12:45.828 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T17:12:45.829 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T17:12:45.830 INFO:tasks.ceph.mgr.x:Started 2024-09-13T17:12:45.830 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T17:12:45.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T17:12:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.933+0000 7f3687b0f640 1 Processor -- start 2024-09-13T17:12:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.933+0000 7f3687b0f640 1 -- start start 2024-09-13T17:12:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f3687b0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f3687b0f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368015ccc0 con 0x7f368006bd70 2024-09-13T17:12:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f3687b0f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368006f480 con 0x7f368015c8e0 2024-09-13T17:12:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f3687b0f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368006fa40 con 0x7f36800af400 2024-09-13T17:12:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36850aa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f368006bd70 0x7f36800ca960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41532/0 (socket says 172.21.15.5:41532) 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 learned_addr learned my addr 172.21.15.5:0/564889763 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:45.934+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:12:46.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.135+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.135+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:12:46.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.135+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:46.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.135+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:46.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.135+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:12:46.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.536+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.536+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:12:46.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.536+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:46.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.536+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:46.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:46.536+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:12:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:47.337+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:47.337+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:12:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:47.337+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:47.337+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:47.337+0000 7f36860ac640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 msgr2=0x7f36800d0e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.5:3300/0 conn(0x7f36800af400 0x7f36800d0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 >> v1:172.21.15.179:6789/0 conn(0x7f368015c8e0 legacy=0x7f368006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 >> v1:172.21.15.5:6789/0 conn(0x7f368006bd70 legacy=0x7f36800ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:48.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368006fa40 con 0x7f36640036e0 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3664008d20 con 0x7f3664006180 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.934+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:12:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:48.935+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:12:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:49.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.136+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:12:49.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:49.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:49.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:49.537+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:12:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.338+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.338+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.338+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:12:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.338+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.338+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.339+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:12:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.339+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T17:12:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.339+0000 7f36858ab640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:12:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.339+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:12:50.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:50.339+0000 7f36858ab640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:12:51.213 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.210+0000 7f325ad25040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:12:51.253 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.251+0000 7f325ad25040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:12:51.394 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.392+0000 7f325ad25040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:12:51.443 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.441+0000 7f325ad25040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:12:51.604 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.603+0000 7f325ad25040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:12:51.711 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:51.710+0000 7f325ad25040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:12:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 msgr2=0x7f3664008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:12:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664006180 0x7f3664008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 msgr2=0x7f3664005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:12:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f36640036e0 0x7f3664005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:51.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36860ac640 1 -- 172.21.15.5:0/564889763 reap_dead start 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f3664003b30 0x7f3664006610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368006b040 con 0x7f3664006b50 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3664008870 con 0x7f368015c8e0 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.934+0000 7f36777fe640 1 -- 172.21.15.5:0/564889763 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368006fa40 con 0x7f3664003b30 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.935+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> v2:172.21.15.179:3300/0 conn(0x7f3664003b30 0x7f3664006610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.935+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> v1:172.21.15.179:6789/0 conn(0x7f368015c8e0 legacy=0x7f366400b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.935+0000 7f36848a9640 1 -- 172.21.15.5:0/564889763 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931222509 0 0) 0x7f368006b040 con 0x7f3664006b50 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.935+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 >> v1:172.21.15.5:6789/0 conn(0x7f3664006b50 legacy=0x7f3664007000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.935+0000 7f36850aa640 1 -- 172.21.15.5:0/564889763 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640108a0 con 0x7f3664003b30 2024-09-13T17:12:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.936+0000 7f36850aa640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3664003b30 0x7f3664006610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3670007d20 tx=0x7f367002ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e751ff73d395220 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.936+0000 7f36848a9640 1 -- 172.21.15.5:0/564889763 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367002b710 con 0x7f3664003b30 2024-09-13T17:12:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.936+0000 7f36848a9640 1 -- 172.21.15.5:0/564889763 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367002f070 con 0x7f3664003b30 2024-09-13T17:12:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.936+0000 7f36848a9640 1 -- 172.21.15.5:0/564889763 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367002bad0 con 0x7f3664003b30 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 -- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3664003b30 msgr2=0x7f3664006610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3664003b30 0x7f3664006610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3670007d20 tx=0x7f367002ac10 comp rx=0 tx=0).stop 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 -- 172.21.15.5:0/564889763 shutdown_connections 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 --2- 172.21.15.5:0/564889763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3664003b30 0x7f3664006610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 -- 172.21.15.5:0/564889763 >> 172.21.15.5:0/564889763 conn(0x7f36800d0310 msgr2=0x7f36800d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 -- 172.21.15.5:0/564889763 shutdown_connections 2024-09-13T17:12:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.937+0000 7f3687b0f640 1 -- 172.21.15.5:0/564889763 wait complete. 2024-09-13T17:12:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.940+0000 7f3687b0f640 1 Processor -- start 2024-09-13T17:12:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.940+0000 7f3687b0f640 1 -- start start 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664003b30 0x7f368015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 0x7f36801e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 0x7f36801514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368015adc0 con 0x7f3664006b50 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800b50a0 con 0x7f368015c8e0 2024-09-13T17:12:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f3687b0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680159da0 con 0x7f3664003b30 2024-09-13T17:12:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f36850aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 0x7f36801e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f36860ac640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 0x7f36801514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f36850aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 0x7f36801e9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47694/0 (socket says 172.21.15.5:47694) 2024-09-13T17:12:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f36850aa640 1 -- 172.21.15.5:0/3908930787 learned_addr learned my addr 172.21.15.5:0/3908930787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:12:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.941+0000 7f36858ab640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664003b30 0x7f368015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 -- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664003b30 msgr2=0x7f368015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664003b30 0x7f368015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 -- 172.21.15.5:0/3908930787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 msgr2=0x7f36801e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 0x7f36801e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 -- 172.21.15.5:0/3908930787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367000f040 con 0x7f368015c8e0 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36860ac640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 0x7f36801514e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36800af7e0 tx=0x7f3678010590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:51.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678012ea0 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678010c70 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678003bd0 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368015a080 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.942+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36800b5380 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.943+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3678018770 con 0x7f368015c8e0 2024-09-13T17:12:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.943+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3678016ac0 con 0x7f368015c8e0 2024-09-13T17:12:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.943+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368015a5a0 con 0x7f368015c8e0 2024-09-13T17:12:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:51.948+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f367801c030 con 0x7f368015c8e0 2024-09-13T17:12:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.013+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3680066dc0 con 0x7f368015c8e0 2024-09-13T17:12:52.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.020+0000 7f36767fc640 1 -- 172.21.15.5:0/3908930787 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3678010e20 con 0x7f368015c8e0 2024-09-13T17:12:52.021 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-09-13T17:12:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 msgr2=0x7f36801514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 0x7f36801514e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36800af7e0 tx=0x7f3678010590 comp rx=0 tx=0).stop 2024-09-13T17:12:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 shutdown_connections 2024-09-13T17:12:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f368015c8e0 0x7f36801514e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3664006b50 0x7f36801e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 --2- 172.21.15.5:0/3908930787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3664003b30 0x7f368015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 >> 172.21.15.5:0/3908930787 conn(0x7f36800d0310 msgr2=0x7f36800cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 shutdown_connections 2024-09-13T17:12:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:52.021+0000 7f3687b0f640 1 -- 172.21.15.5:0/3908930787 wait complete. 2024-09-13T17:12:52.027 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.026+0000 7f008bf1a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:12:52.033 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T17:12:52.034 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T17:12:52.034 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:52.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T17:12:52.061 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:52.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T17:12:52.065 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:52.064+0000 7f325ad25040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:12:52.072 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.071+0000 7f008bf1a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:12:52.098 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:52.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T17:12:52.114 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:52.113+0000 7f325ad25040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:12:52.165 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:12:52.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T17:12:52.231 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:52.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T17:12:52.234 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.233+0000 7f008bf1a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:12:52.257 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:52.257 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T17:12:52.262 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:52.261+0000 7f325ad25040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:12:52.287 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:52.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T17:12:52.288 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.286+0000 7f008bf1a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:12:52.353 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:12:52.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T17:12:52.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 88246ab7-8144-43e9-8fcd-2bfd01c2526f 0 2024-09-13T17:12:52.459 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.458+0000 7f008bf1a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:12:52.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.554+0000 7f43940e9640 1 Processor -- start 2024-09-13T17:12:52.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 -- start start 2024-09-13T17:12:52.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0b5310 con 0x7f438c0b4ed0 2024-09-13T17:12:52.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c15eec0 con 0x7f438c15e700 2024-09-13T17:12:52.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.555+0000 7f43940e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1441e0 con 0x7f438c143e00 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4392686640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4392686640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52220/0 (socket says 172.21.15.179:52220) 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60710/0 (socket says 172.21.15.179:60710) 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4392686640 1 -- 172.21.15.179:0/2064915128 learned_addr learned my addr 172.21.15.179:0/2064915128 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391684640 1 --1- 172.21.15.179:0/2064915128 >> v1:172.21.15.179:6789/0 conn(0x7f438c0b4ed0 0x7f438c15dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45104/0 (socket says 172.21.15.179:45104) 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 -- 172.21.15.179:0/2064915128 >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 msgr2=0x7f438c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 --2- 172.21.15.179:0/2064915128 >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 -- 172.21.15.179:0/2064915128 >> v1:172.21.15.179:6789/0 conn(0x7f438c0b4ed0 legacy=0x7f438c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4391e85640 1 -- 172.21.15.179:0/2064915128 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0d0020 con 0x7f438c143e00 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4390e83640 1 -- 172.21.15.179:0/2064915128 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702848586 0 0) 0x7f437c001110 con 0x7f438c0b4ed0 2024-09-13T17:12:52.558 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.556+0000 7f4392686640 1 --2- 172.21.15.179:0/2064915128 >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f4391e85640 1 --2- 172.21.15.179:0/2064915128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c88b66944dccc0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f4390e83640 1 -- 172.21.15.179:0/2064915128 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438802ae50 con 0x7f438c143e00 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f4390e83640 1 -- 172.21.15.179:0/2064915128 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388032440 con 0x7f438c143e00 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f4390e83640 1 -- 172.21.15.179:0/2064915128 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43880327d0 con 0x7f438c143e00 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 -- 172.21.15.179:0/2064915128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 msgr2=0x7f438c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 --2- 172.21.15.179:0/2064915128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f43880097a0 tx=0x7f438802a100 comp rx=0 tx=0).stop 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 -- 172.21.15.179:0/2064915128 shutdown_connections 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 --2- 172.21.15.179:0/2064915128 >> v2:172.21.15.179:3300/0 conn(0x7f438c15e700 0x7f438c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 --2- 172.21.15.179:0/2064915128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c0cf9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.557+0000 7f43940e9640 1 -- 172.21.15.179:0/2064915128 >> 172.21.15.179:0/2064915128 conn(0x7f438c098a00 msgr2=0x7f438c0b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.558+0000 7f43940e9640 1 -- 172.21.15.179:0/2064915128 shutdown_connections 2024-09-13T17:12:52.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.558+0000 7f43940e9640 1 -- 172.21.15.179:0/2064915128 wait complete. 2024-09-13T17:12:52.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 Processor -- start 2024-09-13T17:12:52.561 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 -- start start 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438c0b4ed0 0x7f438c13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15b780 con 0x7f438c0b4ed0 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1403f0 con 0x7f438c15e700 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.559+0000 7f43940e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15ab20 con 0x7f438c143e00 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4391684640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4391684640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60716/0 (socket says 172.21.15.179:60716) 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52224/0 (socket says 172.21.15.179:52224) 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4391684640 1 -- 172.21.15.179:0/710865013 learned_addr learned my addr 172.21.15.179:0/710865013 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4391e85640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438c0b4ed0 0x7f438c13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 -- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 msgr2=0x7f438c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 -- 172.21.15.179:0/710865013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438c0b4ed0 msgr2=0x7f438c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438c0b4ed0 0x7f438c13feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 -- 172.21.15.179:0/710865013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384009b30 con 0x7f438c15e700 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4391684640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f4392686640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f438c0706b0 tx=0x7f438400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438400cc80 con 0x7f438c15e700 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400f040 con 0x7f438c15e700 2024-09-13T17:12:52.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4388009400 con 0x7f438c15e700 2024-09-13T17:12:52.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384014480 con 0x7f438c15e700 2024-09-13T17:12:52.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c15b0c0 con 0x7f438c15e700 2024-09-13T17:12:52.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f43840148e0 con 0x7f438c15e700 2024-09-13T17:12:52.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.560+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f438401da00 con 0x7f438c15e700 2024-09-13T17:12:52.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.561+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c15b8c0 con 0x7f438c15e700 2024-09-13T17:12:52.566 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.565+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f438c15b8c0 con 0x7f438c15e700 2024-09-13T17:12:52.574 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.573+0000 7f008bf1a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:12:52.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.632+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88246ab7-8144-43e9-8fcd-2bfd01c2526f", "id": 0} v 0) v1 -- 0x7f438c06cfe0 con 0x7f438c15e700 2024-09-13T17:12:52.637 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.636+0000 7f43827fc640 1 -- 172.21.15.179:0/710865013 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88246ab7-8144-43e9-8fcd-2bfd01c2526f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f438402c0b0 con 0x7f438c15e700 2024-09-13T17:12:52.637 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-09-13T17:12:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 msgr2=0x7f438c159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f438c0706b0 tx=0x7f438400ef90 comp rx=0 tx=0).stop 2024-09-13T17:12:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 shutdown_connections 2024-09-13T17:12:52.638 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f438c15e700 0x7f438c159b60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f438c143e00 0x7f438c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 --2- 172.21.15.179:0/710865013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f438c0b4ed0 0x7f438c13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 >> 172.21.15.179:0/710865013 conn(0x7f438c098a00 msgr2=0x7f438c0cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 shutdown_connections 2024-09-13T17:12:52.639 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.637+0000 7f43940e9640 1 -- 172.21.15.179:0/710865013 wait complete. 2024-09-13T17:12:52.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 2fdcc3ee-0538-4376-9494-e18ce97f3943 1 2024-09-13T17:12:52.746 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.745+0000 7f03b0296640 1 Processor -- start 2024-09-13T17:12:52.746 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.745+0000 7f03b0296640 1 -- start start 2024-09-13T17:12:52.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03b0296640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03a80ae130 0x7f03a80ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03b0296640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ad090 con 0x7f03a815c320 2024-09-13T17:12:52.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03b0296640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ad370 con 0x7f03a806eb90 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03b0296640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80ae580 con 0x7f03a80ae130 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ae833640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03a80ae130 0x7f03a80ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ad831640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f03a806eb90 0x7f03a815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45112/0 (socket says 172.21.15.179:45112) 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ad831640 1 -- 172.21.15.179:0/2530696977 learned_addr learned my addr 172.21.15.179:0/2530696977 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ae833640 1 -- 172.21.15.179:0/2530696977 >> v1:172.21.15.179:6789/0 conn(0x7f03a806eb90 legacy=0x7f03a815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ae833640 1 -- 172.21.15.179:0/2530696977 >> v1:172.21.15.5:6789/0 conn(0x7f03a815c320 legacy=0x7f03a806e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ad030640 1 -- 172.21.15.179:0/2530696977 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647352826 0 0) 0x7f03a80ad370 con 0x7f03a806eb90 2024-09-13T17:12:52.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.746+0000 7f03ae833640 1 -- 172.21.15.179:0/2530696977 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ad650 con 0x7f03a80ae130 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03ae833640 1 --2- 172.21.15.179:0/2530696977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a80ac9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009dc0 tx=0x7f03a002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22a922ed91c44801 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03ad030640 1 -- 172.21.15.179:0/2530696977 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0007740 con 0x7f03a80ae130 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03ad030640 1 -- 172.21.15.179:0/2530696977 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a002d050 con 0x7f03a80ae130 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03ad030640 1 -- 172.21.15.179:0/2530696977 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0007ac0 con 0x7f03a80ae130 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03b0296640 1 -- 172.21.15.179:0/2530696977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 msgr2=0x7f03a80ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.747+0000 7f03b0296640 1 --2- 172.21.15.179:0/2530696977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a80ac9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009dc0 tx=0x7f03a002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.748+0000 7f03b0296640 1 -- 172.21.15.179:0/2530696977 shutdown_connections 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.748+0000 7f03b0296640 1 --2- 172.21.15.179:0/2530696977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a80ac9b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.748+0000 7f03b0296640 1 -- 172.21.15.179:0/2530696977 >> 172.21.15.179:0/2530696977 conn(0x7f03a8071950 msgr2=0x7f03a8069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.748+0000 7f03b0296640 1 -- 172.21.15.179:0/2530696977 shutdown_connections 2024-09-13T17:12:52.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.748+0000 7f03b0296640 1 -- 172.21.15.179:0/2530696977 wait complete. 2024-09-13T17:12:52.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 Processor -- start 2024-09-13T17:12:52.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 -- start start 2024-09-13T17:12:52.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a806eb90 0x7f03a8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03a815c320 0x7f03a8158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8155270 con 0x7f03a806eb90 2024-09-13T17:12:52.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815e870 con 0x7f03a80ae130 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03b0296640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8155530 con 0x7f03a815c320 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.749+0000 7f03ad831640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52238/0 (socket says 172.21.15.179:52238) 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 -- 172.21.15.179:0/2517085754 learned_addr learned my addr 172.21.15.179:0/2517085754 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ae833640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03a815c320 0x7f03a8158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ae032640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a806eb90 0x7f03a8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 -- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03a815c320 msgr2=0x7f03a8158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03a815c320 0x7f03a8158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 -- 172.21.15.179:0/2517085754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a806eb90 msgr2=0x7f03a8151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a806eb90 0x7f03a8151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 -- 172.21.15.179:0/2517085754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009a70 con 0x7f03a80ae130 2024-09-13T17:12:52.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03ad831640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f039800c4a0 tx=0x7f039800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980074e0 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398007640 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a8155810 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398004a00 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8156550 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f039801d440 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.750+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0398012880 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.751+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8155d30 con 0x7f03a80ae130 2024-09-13T17:12:52.755 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.753+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f03a8155d30 con 0x7f03a80ae130 2024-09-13T17:12:52.823 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.822+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2fdcc3ee-0538-4376-9494-e18ce97f3943", "id": 1} v 0) v1 -- 0x7f03a815d700 con 0x7f03a80ae130 2024-09-13T17:12:52.826 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.825+0000 7f039effd640 1 -- 172.21.15.179:0/2517085754 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fdcc3ee-0538-4376-9494-e18ce97f3943", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0398018070 con 0x7f03a80ae130 2024-09-13T17:12:52.826 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:12:52.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 msgr2=0x7f03a8156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f039800c4a0 tx=0x7f039800c960 comp rx=0 tx=0).stop 2024-09-13T17:12:52.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 shutdown_connections 2024-09-13T17:12:52.827 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03a815c320 0x7f03a8158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03a80ae130 0x7f03a8156010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 --2- 172.21.15.179:0/2517085754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a806eb90 0x7f03a8151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 >> 172.21.15.179:0/2517085754 conn(0x7f03a8071950 msgr2=0x7f03a80afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 shutdown_connections 2024-09-13T17:12:52.828 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.826+0000 7f03b0296640 1 -- 172.21.15.179:0/2517085754 wait complete. 2024-09-13T17:12:52.838 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new a95f771e-3df2-42a8-935e-3fa6e1ef3845 2 2024-09-13T17:12:52.896 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.895+0000 7f008bf1a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:12:52.934 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.933+0000 7f385fd9c640 1 Processor -- start 2024-09-13T17:12:52.935 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.933+0000 7f385fd9c640 1 -- start start 2024-09-13T17:12:52.936 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385fd9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 0x7f385815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.936 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385fd9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f385806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.936 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385fd9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580b35f0 con 0x7f385806eb80 2024-09-13T17:12:52.936 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385fd9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3858160020 con 0x7f38580b1ac0 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385fd9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3858156f50 con 0x7f385806ef60 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385d337640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 0x7f385815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385db38640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f385806eb80 0x7f38580b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45118/0 (socket says 172.21.15.179:45118) 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385db38640 1 -- 172.21.15.179:0/3374759466 learned_addr learned my addr 172.21.15.179:0/3374759466 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385e339640 1 --2- 172.21.15.179:0/3374759466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f385806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385e339640 1 -- 172.21.15.179:0/3374759466 >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 msgr2=0x7f385815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385e339640 1 --2- 172.21.15.179:0/3374759466 >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 0x7f385815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385e339640 1 -- 172.21.15.179:0/3374759466 >> v1:172.21.15.179:6789/0 conn(0x7f385806eb80 legacy=0x7f38580b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385cb36640 1 -- 172.21.15.179:0/3374759466 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637524676 0 0) 0x7f38580b35f0 con 0x7f385806eb80 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385e339640 1 -- 172.21.15.179:0/3374759466 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580b1fa0 con 0x7f385806ef60 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.934+0000 7f385d337640 1 --2- 172.21.15.179:0/3374759466 >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 0x7f385815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.935+0000 7f385e339640 1 --2- 172.21.15.179:0/3374759466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f385806aea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3850009d90 tx=0x7f385002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea132349749a91fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.937 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.935+0000 7f385cb36640 1 -- 172.21.15.179:0/3374759466 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850007740 con 0x7f385806ef60 2024-09-13T17:12:52.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.935+0000 7f385cb36640 1 -- 172.21.15.179:0/3374759466 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385002d050 con 0x7f385806ef60 2024-09-13T17:12:52.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.935+0000 7f385cb36640 1 -- 172.21.15.179:0/3374759466 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850007ac0 con 0x7f385806ef60 2024-09-13T17:12:52.940 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 -- 172.21.15.179:0/3374759466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 msgr2=0x7f385806aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 --2- 172.21.15.179:0/3374759466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f385806aea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3850009d90 tx=0x7f385002a660 comp rx=0 tx=0).stop 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 -- 172.21.15.179:0/3374759466 shutdown_connections 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 --2- 172.21.15.179:0/3374759466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f385806aea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 --2- 172.21.15.179:0/3374759466 >> v2:172.21.15.179:3300/0 conn(0x7f38580b1ac0 0x7f385815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 -- 172.21.15.179:0/3374759466 >> 172.21.15.179:0/3374759466 conn(0x7f3858070af0 msgr2=0x7f3858070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 -- 172.21.15.179:0/3374759466 shutdown_connections 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.936+0000 7f385fd9c640 1 -- 172.21.15.179:0/3374759466 wait complete. 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.937+0000 7f385fd9c640 1 Processor -- start 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.937+0000 7f385fd9c640 1 -- start start 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385806eb80 0x7f38580cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.941 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 0x7f3858148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cd990 con 0x7f385806eb80 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3858157380 con 0x7f38580b1ac0 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580ce360 con 0x7f385806ef60 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385e339640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 0x7f3858148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60750/0 (socket says 172.21.15.179:60750) 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 -- 172.21.15.179:0/71051019 learned_addr learned my addr 172.21.15.179:0/71051019 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385db38640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385806eb80 0x7f38580cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 -- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 msgr2=0x7f3858148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 0x7f3858148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 -- 172.21.15.179:0/71051019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385806eb80 msgr2=0x7f38580cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385806eb80 0x7f38580cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:52.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 -- 172.21.15.179:0/71051019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009400 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385e339640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 0x7f3858148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385d337640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f384800e990 tx=0x7f384800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800c9e0 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800cb40 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3850009a70 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800ced0 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580cd060 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.938+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3848005c90 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.939+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3848013890 con 0x7f385806ef60 2024-09-13T17:12:52.943 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.939+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38580672e0 con 0x7f385806ef60 2024-09-13T17:12:52.944 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:52.941+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3848021060 con 0x7f385806ef60 2024-09-13T17:12:52.955 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:52.954+0000 7f008bf1a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:12:53.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.009+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a95f771e-3df2-42a8-935e-3fa6e1ef3845", "id": 2} v 0) v1 -- 0x7f385815ca30 con 0x7f385806ef60 2024-09-13T17:12:53.013 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.012+0000 7f384e7fc640 1 -- 172.21.15.179:0/71051019 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a95f771e-3df2-42a8-935e-3fa6e1ef3845", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3848017070 con 0x7f385806ef60 2024-09-13T17:12:53.014 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 msgr2=0x7f38580cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f384800e990 tx=0x7f384800ee50 comp rx=0 tx=0).stop 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 shutdown_connections 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580b1ac0 0x7f3858148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385806ef60 0x7f38580cde20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 --2- 172.21.15.179:0/71051019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385806eb80 0x7f38580cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 >> 172.21.15.179:0/71051019 conn(0x7f3858070af0 msgr2=0x7f385815e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 shutdown_connections 2024-09-13T17:12:53.015 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.013+0000 7f385fd9c640 1 -- 172.21.15.179:0/71051019 wait complete. 2024-09-13T17:12:53.025 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new a7c61a9d-e157-4f72-bee2-46c3e9787541 3 2024-09-13T17:12:53.110 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:53.109+0000 7f008bf1a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:12:53.124 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.123+0000 7f0506e9c640 1 Processor -- start 2024-09-13T17:12:53.124 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.123+0000 7f0506e9c640 1 -- start start 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0506e9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0500098a00 0x7f05000ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0506e9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000afce0 con 0x7f05000b0450 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0506e9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000cba80 con 0x7f05000ce980 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0506e9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0500099df0 con 0x7f0500098a00 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f04fffff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f05000ce980 0x7f05000cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45122/0 (socket says 172.21.15.179:45122) 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f04fffff640 1 -- 172.21.15.179:0/3446576600 learned_addr learned my addr 172.21.15.179:0/3446576600 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0504c38640 1 --2- 172.21.15.179:0/3446576600 >> v2:172.21.15.5:3300/0 conn(0x7f0500098a00 0x7f05000ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132758379 0 0) 0x7f05000cba80 con 0x7f05000ce980 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003520 con 0x7f05000ce980 2024-09-13T17:12:53.126 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0504c38640 1 -- 172.21.15.179:0/3446576600 >> v1:172.21.15.179:6789/0 conn(0x7f05000ce980 legacy=0x7f05000cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203765207 0 0) 0x7f05000afce0 con 0x7f05000b0450 2024-09-13T17:12:53.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0504c38640 1 -- 172.21.15.179:0/3446576600 >> v1:172.21.15.5:6789/0 conn(0x7f05000b0450 legacy=0x7f05000b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.124+0000 7f0504c38640 1 -- 172.21.15.179:0/3446576600 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000cbd60 con 0x7f0500098a00 2024-09-13T17:12:53.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.125+0000 7f0504c38640 1 --2- 172.21.15.179:0/3446576600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f05000ce440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f04f40097a0 tx=0x7f04f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85db6dfcfab896fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.125+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4032440 con 0x7f0500098a00 2024-09-13T17:12:53.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.125+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f40325a0 con 0x7f0500098a00 2024-09-13T17:12:53.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.125+0000 7f04ff7fe640 1 -- 172.21.15.179:0/3446576600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4032930 con 0x7f0500098a00 2024-09-13T17:12:53.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 -- 172.21.15.179:0/3446576600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 msgr2=0x7f05000ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 --2- 172.21.15.179:0/3446576600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f05000ce440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f04f40097a0 tx=0x7f04f402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 -- 172.21.15.179:0/3446576600 shutdown_connections 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 --2- 172.21.15.179:0/3446576600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f05000ce440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 -- 172.21.15.179:0/3446576600 >> 172.21.15.179:0/3446576600 conn(0x7f05000d0330 msgr2=0x7f05000d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 -- 172.21.15.179:0/3446576600 shutdown_connections 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.126+0000 7f0506e9c640 1 -- 172.21.15.179:0/3446576600 wait complete. 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.127+0000 7f0506e9c640 1 Processor -- start 2024-09-13T17:12:53.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.127+0000 7f0506e9c640 1 -- start start 2024-09-13T17:12:53.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f050014c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 0x7f05000c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c7400 con 0x7f0500098a00 2024-09-13T17:12:53.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c76e0 con 0x7f05000b0450 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0506e9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c79c0 con 0x7f05000ce980 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52270/0 (socket says 172.21.15.179:52270) 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 -- 172.21.15.179:0/2150068401 learned_addr learned my addr 172.21.15.179:0/2150068401 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0505439640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 0x7f05000c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0504c38640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f050014c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 -- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 msgr2=0x7f05000c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 0x7f05000c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 -- 172.21.15.179:0/2150068401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 msgr2=0x7f050014c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f050014c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 -- 172.21.15.179:0/2150068401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4009400 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f0505439640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 0x7f05000c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fffff640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c430 tx=0x7f04ec00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.128+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec005ce0 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec005e40 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000c7ca0 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0072f0 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000c8260 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f04ec01c440 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.129+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f04ec01cb80 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.130+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05000d0c70 con 0x7f05000b0450 2024-09-13T17:12:53.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.132+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f04ec017070 con 0x7f05000b0450 2024-09-13T17:12:53.200 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.199+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7c61a9d-e157-4f72-bee2-46c3e9787541", "id": 3} v 0) v1 -- 0x7f05000ce440 con 0x7f05000b0450 2024-09-13T17:12:53.203 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.202+0000 7f04fd7fa640 1 -- 172.21.15.179:0/2150068401 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7c61a9d-e157-4f72-bee2-46c3e9787541", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04ec01c7c0 con 0x7f05000b0450 2024-09-13T17:12:53.204 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 msgr2=0x7f05000c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c430 tx=0x7f04ec00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 shutdown_connections 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05000ce980 0x7f05000c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05000b0450 0x7f05000c8780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 --2- 172.21.15.179:0/2150068401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0500098a00 0x7f050014c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 >> 172.21.15.179:0/2150068401 conn(0x7f05000d0330 msgr2=0x7f05000b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 shutdown_connections 2024-09-13T17:12:53.205 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.203+0000 7f0506e9c640 1 -- 172.21.15.179:0/2150068401 wait complete. 2024-09-13T17:12:53.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 16465137-863c-4f89-83a2-43ee2ed6fb44 4 2024-09-13T17:12:53.300 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:53.299+0000 7f325ad25040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:12:53.311 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.310+0000 7fc6183b5640 1 Processor -- start 2024-09-13T17:12:53.311 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.310+0000 7fc6183b5640 1 -- start start 2024-09-13T17:12:53.312 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc6183b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc6100af400 0x7fc6100d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.312 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc6183b5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61015ccc0 con 0x7fc61006bd70 2024-09-13T17:12:53.312 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc6183b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61006f480 con 0x7fc61015c8e0 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc6183b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61006fa40 con 0x7fc6100af400 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616952640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc6100af400 0x7fc6100d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616151640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc61015c8e0 0x7fc61006b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45130/0 (socket says 172.21.15.179:45130) 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616151640 1 -- 172.21.15.179:0/3224043414 learned_addr learned my addr 172.21.15.179:0/3224043414 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616952640 1 -- 172.21.15.179:0/3224043414 >> v1:172.21.15.179:6789/0 conn(0x7fc61015c8e0 legacy=0x7fc61006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616952640 1 -- 172.21.15.179:0/3224043414 >> v1:172.21.15.5:6789/0 conn(0x7fc61006bd70 legacy=0x7fc6100ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.313 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.311+0000 7fc616952640 1 -- 172.21.15.179:0/3224043414 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61006b040 con 0x7fc6100af400 2024-09-13T17:12:53.314 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.312+0000 7fc616952640 1 --2- 172.21.15.179:0/3224043414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6100af400 0x7fc6100d0e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc608009d90 tx=0x7fc60802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5226b79b8f270050 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.314 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.312+0000 7fc61514f640 1 -- 172.21.15.179:0/3224043414 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007740 con 0x7fc6100af400 2024-09-13T17:12:53.314 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.312+0000 7fc61514f640 1 -- 172.21.15.179:0/3224043414 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60802d050 con 0x7fc6100af400 2024-09-13T17:12:53.314 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.312+0000 7fc61514f640 1 -- 172.21.15.179:0/3224043414 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007ac0 con 0x7fc6100af400 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 -- 172.21.15.179:0/3224043414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6100af400 msgr2=0x7fc6100d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 --2- 172.21.15.179:0/3224043414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6100af400 0x7fc6100d0e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc608009d90 tx=0x7fc60802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 -- 172.21.15.179:0/3224043414 shutdown_connections 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 --2- 172.21.15.179:0/3224043414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6100af400 0x7fc6100d0e30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 -- 172.21.15.179:0/3224043414 >> 172.21.15.179:0/3224043414 conn(0x7fc6100d0310 msgr2=0x7fc6100d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 -- 172.21.15.179:0/3224043414 shutdown_connections 2024-09-13T17:12:53.315 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.313+0000 7fc6183b5640 1 -- 172.21.15.179:0/3224043414 wait complete. 2024-09-13T17:12:53.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.314+0000 7fc6183b5640 1 Processor -- start 2024-09-13T17:12:53.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.314+0000 7fc6183b5640 1 -- start start 2024-09-13T17:12:53.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6100af400 0x7fc6101f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.317 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc61015c8e0 0x7fc6100ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610154bd0 con 0x7fc61015c8e0 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100b3fa0 con 0x7fc61006bd70 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc6183b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc610152880 con 0x7fc6100af400 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52286/0 (socket says 172.21.15.179:52286) 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 -- 172.21.15.179:0/2780103035 learned_addr learned my addr 172.21.15.179:0/2780103035 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc615950640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6100af400 0x7fc6101f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616952640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc61015c8e0 0x7fc6100ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 -- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6100af400 msgr2=0x7fc6101f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6100af400 0x7fc6101f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 -- 172.21.15.179:0/2780103035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc61015c8e0 msgr2=0x7fc6100ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc61015c8e0 0x7fc6100ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 -- 172.21.15.179:0/2780103035 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009a70 con 0x7fc61006bd70 2024-09-13T17:12:53.318 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc616151640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c480 tx=0x7fc60c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.315+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c005ce0 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c005e40 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0072f0 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc610152b60 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc610153120 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc60c01c440 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.316+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc60c012910 con 0x7fc61006bd70 2024-09-13T17:12:53.319 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.317+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6100d0e30 con 0x7fc61006bd70 2024-09-13T17:12:53.320 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.319+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc60c021060 con 0x7fc61006bd70 2024-09-13T17:12:53.354 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:53.353+0000 7f325ad25040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:12:53.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.386+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16465137-863c-4f89-83a2-43ee2ed6fb44", "id": 4} v 0) v1 -- 0x7fc6100b6230 con 0x7fc61006bd70 2024-09-13T17:12:53.390 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.389+0000 7fc606ffd640 1 -- 172.21.15.179:0/2780103035 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16465137-863c-4f89-83a2-43ee2ed6fb44", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc60c017070 con 0x7fc61006bd70 2024-09-13T17:12:53.391 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-09-13T17:12:53.392 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 msgr2=0x7fc6101522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.392 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c480 tx=0x7fc60c00c940 comp rx=0 tx=0).stop 2024-09-13T17:12:53.392 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 shutdown_connections 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc61015c8e0 0x7fc6100ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6100af400 0x7fc6101f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 --2- 172.21.15.179:0/2780103035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc61006bd70 0x7fc6101522a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 >> 172.21.15.179:0/2780103035 conn(0x7fc6100d0310 msgr2=0x7fc6100ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 shutdown_connections 2024-09-13T17:12:53.393 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.391+0000 7fc6183b5640 1 -- 172.21.15.179:0/2780103035 wait complete. 2024-09-13T17:12:53.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 6319a912-abd4-4259-b992-7aaed68bc6d6 5 2024-09-13T17:12:53.503 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.501+0000 7f8bc49ce640 1 Processor -- start 2024-09-13T17:12:53.503 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.501+0000 7f8bc49ce640 1 -- start start 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bc49ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 0x7f8bc00d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bc49ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc015ccc0 con 0x7f8bc00af400 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bc49ce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc006f480 con 0x7f8bc015c8e0 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bc49ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc006fa40 con 0x7f8bc006bd70 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bbdd9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 0x7f8bc00d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bbe59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8bc015c8e0 0x7f8bc006b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45144/0 (socket says 172.21.15.179:45144) 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.502+0000 7f8bbe59c640 1 -- 172.21.15.179:0/3655649342 learned_addr learned my addr 172.21.15.179:0/3655649342 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.503+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/3655649342 >> v1:172.21.15.179:6789/0 conn(0x7f8bc015c8e0 legacy=0x7f8bc006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.503+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/3655649342 >> v1:172.21.15.5:6789/0 conn(0x7f8bc00af400 legacy=0x7f8bc00ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:53.505 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.503+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/3655649342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc006b040 con 0x7f8bc006bd70 2024-09-13T17:12:53.506 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.503+0000 7f8bbdd9b640 1 --2- 172.21.15.179:0/3655649342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 0x7f8bc00d0e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097d0 tx=0x7f8ba802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98708c682864779e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.506 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bbd59a640 1 -- 172.21.15.179:0/3655649342 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8032440 con 0x7f8bc006bd70 2024-09-13T17:12:53.506 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bbd59a640 1 -- 172.21.15.179:0/3655649342 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba80325a0 con 0x7f8bc006bd70 2024-09-13T17:12:53.506 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bbd59a640 1 -- 172.21.15.179:0/3655649342 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8032930 con 0x7f8bc006bd70 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 -- 172.21.15.179:0/3655649342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 msgr2=0x7f8bc00d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/3655649342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 0x7f8bc00d0e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097d0 tx=0x7f8ba802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 -- 172.21.15.179:0/3655649342 shutdown_connections 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/3655649342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc006bd70 0x7f8bc00d0e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 -- 172.21.15.179:0/3655649342 >> 172.21.15.179:0/3655649342 conn(0x7f8bc00d0310 msgr2=0x7f8bc00d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.507 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 -- 172.21.15.179:0/3655649342 shutdown_connections 2024-09-13T17:12:53.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.504+0000 7f8bc49ce640 1 -- 172.21.15.179:0/3655649342 wait complete. 2024-09-13T17:12:53.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 Processor -- start 2024-09-13T17:12:53.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 -- start start 2024-09-13T17:12:53.510 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 0x7f8bc01553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.510 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.510 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc015c8e0 0x7f8bc01570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00afd90 con 0x7f8bc015c8e0 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00b0070 con 0x7f8bc006bd70 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bc49ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00b0350 con 0x7f8bc00af400 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bbdd9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.506+0000 7f8bbe59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 0x7f8bc01553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60800/0 (socket says 172.21.15.179:60800) 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbe59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 0x7f8bc01553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:52302/0 (socket says 172.21.15.179:52302) 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/461793831 learned_addr learned my addr 172.21.15.179:0/461793831 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbed9d640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc015c8e0 0x7f8bc01570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 msgr2=0x7f8bc01553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 0x7f8bc01553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/461793831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc015c8e0 msgr2=0x7f8bc01570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc015c8e0 0x7f8bc01570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 -- 172.21.15.179:0/461793831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009400 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bbdd9b640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097d0 tx=0x7f8ba80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8030b80 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba8030d00 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc00b0630 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba803b640 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0155e00 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8ba8039040 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.507+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8ba8047ac0 con 0x7f8bc00af400 2024-09-13T17:12:53.512 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.508+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc00b0b50 con 0x7f8bc00af400 2024-09-13T17:12:53.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.512+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8bc00b0b50 con 0x7f8bc00af400 2024-09-13T17:12:53.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.580+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6319a912-abd4-4259-b992-7aaed68bc6d6", "id": 5} v 0) v1 -- 0x7f8bc00d0e30 con 0x7f8bc00af400 2024-09-13T17:12:53.584 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.583+0000 7f8bb6ffd640 1 -- 172.21.15.179:0/461793831 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6319a912-abd4-4259-b992-7aaed68bc6d6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ba804c060 con 0x7f8bc00af400 2024-09-13T17:12:53.584 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-09-13T17:12:53.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 msgr2=0x7f8bc00c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097d0 tx=0x7f8ba80046c0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 shutdown_connections 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc015c8e0 0x7f8bc01570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bc00af400 0x7f8bc00c4190 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 --2- 172.21.15.179:0/461793831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bc006bd70 0x7f8bc01553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 >> 172.21.15.179:0/461793831 conn(0x7f8bc00d0310 msgr2=0x7f8bc00ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 shutdown_connections 2024-09-13T17:12:53.586 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.584+0000 7f8bc49ce640 1 -- 172.21.15.179:0/461793831 wait complete. 2024-09-13T17:12:53.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 8de296e9-c643-45b8-9721-56700e58451c 6 2024-09-13T17:12:53.694 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.692+0000 7f564e145640 1 Processor -- start 2024-09-13T17:12:53.694 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 -- start start 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5648146150 0x7f56480b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564815cfb0 con 0x7f564806a3d0 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564806a860 con 0x7f5648146150 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f564e145640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564815d290 con 0x7f56480b4130 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.693+0000 7f5646ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60810/0 (socket says 172.21.15.179:60810) 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 -- 172.21.15.179:0/2781838295 learned_addr learned my addr 172.21.15.179:0/2781838295 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f56477fe640 1 --2- 172.21.15.179:0/2781838295 >> v2:172.21.15.5:3300/0 conn(0x7f5648146150 0x7f56480b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 -- 172.21.15.179:0/2781838295 >> v2:172.21.15.5:3300/0 conn(0x7f5648146150 msgr2=0x7f56480b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:53.696 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 --2- 172.21.15.179:0/2781838295 >> v2:172.21.15.5:3300/0 conn(0x7f5648146150 0x7f56480b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 -- 172.21.15.179:0/2781838295 >> v1:172.21.15.5:6789/0 conn(0x7f564806a3d0 legacy=0x7f56480cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 -- 172.21.15.179:0/2781838295 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564815d570 con 0x7f56480b4130 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.694+0000 7f5646ffd640 1 --2- 172.21.15.179:0/2781838295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f563002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450c3238b33abb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f56467fc640 1 -- 172.21.15.179:0/2781838295 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630032440 con 0x7f56480b4130 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f56467fc640 1 -- 172.21.15.179:0/2781838295 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300325a0 con 0x7f56480b4130 2024-09-13T17:12:53.697 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f56467fc640 1 -- 172.21.15.179:0/2781838295 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630032930 con 0x7f56480b4130 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 -- 172.21.15.179:0/2781838295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 msgr2=0x7f5648069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 --2- 172.21.15.179:0/2781838295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5630009870 tx=0x7f563002a210 comp rx=0 tx=0).stop 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 -- 172.21.15.179:0/2781838295 shutdown_connections 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 --2- 172.21.15.179:0/2781838295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56480b4130 0x7f5648069e90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 --2- 172.21.15.179:0/2781838295 >> v2:172.21.15.5:3300/0 conn(0x7f5648146150 0x7f56480b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 -- 172.21.15.179:0/2781838295 >> 172.21.15.179:0/2781838295 conn(0x7f5648098a00 msgr2=0x7f56480b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.698 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 -- 172.21.15.179:0/2781838295 shutdown_connections 2024-09-13T17:12:53.699 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.695+0000 7f564e145640 1 -- 172.21.15.179:0/2781838295 wait complete. 2024-09-13T17:12:53.699 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.696+0000 7f564e145640 1 Processor -- start 2024-09-13T17:12:53.699 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 -- start start 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56480b4130 0x7f564809c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 0x7f564809cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648099400 con 0x7f56480b4130 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564813f6d0 con 0x7f5648146150 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f564e145640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564809d1d0 con 0x7f564806a3d0 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.697+0000 7f56477fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.701 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60822/0 (socket says 172.21.15.179:60822) 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 -- 172.21.15.179:0/4071173116 learned_addr learned my addr 172.21.15.179:0/4071173116 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f5647fff640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 0x7f564809cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f5646ffd640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56480b4130 0x7f564809c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 -- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 msgr2=0x7f564809cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 0x7f564809cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 -- 172.21.15.179:0/4071173116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56480b4130 msgr2=0x7f564809c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56480b4130 0x7f564809c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 -- 172.21.15.179:0/4071173116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300094d0 con 0x7f564806a3d0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f5647fff640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 0x7f564809cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f56477fe640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f563800d620 tx=0x7f563800dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800b620 con 0x7f564806a3d0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800b780 con 0x7f564806a3d0 2024-09-13T17:12:53.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800bb30 con 0x7f564806a3d0 2024-09-13T17:12:53.703 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564815cd80 con 0x7f564806a3d0 2024-09-13T17:12:53.703 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56480ad450 con 0x7f564806a3d0 2024-09-13T17:12:53.703 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f563801e460 con 0x7f564806a3d0 2024-09-13T17:12:53.703 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.698+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5638014ac0 con 0x7f564806a3d0 2024-09-13T17:12:53.703 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.699+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648071dc0 con 0x7f564806a3d0 2024-09-13T17:12:53.704 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.703+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5638014d60 con 0x7f564806a3d0 2024-09-13T17:12:53.747 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:53.746+0000 7f325ad25040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:12:53.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.769+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8de296e9-c643-45b8-9721-56700e58451c", "id": 6} v 0) v1 -- 0x7f5648069e90 con 0x7f564806a3d0 2024-09-13T17:12:53.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.772+0000 7f563ffff640 1 -- 172.21.15.179:0/4071173116 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8de296e9-c643-45b8-9721-56700e58451c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f56380144d0 con 0x7f564806a3d0 2024-09-13T17:12:53.773 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 msgr2=0x7f564815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f563800d620 tx=0x7f563800dae0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 shutdown_connections 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5648146150 0x7f564809cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56480b4130 0x7f564809c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 --2- 172.21.15.179:0/4071173116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564806a3d0 0x7f564815c020 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 >> 172.21.15.179:0/4071173116 conn(0x7f5648098a00 msgr2=0x7f56480b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 shutdown_connections 2024-09-13T17:12:53.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.773+0000 7f564e145640 1 -- 172.21.15.179:0/4071173116 wait complete. 2024-09-13T17:12:53.784 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d06961fe-67f5-4910-b533-4b0e69b816ab 7 2024-09-13T17:12:53.836 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:53.835+0000 7f325ad25040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:12:53.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.881+0000 7efd4e227640 1 Processor -- start 2024-09-13T17:12:53.882 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.881+0000 7efd4e227640 1 -- start start 2024-09-13T17:12:53.883 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd4e227640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd480cfbc0 0x7efd48099110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.883 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd4e227640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.883 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd4e227640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4806e3b0 con 0x7efd4815a6b0 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd4e227640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4806e690 con 0x7efd480cfbc0 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd4e227640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4806e970 con 0x7efd480caf20 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60830/0 (socket says 172.21.15.179:60830) 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 -- 172.21.15.179:0/2682710389 learned_addr learned my addr 172.21.15.179:0/2682710389 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd46ffd640 1 --2- 172.21.15.179:0/2682710389 >> v2:172.21.15.5:3300/0 conn(0x7efd480cfbc0 0x7efd48099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 -- 172.21.15.179:0/2682710389 >> v2:172.21.15.5:3300/0 conn(0x7efd480cfbc0 msgr2=0x7efd48099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 --2- 172.21.15.179:0/2682710389 >> v2:172.21.15.5:3300/0 conn(0x7efd480cfbc0 0x7efd48099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 -- 172.21.15.179:0/2682710389 >> v1:172.21.15.5:6789/0 conn(0x7efd4815a6b0 legacy=0x7efd48098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.884 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.882+0000 7efd47fff640 1 -- 172.21.15.179:0/2682710389 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480ce3b0 con 0x7efd480caf20 2024-09-13T17:12:53.885 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.883+0000 7efd47fff640 1 --2- 172.21.15.179:0/2682710389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd40009e50 tx=0x7efd4002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbb7d98c97b6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.883+0000 7efd467fc640 1 -- 172.21.15.179:0/2682710389 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4002aea0 con 0x7efd480caf20 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.883+0000 7efd467fc640 1 -- 172.21.15.179:0/2682710389 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4002d050 con 0x7efd480caf20 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.883+0000 7efd467fc640 1 -- 172.21.15.179:0/2682710389 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40031820 con 0x7efd480caf20 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 -- 172.21.15.179:0/2682710389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 msgr2=0x7efd480cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 --2- 172.21.15.179:0/2682710389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd40009e50 tx=0x7efd4002a680 comp rx=0 tx=0).stop 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 -- 172.21.15.179:0/2682710389 shutdown_connections 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 --2- 172.21.15.179:0/2682710389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd480cb370 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 --2- 172.21.15.179:0/2682710389 >> v2:172.21.15.5:3300/0 conn(0x7efd480cfbc0 0x7efd48099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 -- 172.21.15.179:0/2682710389 >> 172.21.15.179:0/2682710389 conn(0x7efd480d0310 msgr2=0x7efd480d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 -- 172.21.15.179:0/2682710389 shutdown_connections 2024-09-13T17:12:53.886 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.884+0000 7efd4e227640 1 -- 172.21.15.179:0/2682710389 wait complete. 2024-09-13T17:12:53.888 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.885+0000 7efd4e227640 1 Processor -- start 2024-09-13T17:12:53.888 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.885+0000 7efd4e227640 1 -- start start 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd480cfbc0 0x7efd480adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd4815a6b0 0x7efd480ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481e5980 con 0x7efd4815a6b0 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481df920 con 0x7efd480cfbc0 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd4e227640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481dfc00 con 0x7efd480caf20 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd46ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd480cfbc0 0x7efd480adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:60834/0 (socket says 172.21.15.179:60834) 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 -- 172.21.15.179:0/3322308971 learned_addr learned my addr 172.21.15.179:0/3322308971 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd47fff640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd4815a6b0 0x7efd480ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:53.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 -- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd480cfbc0 msgr2=0x7efd480adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd480cfbc0 0x7efd480adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 -- 172.21.15.179:0/3322308971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd4815a6b0 msgr2=0x7efd480ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd4815a6b0 0x7efd480ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 -- 172.21.15.179:0/3322308971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40009b30 con 0x7efd480caf20 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.886+0000 7efd477fe640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c450 tx=0x7efd3800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380052d0 con 0x7efd480caf20 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38005430 con 0x7efd480caf20 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481dfee0 con 0x7efd480caf20 2024-09-13T17:12:53.890 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38012870 con 0x7efd480caf20 2024-09-13T17:12:53.891 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481597a0 con 0x7efd480caf20 2024-09-13T17:12:53.891 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7efd38012cd0 con 0x7efd480caf20 2024-09-13T17:12:53.891 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.887+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7efd3801ba60 con 0x7efd480caf20 2024-09-13T17:12:53.891 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.888+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd480d0080 con 0x7efd480caf20 2024-09-13T17:12:53.891 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.890+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7efd3801b400 con 0x7efd480caf20 2024-09-13T17:12:53.957 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:53.956+0000 7f325ad25040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:12:53.970 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.969+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d06961fe-67f5-4910-b533-4b0e69b816ab", "id": 7} v 0) v1 -- 0x7efd48098a00 con 0x7efd480caf20 2024-09-13T17:12:53.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.972+0000 7efd2ffff640 1 -- 172.21.15.179:0/3322308971 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d06961fe-67f5-4910-b533-4b0e69b816ab", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7efd3802a0b0 con 0x7efd480caf20 2024-09-13T17:12:53.973 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-09-13T17:12:53.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 msgr2=0x7efd48159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:53.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c450 tx=0x7efd3800c910 comp rx=0 tx=0).stop 2024-09-13T17:12:53.974 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 shutdown_connections 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd4815a6b0 0x7efd480ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd480cfbc0 0x7efd480adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 --2- 172.21.15.179:0/3322308971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd480caf20 0x7efd48159260 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 >> 172.21.15.179:0/3322308971 conn(0x7efd480d0310 msgr2=0x7efd480ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 shutdown_connections 2024-09-13T17:12:53.975 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-13T17:12:53.973+0000 7efd4e227640 1 -- 172.21.15.179:0/3322308971 wait complete. 2024-09-13T17:12:53.985 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T17:12:53.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T17:12:53.987 INFO:tasks.ceph.osd.0:Started 2024-09-13T17:12:53.987 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T17:12:53.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T17:12:53.989 INFO:tasks.ceph.osd.1:Started 2024-09-13T17:12:53.989 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T17:12:53.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T17:12:53.991 INFO:tasks.ceph.osd.2:Started 2024-09-13T17:12:53.991 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T17:12:53.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T17:12:53.994 INFO:tasks.ceph.osd.3:Started 2024-09-13T17:12:53.994 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T17:12:53.994 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T17:12:53.996 INFO:tasks.ceph.osd.4:Started 2024-09-13T17:12:53.996 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T17:12:53.996 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T17:12:53.998 INFO:tasks.ceph.osd.5:Started 2024-09-13T17:12:53.998 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T17:12:53.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T17:12:54.000 INFO:tasks.ceph.osd.6:Started 2024-09-13T17:12:54.001 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T17:12:54.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T17:12:54.003 INFO:tasks.ceph.osd.7:Started 2024-09-13T17:12:54.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:12:54.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.007+0000 7f325ad25040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:12:54.119 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.118+0000 7f008bf1a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:12:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.128+0000 7f8f2a9ed640 1 Processor -- start 2024-09-13T17:12:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.128+0000 7f8f2a9ed640 1 -- start start 2024-09-13T17:12:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f2a9ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f2a9ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f240d1e80 con 0x7f8f2415c810 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f2a9ed640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f240d1750 con 0x7f8f240b4cf0 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f2a9ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240d0bd0 con 0x7f8f240d06d0 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f23fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f2415c810 0x7f8f240b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47890/0 (socket says 172.21.15.5:47890) 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f23fff640 1 -- 172.21.15.5:0/1247891963 learned_addr learned my addr 172.21.15.5:0/1247891963 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f28f8a640 1 --2- 172.21.15.5:0/1247891963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737686141 0 0) 0x7f8f240d1e80 con 0x7f8f2415c810 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c003520 con 0x7f8f2415c810 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079866492 0 0) 0x7f8f240d1750 con 0x7f8f240b4cf0 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f240d1e80 con 0x7f8f240b4cf0 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f28f8a640 1 -- 172.21.15.5:0/1247891963 >> v1:172.21.15.179:6789/0 conn(0x7f8f240b4cf0 legacy=0x7f8f240b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f28f8a640 1 -- 172.21.15.5:0/1247891963 >> v1:172.21.15.5:6789/0 conn(0x7f8f2415c810 legacy=0x7f8f240b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.129+0000 7f8f28f8a640 1 -- 172.21.15.5:0/1247891963 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240d0eb0 con 0x7f8f240d06d0 2024-09-13T17:12:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.130+0000 7f8f28f8a640 1 --2- 172.21.15.5:0/1247891963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240cd780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009dc0 tx=0x7f8f1c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1eb68a564ca61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.130+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c007740 con 0x7f8f240d06d0 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.130+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c02d050 con 0x7f8f240d06d0 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.130+0000 7f8f22ffd640 1 -- 172.21.15.5:0/1247891963 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c007ac0 con 0x7f8f240d06d0 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1247891963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 msgr2=0x7f8f240cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1247891963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240cd780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009dc0 tx=0x7f8f1c02a6d0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1247891963 shutdown_connections 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1247891963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240cd780 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1247891963 >> 172.21.15.5:0/1247891963 conn(0x7f8f240717a0 msgr2=0x7f8f24071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1247891963 shutdown_connections 2024-09-13T17:12:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.131+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1247891963 wait complete. 2024-09-13T17:12:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.132+0000 7f8f2a9ed640 1 Processor -- start 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.132+0000 7f8f2a9ed640 1 -- start start 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48518/0 (socket says 172.21.15.5:48518) 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f23fff640 1 -- 172.21.15.5:0/1415187908 learned_addr learned my addr 172.21.15.5:0/1415187908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2415c810 0x7f8f241f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f241efc70 con 0x7f8f240b4cf0 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240c6230 con 0x7f8f2415c810 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.133+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f241f2cb0 con 0x7f8f240d06d0 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f28f8a640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2415c810 0x7f8f241f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f237fe640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 -- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 msgr2=0x7f8f240c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 -- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2415c810 msgr2=0x7f8f241f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2415c810 0x7f8f241f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c009a70 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f237fe640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f23fff640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c410 tx=0x7f8f1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14005ce0 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14005e40 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f140072d0 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f241f2f90 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.134+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f240c6760 con 0x7f8f240b4cf0 2024-09-13T17:12:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.135+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8f1401c440 con 0x7f8f240b4cf0 2024-09-13T17:12:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.135+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8f14012ad0 con 0x7f8f240b4cf0 2024-09-13T17:12:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.135+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f240672a0 con 0x7f8f240b4cf0 2024-09-13T17:12:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.137+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8f14021060 con 0x7f8f240b4cf0 2024-09-13T17:12:54.142 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.141+0000 7f325ad25040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:12:54.174 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.173+0000 7f008bf1a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:12:54.194 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.193+0000 7f325ad25040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:12:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.196+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f240cd780 con 0x7f8f240b4cf0 2024-09-13T17:12:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.196+0000 7f8f20ff9640 1 -- 172.21.15.5:0/1415187908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8f14017070 con 0x7f8f240b4cf0 2024-09-13T17:12:54.197 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:12:54.198 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:12:53.970777+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:12:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 msgr2=0x7f8f241ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c410 tx=0x7f8f1400c8d0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 shutdown_connections 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2415c810 0x7f8f241f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f240d06d0 0x7f8f240c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 --2- 172.21.15.5:0/1415187908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f240b4cf0 0x7f8f241ef730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 >> 172.21.15.5:0/1415187908 conn(0x7f8f240717a0 msgr2=0x7f8f2415d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 shutdown_connections 2024-09-13T17:12:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:12:54.197+0000 7f8f2a9ed640 1 -- 172.21.15.5:0/1415187908 wait complete. 2024-09-13T17:12:54.209 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T17:12:54.209 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T17:12:54.238 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.237+0000 7f325ad25040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:12:54.348 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.347+0000 7f325ad25040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:12:54.399 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.398+0000 7f325ad25040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:12:54.450 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.449+0000 7f325ad25040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:12:54.516 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.514+0000 7f325ad25040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:12:54.559 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.558+0000 7f325ad25040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:12:54.561 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.560+0000 7f008bf1a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:12:54.594 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-13T17:12:54.593+0000 7fe37412b640 -1 Falling back to public interface 2024-09-13T17:12:54.602 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-13T17:12:54.601+0000 7fbb59c1b640 -1 Falling back to public interface 2024-09-13T17:12:54.603 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:54.603+0000 7f325ad25040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:12:54.613 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-13T17:12:54.612+0000 7f7d712fe640 -1 Falling back to public interface 2024-09-13T17:12:54.615 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-13T17:12:54.614+0000 7f23e57db640 -1 Falling back to public interface 2024-09-13T17:12:54.616 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-13T17:12:54.614+0000 7fe0abf29640 -1 Falling back to public interface 2024-09-13T17:12:54.616 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-13T17:12:54.615+0000 7fd3d4f1b640 -1 Falling back to public interface 2024-09-13T17:12:54.622 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-13T17:12:54.621+0000 7ffb92010640 -1 Falling back to public interface 2024-09-13T17:12:54.622 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-13T17:12:54.621+0000 7f2b4feb2640 -1 Falling back to public interface 2024-09-13T17:12:54.623 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-13T17:12:54.622+0000 7ffb908b1640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-09-13T17:12:54.652 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.651+0000 7f008bf1a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:12:54.762 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.761+0000 7f008bf1a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:12:54.811 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.810+0000 7f008bf1a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:12:54.926 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.925+0000 7f008bf1a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:12:54.982 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:54.980+0000 7f008bf1a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:12:55.015 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:12:55.029 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.028+0000 7f008bf1a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:12:55.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.107+0000 7f786dd1f640 1 Processor -- start 2024-09-13T17:12:55.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.107+0000 7f786dd1f640 1 -- start start 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f786dd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f78680ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f786dd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f786806b9f0 0x7f78680cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f786dd1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786806c440 con 0x7f78680cefc0 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f786dd1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786806be80 con 0x7f786806b9f0 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f786dd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786806c160 con 0x7f786815c6a0 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f786806b9f0 0x7f78680cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f786806b9f0 0x7f78680cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48528/0 (socket says 172.21.15.5:48528) 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7867fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78680cefc0 0x7f7868098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47900/0 (socket says 172.21.15.5:47900) 2024-09-13T17:12:55.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 -- 172.21.15.5:0/173026734 learned_addr learned my addr 172.21.15.5:0/173026734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f78677fe640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f78680ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 -- 172.21.15.5:0/173026734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 msgr2=0x7f78680ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f78680ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 -- 172.21.15.5:0/173026734 >> v1:172.21.15.5:6789/0 conn(0x7f78680cefc0 legacy=0x7f7868098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f78667fc640 1 -- 172.21.15.5:0/173026734 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118813303 0 0) 0x7f7860001490 con 0x7f78680cefc0 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.108+0000 7f7866ffd640 1 -- 172.21.15.5:0/173026734 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680caaf0 con 0x7f786806b9f0 2024-09-13T17:12:55.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.109+0000 7f7866ffd640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786806b9f0 0x7f78680cea80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1ab5580085d77c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:55.114 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.109+0000 7f78667fc640 1 -- 172.21.15.5:0/173026734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c032440 con 0x7f786806b9f0 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.109+0000 7f78667fc640 1 -- 172.21.15.5:0/173026734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0325a0 con 0x7f786806b9f0 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.109+0000 7f78667fc640 1 -- 172.21.15.5:0/173026734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c032930 con 0x7f786806b9f0 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 -- 172.21.15.5:0/173026734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786806b9f0 msgr2=0x7f78680cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786806b9f0 0x7f78680cea80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c02a270 comp rx=0 tx=0).stop 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 -- 172.21.15.5:0/173026734 shutdown_connections 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786806b9f0 0x7f78680cea80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 --2- 172.21.15.5:0/173026734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f78680ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 -- 172.21.15.5:0/173026734 >> 172.21.15.5:0/173026734 conn(0x7f78680b1df0 msgr2=0x7f78680b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 -- 172.21.15.5:0/173026734 shutdown_connections 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.110+0000 7f786dd1f640 1 -- 172.21.15.5:0/173026734 wait complete. 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.111+0000 7f786dd1f640 1 Processor -- start 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.111+0000 7f786dd1f640 1 -- start start 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.115 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f7868156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7868156780 0x7f7868154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681540a0 con 0x7f78680cefc0 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680b3a60 con 0x7f7868156780 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f786dd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7868156c40 con 0x7f786815c6a0 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f78677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f78677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48532/0 (socket says 172.21.15.5:48532) 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f78677fe640 1 -- 172.21.15.5:0/1103698796 learned_addr learned my addr 172.21.15.5:0/1103698796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f7866ffd640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f7868156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.112+0000 7f7867fff640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7868156780 0x7f7868154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 -- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 msgr2=0x7f7868156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f7868156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 -- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7868156780 msgr2=0x7f7868154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.116 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7868156780 0x7f7868154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 -- 172.21.15.5:0/1103698796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0094d0 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f78677fe640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f785800e930 tx=0x7f785800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858009690 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800ca00 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7868156f20 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800cdb0 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78681574e0 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7858013770 con 0x7f78680cefc0 2024-09-13T17:12:55.117 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.113+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7858012aa0 con 0x7f78680cefc0 2024-09-13T17:12:55.118 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.114+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78680ce540 con 0x7f78680cefc0 2024-09-13T17:12:55.118 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.116+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7858021060 con 0x7f78680cefc0 2024-09-13T17:12:55.148 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.147+0000 7f008bf1a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:12:55.176 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.175+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f786806eed0 con 0x7f78680cefc0 2024-09-13T17:12:55.177 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.176+0000 7f784ffff640 1 -- 172.21.15.5:0/1103698796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f785802a090 con 0x7f78680cefc0 2024-09-13T17:12:55.177 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-13T17:12:55.177 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:12:53.970777+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 msgr2=0x7f78681f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f785800e930 tx=0x7f785800edf0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 shutdown_connections 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7868156780 0x7f7868154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f786815c6a0 0x7f7868156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 --2- 172.21.15.5:0/1103698796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78680cefc0 0x7f78681f2780 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.178 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 >> 172.21.15.5:0/1103698796 conn(0x7f78680b1df0 msgr2=0x7f78680cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:55.179 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 shutdown_connections 2024-09-13T17:12:55.179 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:12:55.177+0000 7f786dd1f640 1 -- 172.21.15.5:0/1103698796 wait complete. 2024-09-13T17:12:55.187 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:12:55.201 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.200+0000 7f008bf1a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:12:55.244 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:55.243+0000 7f325ad25040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:12:55.255 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.254+0000 7f008bf1a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:12:55.328 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.327+0000 7f008bf1a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:12:55.374 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.373+0000 7f008bf1a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:12:55.420 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:55.419+0000 7f008bf1a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:12:56.091 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-13T17:12:56.091+0000 7f008bf1a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:12:56.259 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:56.258+0000 7f31fb67e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:12:56.260 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-13T17:12:56.258+0000 7f31fb67e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:12:58.075 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-13T17:12:58.074+0000 7fe37412b640 -1 osd.4 0 log_to_monitors true 2024-09-13T17:12:58.086 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-13T17:12:58.086+0000 7ffb92010640 -1 osd.0 0 log_to_monitors true 2024-09-13T17:12:58.133 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-13T17:12:58.131+0000 7fbb59c1b640 -1 osd.6 0 log_to_monitors true 2024-09-13T17:12:58.144 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-13T17:12:58.143+0000 7f7d712fe640 -1 osd.1 0 log_to_monitors true 2024-09-13T17:12:58.145 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-13T17:12:58.144+0000 7f23e57db640 -1 osd.3 0 log_to_monitors true 2024-09-13T17:12:58.151 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-13T17:12:58.150+0000 7f2b4feb2640 -1 osd.2 0 log_to_monitors true 2024-09-13T17:12:58.152 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-13T17:12:58.151+0000 7fd3d4f1b640 -1 osd.5 0 log_to_monitors true 2024-09-13T17:12:58.152 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-13T17:12:58.151+0000 7fe0abf29640 -1 osd.7 0 log_to_monitors true 2024-09-13T17:13:00.678 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-13T17:13:00.677+0000 7f7d6d28b640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:13:00.680 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-13T17:13:00.678+0000 7f2b4be3f640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:13:00.689 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-13T17:13:00.688+0000 7f7d650ac640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:00.691 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-13T17:13:00.691+0000 7f2b43c60640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:00.716 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-13T17:13:00.715+0000 7ffb8d895640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:13:00.732 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-13T17:13:00.731+0000 7ffb856b6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:00.753 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-13T17:13:00.752+0000 7f23e1f7f640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:13:00.766 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-13T17:13:00.766+0000 7f23d9589640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:01.300 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-13T17:13:01.299+0000 7fe3700b8640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:13:01.318 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-13T17:13:01.317+0000 7fe367ed9640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:01.372 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-13T17:13:01.371+0000 7fbb5552a640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:13:01.374 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-13T17:13:01.373+0000 7fe0a7eb6640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:13:01.386 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-13T17:13:01.385+0000 7fbb4d34b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:01.393 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-13T17:13:01.392+0000 7fe09fcd7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:01.406 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-13T17:13:01.405+0000 7fd3d0ea8640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:13:01.418 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-13T17:13:01.417+0000 7fd3c8cc9640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:13:01.994 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:02.098 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.097+0000 7f4ff5c32640 1 Processor -- start 2024-09-13T17:13:02.098 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.097+0000 7f4ff5c32640 1 -- start start 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4ff5c32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ff006bf80 0x7f4ff0160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4ff5c32640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff006af20 con 0x7f4ff015c5f0 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4ff5c32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00d2ed0 con 0x7f4ff00b4690 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4ff5c32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff006b1c0 con 0x7f4ff006bf80 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4fef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ff015c5f0 0x7f4ff00b3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47902/0 (socket says 172.21.15.5:47902) 2024-09-13T17:13:02.101 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4fef7fe640 1 -- 172.21.15.5:0/2992851618 learned_addr learned my addr 172.21.15.5:0/2992851618 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4feeffd640 1 --2- 172.21.15.5:0/2992851618 >> v2:172.21.15.179:3300/0 conn(0x7f4ff006bf80 0x7f4ff0160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361116641 0 0) 0x7f4ff006af20 con 0x7f4ff015c5f0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.098+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fd8003520 con 0x7f4ff015c5f0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477583783 0 0) 0x7f4fd8003520 con 0x7f4ff015c5f0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 >> v2:172.21.15.179:3300/0 conn(0x7f4ff006bf80 msgr2=0x7f4ff0160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 --2- 172.21.15.5:0/2992851618 >> v2:172.21.15.179:3300/0 conn(0x7f4ff006bf80 0x7f4ff0160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 >> v1:172.21.15.179:6789/0 conn(0x7f4ff00b4690 legacy=0x7f4ff015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff006b4a0 con 0x7f4ff015c5f0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f4fe0001670 con 0x7f4ff015c5f0 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 >> v1:172.21.15.5:6789/0 conn(0x7f4ff015c5f0 legacy=0x7f4ff00b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd80039a0 0x7f4fd8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 0x7f4fd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.102 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80051d0 0x7f4fd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff006b1c0 con 0x7f4fd80047c0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd800c100 con 0x7f4fd80039a0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd800c2c0 con 0x7f4fd80051d0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 0x7f4fd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4fef7fe640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd80039a0 0x7f4fd8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feffff640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80051d0 0x7f4fd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 -- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80051d0 msgr2=0x7f4fd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80051d0 0x7f4fd800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 -- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd80039a0 msgr2=0x7f4fd8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fd80039a0 0x7f4fd8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feeffd640 1 -- 172.21.15.5:0/2992851618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8003520 con 0x7f4fd80047c0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.099+0000 7f4feffff640 1 -- 172.21.15.5:0/2992851618 reap_dead start 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.100+0000 7f4feeffd640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 0x7f4fd8004c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009ac0 tx=0x7f4fd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ee4d3c366b5dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.103 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.100+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4031400 con 0x7f4fd80047c0 2024-09-13T17:13:02.104 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.100+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe402d050 con 0x7f4fd80047c0 2024-09-13T17:13:02.104 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.100+0000 7f4fee7fc640 1 -- 172.21.15.5:0/2992851618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4031780 con 0x7f4fd80047c0 2024-09-13T17:13:02.106 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 -- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 msgr2=0x7f4fd8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.106 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 0x7f4fd8004c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009ac0 tx=0x7f4fd80057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.106 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 -- 172.21.15.5:0/2992851618 shutdown_connections 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/2992851618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fd80047c0 0x7f4fd8004c40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 -- 172.21.15.5:0/2992851618 >> 172.21.15.5:0/2992851618 conn(0x7f4ff0089f90 msgr2=0x7f4ff00d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 -- 172.21.15.5:0/2992851618 shutdown_connections 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.101+0000 7f4ff5c32640 1 -- 172.21.15.5:0/2992851618 wait complete. 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.102+0000 7f4ff5c32640 1 Processor -- start 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.102+0000 7f4ff5c32640 1 -- start start 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80047c0 0x7f4ff0154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00b5d40 0x7f4ff00b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00b7f40 con 0x7f4ff00b7580 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff01562a0 con 0x7f4ff00b5d40 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4ff5c32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00b67c0 con 0x7f4fd80047c0 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.107 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48570/0 (socket says 172.21.15.5:48570) 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 -- 172.21.15.5:0/1742853170 learned_addr learned my addr 172.21.15.5:0/1742853170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4fef7fe640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80047c0 0x7f4ff0154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feeffd640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00b5d40 0x7f4ff00b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 -- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80047c0 msgr2=0x7f4ff0154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80047c0 0x7f4ff0154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 -- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00b5d40 msgr2=0x7f4ff00b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00b5d40 0x7f4ff00b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.103+0000 7f4feffff640 1 -- 172.21.15.5:0/1742853170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00b6aa0 con 0x7f4ff00b7580 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4feffff640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007fd0 tx=0x7f4fe800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8003970 con 0x7f4ff00b7580 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8003af0 con 0x7f4ff00b7580 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8003ea0 con 0x7f4ff00b7580 2024-09-13T17:13:02.108 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff0155f30 con 0x7f4ff00b7580 2024-09-13T17:13:02.109 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.104+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff015fde0 con 0x7f4ff00b7580 2024-09-13T17:13:02.109 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.105+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff00672a0 con 0x7f4ff00b7580 2024-09-13T17:13:02.109 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.105+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f4fe80050d0 con 0x7f4ff00b7580 2024-09-13T17:13:02.109 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.106+0000 7f4fd7fff640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 0x7f4fdc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.109 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.106+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4fe8088990 con 0x7f4ff00b7580 2024-09-13T17:13:02.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.106+0000 7f4fef7fe640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 0x7f4fdc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.110 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.107+0000 7f4fef7fe640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 0x7f4fdc06d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007de0 tx=0x7f4fe0001bd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.111 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.111+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4fe8054260 con 0x7f4ff00b7580 2024-09-13T17:13:02.291 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.290+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ff0066870 con 0x7f4ff00b7580 2024-09-13T17:13:02.291 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.290+0000 7f4fd7fff640 1 -- 172.21.15.5:0/1742853170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10872 (secure 0 0 0) 0x7f4fe8057880 con 0x7f4ff00b7580 2024-09-13T17:13:02.291 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-13T17:13:02.292 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":13,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:01.684353+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 msgr2=0x7f4fdc06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 0x7f4fdc06d030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007de0 tx=0x7f4fe0001bd0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 msgr2=0x7f4ff00b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8007fd0 tx=0x7f4fe800eb90 comp rx=0 tx=0).stop 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 shutdown_connections 2024-09-13T17:13:02.294 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fdc06ab70 0x7f4fdc06d030 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00b7580 0x7f4ff00b7a00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff00b5d40 0x7f4ff00b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 --2- 172.21.15.5:0/1742853170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fd80047c0 0x7f4ff0154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 >> 172.21.15.5:0/1742853170 conn(0x7f4ff0089f90 msgr2=0x7f4ff00cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 shutdown_connections 2024-09-13T17:13:02.295 INFO:teuthology.misc.health.smithi005.stderr:2024-09-13T17:13:02.293+0000 7f4ff5c32640 1 -- 172.21.15.5:0/1742853170 wait complete. 2024-09-13T17:13:02.303 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T17:13:02.303 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T17:13:02.304 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:13:02.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:13:02.306 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:13:02.307 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:13:02.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:13:02.309 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:13:02.309 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:13:02.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:13:02.312 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:13:02.312 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:13:02.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:13:02.314 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:13:02.314 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T17:13:02.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:02.383 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:13:02.385 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:13:02.392 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:13:02.392 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:13:02.393 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-13T17:13:02.392+0000 7ffb714cc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T17:13:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.420+0000 7fb58742b640 1 Processor -- start 2024-09-13T17:13:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.420+0000 7fb58742b640 1 -- start start 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb58742b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb5800ce1f0 0x7fb5801674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb58742b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800b0be0 con 0x7fb58015ff70 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb58742b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800affd0 con 0x7fb58015fb90 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb58742b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5800b02b0 con 0x7fb5800ce1f0 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb5849c6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb58015ff70 0x7fb5800b1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47924/0 (socket says 172.21.15.5:47924) 2024-09-13T17:13:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb5849c6640 1 -- 172.21.15.5:0/194610100 learned_addr learned my addr 172.21.15.5:0/194610100 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb5859c8640 1 --2- 172.21.15.5:0/194610100 >> v2:172.21.15.179:3300/0 conn(0x7fb5800ce1f0 0x7fb5801674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb577fff640 1 -- 172.21.15.5:0/194610100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961217891 0 0) 0x7fb5800b0be0 con 0x7fb58015ff70 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.421+0000 7fb577fff640 1 -- 172.21.15.5:0/194610100 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb56c003520 con 0x7fb58015ff70 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.422+0000 7fb5859c8640 1 -- 172.21.15.5:0/194610100 >> v1:172.21.15.179:6789/0 conn(0x7fb58015fb90 legacy=0x7fb5800b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.422+0000 7fb5859c8640 1 -- 172.21.15.5:0/194610100 >> v1:172.21.15.5:6789/0 conn(0x7fb58015ff70 legacy=0x7fb5800b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.422+0000 7fb5859c8640 1 -- 172.21.15.5:0/194610100 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800b0590 con 0x7fb5800ce1f0 2024-09-13T17:13:02.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.422+0000 7fb5859c8640 1 --2- 172.21.15.5:0/194610100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5800ce1f0 0x7fb5801674e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb578009d90 tx=0x7fb57802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8518dbae319bde5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.422+0000 7fb577fff640 1 -- 172.21.15.5:0/194610100 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578007740 con 0x7fb5800ce1f0 2024-09-13T17:13:02.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb577fff640 1 -- 172.21.15.5:0/194610100 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57802d050 con 0x7fb5800ce1f0 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb577fff640 1 -- 172.21.15.5:0/194610100 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578007740 con 0x7fb5800ce1f0 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 -- 172.21.15.5:0/194610100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5800ce1f0 msgr2=0x7fb5801674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 --2- 172.21.15.5:0/194610100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5800ce1f0 0x7fb5801674e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb578009d90 tx=0x7fb57802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 -- 172.21.15.5:0/194610100 shutdown_connections 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 --2- 172.21.15.5:0/194610100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5800ce1f0 0x7fb5801674e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 -- 172.21.15.5:0/194610100 >> 172.21.15.5:0/194610100 conn(0x7fb580089f90 msgr2=0x7fb5800d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 -- 172.21.15.5:0/194610100 shutdown_connections 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.423+0000 7fb58742b640 1 -- 172.21.15.5:0/194610100 wait complete. 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.424+0000 7fb58742b640 1 Processor -- start 2024-09-13T17:13:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.424+0000 7fb58742b640 1 -- start start 2024-09-13T17:13:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 0x7fb58009f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 0x7fb58009faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800a0030 con 0x7fb5800ce1f0 2024-09-13T17:13:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580151f90 con 0x7fb58015fb90 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb58742b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58009e510 con 0x7fb58015ff70 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5851c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5851c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48612/0 (socket says 172.21.15.5:48612) 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5851c7640 1 -- 172.21.15.5:0/1196797619 learned_addr learned my addr 172.21.15.5:0/1196797619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5849c6640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 0x7fb58009f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5859c8640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 0x7fb58009faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.425+0000 7fb5851c7640 1 -- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 msgr2=0x7fb58009faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5851c7640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 0x7fb58009faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5851c7640 1 -- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 msgr2=0x7fb58009f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5851c7640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 0x7fb58009f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5851c7640 1 -- 172.21.15.5:0/1196797619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009a70 con 0x7fb5800ce1f0 2024-09-13T17:13:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5859c8640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 0x7fb58009faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5849c6640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 0x7fb58009f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb5851c7640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c400 tx=0x7fb57c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0052d0 con 0x7fb5800ce1f0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c005450 con 0x7fb5800ce1f0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58009e7f0 con 0x7fb5800ce1f0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c007260 con 0x7fb5800ce1f0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.426+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58009edb0 con 0x7fb5800ce1f0 2024-09-13T17:13:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.427+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5800b5350 con 0x7fb5800ce1f0 2024-09-13T17:13:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.428+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fb57c0073c0 con 0x7fb5800ce1f0 2024-09-13T17:13:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.428+0000 7fb575ffb640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 0x7fb56406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.428+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb57c088130 con 0x7fb5800ce1f0 2024-09-13T17:13:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.428+0000 7fb5849c6640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 0x7fb56406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.429+0000 7fb5849c6640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 0x7fb56406d030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb570007fd0 tx=0x7fb570009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.432+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb57c053950 con 0x7fb5800ce1f0 2024-09-13T17:13:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.603+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5800b5d80 con 0x7fb5800ce1f0 2024-09-13T17:13:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.604+0000 7fb575ffb640 1 -- 172.21.15.5:0/1196797619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10872 (secure 0 0 0) 0x7fb57c056f70 con 0x7fb5800ce1f0 2024-09-13T17:13:02.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:02.605 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:01.684353+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 msgr2=0x7fb56406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 0x7fb56406d030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb570007fd0 tx=0x7fb570009040 comp rx=0 tx=0).stop 2024-09-13T17:13:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 msgr2=0x7fb5800b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c400 tx=0x7fb57c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 shutdown_connections 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb58015ff70 0x7fb58009faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58015fb90 0x7fb58009f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb56406ab70 0x7fb56406d030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 --2- 172.21.15.5:0/1196797619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5800ce1f0 0x7fb5800b1ba0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 >> 172.21.15.5:0/1196797619 conn(0x7fb580089f90 msgr2=0x7fb58006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 shutdown_connections 2024-09-13T17:13:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.606+0000 7fb58742b640 1 -- 172.21.15.5:0/1196797619 wait complete. 2024-09-13T17:13:02.617 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-09-13T17:13:02.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.718+0000 7f87e7b76640 1 Processor -- start 2024-09-13T17:13:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.718+0000 7f87e7b76640 1 -- start start 2024-09-13T17:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e7b76640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 0x7f87e00cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e7b76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e7b76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00704a0 con 0x7f87e015fd80 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e7b76640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e006cc10 con 0x7f87e0099110 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e7b76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00d12e0 con 0x7f87e00d0e30 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e5111640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 0x7f87e00cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e6113640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e6113640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39356/0 (socket says 172.21.15.5:39356) 2024-09-13T17:13:02.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.719+0000 7f87e6113640 1 -- 172.21.15.5:0/2961672909 learned_addr learned my addr 172.21.15.5:0/2961672909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:02.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e6113640 1 -- 172.21.15.5:0/2961672909 >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 msgr2=0x7f87e00cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e6113640 1 --2- 172.21.15.5:0/2961672909 >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 0x7f87e00cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e6113640 1 -- 172.21.15.5:0/2961672909 >> v1:172.21.15.179:6789/0 conn(0x7f87e015fd80 legacy=0x7f87e0098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e6113640 1 -- 172.21.15.5:0/2961672909 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e006bd80 con 0x7f87e00d0e30 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e5111640 1 --2- 172.21.15.5:0/2961672909 >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 0x7f87e00cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.720+0000 7f87e6113640 1 --2- 172.21.15.5:0/2961672909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e50 tx=0x7f87d802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d116cc8d1b4ac92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e4910640 1 -- 172.21.15.5:0/2961672909 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d802aea0 con 0x7f87e00d0e30 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e4910640 1 -- 172.21.15.5:0/2961672909 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d802d050 con 0x7f87e00d0e30 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e4910640 1 -- 172.21.15.5:0/2961672909 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8031820 con 0x7f87e00d0e30 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 -- 172.21.15.5:0/2961672909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 msgr2=0x7f87e006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2961672909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e50 tx=0x7f87d802a680 comp rx=0 tx=0).stop 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 -- 172.21.15.5:0/2961672909 shutdown_connections 2024-09-13T17:13:02.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2961672909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e006e870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2961672909 >> v2:172.21.15.179:3300/0 conn(0x7f87e0099110 0x7f87e00cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 -- 172.21.15.5:0/2961672909 >> 172.21.15.5:0/2961672909 conn(0x7f87e00d0310 msgr2=0x7f87e00d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 -- 172.21.15.5:0/2961672909 shutdown_connections 2024-09-13T17:13:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.721+0000 7f87e7b76640 1 -- 172.21.15.5:0/2961672909 wait complete. 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.722+0000 7f87e7b76640 1 Processor -- start 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 -- start start 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 0x7f87e00c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0148db0 con 0x7f87e015fd80 2024-09-13T17:13:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e015bac0 con 0x7f87e0099110 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e7b76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e014b2c0 con 0x7f87e00d0e30 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e6113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e6113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48622/0 (socket says 172.21.15.5:48622) 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.723+0000 7f87e6113640 1 -- 172.21.15.5:0/2807118665 learned_addr learned my addr 172.21.15.5:0/2807118665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e5111640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e5912640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 0x7f87e00c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 -- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 msgr2=0x7f87e015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 -- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 msgr2=0x7f87e00c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 0x7f87e00c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 -- 172.21.15.5:0/2807118665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009400 con 0x7f87e015fd80 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e5912640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 0x7f87e00c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e6113640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e50 tx=0x7f87d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8009510 con 0x7f87e015fd80 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d8009b30 con 0x7f87e015fd80 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e01486f0 con 0x7f87e015fd80 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d803d660 con 0x7f87e015fd80 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.724+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d803d9d0 con 0x7f87e015fd80 2024-09-13T17:13:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.725+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0148ef0 con 0x7f87e015fd80 2024-09-13T17:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.726+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f87d803db30 con 0x7f87e015fd80 2024-09-13T17:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.726+0000 7f87d67fc640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 0x7f87c406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.726+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f87d80a9600 con 0x7f87e015fd80 2024-09-13T17:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.726+0000 7f87e5912640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 0x7f87c406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:02.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.727+0000 7f87e5912640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 0x7f87c406d030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007fd0 tx=0x7f87dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.731+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87e0148ef0 con 0x7f87e015fd80 2024-09-13T17:13:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.934+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87e0148ef0 con 0x7f87e015fd80 2024-09-13T17:13:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.934+0000 7f87d67fc640 1 -- 172.21.15.5:0/2807118665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f87e0148ef0 con 0x7f87e015fd80 2024-09-13T17:13:02.936 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:02.936 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:13:02.936 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 msgr2=0x7f87c406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 0x7f87c406d030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007fd0 tx=0x7f87dc009040 comp rx=0 tx=0).stop 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 msgr2=0x7f87e015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009e50 tx=0x7f87d8004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 shutdown_connections 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87c406ab70 0x7f87c406d030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e015fd80 0x7f87e015c7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87e00d0e30 0x7f87e015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 --2- 172.21.15.5:0/2807118665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87e0099110 0x7f87e00c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.936+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 >> 172.21.15.5:0/2807118665 conn(0x7f87e00d0310 msgr2=0x7f87e00b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.937+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 shutdown_connections 2024-09-13T17:13:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:02.937+0000 7f87e7b76640 1 -- 172.21.15.5:0/2807118665 wait complete. 2024-09-13T17:13:04.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.062+0000 7f049b19c640 1 Processor -- start 2024-09-13T17:13:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.062+0000 7f049b19c640 1 -- start start 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f049b19c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04940b4cf0 0x7f04940cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f049b19c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940d06d0 0x7f04940b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f049b19c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940d1e80 con 0x7f049415c810 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f049b19c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04940d1750 con 0x7f04940b4cf0 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f049b19c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940d0bd0 con 0x7f04940d06d0 2024-09-13T17:13:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f0493fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04940b4cf0 0x7f04940cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f0493fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04940b4cf0 0x7f04940cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44680/0 (socket says 172.21.15.5:44680) 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f0493fff640 1 -- 172.21.15.5:0/1294517313 learned_addr learned my addr 172.21.15.5:0/1294517313 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f0498f38640 1 --1- 172.21.15.5:0/1294517313 >> v1:172.21.15.5:6789/0 conn(0x7f049415c810 0x7f04940b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59930/0 (socket says 172.21.15.5:59930) 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.063+0000 7f0499739640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940d06d0 0x7f04940b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f0493fff640 1 -- 172.21.15.5:0/1294517313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940d06d0 msgr2=0x7f04940b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f0493fff640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940d06d0 0x7f04940b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f0493fff640 1 -- 172.21.15.5:0/1294517313 >> v1:172.21.15.5:6789/0 conn(0x7f049415c810 legacy=0x7f04940b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f0493fff640 1 -- 172.21.15.5:0/1294517313 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940d0eb0 con 0x7f04940b4cf0 2024-09-13T17:13:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f04937fe640 1 -- 172.21.15.5:0/1294517313 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211251096 0 0) 0x7f04940d1e80 con 0x7f049415c810 2024-09-13T17:13:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.064+0000 7f0493fff640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940b4cf0 0x7f04940cd780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478641806054bef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f04937fe640 1 -- 172.21.15.5:0/1294517313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480032440 con 0x7f04940b4cf0 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f04937fe640 1 -- 172.21.15.5:0/1294517313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04800325a0 con 0x7f04940b4cf0 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f04937fe640 1 -- 172.21.15.5:0/1294517313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480032930 con 0x7f04940b4cf0 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 -- 172.21.15.5:0/1294517313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940b4cf0 msgr2=0x7f04940cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940b4cf0 0x7f04940cd780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002a270 comp rx=0 tx=0).stop 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 -- 172.21.15.5:0/1294517313 shutdown_connections 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940d06d0 0x7f04940b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 --2- 172.21.15.5:0/1294517313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940b4cf0 0x7f04940cd780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 -- 172.21.15.5:0/1294517313 >> 172.21.15.5:0/1294517313 conn(0x7f04940717a0 msgr2=0x7f0494071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 -- 172.21.15.5:0/1294517313 shutdown_connections 2024-09-13T17:13:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.065+0000 7f049b19c640 1 -- 172.21.15.5:0/1294517313 wait complete. 2024-09-13T17:13:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.067+0000 7f049b19c640 1 Processor -- start 2024-09-13T17:13:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.067+0000 7f049b19c640 1 -- start start 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940b4cf0 0x7f04941f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 0x7f04940c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c6230 con 0x7f04940d06d0 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04941f2f50 con 0x7f049415c810 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f049b19c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c7520 con 0x7f04940b4cf0 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44688/0 (socket says 172.21.15.5:44688) 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 -- 172.21.15.5:0/1188727735 learned_addr learned my addr 172.21.15.5:0/1188727735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0498f38640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940b4cf0 0x7f04941f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0499739640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 0x7f04940c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 -- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940b4cf0 msgr2=0x7f04941f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940b4cf0 0x7f04941f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 -- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 msgr2=0x7f04940c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 0x7f04940c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 -- 172.21.15.5:0/1188727735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800094d0 con 0x7f04940d06d0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0499739640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 0x7f04940c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f0493fff640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f048002a2b0 tx=0x7f04800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.068+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480032440 con 0x7f04940d06d0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.069+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480030980 con 0x7f04940d06d0 2024-09-13T17:13:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.069+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480030d30 con 0x7f04940d06d0 2024-09-13T17:13:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.069+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940c6480 con 0x7f04940d06d0 2024-09-13T17:13:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.069+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940c6a40 con 0x7f04940d06d0 2024-09-13T17:13:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.070+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04940b7560 con 0x7f04940d06d0 2024-09-13T17:13:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.070+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f0480039040 con 0x7f04940d06d0 2024-09-13T17:13:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.071+0000 7f04917fa640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 0x7f047806d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.071+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f04800a9630 con 0x7f04940d06d0 2024-09-13T17:13:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.071+0000 7f0498f38640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 0x7f047806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.071+0000 7f0498f38640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 0x7f047806d080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0488007fd0 tx=0x7f0488007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.076+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0480074db0 con 0x7f04940d06d0 2024-09-13T17:13:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.300+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04940672a0 con 0x7f04940d06d0 2024-09-13T17:13:05.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.301+0000 7f04917fa640 1 -- 172.21.15.5:0/1188727735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f0480041dd0 con 0x7f04940d06d0 2024-09-13T17:13:05.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:05.303 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T17:13:05.303 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 msgr2=0x7f047806d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 0x7f047806d080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0488007fd0 tx=0x7f0488007de0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 msgr2=0x7f04940c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f048002a2b0 tx=0x7f04800046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 shutdown_connections 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f049415c810 0x7f04940c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047806abc0 0x7f047806d080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04940d06d0 0x7f04940c8020 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 --2- 172.21.15.5:0/1188727735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04940b4cf0 0x7f04941f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 >> 172.21.15.5:0/1188727735 conn(0x7f04940717a0 msgr2=0x7f04940cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 shutdown_connections 2024-09-13T17:13:05.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.303+0000 7f049b19c640 1 -- 172.21.15.5:0/1188727735 wait complete. 2024-09-13T17:13:05.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.418+0000 7f41ff745640 1 Processor -- start 2024-09-13T17:13:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.418+0000 7f41ff745640 1 -- start start 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41ff745640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41f815c810 0x7f41f80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41ff745640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 0x7f41f80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41ff745640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80d1e80 con 0x7f41f80d06d0 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41ff745640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80d1750 con 0x7f41f815c810 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41ff745640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80d0bd0 con 0x7f41f80b4cf0 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fd4e1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41f815c810 0x7f41f80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fcce0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41f80d06d0 0x7f41f80b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59938/0 (socket says 172.21.15.5:59938) 2024-09-13T17:13:05.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fcce0640 1 -- 172.21.15.5:0/2505373790 learned_addr learned my addr 172.21.15.5:0/2505373790 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fdce2640 1 --2- 172.21.15.5:0/2505373790 >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 0x7f41f80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fd4e1640 1 -- 172.21.15.5:0/2505373790 >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 msgr2=0x7f41f80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fd4e1640 1 --2- 172.21.15.5:0/2505373790 >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 0x7f41f80b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41effff640 1 -- 172.21.15.5:0/2505373790 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651390506 0 0) 0x7f41f80d1e80 con 0x7f41f80d06d0 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fd4e1640 1 -- 172.21.15.5:0/2505373790 >> v1:172.21.15.5:6789/0 conn(0x7f41f80d06d0 legacy=0x7f41f80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fd4e1640 1 -- 172.21.15.5:0/2505373790 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80d0eb0 con 0x7f41f815c810 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.419+0000 7f41fdce2640 1 --2- 172.21.15.5:0/2505373790 >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 0x7f41f80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.420+0000 7f41fd4e1640 1 --2- 172.21.15.5:0/2505373790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815c810 0x7f41f80cd780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41f80b5600 tx=0x7f41f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87241b728aa5ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.420+0000 7f41effff640 1 -- 172.21.15.5:0/2505373790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4032440 con 0x7f41f815c810 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.420+0000 7f41effff640 1 -- 172.21.15.5:0/2505373790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40325a0 con 0x7f41f815c810 2024-09-13T17:13:05.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.420+0000 7f41effff640 1 -- 172.21.15.5:0/2505373790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4032930 con 0x7f41f815c810 2024-09-13T17:13:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 -- 172.21.15.5:0/2505373790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815c810 msgr2=0x7f41f80cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 --2- 172.21.15.5:0/2505373790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815c810 0x7f41f80cd780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41f80b5600 tx=0x7f41f402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 -- 172.21.15.5:0/2505373790 shutdown_connections 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 --2- 172.21.15.5:0/2505373790 >> v2:172.21.15.179:3300/0 conn(0x7f41f80b4cf0 0x7f41f80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 --2- 172.21.15.5:0/2505373790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f815c810 0x7f41f80cd780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 -- 172.21.15.5:0/2505373790 >> 172.21.15.5:0/2505373790 conn(0x7f41f80717a0 msgr2=0x7f41f8071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 -- 172.21.15.5:0/2505373790 shutdown_connections 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.421+0000 7f41ff745640 1 -- 172.21.15.5:0/2505373790 wait complete. 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.422+0000 7f41ff745640 1 Processor -- start 2024-09-13T17:13:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.422+0000 7f41ff745640 1 -- start start 2024-09-13T17:13:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41f80b4cf0 0x7f41f80c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41f815c810 0x7f41f80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8158260 con 0x7f41f80d06d0 2024-09-13T17:13:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8159e20 con 0x7f41f815c810 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41ff745640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c9560 con 0x7f41f80b4cf0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44702/0 (socket says 172.21.15.5:44702) 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 -- 172.21.15.5:0/3269982512 learned_addr learned my addr 172.21.15.5:0/3269982512 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fdce2640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41f815c810 0x7f41f80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fd4e1640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41f80b4cf0 0x7f41f80c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 -- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41f80b4cf0 msgr2=0x7f41f80c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41f80b4cf0 0x7f41f80c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 -- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41f815c810 msgr2=0x7f41f80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41f815c810 0x7f41f80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 -- 172.21.15.5:0/3269982512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009400 con 0x7f41f80d06d0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.423+0000 7f41fcce0640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e800c4b0 tx=0x7f41e800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.424+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80074e0 con 0x7f41f80d06d0 2024-09-13T17:13:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.424+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8007660 con 0x7f41f80d06d0 2024-09-13T17:13:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.424+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f80c7f80 con 0x7f41f80d06d0 2024-09-13T17:13:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.424+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8004a20 con 0x7f41f80d06d0 2024-09-13T17:13:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.424+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80c8540 con 0x7f41f80d06d0 2024-09-13T17:13:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.425+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f80672a0 con 0x7f41f80d06d0 2024-09-13T17:13:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.426+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f41e8004b80 con 0x7f41f80d06d0 2024-09-13T17:13:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.426+0000 7f41edffb640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 0x7f41dc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.426+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41e8088390 con 0x7f41f80d06d0 2024-09-13T17:13:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.426+0000 7f41fd4e1640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 0x7f41dc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.427+0000 7f41fd4e1640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 0x7f41dc06d030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034000 tx=0x7f41f402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.430+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41e8053b10 con 0x7f41f80d06d0 2024-09-13T17:13:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.608+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41f80b5a90 con 0x7f41f80d06d0 2024-09-13T17:13:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.609+0000 7f41edffb640 1 -- 172.21.15.5:0/3269982512 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f41e8018090 con 0x7f41f80d06d0 2024-09-13T17:13:05.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:05.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:04.696230+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.610+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 msgr2=0x7f41dc06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.610+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 0x7f41dc06d030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034000 tx=0x7f41f402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.610+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 msgr2=0x7f41f81598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.610+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e800c4b0 tx=0x7f41e800c970 comp rx=0 tx=0).stop 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 shutdown_connections 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41f815c810 0x7f41f80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41dc06ab70 0x7f41dc06d030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41f80d06d0 0x7f41f81598e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 --2- 172.21.15.5:0/3269982512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41f80b4cf0 0x7f41f80c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 >> 172.21.15.5:0/3269982512 conn(0x7f41f80717a0 msgr2=0x7f41f815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 shutdown_connections 2024-09-13T17:13:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.611+0000 7f41ff745640 1 -- 172.21.15.5:0/3269982512 wait complete. 2024-09-13T17:13:05.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:13:05.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.727+0000 7f3c27cc5640 1 Processor -- start 2024-09-13T17:13:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.727+0000 7f3c27cc5640 1 -- start start 2024-09-13T17:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c27cc5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c27cc5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c20099110 0x7f3c2006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c27cc5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200704a0 con 0x7f3c200d0e30 2024-09-13T17:13:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c27cc5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2006cc10 con 0x7f3c20099110 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c27cc5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2006bd80 con 0x7f3c2015fd80 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c25260640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c200d0e30 0x7f3c20098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59954/0 (socket says 172.21.15.5:59954) 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c25260640 1 -- 172.21.15.5:0/205658806 learned_addr learned my addr 172.21.15.5:0/205658806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c26262640 1 --2- 172.21.15.5:0/205658806 >> v2:172.21.15.179:3300/0 conn(0x7f3c20099110 0x7f3c2006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c25a61640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279725751 0 0) 0x7f3c200704a0 con 0x7f3c200d0e30 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c003520 con 0x7f3c200d0e30 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c26262640 1 -- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 msgr2=0x7f3c200cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c26262640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c26262640 1 -- 172.21.15.5:0/205658806 >> v1:172.21.15.5:6789/0 conn(0x7f3c200d0e30 legacy=0x7f3c20098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 85419441 0 0) 0x7f3c0c003520 con 0x7f3c200d0e30 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c26262640 1 -- 172.21.15.5:0/205658806 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200d1270 con 0x7f3c20099110 2024-09-13T17:13:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.728+0000 7f3c25a61640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.729+0000 7f3c26262640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c2006e870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1802a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b803af13170638 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.729+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10001670 con 0x7f3c20099110 2024-09-13T17:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.729+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1802d050 con 0x7f3c20099110 2024-09-13T17:13:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.729+0000 7f3c24a5f640 1 -- 172.21.15.5:0/205658806 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18007740 con 0x7f3c20099110 2024-09-13T17:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 -- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 msgr2=0x7f3c2006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c2006e870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1802a560 comp rx=0 tx=0).stop 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 -- 172.21.15.5:0/205658806 shutdown_connections 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c2006e870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/205658806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 -- 172.21.15.5:0/205658806 >> 172.21.15.5:0/205658806 conn(0x7f3c200d0310 msgr2=0x7f3c200d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 -- 172.21.15.5:0/205658806 shutdown_connections 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.730+0000 7f3c27cc5640 1 -- 172.21.15.5:0/205658806 wait complete. 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.731+0000 7f3c27cc5640 1 Processor -- start 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.731+0000 7f3c27cc5640 1 -- start start 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c20157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201582c0 con 0x7f3c200d0e30 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200b4690 con 0x7f3c20099110 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c27cc5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c20157d00 con 0x7f3c2015fd80 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44716/0 (socket says 172.21.15.5:44716) 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 -- 172.21.15.5:0/1222837179 learned_addr learned my addr 172.21.15.5:0/1222837179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25a61640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c20157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c26262640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 -- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 msgr2=0x7f3c200af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 -- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 msgr2=0x7f3c20157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c20157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 -- 172.21.15.5:0/1222837179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009400 con 0x7f3c200d0e30 2024-09-13T17:13:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.732+0000 7f3c25260640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001380 tx=0x7f3c1000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.733+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10005ad0 con 0x7f3c200d0e30 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.733+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10005c30 con 0x7f3c200d0e30 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.733+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18009a70 con 0x7f3c200d0e30 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.733+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007070 con 0x7f3c200d0e30 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.733+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2015a4c0 con 0x7f3c200d0e30 2024-09-13T17:13:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.734+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c200b4460 con 0x7f3c200d0e30 2024-09-13T17:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.734+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c100071d0 con 0x7f3c200d0e30 2024-09-13T17:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.734+0000 7f3c167fc640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 0x7f3c0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.734+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c10088620 con 0x7f3c200d0e30 2024-09-13T17:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.735+0000 7f3c25a61640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 0x7f3c0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.735+0000 7f3c25a61640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 0x7f3c0406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c200b6420 tx=0x7f3c1c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.739+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c200b4460 con 0x7f3c200d0e30 2024-09-13T17:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.911+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c200b4460 con 0x7f3c200d0e30 2024-09-13T17:13:05.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.911+0000 7f3c167fc640 1 -- 172.21.15.5:0/1222837179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c200b4460 con 0x7f3c200d0e30 2024-09-13T17:13:05.912 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 msgr2=0x7f3c0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 0x7f3c0406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c200b6420 tx=0x7f3c1c009190 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 msgr2=0x7f3c201566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001380 tx=0x7f3c1000cbe0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 shutdown_connections 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2015fd80 0x7f3c200af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c0406ac00 0x7f3c0406d0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c200d0e30 0x7f3c201566c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 --2- 172.21.15.5:0/1222837179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c20099110 0x7f3c20157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 >> 172.21.15.5:0/1222837179 conn(0x7f3c200d0310 msgr2=0x7f3c200b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.913+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 shutdown_connections 2024-09-13T17:13:05.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:05.914+0000 7f3c27cc5640 1 -- 172.21.15.5:0/1222837179 wait complete. 2024-09-13T17:13:05.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:13:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.025+0000 7f0cca8e9640 1 Processor -- start 2024-09-13T17:13:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.025+0000 7f0cca8e9640 1 -- start start 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cca8e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0cc40cbb50 0x7f0cc406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cca8e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 0x7f0cc4162f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cca8e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc41597c0 con 0x7f0cc40cbf30 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cca8e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc406eb70 con 0x7f0cc40cbb50 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cca8e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40cdb10 con 0x7f0cc40ad670 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cc37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0cc40cbf30 0x7f0cc40cc3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59966/0 (socket says 172.21.15.5:59966) 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cc37fe640 1 -- 172.21.15.5:0/1791403951 learned_addr learned my addr 172.21.15.5:0/1791403951 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cc8e86640 1 --2- 172.21.15.5:0/1791403951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 0x7f0cc4162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.026+0000 7f0cc3fff640 1 --2- 172.21.15.5:0/1791403951 >> v2:172.21.15.179:3300/0 conn(0x7f0cc40cbb50 0x7f0cc406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.027+0000 7f0cc8e86640 1 -- 172.21.15.5:0/1791403951 >> v2:172.21.15.179:3300/0 conn(0x7f0cc40cbb50 msgr2=0x7f0cc406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.027+0000 7f0cc8e86640 1 --2- 172.21.15.5:0/1791403951 >> v2:172.21.15.179:3300/0 conn(0x7f0cc40cbb50 0x7f0cc406ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.027+0000 7f0cc8e86640 1 -- 172.21.15.5:0/1791403951 >> v1:172.21.15.5:6789/0 conn(0x7f0cc40cbf30 legacy=0x7f0cc40cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.027+0000 7f0cc8e86640 1 -- 172.21.15.5:0/1791403951 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40cddf0 con 0x7f0cc40ad670 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cc8e86640 1 --2- 172.21.15.5:0/1791403951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 0x7f0cc4162f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009d90 tx=0x7f0cbc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4abbab59a2efa7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cc2ffd640 1 -- 172.21.15.5:0/1791403951 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc007740 con 0x7f0cc40ad670 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cc2ffd640 1 -- 172.21.15.5:0/1791403951 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc02d050 con 0x7f0cc40ad670 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cc2ffd640 1 -- 172.21.15.5:0/1791403951 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc007ac0 con 0x7f0cc40ad670 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 -- 172.21.15.5:0/1791403951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 msgr2=0x7f0cc4162f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/1791403951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 0x7f0cc4162f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009d90 tx=0x7f0cbc02a660 comp rx=0 tx=0).stop 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 -- 172.21.15.5:0/1791403951 shutdown_connections 2024-09-13T17:13:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/1791403951 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40ad670 0x7f0cc4162f10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/1791403951 >> v2:172.21.15.179:3300/0 conn(0x7f0cc40cbb50 0x7f0cc406ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 -- 172.21.15.5:0/1791403951 >> 172.21.15.5:0/1791403951 conn(0x7f0cc40b0f10 msgr2=0x7f0cc40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 -- 172.21.15.5:0/1791403951 shutdown_connections 2024-09-13T17:13:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.028+0000 7f0cca8e9640 1 -- 172.21.15.5:0/1791403951 wait complete. 2024-09-13T17:13:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.029+0000 7f0cca8e9640 1 Processor -- start 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 -- start start 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 0x7f0cc40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 0x7f0cc413cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc413d450 con 0x7f0cc40ad670 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc414f4e0 con 0x7f0cc40cbf30 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.030+0000 7f0cca8e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc413d680 con 0x7f0cc40cbb50 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44726/0 (socket says 172.21.15.5:44726) 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 -- 172.21.15.5:0/858303625 learned_addr learned my addr 172.21.15.5:0/858303625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc37fe640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 0x7f0cc40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc8e86640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 0x7f0cc413cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 -- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 msgr2=0x7f0cc40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 0x7f0cc40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 -- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 msgr2=0x7f0cc413cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 0x7f0cc413cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 -- 172.21.15.5:0/858303625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc009a70 con 0x7f0cc40ad670 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc8e86640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 0x7f0cc413cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc37fe640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 0x7f0cc40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.031+0000 7f0cc3fff640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9b0 tx=0x7f0cb400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.104+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4009670 con 0x7f0cc40ad670 2024-09-13T17:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.104+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc413d960 con 0x7f0cc40ad670 2024-09-13T17:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.104+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc414f760 con 0x7f0cc40ad670 2024-09-13T17:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.104+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb400c9a0 con 0x7f0cc40ad670 2024-09-13T17:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.104+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400cd10 con 0x7f0cc40ad670 2024-09-13T17:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.106+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc40cd730 con 0x7f0cc40ad670 2024-09-13T17:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.106+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0cb4013470 con 0x7f0cc40ad670 2024-09-13T17:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.107+0000 7f0cc0ff9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 0x7f0cb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.107+0000 7f0cc37fe640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 0x7f0cb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.107+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cb40895b0 con 0x7f0cc40ad670 2024-09-13T17:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.107+0000 7f0cc37fe640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 0x7f0cb006d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4155dc0 tx=0x7f0cb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.111+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0cb4054b10 con 0x7f0cc40ad670 2024-09-13T17:13:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.285+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0cc40ad0e0 con 0x7f0cc40ad670 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.285+0000 7f0cc0ff9640 1 -- 172.21.15.5:0/858303625 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0cb4058130 con 0x7f0cc40ad670 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:13:06.287 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 msgr2=0x7f0cb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 0x7f0cb006d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4155dc0 tx=0x7f0cb8009040 comp rx=0 tx=0).stop 2024-09-13T17:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 msgr2=0x7f0cc4155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400e9b0 tx=0x7f0cb400ee70 comp rx=0 tx=0).stop 2024-09-13T17:13:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 shutdown_connections 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cc40cbf30 0x7f0cc413cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cc40cbb50 0x7f0cc40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0cb006ac00 0x7f0cb006d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 --2- 172.21.15.5:0/858303625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc40ad670 0x7f0cc4155f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 >> 172.21.15.5:0/858303625 conn(0x7f0cc40b0f10 msgr2=0x7f0cc40cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 shutdown_connections 2024-09-13T17:13:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.288+0000 7f0cca8e9640 1 -- 172.21.15.5:0/858303625 wait complete. 2024-09-13T17:13:06.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:13:06.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:13:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.403+0000 7f0f38f18640 1 Processor -- start 2024-09-13T17:13:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.403+0000 7f0f38f18640 1 -- start start 2024-09-13T17:13:06.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f38f18640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f340ccfe0 0x7f0f340cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f38f18640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f340cdbf0 0x7f0f340d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f38f18640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340cd900 con 0x7f0f340d07c0 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f38f18640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340b5de0 con 0x7f0f340cdbf0 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f38f18640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340b60c0 con 0x7f0f340ccfe0 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f31d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f340cdbf0 0x7f0f340d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f31d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f340cdbf0 0x7f0f340d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44742/0 (socket says 172.21.15.5:44742) 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f31d9b640 1 -- 172.21.15.5:0/2481715697 learned_addr learned my addr 172.21.15.5:0/2481715697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.404+0000 7f0f3259c640 1 --2- 172.21.15.5:0/2481715697 >> v2:172.21.15.179:3300/0 conn(0x7f0f340ccfe0 0x7f0f340cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.405+0000 7f0f31d9b640 1 -- 172.21.15.5:0/2481715697 >> v2:172.21.15.179:3300/0 conn(0x7f0f340ccfe0 msgr2=0x7f0f340cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.405+0000 7f0f31d9b640 1 --2- 172.21.15.5:0/2481715697 >> v2:172.21.15.179:3300/0 conn(0x7f0f340ccfe0 0x7f0f340cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.405+0000 7f0f31d9b640 1 -- 172.21.15.5:0/2481715697 >> v1:172.21.15.179:6789/0 conn(0x7f0f340d07c0 legacy=0x7f0f340d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.405+0000 7f0f31d9b640 1 -- 172.21.15.5:0/2481715697 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340b63a0 con 0x7f0f340cdbf0 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.405+0000 7f0f31d9b640 1 --2- 172.21.15.5:0/2481715697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f340d2bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f3408af10 tx=0x7f0f1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c31e00dac1311a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f3159a640 1 -- 172.21.15.5:0/2481715697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c032440 con 0x7f0f340cdbf0 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f3159a640 1 -- 172.21.15.5:0/2481715697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c0325a0 con 0x7f0f340cdbf0 2024-09-13T17:13:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f3159a640 1 -- 172.21.15.5:0/2481715697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c032930 con 0x7f0f340cdbf0 2024-09-13T17:13:06.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 -- 172.21.15.5:0/2481715697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 msgr2=0x7f0f340d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 --2- 172.21.15.5:0/2481715697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f340d2bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f3408af10 tx=0x7f0f1c02a270 comp rx=0 tx=0).stop 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 -- 172.21.15.5:0/2481715697 shutdown_connections 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 --2- 172.21.15.5:0/2481715697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f340d2bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 --2- 172.21.15.5:0/2481715697 >> v2:172.21.15.179:3300/0 conn(0x7f0f340ccfe0 0x7f0f340cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 -- 172.21.15.5:0/2481715697 >> 172.21.15.5:0/2481715697 conn(0x7f0f34089f90 msgr2=0x7f0f340d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 -- 172.21.15.5:0/2481715697 shutdown_connections 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.406+0000 7f0f38f18640 1 -- 172.21.15.5:0/2481715697 wait complete. 2024-09-13T17:13:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 Processor -- start 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 -- start start 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f340ccfe0 0x7f0f341f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f340d07c0 0x7f0f3415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3415cba0 con 0x7f0f340cdbf0 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3415d9c0 con 0x7f0f340ccfe0 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.408+0000 7f0f38f18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34156260 con 0x7f0f340d07c0 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44748/0 (socket says 172.21.15.5:44748) 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 -- 172.21.15.5:0/1205469530 learned_addr learned my addr 172.21.15.5:0/1205469530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:06.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f3259c640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f340ccfe0 0x7f0f341f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f32d9d640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f340d07c0 0x7f0f3415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 -- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f340d07c0 msgr2=0x7f0f3415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f340d07c0 0x7f0f3415eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 -- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f340ccfe0 msgr2=0x7f0f341f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f340ccfe0 0x7f0f341f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 -- 172.21.15.5:0/1205469530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0094d0 con 0x7f0f340cdbf0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f31d9b640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c02a2b0 tx=0x7f0f1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c032440 con 0x7f0f340cdbf0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c030980 con 0x7f0f340cdbf0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f341f2d80 con 0x7f0f340cdbf0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c030d10 con 0x7f0f340cdbf0 2024-09-13T17:13:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.409+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3415d090 con 0x7f0f340cdbf0 2024-09-13T17:13:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.410+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3415db70 con 0x7f0f340cdbf0 2024-09-13T17:13:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.411+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f1c039040 con 0x7f0f340cdbf0 2024-09-13T17:13:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.411+0000 7f0f2affd640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 0x7f0f1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.411+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f1c0a9890 con 0x7f0f340cdbf0 2024-09-13T17:13:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.411+0000 7f0f3259c640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 0x7f0f1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.412+0000 7f0f3259c640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 0x7f0f1406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009aa0 tx=0x7f0f2c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.415+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f3415db70 con 0x7f0f340cdbf0 2024-09-13T17:13:06.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.585+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0f3415db70 con 0x7f0f340cdbf0 2024-09-13T17:13:06.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.794+0000 7f0f2affd640 1 -- 172.21.15.5:0/1205469530 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0f3415db70 con 0x7f0f340cdbf0 2024-09-13T17:13:06.795 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 msgr2=0x7f0f1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 0x7f0f1406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009aa0 tx=0x7f0f2c009190 comp rx=0 tx=0).stop 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 msgr2=0x7f0f3415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c02a2b0 tx=0x7f0f1c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 shutdown_connections 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f340d07c0 0x7f0f3415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.798+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f1406ac00 0x7f0f1406d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.799+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f340cdbf0 0x7f0f3415e5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.799+0000 7f0f38f18640 1 --2- 172.21.15.5:0/1205469530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f340ccfe0 0x7f0f341f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.799+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 >> 172.21.15.5:0/1205469530 conn(0x7f0f34089f90 msgr2=0x7f0f3406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.800+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 shutdown_connections 2024-09-13T17:13:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.800+0000 7f0f38f18640 1 -- 172.21.15.5:0/1205469530 wait complete. 2024-09-13T17:13:06.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T17:13:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.920+0000 7f8437bc7640 1 Processor -- start 2024-09-13T17:13:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.920+0000 7f8437bc7640 1 -- start start 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8437bc7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300b1230 0x7f84300cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8437bc7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84300d13f0 0x7f84300b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8437bc7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84300ce590 con 0x7f843015fce0 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8437bc7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300b4fc0 con 0x7f84300d13f0 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8437bc7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84300ccd80 con 0x7f84300b1230 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8436164640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84300d13f0 0x7f84300b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8436164640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84300d13f0 0x7f84300b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8436164640 1 -- 172.21.15.5:0/2910839775 learned_addr learned my addr 172.21.15.5:0/2910839775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.921+0000 7f8435162640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300b1230 0x7f84300cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8436164640 1 -- 172.21.15.5:0/2910839775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300b1230 msgr2=0x7f84300cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8436164640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300b1230 0x7f84300cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8436164640 1 -- 172.21.15.5:0/2910839775 >> v1:172.21.15.179:6789/0 conn(0x7f843015fce0 legacy=0x7f84300b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8436164640 1 -- 172.21.15.5:0/2910839775 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300d3340 con 0x7f84300d13f0 2024-09-13T17:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8436164640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300d13f0 0x7f84300b4670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8428009e50 tx=0x7f842802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e2d410921676ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8434961640 1 -- 172.21.15.5:0/2910839775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842802aea0 con 0x7f84300d13f0 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8434961640 1 -- 172.21.15.5:0/2910839775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842802d050 con 0x7f84300d13f0 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.922+0000 7f8434961640 1 -- 172.21.15.5:0/2910839775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428031820 con 0x7f84300d13f0 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 -- 172.21.15.5:0/2910839775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300d13f0 msgr2=0x7f84300b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300d13f0 0x7f84300b4670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8428009e50 tx=0x7f842802a680 comp rx=0 tx=0).stop 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 -- 172.21.15.5:0/2910839775 shutdown_connections 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300d13f0 0x7f84300b4670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 --2- 172.21.15.5:0/2910839775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300b1230 0x7f84300cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 -- 172.21.15.5:0/2910839775 >> 172.21.15.5:0/2910839775 conn(0x7f8430089f90 msgr2=0x7f84300d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 -- 172.21.15.5:0/2910839775 shutdown_connections 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.923+0000 7f8437bc7640 1 -- 172.21.15.5:0/2910839775 wait complete. 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.924+0000 7f8437bc7640 1 Processor -- start 2024-09-13T17:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.924+0000 7f8437bc7640 1 -- start start 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300d13f0 0x7f843009c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f843015fce0 0x7f84301528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843009ca90 con 0x7f84300b1230 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430152e30 con 0x7f843015fce0 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8437bc7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843009f9e0 con 0x7f84300d13f0 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8435963640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8435963640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44776/0 (socket says 172.21.15.5:44776) 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8435963640 1 -- 172.21.15.5:0/1530969435 learned_addr learned my addr 172.21.15.5:0/1530969435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8435162640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300d13f0 0x7f843009c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.925+0000 7f8436164640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f843015fce0 0x7f84301528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 -- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300d13f0 msgr2=0x7f843009c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300d13f0 0x7f843009c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 -- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f843015fce0 msgr2=0x7f84301528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f843015fce0 0x7f84301528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 -- 172.21.15.5:0/1530969435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428009b30 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8435963640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c400 tx=0x7f842c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0052d0 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c005430 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843009f140 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c003830 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.926+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843009f700 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.927+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84300cea20 con 0x7f84300b1230 2024-09-13T17:13:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.927+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f842c003990 con 0x7f84300b1230 2024-09-13T17:13:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.928+0000 7f84267fc640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 0x7f841406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.928+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f842c088700 con 0x7f84300b1230 2024-09-13T17:13:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.928+0000 7f8435162640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 0x7f841406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.929+0000 7f8435162640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 0x7f841406d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843006bb00 tx=0x7f8420008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:06.933+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f842c053ab0 con 0x7f84300b1230 2024-09-13T17:13:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.102+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f84300d2cf0 con 0x7f84300b1230 2024-09-13T17:13:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:13:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.801+0000 7f84267fc640 1 -- 172.21.15.5:0/1530969435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f842c0570d0 con 0x7f84300b1230 2024-09-13T17:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.813+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 msgr2=0x7f841406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.813+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 0x7f841406d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843006bb00 tx=0x7f8420008040 comp rx=0 tx=0).stop 2024-09-13T17:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.813+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 msgr2=0x7f843009ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.813+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c400 tx=0x7f842c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 shutdown_connections 2024-09-13T17:13:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f843015fce0 0x7f84301528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84300d13f0 0x7f843009c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f841406ac00 0x7f841406d0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 --2- 172.21.15.5:0/1530969435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84300b1230 0x7f843009ea40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 >> 172.21.15.5:0/1530969435 conn(0x7f8430089f90 msgr2=0x7f84300cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 shutdown_connections 2024-09-13T17:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.815+0000 7f8437bc7640 1 -- 172.21.15.5:0/1530969435 wait complete. 2024-09-13T17:13:07.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:13:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.944+0000 7fadd94ca640 1 Processor -- start 2024-09-13T17:13:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.944+0000 7fadd94ca640 1 -- start start 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd94ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd40adf40 0x7fadd4160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd94ca640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fadd40b2230 0x7fadd406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd94ca640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd40b1ac0 con 0x7fadd40ae320 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd94ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd415d210 con 0x7fadd40adf40 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd94ca640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd415d4f0 con 0x7fadd40b2230 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd40adf40 0x7fadd4160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd40adf40 0x7fadd4160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44780/0 (socket says 172.21.15.5:44780) 2024-09-13T17:13:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 -- 172.21.15.5:0/947107692 learned_addr learned my addr 172.21.15.5:0/947107692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd37fe640 1 --2- 172.21.15.5:0/947107692 >> v2:172.21.15.179:3300/0 conn(0x7fadd40b2230 0x7fadd406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 -- 172.21.15.5:0/947107692 >> v2:172.21.15.179:3300/0 conn(0x7fadd40b2230 msgr2=0x7fadd406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/947107692 >> v2:172.21.15.179:3300/0 conn(0x7fadd40b2230 0x7fadd406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 -- 172.21.15.5:0/947107692 >> v1:172.21.15.179:6789/0 conn(0x7fadd40ae320 legacy=0x7fadd415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.945+0000 7fadd2ffd640 1 -- 172.21.15.5:0/947107692 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd415d7d0 con 0x7fadd40adf40 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.946+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/947107692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40adf40 0x7fadd4160a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadd406dd30 tx=0x7fadc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e559e05c49cdabfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.946+0000 7fadd27fc640 1 -- 172.21.15.5:0/947107692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4032440 con 0x7fadd40adf40 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.946+0000 7fadd27fc640 1 -- 172.21.15.5:0/947107692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc40325a0 con 0x7fadd40adf40 2024-09-13T17:13:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.946+0000 7fadd27fc640 1 -- 172.21.15.5:0/947107692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4032930 con 0x7fadd40adf40 2024-09-13T17:13:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 -- 172.21.15.5:0/947107692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40adf40 msgr2=0x7fadd4160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 --2- 172.21.15.5:0/947107692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40adf40 0x7fadd4160a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadd406dd30 tx=0x7fadc402a270 comp rx=0 tx=0).stop 2024-09-13T17:13:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 -- 172.21.15.5:0/947107692 shutdown_connections 2024-09-13T17:13:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 --2- 172.21.15.5:0/947107692 >> v2:172.21.15.179:3300/0 conn(0x7fadd40b2230 0x7fadd406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 --2- 172.21.15.5:0/947107692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40adf40 0x7fadd4160a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 -- 172.21.15.5:0/947107692 >> 172.21.15.5:0/947107692 conn(0x7fadd4070af0 msgr2=0x7fadd4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 -- 172.21.15.5:0/947107692 shutdown_connections 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.947+0000 7fadd94ca640 1 -- 172.21.15.5:0/947107692 wait complete. 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.948+0000 7fadd94ca640 1 Processor -- start 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.948+0000 7fadd94ca640 1 -- start start 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 0x7fadd4159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd40b2230 0x7fadd406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41590a0 con 0x7fadd40ae320 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4151340 con 0x7fadd40adf40 2024-09-13T17:13:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd414f970 con 0x7fadd40b2230 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44794/0 (socket says 172.21.15.5:44794) 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 -- 172.21.15.5:0/453121364 learned_addr learned my addr 172.21.15.5:0/453121364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd37fe640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd40b2230 0x7fadd406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 0x7fadd4159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 -- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd40b2230 msgr2=0x7fadd406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd40b2230 0x7fadd406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 -- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 msgr2=0x7fadd4159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 0x7fadd4159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 -- 172.21.15.5:0/453121364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc40094d0 con 0x7fadd40ae320 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 0x7fadd4159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcbfff640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c450 tx=0x7fadbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0052d0 con 0x7fadd40ae320 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc005430 con 0x7fadd40ae320 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd4158430 con 0x7fadd40ae320 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.949+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc012870 con 0x7fadd40ae320 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.950+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd41517e0 con 0x7fadd40ae320 2024-09-13T17:13:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.951+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd40672e0 con 0x7fadd40ae320 2024-09-13T17:13:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.951+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fadbc0129d0 con 0x7fadd40ae320 2024-09-13T17:13:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.951+0000 7fadcb7fe640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 0x7fadb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.951+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fadbc088d10 con 0x7fadd40ae320 2024-09-13T17:13:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.952+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 0x7fadb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.952+0000 7fadd2ffd640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 0x7fadb406d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadc4034000 tx=0x7fadc402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:07.956+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fadbc053fe0 con 0x7fadd40ae320 2024-09-13T17:13:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.162+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fadd4160a30 con 0x7fadd40ae320 2024-09-13T17:13:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.168+0000 7fadcb7fe640 1 -- 172.21.15.5:0/453121364 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fadbc057600 con 0x7fadd40ae320 2024-09-13T17:13:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:13:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.173+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 msgr2=0x7fadb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.173+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 0x7fadb406d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadc4034000 tx=0x7fadc402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.173+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 msgr2=0x7fadd414f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.173+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c450 tx=0x7fadbc00c910 comp rx=0 tx=0).stop 2024-09-13T17:13:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 shutdown_connections 2024-09-13T17:13:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fadd40b2230 0x7fadd406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fadb406ac00 0x7fadb406d0c0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fadc4034000 tx=0x7fadc402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd40ae320 0x7fadd414f430 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c450 tx=0x7fadbc00c910 comp rx=0 tx=0).stop 2024-09-13T17:13:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 --2- 172.21.15.5:0/453121364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fadd40adf40 0x7fadd4159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.174+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 >> 172.21.15.5:0/453121364 conn(0x7fadd4070af0 msgr2=0x7fadd4155780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.175+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 shutdown_connections 2024-09-13T17:13:08.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.175+0000 7fadd94ca640 1 -- 172.21.15.5:0/453121364 wait complete. 2024-09-13T17:13:08.197 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T17:13:08.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.302+0000 7fa8da99c640 1 Processor -- start 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.302+0000 7fa8da99c640 1 -- start start 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8da99c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8d406da90 0x7fa8d4071e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8da99c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d41696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8da99c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d416a0b0 con 0x7fa8d4169c20 2024-09-13T17:13:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8da99c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d406d120 con 0x7fa8d406da90 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8da99c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40724e0 con 0x7fa8d40ca3c0 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8d3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8d406da90 0x7fa8d4071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8d8f39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa8d4169c20 0x7fa8d4097160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59974/0 (socket says 172.21.15.5:59974) 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8d8f39640 1 -- 172.21.15.5:0/944308735 learned_addr learned my addr 172.21.15.5:0/944308735 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496153978 0 0) 0x7fa8d416a0b0 con 0x7fa8d4169c20 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.303+0000 7fa8d37fe640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d41696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc003500 con 0x7fa8d4169c20 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d3fff640 1 -- 172.21.15.5:0/944308735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 msgr2=0x7fa8d41696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d3fff640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d41696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347734197 0 0) 0x7fa8bc003500 con 0x7fa8d4169c20 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d3fff640 1 -- 172.21.15.5:0/944308735 >> v1:172.21.15.5:6789/0 conn(0x7fa8d4169c20 legacy=0x7fa8d4097160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.318+0000 7fa8d3fff640 1 -- 172.21.15.5:0/944308735 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40b11b0 con 0x7fa8d406da90 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.319+0000 7fa8d3fff640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4071e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a870 tx=0x7fa8c402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9550e58d0edbe676 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.319+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0019f0 con 0x7fa8d406da90 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.319+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c402ab60 con 0x7fa8d406da90 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.319+0000 7fa8d2ffd640 1 -- 172.21.15.5:0/944308735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4032440 con 0x7fa8d406da90 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 -- 172.21.15.5:0/944308735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 msgr2=0x7fa8d4071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4071e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a870 tx=0x7fa8c402a2e0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 -- 172.21.15.5:0/944308735 shutdown_connections 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d41696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 --2- 172.21.15.5:0/944308735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4071e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 -- 172.21.15.5:0/944308735 >> 172.21.15.5:0/944308735 conn(0x7fa8d40b37c0 msgr2=0x7fa8d40afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 -- 172.21.15.5:0/944308735 shutdown_connections 2024-09-13T17:13:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.320+0000 7fa8da99c640 1 -- 172.21.15.5:0/944308735 wait complete. 2024-09-13T17:13:08.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.321+0000 7fa8da99c640 1 Processor -- start 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.321+0000 7fa8da99c640 1 -- start start 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d406c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 0x7fa8d406c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40ad030 con 0x7fa8d406da90 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40862e0 con 0x7fa8d4169c20 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8da99c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40ac420 con 0x7fa8d40ca3c0 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44814/0 (socket says 172.21.15.5:44814) 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 -- 172.21.15.5:0/2492823402 learned_addr learned my addr 172.21.15.5:0/2492823402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d37fe640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d8f39640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 0x7fa8d406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 -- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 msgr2=0x7fa8d406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 -- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 msgr2=0x7fa8d406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 0x7fa8d406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d3fff640 1 -- 172.21.15.5:0/2492823402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c400a4b0 con 0x7fa8d406da90 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.322+0000 7fa8d8f39640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 0x7fa8d406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8d3fff640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a870 tx=0x7fa8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c403d850 con 0x7fa8d406da90 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c403d9b0 con 0x7fa8d406da90 2024-09-13T17:13:08.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40ac700 con 0x7fa8d406da90 2024-09-13T17:13:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c403dd60 con 0x7fa8d406da90 2024-09-13T17:13:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.323+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40accc0 con 0x7fa8d406da90 2024-09-13T17:13:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.324+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40ad170 con 0x7fa8d406da90 2024-09-13T17:13:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.324+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8c4039040 con 0x7fa8d406da90 2024-09-13T17:13:08.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.325+0000 7fa8d0ff9640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 0x7fa8c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.325+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8c40a9a60 con 0x7fa8d406da90 2024-09-13T17:13:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.325+0000 7fa8d37fe640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 0x7fa8c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.325+0000 7fa8d37fe640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 0x7fa8c006d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4202ff0 tx=0x7fa8c8006ff0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:08.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.329+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8d40ad170 con 0x7fa8d406da90 2024-09-13T17:13:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:08.507+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa8d40ad170 con 0x7fa8d406da90 2024-09-13T17:13:09.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.174+0000 7fa8d0ff9640 1 -- 172.21.15.5:0/2492823402 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa8d40ad170 con 0x7fa8d406da90 2024-09-13T17:13:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 msgr2=0x7fa8c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 0x7fa8c006d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4202ff0 tx=0x7fa8c8006ff0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 msgr2=0x7fa8d4085da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a870 tx=0x7fa8c40046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 shutdown_connections 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d4169c20 0x7fa8d406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d40ca3c0 0x7fa8d406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c006ac00 0x7fa8c006d0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 --2- 172.21.15.5:0/2492823402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d406da90 0x7fa8d4085da0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 >> 172.21.15.5:0/2492823402 conn(0x7fa8d40b37c0 msgr2=0x7fa8d40aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 shutdown_connections 2024-09-13T17:13:09.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.177+0000 7fa8da99c640 1 -- 172.21.15.5:0/2492823402 wait complete. 2024-09-13T17:13:09.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:13:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 Processor -- start 2024-09-13T17:13:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 -- start start 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facb01591e0 0x7facb00abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facb006da30 0x7facb006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb006e420 con 0x7facb006da30 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.306+0000 7facb6027640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb00ad050 con 0x7facb01591e0 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facb6027640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00ac440 con 0x7facb00ad4e0 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facb006da30 0x7facb006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facb006da30 0x7facb006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44826/0 (socket says 172.21.15.5:44826) 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 -- 172.21.15.5:0/368659020 learned_addr learned my addr 172.21.15.5:0/368659020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaf7fe640 1 --2- 172.21.15.5:0/368659020 >> v2:172.21.15.179:3300/0 conn(0x7facb01591e0 0x7facb00abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaeffd640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 -- 172.21.15.5:0/368659020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 msgr2=0x7facb00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb00b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 -- 172.21.15.5:0/368659020 >> v2:172.21.15.179:3300/0 conn(0x7facb01591e0 msgr2=0x7facb00abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 --2- 172.21.15.5:0/368659020 >> v2:172.21.15.179:3300/0 conn(0x7facb01591e0 0x7facb00abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaffff640 1 -- 172.21.15.5:0/368659020 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00ac720 con 0x7facb006da30 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.307+0000 7facaeffd640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facaffff640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb006da30 0x7facb006dee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facb006afb0 tx=0x7faca802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d33d4bdf6e0051 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facae7fc640 1 -- 172.21.15.5:0/368659020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8033400 con 0x7facb006da30 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facae7fc640 1 -- 172.21.15.5:0/368659020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca802f070 con 0x7facb006da30 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facae7fc640 1 -- 172.21.15.5:0/368659020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8033780 con 0x7facb006da30 2024-09-13T17:13:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 -- 172.21.15.5:0/368659020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb006da30 msgr2=0x7facb006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb006da30 0x7facb006dee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facb006afb0 tx=0x7faca802c8b0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 -- 172.21.15.5:0/368659020 shutdown_connections 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb006da30 0x7facb006dee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 --2- 172.21.15.5:0/368659020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 --2- 172.21.15.5:0/368659020 >> v2:172.21.15.179:3300/0 conn(0x7facb01591e0 0x7facb00abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 -- 172.21.15.5:0/368659020 >> 172.21.15.5:0/368659020 conn(0x7facb00ce130 msgr2=0x7facb00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 -- 172.21.15.5:0/368659020 shutdown_connections 2024-09-13T17:13:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.308+0000 7facb6027640 1 -- 172.21.15.5:0/368659020 wait complete. 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.310+0000 7facb6027640 1 Processor -- start 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.310+0000 7facb6027640 1 -- start start 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb006da30 0x7facb0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01565d0 con 0x7facb01591e0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01f1dd0 con 0x7facb006da30 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb015bcd0 con 0x7facb00ad4e0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44840/0 (socket says 172.21.15.5:44840) 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 -- 172.21.15.5:0/3837032095 learned_addr learned my addr 172.21.15.5:0/3837032095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaeffd640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaf7fe640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb006da30 0x7facb0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 -- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 msgr2=0x7facb0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 -- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb006da30 msgr2=0x7facb0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb006da30 0x7facb0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 -- 172.21.15.5:0/3837032095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009b30 con 0x7facb01591e0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facaffff640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faca8009f40 tx=0x7faca8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8009510 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca803e470 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb015bfb0 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca803e7e0 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.311+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb015c570 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.312+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb00672a0 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.313+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faca803e940 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.313+0000 7fac97fff640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 0x7fac9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.313+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7faca80aa310 con 0x7facb01591e0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.314+0000 7facaf7fe640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 0x7fac9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.314+0000 7facaf7fe640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 0x7fac9c06d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faca0006fd0 tx=0x7faca0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.317+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faca8075400 con 0x7facb01591e0 2024-09-13T17:13:09.397 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-09-13T17:13:09.395+0000 7f474e9a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:13:09.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:09.487+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7facb015d840 con 0x7facb01591e0 2024-09-13T17:13:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.181+0000 7fac97fff640 1 -- 172.21.15.5:0/3837032095 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7faca8078a20 con 0x7facb01591e0 2024-09-13T17:13:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2024-09-13T17:13:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.187+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 msgr2=0x7fac9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.187+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 0x7fac9c06d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faca0006fd0 tx=0x7faca0008040 comp rx=0 tx=0).stop 2024-09-13T17:13:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.187+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 msgr2=0x7facb0070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.187+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faca8009f40 tx=0x7faca8004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 shutdown_connections 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac9c06ac00 0x7fac9c06d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facb01591e0 0x7facb0070fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facb00ad4e0 0x7facb0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 --2- 172.21.15.5:0/3837032095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb006da30 0x7facb0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.190+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 >> 172.21.15.5:0/3837032095 conn(0x7facb00ce130 msgr2=0x7facb00add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.191+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 shutdown_connections 2024-09-13T17:13:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.191+0000 7facb6027640 1 -- 172.21.15.5:0/3837032095 wait complete. 2024-09-13T17:13:11.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T17:13:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.319+0000 7f1a88753640 1 Processor -- start 2024-09-13T17:13:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.319+0000 7f1a88753640 1 -- start start 2024-09-13T17:13:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a88753640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a80098de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a88753640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a800d10d0 0x7f1a800b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a88753640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a80099320 con 0x7f1a800b0600 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a88753640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800995d0 con 0x7f1a800d10d0 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a88753640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80099890 con 0x7f1a80098a00 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a86cf0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1a800b0600 0x7f1a800b0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59978/0 (socket says 172.21.15.5:59978) 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a86cf0640 1 -- 172.21.15.5:0/4045330493 learned_addr learned my addr 172.21.15.5:0/4045330493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a864ef640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a80098de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a85cee640 1 --2- 172.21.15.5:0/4045330493 >> v2:172.21.15.179:3300/0 conn(0x7f1a800d10d0 0x7f1a800b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319747260 0 0) 0x7f1a80099320 con 0x7f1a800b0600 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a68003520 con 0x7f1a800b0600 2024-09-13T17:13:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766307656 0 0) 0x7f1a68003520 con 0x7f1a800b0600 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 msgr2=0x7f1a80098de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a80098de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 >> v2:172.21.15.179:3300/0 conn(0x7f1a800d10d0 msgr2=0x7f1a800b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 --2- 172.21.15.5:0/4045330493 >> v2:172.21.15.179:3300/0 conn(0x7f1a800d10d0 0x7f1a800b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80099b70 con 0x7f1a800b0600 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.320+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f1a78001670 con 0x7f1a800b0600 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 >> v1:172.21.15.5:6789/0 conn(0x7f1a800b0600 legacy=0x7f1a800b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a68003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a68003ef0 0x7f1a680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68004d00 0x7f1a68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800995d0 con 0x7f1a68003ef0 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80099890 con 0x7f1a68004d00 2024-09-13T17:13:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6800b980 con 0x7f1a80098a00 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a68003ef0 0x7f1a680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a864ef640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a68003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a86cf0640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68004d00 0x7f1a68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 -- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 msgr2=0x7f1a68003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80098a00 0x7f1a68003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 -- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68004d00 msgr2=0x7f1a68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68004d00 0x7f1a68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.321+0000 7f1a85cee640 1 -- 172.21.15.5:0/4045330493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68003520 con 0x7f1a68003ef0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.322+0000 7f1a85cee640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a68003ef0 0x7f1a680047c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a800d0340 tx=0x7f1a680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3273dac3df9f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.322+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74031400 con 0x7f1a68003ef0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.322+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7402d050 con 0x7f1a68003ef0 2024-09-13T17:13:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.322+0000 7f1a854ed640 1 -- 172.21.15.5:0/4045330493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74031780 con 0x7f1a68003ef0 2024-09-13T17:13:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 -- 172.21.15.5:0/4045330493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a68003ef0 msgr2=0x7f1a680047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 --2- 172.21.15.5:0/4045330493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a68003ef0 0x7f1a680047c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a800d0340 tx=0x7f1a680057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a86cf0640 1 -- 172.21.15.5:0/4045330493 reap_dead start 2024-09-13T17:13:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 -- 172.21.15.5:0/4045330493 shutdown_connections 2024-09-13T17:13:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 -- 172.21.15.5:0/4045330493 >> 172.21.15.5:0/4045330493 conn(0x7f1a800d03a0 msgr2=0x7f1a800d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 -- 172.21.15.5:0/4045330493 shutdown_connections 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.323+0000 7f1a88753640 1 -- 172.21.15.5:0/4045330493 wait complete. 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.324+0000 7f1a88753640 1 Processor -- start 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.324+0000 7f1a88753640 1 -- start start 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68003ef0 0x7f1a80158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80155dd0 0x7f1a80157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80159820 con 0x7f1a800b3400 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801570b0 con 0x7f1a68003ef0 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a88753640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80157390 con 0x7f1a80155dd0 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a86cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a86cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44846/0 (socket says 172.21.15.5:44846) 2024-09-13T17:13:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a86cf0640 1 -- 172.21.15.5:0/3133119493 learned_addr learned my addr 172.21.15.5:0/3133119493 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a85cee640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80155dd0 0x7f1a80157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a864ef640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68003ef0 0x7f1a80158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.325+0000 7f1a86cf0640 1 -- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80155dd0 msgr2=0x7f1a80157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a86cf0640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80155dd0 0x7f1a80157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a86cf0640 1 -- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68003ef0 msgr2=0x7f1a80158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a86cf0640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68003ef0 0x7f1a80158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a86cf0640 1 -- 172.21.15.5:0/3133119493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80157670 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a86cf0640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a800715e0 tx=0x7f1a78007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800f700 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800f880 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800fc30 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a800b3df0 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.326+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a80159460 con 0x7f1a800b3400 2024-09-13T17:13:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.327+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a800ae530 con 0x7f1a800b3400 2024-09-13T17:13:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.327+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a7800fd90 con 0x7f1a800b3400 2024-09-13T17:13:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.328+0000 7f1a7effd640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 0x7f1a6c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.328+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1a780893d0 con 0x7f1a800b3400 2024-09-13T17:13:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.328+0000 7f1a864ef640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 0x7f1a6c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.329+0000 7f1a864ef640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 0x7f1a6c06d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a70014430 tx=0x7f1a7000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.332+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a78054390 con 0x7f1a800b3400 2024-09-13T17:13:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:11.504+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1a800ceec0 con 0x7f1a800b3400 2024-09-13T17:13:11.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:13:11.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:13:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.186+0000 7f1a7effd640 1 -- 172.21.15.5:0/3133119493 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a780579b0 con 0x7f1a800b3400 2024-09-13T17:13:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T17:13:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.194+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 msgr2=0x7f1a6c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.194+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 0x7f1a6c06d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a70014430 tx=0x7f1a7000b040 comp rx=0 tx=0).stop 2024-09-13T17:13:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.194+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 msgr2=0x7f1a800b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.194+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a800715e0 tx=0x7f1a78007430 comp rx=0 tx=0).stop 2024-09-13T17:13:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 shutdown_connections 2024-09-13T17:13:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1a6c06ac30 0x7f1a6c06d0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a800b3400 0x7f1a800b38b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a80155dd0 0x7f1a80157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 --2- 172.21.15.5:0/3133119493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68003ef0 0x7f1a80158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.197+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 >> 172.21.15.5:0/3133119493 conn(0x7f1a800d03a0 msgr2=0x7f1a800d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:12.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.199+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 shutdown_connections 2024-09-13T17:13:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.200+0000 7f1a88753640 1 -- 172.21.15.5:0/3133119493 wait complete. 2024-09-13T17:13:12.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T17:13:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.324+0000 7fb5a75ec640 1 Processor -- start 2024-09-13T17:13:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.324+0000 7fb5a75ec640 1 -- start start 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a75ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5a015c6e0 0x7fb5a00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a75ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a00cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a75ec640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00cf980 con 0x7fb5a01602c0 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a75ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00d0630 con 0x7fb5a015c6e0 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a75ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00d0910 con 0x7fb5a00cf000 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5a015c6e0 0x7fb5a00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5a015c6e0 0x7fb5a00cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44858/0 (socket says 172.21.15.5:44858) 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 -- 172.21.15.5:0/689198820 learned_addr learned my addr 172.21.15.5:0/689198820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a4b87640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a00cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 -- 172.21.15.5:0/689198820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 msgr2=0x7fb5a00cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a00cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 -- 172.21.15.5:0/689198820 >> v1:172.21.15.179:6789/0 conn(0x7fb5a01602c0 legacy=0x7fb5a0160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.325+0000 7fb5a5388640 1 -- 172.21.15.5:0/689198820 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00d0bf0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.326+0000 7fb5a5388640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a00cde60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb594009870 tx=0x7fb59402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693b7f995d80230f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.326+0000 7fb593fff640 1 -- 172.21.15.5:0/689198820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594032440 con 0x7fb5a015c6e0 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.326+0000 7fb593fff640 1 -- 172.21.15.5:0/689198820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5940325a0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.326+0000 7fb593fff640 1 -- 172.21.15.5:0/689198820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594032930 con 0x7fb5a015c6e0 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 -- 172.21.15.5:0/689198820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 msgr2=0x7fb5a00cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a00cde60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb594009870 tx=0x7fb59402a270 comp rx=0 tx=0).stop 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 -- 172.21.15.5:0/689198820 shutdown_connections 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a00cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/689198820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a00cde60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 -- 172.21.15.5:0/689198820 >> 172.21.15.5:0/689198820 conn(0x7fb5a0089f90 msgr2=0x7fb5a00d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 -- 172.21.15.5:0/689198820 shutdown_connections 2024-09-13T17:13:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.327+0000 7fb5a75ec640 1 -- 172.21.15.5:0/689198820 wait complete. 2024-09-13T17:13:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.328+0000 7fb5a75ec640 1 Processor -- start 2024-09-13T17:13:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.328+0000 7fb5a75ec640 1 -- start start 2024-09-13T17:13:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5a01602c0 0x7fb5a0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a01594b0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0156100 con 0x7fb5a01602c0 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a75ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a015e880 con 0x7fb5a00cf000 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44868/0 (socket says 172.21.15.5:44868) 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 -- 172.21.15.5:0/1903708801 learned_addr learned my addr 172.21.15.5:0/1903708801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a5388640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a5b89640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5a01602c0 0x7fb5a0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 -- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 msgr2=0x7fb5a0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a0155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 -- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5a01602c0 msgr2=0x7fb5a0158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.329+0000 7fb5a4b87640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5a01602c0 0x7fb5a0158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb5a4b87640 1 -- 172.21.15.5:0/1903708801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940094d0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb5a4b87640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00d800 tx=0x7fb59c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00b6c0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00b840 con 0x7fb5a015c6e0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a015eb20 con 0x7fb5a015c6e0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00bbf0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.330+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a015f0e0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.331+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00672e0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.332+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb59c00bd50 con 0x7fb5a015c6e0 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.332+0000 7fb591ffb640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 0x7fb58406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.332+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb59c089ae0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.332+0000 7fb5a5388640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 0x7fb58406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.333+0000 7fb5a5388640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 0x7fb58406d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb594034000 tx=0x7fb59402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.337+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb59c054aa0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.547+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb5a015f300 con 0x7fb5a015c6e0 2024-09-13T17:13:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.552+0000 7fb591ffb640 1 -- 172.21.15.5:0/1903708801 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb59c0580c0 con 0x7fb5a015c6e0 2024-09-13T17:13:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2024-09-13T17:13:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 msgr2=0x7fb58406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 0x7fb58406d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb594034000 tx=0x7fb59402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 msgr2=0x7fb5a0158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00d800 tx=0x7fb59c00dcc0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 shutdown_connections 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5a01602c0 0x7fb5a0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb58406ac00 0x7fb58406d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5a015c6e0 0x7fb5a0158a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 --2- 172.21.15.5:0/1903708801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5a00cf000 0x7fb5a0155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 >> 172.21.15.5:0/1903708801 conn(0x7fb5a0089f90 msgr2=0x7fb5a00b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 shutdown_connections 2024-09-13T17:13:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.555+0000 7fb5a75ec640 1 -- 172.21.15.5:0/1903708801 wait complete. 2024-09-13T17:13:12.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 Processor -- start 2024-09-13T17:13:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 -- start start 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f966406e090 0x7f96640ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f96640ab5a0 0x7f96640b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96640ab9f0 con 0x7f966415a3e0 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966406e4d0 con 0x7f966406e090 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.670+0000 7f966aa12640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966406d410 con 0x7f96640ab5a0 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f966406e090 0x7f96640ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f966406e090 0x7f96640ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44882/0 (socket says 172.21.15.5:44882) 2024-09-13T17:13:12.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 -- 172.21.15.5:0/2084964212 learned_addr learned my addr 172.21.15.5:0/2084964212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f9668faf640 1 --2- 172.21.15.5:0/2084964212 >> v2:172.21.15.179:3300/0 conn(0x7f96640ab5a0 0x7f96640b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 -- 172.21.15.5:0/2084964212 >> v2:172.21.15.179:3300/0 conn(0x7f96640ab5a0 msgr2=0x7f96640b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 --2- 172.21.15.5:0/2084964212 >> v2:172.21.15.179:3300/0 conn(0x7f96640ab5a0 0x7f96640b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 -- 172.21.15.5:0/2084964212 >> v1:172.21.15.179:6789/0 conn(0x7f966415a3e0 legacy=0x7f966406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.671+0000 7f96637fe640 1 -- 172.21.15.5:0/2084964212 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966406cb70 con 0x7f966406e090 2024-09-13T17:13:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f96637fe640 1 --2- 172.21.15.5:0/2084964212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406e090 0x7f96640ab060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f966406b990 tx=0x7f965802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b37c799c9459937 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f9662ffd640 1 -- 172.21.15.5:0/2084964212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658032440 con 0x7f966406e090 2024-09-13T17:13:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f9662ffd640 1 -- 172.21.15.5:0/2084964212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96580325a0 con 0x7f966406e090 2024-09-13T17:13:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f9662ffd640 1 -- 172.21.15.5:0/2084964212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658032930 con 0x7f966406e090 2024-09-13T17:13:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 -- 172.21.15.5:0/2084964212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406e090 msgr2=0x7f96640ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 --2- 172.21.15.5:0/2084964212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406e090 0x7f96640ab060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f966406b990 tx=0x7f965802a270 comp rx=0 tx=0).stop 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 -- 172.21.15.5:0/2084964212 shutdown_connections 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 --2- 172.21.15.5:0/2084964212 >> v2:172.21.15.179:3300/0 conn(0x7f96640ab5a0 0x7f96640b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 --2- 172.21.15.5:0/2084964212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406e090 0x7f96640ab060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 -- 172.21.15.5:0/2084964212 >> 172.21.15.5:0/2084964212 conn(0x7f96640ce0d0 msgr2=0x7f96640ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 -- 172.21.15.5:0/2084964212 shutdown_connections 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.672+0000 7f966aa12640 1 -- 172.21.15.5:0/2084964212 wait complete. 2024-09-13T17:13:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 Processor -- start 2024-09-13T17:13:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 -- start start 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966406e090 0x7f9664149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640ab5a0 0x7f96640ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966414bd60 con 0x7f966415a3e0 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664149940 con 0x7f96640ab5a0 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.674+0000 7f966aa12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966414e510 con 0x7f966406e090 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44892/0 (socket says 172.21.15.5:44892) 2024-09-13T17:13:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 -- 172.21.15.5:0/1325685340 learned_addr learned my addr 172.21.15.5:0/1325685340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f96637fe640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640ab5a0 0x7f96640ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9663fff640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966406e090 0x7f9664149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 -- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966406e090 msgr2=0x7f9664149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966406e090 0x7f9664149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 -- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640ab5a0 msgr2=0x7f96640ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640ab5a0 0x7f96640ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 -- 172.21.15.5:0/1325685340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580094d0 con 0x7f966415a3e0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9668faf640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f965c007e40 tx=0x7f965c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c014620 con 0x7f966415a3e0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00ee90 con 0x7f966415a3e0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966414b6e0 con 0x7f966415a3e0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0149e0 con 0x7f966415a3e0 2024-09-13T17:13:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.675+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966414e230 con 0x7f966415a3e0 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.676+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966414bea0 con 0x7f966415a3e0 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.677+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f965c014b40 con 0x7f966415a3e0 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.677+0000 7f9660ff9640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 0x7f965006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.677+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f965c089e60 con 0x7f966415a3e0 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.677+0000 7f9663fff640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 0x7f965006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.678+0000 7f9663fff640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 0x7f965006d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96641f3260 tx=0x7f9654009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.681+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f966414bea0 con 0x7f966415a3e0 2024-09-13T17:13:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.887+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f966414bea0 con 0x7f966415a3e0 2024-09-13T17:13:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.887+0000 7f9660ff9640 1 -- 172.21.15.5:0/1325685340 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4721 (secure 0 0 0) 0x7f966414bea0 con 0x7f966415a3e0 2024-09-13T17:13:12.889 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:12.889 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:12.548695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:13:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-09-13T17:13:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 msgr2=0x7f965006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 0x7f965006d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96641f3260 tx=0x7f9654009040 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 msgr2=0x7f96640ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f965c007e40 tx=0x7f965c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 shutdown_connections 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f965006ac00 0x7f965006d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415a3e0 0x7f96640ae8a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96640ab5a0 0x7f96640ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 --2- 172.21.15.5:0/1325685340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966406e090 0x7f9664149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 >> 172.21.15.5:0/1325685340 conn(0x7f96640ce0d0 msgr2=0x7f9664150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 shutdown_connections 2024-09-13T17:13:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:12.889+0000 7f966aa12640 1 -- 172.21.15.5:0/1325685340 wait complete. 2024-09-13T17:13:12.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.001+0000 7fd7a8384640 1 Processor -- start 2024-09-13T17:13:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.001+0000 7fd7a8384640 1 -- start start 2024-09-13T17:13:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.002+0000 7fd7a8384640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7a00ccdc0 0x7fd7a00cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.002+0000 7fd7a8384640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7a00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.002+0000 7fd7a8384640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a00701d0 con 0x7fd7a006e420 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.002+0000 7fd7a8384640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a00704b0 con 0x7fd7a00ccdc0 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.002+0000 7fd7a8384640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00ccc00 con 0x7fd7a00cd8b0 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a591f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd7a006e420 0x7fd7a00cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59986/0 (socket says 172.21.15.5:59986) 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a591f640 1 -- 172.21.15.5:0/1919030516 learned_addr learned my addr 172.21.15.5:0/1919030516 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 --2- 172.21.15.5:0/1919030516 >> v2:172.21.15.179:3300/0 conn(0x7fd7a00ccdc0 0x7fd7a00cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6921640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7a00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954520959 0 0) 0x7fd7a00701d0 con 0x7fd7a006e420 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd788003520 con 0x7fd7a006e420 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799143871 0 0) 0x7fd788003520 con 0x7fd7a006e420 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 msgr2=0x7fd7a00b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7a00b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 >> v2:172.21.15.179:3300/0 conn(0x7fd7a00ccdc0 msgr2=0x7fd7a00cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 --2- 172.21.15.5:0/1919030516 >> v2:172.21.15.179:3300/0 conn(0x7fd7a00ccdc0 0x7fd7a00cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00cfc70 con 0x7fd7a006e420 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd794001670 con 0x7fd7a006e420 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 >> v1:172.21.15.5:6789/0 conn(0x7fd7a006e420 legacy=0x7fd7a00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd788003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd788004d00 0x7fd788005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00704b0 con 0x7fd788003970 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00ccc00 con 0x7fd788004d00 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78800b9b0 con 0x7fd7a00cd8b0 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd788003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a591f640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6921640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd788004d00 0x7fd788005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 -- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 msgr2=0x7fd7880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a00cd8b0 0x7fd7880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 -- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd788004d00 msgr2=0x7fd788005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd788004d00 0x7fd788005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.003+0000 7fd7a6120640 1 -- 172.21.15.5:0/1919030516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788003520 con 0x7fd788003970 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.004+0000 7fd7a6120640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd788003d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd790009fc0 tx=0x7fd7880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec48072f2882e516 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.004+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790031670 con 0x7fd788003970 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.004+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79000f040 con 0x7fd788003970 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.004+0000 7fd7a511e640 1 -- 172.21.15.5:0/1919030516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790031a10 con 0x7fd788003970 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 -- 172.21.15.5:0/1919030516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 msgr2=0x7fd788003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 --2- 172.21.15.5:0/1919030516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd788003d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd790009fc0 tx=0x7fd7880057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a6921640 1 -- 172.21.15.5:0/1919030516 reap_dead start 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 -- 172.21.15.5:0/1919030516 shutdown_connections 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 -- 172.21.15.5:0/1919030516 >> 172.21.15.5:0/1919030516 conn(0x7fd7a00b1fa0 msgr2=0x7fd7a00b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 -- 172.21.15.5:0/1919030516 shutdown_connections 2024-09-13T17:13:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.005+0000 7fd7a8384640 1 -- 172.21.15.5:0/1919030516 wait complete. 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.006+0000 7fd7a8384640 1 Processor -- start 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.006+0000 7fd7a8384640 1 -- start start 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 0x7fd7a0140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 0x7fd7a013ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a01416e0 con 0x7fd788003970 2024-09-13T17:13:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a014ecc0 con 0x7fd7a013e4c0 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a8384640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a014efa0 con 0x7fd7a0141260 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44906/0 (socket says 172.21.15.5:44906) 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 -- 172.21.15.5:0/2217539561 learned_addr learned my addr 172.21.15.5:0/2217539561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a591f640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 0x7fd7a0140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6921640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 0x7fd7a013ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 -- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 msgr2=0x7fd7a013ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 0x7fd7a013ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 -- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 msgr2=0x7fd7a0140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 0x7fd7a0140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 -- 172.21.15.5:0/2217539561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00adc20 con 0x7fd788003970 2024-09-13T17:13:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a591f640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 0x7fd7a0140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6921640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 0x7fd7a013ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.007+0000 7fd7a6120640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd79002af10 tx=0x7fd790009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.008+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790003b90 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.008+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790040070 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.008+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790004030 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.008+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a00adf00 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.008+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a014dfc0 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.009+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a013f9d0 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.009+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd790042070 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.009+0000 7fd79effd640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 0x7fd78c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.010+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7900aaa80 con 0x7fd788003970 2024-09-13T17:13:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.010+0000 7fd7a591f640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 0x7fd78c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.010+0000 7fd7a591f640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 0x7fd78c06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7a01f3730 tx=0x7fd794009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.014+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd790075970 con 0x7fd788003970 2024-09-13T17:13:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.184+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7a015a760 con 0x7fd788003970 2024-09-13T17:13:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.185+0000 7fd79effd640 1 -- 172.21.15.5:0/2217539561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd79004a070 con 0x7fd788003970 2024-09-13T17:13:13.187 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:13.187 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 msgr2=0x7fd78c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 0x7fd78c06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7a01f3730 tx=0x7fd794009040 comp rx=0 tx=0).stop 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 msgr2=0x7fd7a00ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd79002af10 tx=0x7fd790009750 comp rx=0 tx=0).stop 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 shutdown_connections 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a0141260 0x7fd7a013ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a013e4c0 0x7fd7a0140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd78c06ac00 0x7fd78c06d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 --2- 172.21.15.5:0/2217539561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788003970 0x7fd7a00ae700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.187+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 >> 172.21.15.5:0/2217539561 conn(0x7fd7a00b1fa0 msgr2=0x7fd7a00b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.188+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 shutdown_connections 2024-09-13T17:13:13.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.188+0000 7fd7a8384640 1 -- 172.21.15.5:0/2217539561 wait complete. 2024-09-13T17:13:13.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.300+0000 7f5a0959c640 1 Processor -- start 2024-09-13T17:13:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.300+0000 7f5a0959c640 1 -- start start 2024-09-13T17:13:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a0959c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a04156f40 0x7f5a0415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a0959c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f5a040aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a0959c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040b2390 con 0x7f5a040b1080 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a0959c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a040b14c0 con 0x7f5a04156f40 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a0959c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b1780 con 0x7f5a0406e1c0 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f59fa7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a040b1080 0x7f5a0406dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60002/0 (socket says 172.21.15.5:60002) 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f59fa7fc640 1 -- 172.21.15.5:0/2750819123 learned_addr learned my addr 172.21.15.5:0/2750819123 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/2750819123 >> v2:172.21.15.179:3300/0 conn(0x7f5a04156f40 0x7f5a0415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a037fe640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f5a040aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922127881 0 0) 0x7f5a040b2390 con 0x7f5a040b1080 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f0003520 con 0x7f5a040b1080 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2054416983 0 0) 0x7f59f0003520 con 0x7f5a040b1080 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 msgr2=0x7f5a040aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f5a040aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 >> v2:172.21.15.179:3300/0 conn(0x7f5a04156f40 msgr2=0x7f5a0415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 --2- 172.21.15.5:0/2750819123 >> v2:172.21.15.179:3300/0 conn(0x7f5a04156f40 0x7f5a0415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040b1a60 con 0x7f5a040b1080 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f59ec001670 con 0x7f5a040b1080 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 >> v1:172.21.15.5:6789/0 conn(0x7f5a040b1080 legacy=0x7f5a0406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f0003970 0x7f59f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f00047c0 0x7f59f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.301+0000 7f5a027fc640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f59f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b14c0 con 0x7f59f0003970 2024-09-13T17:13:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a040b1780 con 0x7f59f00047c0 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f000b980 con 0x7f5a0406e1c0 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f0003970 0x7f59f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f59fa7fc640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f00047c0 0x7f59f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a037fe640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f59f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 -- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 msgr2=0x7f59f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a0406e1c0 0x7f59f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 -- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f00047c0 msgr2=0x7f59f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59f00047c0 0x7f59f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.302+0000 7f5a02ffd640 1 -- 172.21.15.5:0/2750819123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f0003520 con 0x7f59f0003970 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f0003970 0x7f59f0003d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009aa0 tx=0x7f59f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8788bc042837f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4031400 con 0x7f59f0003970 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f402d050 con 0x7f59f0003970 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a027fc640 1 -- 172.21.15.5:0/2750819123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40317a0 con 0x7f59f0003970 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 -- 172.21.15.5:0/2750819123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f0003970 msgr2=0x7f59f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 --2- 172.21.15.5:0/2750819123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59f0003970 0x7f59f0003d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009aa0 tx=0x7f59f00057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a037fe640 1 -- 172.21.15.5:0/2750819123 reap_dead start 2024-09-13T17:13:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 -- 172.21.15.5:0/2750819123 shutdown_connections 2024-09-13T17:13:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 -- 172.21.15.5:0/2750819123 >> 172.21.15.5:0/2750819123 conn(0x7f5a040ce0d0 msgr2=0x7f5a040ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 -- 172.21.15.5:0/2750819123 shutdown_connections 2024-09-13T17:13:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.303+0000 7f5a0959c640 1 -- 172.21.15.5:0/2750819123 wait complete. 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.304+0000 7f5a0959c640 1 Processor -- start 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 -- start start 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59f0003970 0x7f5a04156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a041f6920 0x7f5a040ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0414db20 con 0x7f5a041f5f60 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0414b3f0 con 0x7f5a041f6920 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f5a0959c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041f6db0 con 0x7f59f0003970 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f59fa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.305+0000 7f59fa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44922/0 (socket says 172.21.15.5:44922) 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 -- 172.21.15.5:0/1529550495 learned_addr learned my addr 172.21.15.5:0/1529550495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59f0003970 0x7f5a04156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f5a037fe640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a041f6920 0x7f5a040ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 -- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59f0003970 msgr2=0x7f5a04156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59f0003970 0x7f5a04156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 -- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a041f6920 msgr2=0x7f5a040ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a041f6920 0x7f5a040ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 -- 172.21.15.5:0/1529550495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0414dfb0 con 0x7f5a041f5f60 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fa7fc640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59ec007310 tx=0x7f59ec0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00f940 con 0x7f5a041f5f60 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00fac0 con 0x7f5a041f5f60 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0414b110 con 0x7f5a041f5f60 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00fe70 con 0x7f5a041f5f60 2024-09-13T17:13:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.306+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0414d7b0 con 0x7f5a041f5f60 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.307+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0414dcd0 con 0x7f5a041f5f60 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.308+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59ec01d460 con 0x7f5a041f5f60 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.308+0000 7f59fbfff640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.308+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59ec089700 con 0x7f5a041f5f60 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.308+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.309+0000 7f5a02ffd640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 0x7f59e406d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59f4033000 tx=0x7f59f4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.312+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a0414dcd0 con 0x7f5a041f5f60 2024-09-13T17:13:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.485+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0414dcd0 con 0x7f5a041f5f60 2024-09-13T17:13:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.486+0000 7f59fbfff640 1 -- 172.21.15.5:0/1529550495 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f5a0414dcd0 con 0x7f5a041f5f60 2024-09-13T17:13:13.487 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:13.487 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.487+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 msgr2=0x7f59e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.487+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 0x7f59e406d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59f4033000 tx=0x7f59f4008030 comp rx=0 tx=0).stop 2024-09-13T17:13:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 msgr2=0x7f5a041f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59ec007310 tx=0x7f59ec0077d0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 shutdown_connections 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a041f6920 0x7f5a040ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59e406ac00 0x7f59e406d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a041f5f60 0x7f5a041f63e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 --2- 172.21.15.5:0/1529550495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59f0003970 0x7f5a04156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 >> 172.21.15.5:0/1529550495 conn(0x7f5a040ce0d0 msgr2=0x7f5a04157740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 shutdown_connections 2024-09-13T17:13:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.488+0000 7f5a0959c640 1 -- 172.21.15.5:0/1529550495 wait complete. 2024-09-13T17:13:13.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.618+0000 7f729222b640 1 Processor -- start 2024-09-13T17:13:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.618+0000 7f729222b640 1 -- start start 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f729222b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f728c06e1c0 0x7f728c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f729222b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f728c15a290 0x7f728c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f729222b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c0b2390 con 0x7f728c156f40 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f729222b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c15a700 con 0x7f728c06e1c0 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f729222b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0b1780 con 0x7f728c15a290 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f728c06e1c0 0x7f728c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f728c156f40 0x7f728c06dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41908/0 (socket says 172.21.15.5:41908) 2024-09-13T17:13:13.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728b7fe640 1 -- 172.21.15.5:0/695802370 learned_addr learned my addr 172.21.15.5:0/695802370 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728bfff640 1 --2- 172.21.15.5:0/695802370 >> v2:172.21.15.179:3300/0 conn(0x7f728c15a290 0x7f728c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728affd640 1 -- 172.21.15.5:0/695802370 >> v2:172.21.15.179:3300/0 conn(0x7f728c15a290 msgr2=0x7f728c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728affd640 1 --2- 172.21.15.5:0/695802370 >> v2:172.21.15.179:3300/0 conn(0x7f728c15a290 0x7f728c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728affd640 1 -- 172.21.15.5:0/695802370 >> v1:172.21.15.5:6789/0 conn(0x7f728c156f40 legacy=0x7f728c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728a7fc640 1 -- 172.21.15.5:0/695802370 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752690451 0 0) 0x7f728c0b2390 con 0x7f728c156f40 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.619+0000 7f728affd640 1 -- 172.21.15.5:0/695802370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0b1a60 con 0x7f728c06e1c0 2024-09-13T17:13:13.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.620+0000 7f728affd640 1 --2- 172.21.15.5:0/695802370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c0aced0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f728c06b8f0 tx=0x7f728002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa931ece9766b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.620+0000 7f728a7fc640 1 -- 172.21.15.5:0/695802370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280032440 con 0x7f728c06e1c0 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.620+0000 7f728a7fc640 1 -- 172.21.15.5:0/695802370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800325a0 con 0x7f728c06e1c0 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.620+0000 7f728a7fc640 1 -- 172.21.15.5:0/695802370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280032930 con 0x7f728c06e1c0 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 -- 172.21.15.5:0/695802370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 msgr2=0x7f728c0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 --2- 172.21.15.5:0/695802370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c0aced0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f728c06b8f0 tx=0x7f728002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 -- 172.21.15.5:0/695802370 shutdown_connections 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 --2- 172.21.15.5:0/695802370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c0aced0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 --2- 172.21.15.5:0/695802370 >> v2:172.21.15.179:3300/0 conn(0x7f728c15a290 0x7f728c0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 -- 172.21.15.5:0/695802370 >> 172.21.15.5:0/695802370 conn(0x7f728c0ce0d0 msgr2=0x7f728c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 -- 172.21.15.5:0/695802370 shutdown_connections 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.621+0000 7f729222b640 1 -- 172.21.15.5:0/695802370 wait complete. 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.622+0000 7f729222b640 1 Processor -- start 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.622+0000 7f729222b640 1 -- start start 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f728c156f40 0x7f728c0979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f728c15a290 0x7f728c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c097f20 con 0x7f728c06e1c0 2024-09-13T17:13:13.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ae090 con 0x7f728c15a290 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f729222b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ae370 con 0x7f728c156f40 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46200/0 (socket says 172.21.15.5:46200) 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 -- 172.21.15.5:0/455937416 learned_addr learned my addr 172.21.15.5:0/455937416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728affd640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f728c156f40 0x7f728c0979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728bfff640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f728c15a290 0x7f728c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 -- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f728c156f40 msgr2=0x7f728c0979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f728c156f40 0x7f728c0979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 -- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f728c15a290 msgr2=0x7f728c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f728c15a290 0x7f728c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 -- 172.21.15.5:0/455937416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7280009400 con 0x7f728c06e1c0 2024-09-13T17:13:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.623+0000 7f728b7fe640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4d0 tx=0x7f727c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.624+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0074e0 con 0x7f728c06e1c0 2024-09-13T17:13:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.624+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c007660 con 0x7f728c06e1c0 2024-09-13T17:13:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.624+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c0aeac0 con 0x7f728c06e1c0 2024-09-13T17:13:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.624+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c004a20 con 0x7f728c06e1c0 2024-09-13T17:13:13.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.624+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c0af080 con 0x7f728c06e1c0 2024-09-13T17:13:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.625+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c0672a0 con 0x7f728c06e1c0 2024-09-13T17:13:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.625+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f727c004b80 con 0x7f728c06e1c0 2024-09-13T17:13:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.625+0000 7f7273fff640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 0x7f727806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.626+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f727c088aa0 con 0x7f728c06e1c0 2024-09-13T17:13:13.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.626+0000 7f728affd640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 0x7f727806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.626+0000 7f728affd640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 0x7f727806d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7280034000 tx=0x7f728002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.630+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f727c053a40 con 0x7f728c06e1c0 2024-09-13T17:13:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.835+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f728c0af270 con 0x7f728c06e1c0 2024-09-13T17:13:13.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.836+0000 7f7273fff640 1 -- 172.21.15.5:0/455937416 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4721 (secure 0 0 0) 0x7f727c018020 con 0x7f728c06e1c0 2024-09-13T17:13:13.837 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:13.837 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:12.548695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:13:13.838 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-09-13T17:13:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 msgr2=0x7f727806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 0x7f727806d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7280034000 tx=0x7f728002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 msgr2=0x7f728c1494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4d0 tx=0x7f727c00c990 comp rx=0 tx=0).stop 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 shutdown_connections 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f728c15a290 0x7f728c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f728c156f40 0x7f728c0979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f727806ac00 0x7f727806d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 --2- 172.21.15.5:0/455937416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f728c06e1c0 0x7f728c1494c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 >> 172.21.15.5:0/455937416 conn(0x7f728c0ce0d0 msgr2=0x7f728c154310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 shutdown_connections 2024-09-13T17:13:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.838+0000 7f729222b640 1 -- 172.21.15.5:0/455937416 wait complete. 2024-09-13T17:13:13.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.950+0000 7f4d6728b640 1 Processor -- start 2024-09-13T17:13:13.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.950+0000 7f4d6728b640 1 -- start start 2024-09-13T17:13:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d6728b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d600cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d6728b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d600d0e30 0x7f4d6006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d6728b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600704a0 con 0x7f4d6015fd80 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d6728b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6006cc10 con 0x7f4d600d0e30 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d6728b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600d12c0 con 0x7f4d60099110 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d600d0e30 0x7f4d6006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d600d0e30 0x7f4d6006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46216/0 (socket says 172.21.15.5:46216) 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 -- 172.21.15.5:0/928792434 learned_addr learned my addr 172.21.15.5:0/928792434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d64826640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d600cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 -- 172.21.15.5:0/928792434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 msgr2=0x7f4d600cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d600cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 -- 172.21.15.5:0/928792434 >> v1:172.21.15.179:6789/0 conn(0x7f4d6015fd80 legacy=0x7f4d60098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.951+0000 7f4d65828640 1 -- 172.21.15.5:0/928792434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6006bd80 con 0x7f4d600d0e30 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d65828640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d6006e870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009e80 tx=0x7f4d5802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb5199d6e8d584 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d57fff640 1 -- 172.21.15.5:0/928792434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5802aea0 con 0x7f4d600d0e30 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d57fff640 1 -- 172.21.15.5:0/928792434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5802d050 con 0x7f4d600d0e30 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d57fff640 1 -- 172.21.15.5:0/928792434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58031820 con 0x7f4d600d0e30 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d6728b640 1 -- 172.21.15.5:0/928792434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 msgr2=0x7f4d6006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.952+0000 7f4d6728b640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d6006e870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009e80 tx=0x7f4d5802a6c0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 -- 172.21.15.5:0/928792434 shutdown_connections 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d6006e870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 --2- 172.21.15.5:0/928792434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d600cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 -- 172.21.15.5:0/928792434 >> 172.21.15.5:0/928792434 conn(0x7f4d600d0310 msgr2=0x7f4d600d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 -- 172.21.15.5:0/928792434 shutdown_connections 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.953+0000 7f4d6728b640 1 -- 172.21.15.5:0/928792434 wait complete. 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 Processor -- start 2024-09-13T17:13:13.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 -- start start 2024-09-13T17:13:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d6015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6015fd80 0x7f4d6015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601e4f90 con 0x7f4d600d0e30 2024-09-13T17:13:13.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601e5270 con 0x7f4d6015fd80 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.954+0000 7f4d6728b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601e5550 con 0x7f4d60099110 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46222/0 (socket says 172.21.15.5:46222) 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 -- 172.21.15.5:0/2266973682 learned_addr learned my addr 172.21.15.5:0/2266973682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d65828640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6015fd80 0x7f4d6015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d65027640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d6015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 -- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 msgr2=0x7f4d6015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d6015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 -- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6015fd80 msgr2=0x7f4d6015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6015fd80 0x7f4d6015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 -- 172.21.15.5:0/2266973682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009b30 con 0x7f4d600d0e30 2024-09-13T17:13:13.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d64826640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e840 tx=0x7f4d5000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000c730 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000c890 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000cc40 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.955+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d601e5830 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.956+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6015b3c0 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.956+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d601e8ef0 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.957+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d50013470 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.957+0000 7f4d55ffb640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 0x7f4d4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.957+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d50089620 con 0x7f4d600d0e30 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.958+0000 7f4d65027640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 0x7f4d4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:13.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.958+0000 7f4d65027640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 0x7f4d4406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c000f60 tx=0x7f4d5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:13.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:13.961+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d500545b0 con 0x7f4d600d0e30 2024-09-13T17:13:14.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.134+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d6006cf50 con 0x7f4d600d0e30 2024-09-13T17:13:14.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.135+0000 7f4d55ffb640 1 -- 172.21.15.5:0/2266973682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f4d50057bd0 con 0x7f4d600d0e30 2024-09-13T17:13:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:14.136 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 msgr2=0x7f4d4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 0x7f4d4406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c000f60 tx=0x7f4d5c009040 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 msgr2=0x7f4d600b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e840 tx=0x7f4d5000ed00 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 shutdown_connections 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d6015fd80 0x7f4d6015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d4406ac00 0x7f4d4406d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d600d0e30 0x7f4d600b3c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 --2- 172.21.15.5:0/2266973682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d60099110 0x7f4d6015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 >> 172.21.15.5:0/2266973682 conn(0x7f4d600d0310 msgr2=0x7f4d600cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 shutdown_connections 2024-09-13T17:13:14.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.137+0000 7f4d6728b640 1 -- 172.21.15.5:0/2266973682 wait complete. 2024-09-13T17:13:14.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:13:08.163883+0000', 'modified': '2024-09-13T17:13:12.548695+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6836/90966651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 90966651}, {'type': 'v1', 'addr': '172.21.15.179:6836', 'nonce': 90966651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T17:13:14.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:13:14.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:13:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.659+0000 7f118737d640 1 Processor -- start 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.659+0000 7f118737d640 1 -- start start 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159290 0x7f1180159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 0x7f1180070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11800b1970 0x7f1180070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11800b1580 con 0x7f11800b1970 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11800b2ad0 con 0x7f1180159bb0 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118737d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11800b1ec0 con 0x7f1180159290 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11800b1970 0x7f1180070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11800b1970 0x7f1180070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46228/0 (socket says 172.21.15.5:46228) 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 -- 172.21.15.5:0/1735865026 learned_addr learned my addr 172.21.15.5:0/1735865026 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f1184918640 1 --2- 172.21.15.5:0/1735865026 >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 0x7f1180070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f1185119640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159290 0x7f1180159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 -- 172.21.15.5:0/1735865026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159290 msgr2=0x7f1180159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159290 0x7f1180159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 -- 172.21.15.5:0/1735865026 >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 msgr2=0x7f1180070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 --2- 172.21.15.5:0/1735865026 >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 0x7f1180070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f118591a640 1 -- 172.21.15.5:0/1735865026 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800b21a0 con 0x7f11800b1970 2024-09-13T17:13:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.660+0000 7f1184918640 1 --2- 172.21.15.5:0/1735865026 >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 0x7f1180070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.661+0000 7f118591a640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11800b1970 0x7f1180070fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f118006ba30 tx=0x7f117802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4242475f141888 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.661+0000 7f1177fff640 1 -- 172.21.15.5:0/1735865026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117802f070 con 0x7f11800b1970 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.661+0000 7f1177fff640 1 -- 172.21.15.5:0/1735865026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117800b2e0 con 0x7f11800b1970 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.661+0000 7f1177fff640 1 -- 172.21.15.5:0/1735865026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178009820 con 0x7f11800b1970 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 -- 172.21.15.5:0/1735865026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11800b1970 msgr2=0x7f1180070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11800b1970 0x7f1180070fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f118006ba30 tx=0x7f117802c8a0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 -- 172.21.15.5:0/1735865026 shutdown_connections 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11800b1970 0x7f1180070fc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 --2- 172.21.15.5:0/1735865026 >> v2:172.21.15.179:3300/0 conn(0x7f1180159bb0 0x7f1180070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 --2- 172.21.15.5:0/1735865026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159290 0x7f1180159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 -- 172.21.15.5:0/1735865026 >> 172.21.15.5:0/1735865026 conn(0x7f11800ce0d0 msgr2=0x7f11800ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 -- 172.21.15.5:0/1735865026 shutdown_connections 2024-09-13T17:13:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.662+0000 7f118737d640 1 -- 172.21.15.5:0/1735865026 wait complete. 2024-09-13T17:13:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.663+0000 7f118737d640 1 Processor -- start 2024-09-13T17:13:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.663+0000 7f118737d640 1 -- start start 2024-09-13T17:13:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11800b1970 0x7f11801edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159bb0 0x7f1180150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11801ee110 con 0x7f1180159290 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118014d0e0 con 0x7f11800b1970 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118737d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118014cdb0 con 0x7f1180159bb0 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46238/0 (socket says 172.21.15.5:46238) 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 -- 172.21.15.5:0/934049185 learned_addr learned my addr 172.21.15.5:0/934049185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f118591a640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159bb0 0x7f1180150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1185119640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11800b1970 0x7f11801edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 -- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159bb0 msgr2=0x7f1180150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159bb0 0x7f1180150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 -- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11800b1970 msgr2=0x7f11801edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11800b1970 0x7f11801edbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.664+0000 7f1184918640 1 -- 172.21.15.5:0/934049185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117800bd40 con 0x7f1180159290 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f1184918640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f117000e810 tx=0x7f117000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f1175ffb640 1 -- 172.21.15.5:0/934049185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170004230 con 0x7f1180159290 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f1175ffb640 1 -- 172.21.15.5:0/934049185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170004390 con 0x7f1180159290 2024-09-13T17:13:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800b30e0 con 0x7f1180159290 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f1175ffb640 1 -- 172.21.15.5:0/934049185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000c8b0 con 0x7f1180159290 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.665+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11800acab0 con 0x7f1180159290 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.666+0000 7f1175ffb640 1 -- 172.21.15.5:0/934049185 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f117000ca10 con 0x7f1180159290 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.667+0000 7f1175ffb640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 0x7f116406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.667+0000 7f1175ffb640 1 -- 172.21.15.5:0/934049185 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11700890b0 con 0x7f1180159290 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.667+0000 7f1185119640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 0x7f116406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.668+0000 7f1185119640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 0x7f116406d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f117c006fd0 tx=0x7f117c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.668+0000 7f118a0a1740 1 Processor -- start 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.668+0000 7f118a0a1740 1 -- start start 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc1a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc17860 0x55e40fc67570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb747c0 con 0x55e40fc41550 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb83b70 con 0x55e40fc17860 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb81300 con 0x55e40fc1a0a0 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46240/0 (socket says 172.21.15.5:46240) 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 -- 172.21.15.5:0/2178033226 learned_addr learned my addr 172.21.15.5:0/2178033226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f1185119640 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc1a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f1184918640 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc17860 0x55e40fc67570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 -- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 msgr2=0x55e40fc1a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc1a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 -- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc17860 msgr2=0x55e40fc67570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc17860 0x55e40fc67570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 -- 172.21.15.5:0/2178033226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40fb094b0 con 0x55e40fc41550 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f118591a640 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117800d240 tx=0x7f1178031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db07ee10df20f513 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f116affd640 1 -- 172.21.15.5:0/2178033226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780097e0 con 0x55e40fc41550 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f116affd640 1 -- 172.21.15.5:0/2178033226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178042070 con 0x55e40fc41550 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.669+0000 7f116affd640 1 -- 172.21.15.5:0/2178033226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178009b40 con 0x55e40fc41550 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- 172.21.15.5:0/2178033226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 msgr2=0x55e40fc67ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f117800d240 tx=0x7f1178031000 comp rx=0 tx=0).stop 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- 172.21.15.5:0/2178033226 shutdown_connections 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc67ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc17860 0x55e40fc67570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 --2- 172.21.15.5:0/2178033226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc1a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- 172.21.15.5:0/2178033226 >> 172.21.15.5:0/2178033226 conn(0x55e40fc167d0 msgr2=0x55e40fc5ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- 172.21.15.5:0/2178033226 shutdown_connections 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- 172.21.15.5:0/2178033226 wait complete. 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.670+0000 7f118a0a1740 1 -- start start 2024-09-13T17:13:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 Processor -- start 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc3f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc66d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb7cbf0 con 0x55e40fc41550 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb3b250 con 0x55e40fc66890 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.671+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb3aef0 con 0x55e40fc1a0a0 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f118a0a1740 10 client.0 _ll_register_callbacks cb 0x55e40fb6d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46244/0 (socket says 172.21.15.5:46244) 2024-09-13T17:13:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 -- 172.21.15.5:0/4090404697 learned_addr learned my addr 172.21.15.5:0/4090404697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1185119640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc3f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f118591a640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc66d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 -- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 msgr2=0x55e40fc3f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc3f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 -- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 msgr2=0x55e40fc66d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc66d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 -- 172.21.15.5:0/4090404697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11800b21a0 con 0x55e40fc41550 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f1184918640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f117000c4c0 tx=0x7f1170006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275475ac16a1b35c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f115ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117005fbb0 con 0x55e40fc41550 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e40f8703c0 con 0x55e40fc41550 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f117005fd10 con 0x55e40fc41550 2024-09-13T17:13:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1170053af0 con 0x55e40fc41550 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f118a0a1740 10 client.4404 fetch_fsmap learned FSMap version 7 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e40fb7b270 con 0x55e40fc41550 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.672+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170073070 con 0x55e40fc41550 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f1170053c50 con 0x55e40fc41550 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 20 client.4404 populate_metadata read hostname 'smithi005' 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc64a00 0x55e40fc64de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 4 client.4404 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 --> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e40f8816c0 con 0x55e40fc64a00 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f1185119640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc64a00 0x55e40fc64de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f115ffff640 10 client.4404 ms_handle_connect on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.673+0000 7f1185119640 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc64a00 0x55e40fc64de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a7fb284e18b41 server_cookie=88733b32e89c8d40 in_seq=0 out_seq=0 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f115ffff640 1 -- 172.21.15.5:0/4090404697 <== mds.0 v2:172.21.15.179:6834/90966651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e40f8816c0 con 0x55e40fc64a00 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f115ffff640 10 client.4404 handle_command_reply: tid=0 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 client.4404 shutdown 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 msgr2=0x55e40fc3f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f117000c4c0 tx=0x7f1170006ed0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 shutdown_connections 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc64a00 0x55e40fc64de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc66d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc3f790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f115ffff640 0 client.4404 ms_handle_reset on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 --2- 172.21.15.5:0/4090404697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc3f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 >> 172.21.15.5:0/4090404697 conn(0x55e40fc17860 msgr2=0x55e40fc5f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 shutdown_connections 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 1 -- 172.21.15.5:0/4090404697 wait complete. 2024-09-13T17:13:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.674+0000 7f118a0a1740 20 client.4404 trim_cache size 0 max 16384 2024-09-13T17:13:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.689+0000 7f118a0a1740 1 Processor -- start 2024-09-13T17:13:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.689+0000 7f118a0a1740 1 -- start start 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc5ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fc15220 con 0x55e40fc41550 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fb00460 con 0x55e40fc66890 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40fc15680 con 0x55e40fc1a0a0 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46254/0 (socket says 172.21.15.5:46254) 2024-09-13T17:13:14.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 -- 172.21.15.5:0/1922163458 learned_addr learned my addr 172.21.15.5:0/1922163458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1185119640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc5ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 -- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 msgr2=0x55e40fc5ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc5ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118591a640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 -- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 msgr2=0x55e40fc192c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc192c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1184918640 1 -- 172.21.15.5:0/1922163458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40fb1d5f0 con 0x55e40fc41550 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f1185119640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc5ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.690+0000 7f118591a640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f1184918640 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f117005fb10 tx=0x7f1170015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdbd60dd6187d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f116b7fe640 1 -- 172.21.15.5:0/1922163458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170054040 con 0x55e40fc41550 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f116b7fe640 1 -- 172.21.15.5:0/1922163458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170073070 con 0x55e40fc41550 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f116b7fe640 1 -- 172.21.15.5:0/1922163458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170053af0 con 0x55e40fc41550 2024-09-13T17:13:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 -- 172.21.15.5:0/1922163458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 msgr2=0x55e40fc18d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f117005fb10 tx=0x7f1170015070 comp rx=0 tx=0).stop 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 -- 172.21.15.5:0/1922163458 shutdown_connections 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc66890 0x55e40fc192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc41550 0x55e40fc18d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 --2- 172.21.15.5:0/1922163458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc1a0a0 0x55e40fc5ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 -- 172.21.15.5:0/1922163458 >> 172.21.15.5:0/1922163458 conn(0x55e40fc17860 msgr2=0x55e40fc5f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 -- 172.21.15.5:0/1922163458 shutdown_connections 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.691+0000 7f118a0a1740 1 -- 172.21.15.5:0/1922163458 wait complete. 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.692+0000 7f118a0a1740 1 -- start start 2024-09-13T17:13:14.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.692+0000 7f118a0a1740 1 Processor -- start 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc41550 0x55e40fc3bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc66890 0x55e40fc3c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fc19680 con 0x55e40fc1a0a0 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40fc14810 con 0x55e40fc41550 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40fc14a50 con 0x55e40fc66890 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118a0a1740 10 client.0 _ll_register_callbacks cb 0x7f11780071f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46262/0 (socket says 172.21.15.5:46262) 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 -- 172.21.15.5:0/3660110934 learned_addr learned my addr 172.21.15.5:0/3660110934 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f118591a640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc66890 0x55e40fc3c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1184918640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc41550 0x55e40fc3bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 -- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc66890 msgr2=0x55e40fc3c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc66890 0x55e40fc3c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 -- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc41550 msgr2=0x55e40fc3bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc41550 0x55e40fc3bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 -- 172.21.15.5:0/3660110934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e40fb7b270 con 0x55e40fc1a0a0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f1185119640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f117c010d20 tx=0x7f117c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b27e2530258a4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.693+0000 7f115ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c029070 con 0x55e40fc1a0a0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f117c004240 con 0x55e40fc1a0a0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1178042070 con 0x55e40fc1a0a0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f117c004400 con 0x55e40fc1a0a0 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 10 client.4410 fetch_fsmap learned FSMap version 7 2024-09-13T17:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e40fb42d00 con 0x55e40fc1a0a0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178042070 con 0x55e40fc1a0a0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f117c02ab00 con 0x55e40fc1a0a0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 10 client.4410 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 20 client.4410 populate_metadata read hostname 'smithi005' 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc77ef0 0x55e40fc782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 4 client.4410 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 --> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e40f8d4d10 con 0x55e40fc77ef0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.694+0000 7f1184918640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc77ef0 0x55e40fc782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f115ffff640 10 client.4410 ms_handle_connect on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f1184918640 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc77ef0 0x55e40fc782d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f7dd28edd33a4c server_cookie=85889cfb81d4ec in_seq=0 out_seq=0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f115ffff640 1 -- 172.21.15.5:0/3660110934 <== mds.0 v2:172.21.15.179:6834/90966651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55e40f8d4d10 con 0x55e40fc77ef0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f115ffff640 10 client.4410 handle_command_reply: tid=0 2024-09-13T17:13:14.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 client.4410 shutdown 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 msgr2=0x55e40fcc9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f117c010d20 tx=0x7f117c004730 comp rx=0 tx=0).stop 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 shutdown_connections 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e40fc66890 0x55e40fc3c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55e40fc77ef0 0x55e40fc782d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e40fc41550 0x55e40fc3bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 --2- 172.21.15.5:0/3660110934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e40fc1a0a0 0x55e40fcc9790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f115ffff640 0 client.4410 ms_handle_reset on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 >> 172.21.15.5:0/3660110934 conn(0x55e40fc17860 msgr2=0x55e40fc3d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 shutdown_connections 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 1 -- 172.21.15.5:0/3660110934 wait complete. 2024-09-13T17:13:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.695+0000 7f118a0a1740 20 client.4410 trim_cache size 0 max 16384 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4276, 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.529408954, 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2024-09-13T17:13:14.704 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2024-09-13T17:13:14.705 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T17:13:14.705 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 12.301839065999999 2024-09-13T17:13:14.705 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 msgr2=0x7f116406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 0x7f116406d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f117c006fd0 tx=0x7f117c008040 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 msgr2=0x7f11800abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f117000e810 tx=0x7f117000ecd0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 shutdown_connections 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1180159bb0 0x7f1180150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f116406ac00 0x7f116406d0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1180159290 0x7f11800abf80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 --2- 172.21.15.5:0/934049185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11800b1970 0x7f11801edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 >> 172.21.15.5:0/934049185 conn(0x7f11800ce0d0 msgr2=0x7f118014f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 shutdown_connections 2024-09-13T17:13:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.696+0000 7f118737d640 1 -- 172.21.15.5:0/934049185 wait complete. 2024-09-13T17:13:14.708 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:14.708 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:14.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:13:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.808+0000 7f696bbed640 1 Processor -- start 2024-09-13T17:13:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.808+0000 7f696bbed640 1 -- start start 2024-09-13T17:13:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f696415fd80 0x7f69640cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69640d0e30 0x7f6964098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6964098f40 0x7f69640ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640993f0 con 0x7f696415fd80 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696406cc10 con 0x7f6964098f40 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696bbed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640704a0 con 0x7f69640d0e30 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f696415fd80 0x7f69640cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f696415fd80 0x7f69640cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46272/0 (socket says 172.21.15.5:46272) 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 -- 172.21.15.5:0/4033746861 learned_addr learned my addr 172.21.15.5:0/4033746861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f696a18a640 1 --2- 172.21.15.5:0/4033746861 >> v2:172.21.15.179:3300/0 conn(0x7f6964098f40 0x7f69640ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969188640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69640d0e30 0x7f6964098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 -- 172.21.15.5:0/4033746861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69640d0e30 msgr2=0x7f6964098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69640d0e30 0x7f6964098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 -- 172.21.15.5:0/4033746861 >> v2:172.21.15.179:3300/0 conn(0x7f6964098f40 msgr2=0x7f69640ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 --2- 172.21.15.5:0/4033746861 >> v2:172.21.15.179:3300/0 conn(0x7f6964098f40 0x7f69640ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.809+0000 7f6969989640 1 -- 172.21.15.5:0/4033746861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696406bd80 con 0x7f696415fd80 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.810+0000 7f6969989640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f696415fd80 0x7f69640cfd30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6964067840 tx=0x7f696002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772c11277f85ee67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.810+0000 7f6968987640 1 -- 172.21.15.5:0/4033746861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696002ae90 con 0x7f696415fd80 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.810+0000 7f6968987640 1 -- 172.21.15.5:0/4033746861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960032440 con 0x7f696415fd80 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.810+0000 7f6968987640 1 -- 172.21.15.5:0/4033746861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69600327d0 con 0x7f696415fd80 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 -- 172.21.15.5:0/4033746861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f696415fd80 msgr2=0x7f69640cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f696415fd80 0x7f69640cfd30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6964067840 tx=0x7f696002a140 comp rx=0 tx=0).stop 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 -- 172.21.15.5:0/4033746861 shutdown_connections 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 --2- 172.21.15.5:0/4033746861 >> v2:172.21.15.179:3300/0 conn(0x7f6964098f40 0x7f69640ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69640d0e30 0x7f6964098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 --2- 172.21.15.5:0/4033746861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f696415fd80 0x7f69640cfd30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 -- 172.21.15.5:0/4033746861 >> 172.21.15.5:0/4033746861 conn(0x7f69640d0310 msgr2=0x7f69640d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 -- 172.21.15.5:0/4033746861 shutdown_connections 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.811+0000 7f696bbed640 1 -- 172.21.15.5:0/4033746861 wait complete. 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.812+0000 7f696bbed640 1 Processor -- start 2024-09-13T17:13:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.812+0000 7f696bbed640 1 -- start start 2024-09-13T17:13:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 0x7f69641567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696415fd80 0x7f69640b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c55b0 con 0x7f69640d0e30 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640afb20 con 0x7f6964098f40 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696bbed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c4f60 con 0x7f696415fd80 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46284/0 (socket says 172.21.15.5:46284) 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969989640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 0x7f69641567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 -- 172.21.15.5:0/3251862201 learned_addr learned my addr 172.21.15.5:0/3251862201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f696a18a640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696415fd80 0x7f69640b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 -- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696415fd80 msgr2=0x7f69640b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696415fd80 0x7f69640b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 -- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 msgr2=0x7f69641567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 0x7f69641567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 -- 172.21.15.5:0/3251862201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600094d0 con 0x7f69640d0e30 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969989640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 0x7f69641567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.813+0000 7f6969188640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f695400d7d0 tx=0x7f695400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.814+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954018070 con 0x7f69640d0e30 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.814+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954004020 con 0x7f69640d0e30 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.814+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640c5240 con 0x7f69640d0e30 2024-09-13T17:13:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.814+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540041b0 con 0x7f69640d0e30 2024-09-13T17:13:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.814+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69640afe00 con 0x7f69640d0e30 2024-09-13T17:13:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.815+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696406c1f0 con 0x7f69640d0e30 2024-09-13T17:13:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.815+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6954004310 con 0x7f69640d0e30 2024-09-13T17:13:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.815+0000 7f695a7fc640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 0x7f694806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.816+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6954089360 con 0x7f69640d0e30 2024-09-13T17:13:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.816+0000 7f6969989640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 0x7f694806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.816+0000 7f6969989640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 0x7f694806d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6960034000 tx=0x7f696002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:14.820+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f696406c1f0 con 0x7f69640d0e30 2024-09-13T17:13:15.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.024+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f696406c1f0 con 0x7f69640d0e30 2024-09-13T17:13:15.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.025+0000 7f695a7fc640 1 -- 172.21.15.5:0/3251862201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f696406c1f0 con 0x7f69640d0e30 2024-09-13T17:13:15.026 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 msgr2=0x7f694806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 0x7f694806d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6960034000 tx=0x7f696002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 msgr2=0x7f69640b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f695400d7d0 tx=0x7f695400dc90 comp rx=0 tx=0).stop 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 shutdown_connections 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696415fd80 0x7f69640b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f694806ac00 0x7f694806d0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69640d0e30 0x7f69640b3c00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 --2- 172.21.15.5:0/3251862201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6964098f40 0x7f69641567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 >> 172.21.15.5:0/3251862201 conn(0x7f69640d0310 msgr2=0x7f69640ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 shutdown_connections 2024-09-13T17:13:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:15.027+0000 7f696bbed640 1 -- 172.21.15.5:0/3251862201 wait complete. 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:15.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:13:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.040 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:15.056 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:15.057 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:13:15.058 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:13:15.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:15.058 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:15.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:13:15.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-09-13T17:13:15.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-09-13T17:13:15.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:13:15.059 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:15.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.217 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:15.243 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:13:15.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.245 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:13:15.313 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:13:15.313 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:15.313 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:13:15.314 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:13:15.314 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:15.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:13:15.315 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:15.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.573 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:13:15.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.590 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-13T17:13:15.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.646 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:15.646 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:15.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:13:15.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T17:13:15.647 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:15.726 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T17:13:15.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.726 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:15.726 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:15.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T17:13:15.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:15.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T17:13:15.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T17:13:15.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T17:13:15.727 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:15.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:15.860 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:15.860 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:15.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:13:15.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:13:15.860 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:15.899 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T17:13:15.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:15.899 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:15.956 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:13:15.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:15.957 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:16.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:16.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:16.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:16.146 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:16.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.147 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:16.204 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:13:16.204 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T17:13:16.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:16.272 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:16.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:16.337 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:16.338 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:16.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.339 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:16.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2024-09-13T17:13:16.340+0000 7fb2ea94d480 -1 init, newargv = 0x56006a5fa6f0 newargc=15 2024-09-13T17:13:16.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[42871]: starting ceph client 2024-09-13T17:13:16.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[42871]: starting fuse 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:13:16.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:13:16.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:16.358 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:13:16.358 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:13:16.358 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:13:16.359 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2024-09-13T17:13:16.360 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:13:16.474 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.42871.asok 2024-09-13T17:13:16.660 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42871.asok 2024-09-13T17:13:16.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42871.asok status 2024-09-13T17:13:16.797 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:13:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:13:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "42871", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4422, 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:13:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4422 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2442559171 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2442559171 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4422 192.168.0.1:0/2442559171", 2024-09-13T17:13:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2442559171", 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 7, 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 25, 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:13:16.800 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:13:16.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.806 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:13:16.806 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:16.822 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:13:16.822 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:16.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:16.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:16.890 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T17:13:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2024-09-13T17:13:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T17:13:16.971 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:16.971 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:13:16.971 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:13:17.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.167+0000 7fbfc289d640 1 Processor -- start 2024-09-13T17:13:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.167+0000 7fbfc289d640 1 -- start start 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc289d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc289d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc289d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0b1580 con 0x7fbfbc159290 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc289d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc071410 con 0x7fbfbc070fc0 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc289d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0b2ad0 con 0x7fbfbc0b1970 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfbb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:54820/0 (socket says 172.21.15.5:54820) 2024-09-13T17:13:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfbb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:57188/0 (socket says 172.21.15.5:57188) 2024-09-13T17:13:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfbbfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbfbc159290 0x7fbfbc159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:55906/0 (socket says 172.21.15.5:55906) 2024-09-13T17:13:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 -- 172.21.15.5:0/3941283095 learned_addr learned my addr 172.21.15.5:0/3941283095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 -- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 msgr2=0x7fbfbc070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 -- 172.21.15.5:0/3941283095 >> v1:172.21.15.179:6789/0 conn(0x7fbfbc159290 legacy=0x7fbfbc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfc0e3a640 1 -- 172.21.15.5:0/3941283095 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0b1ec0 con 0x7fbfbc070fc0 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.168+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.169+0000 7fbfc0e3a640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400d150 tx=0x7fbfb402c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60dc54483ed2e069 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.169+0000 7fbfbaffd640 1 -- 172.21.15.5:0/3941283095 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40337a0 con 0x7fbfbc070fc0 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.169+0000 7fbfbaffd640 1 -- 172.21.15.5:0/3941283095 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4033900 con 0x7fbfbc070fc0 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.169+0000 7fbfbaffd640 1 -- 172.21.15.5:0/3941283095 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4033c90 con 0x7fbfbc070fc0 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 -- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc070fc0 msgr2=0x7fbfbc06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400d150 tx=0x7fbfb402c930 comp rx=0 tx=0).stop 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 -- 172.21.15.5:0/3941283095 shutdown_connections 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc070fc0 0x7fbfbc06c9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 --2- 172.21.15.5:0/3941283095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b1970 0x7fbfbc070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 -- 172.21.15.5:0/3941283095 >> 172.21.15.5:0/3941283095 conn(0x7fbfbc0ce0d0 msgr2=0x7fbfbc0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 -- 172.21.15.5:0/3941283095 shutdown_connections 2024-09-13T17:13:17.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.170+0000 7fbfc289d640 1 -- 172.21.15.5:0/3941283095 wait complete. 2024-09-13T17:13:17.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.171+0000 7fbfc289d640 1 Processor -- start 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.171+0000 7fbfc289d640 1 -- start start 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 0x7fbfbc1ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc159290 0x7fbfbc1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc099cd0 con 0x7fbfbc0b1970 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0987d0 con 0x7fbfbc159290 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc289d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc144a80 con 0x7fbfbc070fc0 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46298/0 (socket says 172.21.15.5:46298) 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 -- 172.21.15.5:0/1176078464 learned_addr learned my addr 172.21.15.5:0/1176078464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 0x7fbfbc1ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfc0e3a640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc159290 0x7fbfbc1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 -- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 msgr2=0x7fbfbc1ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 0x7fbfbc1ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 -- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc159290 msgr2=0x7fbfbc1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc159290 0x7fbfbc1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbb7fe640 1 -- 172.21.15.5:0/1176078464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009400 con 0x7fbfbc0b1970 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.172+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 0x7fbfbc1ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000ebe0 tx=0x7fbfb000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0009760 con 0x7fbfbc0b1970 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000cc30 con 0x7fbfbc0b1970 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000eee0 con 0x7fbfbc0b1970 2024-09-13T17:13:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb400bd40 con 0x7fbfbc0b1970 2024-09-13T17:13:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.173+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc0984f0 con 0x7fbfbc0b1970 2024-09-13T17:13:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.174+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc0672a0 con 0x7fbfbc0b1970 2024-09-13T17:13:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.174+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfb0013470 con 0x7fbfbc0b1970 2024-09-13T17:13:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.175+0000 7fbfb8ff9640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.175+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfb0089940 con 0x7fbfbc0b1970 2024-09-13T17:13:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.175+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.176+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 0x7fbfa806d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbfac007fd0 tx=0x7fbfac007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.179+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbfb0054820 con 0x7fbfbc0b1970 2024-09-13T17:13:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.358+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfbc0b2f60 con 0x7fbfbc0b1970 2024-09-13T17:13:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.359+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/1176078464 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fbfb0057e40 con 0x7fbfbc0b1970 2024-09-13T17:13:17.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:17.362 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 msgr2=0x7fbfa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 0x7fbfa806d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbfac007fd0 tx=0x7fbfac007d40 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 msgr2=0x7fbfbc151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000ebe0 tx=0x7fbfb000c520 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 shutdown_connections 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc159290 0x7fbfbc1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbfa806ac00 0x7fbfa806d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc0b1970 0x7fbfbc151060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 --2- 172.21.15.5:0/1176078464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc070fc0 0x7fbfbc1ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 >> 172.21.15.5:0/1176078464 conn(0x7fbfbc0ce0d0 msgr2=0x7fbfbc06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 shutdown_connections 2024-09-13T17:13:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.361+0000 7fbfc289d640 1 -- 172.21.15.5:0/1176078464 wait complete. 2024-09-13T17:13:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:17.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.476+0000 7f57827d5640 1 Processor -- start 2024-09-13T17:13:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 -- start start 2024-09-13T17:13:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f577c15c6e0 0x7f577c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f577c0cf440 0x7f577c1609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0d0630 con 0x7f577c0cf000 2024-09-13T17:13:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0d0910 con 0x7f577c15c6e0 2024-09-13T17:13:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f57827d5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0d0bf0 con 0x7f577c0cf440 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.477+0000 7f577bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f577c15c6e0 0x7f577c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f577c15c6e0 0x7f577c0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46304/0 (socket says 172.21.15.5:46304) 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 -- 172.21.15.5:0/3951598118 learned_addr learned my addr 172.21.15.5:0/3951598118 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f5780d72640 1 --2- 172.21.15.5:0/3951598118 >> v2:172.21.15.179:3300/0 conn(0x7f577c0cf440 0x7f577c1609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 -- 172.21.15.5:0/3951598118 >> v2:172.21.15.179:3300/0 conn(0x7f577c0cf440 msgr2=0x7f577c1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 --2- 172.21.15.5:0/3951598118 >> v2:172.21.15.179:3300/0 conn(0x7f577c0cf440 0x7f577c1609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 -- 172.21.15.5:0/3951598118 >> v1:172.21.15.179:6789/0 conn(0x7f577c0cf000 legacy=0x7f577c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.478+0000 7f577bfff640 1 -- 172.21.15.5:0/3951598118 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0d0ed0 con 0x7f577c15c6e0 2024-09-13T17:13:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f577bfff640 1 --2- 172.21.15.5:0/3951598118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c15c6e0 0x7f577c0cde60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f577c0d0140 tx=0x7f576c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cad1ae95f053ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f577affd640 1 -- 172.21.15.5:0/3951598118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c032440 con 0x7f577c15c6e0 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f577affd640 1 -- 172.21.15.5:0/3951598118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c0325a0 con 0x7f577c15c6e0 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f577affd640 1 -- 172.21.15.5:0/3951598118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c032930 con 0x7f577c15c6e0 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 -- 172.21.15.5:0/3951598118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c15c6e0 msgr2=0x7f577c0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 --2- 172.21.15.5:0/3951598118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c15c6e0 0x7f577c0cde60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f577c0d0140 tx=0x7f576c02a230 comp rx=0 tx=0).stop 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 -- 172.21.15.5:0/3951598118 shutdown_connections 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 --2- 172.21.15.5:0/3951598118 >> v2:172.21.15.179:3300/0 conn(0x7f577c0cf440 0x7f577c1609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 --2- 172.21.15.5:0/3951598118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c15c6e0 0x7f577c0cde60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 -- 172.21.15.5:0/3951598118 >> 172.21.15.5:0/3951598118 conn(0x7f577c089f90 msgr2=0x7f577c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 -- 172.21.15.5:0/3951598118 shutdown_connections 2024-09-13T17:13:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.479+0000 7f57827d5640 1 -- 172.21.15.5:0/3951598118 wait complete. 2024-09-13T17:13:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.481+0000 7f57827d5640 1 Processor -- start 2024-09-13T17:13:17.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.481+0000 7f57827d5640 1 -- start start 2024-09-13T17:13:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.481+0000 7f57827d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cf440 0x7f577c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c15c6e0 0x7f577c15f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0b69f0 con 0x7f577c0cf000 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c154200 con 0x7f577c0cf440 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c15d4c0 con 0x7f577c15c6e0 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46314/0 (socket says 172.21.15.5:46314) 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 -- 172.21.15.5:0/100914073 learned_addr learned my addr 172.21.15.5:0/100914073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577b7fe640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cf440 0x7f577c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f5780d72640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c15c6e0 0x7f577c15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 -- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c15c6e0 msgr2=0x7f577c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c15c6e0 0x7f577c15f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 -- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cf440 msgr2=0x7f577c0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cf440 0x7f577c0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 -- 172.21.15.5:0/100914073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0094d0 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f577bfff640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f576c02a270 tx=0x7f576c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c030b80 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c030ce0 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c15d7a0 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c03d680 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.482+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c15dd60 con 0x7f577c0cf000 2024-09-13T17:13:17.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.484+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0672e0 con 0x7f577c0cf000 2024-09-13T17:13:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.484+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f576c039040 con 0x7f577c0cf000 2024-09-13T17:13:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.484+0000 7f5778ff9640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 0x7f576806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.484+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f576c0aa2d0 con 0x7f577c0cf000 2024-09-13T17:13:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.485+0000 7f577b7fe640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 0x7f576806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.485+0000 7f577b7fe640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 0x7f576806d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f577c0ce860 tx=0x7f5770009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.489+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f576c075250 con 0x7f577c0cf000 2024-09-13T17:13:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.657+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f577c0d01c0 con 0x7f577c0cf000 2024-09-13T17:13:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.658+0000 7f5778ff9640 1 -- 172.21.15.5:0/100914073 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f576c078870 con 0x7f577c0cf000 2024-09-13T17:13:17.661 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 msgr2=0x7f576806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 0x7f576806d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f577c0ce860 tx=0x7f5770009040 comp rx=0 tx=0).stop 2024-09-13T17:13:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 msgr2=0x7f577c153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f576c02a270 tx=0x7f576c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 shutdown_connections 2024-09-13T17:13:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f577c15c6e0 0x7f577c15f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cf440 0x7f577c0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f576806ac30 0x7f576806d0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 --2- 172.21.15.5:0/100914073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f577c0cf000 0x7f577c153cc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 >> 172.21.15.5:0/100914073 conn(0x7f577c089f90 msgr2=0x7f577c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 shutdown_connections 2024-09-13T17:13:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.660+0000 7f57827d5640 1 -- 172.21.15.5:0/100914073 wait complete. 2024-09-13T17:13:17.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:17.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.775+0000 7f5738c3a640 1 Processor -- start 2024-09-13T17:13:17.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.775+0000 7f5738c3a640 1 -- start start 2024-09-13T17:13:17.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5738c3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f573406c090 0x7f573415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5738c3a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57340ad720 0x7f573406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5738c3a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573406c520 con 0x7f5734157e20 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5738c3a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573415b900 con 0x7f573406c090 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5738c3a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573406db00 con 0x7f57340ad720 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f573406c090 0x7f573415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f573406c090 0x7f573415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46318/0 (socket says 172.21.15.5:46318) 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 -- 172.21.15.5:0/1248490947 learned_addr learned my addr 172.21.15.5:0/1248490947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5732d9d640 1 --2- 172.21.15.5:0/1248490947 >> v2:172.21.15.179:3300/0 conn(0x7f57340ad720 0x7f573406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 -- 172.21.15.5:0/1248490947 >> v2:172.21.15.179:3300/0 conn(0x7f57340ad720 msgr2=0x7f573406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 --2- 172.21.15.5:0/1248490947 >> v2:172.21.15.179:3300/0 conn(0x7f57340ad720 0x7f573406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 -- 172.21.15.5:0/1248490947 >> v1:172.21.15.179:6789/0 conn(0x7f5734157e20 legacy=0x7f57340ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.776+0000 7f5731d9b640 1 -- 172.21.15.5:0/1248490947 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573406c800 con 0x7f573406c090 2024-09-13T17:13:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.777+0000 7f5731d9b640 1 --2- 172.21.15.5:0/1248490947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573406c090 0x7f573415b3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f573415a940 tx=0x7f572802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcb4397e05a1b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.777+0000 7f573159a640 1 -- 172.21.15.5:0/1248490947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728032440 con 0x7f573406c090 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.777+0000 7f573159a640 1 -- 172.21.15.5:0/1248490947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280325a0 con 0x7f573406c090 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.777+0000 7f573159a640 1 -- 172.21.15.5:0/1248490947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728032930 con 0x7f573406c090 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 -- 172.21.15.5:0/1248490947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573406c090 msgr2=0x7f573415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 --2- 172.21.15.5:0/1248490947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573406c090 0x7f573415b3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f573415a940 tx=0x7f572802a270 comp rx=0 tx=0).stop 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 -- 172.21.15.5:0/1248490947 shutdown_connections 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 --2- 172.21.15.5:0/1248490947 >> v2:172.21.15.179:3300/0 conn(0x7f57340ad720 0x7f573406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 --2- 172.21.15.5:0/1248490947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573406c090 0x7f573415b3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 -- 172.21.15.5:0/1248490947 >> 172.21.15.5:0/1248490947 conn(0x7f57340ce130 msgr2=0x7f57340ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 -- 172.21.15.5:0/1248490947 shutdown_connections 2024-09-13T17:13:17.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.778+0000 7f5738c3a640 1 -- 172.21.15.5:0/1248490947 wait complete. 2024-09-13T17:13:17.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.779+0000 7f5738c3a640 1 Processor -- start 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.779+0000 7f5738c3a640 1 -- start start 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 0x7f57340978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5734153a70 0x7f5734140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57341e55a0 con 0x7f57340ad720 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340b1ff0 con 0x7f5734153a70 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5738c3a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57340b22d0 con 0x7f5734157e20 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f573259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f573259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46326/0 (socket says 172.21.15.5:46326) 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f573259c640 1 -- 172.21.15.5:0/3146212273 learned_addr learned my addr 172.21.15.5:0/3146212273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5732d9d640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5734153a70 0x7f5734140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.780+0000 7f5731d9b640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 0x7f57340978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 -- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 msgr2=0x7f57340978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 0x7f57340978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 -- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5734153a70 msgr2=0x7f5734140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5734153a70 0x7f5734140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 -- 172.21.15.5:0/3146212273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280094d0 con 0x7f57340ad720 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5731d9b640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 0x7f57340978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f573259c640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f572400c400 tx=0x7f572400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57240052d0 con 0x7f57340ad720 2024-09-13T17:13:17.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5724005430 con 0x7f57340ad720 2024-09-13T17:13:17.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57340b25b0 con 0x7f57340ad720 2024-09-13T17:13:17.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724003830 con 0x7f57340ad720 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.781+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57340b2b70 con 0x7f57340ad720 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.782+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57340672a0 con 0x7f57340ad720 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.782+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5724003990 con 0x7f57340ad720 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.783+0000 7f5722ffd640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 0x7f571406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.783+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5724088c50 con 0x7f57340ad720 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.783+0000 7f5731d9b640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 0x7f571406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.784+0000 7f5731d9b640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 0x7f571406d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5728034000 tx=0x7f572802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.787+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5724053aa0 con 0x7f57340ad720 2024-09-13T17:13:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.958+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5734158200 con 0x7f57340ad720 2024-09-13T17:13:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.958+0000 7f5722ffd640 1 -- 172.21.15.5:0/3146212273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57240570c0 con 0x7f57340ad720 2024-09-13T17:13:17.961 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.960+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 msgr2=0x7f571406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.960+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 0x7f571406d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5728034000 tx=0x7f572802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 msgr2=0x7f57340b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f572400c400 tx=0x7f572400c8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 shutdown_connections 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5734153a70 0x7f5734140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5734157e20 0x7f57340978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f571406ac30 0x7f571406d0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 --2- 172.21.15.5:0/3146212273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57340ad720 0x7f57340b3090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 >> 172.21.15.5:0/3146212273 conn(0x7f57340ce130 msgr2=0x7f573415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 shutdown_connections 2024-09-13T17:13:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:17.961+0000 7f5738c3a640 1 -- 172.21.15.5:0/3146212273 wait complete. 2024-09-13T17:13:17.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.075+0000 7fedfad57640 1 Processor -- start 2024-09-13T17:13:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.075+0000 7fedfad57640 1 -- start start 2024-09-13T17:13:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedfad57640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedf406c090 0x7fedf415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedfad57640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fedf40ad720 0x7fedf406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedfad57640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf406c520 con 0x7fedf4157e20 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedfad57640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf415b900 con 0x7fedf406c090 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedfad57640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf406db00 con 0x7fedf40ad720 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedf406c090 0x7fedf415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedf406c090 0x7fedf415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46328/0 (socket says 172.21.15.5:46328) 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 -- 172.21.15.5:0/1913449484 learned_addr learned my addr 172.21.15.5:0/1913449484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf92f4640 1 --2- 172.21.15.5:0/1913449484 >> v2:172.21.15.179:3300/0 conn(0x7fedf40ad720 0x7fedf406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 -- 172.21.15.5:0/1913449484 >> v2:172.21.15.179:3300/0 conn(0x7fedf40ad720 msgr2=0x7fedf406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1913449484 >> v2:172.21.15.179:3300/0 conn(0x7fedf40ad720 0x7fedf406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 -- 172.21.15.5:0/1913449484 >> v1:172.21.15.179:6789/0 conn(0x7fedf4157e20 legacy=0x7fedf40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.076+0000 7fedf3fff640 1 -- 172.21.15.5:0/1913449484 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf406c800 con 0x7fedf406c090 2024-09-13T17:13:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.077+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1913449484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf406c090 0x7fedf415b3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedf415a940 tx=0x7fede002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69052e40822c141d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.077+0000 7fedf37fe640 1 -- 172.21.15.5:0/1913449484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0032440 con 0x7fedf406c090 2024-09-13T17:13:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.077+0000 7fedf37fe640 1 -- 172.21.15.5:0/1913449484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede00325a0 con 0x7fedf406c090 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.077+0000 7fedf37fe640 1 -- 172.21.15.5:0/1913449484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0032930 con 0x7fedf406c090 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 -- 172.21.15.5:0/1913449484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf406c090 msgr2=0x7fedf415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 --2- 172.21.15.5:0/1913449484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf406c090 0x7fedf415b3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedf415a940 tx=0x7fede002a270 comp rx=0 tx=0).stop 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 -- 172.21.15.5:0/1913449484 shutdown_connections 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 --2- 172.21.15.5:0/1913449484 >> v2:172.21.15.179:3300/0 conn(0x7fedf40ad720 0x7fedf406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 --2- 172.21.15.5:0/1913449484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf406c090 0x7fedf415b3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 -- 172.21.15.5:0/1913449484 >> 172.21.15.5:0/1913449484 conn(0x7fedf40ce130 msgr2=0x7fedf40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 -- 172.21.15.5:0/1913449484 shutdown_connections 2024-09-13T17:13:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.078+0000 7fedfad57640 1 -- 172.21.15.5:0/1913449484 wait complete. 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.079+0000 7fedfad57640 1 Processor -- start 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.079+0000 7fedfad57640 1 -- start start 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf40ad720 0x7fedf4097a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf4071e90 0x7fedf41519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40cccf0 con 0x7fedf4157e20 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40714c0 con 0x7fedf4071e90 2024-09-13T17:13:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedfad57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40ccf40 con 0x7fedf40ad720 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46340/0 (socket says 172.21.15.5:46340) 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedf3fff640 1 -- 172.21.15.5:0/1181291109 learned_addr learned my addr 172.21.15.5:0/1181291109 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedf8af3640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf40ad720 0x7fedf4097a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.080+0000 7fedf92f4640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf4071e90 0x7fedf41519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 -- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf40ad720 msgr2=0x7fedf4097a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf40ad720 0x7fedf4097a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 -- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf4071e90 msgr2=0x7fedf41519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf4071e90 0x7fedf41519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 -- 172.21.15.5:0/1181291109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00094d0 con 0x7fedf4157e20 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf3fff640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fede002a2b0 tx=0x7fede00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0032440 con 0x7fedf4157e20 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede0030980 con 0x7fedf4157e20 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4070b90 con 0x7fedf4157e20 2024-09-13T17:13:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0030d10 con 0x7fedf4157e20 2024-09-13T17:13:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.081+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4071150 con 0x7fedf4157e20 2024-09-13T17:13:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.082+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf40712e0 con 0x7fedf4157e20 2024-09-13T17:13:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.083+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fede0039040 con 0x7fedf4157e20 2024-09-13T17:13:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.083+0000 7fedf17fa640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 0x7fedd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.083+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fede00a9ed0 con 0x7fedf4157e20 2024-09-13T17:13:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.083+0000 7fedf8af3640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 0x7fedd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.084+0000 7fedf8af3640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 0x7fedd806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fede8000f60 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.087+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fede0074e70 con 0x7fedf4157e20 2024-09-13T17:13:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.257+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedf40672a0 con 0x7fedf4157e20 2024-09-13T17:13:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.258+0000 7fedf17fa640 1 -- 172.21.15.5:0/1181291109 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fede00410a0 con 0x7fedf4157e20 2024-09-13T17:13:18.260 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 msgr2=0x7fedd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 0x7fedd806d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fede8000f60 tx=0x7fede8009040 comp rx=0 tx=0).stop 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 msgr2=0x7fedf4071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fede002a2b0 tx=0x7fede00046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 shutdown_connections 2024-09-13T17:13:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf4071e90 0x7fedf41519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedd806ac00 0x7fedd806d0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf4157e20 0x7fedf4071950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 --2- 172.21.15.5:0/1181291109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf40ad720 0x7fedf4097a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 >> 172.21.15.5:0/1181291109 conn(0x7fedf40ce130 msgr2=0x7fedf415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 shutdown_connections 2024-09-13T17:13:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.260+0000 7fedfad57640 1 -- 172.21.15.5:0/1181291109 wait complete. 2024-09-13T17:13:18.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.375+0000 7fcd16ec9640 1 Processor -- start 2024-09-13T17:13:18.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 -- start start 2024-09-13T17:13:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd1015c6e0 0x7fcd100cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd100d0630 con 0x7fcd100cf000 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100d0910 con 0x7fcd1015c6e0 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.376+0000 7fcd16ec9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100d0bf0 con 0x7fcd100cf440 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd15466640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd14c65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcd1015c6e0 0x7fcd100cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd15466640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:57236/0 (socket says 172.21.15.5:57236) 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd0ffff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcd100cf000 0x7fcd101602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:55928/0 (socket says 172.21.15.5:55928) 2024-09-13T17:13:18.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd15466640 1 -- 172.21.15.5:0/1543349855 learned_addr learned my addr 172.21.15.5:0/1543349855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd14c65640 1 -- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 msgr2=0x7fcd101609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd14c65640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd14c65640 1 -- 172.21.15.5:0/1543349855 >> v1:172.21.15.179:6789/0 conn(0x7fcd100cf000 legacy=0x7fcd101602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd14c65640 1 -- 172.21.15.5:0/1543349855 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100d0ed0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.377+0000 7fcd15466640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:18.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd14c65640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c6e0 0x7fcd100cde60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097a0 tx=0x7fcd0402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cf55339c8b662a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd0f7fe640 1 -- 172.21.15.5:0/1543349855 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04032440 con 0x7fcd1015c6e0 2024-09-13T17:13:18.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd0f7fe640 1 -- 172.21.15.5:0/1543349855 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040325a0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd0f7fe640 1 -- 172.21.15.5:0/1543349855 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04032930 con 0x7fcd1015c6e0 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd16ec9640 1 -- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c6e0 msgr2=0x7fcd100cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.378+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c6e0 0x7fcd100cde60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097a0 tx=0x7fcd0402a180 comp rx=0 tx=0).stop 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 -- 172.21.15.5:0/1543349855 shutdown_connections 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd101609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/1543349855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c6e0 0x7fcd100cde60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 -- 172.21.15.5:0/1543349855 >> 172.21.15.5:0/1543349855 conn(0x7fcd10089f90 msgr2=0x7fcd100d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 -- 172.21.15.5:0/1543349855 shutdown_connections 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.379+0000 7fcd16ec9640 1 -- 172.21.15.5:0/1543349855 wait complete. 2024-09-13T17:13:18.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.380+0000 7fcd16ec9640 1 Processor -- start 2024-09-13T17:13:18.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.380+0000 7fcd16ec9640 1 -- start start 2024-09-13T17:13:18.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd100cf000 0x7fcd1015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd1015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b7670 con 0x7fcd1015c6e0 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015f710 con 0x7fcd100cf000 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100c9d10 con 0x7fcd100cf440 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46344/0 (socket says 172.21.15.5:46344) 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 -- 172.21.15.5:0/4012483665 learned_addr learned my addr 172.21.15.5:0/4012483665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd0ffff640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd1015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd14c65640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd100cf000 0x7fcd1015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 -- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 msgr2=0x7fcd1015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd1015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 -- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd100cf000 msgr2=0x7fcd1015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd100cf000 0x7fcd1015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 -- 172.21.15.5:0/4012483665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009b30 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd15466640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009f10 tx=0x7fcd0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08018070 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0800f040 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800ce60 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.381+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd04009400 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.382+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1015fc20 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.383+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd100672e0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.383+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd08014480 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.383+0000 7fcd0d7fa640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 0x7fccf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.384+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd080897a0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.384+0000 7fcd14c65640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 0x7fccf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.384+0000 7fcd14c65640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 0x7fccf406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd04034000 tx=0x7fcd0402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.388+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd080547d0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.562+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcd100d01c0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.563+0000 7fcd0d7fa640 1 -- 172.21.15.5:0/4012483665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcd08057df0 con 0x7fcd1015c6e0 2024-09-13T17:13:18.565 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 msgr2=0x7fccf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 0x7fccf406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd04034000 tx=0x7fcd0402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 msgr2=0x7fcd1015cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009f10 tx=0x7fcd0800c490 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 shutdown_connections 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fccf406ac00 0x7fccf406d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd1015c6e0 0x7fcd1015cdc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100cf440 0x7fcd1015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 --2- 172.21.15.5:0/4012483665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd100cf000 0x7fcd1015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.564+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 >> 172.21.15.5:0/4012483665 conn(0x7fcd10089f90 msgr2=0x7fcd101e6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.565+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 shutdown_connections 2024-09-13T17:13:18.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.565+0000 7fcd16ec9640 1 -- 172.21.15.5:0/4012483665 wait complete. 2024-09-13T17:13:18.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:13:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.677+0000 7f1f68be2640 1 Processor -- start 2024-09-13T17:13:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.678+0000 7f1f68be2640 1 -- start start 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.678+0000 7f1f68be2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f640b4cf0 0x7f1f640cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.678+0000 7f1f68be2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640d1e80 con 0x7f1f640d06d0 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f68be2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640d1750 con 0x7f1f6415c810 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f68be2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640d0bd0 con 0x7f1f640b4cf0 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f61d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f640b4cf0 0x7f1f640cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f62d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f640d06d0 0x7f1f640b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41918/0 (socket says 172.21.15.5:41918) 2024-09-13T17:13:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f62d9d640 1 -- 172.21.15.5:0/2746528830 learned_addr learned my addr 172.21.15.5:0/2746528830 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f61d9b640 1 -- 172.21.15.5:0/2746528830 >> v1:172.21.15.179:6789/0 conn(0x7f1f6415c810 legacy=0x7f1f640b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f61d9b640 1 -- 172.21.15.5:0/2746528830 >> v1:172.21.15.5:6789/0 conn(0x7f1f640d06d0 legacy=0x7f1f640b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f61d9b640 1 -- 172.21.15.5:0/2746528830 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640d0eb0 con 0x7f1f640b4cf0 2024-09-13T17:13:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.679+0000 7f1f6159a640 1 -- 172.21.15.5:0/2746528830 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550849217 0 0) 0x7f1f640d1e80 con 0x7f1f640d06d0 2024-09-13T17:13:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f61d9b640 1 --2- 172.21.15.5:0/2746528830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640b4cf0 0x7f1f640cd780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7236ccc50ed85c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f6159a640 1 -- 172.21.15.5:0/2746528830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c032440 con 0x7f1f640b4cf0 2024-09-13T17:13:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f6159a640 1 -- 172.21.15.5:0/2746528830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0325a0 con 0x7f1f640b4cf0 2024-09-13T17:13:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f6159a640 1 -- 172.21.15.5:0/2746528830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c032930 con 0x7f1f640b4cf0 2024-09-13T17:13:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f68be2640 1 -- 172.21.15.5:0/2746528830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640b4cf0 msgr2=0x7f1f640cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.680+0000 7f1f68be2640 1 --2- 172.21.15.5:0/2746528830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640b4cf0 0x7f1f640cd780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.681+0000 7f1f68be2640 1 -- 172.21.15.5:0/2746528830 shutdown_connections 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.681+0000 7f1f68be2640 1 --2- 172.21.15.5:0/2746528830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f640b4cf0 0x7f1f640cd780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.681+0000 7f1f68be2640 1 -- 172.21.15.5:0/2746528830 >> 172.21.15.5:0/2746528830 conn(0x7f1f640717a0 msgr2=0x7f1f64071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.681+0000 7f1f68be2640 1 -- 172.21.15.5:0/2746528830 shutdown_connections 2024-09-13T17:13:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.681+0000 7f1f68be2640 1 -- 172.21.15.5:0/2746528830 wait complete. 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.682+0000 7f1f68be2640 1 Processor -- start 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.682+0000 7f1f68be2640 1 -- start start 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f640b4cf0 0x7f1f6414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 0x7f1f640c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640c97f0 con 0x7f1f6415c810 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6414b080 con 0x7f1f640b4cf0 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640c9a00 con 0x7f1f640d06d0 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46374/0 (socket says 172.21.15.5:46374) 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 -- 172.21.15.5:0/474294077 learned_addr learned my addr 172.21.15.5:0/474294077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f61d9b640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 0x7f1f640c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f6259c640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f640b4cf0 0x7f1f6414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 -- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 msgr2=0x7f1f640c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 0x7f1f640c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 -- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f640b4cf0 msgr2=0x7f1f6414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f640b4cf0 0x7f1f6414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 -- 172.21.15.5:0/474294077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009400 con 0x7f1f6415c810 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f61d9b640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 0x7f1f640c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f62d9d640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c450 tx=0x7f1f5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0074e0 con 0x7f1f6415c810 2024-09-13T17:13:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c007660 con 0x7f1f6415c810 2024-09-13T17:13:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f640c9ce0 con 0x7f1f6415c810 2024-09-13T17:13:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.683+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c004a20 con 0x7f1f6415c810 2024-09-13T17:13:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.684+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f640ca2a0 con 0x7f1f6415c810 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.684+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f640672a0 con 0x7f1f6415c810 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.685+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f5c004b80 con 0x7f1f6415c810 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.685+0000 7f1f5affd640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 0x7f1f4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.686+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f5c088970 con 0x7f1f6415c810 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.686+0000 7f1f6259c640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 0x7f1f4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.686+0000 7f1f6259c640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 0x7f1f4406d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400b450 tx=0x7f1f5400d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.690+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f5c053a60 con 0x7f1f6415c810 2024-09-13T17:13:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.870+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1f640ca490 con 0x7f1f6415c810 2024-09-13T17:13:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.871+0000 7f1f5affd640 1 -- 172.21.15.5:0/474294077 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1f5c018080 con 0x7f1f6415c810 2024-09-13T17:13:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 msgr2=0x7f1f4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 0x7f1f4406d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400b450 tx=0x7f1f5400d040 comp rx=0 tx=0).stop 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 msgr2=0x7f1f640ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c450 tx=0x7f1f5c00c910 comp rx=0 tx=0).stop 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 shutdown_connections 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f4406ac30 0x7f1f4406d0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f6415c810 0x7f1f640ca7c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f640d06d0 0x7f1f640c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 --2- 172.21.15.5:0/474294077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f640b4cf0 0x7f1f6414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 >> 172.21.15.5:0/474294077 conn(0x7f1f640717a0 msgr2=0x7f1f640b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 shutdown_connections 2024-09-13T17:13:18.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:18.873+0000 7f1f68be2640 1 -- 172.21.15.5:0/474294077 wait complete. 2024-09-13T17:13:18.885 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:13:18.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:13:18.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:19.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.040+0000 7f465b809640 1 Processor -- start 2024-09-13T17:13:19.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 -- start start 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f46540cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46540b4cf0 0x7f46540b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540d1e80 con 0x7f46540d06d0 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540d1750 con 0x7f46540b4cf0 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.041+0000 7f465b809640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540d0bd0 con 0x7f465415c810 2024-09-13T17:13:19.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46540b4cf0 0x7f46540b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46540b4cf0 0x7f46540b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46390/0 (socket says 172.21.15.5:46390) 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 -- 172.21.15.5:0/3148112954 learned_addr learned my addr 172.21.15.5:0/3148112954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f46595a5640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f46540cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 -- 172.21.15.5:0/3148112954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 msgr2=0x7f46540cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f46540cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 -- 172.21.15.5:0/3148112954 >> v1:172.21.15.179:6789/0 conn(0x7f46540d06d0 legacy=0x7f46540b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.042+0000 7f4659da6640 1 -- 172.21.15.5:0/3148112954 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540d0eb0 con 0x7f46540b4cf0 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f4659da6640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f46540b5a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f464c009e50 tx=0x7f464c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42593d0fd80bdfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f464bfff640 1 -- 172.21.15.5:0/3148112954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c031600 con 0x7f46540b4cf0 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f464bfff640 1 -- 172.21.15.5:0/3148112954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c02d050 con 0x7f46540b4cf0 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f464bfff640 1 -- 172.21.15.5:0/3148112954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c031980 con 0x7f46540b4cf0 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 -- 172.21.15.5:0/3148112954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 msgr2=0x7f46540b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f46540b5a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f464c009e50 tx=0x7f464c02a710 comp rx=0 tx=0).stop 2024-09-13T17:13:19.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 -- 172.21.15.5:0/3148112954 shutdown_connections 2024-09-13T17:13:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f46540b5a90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 --2- 172.21.15.5:0/3148112954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f46540cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 -- 172.21.15.5:0/3148112954 >> 172.21.15.5:0/3148112954 conn(0x7f46540717a0 msgr2=0x7f4654071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 -- 172.21.15.5:0/3148112954 shutdown_connections 2024-09-13T17:13:19.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.043+0000 7f465b809640 1 -- 172.21.15.5:0/3148112954 wait complete. 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 Processor -- start 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 -- start start 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540d06d0 0x7f46541f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f4654156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f2510 con 0x7f46540b4cf0 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654157700 con 0x7f46540d06d0 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f465b809640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f27b0 con 0x7f465415c810 2024-09-13T17:13:19.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f46595a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f46595a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46404/0 (socket says 172.21.15.5:46404) 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.045+0000 7f46595a5640 1 -- 172.21.15.5:0/3488137423 learned_addr learned my addr 172.21.15.5:0/3488137423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f4659da6640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f4654156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f4658da4640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540d06d0 0x7f46541f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 -- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 msgr2=0x7f4654156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f4654156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 -- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540d06d0 msgr2=0x7f46541f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540d06d0 0x7f46541f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 -- 172.21.15.5:0/3488137423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009b30 con 0x7f46540b4cf0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f46595a5640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f465000e870 tx=0x7f465000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500094f0 con 0x7f46540b4cf0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000c940 con 0x7f46540b4cf0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46541f2a90 con 0x7f46540b4cf0 2024-09-13T17:13:19.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000ccf0 con 0x7f46540b4cf0 2024-09-13T17:13:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.046+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46541f34f0 con 0x7f46540b4cf0 2024-09-13T17:13:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.047+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540672a0 con 0x7f46540b4cf0 2024-09-13T17:13:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.048+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4650013470 con 0x7f46540b4cf0 2024-09-13T17:13:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.048+0000 7f4649ffb640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 0x7f463806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.049+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46500897b0 con 0x7f46540b4cf0 2024-09-13T17:13:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.049+0000 7f4658da4640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 0x7f463806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.049+0000 7f4658da4640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 0x7f463806d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f465415c1d0 tx=0x7f4644009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.053+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4650054620 con 0x7f46540b4cf0 2024-09-13T17:13:19.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.224+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46540b5820 con 0x7f46540b4cf0 2024-09-13T17:13:19.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.225+0000 7f4649ffb640 1 -- 172.21.15.5:0/3488137423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f4650057c40 con 0x7f46540b4cf0 2024-09-13T17:13:19.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:19.228 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 msgr2=0x7f463806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 0x7f463806d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f465415c1d0 tx=0x7f4644009040 comp rx=0 tx=0).stop 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 msgr2=0x7f4654148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f465000e870 tx=0x7f465000ed30 comp rx=0 tx=0).stop 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 shutdown_connections 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f465415c810 0x7f4654156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46540d06d0 0x7f46541f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f463806ac00 0x7f463806d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 --2- 172.21.15.5:0/3488137423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46540b4cf0 0x7f4654148ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 >> 172.21.15.5:0/3488137423 conn(0x7f46540717a0 msgr2=0x7f46540cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 shutdown_connections 2024-09-13T17:13:19.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.228+0000 7f465b809640 1 -- 172.21.15.5:0/3488137423 wait complete. 2024-09-13T17:13:19.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:19.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.346+0000 7fed73b21640 1 Processor -- start 2024-09-13T17:13:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.346+0000 7fed73b21640 1 -- start start 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed73b21640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed6c099110 0x7fed6c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed73b21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed6c0d0e30 0x7fed6c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed73b21640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0704a0 con 0x7fed6c15fd80 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed73b21640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c06cc10 con 0x7fed6c0d0e30 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed73b21640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0d12c0 con 0x7fed6c099110 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed718bd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed6c15fd80 0x7fed6c098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41932/0 (socket says 172.21.15.5:41932) 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed718bd640 1 -- 172.21.15.5:0/907200496 learned_addr learned my addr 172.21.15.5:0/907200496 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.347+0000 7fed720be640 1 --2- 172.21.15.5:0/907200496 >> v2:172.21.15.5:3300/0 conn(0x7fed6c0d0e30 0x7fed6c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed708bb640 1 -- 172.21.15.5:0/907200496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547274371 0 0) 0x7fed6c0704a0 con 0x7fed6c15fd80 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed710bc640 1 --2- 172.21.15.5:0/907200496 >> v2:172.21.15.179:3300/0 conn(0x7fed6c099110 0x7fed6c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed708bb640 1 -- 172.21.15.5:0/907200496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed54003520 con 0x7fed6c15fd80 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed720be640 1 -- 172.21.15.5:0/907200496 >> v2:172.21.15.179:3300/0 conn(0x7fed6c099110 msgr2=0x7fed6c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed720be640 1 --2- 172.21.15.5:0/907200496 >> v2:172.21.15.179:3300/0 conn(0x7fed6c099110 0x7fed6c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed720be640 1 -- 172.21.15.5:0/907200496 >> v1:172.21.15.5:6789/0 conn(0x7fed6c15fd80 legacy=0x7fed6c098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed720be640 1 -- 172.21.15.5:0/907200496 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c06bd80 con 0x7fed6c0d0e30 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.348+0000 7fed720be640 1 --2- 172.21.15.5:0/907200496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c0d0e30 0x7fed6c06e870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed6c06cb60 tx=0x7fed6402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7405c6cc7e9fc34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed708bb640 1 -- 172.21.15.5:0/907200496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6402ae50 con 0x7fed6c0d0e30 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed708bb640 1 -- 172.21.15.5:0/907200496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64032440 con 0x7fed6c0d0e30 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed708bb640 1 -- 172.21.15.5:0/907200496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640327d0 con 0x7fed6c0d0e30 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 -- 172.21.15.5:0/907200496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c0d0e30 msgr2=0x7fed6c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 --2- 172.21.15.5:0/907200496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c0d0e30 0x7fed6c06e870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fed6c06cb60 tx=0x7fed6402a140 comp rx=0 tx=0).stop 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 -- 172.21.15.5:0/907200496 shutdown_connections 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 --2- 172.21.15.5:0/907200496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c0d0e30 0x7fed6c06e870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 --2- 172.21.15.5:0/907200496 >> v2:172.21.15.179:3300/0 conn(0x7fed6c099110 0x7fed6c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 -- 172.21.15.5:0/907200496 >> 172.21.15.5:0/907200496 conn(0x7fed6c0d0310 msgr2=0x7fed6c0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 -- 172.21.15.5:0/907200496 shutdown_connections 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.349+0000 7fed73b21640 1 -- 172.21.15.5:0/907200496 wait complete. 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.350+0000 7fed73b21640 1 Processor -- start 2024-09-13T17:13:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.350+0000 7fed73b21640 1 -- start start 2024-09-13T17:13:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed6c0d0e30 0x7fed6c0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 0x7fed6c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c15ae80 con 0x7fed6c099110 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0b39d0 con 0x7fed6c15fd80 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed73b21640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0b43a0 con 0x7fed6c0d0e30 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed718bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed718bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46424/0 (socket says 172.21.15.5:46424) 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.351+0000 7fed718bd640 1 -- 172.21.15.5:0/1163811630 learned_addr learned my addr 172.21.15.5:0/1163811630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed720be640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 0x7fed6c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed710bc640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed6c0d0e30 0x7fed6c0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 -- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed6c0d0e30 msgr2=0x7fed6c0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed6c0d0e30 0x7fed6c0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 -- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 msgr2=0x7fed6c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 0x7fed6c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 -- 172.21.15.5:0/1163811630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64009400 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed720be640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 0x7fed6c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed718bd640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00cbc0 tx=0x7fed5c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00ad40 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c012400 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c0c6180 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00aea0 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.352+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c0b3660 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.353+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c0cfa60 con 0x7fed6c099110 2024-09-13T17:13:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.354+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed5c007070 con 0x7fed6c099110 2024-09-13T17:13:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.354+0000 7fed6a7fc640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 0x7fed5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.354+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed5c089620 con 0x7fed6c099110 2024-09-13T17:13:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.354+0000 7fed710bc640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 0x7fed5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.355+0000 7fed710bc640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 0x7fed5806d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed60006fd0 tx=0x7fed60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.358+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fed5c054530 con 0x7fed6c099110 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.529+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed6c0c6460 con 0x7fed6c099110 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.529+0000 7fed6a7fc640 1 -- 172.21.15.5:0/1163811630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed5c0170a0 con 0x7fed6c099110 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 msgr2=0x7fed5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 0x7fed5806d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed60006fd0 tx=0x7fed60008040 comp rx=0 tx=0).stop 2024-09-13T17:13:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 msgr2=0x7fed6c0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00cbc0 tx=0x7fed5c00a430 comp rx=0 tx=0).stop 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 shutdown_connections 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed6c15fd80 0x7fed6c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed6c0d0e30 0x7fed6c0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fed5806ac00 0x7fed5806d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 --2- 172.21.15.5:0/1163811630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed6c099110 0x7fed6c0b3e60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 >> 172.21.15.5:0/1163811630 conn(0x7fed6c0d0310 msgr2=0x7fed6c0b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 shutdown_connections 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.531+0000 7fed73b21640 1 -- 172.21.15.5:0/1163811630 wait complete. 2024-09-13T17:13:19.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.646+0000 7f03697ed640 1 Processor -- start 2024-09-13T17:13:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.646+0000 7f03697ed640 1 -- start start 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03697ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f036415d850 0x7f03640b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03697ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 0x7f03640ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03697ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640b27f0 con 0x7f0364069e90 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03697ed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036406ed60 con 0x7f036415d850 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03697ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640b40d0 con 0x7f03640ae7b0 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03627fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f036415d850 0x7f03640b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f0362ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0364069e90 0x7f036406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41948/0 (socket says 172.21.15.5:41948) 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f0362ffd640 1 -- 172.21.15.5:0/3590787644 learned_addr learned my addr 172.21.15.5:0/3590787644 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.647+0000 7f03637fe640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 0x7f03640ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03627fc640 1 -- 172.21.15.5:0/3590787644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 msgr2=0x7f03640ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03627fc640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 0x7f03640ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03627fc640 1 -- 172.21.15.5:0/3590787644 >> v1:172.21.15.5:6789/0 conn(0x7f0364069e90 legacy=0x7f036406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03627fc640 1 -- 172.21.15.5:0/3590787644 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640ae390 con 0x7f036415d850 2024-09-13T17:13:19.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f0361ffb640 1 -- 172.21.15.5:0/3590787644 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305639239 0 0) 0x7f03640b27f0 con 0x7f0364069e90 2024-09-13T17:13:19.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03637fe640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 0x7f03640ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f03627fc640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f036415d850 0x7f03640b2130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f03580097a0 tx=0x7f035802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeed8b299ee43db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f0361ffb640 1 -- 172.21.15.5:0/3590787644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358032440 con 0x7f036415d850 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f0361ffb640 1 -- 172.21.15.5:0/3590787644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03580325a0 con 0x7f036415d850 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.648+0000 7f0361ffb640 1 -- 172.21.15.5:0/3590787644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358032930 con 0x7f036415d850 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 -- 172.21.15.5:0/3590787644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f036415d850 msgr2=0x7f03640b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f036415d850 0x7f03640b2130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f03580097a0 tx=0x7f035802a180 comp rx=0 tx=0).stop 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 -- 172.21.15.5:0/3590787644 shutdown_connections 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03640ae7b0 0x7f03640ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 --2- 172.21.15.5:0/3590787644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f036415d850 0x7f03640b2130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 -- 172.21.15.5:0/3590787644 >> 172.21.15.5:0/3590787644 conn(0x7f03640b4650 msgr2=0x7f03640b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 -- 172.21.15.5:0/3590787644 shutdown_connections 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.649+0000 7f03697ed640 1 -- 172.21.15.5:0/3590787644 wait complete. 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.650+0000 7f03697ed640 1 Processor -- start 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.650+0000 7f03697ed640 1 -- start start 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03640ae7b0 0x7f03641e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036415d850 0x7f03641e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364158980 con 0x7f0364069e90 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03641e2c70 con 0x7f03640ae7b0 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03697ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03641e2f50 con 0x7f036415d850 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f0362ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f0362ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46444/0 (socket says 172.21.15.5:46444) 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f0362ffd640 1 -- 172.21.15.5:0/1791913892 learned_addr learned my addr 172.21.15.5:0/1791913892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03627fc640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03640ae7b0 0x7f03641e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.651+0000 7f03637fe640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036415d850 0x7f03641e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 -- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036415d850 msgr2=0x7f03641e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036415d850 0x7f03641e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 -- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03640ae7b0 msgr2=0x7f03641e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03640ae7b0 0x7f03641e3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 -- 172.21.15.5:0/1791913892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358009400 con 0x7f0364069e90 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f0362ffd640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f035400c890 tx=0x7f035400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035400a640 con 0x7f0364069e90 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035400a7c0 con 0x7f0364069e90 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03641e3230 con 0x7f0364069e90 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035400ab70 con 0x7f0364069e90 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.652+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03641e37f0 con 0x7f0364069e90 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.653+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03640672a0 con 0x7f0364069e90 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.653+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f035400acd0 con 0x7f0364069e90 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.654+0000 7f034b7fe640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 0x7f035006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.654+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0354088f20 con 0x7f0364069e90 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.654+0000 7f03627fc640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 0x7f035006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.655+0000 7f03627fc640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 0x7f035006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0358034000 tx=0x7f035802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.658+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0354053e10 con 0x7f0364069e90 2024-09-13T17:13:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.829+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03640ac110 con 0x7f0364069e90 2024-09-13T17:13:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.829+0000 7f034b7fe640 1 -- 172.21.15.5:0/1791913892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03540180a0 con 0x7f0364069e90 2024-09-13T17:13:19.832 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 msgr2=0x7f035006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 0x7f035006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0358034000 tx=0x7f035802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 msgr2=0x7f0364158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f035400c890 tx=0x7f035400cd50 comp rx=0 tx=0).stop 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 shutdown_connections 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036415d850 0x7f03641e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03640ae7b0 0x7f03641e3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f035006ac00 0x7f035006d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 --2- 172.21.15.5:0/1791913892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0364069e90 0x7f0364158440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 >> 172.21.15.5:0/1791913892 conn(0x7f03640b4650 msgr2=0x7f036415b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 shutdown_connections 2024-09-13T17:13:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.831+0000 7f03697ed640 1 -- 172.21.15.5:0/1791913892 wait complete. 2024-09-13T17:13:19.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 Processor -- start 2024-09-13T17:13:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 -- start start 2024-09-13T17:13:19.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0cb8157e20 0x7f0cb815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb806c520 con 0x7f0cb80ad010 2024-09-13T17:13:19.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb815b900 con 0x7f0cb8157e20 2024-09-13T17:13:19.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.947+0000 7f0cbd3e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb806db00 con 0x7f0cb806c090 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0cb8157e20 0x7f0cb815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb77fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0cb80ad010 0x7f0cb80ad460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:55962/0 (socket says 172.21.15.5:55962) 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb67fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:57328/0 (socket says 172.21.15.5:57328) 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb77fe640 1 -- 172.21.15.5:0/3175769962 learned_addr learned my addr 172.21.15.5:0/3175769962 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0cb8157e20 0x7f0cb815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:54954/0 (socket says 172.21.15.5:54954) 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 -- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 msgr2=0x7f0cb806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 -- 172.21.15.5:0/3175769962 >> v1:172.21.15.179:6789/0 conn(0x7f0cb80ad010 legacy=0x7f0cb80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb6ffd640 1 -- 172.21.15.5:0/3175769962 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb806c800 con 0x7f0cb8157e20 2024-09-13T17:13:19.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.948+0000 7f0cb67fc640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.949+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb8157e20 0x7f0cb815b3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097a0 tx=0x7f0ca802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78939b77633adaf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cb5ffb640 1 -- 172.21.15.5:0/3175769962 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8032440 con 0x7f0cb8157e20 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cb5ffb640 1 -- 172.21.15.5:0/3175769962 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca80325a0 con 0x7f0cb8157e20 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cb5ffb640 1 -- 172.21.15.5:0/3175769962 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8032930 con 0x7f0cb8157e20 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb8157e20 msgr2=0x7f0cb815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb8157e20 0x7f0cb815b3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80097a0 tx=0x7f0ca802a180 comp rx=0 tx=0).stop 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/3175769962 shutdown_connections 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb806c090 0x7f0cb806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/3175769962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb8157e20 0x7f0cb815b3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/3175769962 >> 172.21.15.5:0/3175769962 conn(0x7f0cb80ce130 msgr2=0x7f0cb80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/3175769962 shutdown_connections 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.950+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/3175769962 wait complete. 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.951+0000 7f0cbd3e9640 1 Processor -- start 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 -- start start 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 0x7f0cb80979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 0x7f0cb813cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814cad0 con 0x7f0cb814d600 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8097f20 con 0x7f0cb80ad010 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cbd3e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814fbb0 con 0x7f0cb8157e20 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cb77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cb77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46448/0 (socket says 172.21.15.5:46448) 2024-09-13T17:13:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.952+0000 7f0cb77fe640 1 -- 172.21.15.5:0/527755165 learned_addr learned my addr 172.21.15.5:0/527755165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 0x7f0cb80979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb67fc640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 0x7f0cb813cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 -- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 msgr2=0x7f0cb813cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 0x7f0cb813cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 -- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 msgr2=0x7f0cb80979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 0x7f0cb80979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 -- 172.21.15.5:0/527755165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac009400 con 0x7f0cb814d600 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 0x7f0cb80979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb67fc640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 0x7f0cb813cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cb77fe640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000cbf0 tx=0x7f0cb000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000ad40 con 0x7f0cb814d600 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0012400 con 0x7f0cb814d600 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca8009400 con 0x7f0cb814d600 2024-09-13T17:13:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000aea0 con 0x7f0cb814d600 2024-09-13T17:13:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.953+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb814de50 con 0x7f0cb814d600 2024-09-13T17:13:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.954+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb80672a0 con 0x7f0cb814d600 2024-09-13T17:13:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.955+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0cb0007070 con 0x7f0cb814d600 2024-09-13T17:13:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.955+0000 7f0c9f7fe640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 0x7f0ca406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.955+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cb0089570 con 0x7f0cb814d600 2024-09-13T17:13:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.956+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 0x7f0ca406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.956+0000 7f0cb6ffd640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 0x7f0ca406d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:19.959+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0cb0054470 con 0x7f0cb814d600 2024-09-13T17:13:20.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.130+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cb80ab300 con 0x7f0cb814d600 2024-09-13T17:13:20.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.130+0000 7f0c9f7fe640 1 -- 172.21.15.5:0/527755165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cb0057a90 con 0x7f0cb814d600 2024-09-13T17:13:20.133 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 msgr2=0x7f0ca406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 0x7f0ca406d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 msgr2=0x7f0cb813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000cbf0 tx=0x7f0cb000a430 comp rx=0 tx=0).stop 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 shutdown_connections 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ca406ac30 0x7f0ca406d0f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb814d600 0x7f0cb813a0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0cb8157e20 0x7f0cb813cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.132+0000 7f0cbd3e9640 1 --2- 172.21.15.5:0/527755165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0cb80ad010 0x7f0cb80979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.133+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 >> 172.21.15.5:0/527755165 conn(0x7f0cb80ce130 msgr2=0x7f0cb8159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.133+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 shutdown_connections 2024-09-13T17:13:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.133+0000 7f0cbd3e9640 1 -- 172.21.15.5:0/527755165 wait complete. 2024-09-13T17:13:20.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:20.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.251+0000 7f270898a640 1 Processor -- start 2024-09-13T17:13:20.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.251+0000 7f270898a640 1 -- start start 2024-09-13T17:13:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270898a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27041591e0 0x7f27040abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270898a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040ad050 con 0x7f270406da30 2024-09-13T17:13:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270898a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040ac440 con 0x7f27040ad4e0 2024-09-13T17:13:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270898a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27040ac720 con 0x7f27041591e0 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f2702d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f270406da30 0x7f27040700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41954/0 (socket says 172.21.15.5:41954) 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f2702d9d640 1 -- 172.21.15.5:0/1466039531 learned_addr learned my addr 172.21.15.5:0/1466039531 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270259c640 1 --2- 172.21.15.5:0/1466039531 >> v2:172.21.15.179:3300/0 conn(0x7f27041591e0 0x7f27040abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270159a640 1 -- 172.21.15.5:0/1466039531 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190466525 0 0) 0x7f27040ad050 con 0x7f270406da30 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270159a640 1 -- 172.21.15.5:0/1466039531 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26ec005730 con 0x7f270406da30 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270259c640 1 -- 172.21.15.5:0/1466039531 >> v1:172.21.15.179:6789/0 conn(0x7f27040ad4e0 legacy=0x7f27040b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270259c640 1 -- 172.21.15.5:0/1466039531 >> v1:172.21.15.5:6789/0 conn(0x7f270406da30 legacy=0x7f27040700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.252+0000 7f270259c640 1 -- 172.21.15.5:0/1466039531 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040aca00 con 0x7f27041591e0 2024-09-13T17:13:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.253+0000 7f270259c640 1 --2- 172.21.15.5:0/1466039531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f27040abe60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26f40097a0 tx=0x7f26f402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=962d1061f86b47ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.253+0000 7f270159a640 1 -- 172.21.15.5:0/1466039531 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4032440 con 0x7f27041591e0 2024-09-13T17:13:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.253+0000 7f270159a640 1 -- 172.21.15.5:0/1466039531 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f40325a0 con 0x7f27041591e0 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.253+0000 7f270159a640 1 -- 172.21.15.5:0/1466039531 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4032910 con 0x7f27041591e0 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 -- 172.21.15.5:0/1466039531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 msgr2=0x7f27040abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 --2- 172.21.15.5:0/1466039531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f27040abe60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26f40097a0 tx=0x7f26f402a230 comp rx=0 tx=0).stop 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 -- 172.21.15.5:0/1466039531 shutdown_connections 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 --2- 172.21.15.5:0/1466039531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f27040abe60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 -- 172.21.15.5:0/1466039531 >> 172.21.15.5:0/1466039531 conn(0x7f27040ce130 msgr2=0x7f27040ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 -- 172.21.15.5:0/1466039531 shutdown_connections 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.254+0000 7f270898a640 1 -- 172.21.15.5:0/1466039531 wait complete. 2024-09-13T17:13:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.255+0000 7f270898a640 1 Processor -- start 2024-09-13T17:13:20.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.255+0000 7f270898a640 1 -- start start 2024-09-13T17:13:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040ad4e0 0x7f270415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f270415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041558b0 con 0x7f270406da30 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270414f1f0 con 0x7f27041591e0 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270898a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270414f4d0 con 0x7f27040ad4e0 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46462/0 (socket says 172.21.15.5:46462) 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 -- 172.21.15.5:0/1418841936 learned_addr learned my addr 172.21.15.5:0/1418841936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 -- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040ad4e0 msgr2=0x7f270415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f2701d9b640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040ad4e0 0x7f270415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f2702d9d640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f270415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040ad4e0 0x7f270415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 -- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 msgr2=0x7f270415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f270415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.256+0000 7f270259c640 1 -- 172.21.15.5:0/1418841936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4009400 con 0x7f270406da30 2024-09-13T17:13:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f270259c640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26f4000c00 tx=0x7f26f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4032440 con 0x7f270406da30 2024-09-13T17:13:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4004230 con 0x7f270406da30 2024-09-13T17:13:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2704159990 con 0x7f270406da30 2024-09-13T17:13:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4006e10 con 0x7f270406da30 2024-09-13T17:13:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.257+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270414f7b0 con 0x7f270406da30 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.258+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2704159eb0 con 0x7f270406da30 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.258+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26f4039050 con 0x7f270406da30 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.259+0000 7f26f2ffd640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 0x7f26e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.259+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26f40a9ef0 con 0x7f270406da30 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.259+0000 7f2701d9b640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 0x7f26e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.260+0000 7f2701d9b640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 0x7f26e406d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2704158300 tx=0x7f26f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.263+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2704159eb0 con 0x7f270406da30 2024-09-13T17:13:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.435+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2704159eb0 con 0x7f270406da30 2024-09-13T17:13:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.435+0000 7f26f2ffd640 1 -- 172.21.15.5:0/1418841936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2704159eb0 con 0x7f270406da30 2024-09-13T17:13:20.437 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 msgr2=0x7f26e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 0x7f26e406d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2704158300 tx=0x7f26f8009040 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 msgr2=0x7f270414b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26f4000c00 tx=0x7f26f40046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 shutdown_connections 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27041591e0 0x7f270415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27040ad4e0 0x7f270415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e406ac30 0x7f26e406d0f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 --2- 172.21.15.5:0/1418841936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270406da30 0x7f270414b7c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 >> 172.21.15.5:0/1418841936 conn(0x7f27040ce130 msgr2=0x7f2704152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 shutdown_connections 2024-09-13T17:13:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.437+0000 7f270898a640 1 -- 172.21.15.5:0/1418841936 wait complete. 2024-09-13T17:13:20.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:13:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.549+0000 7f251ab18640 1 Processor -- start 2024-09-13T17:13:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 -- start start 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f251406e420 0x7f25140cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 0x7f25140b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140cf770 con 0x7f25140ccdc0 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25140704b0 con 0x7f251406e420 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.550+0000 7f251ab18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140ccc00 con 0x7f25140cd6e0 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f251406e420 0x7f25140cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f251406e420 0x7f25140cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46470/0 (socket says 172.21.15.5:46470) 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 -- 172.21.15.5:0/2772062748 learned_addr learned my addr 172.21.15.5:0/2772062748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f25190b5640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 0x7f25140b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 -- 172.21.15.5:0/2772062748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 msgr2=0x7f25140b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 0x7f25140b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 -- 172.21.15.5:0/2772062748 >> v1:172.21.15.179:6789/0 conn(0x7f25140ccdc0 legacy=0x7f25140cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f2513fff640 1 -- 172.21.15.5:0/2772062748 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140701d0 con 0x7f251406e420 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.551+0000 7f25190b5640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 0x7f25140b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f2513fff640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25140cd1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009870 tx=0x7f24fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08e79503146678a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f25137fe640 1 -- 172.21.15.5:0/2772062748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc032640 con 0x7f251406e420 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f25137fe640 1 -- 172.21.15.5:0/2772062748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc0327a0 con 0x7f251406e420 2024-09-13T17:13:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f25137fe640 1 -- 172.21.15.5:0/2772062748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc032b30 con 0x7f251406e420 2024-09-13T17:13:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 -- 172.21.15.5:0/2772062748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 msgr2=0x7f25140cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25140cd1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009870 tx=0x7f24fc02a300 comp rx=0 tx=0).stop 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 -- 172.21.15.5:0/2772062748 shutdown_connections 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140cd6e0 0x7f25140b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 --2- 172.21.15.5:0/2772062748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25140cd1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 -- 172.21.15.5:0/2772062748 >> 172.21.15.5:0/2772062748 conn(0x7f25140b1fa0 msgr2=0x7f25140b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 -- 172.21.15.5:0/2772062748 shutdown_connections 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.552+0000 7f251ab18640 1 -- 172.21.15.5:0/2772062748 wait complete. 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.554+0000 7f251ab18640 1 Processor -- start 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.554+0000 7f251ab18640 1 -- start start 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.554+0000 7f251ab18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.554+0000 7f251ab18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 0x7f25141587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25140cd6e0 0x7f25140aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140ad2b0 con 0x7f251406e420 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140ad590 con 0x7f25140cd6e0 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140ad870 con 0x7f25140ccdc0 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46472/0 (socket says 172.21.15.5:46472) 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 -- 172.21.15.5:0/577489912 learned_addr learned my addr 172.21.15.5:0/577489912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25190b5640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25140cd6e0 0x7f25140aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f2513fff640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 0x7f25141587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 -- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 msgr2=0x7f25141587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 0x7f25141587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 -- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25140cd6e0 msgr2=0x7f25140aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25140cd6e0 0x7f25140aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 -- 172.21.15.5:0/577489912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc0094d0 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f2513fff640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 0x7f25141587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25188b4640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f250400c450 tx=0x7f250400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040052d0 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504005430 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504012870 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25140adb50 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.555+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25141e4f30 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.556+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25140cc640 con 0x7f251406e420 2024-09-13T17:13:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.557+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25040129d0 con 0x7f251406e420 2024-09-13T17:13:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.557+0000 7f25117fa640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 0x7f24f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.557+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25040890f0 con 0x7f251406e420 2024-09-13T17:13:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.557+0000 7f2513fff640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 0x7f24f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:20.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.558+0000 7f2513fff640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 0x7f24f406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24fc034000 tx=0x7f24fc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:20.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.561+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2504053fe0 con 0x7f251406e420 2024-09-13T17:13:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.744+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25140afba0 con 0x7f251406e420 2024-09-13T17:13:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.744+0000 7f25117fa640 1 -- 172.21.15.5:0/577489912 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2504057600 con 0x7f251406e420 2024-09-13T17:13:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 msgr2=0x7f24f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 0x7f24f406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24fc034000 tx=0x7f24fc02e000 comp rx=0 tx=0).stop 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 msgr2=0x7f25141582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f250400c450 tx=0x7f250400c910 comp rx=0 tx=0).stop 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 shutdown_connections 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25140cd6e0 0x7f25140aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25140ccdc0 0x7f25141587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f24f406ac00 0x7f24f406d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 --2- 172.21.15.5:0/577489912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f251406e420 0x7f25141582b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:20.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 >> 172.21.15.5:0/577489912 conn(0x7f25140b1fa0 msgr2=0x7f25140b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:20.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 shutdown_connections 2024-09-13T17:13:20.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:20.746+0000 7f251ab18640 1 -- 172.21.15.5:0/577489912 wait complete. 2024-09-13T17:13:20.759 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:13:20.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:20.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:13:20.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[42871]: fuse finished with error 0 and tester_r 0 2024-09-13T17:13:20.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:13:26.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:13:26.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:26.888 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T17:13:26.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.069+0000 7f91ea701640 1 Processor -- start 2024-09-13T17:13:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 -- start start 2024-09-13T17:13:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91e4159290 0x7f91e4159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e4070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91e40b1970 0x7f91e4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40b1580 con 0x7f91e4159290 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40b2ad0 con 0x7f91e40b1970 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.070+0000 7f91ea701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b1ec0 con 0x7f91e4159bb0 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91e4159290 0x7f91e4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91e4159290 0x7f91e4159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38716/0 (socket says 172.21.15.5:38716) 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 -- 172.21.15.5:0/2907622652 learned_addr learned my addr 172.21.15.5:0/2907622652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e8c9e640 1 --2- 172.21.15.5:0/2907622652 >> v2:172.21.15.179:3300/0 conn(0x7f91e40b1970 0x7f91e4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91dbfff640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e4070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 -- 172.21.15.5:0/2907622652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 msgr2=0x7f91e4070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e4070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 -- 172.21.15.5:0/2907622652 >> v2:172.21.15.179:3300/0 conn(0x7f91e40b1970 msgr2=0x7f91e4070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 --2- 172.21.15.5:0/2907622652 >> v2:172.21.15.179:3300/0 conn(0x7f91e40b1970 0x7f91e4070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.071+0000 7f91e3fff640 1 -- 172.21.15.5:0/2907622652 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40b21a0 con 0x7f91e4159290 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.072+0000 7f91e3fff640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e4159670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b1180 tx=0x7f91d402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ab4d1655f73552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.072+0000 7f91e37fe640 1 -- 172.21.15.5:0/2907622652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4032790 con 0x7f91e4159290 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.072+0000 7f91e37fe640 1 -- 172.21.15.5:0/2907622652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d40328f0 con 0x7f91e4159290 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.072+0000 7f91e37fe640 1 -- 172.21.15.5:0/2907622652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4032c80 con 0x7f91e4159290 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 -- 172.21.15.5:0/2907622652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 msgr2=0x7f91e4159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e4159670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b1180 tx=0x7f91d402c890 comp rx=0 tx=0).stop 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 -- 172.21.15.5:0/2907622652 shutdown_connections 2024-09-13T17:13:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 --2- 172.21.15.5:0/2907622652 >> v2:172.21.15.179:3300/0 conn(0x7f91e40b1970 0x7f91e4070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e4070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 --2- 172.21.15.5:0/2907622652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e4159670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 -- 172.21.15.5:0/2907622652 >> 172.21.15.5:0/2907622652 conn(0x7f91e40ce0d0 msgr2=0x7f91e40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 -- 172.21.15.5:0/2907622652 shutdown_connections 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.073+0000 7f91ea701640 1 -- 172.21.15.5:0/2907622652 wait complete. 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.074+0000 7f91ea701640 1 Processor -- start 2024-09-13T17:13:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.074+0000 7f91ea701640 1 -- start start 2024-09-13T17:13:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40b1970 0x7f91e414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e41e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40ccc40 con 0x7f91e4159290 2024-09-13T17:13:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e41e1b60 con 0x7f91e40b1970 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91ea701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e41e1e40 con 0x7f91e4159bb0 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38726/0 (socket says 172.21.15.5:38726) 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 -- 172.21.15.5:0/3039575661 learned_addr learned my addr 172.21.15.5:0/3039575661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91e3fff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40b1970 0x7f91e414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91e8c9e640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e41e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 -- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 msgr2=0x7f91e41e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e41e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 -- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40b1970 msgr2=0x7f91e414da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40b1970 0x7f91e414da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 -- 172.21.15.5:0/3039575661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d400b770 con 0x7f91e4159290 2024-09-13T17:13:27.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.075+0000 7f91dbfff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d7d0 tx=0x7f91cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.076+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00b6c0 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.076+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc00b840 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.076+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00bbf0 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.076+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40b30e0 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.076+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e40cd1a0 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.077+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e40cd360 con 0x7f91e4159290 2024-09-13T17:13:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.077+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91cc00bd50 con 0x7f91e4159290 2024-09-13T17:13:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.078+0000 7f91e17fa640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 0x7f91c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.078+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91cc089960 con 0x7f91e4159290 2024-09-13T17:13:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.078+0000 7f91e3fff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 0x7f91c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.078+0000 7f91e3fff640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 0x7f91c406d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d4037000 tx=0x7f91d403e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.082+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91cc054990 con 0x7f91e4159290 2024-09-13T17:13:27.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.256+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e40b2f40 con 0x7f91e4159290 2024-09-13T17:13:27.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.257+0000 7f91e17fa640 1 -- 172.21.15.5:0/3039575661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f91e40b2f40 con 0x7f91e4159290 2024-09-13T17:13:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:27.260 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 msgr2=0x7f91c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 0x7f91c406d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d4037000 tx=0x7f91d403e040 comp rx=0 tx=0).stop 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 msgr2=0x7f91e40cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d7d0 tx=0x7f91cc00dc90 comp rx=0 tx=0).stop 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 shutdown_connections 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e4159bb0 0x7f91e41e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91c406ac00 0x7f91c406d0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91e4159290 0x7f91e40cd6c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.259+0000 7f91ea701640 1 --2- 172.21.15.5:0/3039575661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40b1970 0x7f91e414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.260+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 >> 172.21.15.5:0/3039575661 conn(0x7f91e40ce0d0 msgr2=0x7f91e406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.260+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 shutdown_connections 2024-09-13T17:13:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.260+0000 7f91ea701640 1 -- 172.21.15.5:0/3039575661 wait complete. 2024-09-13T17:13:27.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.373+0000 7f0afe7ae640 1 Processor -- start 2024-09-13T17:13:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.373+0000 7f0afe7ae640 1 -- start start 2024-09-13T17:13:27.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afe7ae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af8159290 0x7f0af8159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afe7ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8071190 0x7f0af806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afe7ae640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80b1580 con 0x7f0af8159bb0 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afe7ae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80b2ad0 con 0x7f0af8159290 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afe7ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80b1ec0 con 0x7f0af8071190 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af8159290 0x7f0af8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0afcd4b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8071190 0x7f0af806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af77fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0af8159bb0 0x7f0af8070a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60148/0 (socket says 172.21.15.5:60148) 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af77fe640 1 -- 172.21.15.5:0/1468973441 learned_addr learned my addr 172.21.15.5:0/1468973441 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af7fff640 1 -- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8071190 msgr2=0x7f0af806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af7fff640 1 --2- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8071190 0x7f0af806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af7fff640 1 -- 172.21.15.5:0/1468973441 >> v1:172.21.15.179:6789/0 conn(0x7f0af8159bb0 legacy=0x7f0af8070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.374+0000 7f0af7fff640 1 -- 172.21.15.5:0/1468973441 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80b21a0 con 0x7f0af8159290 2024-09-13T17:13:27.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.375+0000 7f0af7fff640 1 --2- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8159290 0x7f0af8159670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9445441d4de32ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.375+0000 7f0af6ffd640 1 -- 172.21.15.5:0/1468973441 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8032440 con 0x7f0af8159290 2024-09-13T17:13:27.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.375+0000 7f0af6ffd640 1 -- 172.21.15.5:0/1468973441 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80325a0 con 0x7f0af8159290 2024-09-13T17:13:27.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.375+0000 7f0af6ffd640 1 -- 172.21.15.5:0/1468973441 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8032930 con 0x7f0af8159290 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 -- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8159290 msgr2=0x7f0af8159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8159290 0x7f0af8159670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802a180 comp rx=0 tx=0).stop 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 -- 172.21.15.5:0/1468973441 shutdown_connections 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8071190 0x7f0af806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/1468973441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8159290 0x7f0af8159670 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 -- 172.21.15.5:0/1468973441 >> 172.21.15.5:0/1468973441 conn(0x7f0af80ce0d0 msgr2=0x7f0af80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 -- 172.21.15.5:0/1468973441 shutdown_connections 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.376+0000 7f0afe7ae640 1 -- 172.21.15.5:0/1468973441 wait complete. 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.377+0000 7f0afe7ae640 1 Processor -- start 2024-09-13T17:13:27.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.377+0000 7f0afe7ae640 1 -- start start 2024-09-13T17:13:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8071190 0x7f0af814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8159290 0x7f0af80ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80ab9e0 con 0x7f0af8159bb0 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80ab6e0 con 0x7f0af8071190 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afe7ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80af510 con 0x7f0af8159290 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38736/0 (socket says 172.21.15.5:38736) 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 -- 172.21.15.5:0/927295829 learned_addr learned my addr 172.21.15.5:0/927295829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0af77fe640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8159290 0x7f0af80ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0af7fff640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8071190 0x7f0af814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 -- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8159290 msgr2=0x7f0af80ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8159290 0x7f0af80ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 -- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8071190 msgr2=0x7f0af814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8071190 0x7f0af814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.378+0000 7f0afcd4b640 1 -- 172.21.15.5:0/927295829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009400 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0afcd4b640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0af000bda0 tx=0x7f0af000e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0010040 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000eb20 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af80b30e0 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000eed0 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.379+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af80afad0 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.380+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af80b2f40 con 0x7f0af8159bb0 2024-09-13T17:13:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.380+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0af0003990 con 0x7f0af8159bb0 2024-09-13T17:13:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.381+0000 7f0af4ff9640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 0x7f0ae406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.381+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0af0089860 con 0x7f0af8159bb0 2024-09-13T17:13:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.381+0000 7f0af7fff640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 0x7f0ae406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.382+0000 7f0af7fff640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 0x7f0ae406d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8034000 tx=0x7f0ae802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.385+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0af80b2f40 con 0x7f0af8159bb0 2024-09-13T17:13:27.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.556+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af80b2f40 con 0x7f0af8159bb0 2024-09-13T17:13:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.557+0000 7f0af4ff9640 1 -- 172.21.15.5:0/927295829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f0af80b2f40 con 0x7f0af8159bb0 2024-09-13T17:13:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:27.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:27.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 msgr2=0x7f0ae406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 0x7f0ae406d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8034000 tx=0x7f0ae802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:27.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 msgr2=0x7f0af80aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0af000bda0 tx=0x7f0af000e490 comp rx=0 tx=0).stop 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 shutdown_connections 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ae406ac00 0x7f0ae406d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af8159bb0 0x7f0af80aee90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af8159290 0x7f0af80ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 --2- 172.21.15.5:0/927295829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af8071190 0x7f0af814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 >> 172.21.15.5:0/927295829 conn(0x7f0af80ce0d0 msgr2=0x7f0af8150950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 shutdown_connections 2024-09-13T17:13:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.559+0000 7f0afe7ae640 1 -- 172.21.15.5:0/927295829 wait complete. 2024-09-13T17:13:27.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:13:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.674+0000 7fdf58ab1640 1 Processor -- start 2024-09-13T17:13:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.674+0000 7fdf58ab1640 1 -- start start 2024-09-13T17:13:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf58ab1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf540cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf58ab1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf540704a0 con 0x7fdf5415fd80 2024-09-13T17:13:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf58ab1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5406bd80 con 0x7fdf540d0e30 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf58ab1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5406cc10 con 0x7fdf54099110 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf5259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf5415fd80 0x7fdf54098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40424/0 (socket says 172.21.15.5:40424) 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf5259c640 1 -- 172.21.15.5:0/1148638579 learned_addr learned my addr 172.21.15.5:0/1148638579 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.675+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859723479 0 0) 0x7fdf540704a0 con 0x7fdf5415fd80 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf540cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf3c003520 con 0x7fdf5415fd80 2024-09-13T17:13:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730606890 0 0) 0x7fdf3c003520 con 0x7fdf5415fd80 2024-09-13T17:13:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 msgr2=0x7fdf540cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf540cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 >> v1:172.21.15.179:6789/0 conn(0x7fdf540d0e30 legacy=0x7fdf5406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5406c210 con 0x7fdf5415fd80 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fdf44001670 con 0x7fdf5415fd80 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 >> v1:172.21.15.5:6789/0 conn(0x7fdf5415fd80 legacy=0x7fdf54098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c0047c0 0x7fdf3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00bab0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00bc20 con 0x7fdf3c0047c0 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00bde0 con 0x7fdf54099110 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf52d9d640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c0047c0 0x7fdf3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 -- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 msgr2=0x7fdf3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf54099110 0x7fdf3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 -- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c0047c0 msgr2=0x7fdf3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c0047c0 0x7fdf3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.676+0000 7fdf5259c640 1 -- 172.21.15.5:0/1148638579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c003520 con 0x7fdf3c0039a0 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.677+0000 7fdf5259c640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf3c003dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c240 tx=0x7fdf3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511a396fdcfd580 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.677+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4402e070 con 0x7fdf3c0039a0 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.677+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf440058d0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.677+0000 7fdf5159a640 1 -- 172.21.15.5:0/1148638579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44005c80 con 0x7fdf3c0039a0 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 -- 172.21.15.5:0/1148638579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 msgr2=0x7fdf3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/1148638579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf3c003dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c240 tx=0x7fdf3c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf52d9d640 1 -- 172.21.15.5:0/1148638579 reap_dead start 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 -- 172.21.15.5:0/1148638579 shutdown_connections 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 -- 172.21.15.5:0/1148638579 >> 172.21.15.5:0/1148638579 conn(0x7fdf540d0310 msgr2=0x7fdf540d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 -- 172.21.15.5:0/1148638579 shutdown_connections 2024-09-13T17:13:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.678+0000 7fdf58ab1640 1 -- 172.21.15.5:0/1148638579 wait complete. 2024-09-13T17:13:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.679+0000 7fdf58ab1640 1 Processor -- start 2024-09-13T17:13:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.679+0000 7fdf58ab1640 1 -- start start 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 0x7fdf541f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf541f2510 0x7fdf5415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540c90f0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541f2ff0 con 0x7fdf541f2510 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf58ab1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541f2a30 con 0x7fdf540c4ad0 2024-09-13T17:13:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38750/0 (socket says 172.21.15.5:38750) 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf5259c640 1 -- 172.21.15.5:0/3753953765 learned_addr learned my addr 172.21.15.5:0/3753953765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 0x7fdf541f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf52d9d640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf541f2510 0x7fdf5415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf5259c640 1 -- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 msgr2=0x7fdf541f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.680+0000 7fdf5259c640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 0x7fdf541f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf5259c640 1 -- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf541f2510 msgr2=0x7fdf5415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf5259c640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf541f2510 0x7fdf5415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf5259c640 1 -- 172.21.15.5:0/3753953765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf541f2d10 con 0x7fdf3c0039a0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 0x7fdf541f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf5259c640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf4402ad70 tx=0x7fdf44001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44000ed0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf440076b0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf540c8d10 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44033640 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.681+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5415e530 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.682+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540cfa60 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.682+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf440337a0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.683+0000 7fdf42ffd640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 0x7fdf3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.683+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf440a9e40 con 0x7fdf3c0039a0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.683+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 0x7fdf3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.684+0000 7fdf51d9b640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 0x7fdf3406d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf5415d2f0 tx=0x7fdf48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.687+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf44074ee0 con 0x7fdf3c0039a0 2024-09-13T17:13:27.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:27.895+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf540b1880 con 0x7fdf3c0039a0 2024-09-13T17:13:28.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.339+0000 7fdf42ffd640 1 -- 172.21.15.5:0/3753953765 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf44078500 con 0x7fdf3c0039a0 2024-09-13T17:13:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 msgr2=0x7fdf3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 0x7fdf3406d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf5415d2f0 tx=0x7fdf48008040 comp rx=0 tx=0).stop 2024-09-13T17:13:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 msgr2=0x7fdf54157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf4402ad70 tx=0x7fdf44001a00 comp rx=0 tx=0).stop 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 shutdown_connections 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf541f2510 0x7fdf5415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540c4ad0 0x7fdf541f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3406ac30 0x7fdf3406d0f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 --2- 172.21.15.5:0/3753953765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf3c0039a0 0x7fdf54157a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 >> 172.21.15.5:0/3753953765 conn(0x7fdf540d0310 msgr2=0x7fdf540cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 shutdown_connections 2024-09-13T17:13:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.341+0000 7fdf58ab1640 1 -- 172.21.15.5:0/3753953765 wait complete. 2024-09-13T17:13:28.355 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T17:13:28.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:13:28.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.462+0000 7f7c75a5a640 1 Processor -- start 2024-09-13T17:13:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.462+0000 7f7c75a5a640 1 -- start start 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c75a5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c700b1230 0x7f7c700cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c75a5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c700b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c75a5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c700ce590 con 0x7f7c7015fce0 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c75a5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700b4fc0 con 0x7f7c700b1230 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c75a5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700ccd80 con 0x7f7c700d13f0 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c6effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c7015fce0 0x7f7c700b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40430/0 (socket says 172.21.15.5:40430) 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.463+0000 7f7c6effd640 1 -- 172.21.15.5:0/3404196483 learned_addr learned my addr 172.21.15.5:0/3404196483 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6f7fe640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c700b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6e7fc640 1 --2- 172.21.15.5:0/3404196483 >> v2:172.21.15.179:3300/0 conn(0x7f7c700b1230 0x7f7c700cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107457043 0 0) 0x7f7c700ce590 con 0x7f7c7015fce0 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c58003520 con 0x7f7c7015fce0 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 38155026 0 0) 0x7f7c58003520 con 0x7f7c7015fce0 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 msgr2=0x7f7c700b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c700b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 >> v2:172.21.15.179:3300/0 conn(0x7f7c700b1230 msgr2=0x7f7c700cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3404196483 >> v2:172.21.15.179:3300/0 conn(0x7f7c700b1230 0x7f7c700cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700d3340 con 0x7f7c7015fce0 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f7c60001670 con 0x7f7c7015fce0 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 >> v1:172.21.15.5:6789/0 conn(0x7f7c7015fce0 legacy=0x7f7c700b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c58003970 0x7f7c58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c580047c0 0x7f7c58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b4fc0 con 0x7f7c58003970 2024-09-13T17:13:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700ccd80 con 0x7f7c580047c0 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5800b980 con 0x7f7c700d13f0 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c58003970 0x7f7c58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6f7fe640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6e7fc640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c580047c0 0x7f7c58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 -- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 msgr2=0x7f7c58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700d13f0 0x7f7c58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 -- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c580047c0 msgr2=0x7f7c58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c580047c0 0x7f7c58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.464+0000 7f7c6effd640 1 -- 172.21.15.5:0/3404196483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58003520 con 0x7f7c58003970 2024-09-13T17:13:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.465+0000 7f7c6effd640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c58003970 0x7f7c58003d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c2c0 tx=0x7f7c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d881eed512d2b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.465+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60005ad0 con 0x7f7c58003970 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.465+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c60005c30 con 0x7f7c58003970 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.465+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3404196483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60007070 con 0x7f7c58003970 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 -- 172.21.15.5:0/3404196483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c58003970 msgr2=0x7f7c58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/3404196483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c58003970 0x7f7c58003d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c2c0 tx=0x7f7c580057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c6f7fe640 1 -- 172.21.15.5:0/3404196483 reap_dead start 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 -- 172.21.15.5:0/3404196483 shutdown_connections 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 -- 172.21.15.5:0/3404196483 >> 172.21.15.5:0/3404196483 conn(0x7f7c70089f90 msgr2=0x7f7c700d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 -- 172.21.15.5:0/3404196483 shutdown_connections 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.466+0000 7f7c75a5a640 1 -- 172.21.15.5:0/3404196483 wait complete. 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.467+0000 7f7c75a5a640 1 Processor -- start 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.467+0000 7f7c75a5a640 1 -- start start 2024-09-13T17:13:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c58003970 0x7f7c701efa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b61d0 0x7f7c700c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c701eff80 con 0x7f7c700c8a30 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700c7450 con 0x7f7c58003970 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c75a5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700c7730 con 0x7f7c700b61d0 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38766/0 (socket says 172.21.15.5:38766) 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 -- 172.21.15.5:0/39372227 learned_addr learned my addr 172.21.15.5:0/39372227 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6e7fc640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b61d0 0x7f7c700c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6effd640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c58003970 0x7f7c701efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 -- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b61d0 msgr2=0x7f7c700c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b61d0 0x7f7c700c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 -- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c58003970 msgr2=0x7f7c701efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c58003970 0x7f7c701efa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.468+0000 7f7c6f7fe640 1 -- 172.21.15.5:0/39372227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700c7a10 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c6f7fe640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c7008ac70 tx=0x7f7c6800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800e040 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800f040 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c700c7cf0 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68015670 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.469+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700c7090 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.470+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700cdf00 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.470+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c680157d0 con 0x7f7c700c8a30 2024-09-13T17:13:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.471+0000 7f7c57fff640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 0x7f7c5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.471+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c68089e30 con 0x7f7c700c8a30 2024-09-13T17:13:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.471+0000 7f7c6effd640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 0x7f7c5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.472+0000 7f7c6effd640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 0x7f7c5c06d0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c60033000 tx=0x7f7c60009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.475+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c68054d20 con 0x7f7c700c8a30 2024-09-13T17:13:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:28.684+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c700cea20 con 0x7f7c700c8a30 2024-09-13T17:13:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.344+0000 7f7c57fff640 1 -- 172.21.15.5:0/39372227 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c68058340 con 0x7f7c700c8a30 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 msgr2=0x7f7c5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 0x7f7c5c06d0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c60033000 tx=0x7f7c60009030 comp rx=0 tx=0).stop 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 msgr2=0x7f7c701f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c7008ac70 tx=0x7f7c6800f580 comp rx=0 tx=0).stop 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 shutdown_connections 2024-09-13T17:13:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c5c06ac30 0x7f7c5c06d0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c700c8a30 0x7f7c701f36c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b61d0 0x7f7c700c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 --2- 172.21.15.5:0/39372227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c58003970 0x7f7c701efa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 >> 172.21.15.5:0/39372227 conn(0x7f7c70089f90 msgr2=0x7f7c7006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 shutdown_connections 2024-09-13T17:13:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.347+0000 7f7c75a5a640 1 -- 172.21.15.5:0/39372227 wait complete. 2024-09-13T17:13:29.362 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:13:29.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.468+0000 7fe4218e9640 1 Processor -- start 2024-09-13T17:13:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.468+0000 7fe4218e9640 1 -- start start 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe4218e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe41c15ff70 0x7fe41c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe4218e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0b0be0 con 0x7fe41c0b15b0 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe4218e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0affd0 con 0x7fe41c15fb90 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe4218e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0b02b0 con 0x7fe41c15ff70 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe41b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe41c0b15b0 0x7fe41c0cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40436/0 (socket says 172.21.15.5:40436) 2024-09-13T17:13:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.469+0000 7fe41b7fe640 1 -- 172.21.15.5:0/2779411600 learned_addr learned my addr 172.21.15.5:0/2779411600 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe41a7fc640 1 --2- 172.21.15.5:0/2779411600 >> v2:172.21.15.179:3300/0 conn(0x7fe41c15ff70 0x7fe41c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340951450 0 0) 0x7fe41c0b0be0 con 0x7fe41c0b15b0 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe404003520 con 0x7fe41c0b15b0 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665987681 0 0) 0x7fe41c0affd0 con 0x7fe41c15fb90 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe41c0b0be0 con 0x7fe41c15fb90 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541858352 0 0) 0x7fe404003520 con 0x7fe41c0b15b0 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe41a7fc640 1 -- 172.21.15.5:0/2779411600 >> v1:172.21.15.179:6789/0 conn(0x7fe41c15fb90 legacy=0x7fe41c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe41a7fc640 1 -- 172.21.15.5:0/2779411600 >> v1:172.21.15.5:6789/0 conn(0x7fe41c0b15b0 legacy=0x7fe41c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.470+0000 7fe41a7fc640 1 -- 172.21.15.5:0/2779411600 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0b0590 con 0x7fe41c15ff70 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.471+0000 7fe41a7fc640 1 --2- 172.21.15.5:0/2779411600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c15ff70 0x7fe41c0b1070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe410009790 tx=0x7fe41002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be5233951450693 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.471+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140019f0 con 0x7fe41c15ff70 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.471+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41002ac30 con 0x7fe41c15ff70 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.471+0000 7fe419ffb640 1 -- 172.21.15.5:0/2779411600 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410032440 con 0x7fe41c15ff70 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 -- 172.21.15.5:0/2779411600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c15ff70 msgr2=0x7fe41c0b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 --2- 172.21.15.5:0/2779411600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c15ff70 0x7fe41c0b1070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe410009790 tx=0x7fe41002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 -- 172.21.15.5:0/2779411600 shutdown_connections 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 --2- 172.21.15.5:0/2779411600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c15ff70 0x7fe41c0b1070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 -- 172.21.15.5:0/2779411600 >> 172.21.15.5:0/2779411600 conn(0x7fe41c089f90 msgr2=0x7fe41c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 -- 172.21.15.5:0/2779411600 shutdown_connections 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.472+0000 7fe4218e9640 1 -- 172.21.15.5:0/2779411600 wait complete. 2024-09-13T17:13:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.473+0000 7fe4218e9640 1 Processor -- start 2024-09-13T17:13:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.473+0000 7fe4218e9640 1 -- start start 2024-09-13T17:13:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c0b15b0 0x7fe41c159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe41c15fb90 0x7fe41c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b37d0 con 0x7fe41c15ff70 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b3ab0 con 0x7fe41c0b15b0 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe4218e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b3d90 con 0x7fe41c15fb90 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38780/0 (socket says 172.21.15.5:38780) 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 -- 172.21.15.5:0/518350074 learned_addr learned my addr 172.21.15.5:0/518350074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41a7fc640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe41c15fb90 0x7fe41c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41affd640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c0b15b0 0x7fe41c159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 -- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe41c15fb90 msgr2=0x7fe41c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe41c15fb90 0x7fe41c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 -- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c0b15b0 msgr2=0x7fe41c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c0b15b0 0x7fe41c159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 -- 172.21.15.5:0/518350074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100093a0 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe41b7fe640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe414001f60 tx=0x7fe41400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.474+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414012400 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.475+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414012580 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.475+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0b4070 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.475+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414012930 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.475+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c0b4590 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.475+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c0b42b0 con 0x7fe41c15ff70 2024-09-13T17:13:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.476+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe414007070 con 0x7fe41c15ff70 2024-09-13T17:13:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.476+0000 7fe403fff640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.477+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe414089700 con 0x7fe41c15ff70 2024-09-13T17:13:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.477+0000 7fe41affd640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.477+0000 7fe41affd640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 0x7fe40806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0011e0 tx=0x7fe40c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.481+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe414054730 con 0x7fe41c15ff70 2024-09-13T17:13:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.692+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe41c0b3910 con 0x7fe41c15ff70 2024-09-13T17:13:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.693+0000 7fe403fff640 1 -- 172.21.15.5:0/518350074 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7fe41c0b3910 con 0x7fe41c15ff70 2024-09-13T17:13:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:29.695 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:13:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 msgr2=0x7fe40806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 0x7fe40806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0011e0 tx=0x7fe40c009040 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 msgr2=0x7fe41c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe414001f60 tx=0x7fe41400a430 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 shutdown_connections 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe41c15ff70 0x7fe41c15ae20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe41c15fb90 0x7fe41c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 --2- 172.21.15.5:0/518350074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe41c0b15b0 0x7fe41c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 >> 172.21.15.5:0/518350074 conn(0x7fe41c089f90 msgr2=0x7fe41c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 shutdown_connections 2024-09-13T17:13:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.695+0000 7fe4218e9640 1 -- 172.21.15.5:0/518350074 wait complete. 2024-09-13T17:13:29.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.807+0000 7f0712eb8640 1 Processor -- start 2024-09-13T17:13:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.807+0000 7f0712eb8640 1 -- start start 2024-09-13T17:13:29.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0712eb8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f070c156f40 0x7f070c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0712eb8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f070c0b1080 0x7f070c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0712eb8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c0b2390 con 0x7f070c06dff0 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0712eb8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070c06e440 con 0x7f070c0b1080 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0712eb8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070c0b14c0 con 0x7f070c156f40 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f070c0b1080 0x7f070c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f070c0b1080 0x7f070c06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38790/0 (socket says 172.21.15.5:38790) 2024-09-13T17:13:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 -- 172.21.15.5:0/3640040144 learned_addr learned my addr 172.21.15.5:0/3640040144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f0710c54640 1 --2- 172.21.15.5:0/3640040144 >> v2:172.21.15.179:3300/0 conn(0x7f070c156f40 0x7f070c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 -- 172.21.15.5:0/3640040144 >> v2:172.21.15.179:3300/0 conn(0x7f070c156f40 msgr2=0x7f070c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 --2- 172.21.15.5:0/3640040144 >> v2:172.21.15.179:3300/0 conn(0x7f070c156f40 0x7f070c15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 -- 172.21.15.5:0/3640040144 >> v1:172.21.15.179:6789/0 conn(0x7f070c06dff0 legacy=0x7f070c0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.808+0000 7f070bfff640 1 -- 172.21.15.5:0/3640040144 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c0b1780 con 0x7f070c0b1080 2024-09-13T17:13:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.809+0000 7f070bfff640 1 --2- 172.21.15.5:0/3640040144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c0b1080 0x7f070c06dab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f070c06aea0 tx=0x7f06f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c1402941b42fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.809+0000 7f070b7fe640 1 -- 172.21.15.5:0/3640040144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8032440 con 0x7f070c0b1080 2024-09-13T17:13:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.809+0000 7f070b7fe640 1 -- 172.21.15.5:0/3640040144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80325a0 con 0x7f070c0b1080 2024-09-13T17:13:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.809+0000 7f070b7fe640 1 -- 172.21.15.5:0/3640040144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8032930 con 0x7f070c0b1080 2024-09-13T17:13:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 -- 172.21.15.5:0/3640040144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c0b1080 msgr2=0x7f070c06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 --2- 172.21.15.5:0/3640040144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c0b1080 0x7f070c06dab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f070c06aea0 tx=0x7f06f802a230 comp rx=0 tx=0).stop 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 -- 172.21.15.5:0/3640040144 shutdown_connections 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 --2- 172.21.15.5:0/3640040144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c0b1080 0x7f070c06dab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 --2- 172.21.15.5:0/3640040144 >> v2:172.21.15.179:3300/0 conn(0x7f070c156f40 0x7f070c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 -- 172.21.15.5:0/3640040144 >> 172.21.15.5:0/3640040144 conn(0x7f070c0ce0d0 msgr2=0x7f070c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 -- 172.21.15.5:0/3640040144 shutdown_connections 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.810+0000 7f0712eb8640 1 -- 172.21.15.5:0/3640040144 wait complete. 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.811+0000 7f0712eb8640 1 Processor -- start 2024-09-13T17:13:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.811+0000 7f0712eb8640 1 -- start start 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 0x7f070c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f070c156f40 0x7f070c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c152440 con 0x7f070c06dff0 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c155980 con 0x7f070c0b1080 2024-09-13T17:13:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c154db0 con 0x7f070c156f40 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38796/0 (socket says 172.21.15.5:38796) 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 -- 172.21.15.5:0/4273434321 learned_addr learned my addr 172.21.15.5:0/4273434321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0711455640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f070c156f40 0x7f070c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f070bfff640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 0x7f070c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 -- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f070c156f40 msgr2=0x7f070c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f070c156f40 0x7f070c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 -- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 msgr2=0x7f070c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 0x7f070c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 -- 172.21.15.5:0/4273434321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80094d0 con 0x7f070c06dff0 2024-09-13T17:13:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f070bfff640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 0x7f070c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0710c54640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f070000c820 tx=0x7f070000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004020 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700004180 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.812+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c153930 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.813+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700007830 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.813+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c155330 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.813+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c0672a0 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.814+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0700007990 con 0x7f070c06dff0 2024-09-13T17:13:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.814+0000 7f07097fa640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 0x7f06f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.814+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0700089320 con 0x7f070c06dff0 2024-09-13T17:13:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.815+0000 7f070bfff640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 0x7f06f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.815+0000 7f070bfff640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 0x7f06f006d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034000 tx=0x7f06f802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.819+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0700054210 con 0x7f070c06dff0 2024-09-13T17:13:29.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.990+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070c0ce4b0 con 0x7f070c06dff0 2024-09-13T17:13:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.991+0000 7f07097fa640 1 -- 172.21.15.5:0/4273434321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f0700057830 con 0x7f070c06dff0 2024-09-13T17:13:29.993 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:29.993 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 msgr2=0x7f06f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 0x7f06f006d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f06f8034000 tx=0x7f06f802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 msgr2=0x7f070c14f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f070000c820 tx=0x7f070000cce0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 shutdown_connections 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f070c156f40 0x7f070c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f070c0b1080 0x7f070c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06f006ac00 0x7f06f006d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 --2- 172.21.15.5:0/4273434321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070c06dff0 0x7f070c14f760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 >> 172.21.15.5:0/4273434321 conn(0x7f070c0ce0d0 msgr2=0x7f070c0ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 shutdown_connections 2024-09-13T17:13:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:29.993+0000 7f0712eb8640 1 -- 172.21.15.5:0/4273434321 wait complete. 2024-09-13T17:13:30.006 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:13:30.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:30.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.106+0000 7fbdc8887640 1 Processor -- start 2024-09-13T17:13:30.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.106+0000 7fbdc8887640 1 -- start start 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc8887640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbdc415fb90 0x7fbdc40b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc8887640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdc40b5890 0x7fbdc40b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc8887640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc40b0be0 con 0x7fbdc415ff70 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc8887640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc40affd0 con 0x7fbdc415fb90 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc8887640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc40b02b0 con 0x7fbdc40b5890 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbdc415fb90 0x7fbdc40b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbdc415fb90 0x7fbdc40b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38800/0 (socket says 172.21.15.5:38800) 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.107+0000 7fbdc259c640 1 -- 172.21.15.5:0/2384296330 learned_addr learned my addr 172.21.15.5:0/2384296330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc1d9b640 1 --2- 172.21.15.5:0/2384296330 >> v2:172.21.15.179:3300/0 conn(0x7fbdc40b5890 0x7fbdc40b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc259c640 1 -- 172.21.15.5:0/2384296330 >> v2:172.21.15.179:3300/0 conn(0x7fbdc40b5890 msgr2=0x7fbdc40b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:30.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc259c640 1 --2- 172.21.15.5:0/2384296330 >> v2:172.21.15.179:3300/0 conn(0x7fbdc40b5890 0x7fbdc40b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc259c640 1 -- 172.21.15.5:0/2384296330 >> v1:172.21.15.179:6789/0 conn(0x7fbdc415ff70 legacy=0x7fbdc40d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:30.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc259c640 1 -- 172.21.15.5:0/2384296330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40b0590 con 0x7fbdc415fb90 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.108+0000 7fbdc259c640 1 --2- 172.21.15.5:0/2384296330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc415fb90 0x7fbdc40b5350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40c6020 tx=0x7fbdbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e55de5415999dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc159a640 1 -- 172.21.15.5:0/2384296330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc032440 con 0x7fbdc415fb90 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc159a640 1 -- 172.21.15.5:0/2384296330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0325a0 con 0x7fbdc415fb90 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc159a640 1 -- 172.21.15.5:0/2384296330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc032930 con 0x7fbdc415fb90 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 -- 172.21.15.5:0/2384296330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc415fb90 msgr2=0x7fbdc40b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2384296330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc415fb90 0x7fbdc40b5350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40c6020 tx=0x7fbdbc02a270 comp rx=0 tx=0).stop 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 -- 172.21.15.5:0/2384296330 shutdown_connections 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2384296330 >> v2:172.21.15.179:3300/0 conn(0x7fbdc40b5890 0x7fbdc40b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2384296330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc415fb90 0x7fbdc40b5350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 -- 172.21.15.5:0/2384296330 >> 172.21.15.5:0/2384296330 conn(0x7fbdc4089f90 msgr2=0x7fbdc40d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 -- 172.21.15.5:0/2384296330 shutdown_connections 2024-09-13T17:13:30.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.109+0000 7fbdc8887640 1 -- 172.21.15.5:0/2384296330 wait complete. 2024-09-13T17:13:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 Processor -- start 2024-09-13T17:13:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 -- start start 2024-09-13T17:13:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc415fb90 0x7fbdc40b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc415ff70 0x7fbdc40b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc415a9f0 con 0x7fbdc40b5890 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc409f8c0 con 0x7fbdc415ff70 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc8887640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc409fba0 con 0x7fbdc415fb90 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.111+0000 7fbdc259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38812/0 (socket says 172.21.15.5:38812) 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 -- 172.21.15.5:0/2944778408 learned_addr learned my addr 172.21.15.5:0/2944778408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc1d9b640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc415fb90 0x7fbdc40b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc2d9d640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc415ff70 0x7fbdc40b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 -- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc415fb90 msgr2=0x7fbdc40b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc415fb90 0x7fbdc40b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 -- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc415ff70 msgr2=0x7fbdc40b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc415ff70 0x7fbdc40b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 -- 172.21.15.5:0/2944778408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0094d0 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc259c640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc02a2b0 tx=0x7fbdbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc032440 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc030ba0 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc409fe80 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc03d440 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.112+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc415cf30 con 0x7fbdc40b5890 2024-09-13T17:13:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.113+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc415ab60 con 0x7fbdc40b5890 2024-09-13T17:13:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.114+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdbc039040 con 0x7fbdc40b5890 2024-09-13T17:13:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.114+0000 7fbdbaffd640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.114+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdbc0aa200 con 0x7fbdc40b5890 2024-09-13T17:13:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.115+0000 7fbdc1d9b640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.115+0000 7fbdc1d9b640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 0x7fbda406d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40b7e20 tx=0x7fbdac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.119+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbdc415ab60 con 0x7fbdc40b5890 2024-09-13T17:13:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.284+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdc409fd10 con 0x7fbda406ac00 2024-09-13T17:13:30.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.295+0000 7fbdbaffd640 1 -- 172.21.15.5:0/2944778408 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7fbdc409fd10 con 0x7fbda406ac00 2024-09-13T17:13:30.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 msgr2=0x7fbda406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 0x7fbda406d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40b7e20 tx=0x7fbdac008040 comp rx=0 tx=0).stop 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 msgr2=0x7fbdc41f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc02a2b0 tx=0x7fbdbc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 shutdown_connections 2024-09-13T17:13:30.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc415ff70 0x7fbdc40b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdc415fb90 0x7fbdc40b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 --2- 172.21.15.5:0/2944778408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdc40b5890 0x7fbdc41f1a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 >> 172.21.15.5:0/2944778408 conn(0x7fbdc4089f90 msgr2=0x7fbdc406c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 shutdown_connections 2024-09-13T17:13:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.298+0000 7fbdc8887640 1 -- 172.21.15.5:0/2944778408 wait complete. 2024-09-13T17:13:30.311 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-13T17:13:29.259767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003514"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195149+0000","last_change":"2024-09-13T17:13:07.818703+0000","last_active":"2024-09-13T17:13:12.195149+0000","last_peered":"2024-09-13T17:13:12.195149+0000","last_clean":"2024-09-13T17:13:12.195149+0000","last_became_active":"2024-09-13T17:13:07.818425+0000","last_became_peered":"2024-09-13T17:13:07.818425+0000","last_unstale":"2024-09-13T17:13:12.195149+0000","last_undegraded":"2024-09-13T17:13:12.195149+0000","last_fullsized":"2024-09-13T17:13:12.195149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273719+0000","last_change":"2024-09-13T17:13:08.182685+0000","last_active":"2024-09-13T17:13:12.273719+0000","last_peered":"2024-09-13T17:13:12.273719+0000","last_clean":"2024-09-13T17:13:12.273719+0000","last_became_active":"2024-09-13T17:13:08.182447+0000","last_became_peered":"2024-09-13T17:13:08.182447+0000","last_unstale":"2024-09-13T17:13:12.273719+0000","last_undegraded":"2024-09-13T17:13:12.273719+0000","last_fullsized":"2024-09-13T17:13:12.273719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273620+0000","last_change":"2024-09-13T17:13:12.223668+0000","last_active":"2024-09-13T17:13:12.273620+0000","last_peered":"2024-09-13T17:13:12.273620+0000","last_clean":"2024-09-13T17:13:12.273620+0000","last_became_active":"2024-09-13T17:13:12.223255+0000","last_became_peered":"2024-09-13T17:13:12.223255+0000","last_unstale":"2024-09-13T17:13:12.273620+0000","last_undegraded":"2024-09-13T17:13:12.273620+0000","last_fullsized":"2024-09-13T17:13:12.273620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193136+0000","last_change":"2024-09-13T17:13:07.820516+0000","last_active":"2024-09-13T17:13:12.193136+0000","last_peered":"2024-09-13T17:13:12.193136+0000","last_clean":"2024-09-13T17:13:12.193136+0000","last_became_active":"2024-09-13T17:13:07.820233+0000","last_became_peered":"2024-09-13T17:13:07.820233+0000","last_unstale":"2024-09-13T17:13:12.193136+0000","last_undegraded":"2024-09-13T17:13:12.193136+0000","last_fullsized":"2024-09-13T17:13:12.193136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270669+0000","last_change":"2024-09-13T17:13:08.185959+0000","last_active":"2024-09-13T17:13:12.270669+0000","last_peered":"2024-09-13T17:13:12.270669+0000","last_clean":"2024-09-13T17:13:12.270669+0000","last_became_active":"2024-09-13T17:13:08.185705+0000","last_became_peered":"2024-09-13T17:13:08.185705+0000","last_unstale":"2024-09-13T17:13:12.270669+0000","last_undegraded":"2024-09-13T17:13:12.270669+0000","last_fullsized":"2024-09-13T17:13:12.270669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273272+0000","last_change":"2024-09-13T17:13:12.202324+0000","last_active":"2024-09-13T17:13:12.273272+0000","last_peered":"2024-09-13T17:13:12.273272+0000","last_clean":"2024-09-13T17:13:12.273272+0000","last_became_active":"2024-09-13T17:13:12.201852+0000","last_became_peered":"2024-09-13T17:13:12.201852+0000","last_unstale":"2024-09-13T17:13:12.273272+0000","last_undegraded":"2024-09-13T17:13:12.273272+0000","last_fullsized":"2024-09-13T17:13:12.273272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.222040+0000","last_change":"2024-09-13T17:13:07.823003+0000","last_active":"2024-09-13T17:13:12.222040+0000","last_peered":"2024-09-13T17:13:12.222040+0000","last_clean":"2024-09-13T17:13:12.222040+0000","last_became_active":"2024-09-13T17:13:07.822719+0000","last_became_peered":"2024-09-13T17:13:07.822719+0000","last_unstale":"2024-09-13T17:13:12.222040+0000","last_undegraded":"2024-09-13T17:13:12.222040+0000","last_fullsized":"2024-09-13T17:13:12.222040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:18.156159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272024+0000","last_change":"2024-09-13T17:13:08.183825+0000","last_active":"2024-09-13T17:13:12.272024+0000","last_peered":"2024-09-13T17:13:12.272024+0000","last_clean":"2024-09-13T17:13:12.272024+0000","last_became_active":"2024-09-13T17:13:08.183509+0000","last_became_peered":"2024-09-13T17:13:08.183509+0000","last_unstale":"2024-09-13T17:13:12.272024+0000","last_undegraded":"2024-09-13T17:13:12.272024+0000","last_fullsized":"2024-09-13T17:13:12.272024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273360+0000","last_change":"2024-09-13T17:13:12.204784+0000","last_active":"2024-09-13T17:13:12.273360+0000","last_peered":"2024-09-13T17:13:12.273360+0000","last_clean":"2024-09-13T17:13:12.273360+0000","last_became_active":"2024-09-13T17:13:12.203462+0000","last_became_peered":"2024-09-13T17:13:12.203462+0000","last_unstale":"2024-09-13T17:13:12.273360+0000","last_undegraded":"2024-09-13T17:13:12.273360+0000","last_fullsized":"2024-09-13T17:13:12.273360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221256+0000","last_change":"2024-09-13T17:13:07.822927+0000","last_active":"2024-09-13T17:13:12.221256+0000","last_peered":"2024-09-13T17:13:12.221256+0000","last_clean":"2024-09-13T17:13:12.221256+0000","last_became_active":"2024-09-13T17:13:07.822552+0000","last_became_peered":"2024-09-13T17:13:07.822552+0000","last_unstale":"2024-09-13T17:13:12.221256+0000","last_undegraded":"2024-09-13T17:13:12.221256+0000","last_fullsized":"2024-09-13T17:13:12.221256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272055+0000","last_change":"2024-09-13T17:13:08.184922+0000","last_active":"2024-09-13T17:13:12.272055+0000","last_peered":"2024-09-13T17:13:12.272055+0000","last_clean":"2024-09-13T17:13:12.272055+0000","last_became_active":"2024-09-13T17:13:08.184640+0000","last_became_peered":"2024-09-13T17:13:08.184640+0000","last_unstale":"2024-09-13T17:13:12.272055+0000","last_undegraded":"2024-09-13T17:13:12.272055+0000","last_fullsized":"2024-09-13T17:13:12.272055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273329+0000","last_change":"2024-09-13T17:13:12.202312+0000","last_active":"2024-09-13T17:13:12.273329+0000","last_peered":"2024-09-13T17:13:12.273329+0000","last_clean":"2024-09-13T17:13:12.273329+0000","last_became_active":"2024-09-13T17:13:12.201870+0000","last_became_peered":"2024-09-13T17:13:12.201870+0000","last_unstale":"2024-09-13T17:13:12.273329+0000","last_undegraded":"2024-09-13T17:13:12.273329+0000","last_fullsized":"2024-09-13T17:13:12.273329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:13.831220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272599+0000","last_change":"2024-09-13T17:13:08.183978+0000","last_active":"2024-09-13T17:13:12.272599+0000","last_peered":"2024-09-13T17:13:12.272599+0000","last_clean":"2024-09-13T17:13:12.272599+0000","last_became_active":"2024-09-13T17:13:08.183697+0000","last_became_peered":"2024-09-13T17:13:08.183697+0000","last_unstale":"2024-09-13T17:13:12.272599+0000","last_undegraded":"2024-09-13T17:13:12.272599+0000","last_fullsized":"2024-09-13T17:13:12.272599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221213+0000","last_change":"2024-09-13T17:13:07.823217+0000","last_active":"2024-09-13T17:13:12.221213+0000","last_peered":"2024-09-13T17:13:12.221213+0000","last_clean":"2024-09-13T17:13:12.221213+0000","last_became_active":"2024-09-13T17:13:07.822960+0000","last_became_peered":"2024-09-13T17:13:07.822960+0000","last_unstale":"2024-09-13T17:13:12.221213+0000","last_undegraded":"2024-09-13T17:13:12.221213+0000","last_fullsized":"2024-09-13T17:13:12.221213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273425+0000","last_change":"2024-09-13T17:13:12.203048+0000","last_active":"2024-09-13T17:13:12.273425+0000","last_peered":"2024-09-13T17:13:12.273425+0000","last_clean":"2024-09-13T17:13:12.273425+0000","last_became_active":"2024-09-13T17:13:12.202566+0000","last_became_peered":"2024-09-13T17:13:12.202566+0000","last_unstale":"2024-09-13T17:13:12.273425+0000","last_undegraded":"2024-09-13T17:13:12.273425+0000","last_fullsized":"2024-09-13T17:13:12.273425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:22.271791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273675+0000","last_change":"2024-09-13T17:13:08.185754+0000","last_active":"2024-09-13T17:13:12.273675+0000","last_peered":"2024-09-13T17:13:12.273675+0000","last_clean":"2024-09-13T17:13:12.273675+0000","last_became_active":"2024-09-13T17:13:08.184827+0000","last_became_peered":"2024-09-13T17:13:08.184827+0000","last_unstale":"2024-09-13T17:13:12.273675+0000","last_undegraded":"2024-09-13T17:13:12.273675+0000","last_fullsized":"2024-09-13T17:13:12.273675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193832+0000","last_change":"2024-09-13T17:13:07.821299+0000","last_active":"2024-09-13T17:13:12.193832+0000","last_peered":"2024-09-13T17:13:12.193832+0000","last_clean":"2024-09-13T17:13:12.193832+0000","last_became_active":"2024-09-13T17:13:07.820971+0000","last_became_peered":"2024-09-13T17:13:07.820971+0000","last_unstale":"2024-09-13T17:13:12.193832+0000","last_undegraded":"2024-09-13T17:13:12.193832+0000","last_fullsized":"2024-09-13T17:13:12.193832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273393+0000","last_change":"2024-09-13T17:13:12.207075+0000","last_active":"2024-09-13T17:13:12.273393+0000","last_peered":"2024-09-13T17:13:12.273393+0000","last_clean":"2024-09-13T17:13:12.273393+0000","last_became_active":"2024-09-13T17:13:12.206675+0000","last_became_peered":"2024-09-13T17:13:12.206675+0000","last_unstale":"2024-09-13T17:13:12.273393+0000","last_undegraded":"2024-09-13T17:13:12.273393+0000","last_fullsized":"2024-09-13T17:13:12.273393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273611+0000","last_change":"2024-09-13T17:13:08.179110+0000","last_active":"2024-09-13T17:13:12.273611+0000","last_peered":"2024-09-13T17:13:12.273611+0000","last_clean":"2024-09-13T17:13:12.273611+0000","last_became_active":"2024-09-13T17:13:08.178363+0000","last_became_peered":"2024-09-13T17:13:08.178363+0000","last_unstale":"2024-09-13T17:13:12.273611+0000","last_undegraded":"2024-09-13T17:13:12.273611+0000","last_fullsized":"2024-09-13T17:13:12.273611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190765+0000","last_change":"2024-09-13T17:13:07.817732+0000","last_active":"2024-09-13T17:13:12.190765+0000","last_peered":"2024-09-13T17:13:12.190765+0000","last_clean":"2024-09-13T17:13:12.190765+0000","last_became_active":"2024-09-13T17:13:07.817449+0000","last_became_peered":"2024-09-13T17:13:07.817449+0000","last_unstale":"2024-09-13T17:13:12.190765+0000","last_undegraded":"2024-09-13T17:13:12.190765+0000","last_fullsized":"2024-09-13T17:13:12.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271705+0000","last_change":"2024-09-13T17:13:12.224085+0000","last_active":"2024-09-13T17:13:12.271705+0000","last_peered":"2024-09-13T17:13:12.271705+0000","last_clean":"2024-09-13T17:13:12.271705+0000","last_became_active":"2024-09-13T17:13:12.223683+0000","last_became_peered":"2024-09-13T17:13:12.223683+0000","last_unstale":"2024-09-13T17:13:12.271705+0000","last_undegraded":"2024-09-13T17:13:12.271705+0000","last_fullsized":"2024-09-13T17:13:12.271705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:49.009307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273320+0000","last_change":"2024-09-13T17:13:08.176665+0000","last_active":"2024-09-13T17:13:12.273320+0000","last_peered":"2024-09-13T17:13:12.273320+0000","last_clean":"2024-09-13T17:13:12.273320+0000","last_became_active":"2024-09-13T17:13:08.176310+0000","last_became_peered":"2024-09-13T17:13:08.176310+0000","last_unstale":"2024-09-13T17:13:12.273320+0000","last_undegraded":"2024-09-13T17:13:12.273320+0000","last_fullsized":"2024-09-13T17:13:12.273320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:08.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220596+0000","last_change":"2024-09-13T17:13:07.823315+0000","last_active":"2024-09-13T17:13:12.220596+0000","last_peered":"2024-09-13T17:13:12.220596+0000","last_clean":"2024-09-13T17:13:12.220596+0000","last_became_active":"2024-09-13T17:13:07.822797+0000","last_became_peered":"2024-09-13T17:13:07.822797+0000","last_unstale":"2024-09-13T17:13:12.220596+0000","last_undegraded":"2024-09-13T17:13:12.220596+0000","last_fullsized":"2024-09-13T17:13:12.220596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:23.750435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273442+0000","last_change":"2024-09-13T17:13:12.205036+0000","last_active":"2024-09-13T17:13:12.273442+0000","last_peered":"2024-09-13T17:13:12.273442+0000","last_clean":"2024-09-13T17:13:12.273442+0000","last_became_active":"2024-09-13T17:13:12.204585+0000","last_became_peered":"2024-09-13T17:13:12.204585+0000","last_unstale":"2024-09-13T17:13:12.273442+0000","last_undegraded":"2024-09-13T17:13:12.273442+0000","last_fullsized":"2024-09-13T17:13:12.273442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270653+0000","last_change":"2024-09-13T17:13:08.177098+0000","last_active":"2024-09-13T17:13:12.270653+0000","last_peered":"2024-09-13T17:13:12.270653+0000","last_clean":"2024-09-13T17:13:12.270653+0000","last_became_active":"2024-09-13T17:13:08.176776+0000","last_became_peered":"2024-09-13T17:13:08.176776+0000","last_unstale":"2024-09-13T17:13:12.270653+0000","last_undegraded":"2024-09-13T17:13:12.270653+0000","last_fullsized":"2024-09-13T17:13:12.270653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195520+0000","last_change":"2024-09-13T17:13:07.824199+0000","last_active":"2024-09-13T17:13:12.195520+0000","last_peered":"2024-09-13T17:13:12.195520+0000","last_clean":"2024-09-13T17:13:12.195520+0000","last_became_active":"2024-09-13T17:13:07.823911+0000","last_became_peered":"2024-09-13T17:13:07.823911+0000","last_unstale":"2024-09-13T17:13:12.195520+0000","last_undegraded":"2024-09-13T17:13:12.195520+0000","last_fullsized":"2024-09-13T17:13:12.195520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273309+0000","last_change":"2024-09-13T17:13:12.225869+0000","last_active":"2024-09-13T17:13:12.273309+0000","last_peered":"2024-09-13T17:13:12.273309+0000","last_clean":"2024-09-13T17:13:12.273309+0000","last_became_active":"2024-09-13T17:13:12.225019+0000","last_became_peered":"2024-09-13T17:13:12.225019+0000","last_unstale":"2024-09-13T17:13:12.273309+0000","last_undegraded":"2024-09-13T17:13:12.273309+0000","last_fullsized":"2024-09-13T17:13:12.273309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273755+0000","last_change":"2024-09-13T17:13:08.191978+0000","last_active":"2024-09-13T17:13:12.273755+0000","last_peered":"2024-09-13T17:13:12.273755+0000","last_clean":"2024-09-13T17:13:12.273755+0000","last_became_active":"2024-09-13T17:13:08.191706+0000","last_became_peered":"2024-09-13T17:13:08.191706+0000","last_unstale":"2024-09-13T17:13:12.273755+0000","last_undegraded":"2024-09-13T17:13:12.273755+0000","last_fullsized":"2024-09-13T17:13:12.273755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.397971+0000","last_change":"2024-09-13T17:13:07.818785+0000","last_active":"2024-09-13T17:13:12.397971+0000","last_peered":"2024-09-13T17:13:12.397971+0000","last_clean":"2024-09-13T17:13:12.397971+0000","last_became_active":"2024-09-13T17:13:07.818279+0000","last_became_peered":"2024-09-13T17:13:07.818279+0000","last_unstale":"2024-09-13T17:13:12.397971+0000","last_undegraded":"2024-09-13T17:13:12.397971+0000","last_fullsized":"2024-09-13T17:13:12.397971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273550+0000","last_change":"2024-09-13T17:13:12.224503+0000","last_active":"2024-09-13T17:13:12.273550+0000","last_peered":"2024-09-13T17:13:12.273550+0000","last_clean":"2024-09-13T17:13:12.273550+0000","last_became_active":"2024-09-13T17:13:12.224159+0000","last_became_peered":"2024-09-13T17:13:12.224159+0000","last_unstale":"2024-09-13T17:13:12.273550+0000","last_undegraded":"2024-09-13T17:13:12.273550+0000","last_fullsized":"2024-09-13T17:13:12.273550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.258345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271614+0000","last_change":"2024-09-13T17:13:08.175329+0000","last_active":"2024-09-13T17:13:12.271614+0000","last_peered":"2024-09-13T17:13:12.271614+0000","last_clean":"2024-09-13T17:13:12.271614+0000","last_became_active":"2024-09-13T17:13:08.174912+0000","last_became_peered":"2024-09-13T17:13:08.174912+0000","last_unstale":"2024-09-13T17:13:12.271614+0000","last_undegraded":"2024-09-13T17:13:12.271614+0000","last_fullsized":"2024-09-13T17:13:12.271614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221792+0000","last_change":"2024-09-13T17:13:07.823709+0000","last_active":"2024-09-13T17:13:12.221792+0000","last_peered":"2024-09-13T17:13:12.221792+0000","last_clean":"2024-09-13T17:13:12.221792+0000","last_became_active":"2024-09-13T17:13:07.823325+0000","last_became_peered":"2024-09-13T17:13:07.823325+0000","last_unstale":"2024-09-13T17:13:12.221792+0000","last_undegraded":"2024-09-13T17:13:12.221792+0000","last_fullsized":"2024-09-13T17:13:12.221792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270544+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.270544+0000","last_peered":"2024-09-13T17:13:12.270544+0000","last_clean":"2024-09-13T17:13:12.270544+0000","last_became_active":"2024-09-13T17:13:12.221821+0000","last_became_peered":"2024-09-13T17:13:12.221821+0000","last_unstale":"2024-09-13T17:13:12.270544+0000","last_undegraded":"2024-09-13T17:13:12.270544+0000","last_fullsized":"2024-09-13T17:13:12.270544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272069+0000","last_change":"2024-09-13T17:13:08.181489+0000","last_active":"2024-09-13T17:13:12.272069+0000","last_peered":"2024-09-13T17:13:12.272069+0000","last_clean":"2024-09-13T17:13:12.272069+0000","last_became_active":"2024-09-13T17:13:08.181204+0000","last_became_peered":"2024-09-13T17:13:08.181204+0000","last_unstale":"2024-09-13T17:13:12.272069+0000","last_undegraded":"2024-09-13T17:13:12.272069+0000","last_fullsized":"2024-09-13T17:13:12.272069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.197571+0000","last_change":"2024-09-13T17:13:07.818661+0000","last_active":"2024-09-13T17:13:12.197571+0000","last_peered":"2024-09-13T17:13:12.197571+0000","last_clean":"2024-09-13T17:13:12.197571+0000","last_became_active":"2024-09-13T17:13:07.818317+0000","last_became_peered":"2024-09-13T17:13:07.818317+0000","last_unstale":"2024-09-13T17:13:12.197571+0000","last_undegraded":"2024-09-13T17:13:12.197571+0000","last_fullsized":"2024-09-13T17:13:12.197571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271543+0000","last_change":"2024-09-13T17:13:12.202522+0000","last_active":"2024-09-13T17:13:12.271543+0000","last_peered":"2024-09-13T17:13:12.271543+0000","last_clean":"2024-09-13T17:13:12.271543+0000","last_became_active":"2024-09-13T17:13:12.202110+0000","last_became_peered":"2024-09-13T17:13:12.202110+0000","last_unstale":"2024-09-13T17:13:12.271543+0000","last_undegraded":"2024-09-13T17:13:12.271543+0000","last_fullsized":"2024-09-13T17:13:12.271543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273382+0000","last_change":"2024-09-13T17:13:08.179940+0000","last_active":"2024-09-13T17:13:12.273382+0000","last_peered":"2024-09-13T17:13:12.273382+0000","last_clean":"2024-09-13T17:13:12.273382+0000","last_became_active":"2024-09-13T17:13:08.179628+0000","last_became_peered":"2024-09-13T17:13:08.179628+0000","last_unstale":"2024-09-13T17:13:12.273382+0000","last_undegraded":"2024-09-13T17:13:12.273382+0000","last_fullsized":"2024-09-13T17:13:12.273382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:11.564848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190045+0000","last_change":"2024-09-13T17:13:07.821156+0000","last_active":"2024-09-13T17:13:12.190045+0000","last_peered":"2024-09-13T17:13:12.190045+0000","last_clean":"2024-09-13T17:13:12.190045+0000","last_became_active":"2024-09-13T17:13:07.820920+0000","last_became_peered":"2024-09-13T17:13:07.820920+0000","last_unstale":"2024-09-13T17:13:12.190045+0000","last_undegraded":"2024-09-13T17:13:12.190045+0000","last_fullsized":"2024-09-13T17:13:12.190045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271588+0000","last_change":"2024-09-13T17:13:12.210655+0000","last_active":"2024-09-13T17:13:12.271588+0000","last_peered":"2024-09-13T17:13:12.271588+0000","last_clean":"2024-09-13T17:13:12.271588+0000","last_became_active":"2024-09-13T17:13:12.209944+0000","last_became_peered":"2024-09-13T17:13:12.209944+0000","last_unstale":"2024-09-13T17:13:12.271588+0000","last_undegraded":"2024-09-13T17:13:12.271588+0000","last_fullsized":"2024-09-13T17:13:12.271588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271470+0000","last_change":"2024-09-13T17:13:08.175084+0000","last_active":"2024-09-13T17:13:12.271470+0000","last_peered":"2024-09-13T17:13:12.271470+0000","last_clean":"2024-09-13T17:13:12.271470+0000","last_became_active":"2024-09-13T17:13:08.174696+0000","last_became_peered":"2024-09-13T17:13:08.174696+0000","last_unstale":"2024-09-13T17:13:12.271470+0000","last_undegraded":"2024-09-13T17:13:12.271470+0000","last_fullsized":"2024-09-13T17:13:12.271470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186429+0000","last_change":"2024-09-13T17:13:07.820916+0000","last_active":"2024-09-13T17:13:12.186429+0000","last_peered":"2024-09-13T17:13:12.186429+0000","last_clean":"2024-09-13T17:13:12.186429+0000","last_became_active":"2024-09-13T17:13:07.820607+0000","last_became_peered":"2024-09-13T17:13:07.820607+0000","last_unstale":"2024-09-13T17:13:12.186429+0000","last_undegraded":"2024-09-13T17:13:12.186429+0000","last_fullsized":"2024-09-13T17:13:12.186429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271720+0000","last_change":"2024-09-13T17:13:12.209459+0000","last_active":"2024-09-13T17:13:12.271720+0000","last_peered":"2024-09-13T17:13:12.271720+0000","last_clean":"2024-09-13T17:13:12.271720+0000","last_became_active":"2024-09-13T17:13:12.208931+0000","last_became_peered":"2024-09-13T17:13:12.208931+0000","last_unstale":"2024-09-13T17:13:12.271720+0000","last_undegraded":"2024-09-13T17:13:12.271720+0000","last_fullsized":"2024-09-13T17:13:12.271720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270503+0000","last_change":"2024-09-13T17:13:08.180268+0000","last_active":"2024-09-13T17:13:12.270503+0000","last_peered":"2024-09-13T17:13:12.270503+0000","last_clean":"2024-09-13T17:13:12.270503+0000","last_became_active":"2024-09-13T17:13:08.179711+0000","last_became_peered":"2024-09-13T17:13:08.179711+0000","last_unstale":"2024-09-13T17:13:12.270503+0000","last_undegraded":"2024-09-13T17:13:12.270503+0000","last_fullsized":"2024-09-13T17:13:12.270503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:07.540508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220632+0000","last_change":"2024-09-13T17:13:07.823838+0000","last_active":"2024-09-13T17:13:12.220632+0000","last_peered":"2024-09-13T17:13:12.220632+0000","last_clean":"2024-09-13T17:13:12.220632+0000","last_became_active":"2024-09-13T17:13:07.823558+0000","last_became_peered":"2024-09-13T17:13:07.823558+0000","last_unstale":"2024-09-13T17:13:12.220632+0000","last_undegraded":"2024-09-13T17:13:12.220632+0000","last_fullsized":"2024-09-13T17:13:12.220632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270643+0000","last_change":"2024-09-13T17:13:12.222477+0000","last_active":"2024-09-13T17:13:12.270643+0000","last_peered":"2024-09-13T17:13:12.270643+0000","last_clean":"2024-09-13T17:13:12.270643+0000","last_became_active":"2024-09-13T17:13:12.221879+0000","last_became_peered":"2024-09-13T17:13:12.221879+0000","last_unstale":"2024-09-13T17:13:12.270643+0000","last_undegraded":"2024-09-13T17:13:12.270643+0000","last_fullsized":"2024-09-13T17:13:12.270643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273658+0000","last_change":"2024-09-13T17:13:08.185879+0000","last_active":"2024-09-13T17:13:12.273658+0000","last_peered":"2024-09-13T17:13:12.273658+0000","last_clean":"2024-09-13T17:13:12.273658+0000","last_became_active":"2024-09-13T17:13:08.185632+0000","last_became_peered":"2024-09-13T17:13:08.185632+0000","last_unstale":"2024-09-13T17:13:12.273658+0000","last_undegraded":"2024-09-13T17:13:12.273658+0000","last_fullsized":"2024-09-13T17:13:12.273658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.187815+0000","last_change":"2024-09-13T17:13:07.811868+0000","last_active":"2024-09-13T17:13:12.187815+0000","last_peered":"2024-09-13T17:13:12.187815+0000","last_clean":"2024-09-13T17:13:12.187815+0000","last_became_active":"2024-09-13T17:13:07.811535+0000","last_became_peered":"2024-09-13T17:13:07.811535+0000","last_unstale":"2024-09-13T17:13:12.187815+0000","last_undegraded":"2024-09-13T17:13:12.187815+0000","last_fullsized":"2024-09-13T17:13:12.187815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220708+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:13:12.220708+0000","last_peered":"2024-09-13T17:13:12.220708+0000","last_clean":"2024-09-13T17:13:12.220708+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:13:12.220708+0000","last_undegraded":"2024-09-13T17:13:12.220708+0000","last_fullsized":"2024-09-13T17:13:12.220708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272664+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.272664+0000","last_peered":"2024-09-13T17:13:12.272664+0000","last_clean":"2024-09-13T17:13:12.272664+0000","last_became_active":"2024-09-13T17:13:12.223344+0000","last_became_peered":"2024-09-13T17:13:12.223344+0000","last_unstale":"2024-09-13T17:13:12.272664+0000","last_undegraded":"2024-09-13T17:13:12.272664+0000","last_fullsized":"2024-09-13T17:13:12.272664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.318166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272521+0000","last_change":"2024-09-13T17:13:08.195358+0000","last_active":"2024-09-13T17:13:12.272521+0000","last_peered":"2024-09-13T17:13:12.272521+0000","last_clean":"2024-09-13T17:13:12.272521+0000","last_became_active":"2024-09-13T17:13:08.194963+0000","last_became_peered":"2024-09-13T17:13:08.194963+0000","last_unstale":"2024-09-13T17:13:12.272521+0000","last_undegraded":"2024-09-13T17:13:12.272521+0000","last_fullsized":"2024-09-13T17:13:12.272521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186435+0000","last_change":"2024-09-13T17:13:07.814854+0000","last_active":"2024-09-13T17:13:12.186435+0000","last_peered":"2024-09-13T17:13:12.186435+0000","last_clean":"2024-09-13T17:13:12.186435+0000","last_became_active":"2024-09-13T17:13:07.814526+0000","last_became_peered":"2024-09-13T17:13:07.814526+0000","last_unstale":"2024-09-13T17:13:12.186435+0000","last_undegraded":"2024-09-13T17:13:12.186435+0000","last_fullsized":"2024-09-13T17:13:12.186435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272579+0000","last_change":"2024-09-13T17:13:12.222081+0000","last_active":"2024-09-13T17:13:12.272579+0000","last_peered":"2024-09-13T17:13:12.272579+0000","last_clean":"2024-09-13T17:13:12.272579+0000","last_became_active":"2024-09-13T17:13:12.221687+0000","last_became_peered":"2024-09-13T17:13:12.221687+0000","last_unstale":"2024-09-13T17:13:12.272579+0000","last_undegraded":"2024-09-13T17:13:12.272579+0000","last_fullsized":"2024-09-13T17:13:12.272579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272033+0000","last_change":"2024-09-13T17:13:08.181540+0000","last_active":"2024-09-13T17:13:12.272033+0000","last_peered":"2024-09-13T17:13:12.272033+0000","last_clean":"2024-09-13T17:13:12.272033+0000","last_became_active":"2024-09-13T17:13:08.181238+0000","last_became_peered":"2024-09-13T17:13:08.181238+0000","last_unstale":"2024-09-13T17:13:12.272033+0000","last_undegraded":"2024-09-13T17:13:12.272033+0000","last_fullsized":"2024-09-13T17:13:12.272033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191480+0000","last_change":"2024-09-13T17:13:07.818858+0000","last_active":"2024-09-13T17:13:12.191480+0000","last_peered":"2024-09-13T17:13:12.191480+0000","last_clean":"2024-09-13T17:13:12.191480+0000","last_became_active":"2024-09-13T17:13:07.818565+0000","last_became_peered":"2024-09-13T17:13:07.818565+0000","last_unstale":"2024-09-13T17:13:12.191480+0000","last_undegraded":"2024-09-13T17:13:12.191480+0000","last_fullsized":"2024-09-13T17:13:12.191480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270562+0000","last_change":"2024-09-13T17:13:12.203489+0000","last_active":"2024-09-13T17:13:12.270562+0000","last_peered":"2024-09-13T17:13:12.270562+0000","last_clean":"2024-09-13T17:13:12.270562+0000","last_became_active":"2024-09-13T17:13:12.203032+0000","last_became_peered":"2024-09-13T17:13:12.203032+0000","last_unstale":"2024-09-13T17:13:12.270562+0000","last_undegraded":"2024-09-13T17:13:12.270562+0000","last_fullsized":"2024-09-13T17:13:12.270562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272603+0000","last_change":"2024-09-13T17:13:08.194162+0000","last_active":"2024-09-13T17:13:12.272603+0000","last_peered":"2024-09-13T17:13:12.272603+0000","last_clean":"2024-09-13T17:13:12.272603+0000","last_became_active":"2024-09-13T17:13:08.193901+0000","last_became_peered":"2024-09-13T17:13:08.193901+0000","last_unstale":"2024-09-13T17:13:12.272603+0000","last_undegraded":"2024-09-13T17:13:12.272603+0000","last_fullsized":"2024-09-13T17:13:12.272603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186482+0000","last_change":"2024-09-13T17:13:07.821914+0000","last_active":"2024-09-13T17:13:12.186482+0000","last_peered":"2024-09-13T17:13:12.186482+0000","last_clean":"2024-09-13T17:13:12.186482+0000","last_became_active":"2024-09-13T17:13:07.821626+0000","last_became_peered":"2024-09-13T17:13:07.821626+0000","last_unstale":"2024-09-13T17:13:12.186482+0000","last_undegraded":"2024-09-13T17:13:12.186482+0000","last_fullsized":"2024-09-13T17:13:12.186482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271889+0000","last_change":"2024-09-13T17:13:12.223827+0000","last_active":"2024-09-13T17:13:12.271889+0000","last_peered":"2024-09-13T17:13:12.271889+0000","last_clean":"2024-09-13T17:13:12.271889+0000","last_became_active":"2024-09-13T17:13:12.223230+0000","last_became_peered":"2024-09-13T17:13:12.223230+0000","last_unstale":"2024-09-13T17:13:12.271889+0000","last_undegraded":"2024-09-13T17:13:12.271889+0000","last_fullsized":"2024-09-13T17:13:12.271889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272574+0000","last_change":"2024-09-13T17:13:08.194775+0000","last_active":"2024-09-13T17:13:12.272574+0000","last_peered":"2024-09-13T17:13:12.272574+0000","last_clean":"2024-09-13T17:13:12.272574+0000","last_became_active":"2024-09-13T17:13:08.194500+0000","last_became_peered":"2024-09-13T17:13:08.194500+0000","last_unstale":"2024-09-13T17:13:12.272574+0000","last_undegraded":"2024-09-13T17:13:12.272574+0000","last_fullsized":"2024-09-13T17:13:12.272574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188626+0000","last_change":"2024-09-13T17:13:07.812760+0000","last_active":"2024-09-13T17:13:12.188626+0000","last_peered":"2024-09-13T17:13:12.188626+0000","last_clean":"2024-09-13T17:13:12.188626+0000","last_became_active":"2024-09-13T17:13:07.812481+0000","last_became_peered":"2024-09-13T17:13:07.812481+0000","last_unstale":"2024-09-13T17:13:12.188626+0000","last_undegraded":"2024-09-13T17:13:12.188626+0000","last_fullsized":"2024-09-13T17:13:12.188626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273298+0000","last_change":"2024-09-13T17:13:12.203001+0000","last_active":"2024-09-13T17:13:12.273298+0000","last_peered":"2024-09-13T17:13:12.273298+0000","last_clean":"2024-09-13T17:13:12.273298+0000","last_became_active":"2024-09-13T17:13:12.201855+0000","last_became_peered":"2024-09-13T17:13:12.201855+0000","last_unstale":"2024-09-13T17:13:12.273298+0000","last_undegraded":"2024-09-13T17:13:12.273298+0000","last_fullsized":"2024-09-13T17:13:12.273298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272432+0000","last_change":"2024-09-13T17:13:08.195578+0000","last_active":"2024-09-13T17:13:12.272432+0000","last_peered":"2024-09-13T17:13:12.272432+0000","last_clean":"2024-09-13T17:13:12.272432+0000","last_became_active":"2024-09-13T17:13:08.195118+0000","last_became_peered":"2024-09-13T17:13:08.195118+0000","last_unstale":"2024-09-13T17:13:12.272432+0000","last_undegraded":"2024-09-13T17:13:12.272432+0000","last_fullsized":"2024-09-13T17:13:12.272432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186263+0000","last_change":"2024-09-13T17:13:07.819737+0000","last_active":"2024-09-13T17:13:12.186263+0000","last_peered":"2024-09-13T17:13:12.186263+0000","last_clean":"2024-09-13T17:13:12.186263+0000","last_became_active":"2024-09-13T17:13:07.819435+0000","last_became_peered":"2024-09-13T17:13:07.819435+0000","last_unstale":"2024-09-13T17:13:12.186263+0000","last_undegraded":"2024-09-13T17:13:12.186263+0000","last_fullsized":"2024-09-13T17:13:12.186263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270633+0000","last_change":"2024-09-13T17:13:12.204881+0000","last_active":"2024-09-13T17:13:12.270633+0000","last_peered":"2024-09-13T17:13:12.270633+0000","last_clean":"2024-09-13T17:13:12.270633+0000","last_became_active":"2024-09-13T17:13:12.204492+0000","last_became_peered":"2024-09-13T17:13:12.204492+0000","last_unstale":"2024-09-13T17:13:12.270633+0000","last_undegraded":"2024-09-13T17:13:12.270633+0000","last_fullsized":"2024-09-13T17:13:12.270633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:26.315225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272551+0000","last_change":"2024-09-13T17:13:08.187413+0000","last_active":"2024-09-13T17:13:12.272551+0000","last_peered":"2024-09-13T17:13:12.272551+0000","last_clean":"2024-09-13T17:13:12.272551+0000","last_became_active":"2024-09-13T17:13:08.187156+0000","last_became_peered":"2024-09-13T17:13:08.187156+0000","last_unstale":"2024-09-13T17:13:12.272551+0000","last_undegraded":"2024-09-13T17:13:12.272551+0000","last_fullsized":"2024-09-13T17:13:12.272551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194011+0000","last_change":"2024-09-13T17:13:07.816811+0000","last_active":"2024-09-13T17:13:12.194011+0000","last_peered":"2024-09-13T17:13:12.194011+0000","last_clean":"2024-09-13T17:13:12.194011+0000","last_became_active":"2024-09-13T17:13:07.816486+0000","last_became_peered":"2024-09-13T17:13:07.816486+0000","last_unstale":"2024-09-13T17:13:12.194011+0000","last_undegraded":"2024-09-13T17:13:12.194011+0000","last_fullsized":"2024-09-13T17:13:12.194011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273738+0000","last_change":"2024-09-13T17:13:12.222779+0000","last_active":"2024-09-13T17:13:12.273738+0000","last_peered":"2024-09-13T17:13:12.273738+0000","last_clean":"2024-09-13T17:13:12.273738+0000","last_became_active":"2024-09-13T17:13:12.222431+0000","last_became_peered":"2024-09-13T17:13:12.222431+0000","last_unstale":"2024-09-13T17:13:12.273738+0000","last_undegraded":"2024-09-13T17:13:12.273738+0000","last_fullsized":"2024-09-13T17:13:12.273738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:07.973247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272468+0000","last_change":"2024-09-13T17:13:08.195864+0000","last_active":"2024-09-13T17:13:12.272468+0000","last_peered":"2024-09-13T17:13:12.272468+0000","last_clean":"2024-09-13T17:13:12.272468+0000","last_became_active":"2024-09-13T17:13:08.195589+0000","last_became_peered":"2024-09-13T17:13:08.195589+0000","last_unstale":"2024-09-13T17:13:12.272468+0000","last_undegraded":"2024-09-13T17:13:12.272468+0000","last_fullsized":"2024-09-13T17:13:12.272468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.189968+0000","last_change":"2024-09-13T17:13:07.820905+0000","last_active":"2024-09-13T17:13:12.189968+0000","last_peered":"2024-09-13T17:13:12.189968+0000","last_clean":"2024-09-13T17:13:12.189968+0000","last_became_active":"2024-09-13T17:13:07.820577+0000","last_became_peered":"2024-09-13T17:13:07.820577+0000","last_unstale":"2024-09-13T17:13:12.189968+0000","last_undegraded":"2024-09-13T17:13:12.189968+0000","last_fullsized":"2024-09-13T17:13:12.189968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273689+0000","last_change":"2024-09-13T17:13:12.222206+0000","last_active":"2024-09-13T17:13:12.273689+0000","last_peered":"2024-09-13T17:13:12.273689+0000","last_clean":"2024-09-13T17:13:12.273689+0000","last_became_active":"2024-09-13T17:13:12.221832+0000","last_became_peered":"2024-09-13T17:13:12.221832+0000","last_unstale":"2024-09-13T17:13:12.273689+0000","last_undegraded":"2024-09-13T17:13:12.273689+0000","last_fullsized":"2024-09-13T17:13:12.273689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:24.267854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270533+0000","last_change":"2024-09-13T17:13:08.188169+0000","last_active":"2024-09-13T17:13:12.270533+0000","last_peered":"2024-09-13T17:13:12.270533+0000","last_clean":"2024-09-13T17:13:12.270533+0000","last_became_active":"2024-09-13T17:13:08.183992+0000","last_became_peered":"2024-09-13T17:13:08.183992+0000","last_unstale":"2024-09-13T17:13:12.270533+0000","last_undegraded":"2024-09-13T17:13:12.270533+0000","last_fullsized":"2024-09-13T17:13:12.270533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.196619+0000","last_change":"2024-09-13T17:13:07.809275+0000","last_active":"2024-09-13T17:13:12.196619+0000","last_peered":"2024-09-13T17:13:12.196619+0000","last_clean":"2024-09-13T17:13:12.196619+0000","last_became_active":"2024-09-13T17:13:07.808983+0000","last_became_peered":"2024-09-13T17:13:07.808983+0000","last_unstale":"2024-09-13T17:13:12.196619+0000","last_undegraded":"2024-09-13T17:13:12.196619+0000","last_fullsized":"2024-09-13T17:13:12.196619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272043+0000","last_change":"2024-09-13T17:13:12.223022+0000","last_active":"2024-09-13T17:13:12.272043+0000","last_peered":"2024-09-13T17:13:12.272043+0000","last_clean":"2024-09-13T17:13:12.272043+0000","last_became_active":"2024-09-13T17:13:12.222587+0000","last_became_peered":"2024-09-13T17:13:12.222587+0000","last_unstale":"2024-09-13T17:13:12.272043+0000","last_undegraded":"2024-09-13T17:13:12.272043+0000","last_fullsized":"2024-09-13T17:13:12.272043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272504+0000","last_change":"2024-09-13T17:13:08.191872+0000","last_active":"2024-09-13T17:13:12.272504+0000","last_peered":"2024-09-13T17:13:12.272504+0000","last_clean":"2024-09-13T17:13:12.272504+0000","last_became_active":"2024-09-13T17:13:08.191600+0000","last_became_peered":"2024-09-13T17:13:08.191600+0000","last_unstale":"2024-09-13T17:13:12.272504+0000","last_undegraded":"2024-09-13T17:13:12.272504+0000","last_fullsized":"2024-09-13T17:13:12.272504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:10.848695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:13:16.967984+0000","last_change":"2024-09-13T17:13:07.818187+0000","last_active":"2024-09-13T17:13:16.967984+0000","last_peered":"2024-09-13T17:13:16.967984+0000","last_clean":"2024-09-13T17:13:16.967984+0000","last_became_active":"2024-09-13T17:13:07.817767+0000","last_became_peered":"2024-09-13T17:13:07.817767+0000","last_unstale":"2024-09-13T17:13:16.967984+0000","last_undegraded":"2024-09-13T17:13:16.967984+0000","last_fullsized":"2024-09-13T17:13:16.967984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271560+0000","last_change":"2024-09-13T17:13:12.198787+0000","last_active":"2024-09-13T17:13:12.271560+0000","last_peered":"2024-09-13T17:13:12.271560+0000","last_clean":"2024-09-13T17:13:12.271560+0000","last_became_active":"2024-09-13T17:13:12.198435+0000","last_became_peered":"2024-09-13T17:13:12.198435+0000","last_unstale":"2024-09-13T17:13:12.271560+0000","last_undegraded":"2024-09-13T17:13:12.271560+0000","last_fullsized":"2024-09-13T17:13:12.271560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273414+0000","last_change":"2024-09-13T17:13:08.188875+0000","last_active":"2024-09-13T17:13:12.273414+0000","last_peered":"2024-09-13T17:13:12.273414+0000","last_clean":"2024-09-13T17:13:12.273414+0000","last_became_active":"2024-09-13T17:13:08.187520+0000","last_became_peered":"2024-09-13T17:13:08.187520+0000","last_unstale":"2024-09-13T17:13:12.273414+0000","last_undegraded":"2024-09-13T17:13:12.273414+0000","last_fullsized":"2024-09-13T17:13:12.273414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191401+0000","last_change":"2024-09-13T17:13:07.819358+0000","last_active":"2024-09-13T17:13:12.191401+0000","last_peered":"2024-09-13T17:13:12.191401+0000","last_clean":"2024-09-13T17:13:12.191401+0000","last_became_active":"2024-09-13T17:13:07.819090+0000","last_became_peered":"2024-09-13T17:13:07.819090+0000","last_unstale":"2024-09-13T17:13:12.191401+0000","last_undegraded":"2024-09-13T17:13:12.191401+0000","last_fullsized":"2024-09-13T17:13:12.191401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273371+0000","last_change":"2024-09-13T17:13:12.198537+0000","last_active":"2024-09-13T17:13:12.273371+0000","last_peered":"2024-09-13T17:13:12.273371+0000","last_clean":"2024-09-13T17:13:12.273371+0000","last_became_active":"2024-09-13T17:13:12.198097+0000","last_became_peered":"2024-09-13T17:13:12.198097+0000","last_unstale":"2024-09-13T17:13:12.273371+0000","last_undegraded":"2024-09-13T17:13:12.273371+0000","last_fullsized":"2024-09-13T17:13:12.273371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270678+0000","last_change":"2024-09-13T17:13:08.188117+0000","last_active":"2024-09-13T17:13:12.270678+0000","last_peered":"2024-09-13T17:13:12.270678+0000","last_clean":"2024-09-13T17:13:12.270678+0000","last_became_active":"2024-09-13T17:13:08.187895+0000","last_became_peered":"2024-09-13T17:13:08.187895+0000","last_unstale":"2024-09-13T17:13:12.270678+0000","last_undegraded":"2024-09-13T17:13:12.270678+0000","last_fullsized":"2024-09-13T17:13:12.270678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188395+0000","last_change":"2024-09-13T17:13:07.816509+0000","last_active":"2024-09-13T17:13:12.188395+0000","last_peered":"2024-09-13T17:13:12.188395+0000","last_clean":"2024-09-13T17:13:12.188395+0000","last_became_active":"2024-09-13T17:13:07.816220+0000","last_became_peered":"2024-09-13T17:13:07.816220+0000","last_unstale":"2024-09-13T17:13:12.188395+0000","last_undegraded":"2024-09-13T17:13:12.188395+0000","last_fullsized":"2024-09-13T17:13:12.188395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273587+0000","last_change":"2024-09-13T17:13:12.211455+0000","last_active":"2024-09-13T17:13:12.273587+0000","last_peered":"2024-09-13T17:13:12.273587+0000","last_clean":"2024-09-13T17:13:12.273587+0000","last_became_active":"2024-09-13T17:13:12.211134+0000","last_became_peered":"2024-09-13T17:13:12.211134+0000","last_unstale":"2024-09-13T17:13:12.273587+0000","last_undegraded":"2024-09-13T17:13:12.273587+0000","last_fullsized":"2024-09-13T17:13:12.273587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:01.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272080+0000","last_change":"2024-09-13T17:13:08.186199+0000","last_active":"2024-09-13T17:13:12.272080+0000","last_peered":"2024-09-13T17:13:12.272080+0000","last_clean":"2024-09-13T17:13:12.272080+0000","last_became_active":"2024-09-13T17:13:08.185905+0000","last_became_peered":"2024-09-13T17:13:08.185905+0000","last_unstale":"2024-09-13T17:13:12.272080+0000","last_undegraded":"2024-09-13T17:13:12.272080+0000","last_fullsized":"2024-09-13T17:13:12.272080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195432+0000","last_change":"2024-09-13T17:13:07.818508+0000","last_active":"2024-09-13T17:13:12.195432+0000","last_peered":"2024-09-13T17:13:12.195432+0000","last_clean":"2024-09-13T17:13:12.195432+0000","last_became_active":"2024-09-13T17:13:07.818195+0000","last_became_peered":"2024-09-13T17:13:07.818195+0000","last_unstale":"2024-09-13T17:13:12.195432+0000","last_undegraded":"2024-09-13T17:13:12.195432+0000","last_fullsized":"2024-09-13T17:13:12.195432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273629+0000","last_change":"2024-09-13T17:13:12.225297+0000","last_active":"2024-09-13T17:13:12.273629+0000","last_peered":"2024-09-13T17:13:12.273629+0000","last_clean":"2024-09-13T17:13:12.273629+0000","last_became_active":"2024-09-13T17:13:12.224933+0000","last_became_peered":"2024-09-13T17:13:12.224933+0000","last_unstale":"2024-09-13T17:13:12.273629+0000","last_undegraded":"2024-09-13T17:13:12.273629+0000","last_fullsized":"2024-09-13T17:13:12.273629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270623+0000","last_change":"2024-09-13T17:13:12.224462+0000","last_active":"2024-09-13T17:13:12.270623+0000","last_peered":"2024-09-13T17:13:12.270623+0000","last_clean":"2024-09-13T17:13:12.270623+0000","last_became_active":"2024-09-13T17:13:12.223084+0000","last_became_peered":"2024-09-13T17:13:12.223084+0000","last_unstale":"2024-09-13T17:13:12.270623+0000","last_undegraded":"2024-09-13T17:13:12.270623+0000","last_fullsized":"2024-09-13T17:13:12.270623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271489+0000","last_change":"2024-09-13T17:13:08.179431+0000","last_active":"2024-09-13T17:13:12.271489+0000","last_peered":"2024-09-13T17:13:12.271489+0000","last_clean":"2024-09-13T17:13:12.271489+0000","last_became_active":"2024-09-13T17:13:08.178872+0000","last_became_peered":"2024-09-13T17:13:08.178872+0000","last_unstale":"2024-09-13T17:13:12.271489+0000","last_undegraded":"2024-09-13T17:13:12.271489+0000","last_fullsized":"2024-09-13T17:13:12.271489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188486+0000","last_change":"2024-09-13T17:13:07.808744+0000","last_active":"2024-09-13T17:13:12.188486+0000","last_peered":"2024-09-13T17:13:12.188486+0000","last_clean":"2024-09-13T17:13:12.188486+0000","last_became_active":"2024-09-13T17:13:07.808479+0000","last_became_peered":"2024-09-13T17:13:07.808479+0000","last_unstale":"2024-09-13T17:13:12.188486+0000","last_undegraded":"2024-09-13T17:13:12.188486+0000","last_fullsized":"2024-09-13T17:13:12.188486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272723+0000","last_change":"2024-09-13T17:13:12.202980+0000","last_active":"2024-09-13T17:13:12.272723+0000","last_peered":"2024-09-13T17:13:12.272723+0000","last_clean":"2024-09-13T17:13:12.272723+0000","last_became_active":"2024-09-13T17:13:12.202568+0000","last_became_peered":"2024-09-13T17:13:12.202568+0000","last_unstale":"2024-09-13T17:13:12.272723+0000","last_undegraded":"2024-09-13T17:13:12.272723+0000","last_fullsized":"2024-09-13T17:13:12.272723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:08.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273602+0000","last_change":"2024-09-13T17:13:08.184455+0000","last_active":"2024-09-13T17:13:12.273602+0000","last_peered":"2024-09-13T17:13:12.273602+0000","last_clean":"2024-09-13T17:13:12.273602+0000","last_became_active":"2024-09-13T17:13:08.184221+0000","last_became_peered":"2024-09-13T17:13:08.184221+0000","last_unstale":"2024-09-13T17:13:12.273602+0000","last_undegraded":"2024-09-13T17:13:12.273602+0000","last_fullsized":"2024-09-13T17:13:12.273602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191347+0000","last_change":"2024-09-13T17:13:07.816989+0000","last_active":"2024-09-13T17:13:12.191347+0000","last_peered":"2024-09-13T17:13:12.191347+0000","last_clean":"2024-09-13T17:13:12.191347+0000","last_became_active":"2024-09-13T17:13:07.816688+0000","last_became_peered":"2024-09-13T17:13:07.816688+0000","last_unstale":"2024-09-13T17:13:12.191347+0000","last_undegraded":"2024-09-13T17:13:12.191347+0000","last_fullsized":"2024-09-13T17:13:12.191347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194332+0000","last_change":"2024-09-13T17:13:07.814845+0000","last_active":"2024-09-13T17:13:12.194332+0000","last_peered":"2024-09-13T17:13:12.194332+0000","last_clean":"2024-09-13T17:13:12.194332+0000","last_became_active":"2024-09-13T17:13:07.814565+0000","last_became_peered":"2024-09-13T17:13:07.814565+0000","last_unstale":"2024-09-13T17:13:12.194332+0000","last_undegraded":"2024-09-13T17:13:12.194332+0000","last_fullsized":"2024-09-13T17:13:12.194332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270586+0000","last_change":"2024-09-13T17:13:08.181292+0000","last_active":"2024-09-13T17:13:12.270586+0000","last_peered":"2024-09-13T17:13:12.270586+0000","last_clean":"2024-09-13T17:13:12.270586+0000","last_became_active":"2024-09-13T17:13:08.180800+0000","last_became_peered":"2024-09-13T17:13:08.180800+0000","last_unstale":"2024-09-13T17:13:12.270586+0000","last_undegraded":"2024-09-13T17:13:12.270586+0000","last_fullsized":"2024-09-13T17:13:12.270586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:53.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273547+0000","last_change":"2024-09-13T17:13:12.205700+0000","last_active":"2024-09-13T17:13:12.273547+0000","last_peered":"2024-09-13T17:13:12.273547+0000","last_clean":"2024-09-13T17:13:12.273547+0000","last_became_active":"2024-09-13T17:13:12.205330+0000","last_became_peered":"2024-09-13T17:13:12.205330+0000","last_unstale":"2024-09-13T17:13:12.273547+0000","last_undegraded":"2024-09-13T17:13:12.273547+0000","last_fullsized":"2024-09-13T17:13:12.273547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:55.349358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193464+0000","last_change":"2024-09-13T17:13:07.822962+0000","last_active":"2024-09-13T17:13:12.193464+0000","last_peered":"2024-09-13T17:13:12.193464+0000","last_clean":"2024-09-13T17:13:12.193464+0000","last_became_active":"2024-09-13T17:13:07.822676+0000","last_became_peered":"2024-09-13T17:13:07.822676+0000","last_unstale":"2024-09-13T17:13:12.193464+0000","last_undegraded":"2024-09-13T17:13:12.193464+0000","last_fullsized":"2024-09-13T17:13:12.193464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273347+0000","last_change":"2024-09-13T17:13:08.176946+0000","last_active":"2024-09-13T17:13:12.273347+0000","last_peered":"2024-09-13T17:13:12.273347+0000","last_clean":"2024-09-13T17:13:12.273347+0000","last_became_active":"2024-09-13T17:13:08.176653+0000","last_became_peered":"2024-09-13T17:13:08.176653+0000","last_unstale":"2024-09-13T17:13:12.273347+0000","last_undegraded":"2024-09-13T17:13:12.273347+0000","last_fullsized":"2024-09-13T17:13:12.273347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273706+0000","last_change":"2024-09-13T17:13:12.211076+0000","last_active":"2024-09-13T17:13:12.273706+0000","last_peered":"2024-09-13T17:13:12.273706+0000","last_clean":"2024-09-13T17:13:12.273706+0000","last_became_active":"2024-09-13T17:13:12.210718+0000","last_became_peered":"2024-09-13T17:13:12.210718+0000","last_unstale":"2024-09-13T17:13:12.273706+0000","last_undegraded":"2024-09-13T17:13:12.273706+0000","last_fullsized":"2024-09-13T17:13:12.273706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:57.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272535+0000","last_change":"2024-09-13T17:13:08.186992+0000","last_active":"2024-09-13T17:13:12.272535+0000","last_peered":"2024-09-13T17:13:12.272535+0000","last_clean":"2024-09-13T17:13:12.272535+0000","last_became_active":"2024-09-13T17:13:08.186730+0000","last_became_peered":"2024-09-13T17:13:08.186730+0000","last_unstale":"2024-09-13T17:13:12.272535+0000","last_undegraded":"2024-09-13T17:13:12.272535+0000","last_fullsized":"2024-09-13T17:13:12.272535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273527+0000","last_change":"2024-09-13T17:13:08.185076+0000","last_active":"2024-09-13T17:13:12.273527+0000","last_peered":"2024-09-13T17:13:12.273527+0000","last_clean":"2024-09-13T17:13:12.273527+0000","last_became_active":"2024-09-13T17:13:08.184807+0000","last_became_peered":"2024-09-13T17:13:08.184807+0000","last_unstale":"2024-09-13T17:13:12.273527+0000","last_undegraded":"2024-09-13T17:13:12.273527+0000","last_fullsized":"2024-09-13T17:13:12.273527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271978+0000","last_change":"2024-09-13T17:13:08.182381+0000","last_active":"2024-09-13T17:13:12.271978+0000","last_peered":"2024-09-13T17:13:12.271978+0000","last_clean":"2024-09-13T17:13:12.271978+0000","last_became_active":"2024-09-13T17:13:08.181851+0000","last_became_peered":"2024-09-13T17:13:08.181851+0000","last_unstale":"2024-09-13T17:13:12.271978+0000","last_undegraded":"2024-09-13T17:13:12.271978+0000","last_fullsized":"2024-09-13T17:13:12.271978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270578+0000","last_change":"2024-09-13T17:13:08.179038+0000","last_active":"2024-09-13T17:13:12.270578+0000","last_peered":"2024-09-13T17:13:12.270578+0000","last_clean":"2024-09-13T17:13:12.270578+0000","last_became_active":"2024-09-13T17:13:08.178609+0000","last_became_peered":"2024-09-13T17:13:08.178609+0000","last_unstale":"2024-09-13T17:13:12.270578+0000","last_undegraded":"2024-09-13T17:13:12.270578+0000","last_fullsized":"2024-09-13T17:13:12.270578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273698+0000","last_change":"2024-09-13T17:13:08.179834+0000","last_active":"2024-09-13T17:13:12.273698+0000","last_peered":"2024-09-13T17:13:12.273698+0000","last_clean":"2024-09-13T17:13:12.273698+0000","last_became_active":"2024-09-13T17:13:08.179568+0000","last_became_peered":"2024-09-13T17:13:08.179568+0000","last_unstale":"2024-09-13T17:13:12.273698+0000","last_undegraded":"2024-09-13T17:13:12.273698+0000","last_fullsized":"2024-09-13T17:13:12.273698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271641+0000","last_change":"2024-09-13T17:13:08.178962+0000","last_active":"2024-09-13T17:13:12.271641+0000","last_peered":"2024-09-13T17:13:12.271641+0000","last_clean":"2024-09-13T17:13:12.271641+0000","last_became_active":"2024-09-13T17:13:08.178519+0000","last_became_peered":"2024-09-13T17:13:08.178519+0000","last_unstale":"2024-09-13T17:13:12.271641+0000","last_undegraded":"2024-09-13T17:13:12.271641+0000","last_fullsized":"2024-09-13T17:13:12.271641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272698+0000","last_change":"2024-09-13T17:13:08.189740+0000","last_active":"2024-09-13T17:13:12.272698+0000","last_peered":"2024-09-13T17:13:12.272698+0000","last_clean":"2024-09-13T17:13:12.272698+0000","last_became_active":"2024-09-13T17:13:08.189493+0000","last_became_peered":"2024-09-13T17:13:08.189493+0000","last_unstale":"2024-09-13T17:13:12.272698+0000","last_undegraded":"2024-09-13T17:13:12.272698+0000","last_fullsized":"2024-09-13T17:13:12.272698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273747+0000","last_change":"2024-09-13T17:13:08.187313+0000","last_active":"2024-09-13T17:13:12.273747+0000","last_peered":"2024-09-13T17:13:12.273747+0000","last_clean":"2024-09-13T17:13:12.273747+0000","last_became_active":"2024-09-13T17:13:08.186547+0000","last_became_peered":"2024-09-13T17:13:08.186547+0000","last_unstale":"2024-09-13T17:13:12.273747+0000","last_undegraded":"2024-09-13T17:13:12.273747+0000","last_fullsized":"2024-09-13T17:13:12.273747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271935+0000","last_change":"2024-09-13T17:13:08.181762+0000","last_active":"2024-09-13T17:13:12.271935+0000","last_peered":"2024-09-13T17:13:12.271935+0000","last_clean":"2024-09-13T17:13:12.271935+0000","last_became_active":"2024-09-13T17:13:08.181207+0000","last_became_peered":"2024-09-13T17:13:08.181207+0000","last_unstale":"2024-09-13T17:13:12.271935+0000","last_undegraded":"2024-09-13T17:13:12.271935+0000","last_fullsized":"2024-09-13T17:13:12.271935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273638+0000","last_change":"2024-09-13T17:13:08.180419+0000","last_active":"2024-09-13T17:13:12.273638+0000","last_peered":"2024-09-13T17:13:12.273638+0000","last_clean":"2024-09-13T17:13:12.273638+0000","last_became_active":"2024-09-13T17:13:08.179973+0000","last_became_peered":"2024-09-13T17:13:08.179973+0000","last_unstale":"2024-09-13T17:13:12.273638+0000","last_undegraded":"2024-09-13T17:13:12.273638+0000","last_fullsized":"2024-09-13T17:13:12.273638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271966+0000","last_change":"2024-09-13T17:13:08.187243+0000","last_active":"2024-09-13T17:13:12.271966+0000","last_peered":"2024-09-13T17:13:12.271966+0000","last_clean":"2024-09-13T17:13:12.271966+0000","last_became_active":"2024-09-13T17:13:08.185915+0000","last_became_peered":"2024-09-13T17:13:08.185915+0000","last_unstale":"2024-09-13T17:13:12.271966+0000","last_undegraded":"2024-09-13T17:13:12.271966+0000","last_fullsized":"2024-09-13T17:13:12.271966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270553+0000","last_change":"2024-09-13T17:13:08.183725+0000","last_active":"2024-09-13T17:13:12.270553+0000","last_peered":"2024-09-13T17:13:12.270553+0000","last_clean":"2024-09-13T17:13:12.270553+0000","last_became_active":"2024-09-13T17:13:08.183369+0000","last_became_peered":"2024-09-13T17:13:08.183369+0000","last_unstale":"2024-09-13T17:13:12.270553+0000","last_undegraded":"2024-09-13T17:13:12.270553+0000","last_fullsized":"2024-09-13T17:13:12.270553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272636+0000","last_change":"2024-09-13T17:13:08.184578+0000","last_active":"2024-09-13T17:13:12.272636+0000","last_peered":"2024-09-13T17:13:12.272636+0000","last_clean":"2024-09-13T17:13:12.272636+0000","last_became_active":"2024-09-13T17:13:08.184328+0000","last_became_peered":"2024-09-13T17:13:08.184328+0000","last_unstale":"2024-09-13T17:13:12.272636+0000","last_undegraded":"2024-09-13T17:13:12.272636+0000","last_fullsized":"2024-09-13T17:13:12.272636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272553+0000","last_change":"2024-09-13T17:13:08.183549+0000","last_active":"2024-09-13T17:13:12.272553+0000","last_peered":"2024-09-13T17:13:12.272553+0000","last_clean":"2024-09-13T17:13:12.272553+0000","last_became_active":"2024-09-13T17:13:08.183301+0000","last_became_peered":"2024-09-13T17:13:08.183301+0000","last_unstale":"2024-09-13T17:13:12.272553+0000","last_undegraded":"2024-09-13T17:13:12.272553+0000","last_fullsized":"2024-09-13T17:13:12.272553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273561+0000","last_change":"2024-09-13T17:13:08.182679+0000","last_active":"2024-09-13T17:13:12.273561+0000","last_peered":"2024-09-13T17:13:12.273561+0000","last_clean":"2024-09-13T17:13:12.273561+0000","last_became_active":"2024-09-13T17:13:08.182412+0000","last_became_peered":"2024-09-13T17:13:08.182412+0000","last_unstale":"2024-09-13T17:13:12.273561+0000","last_undegraded":"2024-09-13T17:13:12.273561+0000","last_fullsized":"2024-09-13T17:13:12.273561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272096+0000","last_change":"2024-09-13T17:13:08.189128+0000","last_active":"2024-09-13T17:13:12.272096+0000","last_peered":"2024-09-13T17:13:12.272096+0000","last_clean":"2024-09-13T17:13:12.272096+0000","last_became_active":"2024-09-13T17:13:08.188829+0000","last_became_peered":"2024-09-13T17:13:08.188829+0000","last_unstale":"2024-09-13T17:13:12.272096+0000","last_undegraded":"2024-09-13T17:13:12.272096+0000","last_fullsized":"2024-09-13T17:13:12.272096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271915+0000","last_change":"2024-09-13T17:13:08.181955+0000","last_active":"2024-09-13T17:13:12.271915+0000","last_peered":"2024-09-13T17:13:12.271915+0000","last_clean":"2024-09-13T17:13:12.271915+0000","last_became_active":"2024-09-13T17:13:08.180834+0000","last_became_peered":"2024-09-13T17:13:08.180834+0000","last_unstale":"2024-09-13T17:13:12.271915+0000","last_undegraded":"2024-09-13T17:13:12.271915+0000","last_fullsized":"2024-09-13T17:13:12.271915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271506+0000","last_change":"2024-09-13T17:13:08.177678+0000","last_active":"2024-09-13T17:13:12.271506+0000","last_peered":"2024-09-13T17:13:12.271506+0000","last_clean":"2024-09-13T17:13:12.271506+0000","last_became_active":"2024-09-13T17:13:08.177367+0000","last_became_peered":"2024-09-13T17:13:08.177367+0000","last_unstale":"2024-09-13T17:13:12.271506+0000","last_undegraded":"2024-09-13T17:13:12.271506+0000","last_fullsized":"2024-09-13T17:13:12.271506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270519+0000","last_change":"2024-09-13T17:13:08.177377+0000","last_active":"2024-09-13T17:13:12.270519+0000","last_peered":"2024-09-13T17:13:12.270519+0000","last_clean":"2024-09-13T17:13:12.270519+0000","last_became_active":"2024-09-13T17:13:08.176410+0000","last_became_peered":"2024-09-13T17:13:08.176410+0000","last_unstale":"2024-09-13T17:13:12.270519+0000","last_undegraded":"2024-09-13T17:13:12.270519+0000","last_fullsized":"2024-09-13T17:13:12.270519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273666+0000","last_change":"2024-09-13T17:13:08.183002+0000","last_active":"2024-09-13T17:13:12.273666+0000","last_peered":"2024-09-13T17:13:12.273666+0000","last_clean":"2024-09-13T17:13:12.273666+0000","last_became_active":"2024-09-13T17:13:08.181898+0000","last_became_peered":"2024-09-13T17:13:08.181898+0000","last_unstale":"2024-09-13T17:13:12.273666+0000","last_undegraded":"2024-09-13T17:13:12.273666+0000","last_fullsized":"2024-09-13T17:13:12.273666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273404+0000","last_change":"2024-09-13T17:13:08.183228+0000","last_active":"2024-09-13T17:13:12.273404+0000","last_peered":"2024-09-13T17:13:12.273404+0000","last_clean":"2024-09-13T17:13:12.273404+0000","last_became_active":"2024-09-13T17:13:08.182942+0000","last_became_peered":"2024-09-13T17:13:08.182942+0000","last_unstale":"2024-09-13T17:13:12.273404+0000","last_undegraded":"2024-09-13T17:13:12.273404+0000","last_fullsized":"2024-09-13T17:13:12.273404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:15.542986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272676+0000","last_change":"2024-09-13T17:13:08.192671+0000","last_active":"2024-09-13T17:13:12.272676+0000","last_peered":"2024-09-13T17:13:12.272676+0000","last_clean":"2024-09-13T17:13:12.272676+0000","last_became_active":"2024-09-13T17:13:08.192366+0000","last_became_peered":"2024-09-13T17:13:08.192366+0000","last_unstale":"2024-09-13T17:13:12.272676+0000","last_undegraded":"2024-09-13T17:13:12.272676+0000","last_fullsized":"2024-09-13T17:13:12.272676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272687+0000","last_change":"2024-09-13T17:13:08.193253+0000","last_active":"2024-09-13T17:13:12.272687+0000","last_peered":"2024-09-13T17:13:12.272687+0000","last_clean":"2024-09-13T17:13:12.272687+0000","last_became_active":"2024-09-13T17:13:08.192969+0000","last_became_peered":"2024-09-13T17:13:08.192969+0000","last_unstale":"2024-09-13T17:13:12.272687+0000","last_undegraded":"2024-09-13T17:13:12.272687+0000","last_fullsized":"2024-09-13T17:13:12.272687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272593+0000","last_change":"2024-09-13T17:13:08.195764+0000","last_active":"2024-09-13T17:13:12.272593+0000","last_peered":"2024-09-13T17:13:12.272593+0000","last_clean":"2024-09-13T17:13:12.272593+0000","last_became_active":"2024-09-13T17:13:08.195102+0000","last_became_peered":"2024-09-13T17:13:08.195102+0000","last_unstale":"2024-09-13T17:13:12.272593+0000","last_undegraded":"2024-09-13T17:13:12.272593+0000","last_fullsized":"2024-09-13T17:13:12.272593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273574+0000","last_change":"2024-09-13T17:13:08.192409+0000","last_active":"2024-09-13T17:13:12.273574+0000","last_peered":"2024-09-13T17:13:12.273574+0000","last_clean":"2024-09-13T17:13:12.273574+0000","last_became_active":"2024-09-13T17:13:08.192135+0000","last_became_peered":"2024-09-13T17:13:08.192135+0000","last_unstale":"2024-09-13T17:13:12.273574+0000","last_undegraded":"2024-09-13T17:13:12.273574+0000","last_fullsized":"2024-09-13T17:13:12.273574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272414+0000","last_change":"2024-09-13T17:13:08.188381+0000","last_active":"2024-09-13T17:13:12.272414+0000","last_peered":"2024-09-13T17:13:12.272414+0000","last_clean":"2024-09-13T17:13:12.272414+0000","last_became_active":"2024-09-13T17:13:08.188091+0000","last_became_peered":"2024-09-13T17:13:08.188091+0000","last_unstale":"2024-09-13T17:13:12.272414+0000","last_undegraded":"2024-09-13T17:13:12.272414+0000","last_fullsized":"2024-09-13T17:13:12.272414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271956+0000","last_change":"2024-09-13T17:13:08.181573+0000","last_active":"2024-09-13T17:13:12.271956+0000","last_peered":"2024-09-13T17:13:12.271956+0000","last_clean":"2024-09-13T17:13:12.271956+0000","last_became_active":"2024-09-13T17:13:08.180771+0000","last_became_peered":"2024-09-13T17:13:08.180771+0000","last_unstale":"2024-09-13T17:13:12.271956+0000","last_undegraded":"2024-09-13T17:13:12.271956+0000","last_fullsized":"2024-09-13T17:13:12.271956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272451+0000","last_change":"2024-09-13T17:13:08.182931+0000","last_active":"2024-09-13T17:13:12.272451+0000","last_peered":"2024-09-13T17:13:12.272451+0000","last_clean":"2024-09-13T17:13:12.272451+0000","last_became_active":"2024-09-13T17:13:08.182550+0000","last_became_peered":"2024-09-13T17:13:08.182550+0000","last_unstale":"2024-09-13T17:13:12.272451+0000","last_undegraded":"2024-09-13T17:13:12.272451+0000","last_fullsized":"2024-09-13T17:13:12.272451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272014+0000","last_change":"2024-09-13T17:13:08.183116+0000","last_active":"2024-09-13T17:13:12.272014+0000","last_peered":"2024-09-13T17:13:12.272014+0000","last_clean":"2024-09-13T17:13:12.272014+0000","last_became_active":"2024-09-13T17:13:08.182806+0000","last_became_peered":"2024-09-13T17:13:08.182806+0000","last_unstale":"2024-09-13T17:13:12.272014+0000","last_undegraded":"2024-09-13T17:13:12.272014+0000","last_fullsized":"2024-09-13T17:13:12.272014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270613+0000","last_change":"2024-09-13T17:13:08.175847+0000","last_active":"2024-09-13T17:13:12.270613+0000","last_peered":"2024-09-13T17:13:12.270613+0000","last_clean":"2024-09-13T17:13:12.270613+0000","last_became_active":"2024-09-13T17:13:08.175560+0000","last_became_peered":"2024-09-13T17:13:08.175560+0000","last_unstale":"2024-09-13T17:13:12.270613+0000","last_undegraded":"2024-09-13T17:13:12.270613+0000","last_fullsized":"2024-09-13T17:13:12.270613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271680+0000","last_change":"2024-09-13T17:13:08.178668+0000","last_active":"2024-09-13T17:13:12.271680+0000","last_peered":"2024-09-13T17:13:12.271680+0000","last_clean":"2024-09-13T17:13:12.271680+0000","last_became_active":"2024-09-13T17:13:08.178371+0000","last_became_peered":"2024-09-13T17:13:08.178371+0000","last_unstale":"2024-09-13T17:13:12.271680+0000","last_undegraded":"2024-09-13T17:13:12.271680+0000","last_fullsized":"2024-09-13T17:13:12.271680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272583+0000","last_change":"2024-09-13T17:13:08.193114+0000","last_active":"2024-09-13T17:13:12.272583+0000","last_peered":"2024-09-13T17:13:12.272583+0000","last_clean":"2024-09-13T17:13:12.272583+0000","last_became_active":"2024-09-13T17:13:08.192630+0000","last_became_peered":"2024-09-13T17:13:08.192630+0000","last_unstale":"2024-09-13T17:13:12.272583+0000","last_undegraded":"2024-09-13T17:13:12.272583+0000","last_fullsized":"2024-09-13T17:13:12.272583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:07.796374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:30.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.450+0000 7fe25b91f640 1 Processor -- start 2024-09-13T17:13:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.450+0000 7fe25b91f640 1 -- start start 2024-09-13T17:13:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe25b91f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe25415fd80 0x7fe2540cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe25b91f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540704a0 con 0x7fe254099110 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe25b91f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25406bd80 con 0x7fe2540d0e30 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe25b91f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25406cc10 con 0x7fe25415fd80 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe2596bb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe25415fd80 0x7fe2540cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe259ebc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe254099110 0x7fe25406e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40442/0 (socket says 172.21.15.5:40442) 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe259ebc640 1 -- 172.21.15.5:0/595473804 learned_addr learned my addr 172.21.15.5:0/595473804 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.451+0000 7fe2596bb640 1 -- 172.21.15.5:0/595473804 >> v1:172.21.15.179:6789/0 conn(0x7fe2540d0e30 legacy=0x7fe254098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe2596bb640 1 -- 172.21.15.5:0/595473804 >> v1:172.21.15.5:6789/0 conn(0x7fe254099110 legacy=0x7fe25406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe2596bb640 1 -- 172.21.15.5:0/595473804 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540d1270 con 0x7fe25415fd80 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe24bfff640 1 -- 172.21.15.5:0/595473804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498103704 0 0) 0x7fe2540704a0 con 0x7fe254099110 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe2596bb640 1 --2- 172.21.15.5:0/595473804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2540cfd30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2500097a0 tx=0x7fe25002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a763ff360e832080 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe24bfff640 1 -- 172.21.15.5:0/595473804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25002ae50 con 0x7fe25415fd80 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe24bfff640 1 -- 172.21.15.5:0/595473804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250032440 con 0x7fe25415fd80 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.452+0000 7fe24bfff640 1 -- 172.21.15.5:0/595473804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2500327d0 con 0x7fe25415fd80 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 -- 172.21.15.5:0/595473804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 msgr2=0x7fe2540cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 --2- 172.21.15.5:0/595473804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2540cfd30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2500097a0 tx=0x7fe25002a140 comp rx=0 tx=0).stop 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 -- 172.21.15.5:0/595473804 shutdown_connections 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 --2- 172.21.15.5:0/595473804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2540cfd30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 -- 172.21.15.5:0/595473804 >> 172.21.15.5:0/595473804 conn(0x7fe2540d0310 msgr2=0x7fe2540d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 -- 172.21.15.5:0/595473804 shutdown_connections 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.453+0000 7fe25b91f640 1 -- 172.21.15.5:0/595473804 wait complete. 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.454+0000 7fe25b91f640 1 Processor -- start 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.454+0000 7fe25b91f640 1 -- start start 2024-09-13T17:13:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 0x7fe25414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 0x7fe254150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540af9f0 con 0x7fe25415fd80 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540afcd0 con 0x7fe254099110 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe25b91f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540affb0 con 0x7fe2540d0e30 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38834/0 (socket says 172.21.15.5:38834) 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 -- 172.21.15.5:0/1531988216 learned_addr learned my addr 172.21.15.5:0/1531988216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe2596bb640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 0x7fe25414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe258eba640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 0x7fe254150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 -- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 msgr2=0x7fe254150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 0x7fe254150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 -- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 msgr2=0x7fe25414f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 0x7fe25414f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe259ebc640 1 -- 172.21.15.5:0/1531988216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250009400 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe258eba640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 0x7fe254150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.455+0000 7fe2596bb640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 0x7fe25414f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe259ebc640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c770 tx=0x7fe24c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00ce80 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c00a640 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2540b0290 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00a9f0 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.456+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe254150ff0 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.457+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25406c1f0 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.457+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe24c00ab50 con 0x7fe25415fd80 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.458+0000 7fe249ffb640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 0x7fe23806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.458+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe24c088db0 con 0x7fe25415fd80 2024-09-13T17:13:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.458+0000 7fe2596bb640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 0x7fe23806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.459+0000 7fe2596bb640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 0x7fe23806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe250034000 tx=0x7fe25002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.462+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe25406c1f0 con 0x7fe25415fd80 2024-09-13T17:13:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.633+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2540afe40 con 0x7fe23806ac00 2024-09-13T17:13:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.642+0000 7fe249ffb640 1 -- 172.21.15.5:0/1531988216 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345275 (secure 0 0 0) 0x7fe2540afe40 con 0x7fe23806ac00 2024-09-13T17:13:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 msgr2=0x7fe23806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 0x7fe23806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe250034000 tx=0x7fe25002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 msgr2=0x7fe2541514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c770 tx=0x7fe24c00cc30 comp rx=0 tx=0).stop 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 shutdown_connections 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe23806ac00 0x7fe23806d0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe25415fd80 0x7fe2541514a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2540d0e30 0x7fe254150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 --2- 172.21.15.5:0/1531988216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe254099110 0x7fe25414f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 >> 172.21.15.5:0/1531988216 conn(0x7fe2540d0310 msgr2=0x7fe25415ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 shutdown_connections 2024-09-13T17:13:30.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.645+0000 7fe25b91f640 1 -- 172.21.15.5:0/1531988216 wait complete. 2024-09-13T17:13:30.658 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-13T17:13:29.259767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003514"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195149+0000","last_change":"2024-09-13T17:13:07.818703+0000","last_active":"2024-09-13T17:13:12.195149+0000","last_peered":"2024-09-13T17:13:12.195149+0000","last_clean":"2024-09-13T17:13:12.195149+0000","last_became_active":"2024-09-13T17:13:07.818425+0000","last_became_peered":"2024-09-13T17:13:07.818425+0000","last_unstale":"2024-09-13T17:13:12.195149+0000","last_undegraded":"2024-09-13T17:13:12.195149+0000","last_fullsized":"2024-09-13T17:13:12.195149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273719+0000","last_change":"2024-09-13T17:13:08.182685+0000","last_active":"2024-09-13T17:13:12.273719+0000","last_peered":"2024-09-13T17:13:12.273719+0000","last_clean":"2024-09-13T17:13:12.273719+0000","last_became_active":"2024-09-13T17:13:08.182447+0000","last_became_peered":"2024-09-13T17:13:08.182447+0000","last_unstale":"2024-09-13T17:13:12.273719+0000","last_undegraded":"2024-09-13T17:13:12.273719+0000","last_fullsized":"2024-09-13T17:13:12.273719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273620+0000","last_change":"2024-09-13T17:13:12.223668+0000","last_active":"2024-09-13T17:13:12.273620+0000","last_peered":"2024-09-13T17:13:12.273620+0000","last_clean":"2024-09-13T17:13:12.273620+0000","last_became_active":"2024-09-13T17:13:12.223255+0000","last_became_peered":"2024-09-13T17:13:12.223255+0000","last_unstale":"2024-09-13T17:13:12.273620+0000","last_undegraded":"2024-09-13T17:13:12.273620+0000","last_fullsized":"2024-09-13T17:13:12.273620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193136+0000","last_change":"2024-09-13T17:13:07.820516+0000","last_active":"2024-09-13T17:13:12.193136+0000","last_peered":"2024-09-13T17:13:12.193136+0000","last_clean":"2024-09-13T17:13:12.193136+0000","last_became_active":"2024-09-13T17:13:07.820233+0000","last_became_peered":"2024-09-13T17:13:07.820233+0000","last_unstale":"2024-09-13T17:13:12.193136+0000","last_undegraded":"2024-09-13T17:13:12.193136+0000","last_fullsized":"2024-09-13T17:13:12.193136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270669+0000","last_change":"2024-09-13T17:13:08.185959+0000","last_active":"2024-09-13T17:13:12.270669+0000","last_peered":"2024-09-13T17:13:12.270669+0000","last_clean":"2024-09-13T17:13:12.270669+0000","last_became_active":"2024-09-13T17:13:08.185705+0000","last_became_peered":"2024-09-13T17:13:08.185705+0000","last_unstale":"2024-09-13T17:13:12.270669+0000","last_undegraded":"2024-09-13T17:13:12.270669+0000","last_fullsized":"2024-09-13T17:13:12.270669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273272+0000","last_change":"2024-09-13T17:13:12.202324+0000","last_active":"2024-09-13T17:13:12.273272+0000","last_peered":"2024-09-13T17:13:12.273272+0000","last_clean":"2024-09-13T17:13:12.273272+0000","last_became_active":"2024-09-13T17:13:12.201852+0000","last_became_peered":"2024-09-13T17:13:12.201852+0000","last_unstale":"2024-09-13T17:13:12.273272+0000","last_undegraded":"2024-09-13T17:13:12.273272+0000","last_fullsized":"2024-09-13T17:13:12.273272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.222040+0000","last_change":"2024-09-13T17:13:07.823003+0000","last_active":"2024-09-13T17:13:12.222040+0000","last_peered":"2024-09-13T17:13:12.222040+0000","last_clean":"2024-09-13T17:13:12.222040+0000","last_became_active":"2024-09-13T17:13:07.822719+0000","last_became_peered":"2024-09-13T17:13:07.822719+0000","last_unstale":"2024-09-13T17:13:12.222040+0000","last_undegraded":"2024-09-13T17:13:12.222040+0000","last_fullsized":"2024-09-13T17:13:12.222040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:18.156159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272024+0000","last_change":"2024-09-13T17:13:08.183825+0000","last_active":"2024-09-13T17:13:12.272024+0000","last_peered":"2024-09-13T17:13:12.272024+0000","last_clean":"2024-09-13T17:13:12.272024+0000","last_became_active":"2024-09-13T17:13:08.183509+0000","last_became_peered":"2024-09-13T17:13:08.183509+0000","last_unstale":"2024-09-13T17:13:12.272024+0000","last_undegraded":"2024-09-13T17:13:12.272024+0000","last_fullsized":"2024-09-13T17:13:12.272024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273360+0000","last_change":"2024-09-13T17:13:12.204784+0000","last_active":"2024-09-13T17:13:12.273360+0000","last_peered":"2024-09-13T17:13:12.273360+0000","last_clean":"2024-09-13T17:13:12.273360+0000","last_became_active":"2024-09-13T17:13:12.203462+0000","last_became_peered":"2024-09-13T17:13:12.203462+0000","last_unstale":"2024-09-13T17:13:12.273360+0000","last_undegraded":"2024-09-13T17:13:12.273360+0000","last_fullsized":"2024-09-13T17:13:12.273360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221256+0000","last_change":"2024-09-13T17:13:07.822927+0000","last_active":"2024-09-13T17:13:12.221256+0000","last_peered":"2024-09-13T17:13:12.221256+0000","last_clean":"2024-09-13T17:13:12.221256+0000","last_became_active":"2024-09-13T17:13:07.822552+0000","last_became_peered":"2024-09-13T17:13:07.822552+0000","last_unstale":"2024-09-13T17:13:12.221256+0000","last_undegraded":"2024-09-13T17:13:12.221256+0000","last_fullsized":"2024-09-13T17:13:12.221256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272055+0000","last_change":"2024-09-13T17:13:08.184922+0000","last_active":"2024-09-13T17:13:12.272055+0000","last_peered":"2024-09-13T17:13:12.272055+0000","last_clean":"2024-09-13T17:13:12.272055+0000","last_became_active":"2024-09-13T17:13:08.184640+0000","last_became_peered":"2024-09-13T17:13:08.184640+0000","last_unstale":"2024-09-13T17:13:12.272055+0000","last_undegraded":"2024-09-13T17:13:12.272055+0000","last_fullsized":"2024-09-13T17:13:12.272055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273329+0000","last_change":"2024-09-13T17:13:12.202312+0000","last_active":"2024-09-13T17:13:12.273329+0000","last_peered":"2024-09-13T17:13:12.273329+0000","last_clean":"2024-09-13T17:13:12.273329+0000","last_became_active":"2024-09-13T17:13:12.201870+0000","last_became_peered":"2024-09-13T17:13:12.201870+0000","last_unstale":"2024-09-13T17:13:12.273329+0000","last_undegraded":"2024-09-13T17:13:12.273329+0000","last_fullsized":"2024-09-13T17:13:12.273329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:13.831220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272599+0000","last_change":"2024-09-13T17:13:08.183978+0000","last_active":"2024-09-13T17:13:12.272599+0000","last_peered":"2024-09-13T17:13:12.272599+0000","last_clean":"2024-09-13T17:13:12.272599+0000","last_became_active":"2024-09-13T17:13:08.183697+0000","last_became_peered":"2024-09-13T17:13:08.183697+0000","last_unstale":"2024-09-13T17:13:12.272599+0000","last_undegraded":"2024-09-13T17:13:12.272599+0000","last_fullsized":"2024-09-13T17:13:12.272599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221213+0000","last_change":"2024-09-13T17:13:07.823217+0000","last_active":"2024-09-13T17:13:12.221213+0000","last_peered":"2024-09-13T17:13:12.221213+0000","last_clean":"2024-09-13T17:13:12.221213+0000","last_became_active":"2024-09-13T17:13:07.822960+0000","last_became_peered":"2024-09-13T17:13:07.822960+0000","last_unstale":"2024-09-13T17:13:12.221213+0000","last_undegraded":"2024-09-13T17:13:12.221213+0000","last_fullsized":"2024-09-13T17:13:12.221213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273425+0000","last_change":"2024-09-13T17:13:12.203048+0000","last_active":"2024-09-13T17:13:12.273425+0000","last_peered":"2024-09-13T17:13:12.273425+0000","last_clean":"2024-09-13T17:13:12.273425+0000","last_became_active":"2024-09-13T17:13:12.202566+0000","last_became_peered":"2024-09-13T17:13:12.202566+0000","last_unstale":"2024-09-13T17:13:12.273425+0000","last_undegraded":"2024-09-13T17:13:12.273425+0000","last_fullsized":"2024-09-13T17:13:12.273425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:22.271791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273675+0000","last_change":"2024-09-13T17:13:08.185754+0000","last_active":"2024-09-13T17:13:12.273675+0000","last_peered":"2024-09-13T17:13:12.273675+0000","last_clean":"2024-09-13T17:13:12.273675+0000","last_became_active":"2024-09-13T17:13:08.184827+0000","last_became_peered":"2024-09-13T17:13:08.184827+0000","last_unstale":"2024-09-13T17:13:12.273675+0000","last_undegraded":"2024-09-13T17:13:12.273675+0000","last_fullsized":"2024-09-13T17:13:12.273675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193832+0000","last_change":"2024-09-13T17:13:07.821299+0000","last_active":"2024-09-13T17:13:12.193832+0000","last_peered":"2024-09-13T17:13:12.193832+0000","last_clean":"2024-09-13T17:13:12.193832+0000","last_became_active":"2024-09-13T17:13:07.820971+0000","last_became_peered":"2024-09-13T17:13:07.820971+0000","last_unstale":"2024-09-13T17:13:12.193832+0000","last_undegraded":"2024-09-13T17:13:12.193832+0000","last_fullsized":"2024-09-13T17:13:12.193832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273393+0000","last_change":"2024-09-13T17:13:12.207075+0000","last_active":"2024-09-13T17:13:12.273393+0000","last_peered":"2024-09-13T17:13:12.273393+0000","last_clean":"2024-09-13T17:13:12.273393+0000","last_became_active":"2024-09-13T17:13:12.206675+0000","last_became_peered":"2024-09-13T17:13:12.206675+0000","last_unstale":"2024-09-13T17:13:12.273393+0000","last_undegraded":"2024-09-13T17:13:12.273393+0000","last_fullsized":"2024-09-13T17:13:12.273393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273611+0000","last_change":"2024-09-13T17:13:08.179110+0000","last_active":"2024-09-13T17:13:12.273611+0000","last_peered":"2024-09-13T17:13:12.273611+0000","last_clean":"2024-09-13T17:13:12.273611+0000","last_became_active":"2024-09-13T17:13:08.178363+0000","last_became_peered":"2024-09-13T17:13:08.178363+0000","last_unstale":"2024-09-13T17:13:12.273611+0000","last_undegraded":"2024-09-13T17:13:12.273611+0000","last_fullsized":"2024-09-13T17:13:12.273611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190765+0000","last_change":"2024-09-13T17:13:07.817732+0000","last_active":"2024-09-13T17:13:12.190765+0000","last_peered":"2024-09-13T17:13:12.190765+0000","last_clean":"2024-09-13T17:13:12.190765+0000","last_became_active":"2024-09-13T17:13:07.817449+0000","last_became_peered":"2024-09-13T17:13:07.817449+0000","last_unstale":"2024-09-13T17:13:12.190765+0000","last_undegraded":"2024-09-13T17:13:12.190765+0000","last_fullsized":"2024-09-13T17:13:12.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271705+0000","last_change":"2024-09-13T17:13:12.224085+0000","last_active":"2024-09-13T17:13:12.271705+0000","last_peered":"2024-09-13T17:13:12.271705+0000","last_clean":"2024-09-13T17:13:12.271705+0000","last_became_active":"2024-09-13T17:13:12.223683+0000","last_became_peered":"2024-09-13T17:13:12.223683+0000","last_unstale":"2024-09-13T17:13:12.271705+0000","last_undegraded":"2024-09-13T17:13:12.271705+0000","last_fullsized":"2024-09-13T17:13:12.271705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:49.009307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273320+0000","last_change":"2024-09-13T17:13:08.176665+0000","last_active":"2024-09-13T17:13:12.273320+0000","last_peered":"2024-09-13T17:13:12.273320+0000","last_clean":"2024-09-13T17:13:12.273320+0000","last_became_active":"2024-09-13T17:13:08.176310+0000","last_became_peered":"2024-09-13T17:13:08.176310+0000","last_unstale":"2024-09-13T17:13:12.273320+0000","last_undegraded":"2024-09-13T17:13:12.273320+0000","last_fullsized":"2024-09-13T17:13:12.273320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:08.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220596+0000","last_change":"2024-09-13T17:13:07.823315+0000","last_active":"2024-09-13T17:13:12.220596+0000","last_peered":"2024-09-13T17:13:12.220596+0000","last_clean":"2024-09-13T17:13:12.220596+0000","last_became_active":"2024-09-13T17:13:07.822797+0000","last_became_peered":"2024-09-13T17:13:07.822797+0000","last_unstale":"2024-09-13T17:13:12.220596+0000","last_undegraded":"2024-09-13T17:13:12.220596+0000","last_fullsized":"2024-09-13T17:13:12.220596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:23.750435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273442+0000","last_change":"2024-09-13T17:13:12.205036+0000","last_active":"2024-09-13T17:13:12.273442+0000","last_peered":"2024-09-13T17:13:12.273442+0000","last_clean":"2024-09-13T17:13:12.273442+0000","last_became_active":"2024-09-13T17:13:12.204585+0000","last_became_peered":"2024-09-13T17:13:12.204585+0000","last_unstale":"2024-09-13T17:13:12.273442+0000","last_undegraded":"2024-09-13T17:13:12.273442+0000","last_fullsized":"2024-09-13T17:13:12.273442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270653+0000","last_change":"2024-09-13T17:13:08.177098+0000","last_active":"2024-09-13T17:13:12.270653+0000","last_peered":"2024-09-13T17:13:12.270653+0000","last_clean":"2024-09-13T17:13:12.270653+0000","last_became_active":"2024-09-13T17:13:08.176776+0000","last_became_peered":"2024-09-13T17:13:08.176776+0000","last_unstale":"2024-09-13T17:13:12.270653+0000","last_undegraded":"2024-09-13T17:13:12.270653+0000","last_fullsized":"2024-09-13T17:13:12.270653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195520+0000","last_change":"2024-09-13T17:13:07.824199+0000","last_active":"2024-09-13T17:13:12.195520+0000","last_peered":"2024-09-13T17:13:12.195520+0000","last_clean":"2024-09-13T17:13:12.195520+0000","last_became_active":"2024-09-13T17:13:07.823911+0000","last_became_peered":"2024-09-13T17:13:07.823911+0000","last_unstale":"2024-09-13T17:13:12.195520+0000","last_undegraded":"2024-09-13T17:13:12.195520+0000","last_fullsized":"2024-09-13T17:13:12.195520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273309+0000","last_change":"2024-09-13T17:13:12.225869+0000","last_active":"2024-09-13T17:13:12.273309+0000","last_peered":"2024-09-13T17:13:12.273309+0000","last_clean":"2024-09-13T17:13:12.273309+0000","last_became_active":"2024-09-13T17:13:12.225019+0000","last_became_peered":"2024-09-13T17:13:12.225019+0000","last_unstale":"2024-09-13T17:13:12.273309+0000","last_undegraded":"2024-09-13T17:13:12.273309+0000","last_fullsized":"2024-09-13T17:13:12.273309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273755+0000","last_change":"2024-09-13T17:13:08.191978+0000","last_active":"2024-09-13T17:13:12.273755+0000","last_peered":"2024-09-13T17:13:12.273755+0000","last_clean":"2024-09-13T17:13:12.273755+0000","last_became_active":"2024-09-13T17:13:08.191706+0000","last_became_peered":"2024-09-13T17:13:08.191706+0000","last_unstale":"2024-09-13T17:13:12.273755+0000","last_undegraded":"2024-09-13T17:13:12.273755+0000","last_fullsized":"2024-09-13T17:13:12.273755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.397971+0000","last_change":"2024-09-13T17:13:07.818785+0000","last_active":"2024-09-13T17:13:12.397971+0000","last_peered":"2024-09-13T17:13:12.397971+0000","last_clean":"2024-09-13T17:13:12.397971+0000","last_became_active":"2024-09-13T17:13:07.818279+0000","last_became_peered":"2024-09-13T17:13:07.818279+0000","last_unstale":"2024-09-13T17:13:12.397971+0000","last_undegraded":"2024-09-13T17:13:12.397971+0000","last_fullsized":"2024-09-13T17:13:12.397971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273550+0000","last_change":"2024-09-13T17:13:12.224503+0000","last_active":"2024-09-13T17:13:12.273550+0000","last_peered":"2024-09-13T17:13:12.273550+0000","last_clean":"2024-09-13T17:13:12.273550+0000","last_became_active":"2024-09-13T17:13:12.224159+0000","last_became_peered":"2024-09-13T17:13:12.224159+0000","last_unstale":"2024-09-13T17:13:12.273550+0000","last_undegraded":"2024-09-13T17:13:12.273550+0000","last_fullsized":"2024-09-13T17:13:12.273550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.258345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271614+0000","last_change":"2024-09-13T17:13:08.175329+0000","last_active":"2024-09-13T17:13:12.271614+0000","last_peered":"2024-09-13T17:13:12.271614+0000","last_clean":"2024-09-13T17:13:12.271614+0000","last_became_active":"2024-09-13T17:13:08.174912+0000","last_became_peered":"2024-09-13T17:13:08.174912+0000","last_unstale":"2024-09-13T17:13:12.271614+0000","last_undegraded":"2024-09-13T17:13:12.271614+0000","last_fullsized":"2024-09-13T17:13:12.271614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221792+0000","last_change":"2024-09-13T17:13:07.823709+0000","last_active":"2024-09-13T17:13:12.221792+0000","last_peered":"2024-09-13T17:13:12.221792+0000","last_clean":"2024-09-13T17:13:12.221792+0000","last_became_active":"2024-09-13T17:13:07.823325+0000","last_became_peered":"2024-09-13T17:13:07.823325+0000","last_unstale":"2024-09-13T17:13:12.221792+0000","last_undegraded":"2024-09-13T17:13:12.221792+0000","last_fullsized":"2024-09-13T17:13:12.221792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270544+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.270544+0000","last_peered":"2024-09-13T17:13:12.270544+0000","last_clean":"2024-09-13T17:13:12.270544+0000","last_became_active":"2024-09-13T17:13:12.221821+0000","last_became_peered":"2024-09-13T17:13:12.221821+0000","last_unstale":"2024-09-13T17:13:12.270544+0000","last_undegraded":"2024-09-13T17:13:12.270544+0000","last_fullsized":"2024-09-13T17:13:12.270544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272069+0000","last_change":"2024-09-13T17:13:08.181489+0000","last_active":"2024-09-13T17:13:12.272069+0000","last_peered":"2024-09-13T17:13:12.272069+0000","last_clean":"2024-09-13T17:13:12.272069+0000","last_became_active":"2024-09-13T17:13:08.181204+0000","last_became_peered":"2024-09-13T17:13:08.181204+0000","last_unstale":"2024-09-13T17:13:12.272069+0000","last_undegraded":"2024-09-13T17:13:12.272069+0000","last_fullsized":"2024-09-13T17:13:12.272069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.197571+0000","last_change":"2024-09-13T17:13:07.818661+0000","last_active":"2024-09-13T17:13:12.197571+0000","last_peered":"2024-09-13T17:13:12.197571+0000","last_clean":"2024-09-13T17:13:12.197571+0000","last_became_active":"2024-09-13T17:13:07.818317+0000","last_became_peered":"2024-09-13T17:13:07.818317+0000","last_unstale":"2024-09-13T17:13:12.197571+0000","last_undegraded":"2024-09-13T17:13:12.197571+0000","last_fullsized":"2024-09-13T17:13:12.197571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271543+0000","last_change":"2024-09-13T17:13:12.202522+0000","last_active":"2024-09-13T17:13:12.271543+0000","last_peered":"2024-09-13T17:13:12.271543+0000","last_clean":"2024-09-13T17:13:12.271543+0000","last_became_active":"2024-09-13T17:13:12.202110+0000","last_became_peered":"2024-09-13T17:13:12.202110+0000","last_unstale":"2024-09-13T17:13:12.271543+0000","last_undegraded":"2024-09-13T17:13:12.271543+0000","last_fullsized":"2024-09-13T17:13:12.271543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273382+0000","last_change":"2024-09-13T17:13:08.179940+0000","last_active":"2024-09-13T17:13:12.273382+0000","last_peered":"2024-09-13T17:13:12.273382+0000","last_clean":"2024-09-13T17:13:12.273382+0000","last_became_active":"2024-09-13T17:13:08.179628+0000","last_became_peered":"2024-09-13T17:13:08.179628+0000","last_unstale":"2024-09-13T17:13:12.273382+0000","last_undegraded":"2024-09-13T17:13:12.273382+0000","last_fullsized":"2024-09-13T17:13:12.273382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:11.564848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190045+0000","last_change":"2024-09-13T17:13:07.821156+0000","last_active":"2024-09-13T17:13:12.190045+0000","last_peered":"2024-09-13T17:13:12.190045+0000","last_clean":"2024-09-13T17:13:12.190045+0000","last_became_active":"2024-09-13T17:13:07.820920+0000","last_became_peered":"2024-09-13T17:13:07.820920+0000","last_unstale":"2024-09-13T17:13:12.190045+0000","last_undegraded":"2024-09-13T17:13:12.190045+0000","last_fullsized":"2024-09-13T17:13:12.190045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271588+0000","last_change":"2024-09-13T17:13:12.210655+0000","last_active":"2024-09-13T17:13:12.271588+0000","last_peered":"2024-09-13T17:13:12.271588+0000","last_clean":"2024-09-13T17:13:12.271588+0000","last_became_active":"2024-09-13T17:13:12.209944+0000","last_became_peered":"2024-09-13T17:13:12.209944+0000","last_unstale":"2024-09-13T17:13:12.271588+0000","last_undegraded":"2024-09-13T17:13:12.271588+0000","last_fullsized":"2024-09-13T17:13:12.271588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271470+0000","last_change":"2024-09-13T17:13:08.175084+0000","last_active":"2024-09-13T17:13:12.271470+0000","last_peered":"2024-09-13T17:13:12.271470+0000","last_clean":"2024-09-13T17:13:12.271470+0000","last_became_active":"2024-09-13T17:13:08.174696+0000","last_became_peered":"2024-09-13T17:13:08.174696+0000","last_unstale":"2024-09-13T17:13:12.271470+0000","last_undegraded":"2024-09-13T17:13:12.271470+0000","last_fullsized":"2024-09-13T17:13:12.271470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186429+0000","last_change":"2024-09-13T17:13:07.820916+0000","last_active":"2024-09-13T17:13:12.186429+0000","last_peered":"2024-09-13T17:13:12.186429+0000","last_clean":"2024-09-13T17:13:12.186429+0000","last_became_active":"2024-09-13T17:13:07.820607+0000","last_became_peered":"2024-09-13T17:13:07.820607+0000","last_unstale":"2024-09-13T17:13:12.186429+0000","last_undegraded":"2024-09-13T17:13:12.186429+0000","last_fullsized":"2024-09-13T17:13:12.186429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271720+0000","last_change":"2024-09-13T17:13:12.209459+0000","last_active":"2024-09-13T17:13:12.271720+0000","last_peered":"2024-09-13T17:13:12.271720+0000","last_clean":"2024-09-13T17:13:12.271720+0000","last_became_active":"2024-09-13T17:13:12.208931+0000","last_became_peered":"2024-09-13T17:13:12.208931+0000","last_unstale":"2024-09-13T17:13:12.271720+0000","last_undegraded":"2024-09-13T17:13:12.271720+0000","last_fullsized":"2024-09-13T17:13:12.271720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270503+0000","last_change":"2024-09-13T17:13:08.180268+0000","last_active":"2024-09-13T17:13:12.270503+0000","last_peered":"2024-09-13T17:13:12.270503+0000","last_clean":"2024-09-13T17:13:12.270503+0000","last_became_active":"2024-09-13T17:13:08.179711+0000","last_became_peered":"2024-09-13T17:13:08.179711+0000","last_unstale":"2024-09-13T17:13:12.270503+0000","last_undegraded":"2024-09-13T17:13:12.270503+0000","last_fullsized":"2024-09-13T17:13:12.270503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:07.540508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220632+0000","last_change":"2024-09-13T17:13:07.823838+0000","last_active":"2024-09-13T17:13:12.220632+0000","last_peered":"2024-09-13T17:13:12.220632+0000","last_clean":"2024-09-13T17:13:12.220632+0000","last_became_active":"2024-09-13T17:13:07.823558+0000","last_became_peered":"2024-09-13T17:13:07.823558+0000","last_unstale":"2024-09-13T17:13:12.220632+0000","last_undegraded":"2024-09-13T17:13:12.220632+0000","last_fullsized":"2024-09-13T17:13:12.220632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270643+0000","last_change":"2024-09-13T17:13:12.222477+0000","last_active":"2024-09-13T17:13:12.270643+0000","last_peered":"2024-09-13T17:13:12.270643+0000","last_clean":"2024-09-13T17:13:12.270643+0000","last_became_active":"2024-09-13T17:13:12.221879+0000","last_became_peered":"2024-09-13T17:13:12.221879+0000","last_unstale":"2024-09-13T17:13:12.270643+0000","last_undegraded":"2024-09-13T17:13:12.270643+0000","last_fullsized":"2024-09-13T17:13:12.270643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273658+0000","last_change":"2024-09-13T17:13:08.185879+0000","last_active":"2024-09-13T17:13:12.273658+0000","last_peered":"2024-09-13T17:13:12.273658+0000","last_clean":"2024-09-13T17:13:12.273658+0000","last_became_active":"2024-09-13T17:13:08.185632+0000","last_became_peered":"2024-09-13T17:13:08.185632+0000","last_unstale":"2024-09-13T17:13:12.273658+0000","last_undegraded":"2024-09-13T17:13:12.273658+0000","last_fullsized":"2024-09-13T17:13:12.273658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.187815+0000","last_change":"2024-09-13T17:13:07.811868+0000","last_active":"2024-09-13T17:13:12.187815+0000","last_peered":"2024-09-13T17:13:12.187815+0000","last_clean":"2024-09-13T17:13:12.187815+0000","last_became_active":"2024-09-13T17:13:07.811535+0000","last_became_peered":"2024-09-13T17:13:07.811535+0000","last_unstale":"2024-09-13T17:13:12.187815+0000","last_undegraded":"2024-09-13T17:13:12.187815+0000","last_fullsized":"2024-09-13T17:13:12.187815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220708+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:13:12.220708+0000","last_peered":"2024-09-13T17:13:12.220708+0000","last_clean":"2024-09-13T17:13:12.220708+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:13:12.220708+0000","last_undegraded":"2024-09-13T17:13:12.220708+0000","last_fullsized":"2024-09-13T17:13:12.220708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272664+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.272664+0000","last_peered":"2024-09-13T17:13:12.272664+0000","last_clean":"2024-09-13T17:13:12.272664+0000","last_became_active":"2024-09-13T17:13:12.223344+0000","last_became_peered":"2024-09-13T17:13:12.223344+0000","last_unstale":"2024-09-13T17:13:12.272664+0000","last_undegraded":"2024-09-13T17:13:12.272664+0000","last_fullsized":"2024-09-13T17:13:12.272664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.318166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272521+0000","last_change":"2024-09-13T17:13:08.195358+0000","last_active":"2024-09-13T17:13:12.272521+0000","last_peered":"2024-09-13T17:13:12.272521+0000","last_clean":"2024-09-13T17:13:12.272521+0000","last_became_active":"2024-09-13T17:13:08.194963+0000","last_became_peered":"2024-09-13T17:13:08.194963+0000","last_unstale":"2024-09-13T17:13:12.272521+0000","last_undegraded":"2024-09-13T17:13:12.272521+0000","last_fullsized":"2024-09-13T17:13:12.272521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186435+0000","last_change":"2024-09-13T17:13:07.814854+0000","last_active":"2024-09-13T17:13:12.186435+0000","last_peered":"2024-09-13T17:13:12.186435+0000","last_clean":"2024-09-13T17:13:12.186435+0000","last_became_active":"2024-09-13T17:13:07.814526+0000","last_became_peered":"2024-09-13T17:13:07.814526+0000","last_unstale":"2024-09-13T17:13:12.186435+0000","last_undegraded":"2024-09-13T17:13:12.186435+0000","last_fullsized":"2024-09-13T17:13:12.186435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272579+0000","last_change":"2024-09-13T17:13:12.222081+0000","last_active":"2024-09-13T17:13:12.272579+0000","last_peered":"2024-09-13T17:13:12.272579+0000","last_clean":"2024-09-13T17:13:12.272579+0000","last_became_active":"2024-09-13T17:13:12.221687+0000","last_became_peered":"2024-09-13T17:13:12.221687+0000","last_unstale":"2024-09-13T17:13:12.272579+0000","last_undegraded":"2024-09-13T17:13:12.272579+0000","last_fullsized":"2024-09-13T17:13:12.272579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272033+0000","last_change":"2024-09-13T17:13:08.181540+0000","last_active":"2024-09-13T17:13:12.272033+0000","last_peered":"2024-09-13T17:13:12.272033+0000","last_clean":"2024-09-13T17:13:12.272033+0000","last_became_active":"2024-09-13T17:13:08.181238+0000","last_became_peered":"2024-09-13T17:13:08.181238+0000","last_unstale":"2024-09-13T17:13:12.272033+0000","last_undegraded":"2024-09-13T17:13:12.272033+0000","last_fullsized":"2024-09-13T17:13:12.272033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191480+0000","last_change":"2024-09-13T17:13:07.818858+0000","last_active":"2024-09-13T17:13:12.191480+0000","last_peered":"2024-09-13T17:13:12.191480+0000","last_clean":"2024-09-13T17:13:12.191480+0000","last_became_active":"2024-09-13T17:13:07.818565+0000","last_became_peered":"2024-09-13T17:13:07.818565+0000","last_unstale":"2024-09-13T17:13:12.191480+0000","last_undegraded":"2024-09-13T17:13:12.191480+0000","last_fullsized":"2024-09-13T17:13:12.191480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270562+0000","last_change":"2024-09-13T17:13:12.203489+0000","last_active":"2024-09-13T17:13:12.270562+0000","last_peered":"2024-09-13T17:13:12.270562+0000","last_clean":"2024-09-13T17:13:12.270562+0000","last_became_active":"2024-09-13T17:13:12.203032+0000","last_became_peered":"2024-09-13T17:13:12.203032+0000","last_unstale":"2024-09-13T17:13:12.270562+0000","last_undegraded":"2024-09-13T17:13:12.270562+0000","last_fullsized":"2024-09-13T17:13:12.270562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272603+0000","last_change":"2024-09-13T17:13:08.194162+0000","last_active":"2024-09-13T17:13:12.272603+0000","last_peered":"2024-09-13T17:13:12.272603+0000","last_clean":"2024-09-13T17:13:12.272603+0000","last_became_active":"2024-09-13T17:13:08.193901+0000","last_became_peered":"2024-09-13T17:13:08.193901+0000","last_unstale":"2024-09-13T17:13:12.272603+0000","last_undegraded":"2024-09-13T17:13:12.272603+0000","last_fullsized":"2024-09-13T17:13:12.272603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186482+0000","last_change":"2024-09-13T17:13:07.821914+0000","last_active":"2024-09-13T17:13:12.186482+0000","last_peered":"2024-09-13T17:13:12.186482+0000","last_clean":"2024-09-13T17:13:12.186482+0000","last_became_active":"2024-09-13T17:13:07.821626+0000","last_became_peered":"2024-09-13T17:13:07.821626+0000","last_unstale":"2024-09-13T17:13:12.186482+0000","last_undegraded":"2024-09-13T17:13:12.186482+0000","last_fullsized":"2024-09-13T17:13:12.186482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271889+0000","last_change":"2024-09-13T17:13:12.223827+0000","last_active":"2024-09-13T17:13:12.271889+0000","last_peered":"2024-09-13T17:13:12.271889+0000","last_clean":"2024-09-13T17:13:12.271889+0000","last_became_active":"2024-09-13T17:13:12.223230+0000","last_became_peered":"2024-09-13T17:13:12.223230+0000","last_unstale":"2024-09-13T17:13:12.271889+0000","last_undegraded":"2024-09-13T17:13:12.271889+0000","last_fullsized":"2024-09-13T17:13:12.271889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272574+0000","last_change":"2024-09-13T17:13:08.194775+0000","last_active":"2024-09-13T17:13:12.272574+0000","last_peered":"2024-09-13T17:13:12.272574+0000","last_clean":"2024-09-13T17:13:12.272574+0000","last_became_active":"2024-09-13T17:13:08.194500+0000","last_became_peered":"2024-09-13T17:13:08.194500+0000","last_unstale":"2024-09-13T17:13:12.272574+0000","last_undegraded":"2024-09-13T17:13:12.272574+0000","last_fullsized":"2024-09-13T17:13:12.272574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188626+0000","last_change":"2024-09-13T17:13:07.812760+0000","last_active":"2024-09-13T17:13:12.188626+0000","last_peered":"2024-09-13T17:13:12.188626+0000","last_clean":"2024-09-13T17:13:12.188626+0000","last_became_active":"2024-09-13T17:13:07.812481+0000","last_became_peered":"2024-09-13T17:13:07.812481+0000","last_unstale":"2024-09-13T17:13:12.188626+0000","last_undegraded":"2024-09-13T17:13:12.188626+0000","last_fullsized":"2024-09-13T17:13:12.188626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273298+0000","last_change":"2024-09-13T17:13:12.203001+0000","last_active":"2024-09-13T17:13:12.273298+0000","last_peered":"2024-09-13T17:13:12.273298+0000","last_clean":"2024-09-13T17:13:12.273298+0000","last_became_active":"2024-09-13T17:13:12.201855+0000","last_became_peered":"2024-09-13T17:13:12.201855+0000","last_unstale":"2024-09-13T17:13:12.273298+0000","last_undegraded":"2024-09-13T17:13:12.273298+0000","last_fullsized":"2024-09-13T17:13:12.273298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272432+0000","last_change":"2024-09-13T17:13:08.195578+0000","last_active":"2024-09-13T17:13:12.272432+0000","last_peered":"2024-09-13T17:13:12.272432+0000","last_clean":"2024-09-13T17:13:12.272432+0000","last_became_active":"2024-09-13T17:13:08.195118+0000","last_became_peered":"2024-09-13T17:13:08.195118+0000","last_unstale":"2024-09-13T17:13:12.272432+0000","last_undegraded":"2024-09-13T17:13:12.272432+0000","last_fullsized":"2024-09-13T17:13:12.272432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186263+0000","last_change":"2024-09-13T17:13:07.819737+0000","last_active":"2024-09-13T17:13:12.186263+0000","last_peered":"2024-09-13T17:13:12.186263+0000","last_clean":"2024-09-13T17:13:12.186263+0000","last_became_active":"2024-09-13T17:13:07.819435+0000","last_became_peered":"2024-09-13T17:13:07.819435+0000","last_unstale":"2024-09-13T17:13:12.186263+0000","last_undegraded":"2024-09-13T17:13:12.186263+0000","last_fullsized":"2024-09-13T17:13:12.186263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270633+0000","last_change":"2024-09-13T17:13:12.204881+0000","last_active":"2024-09-13T17:13:12.270633+0000","last_peered":"2024-09-13T17:13:12.270633+0000","last_clean":"2024-09-13T17:13:12.270633+0000","last_became_active":"2024-09-13T17:13:12.204492+0000","last_became_peered":"2024-09-13T17:13:12.204492+0000","last_unstale":"2024-09-13T17:13:12.270633+0000","last_undegraded":"2024-09-13T17:13:12.270633+0000","last_fullsized":"2024-09-13T17:13:12.270633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:26.315225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272551+0000","last_change":"2024-09-13T17:13:08.187413+0000","last_active":"2024-09-13T17:13:12.272551+0000","last_peered":"2024-09-13T17:13:12.272551+0000","last_clean":"2024-09-13T17:13:12.272551+0000","last_became_active":"2024-09-13T17:13:08.187156+0000","last_became_peered":"2024-09-13T17:13:08.187156+0000","last_unstale":"2024-09-13T17:13:12.272551+0000","last_undegraded":"2024-09-13T17:13:12.272551+0000","last_fullsized":"2024-09-13T17:13:12.272551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194011+0000","last_change":"2024-09-13T17:13:07.816811+0000","last_active":"2024-09-13T17:13:12.194011+0000","last_peered":"2024-09-13T17:13:12.194011+0000","last_clean":"2024-09-13T17:13:12.194011+0000","last_became_active":"2024-09-13T17:13:07.816486+0000","last_became_peered":"2024-09-13T17:13:07.816486+0000","last_unstale":"2024-09-13T17:13:12.194011+0000","last_undegraded":"2024-09-13T17:13:12.194011+0000","last_fullsized":"2024-09-13T17:13:12.194011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273738+0000","last_change":"2024-09-13T17:13:12.222779+0000","last_active":"2024-09-13T17:13:12.273738+0000","last_peered":"2024-09-13T17:13:12.273738+0000","last_clean":"2024-09-13T17:13:12.273738+0000","last_became_active":"2024-09-13T17:13:12.222431+0000","last_became_peered":"2024-09-13T17:13:12.222431+0000","last_unstale":"2024-09-13T17:13:12.273738+0000","last_undegraded":"2024-09-13T17:13:12.273738+0000","last_fullsized":"2024-09-13T17:13:12.273738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:07.973247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272468+0000","last_change":"2024-09-13T17:13:08.195864+0000","last_active":"2024-09-13T17:13:12.272468+0000","last_peered":"2024-09-13T17:13:12.272468+0000","last_clean":"2024-09-13T17:13:12.272468+0000","last_became_active":"2024-09-13T17:13:08.195589+0000","last_became_peered":"2024-09-13T17:13:08.195589+0000","last_unstale":"2024-09-13T17:13:12.272468+0000","last_undegraded":"2024-09-13T17:13:12.272468+0000","last_fullsized":"2024-09-13T17:13:12.272468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.189968+0000","last_change":"2024-09-13T17:13:07.820905+0000","last_active":"2024-09-13T17:13:12.189968+0000","last_peered":"2024-09-13T17:13:12.189968+0000","last_clean":"2024-09-13T17:13:12.189968+0000","last_became_active":"2024-09-13T17:13:07.820577+0000","last_became_peered":"2024-09-13T17:13:07.820577+0000","last_unstale":"2024-09-13T17:13:12.189968+0000","last_undegraded":"2024-09-13T17:13:12.189968+0000","last_fullsized":"2024-09-13T17:13:12.189968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273689+0000","last_change":"2024-09-13T17:13:12.222206+0000","last_active":"2024-09-13T17:13:12.273689+0000","last_peered":"2024-09-13T17:13:12.273689+0000","last_clean":"2024-09-13T17:13:12.273689+0000","last_became_active":"2024-09-13T17:13:12.221832+0000","last_became_peered":"2024-09-13T17:13:12.221832+0000","last_unstale":"2024-09-13T17:13:12.273689+0000","last_undegraded":"2024-09-13T17:13:12.273689+0000","last_fullsized":"2024-09-13T17:13:12.273689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:24.267854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270533+0000","last_change":"2024-09-13T17:13:08.188169+0000","last_active":"2024-09-13T17:13:12.270533+0000","last_peered":"2024-09-13T17:13:12.270533+0000","last_clean":"2024-09-13T17:13:12.270533+0000","last_became_active":"2024-09-13T17:13:08.183992+0000","last_became_peered":"2024-09-13T17:13:08.183992+0000","last_unstale":"2024-09-13T17:13:12.270533+0000","last_undegraded":"2024-09-13T17:13:12.270533+0000","last_fullsized":"2024-09-13T17:13:12.270533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.196619+0000","last_change":"2024-09-13T17:13:07.809275+0000","last_active":"2024-09-13T17:13:12.196619+0000","last_peered":"2024-09-13T17:13:12.196619+0000","last_clean":"2024-09-13T17:13:12.196619+0000","last_became_active":"2024-09-13T17:13:07.808983+0000","last_became_peered":"2024-09-13T17:13:07.808983+0000","last_unstale":"2024-09-13T17:13:12.196619+0000","last_undegraded":"2024-09-13T17:13:12.196619+0000","last_fullsized":"2024-09-13T17:13:12.196619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272043+0000","last_change":"2024-09-13T17:13:12.223022+0000","last_active":"2024-09-13T17:13:12.272043+0000","last_peered":"2024-09-13T17:13:12.272043+0000","last_clean":"2024-09-13T17:13:12.272043+0000","last_became_active":"2024-09-13T17:13:12.222587+0000","last_became_peered":"2024-09-13T17:13:12.222587+0000","last_unstale":"2024-09-13T17:13:12.272043+0000","last_undegraded":"2024-09-13T17:13:12.272043+0000","last_fullsized":"2024-09-13T17:13:12.272043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272504+0000","last_change":"2024-09-13T17:13:08.191872+0000","last_active":"2024-09-13T17:13:12.272504+0000","last_peered":"2024-09-13T17:13:12.272504+0000","last_clean":"2024-09-13T17:13:12.272504+0000","last_became_active":"2024-09-13T17:13:08.191600+0000","last_became_peered":"2024-09-13T17:13:08.191600+0000","last_unstale":"2024-09-13T17:13:12.272504+0000","last_undegraded":"2024-09-13T17:13:12.272504+0000","last_fullsized":"2024-09-13T17:13:12.272504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:10.848695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:13:16.967984+0000","last_change":"2024-09-13T17:13:07.818187+0000","last_active":"2024-09-13T17:13:16.967984+0000","last_peered":"2024-09-13T17:13:16.967984+0000","last_clean":"2024-09-13T17:13:16.967984+0000","last_became_active":"2024-09-13T17:13:07.817767+0000","last_became_peered":"2024-09-13T17:13:07.817767+0000","last_unstale":"2024-09-13T17:13:16.967984+0000","last_undegraded":"2024-09-13T17:13:16.967984+0000","last_fullsized":"2024-09-13T17:13:16.967984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271560+0000","last_change":"2024-09-13T17:13:12.198787+0000","last_active":"2024-09-13T17:13:12.271560+0000","last_peered":"2024-09-13T17:13:12.271560+0000","last_clean":"2024-09-13T17:13:12.271560+0000","last_became_active":"2024-09-13T17:13:12.198435+0000","last_became_peered":"2024-09-13T17:13:12.198435+0000","last_unstale":"2024-09-13T17:13:12.271560+0000","last_undegraded":"2024-09-13T17:13:12.271560+0000","last_fullsized":"2024-09-13T17:13:12.271560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273414+0000","last_change":"2024-09-13T17:13:08.188875+0000","last_active":"2024-09-13T17:13:12.273414+0000","last_peered":"2024-09-13T17:13:12.273414+0000","last_clean":"2024-09-13T17:13:12.273414+0000","last_became_active":"2024-09-13T17:13:08.187520+0000","last_became_peered":"2024-09-13T17:13:08.187520+0000","last_unstale":"2024-09-13T17:13:12.273414+0000","last_undegraded":"2024-09-13T17:13:12.273414+0000","last_fullsized":"2024-09-13T17:13:12.273414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191401+0000","last_change":"2024-09-13T17:13:07.819358+0000","last_active":"2024-09-13T17:13:12.191401+0000","last_peered":"2024-09-13T17:13:12.191401+0000","last_clean":"2024-09-13T17:13:12.191401+0000","last_became_active":"2024-09-13T17:13:07.819090+0000","last_became_peered":"2024-09-13T17:13:07.819090+0000","last_unstale":"2024-09-13T17:13:12.191401+0000","last_undegraded":"2024-09-13T17:13:12.191401+0000","last_fullsized":"2024-09-13T17:13:12.191401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273371+0000","last_change":"2024-09-13T17:13:12.198537+0000","last_active":"2024-09-13T17:13:12.273371+0000","last_peered":"2024-09-13T17:13:12.273371+0000","last_clean":"2024-09-13T17:13:12.273371+0000","last_became_active":"2024-09-13T17:13:12.198097+0000","last_became_peered":"2024-09-13T17:13:12.198097+0000","last_unstale":"2024-09-13T17:13:12.273371+0000","last_undegraded":"2024-09-13T17:13:12.273371+0000","last_fullsized":"2024-09-13T17:13:12.273371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270678+0000","last_change":"2024-09-13T17:13:08.188117+0000","last_active":"2024-09-13T17:13:12.270678+0000","last_peered":"2024-09-13T17:13:12.270678+0000","last_clean":"2024-09-13T17:13:12.270678+0000","last_became_active":"2024-09-13T17:13:08.187895+0000","last_became_peered":"2024-09-13T17:13:08.187895+0000","last_unstale":"2024-09-13T17:13:12.270678+0000","last_undegraded":"2024-09-13T17:13:12.270678+0000","last_fullsized":"2024-09-13T17:13:12.270678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188395+0000","last_change":"2024-09-13T17:13:07.816509+0000","last_active":"2024-09-13T17:13:12.188395+0000","last_peered":"2024-09-13T17:13:12.188395+0000","last_clean":"2024-09-13T17:13:12.188395+0000","last_became_active":"2024-09-13T17:13:07.816220+0000","last_became_peered":"2024-09-13T17:13:07.816220+0000","last_unstale":"2024-09-13T17:13:12.188395+0000","last_undegraded":"2024-09-13T17:13:12.188395+0000","last_fullsized":"2024-09-13T17:13:12.188395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273587+0000","last_change":"2024-09-13T17:13:12.211455+0000","last_active":"2024-09-13T17:13:12.273587+0000","last_peered":"2024-09-13T17:13:12.273587+0000","last_clean":"2024-09-13T17:13:12.273587+0000","last_became_active":"2024-09-13T17:13:12.211134+0000","last_became_peered":"2024-09-13T17:13:12.211134+0000","last_unstale":"2024-09-13T17:13:12.273587+0000","last_undegraded":"2024-09-13T17:13:12.273587+0000","last_fullsized":"2024-09-13T17:13:12.273587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:01.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272080+0000","last_change":"2024-09-13T17:13:08.186199+0000","last_active":"2024-09-13T17:13:12.272080+0000","last_peered":"2024-09-13T17:13:12.272080+0000","last_clean":"2024-09-13T17:13:12.272080+0000","last_became_active":"2024-09-13T17:13:08.185905+0000","last_became_peered":"2024-09-13T17:13:08.185905+0000","last_unstale":"2024-09-13T17:13:12.272080+0000","last_undegraded":"2024-09-13T17:13:12.272080+0000","last_fullsized":"2024-09-13T17:13:12.272080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195432+0000","last_change":"2024-09-13T17:13:07.818508+0000","last_active":"2024-09-13T17:13:12.195432+0000","last_peered":"2024-09-13T17:13:12.195432+0000","last_clean":"2024-09-13T17:13:12.195432+0000","last_became_active":"2024-09-13T17:13:07.818195+0000","last_became_peered":"2024-09-13T17:13:07.818195+0000","last_unstale":"2024-09-13T17:13:12.195432+0000","last_undegraded":"2024-09-13T17:13:12.195432+0000","last_fullsized":"2024-09-13T17:13:12.195432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273629+0000","last_change":"2024-09-13T17:13:12.225297+0000","last_active":"2024-09-13T17:13:12.273629+0000","last_peered":"2024-09-13T17:13:12.273629+0000","last_clean":"2024-09-13T17:13:12.273629+0000","last_became_active":"2024-09-13T17:13:12.224933+0000","last_became_peered":"2024-09-13T17:13:12.224933+0000","last_unstale":"2024-09-13T17:13:12.273629+0000","last_undegraded":"2024-09-13T17:13:12.273629+0000","last_fullsized":"2024-09-13T17:13:12.273629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270623+0000","last_change":"2024-09-13T17:13:12.224462+0000","last_active":"2024-09-13T17:13:12.270623+0000","last_peered":"2024-09-13T17:13:12.270623+0000","last_clean":"2024-09-13T17:13:12.270623+0000","last_became_active":"2024-09-13T17:13:12.223084+0000","last_became_peered":"2024-09-13T17:13:12.223084+0000","last_unstale":"2024-09-13T17:13:12.270623+0000","last_undegraded":"2024-09-13T17:13:12.270623+0000","last_fullsized":"2024-09-13T17:13:12.270623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271489+0000","last_change":"2024-09-13T17:13:08.179431+0000","last_active":"2024-09-13T17:13:12.271489+0000","last_peered":"2024-09-13T17:13:12.271489+0000","last_clean":"2024-09-13T17:13:12.271489+0000","last_became_active":"2024-09-13T17:13:08.178872+0000","last_became_peered":"2024-09-13T17:13:08.178872+0000","last_unstale":"2024-09-13T17:13:12.271489+0000","last_undegraded":"2024-09-13T17:13:12.271489+0000","last_fullsized":"2024-09-13T17:13:12.271489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188486+0000","last_change":"2024-09-13T17:13:07.808744+0000","last_active":"2024-09-13T17:13:12.188486+0000","last_peered":"2024-09-13T17:13:12.188486+0000","last_clean":"2024-09-13T17:13:12.188486+0000","last_became_active":"2024-09-13T17:13:07.808479+0000","last_became_peered":"2024-09-13T17:13:07.808479+0000","last_unstale":"2024-09-13T17:13:12.188486+0000","last_undegraded":"2024-09-13T17:13:12.188486+0000","last_fullsized":"2024-09-13T17:13:12.188486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272723+0000","last_change":"2024-09-13T17:13:12.202980+0000","last_active":"2024-09-13T17:13:12.272723+0000","last_peered":"2024-09-13T17:13:12.272723+0000","last_clean":"2024-09-13T17:13:12.272723+0000","last_became_active":"2024-09-13T17:13:12.202568+0000","last_became_peered":"2024-09-13T17:13:12.202568+0000","last_unstale":"2024-09-13T17:13:12.272723+0000","last_undegraded":"2024-09-13T17:13:12.272723+0000","last_fullsized":"2024-09-13T17:13:12.272723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:08.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273602+0000","last_change":"2024-09-13T17:13:08.184455+0000","last_active":"2024-09-13T17:13:12.273602+0000","last_peered":"2024-09-13T17:13:12.273602+0000","last_clean":"2024-09-13T17:13:12.273602+0000","last_became_active":"2024-09-13T17:13:08.184221+0000","last_became_peered":"2024-09-13T17:13:08.184221+0000","last_unstale":"2024-09-13T17:13:12.273602+0000","last_undegraded":"2024-09-13T17:13:12.273602+0000","last_fullsized":"2024-09-13T17:13:12.273602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191347+0000","last_change":"2024-09-13T17:13:07.816989+0000","last_active":"2024-09-13T17:13:12.191347+0000","last_peered":"2024-09-13T17:13:12.191347+0000","last_clean":"2024-09-13T17:13:12.191347+0000","last_became_active":"2024-09-13T17:13:07.816688+0000","last_became_peered":"2024-09-13T17:13:07.816688+0000","last_unstale":"2024-09-13T17:13:12.191347+0000","last_undegraded":"2024-09-13T17:13:12.191347+0000","last_fullsized":"2024-09-13T17:13:12.191347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194332+0000","last_change":"2024-09-13T17:13:07.814845+0000","last_active":"2024-09-13T17:13:12.194332+0000","last_peered":"2024-09-13T17:13:12.194332+0000","last_clean":"2024-09-13T17:13:12.194332+0000","last_became_active":"2024-09-13T17:13:07.814565+0000","last_became_peered":"2024-09-13T17:13:07.814565+0000","last_unstale":"2024-09-13T17:13:12.194332+0000","last_undegraded":"2024-09-13T17:13:12.194332+0000","last_fullsized":"2024-09-13T17:13:12.194332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270586+0000","last_change":"2024-09-13T17:13:08.181292+0000","last_active":"2024-09-13T17:13:12.270586+0000","last_peered":"2024-09-13T17:13:12.270586+0000","last_clean":"2024-09-13T17:13:12.270586+0000","last_became_active":"2024-09-13T17:13:08.180800+0000","last_became_peered":"2024-09-13T17:13:08.180800+0000","last_unstale":"2024-09-13T17:13:12.270586+0000","last_undegraded":"2024-09-13T17:13:12.270586+0000","last_fullsized":"2024-09-13T17:13:12.270586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:53.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273547+0000","last_change":"2024-09-13T17:13:12.205700+0000","last_active":"2024-09-13T17:13:12.273547+0000","last_peered":"2024-09-13T17:13:12.273547+0000","last_clean":"2024-09-13T17:13:12.273547+0000","last_became_active":"2024-09-13T17:13:12.205330+0000","last_became_peered":"2024-09-13T17:13:12.205330+0000","last_unstale":"2024-09-13T17:13:12.273547+0000","last_undegraded":"2024-09-13T17:13:12.273547+0000","last_fullsized":"2024-09-13T17:13:12.273547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:55.349358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193464+0000","last_change":"2024-09-13T17:13:07.822962+0000","last_active":"2024-09-13T17:13:12.193464+0000","last_peered":"2024-09-13T17:13:12.193464+0000","last_clean":"2024-09-13T17:13:12.193464+0000","last_became_active":"2024-09-13T17:13:07.822676+0000","last_became_peered":"2024-09-13T17:13:07.822676+0000","last_unstale":"2024-09-13T17:13:12.193464+0000","last_undegraded":"2024-09-13T17:13:12.193464+0000","last_fullsized":"2024-09-13T17:13:12.193464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273347+0000","last_change":"2024-09-13T17:13:08.176946+0000","last_active":"2024-09-13T17:13:12.273347+0000","last_peered":"2024-09-13T17:13:12.273347+0000","last_clean":"2024-09-13T17:13:12.273347+0000","last_became_active":"2024-09-13T17:13:08.176653+0000","last_became_peered":"2024-09-13T17:13:08.176653+0000","last_unstale":"2024-09-13T17:13:12.273347+0000","last_undegraded":"2024-09-13T17:13:12.273347+0000","last_fullsized":"2024-09-13T17:13:12.273347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273706+0000","last_change":"2024-09-13T17:13:12.211076+0000","last_active":"2024-09-13T17:13:12.273706+0000","last_peered":"2024-09-13T17:13:12.273706+0000","last_clean":"2024-09-13T17:13:12.273706+0000","last_became_active":"2024-09-13T17:13:12.210718+0000","last_became_peered":"2024-09-13T17:13:12.210718+0000","last_unstale":"2024-09-13T17:13:12.273706+0000","last_undegraded":"2024-09-13T17:13:12.273706+0000","last_fullsized":"2024-09-13T17:13:12.273706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:57.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272535+0000","last_change":"2024-09-13T17:13:08.186992+0000","last_active":"2024-09-13T17:13:12.272535+0000","last_peered":"2024-09-13T17:13:12.272535+0000","last_clean":"2024-09-13T17:13:12.272535+0000","last_became_active":"2024-09-13T17:13:08.186730+0000","last_became_peered":"2024-09-13T17:13:08.186730+0000","last_unstale":"2024-09-13T17:13:12.272535+0000","last_undegraded":"2024-09-13T17:13:12.272535+0000","last_fullsized":"2024-09-13T17:13:12.272535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273527+0000","last_change":"2024-09-13T17:13:08.185076+0000","last_active":"2024-09-13T17:13:12.273527+0000","last_peered":"2024-09-13T17:13:12.273527+0000","last_clean":"2024-09-13T17:13:12.273527+0000","last_became_active":"2024-09-13T17:13:08.184807+0000","last_became_peered":"2024-09-13T17:13:08.184807+0000","last_unstale":"2024-09-13T17:13:12.273527+0000","last_undegraded":"2024-09-13T17:13:12.273527+0000","last_fullsized":"2024-09-13T17:13:12.273527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271978+0000","last_change":"2024-09-13T17:13:08.182381+0000","last_active":"2024-09-13T17:13:12.271978+0000","last_peered":"2024-09-13T17:13:12.271978+0000","last_clean":"2024-09-13T17:13:12.271978+0000","last_became_active":"2024-09-13T17:13:08.181851+0000","last_became_peered":"2024-09-13T17:13:08.181851+0000","last_unstale":"2024-09-13T17:13:12.271978+0000","last_undegraded":"2024-09-13T17:13:12.271978+0000","last_fullsized":"2024-09-13T17:13:12.271978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270578+0000","last_change":"2024-09-13T17:13:08.179038+0000","last_active":"2024-09-13T17:13:12.270578+0000","last_peered":"2024-09-13T17:13:12.270578+0000","last_clean":"2024-09-13T17:13:12.270578+0000","last_became_active":"2024-09-13T17:13:08.178609+0000","last_became_peered":"2024-09-13T17:13:08.178609+0000","last_unstale":"2024-09-13T17:13:12.270578+0000","last_undegraded":"2024-09-13T17:13:12.270578+0000","last_fullsized":"2024-09-13T17:13:12.270578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273698+0000","last_change":"2024-09-13T17:13:08.179834+0000","last_active":"2024-09-13T17:13:12.273698+0000","last_peered":"2024-09-13T17:13:12.273698+0000","last_clean":"2024-09-13T17:13:12.273698+0000","last_became_active":"2024-09-13T17:13:08.179568+0000","last_became_peered":"2024-09-13T17:13:08.179568+0000","last_unstale":"2024-09-13T17:13:12.273698+0000","last_undegraded":"2024-09-13T17:13:12.273698+0000","last_fullsized":"2024-09-13T17:13:12.273698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271641+0000","last_change":"2024-09-13T17:13:08.178962+0000","last_active":"2024-09-13T17:13:12.271641+0000","last_peered":"2024-09-13T17:13:12.271641+0000","last_clean":"2024-09-13T17:13:12.271641+0000","last_became_active":"2024-09-13T17:13:08.178519+0000","last_became_peered":"2024-09-13T17:13:08.178519+0000","last_unstale":"2024-09-13T17:13:12.271641+0000","last_undegraded":"2024-09-13T17:13:12.271641+0000","last_fullsized":"2024-09-13T17:13:12.271641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272698+0000","last_change":"2024-09-13T17:13:08.189740+0000","last_active":"2024-09-13T17:13:12.272698+0000","last_peered":"2024-09-13T17:13:12.272698+0000","last_clean":"2024-09-13T17:13:12.272698+0000","last_became_active":"2024-09-13T17:13:08.189493+0000","last_became_peered":"2024-09-13T17:13:08.189493+0000","last_unstale":"2024-09-13T17:13:12.272698+0000","last_undegraded":"2024-09-13T17:13:12.272698+0000","last_fullsized":"2024-09-13T17:13:12.272698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273747+0000","last_change":"2024-09-13T17:13:08.187313+0000","last_active":"2024-09-13T17:13:12.273747+0000","last_peered":"2024-09-13T17:13:12.273747+0000","last_clean":"2024-09-13T17:13:12.273747+0000","last_became_active":"2024-09-13T17:13:08.186547+0000","last_became_peered":"2024-09-13T17:13:08.186547+0000","last_unstale":"2024-09-13T17:13:12.273747+0000","last_undegraded":"2024-09-13T17:13:12.273747+0000","last_fullsized":"2024-09-13T17:13:12.273747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271935+0000","last_change":"2024-09-13T17:13:08.181762+0000","last_active":"2024-09-13T17:13:12.271935+0000","last_peered":"2024-09-13T17:13:12.271935+0000","last_clean":"2024-09-13T17:13:12.271935+0000","last_became_active":"2024-09-13T17:13:08.181207+0000","last_became_peered":"2024-09-13T17:13:08.181207+0000","last_unstale":"2024-09-13T17:13:12.271935+0000","last_undegraded":"2024-09-13T17:13:12.271935+0000","last_fullsized":"2024-09-13T17:13:12.271935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273638+0000","last_change":"2024-09-13T17:13:08.180419+0000","last_active":"2024-09-13T17:13:12.273638+0000","last_peered":"2024-09-13T17:13:12.273638+0000","last_clean":"2024-09-13T17:13:12.273638+0000","last_became_active":"2024-09-13T17:13:08.179973+0000","last_became_peered":"2024-09-13T17:13:08.179973+0000","last_unstale":"2024-09-13T17:13:12.273638+0000","last_undegraded":"2024-09-13T17:13:12.273638+0000","last_fullsized":"2024-09-13T17:13:12.273638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271966+0000","last_change":"2024-09-13T17:13:08.187243+0000","last_active":"2024-09-13T17:13:12.271966+0000","last_peered":"2024-09-13T17:13:12.271966+0000","last_clean":"2024-09-13T17:13:12.271966+0000","last_became_active":"2024-09-13T17:13:08.185915+0000","last_became_peered":"2024-09-13T17:13:08.185915+0000","last_unstale":"2024-09-13T17:13:12.271966+0000","last_undegraded":"2024-09-13T17:13:12.271966+0000","last_fullsized":"2024-09-13T17:13:12.271966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270553+0000","last_change":"2024-09-13T17:13:08.183725+0000","last_active":"2024-09-13T17:13:12.270553+0000","last_peered":"2024-09-13T17:13:12.270553+0000","last_clean":"2024-09-13T17:13:12.270553+0000","last_became_active":"2024-09-13T17:13:08.183369+0000","last_became_peered":"2024-09-13T17:13:08.183369+0000","last_unstale":"2024-09-13T17:13:12.270553+0000","last_undegraded":"2024-09-13T17:13:12.270553+0000","last_fullsized":"2024-09-13T17:13:12.270553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272636+0000","last_change":"2024-09-13T17:13:08.184578+0000","last_active":"2024-09-13T17:13:12.272636+0000","last_peered":"2024-09-13T17:13:12.272636+0000","last_clean":"2024-09-13T17:13:12.272636+0000","last_became_active":"2024-09-13T17:13:08.184328+0000","last_became_peered":"2024-09-13T17:13:08.184328+0000","last_unstale":"2024-09-13T17:13:12.272636+0000","last_undegraded":"2024-09-13T17:13:12.272636+0000","last_fullsized":"2024-09-13T17:13:12.272636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272553+0000","last_change":"2024-09-13T17:13:08.183549+0000","last_active":"2024-09-13T17:13:12.272553+0000","last_peered":"2024-09-13T17:13:12.272553+0000","last_clean":"2024-09-13T17:13:12.272553+0000","last_became_active":"2024-09-13T17:13:08.183301+0000","last_became_peered":"2024-09-13T17:13:08.183301+0000","last_unstale":"2024-09-13T17:13:12.272553+0000","last_undegraded":"2024-09-13T17:13:12.272553+0000","last_fullsized":"2024-09-13T17:13:12.272553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273561+0000","last_change":"2024-09-13T17:13:08.182679+0000","last_active":"2024-09-13T17:13:12.273561+0000","last_peered":"2024-09-13T17:13:12.273561+0000","last_clean":"2024-09-13T17:13:12.273561+0000","last_became_active":"2024-09-13T17:13:08.182412+0000","last_became_peered":"2024-09-13T17:13:08.182412+0000","last_unstale":"2024-09-13T17:13:12.273561+0000","last_undegraded":"2024-09-13T17:13:12.273561+0000","last_fullsized":"2024-09-13T17:13:12.273561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272096+0000","last_change":"2024-09-13T17:13:08.189128+0000","last_active":"2024-09-13T17:13:12.272096+0000","last_peered":"2024-09-13T17:13:12.272096+0000","last_clean":"2024-09-13T17:13:12.272096+0000","last_became_active":"2024-09-13T17:13:08.188829+0000","last_became_peered":"2024-09-13T17:13:08.188829+0000","last_unstale":"2024-09-13T17:13:12.272096+0000","last_undegraded":"2024-09-13T17:13:12.272096+0000","last_fullsized":"2024-09-13T17:13:12.272096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271915+0000","last_change":"2024-09-13T17:13:08.181955+0000","last_active":"2024-09-13T17:13:12.271915+0000","last_peered":"2024-09-13T17:13:12.271915+0000","last_clean":"2024-09-13T17:13:12.271915+0000","last_became_active":"2024-09-13T17:13:08.180834+0000","last_became_peered":"2024-09-13T17:13:08.180834+0000","last_unstale":"2024-09-13T17:13:12.271915+0000","last_undegraded":"2024-09-13T17:13:12.271915+0000","last_fullsized":"2024-09-13T17:13:12.271915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271506+0000","last_change":"2024-09-13T17:13:08.177678+0000","last_active":"2024-09-13T17:13:12.271506+0000","last_peered":"2024-09-13T17:13:12.271506+0000","last_clean":"2024-09-13T17:13:12.271506+0000","last_became_active":"2024-09-13T17:13:08.177367+0000","last_became_peered":"2024-09-13T17:13:08.177367+0000","last_unstale":"2024-09-13T17:13:12.271506+0000","last_undegraded":"2024-09-13T17:13:12.271506+0000","last_fullsized":"2024-09-13T17:13:12.271506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270519+0000","last_change":"2024-09-13T17:13:08.177377+0000","last_active":"2024-09-13T17:13:12.270519+0000","last_peered":"2024-09-13T17:13:12.270519+0000","last_clean":"2024-09-13T17:13:12.270519+0000","last_became_active":"2024-09-13T17:13:08.176410+0000","last_became_peered":"2024-09-13T17:13:08.176410+0000","last_unstale":"2024-09-13T17:13:12.270519+0000","last_undegraded":"2024-09-13T17:13:12.270519+0000","last_fullsized":"2024-09-13T17:13:12.270519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273666+0000","last_change":"2024-09-13T17:13:08.183002+0000","last_active":"2024-09-13T17:13:12.273666+0000","last_peered":"2024-09-13T17:13:12.273666+0000","last_clean":"2024-09-13T17:13:12.273666+0000","last_became_active":"2024-09-13T17:13:08.181898+0000","last_became_peered":"2024-09-13T17:13:08.181898+0000","last_unstale":"2024-09-13T17:13:12.273666+0000","last_undegraded":"2024-09-13T17:13:12.273666+0000","last_fullsized":"2024-09-13T17:13:12.273666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273404+0000","last_change":"2024-09-13T17:13:08.183228+0000","last_active":"2024-09-13T17:13:12.273404+0000","last_peered":"2024-09-13T17:13:12.273404+0000","last_clean":"2024-09-13T17:13:12.273404+0000","last_became_active":"2024-09-13T17:13:08.182942+0000","last_became_peered":"2024-09-13T17:13:08.182942+0000","last_unstale":"2024-09-13T17:13:12.273404+0000","last_undegraded":"2024-09-13T17:13:12.273404+0000","last_fullsized":"2024-09-13T17:13:12.273404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:15.542986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272676+0000","last_change":"2024-09-13T17:13:08.192671+0000","last_active":"2024-09-13T17:13:12.272676+0000","last_peered":"2024-09-13T17:13:12.272676+0000","last_clean":"2024-09-13T17:13:12.272676+0000","last_became_active":"2024-09-13T17:13:08.192366+0000","last_became_peered":"2024-09-13T17:13:08.192366+0000","last_unstale":"2024-09-13T17:13:12.272676+0000","last_undegraded":"2024-09-13T17:13:12.272676+0000","last_fullsized":"2024-09-13T17:13:12.272676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272687+0000","last_change":"2024-09-13T17:13:08.193253+0000","last_active":"2024-09-13T17:13:12.272687+0000","last_peered":"2024-09-13T17:13:12.272687+0000","last_clean":"2024-09-13T17:13:12.272687+0000","last_became_active":"2024-09-13T17:13:08.192969+0000","last_became_peered":"2024-09-13T17:13:08.192969+0000","last_unstale":"2024-09-13T17:13:12.272687+0000","last_undegraded":"2024-09-13T17:13:12.272687+0000","last_fullsized":"2024-09-13T17:13:12.272687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272593+0000","last_change":"2024-09-13T17:13:08.195764+0000","last_active":"2024-09-13T17:13:12.272593+0000","last_peered":"2024-09-13T17:13:12.272593+0000","last_clean":"2024-09-13T17:13:12.272593+0000","last_became_active":"2024-09-13T17:13:08.195102+0000","last_became_peered":"2024-09-13T17:13:08.195102+0000","last_unstale":"2024-09-13T17:13:12.272593+0000","last_undegraded":"2024-09-13T17:13:12.272593+0000","last_fullsized":"2024-09-13T17:13:12.272593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273574+0000","last_change":"2024-09-13T17:13:08.192409+0000","last_active":"2024-09-13T17:13:12.273574+0000","last_peered":"2024-09-13T17:13:12.273574+0000","last_clean":"2024-09-13T17:13:12.273574+0000","last_became_active":"2024-09-13T17:13:08.192135+0000","last_became_peered":"2024-09-13T17:13:08.192135+0000","last_unstale":"2024-09-13T17:13:12.273574+0000","last_undegraded":"2024-09-13T17:13:12.273574+0000","last_fullsized":"2024-09-13T17:13:12.273574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272414+0000","last_change":"2024-09-13T17:13:08.188381+0000","last_active":"2024-09-13T17:13:12.272414+0000","last_peered":"2024-09-13T17:13:12.272414+0000","last_clean":"2024-09-13T17:13:12.272414+0000","last_became_active":"2024-09-13T17:13:08.188091+0000","last_became_peered":"2024-09-13T17:13:08.188091+0000","last_unstale":"2024-09-13T17:13:12.272414+0000","last_undegraded":"2024-09-13T17:13:12.272414+0000","last_fullsized":"2024-09-13T17:13:12.272414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271956+0000","last_change":"2024-09-13T17:13:08.181573+0000","last_active":"2024-09-13T17:13:12.271956+0000","last_peered":"2024-09-13T17:13:12.271956+0000","last_clean":"2024-09-13T17:13:12.271956+0000","last_became_active":"2024-09-13T17:13:08.180771+0000","last_became_peered":"2024-09-13T17:13:08.180771+0000","last_unstale":"2024-09-13T17:13:12.271956+0000","last_undegraded":"2024-09-13T17:13:12.271956+0000","last_fullsized":"2024-09-13T17:13:12.271956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272451+0000","last_change":"2024-09-13T17:13:08.182931+0000","last_active":"2024-09-13T17:13:12.272451+0000","last_peered":"2024-09-13T17:13:12.272451+0000","last_clean":"2024-09-13T17:13:12.272451+0000","last_became_active":"2024-09-13T17:13:08.182550+0000","last_became_peered":"2024-09-13T17:13:08.182550+0000","last_unstale":"2024-09-13T17:13:12.272451+0000","last_undegraded":"2024-09-13T17:13:12.272451+0000","last_fullsized":"2024-09-13T17:13:12.272451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272014+0000","last_change":"2024-09-13T17:13:08.183116+0000","last_active":"2024-09-13T17:13:12.272014+0000","last_peered":"2024-09-13T17:13:12.272014+0000","last_clean":"2024-09-13T17:13:12.272014+0000","last_became_active":"2024-09-13T17:13:08.182806+0000","last_became_peered":"2024-09-13T17:13:08.182806+0000","last_unstale":"2024-09-13T17:13:12.272014+0000","last_undegraded":"2024-09-13T17:13:12.272014+0000","last_fullsized":"2024-09-13T17:13:12.272014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270613+0000","last_change":"2024-09-13T17:13:08.175847+0000","last_active":"2024-09-13T17:13:12.270613+0000","last_peered":"2024-09-13T17:13:12.270613+0000","last_clean":"2024-09-13T17:13:12.270613+0000","last_became_active":"2024-09-13T17:13:08.175560+0000","last_became_peered":"2024-09-13T17:13:08.175560+0000","last_unstale":"2024-09-13T17:13:12.270613+0000","last_undegraded":"2024-09-13T17:13:12.270613+0000","last_fullsized":"2024-09-13T17:13:12.270613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271680+0000","last_change":"2024-09-13T17:13:08.178668+0000","last_active":"2024-09-13T17:13:12.271680+0000","last_peered":"2024-09-13T17:13:12.271680+0000","last_clean":"2024-09-13T17:13:12.271680+0000","last_became_active":"2024-09-13T17:13:08.178371+0000","last_became_peered":"2024-09-13T17:13:08.178371+0000","last_unstale":"2024-09-13T17:13:12.271680+0000","last_undegraded":"2024-09-13T17:13:12.271680+0000","last_fullsized":"2024-09-13T17:13:12.271680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272583+0000","last_change":"2024-09-13T17:13:08.193114+0000","last_active":"2024-09-13T17:13:12.272583+0000","last_peered":"2024-09-13T17:13:12.272583+0000","last_clean":"2024-09-13T17:13:12.272583+0000","last_became_active":"2024-09-13T17:13:08.192630+0000","last_became_peered":"2024-09-13T17:13:08.192630+0000","last_unstale":"2024-09-13T17:13:12.272583+0000","last_undegraded":"2024-09-13T17:13:12.272583+0000","last_fullsized":"2024-09-13T17:13:12.272583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:07.796374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:30.664 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:13:30.664 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:13:30.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:13:30.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T17:13:30.665 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T17:13:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.797+0000 7f303ff25640 1 Processor -- start 2024-09-13T17:13:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.797+0000 7f303ff25640 1 -- start start 2024-09-13T17:13:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303ff25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f303815a3e0 0x7f303806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303ff25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 0x7f30380ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303ff25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303806d410 con 0x7f30380ab5a0 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303ff25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30380aba50 con 0x7f303815a3e0 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303ff25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303806cb70 con 0x7f303806c320 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303dcc1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f303815a3e0 0x7f303806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303d4c0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 0x7f30380ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303e4c2640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f30380ab5a0 0x7f303815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60198/0 (socket says 172.21.15.5:60198) 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303e4c2640 1 -- 172.21.15.5:0/3429002198 learned_addr learned my addr 172.21.15.5:0/3429002198 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303dcc1640 1 -- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 msgr2=0x7f30380ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303dcc1640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 0x7f30380ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303dcc1640 1 -- 172.21.15.5:0/3429002198 >> v1:172.21.15.179:6789/0 conn(0x7f30380ab5a0 legacy=0x7f303815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303dcc1640 1 -- 172.21.15.5:0/3429002198 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303806ce50 con 0x7f303815a3e0 2024-09-13T17:13:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.798+0000 7f303d4c0640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 0x7f30380ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.799+0000 7f303dcc1640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303815a3e0 0x7f303806e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30340097a0 tx=0x7f303402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3adf252cb48785b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.799+0000 7f303ccbf640 1 -- 172.21.15.5:0/3429002198 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034032440 con 0x7f303815a3e0 2024-09-13T17:13:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.799+0000 7f303ccbf640 1 -- 172.21.15.5:0/3429002198 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30340325a0 con 0x7f303815a3e0 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.799+0000 7f303ccbf640 1 -- 172.21.15.5:0/3429002198 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034032930 con 0x7f303815a3e0 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 -- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303815a3e0 msgr2=0x7f303806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303815a3e0 0x7f303806e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30340097a0 tx=0x7f303402a180 comp rx=0 tx=0).stop 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 -- 172.21.15.5:0/3429002198 shutdown_connections 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303806c320 0x7f30380ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 --2- 172.21.15.5:0/3429002198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303815a3e0 0x7f303806e090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 -- 172.21.15.5:0/3429002198 >> 172.21.15.5:0/3429002198 conn(0x7f30380ce0d0 msgr2=0x7f30380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 -- 172.21.15.5:0/3429002198 shutdown_connections 2024-09-13T17:13:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.800+0000 7f303ff25640 1 -- 172.21.15.5:0/3429002198 wait complete. 2024-09-13T17:13:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.801+0000 7f303ff25640 1 Processor -- start 2024-09-13T17:13:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.801+0000 7f303ff25640 1 -- start start 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30380ab5a0 0x7f30381557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303815a3e0 0x7f30380b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038157620 con 0x7f303806c320 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038157900 con 0x7f30380ab5a0 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303ff25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3038157be0 con 0x7f303815a3e0 2024-09-13T17:13:30.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303dcc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303dcc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38846/0 (socket says 172.21.15.5:38846) 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303dcc1640 1 -- 172.21.15.5:0/774062973 learned_addr learned my addr 172.21.15.5:0/774062973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303d4c0640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30380ab5a0 0x7f30381557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.802+0000 7f303e4c2640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303815a3e0 0x7f30380b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 -- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303815a3e0 msgr2=0x7f30380b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303815a3e0 0x7f30380b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 -- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30380ab5a0 msgr2=0x7f30381557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30380ab5a0 0x7f30381557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 -- 172.21.15.5:0/774062973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009400 con 0x7f303806c320 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303dcc1640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30340097a0 tx=0x7f30340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034030b80 con 0x7f303806c320 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3034032e90 con 0x7f303806c320 2024-09-13T17:13:30.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3034009400 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034006e10 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.803+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30381581a0 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.804+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30381583c0 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.804+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3034039040 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.805+0000 7f302e7fc640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 0x7f301c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.805+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30340a9dd0 con 0x7f303806c320 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.805+0000 7f303d4c0640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 0x7f301c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.806+0000 7f303d4c0640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 0x7f301c06d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f303815aad0 tx=0x7f3028008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:30.809+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3034074cc0 con 0x7f303806c320 2024-09-13T17:13:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.024+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f30380672a0 con 0x7f303806c320 2024-09-13T17:13:31.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.027+0000 7f302e7fc640 1 -- 172.21.15.5:0/774062973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170959 (secure 0 0 0) 0x7f303404c090 con 0x7f303806c320 2024-09-13T17:13:31.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 msgr2=0x7f301c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 0x7f301c06d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f303815aad0 tx=0x7f3028008040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 msgr2=0x7f3038149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30340097a0 tx=0x7f30340046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 shutdown_connections 2024-09-13T17:13:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303815a3e0 0x7f30380b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30380ab5a0 0x7f30381557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f301c06ac00 0x7f301c06d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 --2- 172.21.15.5:0/774062973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f303806c320 0x7f3038149280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 >> 172.21.15.5:0/774062973 conn(0x7f30380ce0d0 msgr2=0x7f30380adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 shutdown_connections 2024-09-13T17:13:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.030+0000 7f303ff25640 1 -- 172.21.15.5:0/774062973 wait complete. 2024-09-13T17:13:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1099835240},{"type":"v1","addr":"172.21.15.179:6833","nonce":1099835240}]},"active_addr":"172.21.15.179:6833/1099835240","active_change":"2024-09-13T17:12:55.245998+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3620314893}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":4211155683}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3096762750}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2928371487}]}]} 2024-09-13T17:13:31.046 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T17:13:31.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T17:13:31.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.145+0000 7fe266cf0640 1 Processor -- start 2024-09-13T17:13:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.145+0000 7fe266cf0640 1 -- start start 2024-09-13T17:13:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe266cf0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 0x7fe2600b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe266cf0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2600b1ed0 0x7fe2601598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe266cf0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26015d990 con 0x7fe2600addb0 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe266cf0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600b26f0 con 0x7fe2600b1ed0 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe266cf0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26015de20 con 0x7fe2600cdd90 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe26528d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2600b1ed0 0x7fe2601598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe26528d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2600b1ed0 0x7fe2601598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38852/0 (socket says 172.21.15.5:38852) 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.146+0000 7fe26528d640 1 -- 172.21.15.5:0/597935052 learned_addr learned my addr 172.21.15.5:0/597935052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe25ffff640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 0x7fe2600b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe26528d640 1 -- 172.21.15.5:0/597935052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 msgr2=0x7fe2600b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe26528d640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 0x7fe2600b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe26528d640 1 -- 172.21.15.5:0/597935052 >> v1:172.21.15.179:6789/0 conn(0x7fe2600addb0 legacy=0x7fe2600cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe26528d640 1 -- 172.21.15.5:0/597935052 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600ae190 con 0x7fe2600b1ed0 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe25ffff640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 0x7fe2600b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.147+0000 7fe26528d640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600b1ed0 0x7fe2601598d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2580098a0 tx=0x7fe25802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890d8d340d2ec528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe25f7fe640 1 -- 172.21.15.5:0/597935052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258032440 con 0x7fe2600b1ed0 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe25f7fe640 1 -- 172.21.15.5:0/597935052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2580325a0 con 0x7fe2600b1ed0 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe25f7fe640 1 -- 172.21.15.5:0/597935052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258032930 con 0x7fe2600b1ed0 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 -- 172.21.15.5:0/597935052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600b1ed0 msgr2=0x7fe2601598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600b1ed0 0x7fe2601598d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2580098a0 tx=0x7fe25802a250 comp rx=0 tx=0).stop 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 -- 172.21.15.5:0/597935052 shutdown_connections 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600b1ed0 0x7fe2601598d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 --2- 172.21.15.5:0/597935052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600cdd90 0x7fe2600b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 -- 172.21.15.5:0/597935052 >> 172.21.15.5:0/597935052 conn(0x7fe2600b0420 msgr2=0x7fe2600b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 -- 172.21.15.5:0/597935052 shutdown_connections 2024-09-13T17:13:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.148+0000 7fe266cf0640 1 -- 172.21.15.5:0/597935052 wait complete. 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.149+0000 7fe266cf0640 1 Processor -- start 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.149+0000 7fe266cf0640 1 -- start start 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2600addb0 0x7fe260141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600b1ed0 0x7fe260149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014d7c0 con 0x7fe2600cdd90 2024-09-13T17:13:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600a83d0 con 0x7fe2600addb0 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe266cf0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014cc80 con 0x7fe2600b1ed0 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.150+0000 7fe26528d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38854/0 (socket says 172.21.15.5:38854) 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 -- 172.21.15.5:0/1308544099 learned_addr learned my addr 172.21.15.5:0/1308544099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe25ffff640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600b1ed0 0x7fe260149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe264a8c640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2600addb0 0x7fe260141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 -- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600b1ed0 msgr2=0x7fe260149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600b1ed0 0x7fe260149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 -- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2600addb0 msgr2=0x7fe260141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2600addb0 0x7fe260141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 -- 172.21.15.5:0/1308544099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580094d0 con 0x7fe2600cdd90 2024-09-13T17:13:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe26528d640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe25802a290 tx=0x7fe2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258032440 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258030ba0 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26014cf20 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25803b400 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.151+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26014d4e0 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.152+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2600b2360 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.153+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe258039040 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.153+0000 7fe25d7fa640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 0x7fe24006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.153+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2580a9f40 con 0x7fe2600cdd90 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.153+0000 7fe264a8c640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 0x7fe24006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.154+0000 7fe264a8c640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 0x7fe24006d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2500017f0 tx=0x7fe250009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.157+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe258074e50 con 0x7fe2600cdd90 2024-09-13T17:13:31.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.329+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2600a81a0 con 0x7fe2600cdd90 2024-09-13T17:13:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.330+0000 7fe25d7fa640 1 -- 172.21.15.5:0/1308544099 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fe25804c090 con 0x7fe2600cdd90 2024-09-13T17:13:31.332 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:31.332 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 msgr2=0x7fe24006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 0x7fe24006d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2500017f0 tx=0x7fe250009040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 msgr2=0x7fe26014c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe25802a290 tx=0x7fe2580046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 shutdown_connections 2024-09-13T17:13:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe24006ac00 0x7fe24006d0c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600cdd90 0x7fe26014c740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2600b1ed0 0x7fe260149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 --2- 172.21.15.5:0/1308544099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2600addb0 0x7fe260141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 >> 172.21.15.5:0/1308544099 conn(0x7fe2600b0420 msgr2=0x7fe2600cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 shutdown_connections 2024-09-13T17:13:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.332+0000 7fe266cf0640 1 -- 172.21.15.5:0/1308544099 wait complete. 2024-09-13T17:13:31.346 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T17:13:31.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.445+0000 7efec90de640 1 Processor -- start 2024-09-13T17:13:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.445+0000 7efec90de640 1 -- start start 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec90de640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efec415fd80 0x7efec40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec90de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efec40d0e30 0x7efec4098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec90de640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40704a0 con 0x7efec4098f40 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec90de640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec406cc10 con 0x7efec40d0e30 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec90de640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40993b0 con 0x7efec415fd80 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efec40d0e30 0x7efec4098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.446+0000 7efec259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efec40d0e30 0x7efec4098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38856/0 (socket says 172.21.15.5:38856) 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec259c640 1 -- 172.21.15.5:0/215047163 learned_addr learned my addr 172.21.15.5:0/215047163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec2d9d640 1 --2- 172.21.15.5:0/215047163 >> v2:172.21.15.179:3300/0 conn(0x7efec415fd80 0x7efec40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec259c640 1 -- 172.21.15.5:0/215047163 >> v2:172.21.15.179:3300/0 conn(0x7efec415fd80 msgr2=0x7efec40cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec259c640 1 --2- 172.21.15.5:0/215047163 >> v2:172.21.15.179:3300/0 conn(0x7efec415fd80 0x7efec40cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec259c640 1 -- 172.21.15.5:0/215047163 >> v1:172.21.15.179:6789/0 conn(0x7efec4098f40 legacy=0x7efec40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.447+0000 7efec259c640 1 -- 172.21.15.5:0/215047163 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec406bd80 con 0x7efec40d0e30 2024-09-13T17:13:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec259c640 1 --2- 172.21.15.5:0/215047163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec40d0e30 0x7efec4098a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efec4071620 tx=0x7efeb802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfb94e067ea57fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec1d9b640 1 -- 172.21.15.5:0/215047163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8032440 con 0x7efec40d0e30 2024-09-13T17:13:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec1d9b640 1 -- 172.21.15.5:0/215047163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80325a0 con 0x7efec40d0e30 2024-09-13T17:13:31.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec1d9b640 1 -- 172.21.15.5:0/215047163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8032930 con 0x7efec40d0e30 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 -- 172.21.15.5:0/215047163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec40d0e30 msgr2=0x7efec4098a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 --2- 172.21.15.5:0/215047163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec40d0e30 0x7efec4098a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efec4071620 tx=0x7efeb802a210 comp rx=0 tx=0).stop 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 -- 172.21.15.5:0/215047163 shutdown_connections 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 --2- 172.21.15.5:0/215047163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec40d0e30 0x7efec4098a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 --2- 172.21.15.5:0/215047163 >> v2:172.21.15.179:3300/0 conn(0x7efec415fd80 0x7efec40cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 -- 172.21.15.5:0/215047163 >> 172.21.15.5:0/215047163 conn(0x7efec40d0310 msgr2=0x7efec40d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 -- 172.21.15.5:0/215047163 shutdown_connections 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.448+0000 7efec90de640 1 -- 172.21.15.5:0/215047163 wait complete. 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.450+0000 7efec90de640 1 Processor -- start 2024-09-13T17:13:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.450+0000 7efec90de640 1 -- start start 2024-09-13T17:13:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efec4098f40 0x7efec4145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec40d0e30 0x7efec41442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4144c10 con 0x7efec415fd80 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4144ef0 con 0x7efec40d0e30 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec41451d0 con 0x7efec4098f40 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38860/0 (socket says 172.21.15.5:38860) 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 -- 172.21.15.5:0/2330653115 learned_addr learned my addr 172.21.15.5:0/2330653115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec259c640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec40d0e30 0x7efec41442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec2d9d640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efec4098f40 0x7efec4145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 -- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efec4098f40 msgr2=0x7efec4145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efec4098f40 0x7efec4145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 -- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec40d0e30 msgr2=0x7efec41442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec40d0e30 0x7efec41442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 -- 172.21.15.5:0/2330653115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80094d0 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec359e640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c6b0 tx=0x7efebc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc003b70 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc003cf0 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc003ea0 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec41454b0 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.451+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec4144820 con 0x7efec415fd80 2024-09-13T17:13:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.453+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec41459d0 con 0x7efec415fd80 2024-09-13T17:13:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.453+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efebc005310 con 0x7efec415fd80 2024-09-13T17:13:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.453+0000 7efeab7fe640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 0x7efeb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.453+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efebc089250 con 0x7efec415fd80 2024-09-13T17:13:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.453+0000 7efec2d9d640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 0x7efeb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.454+0000 7efec2d9d640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 0x7efeb006d0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009b40 tx=0x7efeb4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.458+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efec41459d0 con 0x7efec415fd80 2024-09-13T17:13:31.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.628+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efec41459d0 con 0x7efec415fd80 2024-09-13T17:13:31.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.630+0000 7efeab7fe640 1 -- 172.21.15.5:0/2330653115 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7efec41459d0 con 0x7efec415fd80 2024-09-13T17:13:31.632 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:31.632 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:31.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 msgr2=0x7efeb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 0x7efeb006d0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009b40 tx=0x7efeb4009190 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 msgr2=0x7efec41465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c6b0 tx=0x7efebc00cb70 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 shutdown_connections 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeb006ac00 0x7efeb006d0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efec415fd80 0x7efec41465e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec40d0e30 0x7efec41442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 --2- 172.21.15.5:0/2330653115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efec4098f40 0x7efec4145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 >> 172.21.15.5:0/2330653115 conn(0x7efec40d0310 msgr2=0x7efec415ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 shutdown_connections 2024-09-13T17:13:31.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.632+0000 7efec90de640 1 -- 172.21.15.5:0/2330653115 wait complete. 2024-09-13T17:13:31.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T17:13:31.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T17:13:31.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T17:13:31.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T17:13:31.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T17:13:31.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T17:13:31.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T17:13:31.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T17:13:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.822+0000 7fb03c908640 1 Processor -- start 2024-09-13T17:13:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.822+0000 7fb03c908640 1 -- start start 2024-09-13T17:13:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.823+0000 7facec6a3640 1 Processor -- start 2024-09-13T17:13:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.823+0000 7facec6a3640 1 -- start start 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.823+0000 7f0341c96640 1 Processor -- start 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7f0341c96640 1 -- start start 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7facec6a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7face40ad670 0x7face40cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7facec6a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7face40cc470 0x7face4069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7facec6a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face41597c0 con 0x7face40cbb50 2024-09-13T17:13:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7facec6a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face406eb70 con 0x7face40cc470 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7facec6a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40cdb10 con 0x7face40ad670 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb03c908640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0380b0850 0x7fb0380ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb03c908640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb038164b20 0x7fb0380b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb03c908640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0380b1080 con 0x7fb038160930 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb03c908640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb038160d10 con 0x7fb038164b20 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb03c908640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380b12d0 con 0x7fb0380b0850 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7fb036d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb038164b20 0x7fb0380b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb038164b20 0x7fb0380b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38664/0 (socket says 172.21.15.5:38664) 2024-09-13T17:13:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 -- 172.21.15.5:0/1215035977 learned_addr learned my addr 172.21.15.5:0/1215035977 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7f7718dff640 1 Processor -- start 2024-09-13T17:13:31.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.823+0000 7f8b13a0d640 1 Processor -- start 2024-09-13T17:13:31.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.823+0000 7f8b13a0d640 1 -- start start 2024-09-13T17:13:31.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb035d9b640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0380b0850 0x7fb0380ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7face40cc470 0x7face4069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fa3d53f1640 1 Processor -- start 2024-09-13T17:13:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fa3d53f1640 1 -- start start 2024-09-13T17:13:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f0341c96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f033c0cb800 0x7f033c159290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40460/0 (socket says 172.21.15.5:40460) 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f0341c96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f033c0b2850 0x7f033c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7face40cc470 0x7face4069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38872/0 (socket says 172.21.15.5:38872) 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 -- 172.21.15.5:0/2186577717 learned_addr learned my addr 172.21.15.5:0/2186577717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 -- 172.21.15.5:0/2186577717 >> v2:172.21.15.179:3300/0 conn(0x7face40ad670 msgr2=0x7face40cbf30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 --2- 172.21.15.5:0/2186577717 >> v2:172.21.15.179:3300/0 conn(0x7face40ad670 0x7face40cbf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 -- 172.21.15.5:0/2186577717 >> v1:172.21.15.5:6789/0 conn(0x7face40cbb50 legacy=0x7face406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7faceac40640 1 -- 172.21.15.5:0/2186577717 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40cddf0 con 0x7face40cc470 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.824+0000 7f7718dff640 1 -- start start 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f0341c96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c1599a0 con 0x7f033c0cb800 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f0341c96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0b3c10 con 0x7f033c0b2850 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f0341c96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0b3090 con 0x7f033c098a00 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 -- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0380b0850 msgr2=0x7fb0380ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0380b0850 0x7fb0380ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 -- 172.21.15.5:0/1215035977 >> v1:172.21.15.5:6789/0 conn(0x7fb038160930 legacy=0x7fb038164410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7fb036d9d640 1 -- 172.21.15.5:0/1215035977 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380b15b0 con 0x7fb038164b20 2024-09-13T17:13:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:48956/0 (socket says 172.21.15.5:48956) 2024-09-13T17:13:31.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 -- 172.21.15.5:0/4265164960 learned_addr learned my addr 172.21.15.5:0/4265164960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b13a0d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 0x7f8b040e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b13a0d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b04053250 0x7f8b04053d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b13a0d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b04050620 con 0x7f8b040dfb50 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b13a0d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b040e0ef0 con 0x7f8b04053250 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b13a0d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b04053a60 con 0x7f8b040df770 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b117a9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 0x7f8b040e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7718dff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 0x7f7714160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7718dff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f771415aef0 0x7f77140707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7718dff640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771406ffe0 con 0x7f771406ced0 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b117a9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 0x7f8b040e09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38674/0 (socket says 172.21.15.5:38674) 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b117a9640 1 -- 172.21.15.5:0/1603244828 learned_addr learned my addr 172.21.15.5:0/1603244828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.825+0000 7f8b11faa640 1 --2- 172.21.15.5:0/1603244828 >> v2:172.21.15.5:3300/0 conn(0x7f8b04053250 0x7f8b04053d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f8b11faa640 1 -- 172.21.15.5:0/1603244828 >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 msgr2=0x7f8b040e09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f8b11faa640 1 --2- 172.21.15.5:0/1603244828 >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 0x7f8b040e09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f8b11faa640 1 -- 172.21.15.5:0/1603244828 >> v1:172.21.15.5:6789/0 conn(0x7f8b040dfb50 legacy=0x7f8b04050ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:13:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f8b11faa640 1 -- 172.21.15.5:0/1603244828 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04050010 con 0x7f8b04053250 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7718dff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7714161510 con 0x7f771415ab10 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7718dff640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77141617f0 con 0x7f771415aef0 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7712d9d640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f771406ced0 0x7f77140710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60208/0 (socket says 172.21.15.5:60208) 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7712d9d640 1 -- 172.21.15.5:0/3694995340 learned_addr learned my addr 172.21.15.5:0/3694995340 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f7711d9b640 1 --2- 172.21.15.5:0/3694995340 >> v2:172.21.15.179:3300/0 conn(0x7f771415aef0 0x7f77140707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 -- 172.21.15.5:0/4265164960 >> v2:172.21.15.5:3300/0 conn(0x7f033c0b2850 msgr2=0x7f033c0ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 --2- 172.21.15.5:0/4265164960 >> v2:172.21.15.5:3300/0 conn(0x7f033c0b2850 0x7f033c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 -- 172.21.15.5:0/4265164960 >> v1:172.21.15.5:6789/0 conn(0x7f033c0cb800 legacy=0x7f033c159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7faceac40640 1 --2- 172.21.15.5:0/2186577717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40cc470 0x7face4069e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7face40b54d0 tx=0x7facd402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a391f2d2faf7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7f7711d9b640 1 -- 172.21.15.5:0/3694995340 >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 msgr2=0x7f7714160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fb036d9d640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380b2090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb030009e50 tx=0x7fb03002a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b3bdf9282e624c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7face943d640 1 -- 172.21.15.5:0/2186577717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4032440 con 0x7face40cc470 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7face943d640 1 -- 172.21.15.5:0/2186577717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40325a0 con 0x7face40cc470 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7face943d640 1 -- 172.21.15.5:0/2186577717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4032930 con 0x7face40cc470 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3d01584f0 0x7fa3d00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3d006c480 0x7fa3d00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d006d3a0 con 0x7fa3d01584f0 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d00cc6b0 con 0x7fa3d006c480 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d53f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00afb50 con 0x7fa3d00b39c0 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7f771159a640 1 -- 172.21.15.5:0/3694995340 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916217099 0 0) 0x7f771406ffe0 con 0x7f771406ced0 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:48962/0 (socket says 172.21.15.5:48962) 2024-09-13T17:13:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/4097398828 learned_addr learned my addr 172.21.15.5:0/4097398828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fb03559a640 1 -- 172.21.15.5:0/1215035977 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030031600 con 0x7fb038164b20 2024-09-13T17:13:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fb03559a640 1 -- 172.21.15.5:0/1215035977 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03002d050 con 0x7fb038164b20 2024-09-13T17:13:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fb03559a640 1 -- 172.21.15.5:0/1215035977 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030031600 con 0x7fb038164b20 2024-09-13T17:13:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f033affd640 1 -- 172.21.15.5:0/4265164960 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0b3370 con 0x7f033c098a00 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.827+0000 7fa3d4bf0640 1 --2- 172.21.15.5:0/4097398828 >> v2:172.21.15.179:3300/0 conn(0x7fa3d006c480 0x7fa3d00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.826+0000 7f771259c640 1 --2- 172.21.15.5:0/3694995340 >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 0x7f7714160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f7711d9b640 1 --2- 172.21.15.5:0/3694995340 >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 0x7f7714160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f7711d9b640 1 -- 172.21.15.5:0/3694995340 >> v1:172.21.15.179:6789/0 conn(0x7f771406ced0 legacy=0x7f77140710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f7711d9b640 1 -- 172.21.15.5:0/3694995340 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714161ad0 con 0x7f771415aef0 2024-09-13T17:13:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f771259c640 1 --2- 172.21.15.5:0/3694995340 >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 0x7f7714160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f425c8c9640 1 Processor -- start 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f425c8c9640 1 -- start start 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/4097398828 >> v2:172.21.15.179:3300/0 conn(0x7fa3d006c480 msgr2=0x7fa3d00ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/4097398828 >> v2:172.21.15.179:3300/0 conn(0x7fa3d006c480 0x7fa3d00ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/4097398828 >> v2:172.21.15.5:3300/0 conn(0x7fa3d01584f0 msgr2=0x7fa3d00b08f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:13:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/4097398828 >> v2:172.21.15.5:3300/0 conn(0x7fa3d01584f0 0x7fa3d00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f8b11faa640 1 --2- 172.21.15.5:0/1603244828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b04053d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b04038240 tx=0x7f8afc02a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb71f9ad81e3122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 -- 172.21.15.5:0/2186577717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40cc470 msgr2=0x7face4069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 --2- 172.21.15.5:0/2186577717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40cc470 0x7face4069e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7face40b54d0 tx=0x7facd402a250 comp rx=0 tx=0).stop 2024-09-13T17:13:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/4097398828 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d006d5f0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f033affd640 1 --2- 172.21.15.5:0/4265164960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f032c009870 tx=0x7f032c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e4ebf16ceb1f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f5b2bfff640 1 Processor -- start 2024-09-13T17:13:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f5b2bfff640 1 -- start start 2024-09-13T17:13:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 -- 172.21.15.5:0/2186577717 shutdown_connections 2024-09-13T17:13:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7f8b03fff640 1 -- 172.21.15.5:0/1603244828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc02ae20 con 0x7f8b04053250 2024-09-13T17:13:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f033a7fc640 1 -- 172.21.15.5:0/4265164960 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c02ae90 con 0x7f033c098a00 2024-09-13T17:13:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f8b03fff640 1 -- 172.21.15.5:0/1603244828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc032440 con 0x7f8b04053250 2024-09-13T17:13:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f8b03fff640 1 -- 172.21.15.5:0/1603244828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0327d0 con 0x7f8b04053250 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f033a7fc640 1 -- 172.21.15.5:0/4265164960 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c02ae90 con 0x7f033c098a00 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 --2- 172.21.15.5:0/2186577717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40cc470 0x7face4069e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 --2- 172.21.15.5:0/2186577717 >> v2:172.21.15.179:3300/0 conn(0x7face40ad670 0x7face40cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7facec6a3640 1 -- 172.21.15.5:0/2186577717 >> 172.21.15.5:0/2186577717 conn(0x7face40b0f10 msgr2=0x7face40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7facec6a3640 1 -- 172.21.15.5:0/2186577717 shutdown_connections 2024-09-13T17:13:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7facec6a3640 1 -- 172.21.15.5:0/2186577717 wait complete. 2024-09-13T17:13:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f033a7fc640 1 -- 172.21.15.5:0/4265164960 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c032440 con 0x7f033c098a00 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fb03c908640 1 -- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 msgr2=0x7fb0380b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.828+0000 7fb03c908640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380b2090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb030009e50 tx=0x7fb03002a630 comp rx=0 tx=0).stop 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 -- 172.21.15.5:0/1215035977 shutdown_connections 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0380b0850 0x7fb0380ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 --2- 172.21.15.5:0/1215035977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380b2090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 -- 172.21.15.5:0/1215035977 >> 172.21.15.5:0/1215035977 conn(0x7fb0380b37c0 msgr2=0x7fb0380afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 -- 172.21.15.5:0/1215035977 shutdown_connections 2024-09-13T17:13:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fb03c908640 1 -- 172.21.15.5:0/1215035977 wait complete. 2024-09-13T17:13:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f7711d9b640 1 --2- 172.21.15.5:0/3694995340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415aef0 0x7f77140707c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77140ad7a0 tx=0x7f770002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9f1433835272a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/4097398828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00ae350 tx=0x7fa3c802ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48f95e52b395030 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f8b13a0d640 1 -- 172.21.15.5:0/1603244828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 msgr2=0x7f8b04053d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.829+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/1603244828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b04053d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b04038240 tx=0x7f8afc02a320 comp rx=0 tx=0).stop 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7fa3ceffd640 1 -- 172.21.15.5:0/4097398828 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c802f930 con 0x7fa3d00b39c0 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 -- 172.21.15.5:0/4265164960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 msgr2=0x7f033c0b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 --2- 172.21.15.5:0/4265164960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f032c009870 tx=0x7f032c02a180 comp rx=0 tx=0).stop 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f425c8c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 0x7f425815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f425c8c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 0x7f425806c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f425c8c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42580b0490 con 0x7f425815a440 2024-09-13T17:13:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f425c8c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580abb50 con 0x7f42580ab060 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f425c8c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42580b0cf0 con 0x7f42580ac4f0 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f8b13a0d640 1 -- 172.21.15.5:0/1603244828 shutdown_connections 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/1603244828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b04053d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/1603244828 >> v2:172.21.15.179:3300/0 conn(0x7f8b040df770 0x7f8b040e09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f8b13a0d640 1 -- 172.21.15.5:0/1603244828 >> 172.21.15.5:0/1603244828 conn(0x7f8b04055680 msgr2=0x7f8b04055a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f4255d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f425815a440 0x7f42580ab440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40476/0 (socket says 172.21.15.5:40476) 2024-09-13T17:13:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f4255d9b640 1 -- 172.21.15.5:0/1811824303 learned_addr learned my addr 172.21.15.5:0/1811824303 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 -- 172.21.15.5:0/4265164960 shutdown_connections 2024-09-13T17:13:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 --2- 172.21.15.5:0/4265164960 >> v2:172.21.15.5:3300/0 conn(0x7f033c0b2850 0x7f033c0ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 --2- 172.21.15.5:0/4265164960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c098a00 0x7f033c0b2310 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f032c009870 tx=0x7f032c02a180 comp rx=0 tx=0).stop 2024-09-13T17:13:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 -- 172.21.15.5:0/4265164960 >> 172.21.15.5:0/4265164960 conn(0x7f033c0717c0 msgr2=0x7f033c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f4256d9d640 1 --2- 172.21.15.5:0/1811824303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 0x7f425806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7fa3ceffd640 1 -- 172.21.15.5:0/4097398828 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8033070 con 0x7fa3d00b39c0 2024-09-13T17:13:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7fa3ceffd640 1 -- 172.21.15.5:0/4097398828 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c802fcd0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f8b13a0d640 1 -- 172.21.15.5:0/1603244828 shutdown_connections 2024-09-13T17:13:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b2c164970 0x7f5b2c0ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2bfff640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0acd40 con 0x7f5b2c071970 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2bfff640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c071d50 con 0x7f5b2c0abc90 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7facec6a3640 1 Processor -- start 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2bfff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0ac130 con 0x7f5b2c164970 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b2c071970 0x7f5b2c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40480/0 (socket says 172.21.15.5:40480) 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2affd640 1 -- 172.21.15.5:0/2170638320 learned_addr learned my addr 172.21.15.5:0/2170638320 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f5b2b7fe640 1 --2- 172.21.15.5:0/2170638320 >> v2:172.21.15.5:3300/0 conn(0x7f5b2c164970 0x7f5b2c0ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f425559a640 1 -- 172.21.15.5:0/1811824303 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762335483 0 0) 0x7f42580b0490 con 0x7f425815a440 2024-09-13T17:13:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f771159a640 1 -- 172.21.15.5:0/3694995340 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770002ae60 con 0x7f771415aef0 2024-09-13T17:13:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f771159a640 1 -- 172.21.15.5:0/3694995340 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7700032440 con 0x7f771415aef0 2024-09-13T17:13:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f771159a640 1 -- 172.21.15.5:0/3694995340 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000327d0 con 0x7f771415aef0 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f425659c640 1 --2- 172.21.15.5:0/1811824303 >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 0x7f425815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f425559a640 1 -- 172.21.15.5:0/1811824303 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4240003520 con 0x7f425815a440 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.830+0000 7f0341c96640 1 -- 172.21.15.5:0/4265164960 shutdown_connections 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 -- 172.21.15.5:0/4097398828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 msgr2=0x7fa3d00b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/4097398828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00ae350 tx=0x7fa3c802ebe0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 -- 172.21.15.5:0/4097398828 shutdown_connections 2024-09-13T17:13:31.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/4097398828 >> v2:172.21.15.179:3300/0 conn(0x7fa3d006c480 0x7fa3d00ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/4097398828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d00b39c0 0x7fa3d00b0e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/4097398828 >> v2:172.21.15.5:3300/0 conn(0x7fa3d01584f0 0x7fa3d00b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fa3d53f1640 1 -- 172.21.15.5:0/4097398828 >> 172.21.15.5:0/4097398828 conn(0x7fa3d0069e90 msgr2=0x7fa3d006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f5b29ffb640 1 -- 172.21.15.5:0/2170638320 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293653300 0 0) 0x7f5b2c0acd40 con 0x7f5b2c071970 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f5b29ffb640 1 -- 172.21.15.5:0/2170638320 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b14003520 con 0x7f5b2c071970 2024-09-13T17:13:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f0341c96640 1 -- 172.21.15.5:0/4265164960 wait complete. 2024-09-13T17:13:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f8b13a0d640 1 -- 172.21.15.5:0/1603244828 wait complete. 2024-09-13T17:13:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fb03c908640 1 Processor -- start 2024-09-13T17:13:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7fb03c908640 1 -- start start 2024-09-13T17:13:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f7718dff640 1 -- 172.21.15.5:0/3694995340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415aef0 msgr2=0x7f77140707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f7718dff640 1 --2- 172.21.15.5:0/3694995340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415aef0 0x7f77140707c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77140ad7a0 tx=0x7f770002a110 comp rx=0 tx=0).stop 2024-09-13T17:13:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f4256d9d640 1 -- 172.21.15.5:0/1811824303 >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 msgr2=0x7f425815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f4256d9d640 1 --2- 172.21.15.5:0/1811824303 >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 0x7f425815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f4256d9d640 1 -- 172.21.15.5:0/1811824303 >> v1:172.21.15.5:6789/0 conn(0x7f425815a440 legacy=0x7f42580ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f4256d9d640 1 -- 172.21.15.5:0/1811824303 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580abd30 con 0x7f42580ac4f0 2024-09-13T17:13:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f425659c640 1 --2- 172.21.15.5:0/1811824303 >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 0x7f425815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f5b2b7fe640 1 -- 172.21.15.5:0/2170638320 >> v1:172.21.15.179:6789/0 conn(0x7f5b2c0abc90 legacy=0x7f5b2c164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f5b2b7fe640 1 -- 172.21.15.5:0/2170638320 >> v1:172.21.15.5:6789/0 conn(0x7f5b2c071970 legacy=0x7f5b2c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7f5b2b7fe640 1 -- 172.21.15.5:0/2170638320 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0ac410 con 0x7f5b2c164970 2024-09-13T17:13:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7fa3d53f1640 1 -- 172.21.15.5:0/4097398828 shutdown_connections 2024-09-13T17:13:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f4256d9d640 1 --2- 172.21.15.5:0/1811824303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 0x7f425806c080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f424802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5046d928759bd826 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7fb03c908640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0380b0850 0x7fb038161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f425559a640 1 -- 172.21.15.5:0/1811824303 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248032440 con 0x7f42580ac4f0 2024-09-13T17:13:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7f8b13a0d640 1 Processor -- start 2024-09-13T17:13:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.831+0000 7facec6a3640 1 -- start start 2024-09-13T17:13:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7fb03c908640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 0x7fb038158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb03c908640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f425559a640 1 -- 172.21.15.5:0/1811824303 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42480325a0 con 0x7f42580ac4f0 2024-09-13T17:13:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f8b13a0d640 1 -- start start 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40ad670 0x7face4144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 0x7fb038158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 0x7fb038158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:48986/0 (socket says 172.21.15.5:48986) 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 -- 172.21.15.5:0/121918659 learned_addr learned my addr 172.21.15.5:0/121918659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380af9c0 con 0x7fb0380b0850 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380aee80 con 0x7fb038164b20 2024-09-13T17:13:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380af120 con 0x7fb038160930 2024-09-13T17:13:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f0341c96640 1 Processor -- start 2024-09-13T17:13:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 0x7face4158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb036d9d640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7fa3d53f1640 1 -- 172.21.15.5:0/4097398828 wait complete. 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb03659c640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0380b0850 0x7fb038161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 -- 172.21.15.5:0/3694995340 shutdown_connections 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 --2- 172.21.15.5:0/3694995340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415aef0 0x7f77140707c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 --2- 172.21.15.5:0/3694995340 >> v2:172.21.15.5:3300/0 conn(0x7f771415ab10 0x7f7714160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 -- 172.21.15.5:0/3694995340 >> 172.21.15.5:0/3694995340 conn(0x7f77140aff60 msgr2=0x7f77140b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40cc470 0x7face41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 -- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 msgr2=0x7fb0380ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb038164b20 0x7fb0380ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 -- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0380b0850 msgr2=0x7fb038161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 -- 172.21.15.5:0/3694995340 shutdown_connections 2024-09-13T17:13:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7face9c3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 0x7face4158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0380b0850 0x7fb038161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7face9c3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 0x7face4158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38692/0 (socket says 172.21.15.5:38692) 2024-09-13T17:13:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7face9c3e640 1 -- 172.21.15.5:0/2252637535 learned_addr learned my addr 172.21.15.5:0/2252637535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face41538a0 con 0x7face40ad670 2024-09-13T17:13:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4144b30 con 0x7face40cbb50 2024-09-13T17:13:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7fb035d9b640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009b30 con 0x7fb038160930 2024-09-13T17:13:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f425559a640 1 -- 172.21.15.5:0/1811824303 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248032950 con 0x7f42580ac4f0 2024-09-13T17:13:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 -- 172.21.15.5:0/1811824303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 msgr2=0x7f425806c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 --2- 172.21.15.5:0/1811824303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 0x7f425806c080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f424802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b0404eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b040df770 0x7f8b040365b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 -- 172.21.15.5:0/1811824303 shutdown_connections 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 --2- 172.21.15.5:0/1811824303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42580ac4f0 0x7f425806c080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 --2- 172.21.15.5:0/1811824303 >> v2:172.21.15.5:3300/0 conn(0x7f42580ab060 0x7f425815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 -- 172.21.15.5:0/1811824303 >> 172.21.15.5:0/1811824303 conn(0x7f42580b37c0 msgr2=0x7f42580afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b040dfb50 0x7f8b0404d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7fb03659c640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0380b0850 0x7fb038161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 -- 172.21.15.5:0/1811824303 shutdown_connections 2024-09-13T17:13:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04178880 con 0x7f8b04053250 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7fb035d9b640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 0x7fb038158840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d800 tx=0x7fb02400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04178570 con 0x7f8b040dfb50 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b13a0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04036af0 con 0x7f8b040df770 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b117a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b0404eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b117a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b0404eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38958/0 (socket says 172.21.15.5:38958) 2024-09-13T17:13:31.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4144520 con 0x7face40cc470 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7faceac40640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40cc470 0x7face41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.832+0000 7facea43f640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40ad670 0x7face4144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 -- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40cc470 msgr2=0x7face41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7face40cc470 0x7face41587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b117a9640 1 -- 172.21.15.5:0/3283982198 learned_addr learned my addr 172.21.15.5:0/3283982198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 -- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40ad670 msgr2=0x7face4144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40ad670 0x7face4144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40094d0 con 0x7face40cbb50 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7facea43f640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7face40ad670 0x7face4144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7face9c3e640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 0x7face4158260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7face000b3e0 tx=0x7face000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0014e90 con 0x7face40cbb50 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face001c440 con 0x7face40cbb50 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face001c810 con 0x7face40cbb50 2024-09-13T17:13:31.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400b6c0 con 0x7fb038160930 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40b43d0 con 0x7face40cbb50 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b117a9640 1 -- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b040df770 msgr2=0x7f8b040365b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f8b117a9640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b040df770 0x7f8b040365b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f8b117a9640 1 -- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b040dfb50 msgr2=0x7f8b0404d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f8b117a9640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b040dfb50 0x7f8b0404d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f8b117a9640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009400 con 0x7f8b04053250 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f0341c96640 1 -- start start 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f0341c96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c0b2850 0x7f033c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f0341c96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 0x7f033c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f0341c96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033c09c0f0 0x7f033c09c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f033affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 0x7f033c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f033affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 0x7f033c0ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38972/0 (socket says 172.21.15.5:38972) 2024-09-13T17:13:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40b46b0 con 0x7face40cbb50 2024-09-13T17:13:31.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f0341c96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1530f0 con 0x7f033c0cb800 2024-09-13T17:13:31.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f033affd640 1 -- 172.21.15.5:0/973193184 learned_addr learned my addr 172.21.15.5:0/973193184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0380af400 con 0x7fb038160930 2024-09-13T17:13:31.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb038161fc0 con 0x7fb038160930 2024-09-13T17:13:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f0341c96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c09ad70 con 0x7f033c09c0f0 2024-09-13T17:13:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f0341c96640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c09b050 con 0x7f033c0b2850 2024-09-13T17:13:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f033bfff640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033c09c0f0 0x7f033c09c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f8b117a9640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b0404eb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b08012c30 tx=0x7f8b08010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400b860 con 0x7fb038160930 2024-09-13T17:13:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7fa3d53f1640 1 Processor -- start 2024-09-13T17:13:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f5b2b7fe640 1 --2- 172.21.15.5:0/2170638320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c164970 0x7f5b2c0ad1d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8e44c24251e651 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.833+0000 7f7718dff640 1 -- 172.21.15.5:0/3694995340 wait complete. 2024-09-13T17:13:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.835+0000 7f7718dff640 1 Processor -- start 2024-09-13T17:13:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7fa3d53f1640 1 -- start start 2024-09-13T17:13:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033b7fe640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c0b2850 0x7f033c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d006c480 0x7fa3d0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033affd640 1 -- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c0b2850 msgr2=0x7f033c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033affd640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f033c0b2850 0x7f033c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7face406dce0 con 0x7face40cbb50 2024-09-13T17:13:31.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.834+0000 7f425c8c9640 1 -- 172.21.15.5:0/1811824303 wait complete. 2024-09-13T17:13:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033affd640 1 -- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033c09c0f0 msgr2=0x7f033c09c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033affd640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033c09c0f0 0x7f033c09c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f5b29ffb640 1 -- 172.21.15.5:0/2170638320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c032440 con 0x7f5b2c164970 2024-09-13T17:13:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f033affd640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0094d0 con 0x7f033c0cb800 2024-09-13T17:13:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400bc10 con 0x7fb038160930 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 0x7fa3d014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 0x7fa3d014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 0x7fa3d014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38978/0 (socket says 172.21.15.5:38978) 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d006c480 0x7fa3d0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d006c480 0x7fa3d0151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49002/0 (socket says 172.21.15.5:49002) 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d01584f0 0x7fa3d014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad100 con 0x7fa3d00b39c0 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad3e0 con 0x7fa3d01584f0 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3d53f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad6c0 con 0x7fa3d006c480 2024-09-13T17:13:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/663530160 learned_addr learned my addr 172.21.15.5:0/663530160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d006c480 msgr2=0x7fa3d0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d006c480 0x7fa3d0151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d01584f0 msgr2=0x7fa3d014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f7718dff640 1 -- start start 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 0x7f7714146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415ab10 0x7f771415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771415aef0 0x7f7714147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714147410 con 0x7f771415aef0 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771414cd80 con 0x7f771415ab10 2024-09-13T17:13:31.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7718dff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771414b5c0 con 0x7f771406ced0 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f771259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 0x7f7714146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f425c8c9640 1 Processor -- start 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08026680 con 0x7f8b04053250 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800c040 con 0x7f8b04053250 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08026a20 con 0x7f8b04053250 2024-09-13T17:13:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0404d5d0 con 0x7f8b04053250 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0404f4f0 con 0x7f8b04053250 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.836+0000 7f5b29ffb640 1 -- 172.21.15.5:0/2170638320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0325a0 con 0x7f5b2c164970 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f5b2bfff640 1 -- 172.21.15.5:0/2170638320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c164970 msgr2=0x7f5b2c0ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f5b2bfff640 1 --2- 172.21.15.5:0/2170638320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c164970 0x7f5b2c0ad1d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02a230 comp rx=0 tx=0).stop 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f5b2bfff640 1 -- 172.21.15.5:0/2170638320 shutdown_connections 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f5b2bfff640 1 --2- 172.21.15.5:0/2170638320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c164970 0x7f5b2c0ad1d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f5b2bfff640 1 -- 172.21.15.5:0/2170638320 >> 172.21.15.5:0/2170638320 conn(0x7f5b2c0aff60 msgr2=0x7f5b2c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f771259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 0x7f7714146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49012/0 (socket says 172.21.15.5:49012) 2024-09-13T17:13:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f771259c640 1 -- 172.21.15.5:0/216056378 learned_addr learned my addr 172.21.15.5:0/216056378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f7711d9b640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415ab10 0x7f771415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f5b2bfff640 1 -- 172.21.15.5:0/2170638320 shutdown_connections 2024-09-13T17:13:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7face0014020 con 0x7face40cbb50 2024-09-13T17:13:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facdaffd640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7facc806ad00 0x7facc806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7face0089070 con 0x7face40cbb50 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facdaffd640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7facc80741d0 0x7facc8076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facc8076ce0 con 0x7facc80741d0 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7face008b690 con 0x7face40cbb50 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7f425c8c9640 1 -- start start 2024-09-13T17:13:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7fa3d4bf0640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d01584f0 0x7fa3d014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7facea43f640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7facc806ad00 0x7facc806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f033affd640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 0x7f033c0ce890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f032c000c00 tx=0x7f032c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d01584f0 0x7fa3d014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7fa3cf7fe640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80079d0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7fa3d4bf0640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d01584f0 0x7fa3d014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f5b2bfff640 1 -- 172.21.15.5:0/2170638320 wait complete. 2024-09-13T17:13:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7fa3cf7fe640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 0x7fa3d014e200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802ec20 tx=0x7fa3c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c032440 con 0x7f033c0cb800 2024-09-13T17:13:31.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.837+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb014000fc0 con 0x7fb038160930 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f425c8c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 0x7f42580ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f425c8c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42580ac4f0 0x7f425809b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f425c8c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f425815a440 0x7f4258156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425c8c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4258154ec0 con 0x7f42580ac4f0 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425c8c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42580cd130 con 0x7f42580ab060 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425c8c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4258155110 con 0x7f425815a440 2024-09-13T17:13:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 0x7f42580ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f0341c96640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c09b330 con 0x7f033c0cb800 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f0341c96640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c09b8f0 con 0x7f033c0cb800 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c004020 con 0x7f033c0cb800 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f771259c640 1 -- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415ab10 msgr2=0x7f771415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f771259c640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771415ab10 0x7f771415a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f771259c640 1 -- 172.21.15.5:0/216056378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771415aef0 msgr2=0x7f7714147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f771259c640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771415aef0 0x7f7714147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.838+0000 7f771259c640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009400 con 0x7f771406ced0 2024-09-13T17:13:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f771259c640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 0x7f7714146ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f770c00ce30 tx=0x7f770c00a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 0x7f42580ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38734/0 (socket says 172.21.15.5:38734) 2024-09-13T17:13:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f425659c640 1 -- 172.21.15.5:0/4069538809 learned_addr learned my addr 172.21.15.5:0/4069538809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb02401e460 con 0x7fb038160930 2024-09-13T17:13:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b040df360 con 0x7f8b04053250 2024-09-13T17:13:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7faceac40640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7facc80741d0 0x7facc8076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f4255d9b640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42580ac4f0 0x7f425809b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c0043d0 con 0x7f033c0cb800 2024-09-13T17:13:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fb02effd640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb02006ad00 0x7fb02006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00f890 con 0x7f771406ced0 2024-09-13T17:13:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.839+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00f9f0 con 0x7f771406ced0 2024-09-13T17:13:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f5b2bfff640 1 Processor -- start 2024-09-13T17:13:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb024089bf0 con 0x7fb038160930 2024-09-13T17:13:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f5b2bfff640 1 -- start start 2024-09-13T17:13:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00fd60 con 0x7f771406ced0 2024-09-13T17:13:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 -- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f425815a440 msgr2=0x7f4258156400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f425815a440 0x7f4258156400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 -- 172.21.15.5:0/4069538809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42580ac4f0 msgr2=0x7f425809b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42580ac4f0 0x7f425809b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248009400 con 0x7f42580ab060 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f425659c640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 0x7f42580ccbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7f0 tx=0x7f424c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fb02effd640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7fb0200742c0 0x7fb020076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb020076dd0 con 0x7fb0200742c0 2024-09-13T17:13:31.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb024054ac0 con 0x7fb038160930 2024-09-13T17:13:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7facea43f640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7facc806ad00 0x7facc806d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facdc00f2e0 tx=0x7facdc003d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7faceac40640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7facc80741d0 0x7facc8076610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f0341c96640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f031c000fc0 con 0x7f033c0cb800 2024-09-13T17:13:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b08026b80 con 0x7f8b04053250 2024-09-13T17:13:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f8b01ffb640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8af006acd0 0x7f8af006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c007a30 con 0x7f42580ab060 2024-09-13T17:13:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c007b90 con 0x7f42580ab060 2024-09-13T17:13:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c071970 0x7f5b2c09ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b0809af80 con 0x7f8b04053250 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 0x7f5b2c098170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b2c0986b0 0x7f5b2c14bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c09b5f0 con 0x7f5b2c071970 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c09a9e0 con 0x7f5b2c0abc90 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2bfff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c09acc0 con 0x7f5b2c0986b0 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f8b01ffb640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f8af0074310 0x7f8af0076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8af0076e20 con 0x7f8af0074310 2024-09-13T17:13:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b0809d5a0 con 0x7f8b04053250 2024-09-13T17:13:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 0x7f5b2c098170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2a7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 0x7f5b2c098170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38748/0 (socket says 172.21.15.5:38748) 2024-09-13T17:13:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7f5b2a7fc640 1 -- 172.21.15.5:0/3428312519 learned_addr learned my addr 172.21.15.5:0/3428312519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7fb036d9d640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7fb0200742c0 0x7fb020076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80459d0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8045b30 con 0x7fa3d00b39c0 2024-09-13T17:13:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.841+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8004040 con 0x7fa3d00b39c0 2024-09-13T17:13:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2b7fe640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b2c0986b0 0x7f5b2c14bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7fb03659c640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb02006ad00 0x7fb02006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771415a900 con 0x7f771406ced0 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.840+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771414db30 con 0x7f771406ced0 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77140b2820 con 0x7f771406ced0 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f8b11faa640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f8af0074310 0x7f8af0076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581553f0 con 0x7f42580ab060 2024-09-13T17:13:31.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581559b0 con 0x7f42580ab060 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00ce40 con 0x7f42580ab060 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2a7fc640 1 -- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b2c0986b0 msgr2=0x7f5b2c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2a7fc640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b2c0986b0 0x7f5b2c14bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2a7fc640 1 -- 172.21.15.5:0/3428312519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c071970 msgr2=0x7f5b2c09ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== osd.1 v2:172.21.15.5:6800/1152985231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7facc8076ce0 con 0x7facc80741d0 2024-09-13T17:13:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2affd640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c071970 0x7f5b2c09ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f8b10fa8640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8af006acd0 0x7f8af006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2a7fc640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c071970 0x7f5b2c09ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2a7fc640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009400 con 0x7f5b2c0abc90 2024-09-13T17:13:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7f5b2affd640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b2c071970 0x7f5b2c09ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7fb036d9d640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7fb0200742c0 0x7fb020076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d0158a00 con 0x7fa3d00b39c0 2024-09-13T17:13:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.842+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d014d9f0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7fb03659c640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb02006ad00 0x7fb02006d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb028001750 tx=0x7fb028009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f032c039040 con 0x7f033c0cb800 2024-09-13T17:13:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f8b11faa640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f8af0074310 0x7f8af0076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42580b0a10 con 0x7f42580ab060 2024-09-13T17:13:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f8b10fa8640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8af006acd0 0x7f8af006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0684d0 tx=0x7f8b0c0691c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f0323fff640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f032806ad00 0x7f032806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f770c00b040 con 0x7f771406ced0 2024-09-13T17:13:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f032c0a9b20 con 0x7f033c0cb800 2024-09-13T17:13:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== osd.2 v2:172.21.15.5:6816/2157447166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb020076dd0 con 0x7fb0200742c0 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f5b2a7fc640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 0x7f5b2c098170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c3c0 tx=0x7f5b2000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200052d0 con 0x7f5b2c0abc90 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c09afa0 con 0x7f5b2c0abc90 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c14b770 con 0x7f5b2c0abc90 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20005450 con 0x7f5b2c0abc90 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.843+0000 7f0323fff640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f0328074150 0x7f0328076590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0328076c60 con 0x7f0328074150 2024-09-13T17:13:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== osd.6 v2:172.21.15.179:6808/3336213944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8af0076e20 con 0x7f8af0074310 2024-09-13T17:13:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f770affd640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f76fc06ad00 0x7f76fc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f033b7fe640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f032806ad00 0x7f032806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f770c08a590 con 0x7f771406ced0 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f770affd640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f76fc0741d0 0x7f76fc076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76fc076ce0 con 0x7f76fc0741d0 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770c08a940 con 0x7f771406ced0 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.844+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3d00cc930 con 0x7fa3d00b39c0 2024-09-13T17:13:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f7711d9b640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f76fc06ad00 0x7f76fc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20003830 con 0x7f5b2c0abc90 2024-09-13T17:13:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f7712d9d640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f76fc0741d0 0x7f76fc076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f424c0113f0 con 0x7f42580ab060 2024-09-13T17:13:31.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b0c000fc0 con 0x7f5b2c0abc90 2024-09-13T17:13:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.845+0000 7f033b7fe640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f032806ad00 0x7f032806d1c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0330007fd0 tx=0x7f0330009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f033bfff640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f0328074150 0x7f0328076590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f4246ffd640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f423806acd0 0x7f423806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f7711d9b640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f76fc06ad00 0x7f76fc06d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7700034000 tx=0x7f770002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f033bfff640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f0328074150 0x7f0328076590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f032c0749f0 con 0x7f033c0cb800 2024-09-13T17:13:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3c80041a0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f7712d9d640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f76fc0741d0 0x7f76fc076610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f4255d9b640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f423806acd0 0x7f423806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f424c089cf0 con 0x7f42580ab060 2024-09-13T17:13:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b20003990 con 0x7f5b2c0abc90 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3ccff9640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa3bc06acd0 0x7fa3bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3c80b2280 con 0x7fa3d00b39c0 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3cffff640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa3bc06acd0 0x7fa3bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3ccff9640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7fa3bc0741a0 0x7fa3bc0765e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3bc076cb0 con 0x7fa3bc0741a0 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3c80b49f0 con 0x7fa3d00b39c0 2024-09-13T17:13:31.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== osd.0 v2:172.21.15.5:6817/2570471928 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0328076c60 con 0x7f0328074150 2024-09-13T17:13:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== osd.4 v2:172.21.15.179:6800/1714873642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f76fc076ce0 con 0x7f76fc0741d0 2024-09-13T17:13:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f5b13fff640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b1806ac30 0x7f5b1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b20088be0 con 0x7f5b2c0abc90 2024-09-13T17:13:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f5b2affd640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b1806ac30 0x7f5b1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f5b13fff640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f5b18074100 0x7f5b18076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b18076c10 con 0x7f5b18074100 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b2008d220 con 0x7f5b2c0abc90 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.846+0000 7f4246ffd640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7f42380741a0 0x7f42380765e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4238076cb0 con 0x7f42380741a0 2024-09-13T17:13:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f424c08a0a0 con 0x7f42580ab060 2024-09-13T17:13:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f5b2b7fe640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f5b18074100 0x7f5b18076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7fa3cffff640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa3bc06acd0 0x7fa3bc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098e0 tx=0x7fa3c4009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7fa3d4bf0640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7fa3bc0741a0 0x7fa3bc0765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.847+0000 7f4255d9b640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f423806acd0 0x7f423806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4258154430 tx=0x7f4250009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.848+0000 7f5b2affd640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b1806ac30 0x7f5b1806d0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005c00 tx=0x7f5b24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.849+0000 7f4256d9d640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7f42380741a0 0x7f42380765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.849+0000 7f5b2b7fe640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f5b18074100 0x7f5b18076540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.849+0000 7fa3d4bf0640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7fa3bc0741a0 0x7fa3bc0765e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.849+0000 7f4256d9d640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7f42380741a0 0x7f42380765e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.850+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== osd.7 v2:172.21.15.179:6816/1963856475 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5b18076c10 con 0x7f5b18074100 2024-09-13T17:13:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.850+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== osd.3 v2:172.21.15.5:6808/3301555269 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3bc076cb0 con 0x7fa3bc0741a0 2024-09-13T17:13:31.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.851+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== osd.5 v2:172.21.15.179:6820/2660134855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4238076cb0 con 0x7f42380741a0 2024-09-13T17:13:31.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.871+0000 7facec6a3640 1 -- 172.21.15.5:0/2252637535 --> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7face406e2d0 con 0x7facc80741d0 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.872+0000 7facdaffd640 1 -- 172.21.15.5:0/2252637535 <== osd.1 v2:172.21.15.5:6800/1152985231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facd4032990 con 0x7facc80741d0 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.872+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7facc80741d0 msgr2=0x7facc8076610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.872+0000 7facd8ff9640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7facc80741d0 0x7facc8076610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7facc806ad00 msgr2=0x7facc806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7facc806ad00 0x7facc806d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facdc00f2e0 tx=0x7facdc003d90 comp rx=0 tx=0).stop 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 msgr2=0x7face4158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 --2- 172.21.15.5:0/2252637535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face40cbb50 0x7face4158260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7face000b3e0 tx=0x7face000b8a0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7faceac40640 1 -- 172.21.15.5:0/2252637535 reap_dead start 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 shutdown_connections 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 >> 172.21.15.5:0/2252637535 conn(0x7face40b0f10 msgr2=0x7face40cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 shutdown_connections 2024-09-13T17:13:31.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7facd8ff9640 1 -- 172.21.15.5:0/2252637535 wait complete. 2024-09-13T17:13:31.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.873+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 --> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b040502b0 con 0x7f8af0074310 2024-09-13T17:13:31.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.874+0000 7f8b01ffb640 1 -- 172.21.15.5:0/3283982198 <== osd.6 v2:172.21.15.179:6808/3336213944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8af0076e20 con 0x7f8af0074310 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f8af0074310 msgr2=0x7f8af0076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f8af0074310 0x7f8af0076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8af006acd0 msgr2=0x7f8af006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8af006acd0 0x7f8af006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0684d0 tx=0x7f8b0c0691c0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 msgr2=0x7f8b0404eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b13a0d640 1 --2- 172.21.15.5:0/3283982198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b04053250 0x7f8b0404eb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b08012c30 tx=0x7f8b08010670 comp rx=0 tx=0).stop 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7f8b11faa640 1 -- 172.21.15.5:0/3283982198 reap_dead start 2024-09-13T17:13:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.875+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb014002cb0 con 0x7fb0200742c0 2024-09-13T17:13:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.876+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 shutdown_connections 2024-09-13T17:13:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.876+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 >> 172.21.15.5:0/3283982198 conn(0x7f8b04055680 msgr2=0x7f8b040e34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.876+0000 7fb02effd640 1 -- 172.21.15.5:0/121918659 <== osd.2 v2:172.21.15.5:6816/2157447166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb014002cb0 con 0x7fb0200742c0 2024-09-13T17:13:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.876+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 shutdown_connections 2024-09-13T17:13:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.876+0000 7f8b13a0d640 1 -- 172.21.15.5:0/3283982198 wait complete. 2024-09-13T17:13:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 --> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77140b2820 con 0x7f76fc0741d0 2024-09-13T17:13:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7f0341c96640 1 -- 172.21.15.5:0/973193184 --> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f031c002cb0 con 0x7f0328074150 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7fb0200742c0 msgr2=0x7fb020076700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7fb0200742c0 0x7fb020076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb02006ad00 msgr2=0x7fb02006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb02006ad00 0x7fb02006d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb028001750 tx=0x7fb028009040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 msgr2=0x7fb038158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.877+0000 7fb03c908640 1 --2- 172.21.15.5:0/121918659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb038160930 0x7fb038158840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d800 tx=0x7fb02400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7fb036d9d640 1 -- 172.21.15.5:0/121918659 reap_dead start 2024-09-13T17:13:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7f0323fff640 1 -- 172.21.15.5:0/973193184 <== osd.0 v2:172.21.15.5:6817/2570471928 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f031c002cb0 con 0x7f0328074150 2024-09-13T17:13:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 shutdown_connections 2024-09-13T17:13:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 >> 172.21.15.5:0/121918659 conn(0x7fb0380b37c0 msgr2=0x7fb0380ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7f770affd640 1 -- 172.21.15.5:0/216056378 <== osd.4 v2:172.21.15.179:6800/1714873642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77140b2820 con 0x7f76fc0741d0 2024-09-13T17:13:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 shutdown_connections 2024-09-13T17:13:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7fb03c908640 1 -- 172.21.15.5:0/121918659 wait complete. 2024-09-13T17:13:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f0328074150 msgr2=0x7f0328076590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7f0321ffb640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f0328074150 0x7f0328076590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.878+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 --> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42580b0730 con 0x7f42380741a0 2024-09-13T17:13:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f032806ad00 msgr2=0x7f032806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f032806ad00 0x7f032806d1c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0330007fd0 tx=0x7f0330009040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f76fc0741d0 msgr2=0x7f76fc076610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f76fc0741d0 0x7f76fc076610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 msgr2=0x7f033c0ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 --2- 172.21.15.5:0/973193184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0cb800 0x7f033c0ce890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f032c000c00 tx=0x7f032c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f033bfff640 1 -- 172.21.15.5:0/973193184 reap_dead start 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f76fc06ad00 msgr2=0x7f76fc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f76fc06ad00 0x7f76fc06d1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7700034000 tx=0x7f770002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 msgr2=0x7f7714146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 --2- 172.21.15.5:0/216056378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771406ced0 0x7f7714146ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f770c00ce30 tx=0x7f770c00a650 comp rx=0 tx=0).stop 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7712d9d640 1 -- 172.21.15.5:0/216056378 reap_dead start 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 shutdown_connections 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 >> 172.21.15.5:0/216056378 conn(0x7f77140aff60 msgr2=0x7f7714069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 shutdown_connections 2024-09-13T17:13:31.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f7718dff640 1 -- 172.21.15.5:0/216056378 wait complete. 2024-09-13T17:13:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f4246ffd640 1 -- 172.21.15.5:0/4069538809 <== osd.5 v2:172.21.15.179:6820/2660134855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f424802bde0 con 0x7f42380741a0 2024-09-13T17:13:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 shutdown_connections 2024-09-13T17:13:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.879+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 >> 172.21.15.5:0/973193184 conn(0x7f033c0717c0 msgr2=0x7f033c0ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 --> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b0c002cb0 con 0x7f5b18074100 2024-09-13T17:13:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 shutdown_connections 2024-09-13T17:13:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f0321ffb640 1 -- 172.21.15.5:0/973193184 wait complete. 2024-09-13T17:13:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7f42380741a0 msgr2=0x7f42380765e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 --> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3d006dbb0 con 0x7fa3bc0741a0 2024-09-13T17:13:31.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f425c8c9640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7f42380741a0 0x7f42380765e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.880+0000 7f5b13fff640 1 -- 172.21.15.5:0/3428312519 <== osd.7 v2:172.21.15.179:6816/1963856475 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b0c002cb0 con 0x7f5b18074100 2024-09-13T17:13:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7fa3ccff9640 1 -- 172.21.15.5:0/663530160 <== osd.3 v2:172.21.15.5:6808/3301555269 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3c0009730 con 0x7fa3bc0741a0 2024-09-13T17:13:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f5b18074100 msgr2=0x7f5b18076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f5b18074100 0x7f5b18076540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f423806acd0 msgr2=0x7f423806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f423806acd0 0x7f423806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4258154430 tx=0x7f4250009040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 msgr2=0x7f42580ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 --2- 172.21.15.5:0/4069538809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42580ab060 0x7f42580ccbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7f0 tx=0x7f424c00cbf0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f4256d9d640 1 -- 172.21.15.5:0/4069538809 reap_dead start 2024-09-13T17:13:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 shutdown_connections 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b1806ac30 msgr2=0x7f5b1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b1806ac30 0x7f5b1806d0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005c00 tx=0x7f5b24009040 comp rx=0 tx=0).stop 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 msgr2=0x7f5b2c098170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 --2- 172.21.15.5:0/3428312519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b2c0abc90 0x7f5b2c098170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c3c0 tx=0x7f5b2000c880 comp rx=0 tx=0).stop 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2b7fe640 1 -- 172.21.15.5:0/3428312519 reap_dead start 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 >> 172.21.15.5:0/4069538809 conn(0x7f42580b37c0 msgr2=0x7f42580ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 shutdown_connections 2024-09-13T17:13:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f425c8c9640 1 -- 172.21.15.5:0/4069538809 wait complete. 2024-09-13T17:13:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 shutdown_connections 2024-09-13T17:13:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.881+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 >> 172.21.15.5:0/3428312519 conn(0x7f5b2c0aff60 msgr2=0x7f5b2c0aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 shutdown_connections 2024-09-13T17:13:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7f5b2bfff640 1 -- 172.21.15.5:0/3428312519 wait complete. 2024-09-13T17:13:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7fa3bc0741a0 msgr2=0x7fa3bc0765e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7fa3bc0741a0 0x7fa3bc0765e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa3bc06acd0 msgr2=0x7fa3bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa3bc06acd0 0x7fa3bc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40098e0 tx=0x7fa3c4009060 comp rx=0 tx=0).stop 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 msgr2=0x7fa3d014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 --2- 172.21.15.5:0/663530160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3d00b39c0 0x7fa3d014e200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802ec20 tx=0x7fa3c8004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d4bf0640 1 -- 172.21.15.5:0/663530160 reap_dead start 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 shutdown_connections 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.882+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 >> 172.21.15.5:0/663530160 conn(0x7fa3d0069e90 msgr2=0x7fa3d00ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.883+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 shutdown_connections 2024-09-13T17:13:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:31.883+0000 7fa3d53f1640 1 -- 172.21.15.5:0/663530160 wait complete. 2024-09-13T17:13:31.945 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:31.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:13:31.946 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:31.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:13:31.947 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:31.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:13:31.948 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:31.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:13:31.949 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:31.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:13:31.950 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:31.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:13:31.951 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:31.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:13:31.952 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:31.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:13:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.158+0000 7fa14ffff640 1 Processor -- start 2024-09-13T17:13:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.158+0000 7fa14ffff640 1 -- start start 2024-09-13T17:13:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7fa14ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1500cea90 0x7fa1500ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7fa14ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa15006b7e0 0x7fa15006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7fa14ffff640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500cf410 con 0x7fa15015fa50 2024-09-13T17:13:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7fa14ffff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15006b3c0 con 0x7fa15006b7e0 2024-09-13T17:13:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7fa14ffff640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15006b050 con 0x7fa1500cea90 2024-09-13T17:13:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7fa14f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa15006b7e0 0x7fa15006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7fa14f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa15006b7e0 0x7fa15006bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39006/0 (socket says 172.21.15.5:39006) 2024-09-13T17:13:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7fa14f7fe640 1 -- 172.21.15.5:0/1656209222 learned_addr learned my addr 172.21.15.5:0/1656209222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7fa14e7fc640 1 --2- 172.21.15.5:0/1656209222 >> v2:172.21.15.179:3300/0 conn(0x7fa1500cea90 0x7fa1500ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7f5daa1db640 1 Processor -- start 2024-09-13T17:13:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.159+0000 7f5daa1db640 1 -- start start 2024-09-13T17:13:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7f6e627a0640 1 Processor -- start 2024-09-13T17:13:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7f4641210640 1 Processor -- start 2024-09-13T17:13:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7f5daa1db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5da4070620 0x7f5da415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7f5daa1db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 0x7f5da40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.160+0000 7f5daa1db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da40b1b00 0x7f5da40b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5daa1db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40b24b0 con 0x7f5da4070620 2024-09-13T17:13:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5daa1db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4071be0 con 0x7f5da40af370 2024-09-13T17:13:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5daa1db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40ae780 con 0x7f5da40b1b00 2024-09-13T17:13:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f6e627a0640 1 -- start start 2024-09-13T17:13:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f4641210640 1 -- start start 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fa14f7fe640 1 -- 172.21.15.5:0/1656209222 >> v2:172.21.15.179:3300/0 conn(0x7fa1500cea90 msgr2=0x7fa1500ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fa14f7fe640 1 --2- 172.21.15.5:0/1656209222 >> v2:172.21.15.179:3300/0 conn(0x7fa1500cea90 0x7fa1500ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fa14f7fe640 1 -- 172.21.15.5:0/1656209222 >> v1:172.21.15.179:6789/0 conn(0x7fa15015fa50 legacy=0x7fa1500d2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fa14f7fe640 1 -- 172.21.15.5:0/1656209222 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500d0c10 con 0x7fa15006b7e0 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5da2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 0x7f5da40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5da2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 0x7f5da40b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38754/0 (socket says 172.21.15.5:38754) 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5da2ffd640 1 -- 172.21.15.5:0/3786115479 learned_addr learned my addr 172.21.15.5:0/3786115479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5da37fe640 1 --2- 172.21.15.5:0/3786115479 >> v2:172.21.15.5:3300/0 conn(0x7f5da4070620 0x7f5da415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f5da3fff640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da40b1b00 0x7f5da40b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fb8e61ed640 1 Processor -- start 2024-09-13T17:13:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f236359e640 1 Processor -- start 2024-09-13T17:13:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7f236359e640 1 -- start start 2024-09-13T17:13:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f5da37fe640 1 -- 172.21.15.5:0/3786115479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da40b1b00 msgr2=0x7f5da40b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f5da37fe640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da40b1b00 0x7f5da40b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f5da37fe640 1 -- 172.21.15.5:0/3786115479 >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 msgr2=0x7f5da40b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f5da37fe640 1 --2- 172.21.15.5:0/3786115479 >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 0x7f5da40b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f5da37fe640 1 -- 172.21.15.5:0/3786115479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40aea40 con 0x7f5da4070620 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e627a0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e5c06b1f0 0x7f6e5c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e627a0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0d1db0 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e627a0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0d1a70 con 0x7f6e5c0b6010 2024-09-13T17:13:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e627a0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b6440 con 0x7f6e5c06b1f0 2024-09-13T17:13:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.161+0000 7fb8e61ed640 1 -- start start 2024-09-13T17:13:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7fa14f7fe640 1 --2- 172.21.15.5:0/1656209222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa15006b7e0 0x7fa15006bc70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa15008b080 tx=0x7fa14002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40f28840e20ac2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f4641210640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f4641210640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 0x7f463400a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f4641210640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340076d0 con 0x7f46340ea8f0 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e60f9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6e5c0b1a00 0x7f6e5c0b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40492/0 (socket says 172.21.15.5:40492) 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e61f9f640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6e5c0b6010 0x7f6e5c06b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60228/0 (socket says 172.21.15.5:60228) 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f4641210640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4634006820 con 0x7f4634033b50 2024-09-13T17:13:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f4641210640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634034310 con 0x7f4634051f60 2024-09-13T17:13:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f6e61f9f640 1 -- 172.21.15.5:0/1003298257 learned_addr learned my addr 172.21.15.5:0/1003298257 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f463b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7fa14dffb640 1 -- 172.21.15.5:0/1656209222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140032440 con 0x7fa15006b7e0 2024-09-13T17:13:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7fa14dffb640 1 -- 172.21.15.5:0/1656209222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1400325a0 con 0x7fa15006b7e0 2024-09-13T17:13:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7fa14dffb640 1 -- 172.21.15.5:0/1656209222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140032930 con 0x7fa15006b7e0 2024-09-13T17:13:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f463b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49040/0 (socket says 172.21.15.5:49040) 2024-09-13T17:13:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.162+0000 7f463b7fe640 1 -- 172.21.15.5:0/69872280 learned_addr learned my addr 172.21.15.5:0/69872280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f4640a0f640 1 --2- 172.21.15.5:0/69872280 >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 0x7f463400a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8e61ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 0x7fb8e006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8e61ed640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb8e006db10 0x7fb8e006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8e61ed640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e006b820 con 0x7fb8e01496a0 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8e61ed640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00cc420 con 0x7fb8e006db10 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8e61ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00b2c50 con 0x7fb8e006aea0 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8df7fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb8e01496a0 0x7fb8e00b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60238/0 (socket says 172.21.15.5:60238) 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fb8df7fe640 1 -- 172.21.15.5:0/46640833 learned_addr learned my addr 172.21.15.5:0/46640833 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f5da37fe640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da4070620 0x7f5da415bb90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da4070b60 tx=0x7f5d8c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d884b2c27df9b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f236359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 0x7f23640ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f236359e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f236415a570 0x7f23640cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f236359e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640cd000 con 0x7f23640cff50 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f236359e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640cdad0 con 0x7f236415a190 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f236359e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640b41a0 con 0x7f236415a570 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fa14ffff640 1 -- 172.21.15.5:0/1656209222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa15006b7e0 msgr2=0x7fa15006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7fa14ffff640 1 --2- 172.21.15.5:0/1656209222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa15006b7e0 0x7fa15006bc70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa15008b080 tx=0x7fa14002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f2361d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f236415a570 0x7f23640cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f2361d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f236415a570 0x7f23640cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38778/0 (socket says 172.21.15.5:38778) 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f2361d9b640 1 -- 172.21.15.5:0/2955637070 learned_addr learned my addr 172.21.15.5:0/2955637070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 -- 172.21.15.5:0/1656209222 shutdown_connections 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 --2- 172.21.15.5:0/1656209222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa15006b7e0 0x7fa15006bc70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 --2- 172.21.15.5:0/1656209222 >> v2:172.21.15.179:3300/0 conn(0x7fa1500cea90 0x7fa1500ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 -- 172.21.15.5:0/1656209222 >> 172.21.15.5:0/1656209222 conn(0x7fa150089f90 msgr2=0x7fa1500d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f463b7fe640 1 -- 172.21.15.5:0/69872280 >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 msgr2=0x7f463400a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f463b7fe640 1 --2- 172.21.15.5:0/69872280 >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 0x7f463400a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f463b7fe640 1 -- 172.21.15.5:0/69872280 >> v1:172.21.15.5:6789/0 conn(0x7f46340ea8f0 legacy=0x7f4634051850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f463b7fe640 1 -- 172.21.15.5:0/69872280 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634006ac0 con 0x7f4634051f60 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.163+0000 7f4640a0f640 1 --2- 172.21.15.5:0/69872280 >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 0x7f463400a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 -- 172.21.15.5:0/1656209222 shutdown_connections 2024-09-13T17:13:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8deffd640 1 --2- 172.21.15.5:0/46640833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 0x7fb8e006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e6179e640 1 --2- 172.21.15.5:0/1003298257 >> v2:172.21.15.5:3300/0 conn(0x7f6e5c06b1f0 0x7f6e5c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294849416 0 0) 0x7f6e5c0d1a70 con 0x7f6e5c0b6010 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e48003520 con 0x7f6e5c0b6010 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410496987 0 0) 0x7f6e5c0d1db0 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e5c0d1a70 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f236259c640 1 --2- 172.21.15.5:0/2955637070 >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 0x7f23640ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8de7fc640 1 -- 172.21.15.5:0/46640833 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396197067 0 0) 0x7fb8e006b820 con 0x7fb8e01496a0 2024-09-13T17:13:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8de7fc640 1 -- 172.21.15.5:0/46640833 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d0003520 con 0x7fb8e01496a0 2024-09-13T17:13:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f5da27fc640 1 -- 172.21.15.5:0/3786115479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c02add0 con 0x7f5da4070620 2024-09-13T17:13:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f5da27fc640 1 -- 172.21.15.5:0/3786115479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c032440 con 0x7f5da4070620 2024-09-13T17:13:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374851849 0 0) 0x7f6e5c0d1a70 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 >> v2:172.21.15.5:3300/0 conn(0x7f6e5c06b1f0 msgr2=0x7f6e5c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8deffd640 1 -- 172.21.15.5:0/46640833 >> v2:172.21.15.179:3300/0 conn(0x7fb8e006db10 msgr2=0x7fb8e006dfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:13:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8deffd640 1 --2- 172.21.15.5:0/46640833 >> v2:172.21.15.179:3300/0 conn(0x7fb8e006db10 0x7fb8e006dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8deffd640 1 -- 172.21.15.5:0/46640833 >> v1:172.21.15.179:6789/0 conn(0x7fb8e01496a0 legacy=0x7fb8e00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f463b7fe640 1 --2- 172.21.15.5:0/69872280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4628009870 tx=0x7f462802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdbe458cb69a1194 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f2361d9b640 1 -- 172.21.15.5:0/2955637070 >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 msgr2=0x7f23640ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f2361d9b640 1 --2- 172.21.15.5:0/2955637070 >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 0x7f23640ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 --2- 172.21.15.5:0/1003298257 >> v2:172.21.15.5:3300/0 conn(0x7f6e5c06b1f0 0x7f6e5c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 >> v1:172.21.15.179:6789/0 conn(0x7f6e5c0b6010 legacy=0x7f6e5c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0d22e0 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f6e580015f0 con 0x7f6e5c0b1a00 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 >> v1:172.21.15.5:6789/0 conn(0x7f6e5c0b1a00 legacy=0x7f6e5c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e48004bb0 0x7f6e48004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 0x7f6e48003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48004120 0x7f6e4800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b6440 con 0x7f6e48003760 2024-09-13T17:13:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c020 con 0x7f6e48004bb0 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c1e0 con 0x7f6e48004120 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e6179e640 1 --2- 172.21.15.5:0/1003298257 >> v2:172.21.15.5:3300/0 conn(0x7f6e5c06b1f0 0x7f6e5c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7f5da27fc640 1 -- 172.21.15.5:0/3786115479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0327d0 con 0x7f5da4070620 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f2361d9b640 1 -- 172.21.15.5:0/2955637070 >> v1:172.21.15.179:6789/0 conn(0x7f23640cff50 legacy=0x7f23640d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f2361d9b640 1 -- 172.21.15.5:0/2955637070 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640cd230 con 0x7f236415a570 2024-09-13T17:13:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f236259c640 1 --2- 172.21.15.5:0/2955637070 >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 0x7f23640ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fa14ffff640 1 -- 172.21.15.5:0/1656209222 wait complete. 2024-09-13T17:13:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e6179e640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e48004bb0 0x7f6e48004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 0x7f6e48003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.164+0000 7fb8deffd640 1 -- 172.21.15.5:0/46640833 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e006ca70 con 0x7fb8e006aea0 2024-09-13T17:13:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f463affd640 1 -- 172.21.15.5:0/69872280 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628032440 con 0x7f4634051f60 2024-09-13T17:13:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f463affd640 1 -- 172.21.15.5:0/69872280 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280325a0 con 0x7f4634051f60 2024-09-13T17:13:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f463affd640 1 -- 172.21.15.5:0/69872280 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628032930 con 0x7f4634051f60 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48004120 msgr2=0x7f6e4800ba00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48004120 0x7f6e4800ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e48004bb0 msgr2=0x7f6e48004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e48004bb0 0x7f6e48004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1003298257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0d22e0 con 0x7f6e48003760 2024-09-13T17:13:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fb8deffd640 1 --2- 172.21.15.5:0/46640833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 0x7fb8e006b2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097a0 tx=0x7fb8cc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76fab442aee58a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f5daa1db640 1 -- 172.21.15.5:0/3786115479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da4070620 msgr2=0x7f5da415bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.165+0000 7f5daa1db640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da4070620 0x7f5da415bb90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da4070b60 tx=0x7f5d8c02a080 comp rx=0 tx=0).stop 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f5daa1db640 1 -- 172.21.15.5:0/3786115479 shutdown_connections 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f5daa1db640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da40b1b00 0x7f5da40b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f6e61f9f640 1 -- 172.21.15.5:0/1003298257 reap_dead start 2024-09-13T17:13:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f5daa1db640 1 --2- 172.21.15.5:0/3786115479 >> v2:172.21.15.179:3300/0 conn(0x7f5da40af370 0x7f5da40b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f5daa1db640 1 --2- 172.21.15.5:0/3786115479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da4070620 0x7f5da415bb90 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da4070b60 tx=0x7f5d8c02a080 comp rx=0 tx=0).stop 2024-09-13T17:13:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f5daa1db640 1 -- 172.21.15.5:0/3786115479 >> 172.21.15.5:0/3786115479 conn(0x7f5da40b37c0 msgr2=0x7f5da40714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f2361d9b640 1 --2- 172.21.15.5:0/2955637070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f236415a570 0x7f23640cdff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2364071930 tx=0x7f235402a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2993cd09a6a5cf31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fb8de7fc640 1 -- 172.21.15.5:0/46640833 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc032440 con 0x7fb8e006aea0 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fb8de7fc640 1 -- 172.21.15.5:0/46640833 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0325a0 con 0x7fb8e006aea0 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fb8de7fc640 1 -- 172.21.15.5:0/46640833 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc032930 con 0x7fb8e006aea0 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 -- 172.21.15.5:0/69872280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 msgr2=0x7f4634038860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 --2- 172.21.15.5:0/69872280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4628009870 tx=0x7f462802a250 comp rx=0 tx=0).stop 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f236159a640 1 -- 172.21.15.5:0/2955637070 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354032440 con 0x7f236415a570 2024-09-13T17:13:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f236159a640 1 -- 172.21.15.5:0/2955637070 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540325a0 con 0x7f236415a570 2024-09-13T17:13:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fa14ffff640 1 Processor -- start 2024-09-13T17:13:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 -- 172.21.15.5:0/69872280 shutdown_connections 2024-09-13T17:13:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7fa14ffff640 1 -- start start 2024-09-13T17:13:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 --2- 172.21.15.5:0/69872280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634038860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 --2- 172.21.15.5:0/69872280 >> v2:172.21.15.179:3300/0 conn(0x7f4634033b50 0x7f463400a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 -- 172.21.15.5:0/69872280 >> 172.21.15.5:0/69872280 conn(0x7f463401e190 msgr2=0x7f4634037d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 -- 172.21.15.5:0/69872280 shutdown_connections 2024-09-13T17:13:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.166+0000 7f4641210640 1 -- 172.21.15.5:0/69872280 wait complete. 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f5daa1db640 1 -- 172.21.15.5:0/3786115479 shutdown_connections 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f5daa1db640 1 -- 172.21.15.5:0/3786115479 wait complete. 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 -- 172.21.15.5:0/46640833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 msgr2=0x7fb8e006b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 --2- 172.21.15.5:0/46640833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 0x7fb8e006b2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097a0 tx=0x7fb8cc02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236159a640 1 -- 172.21.15.5:0/2955637070 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354032930 con 0x7f236415a570 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 -- 172.21.15.5:0/2955637070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f236415a570 msgr2=0x7f23640cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 --2- 172.21.15.5:0/2955637070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f236415a570 0x7f23640cdff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2364071930 tx=0x7f235402a280 comp rx=0 tx=0).stop 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 -- 172.21.15.5:0/46640833 shutdown_connections 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 --2- 172.21.15.5:0/46640833 >> v2:172.21.15.179:3300/0 conn(0x7fb8e006db10 0x7fb8e006dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 --2- 172.21.15.5:0/46640833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e006aea0 0x7fb8e006b2e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 -- 172.21.15.5:0/46640833 >> 172.21.15.5:0/46640833 conn(0x7fb8e0070830 msgr2=0x7fb8e0070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 -- 172.21.15.5:0/46640833 shutdown_connections 2024-09-13T17:13:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7fb8e61ed640 1 -- 172.21.15.5:0/46640833 wait complete. 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 -- 172.21.15.5:0/2955637070 shutdown_connections 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 --2- 172.21.15.5:0/2955637070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f236415a570 0x7f23640cdff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 --2- 172.21.15.5:0/2955637070 >> v2:172.21.15.5:3300/0 conn(0x7f236415a190 0x7f23640ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.167+0000 7f236359e640 1 -- 172.21.15.5:0/2955637070 >> 172.21.15.5:0/2955637070 conn(0x7f23640b1e00 msgr2=0x7f23640b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7f236359e640 1 -- 172.21.15.5:0/2955637070 shutdown_connections 2024-09-13T17:13:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7f236359e640 1 -- 172.21.15.5:0/2955637070 wait complete. 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15006b7e0 0x7fa1500c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa15015fa50 0x7fa15015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14ffff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150156550 con 0x7fa1500cea90 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7f4641210640 1 Processor -- start 2024-09-13T17:13:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39048/0 (socket says 172.21.15.5:39048) 2024-09-13T17:13:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14e7fc640 1 -- 172.21.15.5:0/3221304435 learned_addr learned my addr 172.21.15.5:0/3221304435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.168+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501596f0 con 0x7fa15006b7e0 2024-09-13T17:13:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501593a0 con 0x7fa15015fa50 2024-09-13T17:13:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14f7fe640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa15015fa50 0x7fa15015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7f4641210640 1 -- start start 2024-09-13T17:13:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7f5daa1db640 1 Processor -- start 2024-09-13T17:13:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fb8e61ed640 1 Processor -- start 2024-09-13T17:13:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7f5daa1db640 1 -- start start 2024-09-13T17:13:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14e7fc640 1 -- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa15015fa50 msgr2=0x7fa15015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fb8e61ed640 1 -- start start 2024-09-13T17:13:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f90c5de2640 1 Processor -- start 2024-09-13T17:13:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f236359e640 1 Processor -- start 2024-09-13T17:13:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fcf127ed640 1 Processor -- start 2024-09-13T17:13:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f90c5de2640 1 -- start start 2024-09-13T17:13:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fcf127ed640 1 -- start start 2024-09-13T17:13:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f236359e640 1 -- start start 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f4641210640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 0x7f6e48003be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e58007fb0 tx=0x7f6e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e1cbc9729072ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007270 con 0x7f6e48003760 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5802d070 con 0x7f6e48003760 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f6e53fff640 1 -- 172.21.15.5:0/1003298257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58007610 con 0x7f6e48003760 2024-09-13T17:13:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14e7fc640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa15015fa50 0x7fa15015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14e7fc640 1 -- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15006b7e0 msgr2=0x7fa1500c66c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14e7fc640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15006b7e0 0x7fa1500c66c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.169+0000 7fa14e7fc640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094d0 con 0x7fa1500cea90 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fa14e7fc640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d800 tx=0x7fa14400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f4641210640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634035590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7f4641210640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400b6c0 con 0x7fa1500cea90 2024-09-13T17:13:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.170+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400b820 con 0x7fa1500cea90 2024-09-13T17:13:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400bbb0 con 0x7fa1500cea90 2024-09-13T17:13:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f463bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f463bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38806/0 (socket says 172.21.15.5:38806) 2024-09-13T17:13:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7fb8e61ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e006aea0 0x7fb8e0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f4640a0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f90c5de2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90c0155f60 0x7f90c0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f4640a0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39060/0 (socket says 172.21.15.5:39060) 2024-09-13T17:13:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f236359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 0x7f23641e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f463b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634035590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f463b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634035590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49078/0 (socket says 172.21.15.5:49078) 2024-09-13T17:13:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f463bfff640 1 -- 172.21.15.5:0/1903306714 learned_addr learned my addr 172.21.15.5:0/1903306714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f90c5de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463404df00 con 0x7f46340ea8f0 2024-09-13T17:13:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f236359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 0x7f23641507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463404ec80 con 0x7f4634033b50 2024-09-13T17:13:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340de340 con 0x7f4634051f60 2024-09-13T17:13:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 -- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 msgr2=0x7f6e48003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 0x7f23641e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 0x7f23641e2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38836/0 (socket says 172.21.15.5:38836) 2024-09-13T17:13:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 0x7f6e48003be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e58007fb0 tx=0x7f6e480057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf127ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf0c098a00 0x7fcf0c0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236259c640 1 -- 172.21.15.5:0/1029179008 learned_addr learned my addr 172.21.15.5:0/1029179008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 -- 172.21.15.5:0/1003298257 shutdown_connections 2024-09-13T17:13:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1003298257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e48003760 0x7f6e48003be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 -- 172.21.15.5:0/1003298257 >> 172.21.15.5:0/1003298257 conn(0x7f6e5c0cef80 msgr2=0x7f6e5c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf127ed640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf0c0b4270 0x7fcf0c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90bffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90bffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49090/0 (socket says 172.21.15.5:49090) 2024-09-13T17:13:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f2361d9b640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 0x7f23641507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236359e640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 0x7f23640c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8e61ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640c5fa0 con 0x7f236415a570 2024-09-13T17:13:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 -- 172.21.15.5:0/1003298257 shutdown_connections 2024-09-13T17:13:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf127ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0b46c0 con 0x7fcf0c159220 2024-09-13T17:13:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf0bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf0c159220 0x7fcf0c0b15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40510/0 (socket says 172.21.15.5:40510) 2024-09-13T17:13:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf127ed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b21a0 con 0x7fcf0c098a00 2024-09-13T17:13:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf0bfff640 1 -- 172.21.15.5:0/1517584368 learned_addr learned my addr 172.21.15.5:0/1517584368 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b2480 con 0x7fcf0c0b4270 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/1517584368 >> v2:172.21.15.179:3300/0 conn(0x7fcf0c0b4270 0x7fcf0c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641e1ac0 con 0x7f23640cff50 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23641e1da0 con 0x7f236415a190 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90c5de2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c0070a70 con 0x7f90c0071530 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90c5de2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00b26b0 con 0x7f90c0155f60 2024-09-13T17:13:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90c5de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0070180 con 0x7f90c0159340 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f90bffff640 1 -- 172.21.15.5:0/1641238079 learned_addr learned my addr 172.21.15.5:0/1641238079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8e61ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e01496a0 0x7fb8e0144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4640a0f640 1 -- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 msgr2=0x7f4634035590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4640a0f640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634035590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4640a0f640 1 -- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 msgr2=0x7f46340dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4640a0f640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f4640a0f640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280094d0 con 0x7f46340ea8f0 2024-09-13T17:13:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f2362d9d640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 0x7f23640c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fcf0b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf0c098a00 0x7fcf0c0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fcf10d8a640 1 -- 172.21.15.5:0/1517584368 >> v2:172.21.15.5:3300/0 conn(0x7fcf0c098a00 msgr2=0x7fcf0c0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 0x7f5da414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 0x7f5da414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 0x7f5da414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 0x7f5da414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38814/0 (socket says 172.21.15.5:38814) 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5da37fe640 1 -- 172.21.15.5:0/2336806466 learned_addr learned my addr 172.21.15.5:0/2336806466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5da2ffd640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 0x7f5da414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f463bfff640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da415a610 0x7f5da4095270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4146a10 con 0x7f5da40b1b00 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da414ba70 con 0x7f5da40af370 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4149420 con 0x7f5da415a610 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.171+0000 7f5da3fff640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da415a610 0x7f5da4095270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f5da2ffd640 1 -- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da415a610 msgr2=0x7f5da4095270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f5da2ffd640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da415a610 0x7f5da4095270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f5da2ffd640 1 -- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 msgr2=0x7f5da414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f5da2ffd640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 0x7f5da414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f5da2ffd640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009400 con 0x7f5da40b1b00 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2361d9b640 1 -- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 msgr2=0x7f23641e2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2361d9b640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 0x7f23641e2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2361d9b640 1 -- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 msgr2=0x7f23640c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/1517584368 >> v2:172.21.15.5:3300/0 conn(0x7fcf0c098a00 0x7fcf0c0b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fcf10d8a640 1 -- 172.21.15.5:0/1517584368 >> v1:172.21.15.5:6789/0 conn(0x7fcf0c159220 legacy=0x7fcf0c0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fcf10d8a640 1 -- 172.21.15.5:0/1517584368 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c159600 con 0x7fcf0c0b4270 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218107725 0 0) 0x7f90c0070a70 con 0x7f90c0071530 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a8003520 con 0x7f90c0071530 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e006aea0 0x7fb8e0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38850/0 (socket says 172.21.15.5:38850) 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8deffd640 1 -- 172.21.15.5:0/1816689228 learned_addr learned my addr 172.21.15.5:0/1816689228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e015b100 con 0x7fb8e006aea0 2024-09-13T17:13:32.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7fb8dffff640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e01496a0 0x7fb8e0144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e015adb0 con 0x7fb8e006db10 2024-09-13T17:13:32.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01f69f0 con 0x7fb8e01496a0 2024-09-13T17:13:32.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500c6c00 con 0x7fa1500cea90 2024-09-13T17:13:32.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2361d9b640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 0x7f23640c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8deffd640 1 -- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e01496a0 msgr2=0x7fb8e0144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2361d9b640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c009a70 con 0x7f236415a190 2024-09-13T17:13:32.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f2362d9d640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 0x7f23640c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:32.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8deffd640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e01496a0 0x7fb8e0144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500c7af0 con 0x7fa1500cea90 2024-09-13T17:13:32.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8deffd640 1 -- 172.21.15.5:0/1816689228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e006aea0 msgr2=0x7fb8e0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f5da2ffd640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 0x7f5da414b530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00e7d0 tx=0x7f5d9c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f90c4de0640 1 --2- 172.21.15.5:0/1641238079 >> v2:172.21.15.179:3300/0 conn(0x7f90c0155f60 0x7f90c0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.172+0000 7f6e627a0640 1 -- 172.21.15.5:0/1003298257 wait complete. 2024-09-13T17:13:32.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7f4640a0f640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f463c074e30 tx=0x7f463c0678a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8deffd640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e006aea0 0x7fb8e0148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.173+0000 7fb8deffd640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009400 con 0x7fb8e006db10 2024-09-13T17:13:32.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7fb8deffd640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0098c0 tx=0x7fb8cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720605261 0 0) 0x7f90a8003520 con 0x7f90c0071530 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f90bffff640 1 -- 172.21.15.5:0/1641238079 >> v2:172.21.15.179:3300/0 conn(0x7f90c0155f60 msgr2=0x7f90c0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f90bffff640 1 --2- 172.21.15.5:0/1641238079 >> v2:172.21.15.179:3300/0 conn(0x7f90c0155f60 0x7f90c0070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f90bffff640 1 -- 172.21.15.5:0/1641238079 >> v1:172.21.15.5:6789/0 conn(0x7f90c0071530 legacy=0x7f90c00ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00eee0 con 0x7f5da40b1b00 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4149700 con 0x7f5da40b1b00 2024-09-13T17:13:32.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da4146630 con 0x7f5da40b1b00 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c08e070 con 0x7f46340ea8f0 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0670b0 con 0x7f46340ea8f0 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c072040 con 0x7f46340ea8f0 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463404e1a0 con 0x7f46340ea8f0 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463404e760 con 0x7f46340ea8f0 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f6e627a0640 1 Processor -- start 2024-09-13T17:13:32.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f6e627a0640 1 -- start start 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7f90bffff640 1 -- 172.21.15.5:0/1641238079 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0159780 con 0x7f90c0159340 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.174+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/1517584368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c0b2910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c070fc0 tx=0x7fcf0402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e584cb97cc951ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fcf0affd640 1 -- 172.21.15.5:0/1517584368 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04007740 con 0x7fcf0c0b4270 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fcf0affd640 1 -- 172.21.15.5:0/1517584368 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0402d050 con 0x7fcf0c0b4270 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fcf0affd640 1 -- 172.21.15.5:0/1517584368 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04007ac0 con 0x7fcf0c0b4270 2024-09-13T17:13:32.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500ceed0 con 0x7fa1500cea90 2024-09-13T17:13:32.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7f2361d9b640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 0x7f23641507b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2354031000 tx=0x7f23540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7f6e627a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 0x7f6e5c15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354032440 con 0x7f236415a190 2024-09-13T17:13:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f90bffff640 1 --2- 172.21.15.5:0/1641238079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009870 tx=0x7f90b402a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a90aab6b52d5acd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c005990 con 0x7f5da40b1b00 2024-09-13T17:13:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354030b80 con 0x7f236415a190 2024-09-13T17:13:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23540094d0 con 0x7f236415a190 2024-09-13T17:13:32.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc030b00 con 0x7fb8e006db10 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc030c60 con 0x7fb8e006db10 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.175+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc030b00 con 0x7fb8e006db10 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235403c400 con 0x7f236415a190 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e627a0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 0x7f6e5c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e627a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5c1f5b00 0x7f6e5c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e627a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ca830 con 0x7f6e5c1f5b00 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e627a0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0cab10 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e627a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0cadf0 con 0x7f6e48003760 2024-09-13T17:13:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e01f6cd0 con 0x7fb8e006db10 2024-09-13T17:13:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23641e2360 con 0x7f236415a190 2024-09-13T17:13:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e6179e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 0x7f6e5c15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e6179e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 0x7f6e5c15fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49118/0 (socket says 172.21.15.5:49118) 2024-09-13T17:13:32.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e6179e640 1 -- 172.21.15.5:0/1905740201 learned_addr learned my addr 172.21.15.5:0/1905740201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8001670 con 0x7f90c0159340 2024-09-13T17:13:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b402ac80 con 0x7f90c0159340 2024-09-13T17:13:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 0x7f6e5c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f90bf7fe640 1 -- 172.21.15.5:0/1641238079 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8001670 con 0x7f90c0159340 2024-09-13T17:13:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.176+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e01f66e0 con 0x7fb8e006db10 2024-09-13T17:13:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f463c093420 con 0x7f46340ea8f0 2024-09-13T17:13:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463400dec0 con 0x7f46340ea8f0 2024-09-13T17:13:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7f4638ff9640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 0x7f462006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640ccac0 con 0x7f236415a190 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 msgr2=0x7f6e5c15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 0x7f6e5c15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1905740201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5c1f5b00 msgr2=0x7f6e5c15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5c1f5b00 0x7f6e5c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f6e60f9d640 1 -- 172.21.15.5:0/1905740201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0cb0d0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7f6e60f9d640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 0x7f6e5c0c9fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e5802f000 tx=0x7f6e5802c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f90c5de2640 1 -- 172.21.15.5:0/1641238079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 msgr2=0x7f90c00b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.177+0000 7f90c5de2640 1 --2- 172.21.15.5:0/1641238079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009870 tx=0x7f90b402a1f0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c005d00 con 0x7f5da40b1b00 2024-09-13T17:13:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 msgr2=0x7fcf0c0b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 --2- 172.21.15.5:0/1517584368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c0b2910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c070fc0 tx=0x7fcf0402a5f0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 shutdown_connections 2024-09-13T17:13:32.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 --2- 172.21.15.5:0/1517584368 >> v2:172.21.15.5:3300/0 conn(0x7fcf0c098a00 0x7fcf0c0b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580076c0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 --2- 172.21.15.5:0/1517584368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c0b2910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 >> 172.21.15.5:0/1517584368 conn(0x7fcf0c071570 msgr2=0x7fcf0c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f463c102980 con 0x7f46340ea8f0 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa14400bd10 con 0x7fa1500cea90 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7fa1377fe640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 0x7fa13c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa144089b40 con 0x7fa1500cea90 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.178+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8cc039050 con 0x7fb8e006db10 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fb8cbfff640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 0x7fb8c406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8cc0a9bd0 con 0x7fb8e006db10 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fb8df7fe640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 0x7fb8c406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7fb8df7fe640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 0x7fb8c406d180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40011e0 tx=0x7fb8d4007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88005250 con 0x7f5da40b1b00 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f235403c560 con 0x7f236415a190 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f2352ffd640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 0x7f234406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2354032e40 con 0x7f236415a190 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f236259c640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 0x7f234406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0cb3b0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e580047e0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 shutdown_connections 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7fcf127ed640 1 -- 172.21.15.5:0/1517584368 wait complete. 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 -- 172.21.15.5:0/1641238079 shutdown_connections 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 --2- 172.21.15.5:0/1641238079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c00b1e60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 --2- 172.21.15.5:0/1641238079 >> v2:172.21.15.179:3300/0 conn(0x7f90c0155f60 0x7f90c0070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 -- 172.21.15.5:0/1641238079 >> 172.21.15.5:0/1641238079 conn(0x7f90c00aff60 msgr2=0x7f90c00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 -- 172.21.15.5:0/1641238079 shutdown_connections 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.180+0000 7f90c5de2640 1 -- 172.21.15.5:0/1641238079 wait complete. 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7f463bfff640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 0x7f462006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d9c00c940 con 0x7f5da40b1b00 2024-09-13T17:13:32.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7fa14effd640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 0x7fa13c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.179+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58004b50 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c1f5f90 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7f5d9bfff640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 0x7f5d8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.181+0000 7f236259c640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 0x7f234406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23640cff20 tx=0x7f235c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7f463bfff640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 0x7f462006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f46340e1d50 tx=0x7f4630009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7fcf127ed640 1 Processor -- start 2024-09-13T17:13:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7f90c5de2640 1 Processor -- start 2024-09-13T17:13:32.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7f90c5de2640 1 -- start start 2024-09-13T17:13:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e0149a80 con 0x7fb8e006db10 2024-09-13T17:13:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7f5da37fe640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 0x7f5d8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d9c0896b0 con 0x7f5da40b1b00 2024-09-13T17:13:32.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.182+0000 7fcf127ed640 1 -- start start 2024-09-13T17:13:32.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fa14effd640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 0x7fa13c06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa14800abb0 tx=0x7fa148009250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 0x7fcf0c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 0x7fcf0c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c150460 con 0x7fcf0c098a00 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c149bf0 con 0x7fcf0c0b4270 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf127ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c14fb30 con 0x7fcf0c159220 2024-09-13T17:13:32.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7f90c5de2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7fcf0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 0x7fcf0c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 0x7fcf0c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c5de2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c0155f60 0x7f90c0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 0x7fcf0c14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39114/0 (socket says 172.21.15.5:39114) 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf0bfff640 1 -- 172.21.15.5:0/3404149325 learned_addr learned my addr 172.21.15.5:0/3404149325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf0b7fe640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39116/0 (socket says 172.21.15.5:39116) 2024-09-13T17:13:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f5da37fe640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 0x7f5d8406d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02a0c0 tx=0x7f5d8c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 -- 172.21.15.5:0/4183127345 learned_addr learned my addr 172.21.15.5:0/4183127345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90bffff640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c0155f60 0x7f90c0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 -- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 msgr2=0x7fcf0c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c14e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 -- 172.21.15.5:0/3404149325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 msgr2=0x7fcf0c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 0x7fcf0c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 -- 172.21.15.5:0/3404149325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009a70 con 0x7fcf0c159220 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00c9570 con 0x7f90c0071530 2024-09-13T17:13:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0153e10 con 0x7f90c0155f60 2024-09-13T17:13:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00c89f0 con 0x7f90c0159340 2024-09-13T17:13:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c55e1640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.183+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c0cc8c0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 -- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 msgr2=0x7f90c0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7fcf10d8a640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 0x7fcf0c14e850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf04031000 tx=0x7fcf04004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 -- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c0155f60 msgr2=0x7f90c0157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c0155f60 0x7f90c0157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.184+0000 7f90c4de0640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40094d0 con 0x7f90c0071530 2024-09-13T17:13:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7fcf0b7fe640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7f90c4de0640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90b000efc0 tx=0x7f90b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e5802f030 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7f6e51ffb640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 0x7f6e4006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e580a9670 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.185+0000 7f6e6179e640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 0x7f6e4006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04031b40 con 0x7fcf0c159220 2024-09-13T17:13:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04031ca0 con 0x7fcf0c159220 2024-09-13T17:13:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040456a0 con 0x7fcf0c159220 2024-09-13T17:13:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c14fe10 con 0x7fcf0c159220 2024-09-13T17:13:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f23540753e0 con 0x7f236415a190 2024-09-13T17:13:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c1434e0 con 0x7fcf0c159220 2024-09-13T17:13:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.186+0000 7f6e6179e640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 0x7f6e4006d140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c15f830 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.187+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c143670 con 0x7fcf0c159220 2024-09-13T17:13:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.188+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f463c0cd850 con 0x7f46340ea8f0 2024-09-13T17:13:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.188+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf04045800 con 0x7fcf0c159220 2024-09-13T17:13:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.188+0000 7fcf08ff9640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 0x7fcef806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.189+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf040ab300 con 0x7fcf0c159220 2024-09-13T17:13:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.189+0000 7fcf0bfff640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 0x7fcef806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.189+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8cc074b80 con 0x7fb8e006db10 2024-09-13T17:13:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.189+0000 7fcf0bfff640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 0x7fcef806d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcefc004e40 tx=0x7fcefc007f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.194+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6e580745b0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.194+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcf040761e0 con 0x7fcf0c159220 2024-09-13T17:13:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.196+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa144054a20 con 0x7fa1500cea90 2024-09-13T17:13:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.205+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5d9c054640 con 0x7f5da40b1b00 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.205+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0014480 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.205+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b000f040 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.206+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0014800 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.206+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c00c8cd0 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.206+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c00c9290 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.208+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c00672a0 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.208+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90b0014960 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.209+0000 7f90bd7fa640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 0x7f90ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.209+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90b008a350 con 0x7f90c0071530 2024-09-13T17:13:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.214+0000 7f90bffff640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 0x7f90ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.219+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90b0055360 con 0x7f90c0071530 2024-09-13T17:13:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.219+0000 7f90bffff640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 0x7f90ac06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90b4034000 tx=0x7f90b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:32.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.584+0000 7f236359e640 1 -- 172.21.15.5:0/1029179008 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f23640737c0 con 0x7f236415a190 2024-09-13T17:13:32.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.585+0000 7f2352ffd640 1 -- 172.21.15.5:0/1029179008 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2354078a00 con 0x7f236415a190 2024-09-13T17:13:32.587 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:32.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.585+0000 7fb8e61ed640 1 -- 172.21.15.5:0/1816689228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb8e00b31c0 con 0x7fb8e006db10 2024-09-13T17:13:32.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.586+0000 7fb8cbfff640 1 -- 172.21.15.5:0/1816689228 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8cc037070 con 0x7fb8e006db10 2024-09-13T17:13:32.588 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-13T17:13:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f4641210640 1 -- 172.21.15.5:0/1903306714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f463403f3e0 con 0x7f46340ea8f0 2024-09-13T17:13:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 msgr2=0x7f234406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 0x7f234406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23640cff20 tx=0x7f235c00b040 comp rx=0 tx=0).stop 2024-09-13T17:13:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 msgr2=0x7f23641507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 0x7f23641507b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2354031000 tx=0x7f23540046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f4638ff9640 1 -- 172.21.15.5:0/1903306714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f463c0d0e70 con 0x7f46340ea8f0 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 shutdown_connections 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.588+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f234406acd0 0x7f234406d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f236415a570 0x7f23640c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f236415a190 0x7f23641507b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 --2- 172.21.15.5:0/1029179008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23640cff50 0x7f23641e2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 >> 172.21.15.5:0/1029179008 conn(0x7f23640b1e00 msgr2=0x7f23640730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.592 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:32.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 shutdown_connections 2024-09-13T17:13:32.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 msgr2=0x7fb8c406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7f2350ff9640 1 -- 172.21.15.5:0/1029179008 wait complete. 2024-09-13T17:13:32.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 0x7fb8c406d180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40011e0 tx=0x7fb8d4007d30 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 msgr2=0x7fb8e01f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0098c0 tx=0x7fb8cc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 shutdown_connections 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.589+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8e01496a0 0x7fb8e0144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8e006db10 0x7fb8e01f61a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb8c406acc0 0x7fb8c406d180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 --2- 172.21.15.5:0/1816689228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e006aea0 0x7fb8e0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 >> 172.21.15.5:0/1816689228 conn(0x7fb8e0070830 msgr2=0x7fb8e00b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 shutdown_connections 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.590+0000 7fb8c9ffb640 1 -- 172.21.15.5:0/1816689228 wait complete. 2024-09-13T17:13:32.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa150069e90 con 0x7fa1500cea90 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 msgr2=0x7f462006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 0x7f462006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f46340e1d50 tx=0x7f4630009040 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 msgr2=0x7f4634053f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f463c074e30 tx=0x7f463c0678a0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 shutdown_connections 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f462006acd0 0x7f462006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46340ea8f0 0x7f4634053f70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4634051f60 0x7f4634035590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 --2- 172.21.15.5:0/1903306714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4634033b50 0x7f46340dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 >> 172.21.15.5:0/1903306714 conn(0x7f463401e190 msgr2=0x7f4634050100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 shutdown_connections 2024-09-13T17:13:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.592+0000 7f46267fc640 1 -- 172.21.15.5:0/1903306714 wait complete. 2024-09-13T17:13:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.593+0000 7fa1377fe640 1 -- 172.21.15.5:0/3221304435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa144089e60 con 0x7fa1500cea90 2024-09-13T17:13:32.598 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-13T17:13:32.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.594+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e5c06c8d0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.595+0000 7f6e51ffb640 1 -- 172.21.15.5:0/1905740201 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e580745b0 con 0x7f6e5c0cb8d0 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.597+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 msgr2=0x7fa13c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.597+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 0x7fa13c06d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa14800abb0 tx=0x7fa148009250 comp rx=0 tx=0).stop 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.597+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 msgr2=0x7fa15009f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d800 tx=0x7fa14400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 shutdown_connections 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa15015fa50 0x7fa15015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa13c06ac00 0x7fa13c06d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.601 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-13T17:13:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcf0c06ac70 con 0x7fcf0c159220 2024-09-13T17:13:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1500cea90 0x7fa15009f5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 --2- 172.21.15.5:0/3221304435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15006b7e0 0x7fa1500c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 >> 172.21.15.5:0/3221304435 conn(0x7fa150089f90 msgr2=0x7fa1500b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 shutdown_connections 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fa14ffff640 1 -- 172.21.15.5:0/3221304435 wait complete. 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.598+0000 7fcf08ff9640 1 -- 172.21.15.5:0/3404149325 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf04079800 con 0x7fcf0c159220 2024-09-13T17:13:32.602 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 msgr2=0x7f6e4006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 0x7f6e4006d140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c15f830 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 msgr2=0x7f6e5c0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 0x7f6e5c0c9fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e5802f000 tx=0x7f6e5802c000 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 shutdown_connections 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac80 0x7f6e4006d140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5c1f5b00 0x7f6e5c15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5c0cb8d0 0x7f6e5c0c9fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 --2- 172.21.15.5:0/1905740201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e48003760 0x7f6e5c15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 >> 172.21.15.5:0/1905740201 conn(0x7f6e5c0cef80 msgr2=0x7f6e5c0af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 shutdown_connections 2024-09-13T17:13:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.599+0000 7f6e627a0640 1 -- 172.21.15.5:0/1905740201 wait complete. 2024-09-13T17:13:32.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.602+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 msgr2=0x7fcef806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.602+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 0x7fcef806d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcefc004e40 tx=0x7fcefc007f10 comp rx=0 tx=0).stop 2024-09-13T17:13:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.602+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 msgr2=0x7fcf0c14e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.602+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 0x7fcf0c14e850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf04031000 tx=0x7fcf04004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 shutdown_connections 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf0c159220 0x7fcf0c14e850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf0c0b4270 0x7fcf0c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcef806ac30 0x7fcef806d0f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 --2- 172.21.15.5:0/3404149325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf0c098a00 0x7fcf0c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.604+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 >> 172.21.15.5:0/3404149325 conn(0x7fcf0c071570 msgr2=0x7fcf0c1583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.605+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 shutdown_connections 2024-09-13T17:13:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.605+0000 7fcf127ed640 1 -- 172.21.15.5:0/3404149325 wait complete. 2024-09-13T17:13:32.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-09-13T17:13:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.610+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d88005500 con 0x7f5da40b1b00 2024-09-13T17:13:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.611+0000 7f5d9bfff640 1 -- 172.21.15.5:0/2336806466 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d9c005e60 con 0x7f5da40b1b00 2024-09-13T17:13:32.613 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:32.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.613+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 msgr2=0x7f5d8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.613+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 0x7f5d8406d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02a0c0 tx=0x7f5d8c02e000 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.613+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 msgr2=0x7f5da414b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.613+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 0x7f5da414b530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00e7d0 tx=0x7f5d9c00ec90 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 shutdown_connections 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5da415a610 0x7f5da4095270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d8406ac00 0x7f5d8406d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5da40b1b00 0x7f5da414b530 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 --2- 172.21.15.5:0/2336806466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5da40af370 0x7f5da414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 >> 172.21.15.5:0/2336806466 conn(0x7f5da40b37c0 msgr2=0x7f5da415c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 shutdown_connections 2024-09-13T17:13:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.614+0000 7f5daa1db640 1 -- 172.21.15.5:0/2336806466 wait complete. 2024-09-13T17:13:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.617+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90c00b2320 con 0x7f90c0071530 2024-09-13T17:13:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.617+0000 7f90bd7fa640 1 -- 172.21.15.5:0/4183127345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90b0058980 con 0x7f90c0071530 2024-09-13T17:13:32.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-09-13T17:13:32.620 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-09-13T17:13:32.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-09-13T17:13:32.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-09-13T17:13:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 msgr2=0x7f90ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 0x7f90ac06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90b4034000 tx=0x7f90b402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:32.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 msgr2=0x7f90c014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90b000efc0 tx=0x7f90b000c490 comp rx=0 tx=0).stop 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 shutdown_connections 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c0159340 0x7f90c0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c0155f60 0x7f90c0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90ac06acd0 0x7f90ac06d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 --2- 172.21.15.5:0/4183127345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c0071530 0x7f90c014e6a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 >> 172.21.15.5:0/4183127345 conn(0x7f90c00aff60 msgr2=0x7f90c00b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 shutdown_connections 2024-09-13T17:13:32.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:32.620+0000 7f90c5de2640 1 -- 172.21.15.5:0/4183127345 wait complete. 2024-09-13T17:13:32.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-09-13T17:13:32.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-13T17:13:32.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-09-13T17:13:33.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:13:33.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:13:33.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:13:33.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:13:33.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:13:33.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:13:33.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:13:33.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:13:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.776+0000 7f49b759e640 1 Processor -- start 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.776+0000 7f49b759e640 1 -- start start 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b759e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49b8164f80 0x7f49b80b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b759e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b806cc20 con 0x7f49b8160670 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b759e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b80b15c0 con 0x7f49b8164f80 2024-09-13T17:13:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80ab160 con 0x7f49b8160a50 2024-09-13T17:13:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45748/0 (socket says 172.21.15.5:45748) 2024-09-13T17:13:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.778+0000 7f49b5d9b640 1 -- 172.21.15.5:0/3830527553 learned_addr learned my addr 172.21.15.5:0/3830527553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.779+0000 7f49b6d9d640 1 --2- 172.21.15.5:0/3830527553 >> v2:172.21.15.179:3300/0 conn(0x7f49b8164f80 0x7f49b80b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.779+0000 7f49b5d9b640 1 -- 172.21.15.5:0/3830527553 >> v2:172.21.15.179:3300/0 conn(0x7f49b8164f80 msgr2=0x7f49b80b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.779+0000 7f49b5d9b640 1 --2- 172.21.15.5:0/3830527553 >> v2:172.21.15.179:3300/0 conn(0x7f49b8164f80 0x7f49b80b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.779+0000 7f49b5d9b640 1 -- 172.21.15.5:0/3830527553 >> v1:172.21.15.179:6789/0 conn(0x7f49b8160670 legacy=0x7f49b8164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.779+0000 7f49b5d9b640 1 -- 172.21.15.5:0/3830527553 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b806ffe0 con 0x7f49b8160a50 2024-09-13T17:13:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.781+0000 7f49b5d9b640 1 --2- 172.21.15.5:0/3830527553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009e50 tx=0x7f49b002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea3eaa49c761d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.781+0000 7f49b559a640 1 -- 172.21.15.5:0/3830527553 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0031600 con 0x7f49b8160a50 2024-09-13T17:13:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.781+0000 7f49b559a640 1 -- 172.21.15.5:0/3830527553 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b002d050 con 0x7f49b8160a50 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.782+0000 7f49b759e640 1 -- 172.21.15.5:0/3830527553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 msgr2=0x7f49b8164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.782+0000 7f49b759e640 1 --2- 172.21.15.5:0/3830527553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009e50 tx=0x7f49b002a6c0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 -- 172.21.15.5:0/3830527553 shutdown_connections 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 --2- 172.21.15.5:0/3830527553 >> v2:172.21.15.179:3300/0 conn(0x7f49b8164f80 0x7f49b80b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 --2- 172.21.15.5:0/3830527553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8160a50 0x7f49b8164a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 -- 172.21.15.5:0/3830527553 >> 172.21.15.5:0/3830527553 conn(0x7f49b80aff60 msgr2=0x7f49b80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 -- 172.21.15.5:0/3830527553 shutdown_connections 2024-09-13T17:13:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.783+0000 7f49b759e640 1 -- 172.21.15.5:0/3830527553 wait complete. 2024-09-13T17:13:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.786+0000 7f49b759e640 1 Processor -- start 2024-09-13T17:13:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.786+0000 7f49b759e640 1 -- start start 2024-09-13T17:13:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.787+0000 7f49b759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b8160670 0x7f49b8162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 0x7f49b81631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 0x7f49b80cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 0x7f49b81631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b5d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 0x7f49b81631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45754/0 (socket says 172.21.15.5:45754) 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b5d9b640 1 -- 172.21.15.5:0/1657496741 learned_addr learned my addr 172.21.15.5:0/1657496741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b6d9d640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 0x7f49b80cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.788+0000 7f49b759e640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8150810 con 0x7f49b81514d0 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.789+0000 7f49b759e640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80caff0 con 0x7f49b8160670 2024-09-13T17:13:33.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.789+0000 7f49b759e640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80cad10 con 0x7f49b8164f80 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 -- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 msgr2=0x7f49b81631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 0x7f49b81631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 -- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b8160670 msgr2=0x7f49b8162c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b8160670 0x7f49b8162c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0009b30 con 0x7f49b81514d0 2024-09-13T17:13:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.790+0000 7f49b6d9d640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 0x7f49b80cc420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00e5c0 tx=0x7f49ac00ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.791+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac013680 con 0x7f49b81514d0 2024-09-13T17:13:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.791+0000 7f49b759e640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b81509f0 con 0x7f49b81514d0 2024-09-13T17:13:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.792+0000 7f49b759e640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8150d80 con 0x7f49b81514d0 2024-09-13T17:13:33.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.796+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac013800 con 0x7f49b81514d0 2024-09-13T17:13:33.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.796+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac013bb0 con 0x7f49b81514d0 2024-09-13T17:13:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.797+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49ac013d10 con 0x7f49b81514d0 2024-09-13T17:13:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.797+0000 7f49a6ffd640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 0x7f499806d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.798+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49ac088e30 con 0x7f49b81514d0 2024-09-13T17:13:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.799+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c005250 con 0x7f49b81514d0 2024-09-13T17:13:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.804+0000 7f49b659c640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 0x7f499806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.808+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f49ac08e060 con 0x7f49b81514d0 2024-09-13T17:13:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.808+0000 7f49b659c640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 0x7f499806d240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49a8000f60 tx=0x7f49a80079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.837+0000 7f12991e9640 1 Processor -- start 2024-09-13T17:13:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.838+0000 7f12991e9640 1 -- start start 2024-09-13T17:13:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.837+0000 7f453973e640 1 Processor -- start 2024-09-13T17:13:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.838+0000 7fd78f59e640 1 Processor -- start 2024-09-13T17:13:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.838+0000 7fd78f59e640 1 -- start start 2024-09-13T17:13:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.837+0000 7f453973e640 1 -- start start 2024-09-13T17:13:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.838+0000 7f165ccdc640 1 Processor -- start 2024-09-13T17:13:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f996d0c9640 1 Processor -- start 2024-09-13T17:13:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7fe37b51b640 1 Processor -- start 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7fe37b51b640 1 -- start start 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f996d0c9640 1 -- start start 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad500 0x7f4534161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45340ad8e0 0x7f45340b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45340700e0 0x7f4534070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4534070a50 con 0x7f45340700e0 2024-09-13T17:13:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340b1d60 con 0x7f45340ad8e0 2024-09-13T17:13:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f453973e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b2040 con 0x7f45340ad500 2024-09-13T17:13:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7fc69d45a640 1 Processor -- start 2024-09-13T17:13:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f12991e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 0x7f128c036670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f12991e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f12991e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c00b670 con 0x7f128c054070 2024-09-13T17:13:33.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7fc69d45a640 1 -- start start 2024-09-13T17:13:33.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f12991e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c033da0 con 0x7f128c036290 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f12991e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0478b0 con 0x7f128c036bb0 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f1292d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 0x7f128c036670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f129359e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f128c054070 0x7f128c039790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33600/0 (socket says 172.21.15.5:33600) 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78f59e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7880e0a10 0x7fd788035860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd788054aa0 0x7fd788054f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78f59e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7880515d0 con 0x7fd78800bd60 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78f59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78800c1a0 con 0x7fd788054aa0 2024-09-13T17:13:33.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78f59e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880544e0 con 0x7fd7880e0a10 2024-09-13T17:13:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f129259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f129259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45782/0 (socket says 172.21.15.5:45782) 2024-09-13T17:13:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f129259c640 1 -- 172.21.15.5:0/445735810 learned_addr learned my addr 172.21.15.5:0/445735810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f1292d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 0x7f128c036670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:49046/0 (socket says 172.21.15.5:49046) 2024-09-13T17:13:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78dd9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd78800bd60 0x7fd788056e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:47536/0 (socket says 172.21.15.5:47536) 2024-09-13T17:13:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fe37b51b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 0x7fe36c01d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f996d0c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f996806d680 0x7f996806e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f996d0c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9968158700 0x7f9968065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f996d0c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680ccc80 con 0x7f996806aea0 2024-09-13T17:13:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fd78dd9b640 1 -- 172.21.15.5:0/3449668567 learned_addr learned my addr 172.21.15.5:0/3449668567 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37a519640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 0x7fe36c01d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37a519640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 0x7fe36c01d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45788/0 (socket says 172.21.15.5:45788) 2024-09-13T17:13:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37a519640 1 -- 172.21.15.5:0/3131364072 learned_addr learned my addr 172.21.15.5:0/3131364072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fd78e59c640 1 --2- 172.21.15.5:0/3449668567 >> v2:172.21.15.179:3300/0 conn(0x7fd7880e0a10 0x7fd788035860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f129259c640 1 -- 172.21.15.5:0/445735810 >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 msgr2=0x7f128c036670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f129259c640 1 --2- 172.21.15.5:0/445735810 >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 0x7f128c036670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f129259c640 1 -- 172.21.15.5:0/445735810 >> v1:172.21.15.5:6789/0 conn(0x7f128c054070 legacy=0x7f128c039790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f129259c640 1 -- 172.21.15.5:0/445735810 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0530f0 con 0x7f128c036bb0 2024-09-13T17:13:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7f165ccdc640 1 -- start start 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37b51b640 1 --2- 172.21.15.5:0/3131364072 >> v2:172.21.15.5:3300/0 conn(0x7fe36c053540 0x7fe36c0e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0520a0 con 0x7fe36c006480 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c032730 con 0x7fe36c053540 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c01db30 con 0x7fe36c04fc20 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fe37ad1a640 1 --2- 172.21.15.5:0/3131364072 >> v2:172.21.15.5:3300/0 conn(0x7fe36c053540 0x7fe36c0e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45340700e0 0x7f4534070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45340700e0 0x7f4534070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59166/0 (socket says 172.21.15.5:59166) 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 -- 172.21.15.5:0/994665631 learned_addr learned my addr 172.21.15.5:0/994665631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f4532ffd640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad500 0x7f4534161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 -- 172.21.15.5:0/994665631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad500 msgr2=0x7f4534161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad500 0x7f4534161aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 -- 172.21.15.5:0/994665631 >> v2:172.21.15.179:3300/0 conn(0x7f45340ad8e0 msgr2=0x7f45340b1650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 --2- 172.21.15.5:0/994665631 >> v2:172.21.15.179:3300/0 conn(0x7f45340ad8e0 0x7f45340b1650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.839+0000 7f45337fe640 1 -- 172.21.15.5:0/994665631 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340b2320 con 0x7f45340700e0 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f45337fe640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340700e0 0x7f4534070510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45340b0c30 tx=0x7f452402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa39963cacba19b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc69d45a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6980b12f0 0x7fc698070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc696ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6980b12f0 0x7fc698070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc696ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6980b12f0 0x7fc698070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59182/0 (socket says 172.21.15.5:59182) 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc69d45a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc698071000 0x7fc6980b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc696ffd640 1 -- 172.21.15.5:0/2022731420 learned_addr learned my addr 172.21.15.5:0/2022731420 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f165ccdc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 0x7f16580b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f165ccdc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16580b4550 con 0x7f1658160980 2024-09-13T17:13:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc69d45a640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 0x7fc69806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f165ccdc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165806ec70 con 0x7f1658098b00 2024-09-13T17:13:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f165ccdc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580b2020 con 0x7f165806a5a0 2024-09-13T17:13:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f16577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1658160980 0x7f16580b3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33612/0 (socket says 172.21.15.5:33612) 2024-09-13T17:13:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f16577fe640 1 -- 172.21.15.5:0/21816612 learned_addr learned my addr 172.21.15.5:0/21816612 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1657fff640 1 --2- 172.21.15.5:0/21816612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 0x7f16580b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7fc6967fc640 1 --2- 172.21.15.5:0/2022731420 >> v2:172.21.15.179:3300/0 conn(0x7fc698071000 0x7fc6980b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc6977fe640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 0x7fc69806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc698158880 con 0x7fc6980b12f0 2024-09-13T17:13:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69806c240 con 0x7fc698071000 2024-09-13T17:13:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69806c520 con 0x7fc69806e1d0 2024-09-13T17:13:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f996659c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9968158700 0x7f9968065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203927057 0 0) 0x7f165806ec70 con 0x7f1658098b00 2024-09-13T17:13:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1644003520 con 0x7f1658098b00 2024-09-13T17:13:33.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1657fff640 1 -- 172.21.15.5:0/21816612 >> v1:172.21.15.179:6789/0 conn(0x7f1658098b00 legacy=0x7f1658069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc696ffd640 1 -- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 msgr2=0x7fc69806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc696ffd640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 0x7fc69806d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc696ffd640 1 -- 172.21.15.5:0/2022731420 >> v2:172.21.15.179:3300/0 conn(0x7fc698071000 msgr2=0x7fc6980b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc696ffd640 1 --2- 172.21.15.5:0/2022731420 >> v2:172.21.15.179:3300/0 conn(0x7fc698071000 0x7fc6980b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f996659c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9968158700 0x7f9968065bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:49050/0 (socket says 172.21.15.5:49050) 2024-09-13T17:13:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f996659c640 1 -- 172.21.15.5:0/1678739713 learned_addr learned my addr 172.21.15.5:0/1678739713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc696ffd640 1 -- 172.21.15.5:0/2022731420 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69806c800 con 0x7fc6980b12f0 2024-09-13T17:13:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996806eac0 con 0x7f996806d680 2024-09-13T17:13:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fc6977fe640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 0x7fc69806d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1657fff640 1 -- 172.21.15.5:0/21816612 >> v1:172.21.15.5:6789/0 conn(0x7f1658160980 legacy=0x7f16580b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297230915 0 0) 0x7f16580b4550 con 0x7f1658160980 2024-09-13T17:13:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f129259c640 1 --2- 172.21.15.5:0/445735810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1288009870 tx=0x7f128802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ac39d19d603505 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996806f290 con 0x7f9968158700 2024-09-13T17:13:33.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f1657fff640 1 -- 172.21.15.5:0/21816612 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165806ef50 con 0x7f165806a5a0 2024-09-13T17:13:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f1291d9b640 1 -- 172.21.15.5:0/445735810 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288032440 con 0x7f128c036bb0 2024-09-13T17:13:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fe37ad1a640 1 -- 172.21.15.5:0/3131364072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 msgr2=0x7fe36c01d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fe37ad1a640 1 --2- 172.21.15.5:0/3131364072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 0x7fe36c01d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fe37ad1a640 1 -- 172.21.15.5:0/3131364072 >> v1:172.21.15.179:6789/0 conn(0x7fe36c006480 legacy=0x7fe36c050000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fe37ad1a640 1 -- 172.21.15.5:0/3131364072 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c006940 con 0x7fe36c053540 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.841+0000 7f4531ffb640 1 -- 172.21.15.5:0/994665631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524032440 con 0x7f45340700e0 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7f4531ffb640 1 -- 172.21.15.5:0/994665631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45240325a0 con 0x7f45340700e0 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 -- 172.21.15.5:0/994665631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340700e0 msgr2=0x7f4534070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f4531ffb640 1 -- 172.21.15.5:0/994665631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524032440 con 0x7f45340700e0 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340700e0 0x7f4534070510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45340b0c30 tx=0x7f452402a200 comp rx=0 tx=0).stop 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 -- 172.21.15.5:0/994665631 shutdown_connections 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340700e0 0x7f4534070510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 --2- 172.21.15.5:0/994665631 >> v2:172.21.15.179:3300/0 conn(0x7f45340ad8e0 0x7f45340b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 --2- 172.21.15.5:0/994665631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad500 0x7f4534161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f453973e640 1 -- 172.21.15.5:0/994665631 >> 172.21.15.5:0/994665631 conn(0x7f45340ce0d0 msgr2=0x7f45340ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251784174 0 0) 0x7f99680ccc80 con 0x7f996806aea0 2024-09-13T17:13:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.840+0000 7fd78ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd788054aa0 0x7fd788054f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f1291d9b640 1 -- 172.21.15.5:0/445735810 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880325a0 con 0x7f128c036bb0 2024-09-13T17:13:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9950003520 con 0x7f996806aea0 2024-09-13T17:13:33.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.842+0000 7fd78d59a640 1 -- 172.21.15.5:0/3449668567 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134059709 0 0) 0x7fd7880515d0 con 0x7fd78800bd60 2024-09-13T17:13:33.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fe37ad1a640 1 --2- 172.21.15.5:0/3131364072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c053540 0x7fe36c0e9330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe374063830 tx=0x7fe3740a3f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca371f08a972f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f9966d9d640 1 --2- 172.21.15.5:0/1678739713 >> v2:172.21.15.5:3300/0 conn(0x7f996806d680 0x7f996806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fd78d59a640 1 -- 172.21.15.5:0/3449668567 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd778003520 con 0x7fd78800bd60 2024-09-13T17:13:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158289121 0 0) 0x7f9950003520 con 0x7f996806aea0 2024-09-13T17:13:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f996659c640 1 -- 172.21.15.5:0/1678739713 >> v2:172.21.15.5:3300/0 conn(0x7f996806d680 msgr2=0x7f996806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f996659c640 1 --2- 172.21.15.5:0/1678739713 >> v2:172.21.15.5:3300/0 conn(0x7f996806d680 0x7f996806e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f996659c640 1 -- 172.21.15.5:0/1678739713 >> v1:172.21.15.179:6789/0 conn(0x7f996806aea0 legacy=0x7f99680b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f996659c640 1 -- 172.21.15.5:0/1678739713 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680ccf20 con 0x7f9968158700 2024-09-13T17:13:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7f1291d9b640 1 -- 172.21.15.5:0/445735810 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288032930 con 0x7f128c036bb0 2024-09-13T17:13:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fd78ed9d640 1 -- 172.21.15.5:0/3449668567 >> v2:172.21.15.179:3300/0 conn(0x7fd7880e0a10 msgr2=0x7fd788035860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fd78ed9d640 1 --2- 172.21.15.5:0/3449668567 >> v2:172.21.15.179:3300/0 conn(0x7fd7880e0a10 0x7fd788035860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fd78ed9d640 1 -- 172.21.15.5:0/3449668567 >> v1:172.21.15.179:6789/0 conn(0x7fd78800bd60 legacy=0x7fd788056e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fe379517640 1 -- 172.21.15.5:0/3131364072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374072040 con 0x7fe36c053540 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fe379517640 1 -- 172.21.15.5:0/3131364072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3740a4cc0 con 0x7fe36c053540 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.843+0000 7fe379517640 1 -- 172.21.15.5:0/3131364072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740ac640 con 0x7fe36c053540 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fd78ed9d640 1 -- 172.21.15.5:0/3449668567 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880547c0 con 0x7fd788054aa0 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f1657fff640 1 --2- 172.21.15.5:0/21816612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 0x7f16580b1430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16500097d0 tx=0x7f165002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15adece4c4800116 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 -- 172.21.15.5:0/445735810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 msgr2=0x7f128c039250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 --2- 172.21.15.5:0/445735810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1288009870 tx=0x7f128802a250 comp rx=0 tx=0).stop 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fc696ffd640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6980b12f0 0x7fc698070ac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc6980ca7a0 tx=0x7fc68802b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b366475f333190 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650032440 con 0x7f165806a5a0 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16500325a0 con 0x7f165806a5a0 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f1656ffd640 1 -- 172.21.15.5:0/21816612 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650032930 con 0x7f165806a5a0 2024-09-13T17:13:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f453973e640 1 -- 172.21.15.5:0/994665631 shutdown_connections 2024-09-13T17:13:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fc695ffb640 1 -- 172.21.15.5:0/2022731420 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880089e0 con 0x7fc6980b12f0 2024-09-13T17:13:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fc695ffb640 1 -- 172.21.15.5:0/2022731420 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688008b40 con 0x7fc6980b12f0 2024-09-13T17:13:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fc695ffb640 1 -- 172.21.15.5:0/2022731420 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800a0d0 con 0x7fc6980b12f0 2024-09-13T17:13:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c053540 msgr2=0x7fe36c0e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f453973e640 1 -- 172.21.15.5:0/994665631 wait complete. 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7fe37b51b640 1 --2- 172.21.15.5:0/3131364072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c053540 0x7fe36c0e9330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe374063830 tx=0x7fe3740a3f70 comp rx=0 tx=0).stop 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 -- 172.21.15.5:0/445735810 shutdown_connections 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 --2- 172.21.15.5:0/445735810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c036bb0 0x7f128c039250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 --2- 172.21.15.5:0/445735810 >> v2:172.21.15.179:3300/0 conn(0x7f128c036290 0x7f128c036670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.844+0000 7f12991e9640 1 -- 172.21.15.5:0/445735810 >> 172.21.15.5:0/445735810 conn(0x7f128c01d930 msgr2=0x7f128c0545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f12991e9640 1 -- 172.21.15.5:0/445735810 shutdown_connections 2024-09-13T17:13:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f12991e9640 1 -- 172.21.15.5:0/445735810 wait complete. 2024-09-13T17:13:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fd78ed9d640 1 --2- 172.21.15.5:0/3449668567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd788054f10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd788039330 tx=0x7fd78002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43775d3915366947 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 -- 172.21.15.5:0/21816612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 msgr2=0x7f16580b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6980b12f0 msgr2=0x7fc698070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 --2- 172.21.15.5:0/21816612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 0x7f16580b1430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16500097d0 tx=0x7f165002a210 comp rx=0 tx=0).stop 2024-09-13T17:13:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fd78d59a640 1 -- 172.21.15.5:0/3449668567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784001670 con 0x7fd788054aa0 2024-09-13T17:13:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6980b12f0 0x7fc698070ac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc6980ca7a0 tx=0x7fc68802b1e0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 shutdown_connections 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 -- 172.21.15.5:0/21816612 shutdown_connections 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 --2- 172.21.15.5:0/21816612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f165806a5a0 0x7f16580b1430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 -- 172.21.15.5:0/21816612 >> 172.21.15.5:0/21816612 conn(0x7f1658071550 msgr2=0x7f16580b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc69806e1d0 0x7fc69806d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 --2- 172.21.15.5:0/2022731420 >> v2:172.21.15.179:3300/0 conn(0x7fc698071000 0x7fc6980b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 --2- 172.21.15.5:0/2022731420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6980b12f0 0x7fc698070ac0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc6980ca7a0 tx=0x7fc68802b1e0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 >> 172.21.15.5:0/2022731420 conn(0x7fc6980ce0d0 msgr2=0x7fc6980ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 shutdown_connections 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fc69d45a640 1 -- 172.21.15.5:0/2022731420 wait complete. 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7fd78d59a640 1 -- 172.21.15.5:0/3449668567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78002aba0 con 0x7fd788054aa0 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.845+0000 7f165ccdc640 1 -- 172.21.15.5:0/21816612 shutdown_connections 2024-09-13T17:13:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.846+0000 7f165ccdc640 1 -- 172.21.15.5:0/21816612 wait complete. 2024-09-13T17:13:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.846+0000 7fd78d59a640 1 -- 172.21.15.5:0/3449668567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784001670 con 0x7fd788054aa0 2024-09-13T17:13:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.846+0000 7fd78f59e640 1 -- 172.21.15.5:0/3449668567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 msgr2=0x7fd788054f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.846+0000 7fd78f59e640 1 --2- 172.21.15.5:0/3449668567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd788054f10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd788039330 tx=0x7fd78002a110 comp rx=0 tx=0).stop 2024-09-13T17:13:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7f453973e640 1 Processor -- start 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 shutdown_connections 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 --2- 172.21.15.5:0/3131364072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c053540 0x7fe36c0e9330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 --2- 172.21.15.5:0/3131364072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c04fc20 0x7fe36c01d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 >> 172.21.15.5:0/3131364072 conn(0x7fe36c036050 msgr2=0x7fe36c036460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 -- 172.21.15.5:0/3449668567 shutdown_connections 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 --2- 172.21.15.5:0/3449668567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd788054f10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 --2- 172.21.15.5:0/3449668567 >> v2:172.21.15.179:3300/0 conn(0x7fd7880e0a10 0x7fd788035860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 -- 172.21.15.5:0/3449668567 >> 172.21.15.5:0/3449668567 conn(0x7fd78801fb00 msgr2=0x7fd788056770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 -- 172.21.15.5:0/3449668567 shutdown_connections 2024-09-13T17:13:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 shutdown_connections 2024-09-13T17:13:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fd78f59e640 1 -- 172.21.15.5:0/3449668567 wait complete. 2024-09-13T17:13:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fc69d45a640 1 Processor -- start 2024-09-13T17:13:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7f165ccdc640 1 Processor -- start 2024-09-13T17:13:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7f12991e9640 1 Processor -- start 2024-09-13T17:13:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fc69d45a640 1 -- start start 2024-09-13T17:13:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7f12991e9640 1 -- start start 2024-09-13T17:13:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7fe37b51b640 1 -- 172.21.15.5:0/3131364072 wait complete. 2024-09-13T17:13:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7f165ccdc640 1 -- start start 2024-09-13T17:13:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7f996659c640 1 --2- 172.21.15.5:0/1678739713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9968158700 0x7f9968065bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9968071a60 tx=0x7f995c02a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff9e594febb01e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc698153830 0x7fc698153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6981543b0 0x7fc698154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698098d20 con 0x7fc69806e1d0 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698155cc0 con 0x7fc6981543b0 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7fc69d45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980989d0 con 0x7fc698153830 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.847+0000 7f453973e640 1 -- start start 2024-09-13T17:13:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7f453973e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45340700e0 0x7f45341492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.848+0000 7f453973e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59202/0 (socket says 172.21.15.5:59202) 2024-09-13T17:13:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fc696ffd640 1 -- 172.21.15.5:0/3794740747 learned_addr learned my addr 172.21.15.5:0/3794740747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960001a20 con 0x7f9968158700 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c02ad20 con 0x7f9968158700 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f9965d9b640 1 -- 172.21.15.5:0/1678739713 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c032660 con 0x7f9968158700 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f453973e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad8e0 0x7f4534158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f453973e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534161050 con 0x7f45340ad500 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f453973e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4534161330 con 0x7f45340700e0 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f453973e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4534161610 con 0x7f45340ad8e0 2024-09-13T17:13:33.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f165ccdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 0x7f16581554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f45327fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f12991e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 0x7f128c166920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f45327fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59198/0 (socket says 172.21.15.5:59198) 2024-09-13T17:13:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f45327fc640 1 -- 172.21.15.5:0/2264412202 learned_addr learned my addr 172.21.15.5:0/2264412202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fd78f59e640 1 Processor -- start 2024-09-13T17:13:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f12991e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 0x7f128c04d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f12991e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 0x7f128c04b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f12991e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c04c0a0 con 0x7f128c036290 2024-09-13T17:13:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fe37b51b640 1 Processor -- start 2024-09-13T17:13:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fd78f59e640 1 -- start start 2024-09-13T17:13:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f165ccdc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9968158700 msgr2=0x7f9968065bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f996d0c9640 1 --2- 172.21.15.5:0/1678739713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9968158700 0x7f9968065bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9968071a60 tx=0x7f995c02a290 comp rx=0 tx=0).stop 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f165ccdc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 0x7f1658159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45828/0 (socket says 172.21.15.5:45828) 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 -- 172.21.15.5:0/2232091732 learned_addr learned my addr 172.21.15.5:0/2232091732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f1657fff640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 0x7f1658159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581616b0 con 0x7f165806a5a0 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581548e0 con 0x7f1658160980 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165815a720 con 0x7f1658098b00 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f16577fe640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 0x7f16581554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7fe37b51b640 1 -- start start 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.849+0000 7f4532ffd640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45340700e0 0x7f45341492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 -- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad8e0 msgr2=0x7f4534158910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad8e0 0x7f4534158910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 -- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45340700e0 msgr2=0x7f45341492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45340700e0 0x7f45341492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 -- 172.21.15.5:0/2264412202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240094d0 con 0x7f45340ad500 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f45327fc640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f452800b3c0 tx=0x7f452800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7fc696ffd640 1 -- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc698153830 msgr2=0x7fc698153c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7fc696ffd640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc698153830 0x7fc698153c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7fc696ffd640 1 -- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6981543b0 msgr2=0x7fc698154830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7fc696ffd640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6981543b0 0x7fc698154830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7fc696ffd640 1 -- 172.21.15.5:0/3794740747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688007040 con 0x7fc69806e1d0 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1292d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 0x7f128c166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 -- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 msgr2=0x7f1658159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 0x7f1658159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 -- 172.21.15.5:0/2232091732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 msgr2=0x7f16581554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 0x7f16581554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78800bd60 0x7fd7880d6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.850+0000 7f164effd640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009400 con 0x7f1658098b00 2024-09-13T17:13:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1657fff640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 0x7f1658159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f16577fe640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 0x7f16581554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:33.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd7880d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1292d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 0x7f128c166920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59218/0 (socket says 172.21.15.5:59218) 2024-09-13T17:13:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 0x7fe36c01c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f164effd640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f164000c490 tx=0x7f164000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fc696ffd640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc688035040 tx=0x7fc6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788044f80 con 0x7fd788054aa0 2024-09-13T17:13:33.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c6320 con 0x7fd78800bd60 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe36c053540 0x7fe36c009ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c04bc90 con 0x7fe36c04fc20 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c00ba20 con 0x7fe36c053540 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37b51b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c04b640 con 0x7fe36c006480 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78f59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c8fd0 con 0x7fd7880e0a10 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37a519640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37a519640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45840/0 (socket says 172.21.15.5:45840) 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37a519640 1 -- 172.21.15.5:0/524574367 learned_addr learned my addr 172.21.15.5:0/524574367 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528011830 con 0x7f45340ad500 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528011990 con 0x7f45340ad500 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528011d60 con 0x7f45340ad500 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1292d9d640 1 -- 172.21.15.5:0/3807189776 learned_addr learned my addr 172.21.15.5:0/3807189776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400052d0 con 0x7f1658098b00 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640005430 con 0x7f1658098b00 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1658160ff0 con 0x7f1658098b00 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe37ad1a640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe36c053540 0x7fe36c009ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45341618f0 con 0x7f45340ad500 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4534149830 con 0x7f45340ad500 2024-09-13T17:13:33.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c04c380 con 0x7f128c036bb0 2024-09-13T17:13:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c04c660 con 0x7f128c054070 2024-09-13T17:13:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fe379d18640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 0x7fe36c01c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7f129259c640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 0x7f128c04d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 shutdown_connections 2024-09-13T17:13:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 --2- 172.21.15.5:0/1678739713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9968158700 0x7f9968065bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 --2- 172.21.15.5:0/1678739713 >> v2:172.21.15.5:3300/0 conn(0x7f996806d680 0x7f996806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 >> 172.21.15.5:0/1678739713 conn(0x7f9968070830 msgr2=0x7f9968070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 shutdown_connections 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78ed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78ed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:45852/0 (socket says 172.21.15.5:45852) 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78ed9d640 1 -- 172.21.15.5:0/4175628226 learned_addr learned my addr 172.21.15.5:0/4175628226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.851+0000 7fd78e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78800bd60 0x7fd7880d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fd78dd9b640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd7880d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f996d0c9640 1 -- 172.21.15.5:0/1678739713 wait complete. 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fd78ed9d640 1 -- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78800bd60 msgr2=0x7fd7880d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 -- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe36c053540 msgr2=0x7fe36c009ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe36c053540 0x7fe36c009ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 -- 172.21.15.5:0/524574367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 msgr2=0x7fe36c01c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 0x7fe36c01c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 -- 172.21.15.5:0/524574367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c04b920 con 0x7fe36c006480 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe379d18640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 0x7fe36c01c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37a519640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e8b0 tx=0x7fe37000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000c940 con 0x7fe36c006480 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c00bd00 con 0x7fe36c006480 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000caa0 con 0x7fe36c006480 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c01cc90 con 0x7fe36c006480 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800a5e0 con 0x7fc69806e1d0 2024-09-13T17:13:33.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800a740 con 0x7fc69806e1d0 2024-09-13T17:13:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fd78ed9d640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78800bd60 0x7fd7880d6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fd78ed9d640 1 -- 172.21.15.5:0/4175628226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 msgr2=0x7fd7880d5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012910 con 0x7f1658098b00 2024-09-13T17:13:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534161e10 con 0x7f45340ad500 2024-09-13T17:13:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165815a440 con 0x7f1658098b00 2024-09-13T17:13:33.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000c940 con 0x7fe36c006480 2024-09-13T17:13:33.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fd78ed9d640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd7880d5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.853+0000 7fd78ed9d640 1 -- 172.21.15.5:0/4175628226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780009400 con 0x7fd7880e0a10 2024-09-13T17:13:33.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd78ed9d640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd780009860 tx=0x7fd7800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1640012b30 con 0x7f1658098b00 2024-09-13T17:13:33.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd78dd9b640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd7880d5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:33.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688008240 con 0x7fc69806e1d0 2024-09-13T17:13:33.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc698154d70 con 0x7fc69806e1d0 2024-09-13T17:13:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6981541d0 con 0x7fc69806e1d0 2024-09-13T17:13:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.852+0000 7f129359e640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 0x7f128c04b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1658069e90 con 0x7f1658098b00 2024-09-13T17:13:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7f996d0c9640 1 Processor -- start 2024-09-13T17:13:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7f996d0c9640 1 -- start start 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784001670 con 0x7fd7880e0a10 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780006e10 con 0x7fd7880e0a10 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780004250 con 0x7fd7880e0a10 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7880c92b0 con 0x7fd7880e0a10 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78804dcd0 con 0x7fd7880e0a10 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f129259c640 1 -- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 msgr2=0x7f128c04b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f129259c640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 0x7f128c04b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f129259c640 1 -- 172.21.15.5:0/3807189776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 msgr2=0x7f128c166920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f129259c640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 0x7f128c166920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f129259c640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880094d0 con 0x7f128c036bb0 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f129359e640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 0x7f128c04b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f452801b460 con 0x7f45340ad500 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.855+0000 7f451b7fe640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 0x7f452006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45280892c0 con 0x7f45340ad500 2024-09-13T17:13:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698070ac0 con 0x7fc69806e1d0 2024-09-13T17:13:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 0x7f99681481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968158700 0x7f99681486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.854+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c034270 con 0x7fe36c006480 2024-09-13T17:13:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd774005250 con 0x7fd7880e0a10 2024-09-13T17:13:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f1654ff9640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 0x7f163806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f9966d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f9966d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:49124/0 (socket says 172.21.15.5:49124) 2024-09-13T17:13:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1640088920 con 0x7f1658098b00 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f4532ffd640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 0x7f452006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f9966d9d640 1 -- 172.21.15.5:0/2657724172 learned_addr learned my addr 172.21.15.5:0/2657724172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99681f73e0 con 0x7f9968158700 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99681f76c0 con 0x7f996806aea0 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99681f79a0 con 0x7f996806d680 2024-09-13T17:13:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f996759e640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968158700 0x7f99681486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.856+0000 7f16577fe640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 0x7f163806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f129259c640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 0x7f128c04d140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1288031000 tx=0x7f12880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f996659c640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 0x7f99681481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe37000cc10 con 0x7fe36c006480 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f4532ffd640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 0x7f452006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f452c0113e0 tx=0x7f452c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f16577fe640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 0x7f163806d110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1648007fd0 tx=0x7f1648009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288032440 con 0x7f128c036bb0 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288030b80 con 0x7f128c036bb0 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128803d420 con 0x7f128c036bb0 2024-09-13T17:13:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c04c940 con 0x7f128c036bb0 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f9966d9d640 1 -- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 msgr2=0x7f99681481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f9966d9d640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 0x7f99681481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f9966d9d640 1 -- 172.21.15.5:0/2657724172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968158700 msgr2=0x7f99681486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f9966d9d640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968158700 0x7f99681486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f9966d9d640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0094d0 con 0x7f996806aea0 2024-09-13T17:13:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7f996659c640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 0x7f99681481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:33.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7fe36affd640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 0x7fe35806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe370089680 con 0x7fe36c006480 2024-09-13T17:13:33.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f9966d9d640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f995800e9b0 tx=0x7f995800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7fe379d18640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 0x7fe35806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958009670 con 0x7f996806aea0 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800c9a0 con 0x7f996806aea0 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99681f7c80 con 0x7f996806aea0 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.857+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6880083a0 con 0x7fc69806e1d0 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7fc67f7fe640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 0x7fc68406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99681f3dc0 con 0x7f996806aea0 2024-09-13T17:13:33.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958009670 con 0x7f996806aea0 2024-09-13T17:13:33.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c169f80 con 0x7f128c036bb0 2024-09-13T17:13:33.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7fe379d18640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 0x7fe35806d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ebf60 tx=0x7fe364009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7fc6967fc640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 0x7fc68406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.858+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd780049070 con 0x7fd7880e0a10 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7fd77effd640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 0x7fd77006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7800b1b70 con 0x7fd7880e0a10 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7fd78e59c640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 0x7fd77006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.859+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99681f81a0 con 0x7f996806aea0 2024-09-13T17:13:33.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.860+0000 7fc6967fc640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 0x7fc68406d110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6980724c0 tx=0x7fc68c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.860+0000 7fd78e59c640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 0x7fd77006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd790068c00 tx=0x7fd79008b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.860+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c04ce60 con 0x7f128c036bb0 2024-09-13T17:13:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f995800cb10 con 0x7f996806aea0 2024-09-13T17:13:33.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1288039040 con 0x7f128c036bb0 2024-09-13T17:13:33.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f127b7fe640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 0x7f128006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f994f7fe640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 0x7f995406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12880aa150 con 0x7f128c036bb0 2024-09-13T17:13:33.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.861+0000 7f1292d9d640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 0x7f128006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.862+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9958089360 con 0x7f996806aea0 2024-09-13T17:13:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.862+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1640053800 con 0x7f1658098b00 2024-09-13T17:13:33.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.862+0000 7f996659c640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 0x7f995406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.862+0000 7f1292d9d640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 0x7f128006d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1284006a30 tx=0x7f1284008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.862+0000 7f996659c640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 0x7f995406d180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f995c034000 tx=0x7f995c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.864+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc68800a8b0 con 0x7fc69806e1d0 2024-09-13T17:13:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.865+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4534161e10 con 0x7f45340ad500 2024-09-13T17:13:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.865+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9958054260 con 0x7f996806aea0 2024-09-13T17:13:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.866+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd78007cb80 con 0x7fd7880e0a10 2024-09-13T17:13:33.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.869+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f128c04ce60 con 0x7f128c036bb0 2024-09-13T17:13:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.871+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe370054630 con 0x7fe36c006480 2024-09-13T17:13:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:33.873+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc688075b80 con 0x7fc69806e1d0 2024-09-13T17:13:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.189+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f499c0050c0 con 0x7f49b81514d0 2024-09-13T17:13:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.190+0000 7f49a6ffd640 1 -- 172.21.15.5:0/1657496741 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49ac017070 con 0x7f49b81514d0 2024-09-13T17:13:34.193 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-09-13T17:13:34.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.193+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 msgr2=0x7f499806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.193+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 0x7f499806d240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49a8000f60 tx=0x7f49a80079b0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 msgr2=0x7f49b80cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 0x7f49b80cc420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00e5c0 tx=0x7f49ac00ea80 comp rx=0 tx=0).stop 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 shutdown_connections 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f499806ad80 0x7f499806d240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b81514d0 0x7f49b80cc420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b8164f80 0x7f49b81631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 --2- 172.21.15.5:0/1657496741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b8160670 0x7f49b8162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.194+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 >> 172.21.15.5:0/1657496741 conn(0x7f49b80aff60 msgr2=0x7f49b80b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.195+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 shutdown_connections 2024-09-13T17:13:34.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.195+0000 7f49a4ff9640 1 -- 172.21.15.5:0/1657496741 wait complete. 2024-09-13T17:13:34.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2024-09-13T17:13:34.213 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.234+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe36c04bab0 con 0x7fe36c006480 2024-09-13T17:13:34.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.234+0000 7fe36affd640 1 -- 172.21.15.5:0/524574367 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe370054630 con 0x7fe36c006480 2024-09-13T17:13:34.237 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 msgr2=0x7fe35806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 0x7fe35806d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ebf60 tx=0x7fe364009040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 msgr2=0x7fe36c00b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e8b0 tx=0x7fe37000ed70 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 shutdown_connections 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe36c053540 0x7fe36c009ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe35806ac90 0x7fe35806d150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe36c04fc20 0x7fe36c01c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 --2- 172.21.15.5:0/524574367 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe36c006480 0x7fe36c00b320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 >> 172.21.15.5:0/524574367 conn(0x7fe36c036050 msgr2=0x7fe36c050000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 shutdown_connections 2024-09-13T17:13:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.237+0000 7fe37b51b640 1 -- 172.21.15.5:0/524574367 wait complete. 2024-09-13T17:13:34.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2024-09-13T17:13:34.250 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.266+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd7740057d0 con 0x7fd7880e0a10 2024-09-13T17:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.266+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4534161e10 con 0x7f45340ad500 2024-09-13T17:13:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.266+0000 7f451b7fe640 1 -- 172.21.15.5:0/2264412202 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4534161e10 con 0x7f45340ad500 2024-09-13T17:13:34.269 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-09-13T17:13:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.266+0000 7fd77effd640 1 -- 172.21.15.5:0/4175628226 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd780059090 con 0x7fd7880e0a10 2024-09-13T17:13:34.269 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-09-13T17:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.268+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16580cfc90 con 0x7f1658098b00 2024-09-13T17:13:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f1654ff9640 1 -- 172.21.15.5:0/2232091732 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1640056e20 con 0x7f1658098b00 2024-09-13T17:13:34.271 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 msgr2=0x7f452006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 0x7f452006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f452c0113e0 tx=0x7f452c00b040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 msgr2=0x7f45341583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f452800b3c0 tx=0x7f452800b880 comp rx=0 tx=0).stop 2024-09-13T17:13:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 msgr2=0x7fd77006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 shutdown_connections 2024-09-13T17:13:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45340ad8e0 0x7f4534158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f452006acd0 0x7f452006d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45340ad500 0x7f45341583d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 --2- 172.21.15.5:0/2264412202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45340700e0 0x7f45341492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 >> 172.21.15.5:0/2264412202 conn(0x7f45340ce0d0 msgr2=0x7f45340af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 0x7fd77006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd790068c00 tx=0x7fd79008b040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 msgr2=0x7fd788048600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.269+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd780009860 tx=0x7fd7800046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 shutdown_connections 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7880e0a10 0x7fd788048600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd77006acd0 0x7fd77006d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd788054aa0 0x7fd7880d5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 --2- 172.21.15.5:0/4175628226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78800bd60 0x7fd7880d6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 >> 172.21.15.5:0/4175628226 conn(0x7fd78801fb00 msgr2=0x7fd7880d9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 shutdown_connections 2024-09-13T17:13:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 shutdown_connections 2024-09-13T17:13:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7fd78f59e640 1 -- 172.21.15.5:0/4175628226 wait complete. 2024-09-13T17:13:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.270+0000 7f453973e640 1 -- 172.21.15.5:0/2264412202 wait complete. 2024-09-13T17:13:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.271+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f99681f81a0 con 0x7f996806aea0 2024-09-13T17:13:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.271+0000 7f994f7fe640 1 -- 172.21.15.5:0/2657724172 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99681f81a0 con 0x7f996806aea0 2024-09-13T17:13:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 msgr2=0x7f163806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f128c04ce60 con 0x7f128c036bb0 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 0x7f163806d110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1648007fd0 tx=0x7f1648009040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 msgr2=0x7f16581599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f164000c490 tx=0x7f164000c950 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 shutdown_connections 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1658160980 0x7f1658159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1658098b00 0x7f16581599c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f163806ac50 0x7f163806d110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 --2- 172.21.15.5:0/2232091732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f165806a5a0 0x7f16581554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 >> 172.21.15.5:0/2232091732 conn(0x7f1658071550 msgr2=0x7f16580b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.272+0000 7f127b7fe640 1 -- 172.21.15.5:0/3807189776 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f128c04ce60 con 0x7f128c036bb0 2024-09-13T17:13:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-09-13T17:13:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.273+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 shutdown_connections 2024-09-13T17:13:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.273+0000 7f165ccdc640 1 -- 172.21.15.5:0/2232091732 wait complete. 2024-09-13T17:13:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.274+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6980cefe0 con 0x7fc69806e1d0 2024-09-13T17:13:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.274+0000 7fc67f7fe640 1 -- 172.21.15.5:0/3794740747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6880791a0 con 0x7fc69806e1d0 2024-09-13T17:13:34.280 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-09-13T17:13:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 msgr2=0x7f995406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 0x7f995406d180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f995c034000 tx=0x7f995c02e000 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 msgr2=0x7f9968144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f995800e9b0 tx=0x7f995800ee70 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 shutdown_connections 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f995406acc0 0x7f995406d180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9968158700 0x7f99681486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f996806d680 0x7f99681481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 --2- 172.21.15.5:0/2657724172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f996806aea0 0x7f9968144490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 >> 172.21.15.5:0/2657724172 conn(0x7f9968070830 msgr2=0x7f996806dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 shutdown_connections 2024-09-13T17:13:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.275+0000 7f996d0c9640 1 -- 172.21.15.5:0/2657724172 wait complete. 2024-09-13T17:13:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 msgr2=0x7f128006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 0x7f128006d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1284006a30 tx=0x7f1284008040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 msgr2=0x7f128c04d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 0x7f128c04d140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1288031000 tx=0x7f12880046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 shutdown_connections 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f128c054070 0x7f128c04b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f128c036bb0 0x7f128c04d140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f128006ac00 0x7f128006d0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 --2- 172.21.15.5:0/3807189776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f128c036290 0x7f128c166920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 >> 172.21.15.5:0/3807189776 conn(0x7f128c01d930 msgr2=0x7f128c031ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 shutdown_connections 2024-09-13T17:13:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.276+0000 7f12991e9640 1 -- 172.21.15.5:0/3807189776 wait complete. 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 msgr2=0x7fc68406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 0x7fc68406d110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6980724c0 tx=0x7fc68c009190 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 msgr2=0x7fc6980abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc688035040 tx=0x7fc6880046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 shutdown_connections 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6981543b0 0x7fc698154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc698153830 0x7fc698153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc68406ac50 0x7fc68406d110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 --2- 172.21.15.5:0/3794740747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc69806e1d0 0x7fc6980abaf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 >> 172.21.15.5:0/3794740747 conn(0x7fc6980ce0d0 msgr2=0x7fc698155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 shutdown_connections 2024-09-13T17:13:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.278+0000 7fc69d45a640 1 -- 172.21.15.5:0/3794740747 wait complete. 2024-09-13T17:13:34.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.2 2024-09-13T17:13:34.290 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-09-13T17:13:34.294 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2024-09-13T17:13:34.295 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2024-09-13T17:13:34.297 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.1 2024-09-13T17:13:34.297 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2024-09-13T17:13:34.299 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:34.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:13:34.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.439+0000 7fb6b10f0640 1 Processor -- start 2024-09-13T17:13:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.439+0000 7fb6b10f0640 1 -- start start 2024-09-13T17:13:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6b10f0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6ac0b4cf0 0x7fb6ac0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6b10f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 0x7fb6ac0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6b10f0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac0d1e80 con 0x7fb6ac15c810 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6b10f0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac0d1750 con 0x7fb6ac0b4cf0 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6b10f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0d0bd0 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6ab59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 0x7fb6ac0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.440+0000 7fb6aa59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6ac0b4cf0 0x7fb6ac0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6aad9d640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb6ac15c810 0x7fb6ac0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:47586/0 (socket says 172.21.15.5:47586) 2024-09-13T17:13:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6aad9d640 1 -- 172.21.15.5:0/3114924779 learned_addr learned my addr 172.21.15.5:0/3114924779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6a9d9b640 1 -- 172.21.15.5:0/3114924779 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064042000 0 0) 0x7fb6ac0d1e80 con 0x7fb6ac15c810 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6a9d9b640 1 -- 172.21.15.5:0/3114924779 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb698003520 con 0x7fb6ac15c810 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6ab59e640 1 -- 172.21.15.5:0/3114924779 >> v2:172.21.15.179:3300/0 conn(0x7fb6ac0b4cf0 msgr2=0x7fb6ac0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6ab59e640 1 --2- 172.21.15.5:0/3114924779 >> v2:172.21.15.179:3300/0 conn(0x7fb6ac0b4cf0 0x7fb6ac0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6ab59e640 1 -- 172.21.15.5:0/3114924779 >> v1:172.21.15.179:6789/0 conn(0x7fb6ac15c810 legacy=0x7fb6ac0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.441+0000 7fb6ab59e640 1 -- 172.21.15.5:0/3114924779 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0d0eb0 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6ab59e640 1 --2- 172.21.15.5:0/3114924779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 0x7fb6ac0b5a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40097a0 tx=0x7fb6a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f60e444c6d1fed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6a9d9b640 1 -- 172.21.15.5:0/3114924779 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4032440 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6a9d9b640 1 -- 172.21.15.5:0/3114924779 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40325a0 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6a9d9b640 1 -- 172.21.15.5:0/3114924779 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4032930 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 -- 172.21.15.5:0/3114924779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 msgr2=0x7fb6ac0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/3114924779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 0x7fb6ac0b5a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40097a0 tx=0x7fb6a402a180 comp rx=0 tx=0).stop 2024-09-13T17:13:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 -- 172.21.15.5:0/3114924779 shutdown_connections 2024-09-13T17:13:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/3114924779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0d06d0 0x7fb6ac0b5a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/3114924779 >> v2:172.21.15.179:3300/0 conn(0x7fb6ac0b4cf0 0x7fb6ac0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 -- 172.21.15.5:0/3114924779 >> 172.21.15.5:0/3114924779 conn(0x7fb6ac0717a0 msgr2=0x7fb6ac071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 -- 172.21.15.5:0/3114924779 shutdown_connections 2024-09-13T17:13:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.442+0000 7fb6b10f0640 1 -- 172.21.15.5:0/3114924779 wait complete. 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.444+0000 7fb6b10f0640 1 Processor -- start 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.444+0000 7fb6b10f0640 1 -- start start 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0b4cf0 0x7fb6ac0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ac0d06d0 0x7fb6ac0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b40b0 con 0x7fb6ac15c810 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c76c0 con 0x7fb6ac0d06d0 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6b10f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0a9250 con 0x7fb6ac0b4cf0 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6aad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0b4cf0 0x7fb6ac0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59260/0 (socket says 172.21.15.5:59260) 2024-09-13T17:13:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 -- 172.21.15.5:0/1441204536 learned_addr learned my addr 172.21.15.5:0/1441204536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6aa59c640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ac0d06d0 0x7fb6ac0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 -- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0b4cf0 msgr2=0x7fb6ac0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0b4cf0 0x7fb6ac0c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 -- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ac0d06d0 msgr2=0x7fb6ac0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ac0d06d0 0x7fb6ac0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 -- 172.21.15.5:0/1441204536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009400 con 0x7fb6ac15c810 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6ab59e640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4035040 tx=0x7fb6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.445+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a403d830 con 0x7fb6ac15c810 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.446+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a403d9b0 con 0x7fb6ac15c810 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.446+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0c78c0 con 0x7fb6ac15c810 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.446+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a403dd60 con 0x7fb6ac15c810 2024-09-13T17:13:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.446+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac0c97f0 con 0x7fb6ac15c810 2024-09-13T17:13:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.447+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac0672a0 con 0x7fb6ac15c810 2024-09-13T17:13:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.447+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb6a4039040 con 0x7fb6ac15c810 2024-09-13T17:13:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.447+0000 7fb6a37fe640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 0x7fb68c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.448+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6a40aa060 con 0x7fb6ac15c810 2024-09-13T17:13:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.448+0000 7fb6aad9d640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 0x7fb68c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.448+0000 7fb6aad9d640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 0x7fb68c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001560 tx=0x7fb69c0019f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.452+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb6a4075000 con 0x7fb6ac15c810 2024-09-13T17:13:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.618+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6ac0d1470 con 0x7fb68c06ac00 2024-09-13T17:13:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.627+0000 7fb6a37fe640 1 -- 172.21.15.5:0/1441204536 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345283 (secure 0 0 0) 0x7fb69c001ee0 con 0x7fb68c06ac00 2024-09-13T17:13:34.633 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:13:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 msgr2=0x7fb68c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 0x7fb68c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001560 tx=0x7fb69c0019f0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 msgr2=0x7fb6ac1f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4035040 tx=0x7fb6a40046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 shutdown_connections 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68c06ac00 0x7fb68c06d0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6ac15c810 0x7fb6ac1f1d50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6ac0d06d0 0x7fb6ac0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 --2- 172.21.15.5:0/1441204536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6ac0b4cf0 0x7fb6ac0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.630+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 >> 172.21.15.5:0/1441204536 conn(0x7fb6ac0717a0 msgr2=0x7fb6ac071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.631+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 shutdown_connections 2024-09-13T17:13:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.631+0000 7fb6b10f0640 1 -- 172.21.15.5:0/1441204536 wait complete. 2024-09-13T17:13:34.643 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T17:13:33.260876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003266"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195149+0000","last_change":"2024-09-13T17:13:07.818703+0000","last_active":"2024-09-13T17:13:12.195149+0000","last_peered":"2024-09-13T17:13:12.195149+0000","last_clean":"2024-09-13T17:13:12.195149+0000","last_became_active":"2024-09-13T17:13:07.818425+0000","last_became_peered":"2024-09-13T17:13:07.818425+0000","last_unstale":"2024-09-13T17:13:12.195149+0000","last_undegraded":"2024-09-13T17:13:12.195149+0000","last_fullsized":"2024-09-13T17:13:12.195149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273719+0000","last_change":"2024-09-13T17:13:08.182685+0000","last_active":"2024-09-13T17:13:12.273719+0000","last_peered":"2024-09-13T17:13:12.273719+0000","last_clean":"2024-09-13T17:13:12.273719+0000","last_became_active":"2024-09-13T17:13:08.182447+0000","last_became_peered":"2024-09-13T17:13:08.182447+0000","last_unstale":"2024-09-13T17:13:12.273719+0000","last_undegraded":"2024-09-13T17:13:12.273719+0000","last_fullsized":"2024-09-13T17:13:12.273719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273620+0000","last_change":"2024-09-13T17:13:12.223668+0000","last_active":"2024-09-13T17:13:12.273620+0000","last_peered":"2024-09-13T17:13:12.273620+0000","last_clean":"2024-09-13T17:13:12.273620+0000","last_became_active":"2024-09-13T17:13:12.223255+0000","last_became_peered":"2024-09-13T17:13:12.223255+0000","last_unstale":"2024-09-13T17:13:12.273620+0000","last_undegraded":"2024-09-13T17:13:12.273620+0000","last_fullsized":"2024-09-13T17:13:12.273620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193136+0000","last_change":"2024-09-13T17:13:07.820516+0000","last_active":"2024-09-13T17:13:12.193136+0000","last_peered":"2024-09-13T17:13:12.193136+0000","last_clean":"2024-09-13T17:13:12.193136+0000","last_became_active":"2024-09-13T17:13:07.820233+0000","last_became_peered":"2024-09-13T17:13:07.820233+0000","last_unstale":"2024-09-13T17:13:12.193136+0000","last_undegraded":"2024-09-13T17:13:12.193136+0000","last_fullsized":"2024-09-13T17:13:12.193136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270669+0000","last_change":"2024-09-13T17:13:08.185959+0000","last_active":"2024-09-13T17:13:12.270669+0000","last_peered":"2024-09-13T17:13:12.270669+0000","last_clean":"2024-09-13T17:13:12.270669+0000","last_became_active":"2024-09-13T17:13:08.185705+0000","last_became_peered":"2024-09-13T17:13:08.185705+0000","last_unstale":"2024-09-13T17:13:12.270669+0000","last_undegraded":"2024-09-13T17:13:12.270669+0000","last_fullsized":"2024-09-13T17:13:12.270669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273272+0000","last_change":"2024-09-13T17:13:12.202324+0000","last_active":"2024-09-13T17:13:12.273272+0000","last_peered":"2024-09-13T17:13:12.273272+0000","last_clean":"2024-09-13T17:13:12.273272+0000","last_became_active":"2024-09-13T17:13:12.201852+0000","last_became_peered":"2024-09-13T17:13:12.201852+0000","last_unstale":"2024-09-13T17:13:12.273272+0000","last_undegraded":"2024-09-13T17:13:12.273272+0000","last_fullsized":"2024-09-13T17:13:12.273272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.222040+0000","last_change":"2024-09-13T17:13:07.823003+0000","last_active":"2024-09-13T17:13:12.222040+0000","last_peered":"2024-09-13T17:13:12.222040+0000","last_clean":"2024-09-13T17:13:12.222040+0000","last_became_active":"2024-09-13T17:13:07.822719+0000","last_became_peered":"2024-09-13T17:13:07.822719+0000","last_unstale":"2024-09-13T17:13:12.222040+0000","last_undegraded":"2024-09-13T17:13:12.222040+0000","last_fullsized":"2024-09-13T17:13:12.222040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:18.156159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272024+0000","last_change":"2024-09-13T17:13:08.183825+0000","last_active":"2024-09-13T17:13:12.272024+0000","last_peered":"2024-09-13T17:13:12.272024+0000","last_clean":"2024-09-13T17:13:12.272024+0000","last_became_active":"2024-09-13T17:13:08.183509+0000","last_became_peered":"2024-09-13T17:13:08.183509+0000","last_unstale":"2024-09-13T17:13:12.272024+0000","last_undegraded":"2024-09-13T17:13:12.272024+0000","last_fullsized":"2024-09-13T17:13:12.272024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273360+0000","last_change":"2024-09-13T17:13:12.204784+0000","last_active":"2024-09-13T17:13:12.273360+0000","last_peered":"2024-09-13T17:13:12.273360+0000","last_clean":"2024-09-13T17:13:12.273360+0000","last_became_active":"2024-09-13T17:13:12.203462+0000","last_became_peered":"2024-09-13T17:13:12.203462+0000","last_unstale":"2024-09-13T17:13:12.273360+0000","last_undegraded":"2024-09-13T17:13:12.273360+0000","last_fullsized":"2024-09-13T17:13:12.273360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221256+0000","last_change":"2024-09-13T17:13:07.822927+0000","last_active":"2024-09-13T17:13:12.221256+0000","last_peered":"2024-09-13T17:13:12.221256+0000","last_clean":"2024-09-13T17:13:12.221256+0000","last_became_active":"2024-09-13T17:13:07.822552+0000","last_became_peered":"2024-09-13T17:13:07.822552+0000","last_unstale":"2024-09-13T17:13:12.221256+0000","last_undegraded":"2024-09-13T17:13:12.221256+0000","last_fullsized":"2024-09-13T17:13:12.221256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272055+0000","last_change":"2024-09-13T17:13:08.184922+0000","last_active":"2024-09-13T17:13:12.272055+0000","last_peered":"2024-09-13T17:13:12.272055+0000","last_clean":"2024-09-13T17:13:12.272055+0000","last_became_active":"2024-09-13T17:13:08.184640+0000","last_became_peered":"2024-09-13T17:13:08.184640+0000","last_unstale":"2024-09-13T17:13:12.272055+0000","last_undegraded":"2024-09-13T17:13:12.272055+0000","last_fullsized":"2024-09-13T17:13:12.272055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273329+0000","last_change":"2024-09-13T17:13:12.202312+0000","last_active":"2024-09-13T17:13:12.273329+0000","last_peered":"2024-09-13T17:13:12.273329+0000","last_clean":"2024-09-13T17:13:12.273329+0000","last_became_active":"2024-09-13T17:13:12.201870+0000","last_became_peered":"2024-09-13T17:13:12.201870+0000","last_unstale":"2024-09-13T17:13:12.273329+0000","last_undegraded":"2024-09-13T17:13:12.273329+0000","last_fullsized":"2024-09-13T17:13:12.273329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:13.831220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272599+0000","last_change":"2024-09-13T17:13:08.183978+0000","last_active":"2024-09-13T17:13:12.272599+0000","last_peered":"2024-09-13T17:13:12.272599+0000","last_clean":"2024-09-13T17:13:12.272599+0000","last_became_active":"2024-09-13T17:13:08.183697+0000","last_became_peered":"2024-09-13T17:13:08.183697+0000","last_unstale":"2024-09-13T17:13:12.272599+0000","last_undegraded":"2024-09-13T17:13:12.272599+0000","last_fullsized":"2024-09-13T17:13:12.272599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221213+0000","last_change":"2024-09-13T17:13:07.823217+0000","last_active":"2024-09-13T17:13:12.221213+0000","last_peered":"2024-09-13T17:13:12.221213+0000","last_clean":"2024-09-13T17:13:12.221213+0000","last_became_active":"2024-09-13T17:13:07.822960+0000","last_became_peered":"2024-09-13T17:13:07.822960+0000","last_unstale":"2024-09-13T17:13:12.221213+0000","last_undegraded":"2024-09-13T17:13:12.221213+0000","last_fullsized":"2024-09-13T17:13:12.221213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273425+0000","last_change":"2024-09-13T17:13:12.203048+0000","last_active":"2024-09-13T17:13:12.273425+0000","last_peered":"2024-09-13T17:13:12.273425+0000","last_clean":"2024-09-13T17:13:12.273425+0000","last_became_active":"2024-09-13T17:13:12.202566+0000","last_became_peered":"2024-09-13T17:13:12.202566+0000","last_unstale":"2024-09-13T17:13:12.273425+0000","last_undegraded":"2024-09-13T17:13:12.273425+0000","last_fullsized":"2024-09-13T17:13:12.273425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:22.271791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273675+0000","last_change":"2024-09-13T17:13:08.185754+0000","last_active":"2024-09-13T17:13:12.273675+0000","last_peered":"2024-09-13T17:13:12.273675+0000","last_clean":"2024-09-13T17:13:12.273675+0000","last_became_active":"2024-09-13T17:13:08.184827+0000","last_became_peered":"2024-09-13T17:13:08.184827+0000","last_unstale":"2024-09-13T17:13:12.273675+0000","last_undegraded":"2024-09-13T17:13:12.273675+0000","last_fullsized":"2024-09-13T17:13:12.273675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193832+0000","last_change":"2024-09-13T17:13:07.821299+0000","last_active":"2024-09-13T17:13:12.193832+0000","last_peered":"2024-09-13T17:13:12.193832+0000","last_clean":"2024-09-13T17:13:12.193832+0000","last_became_active":"2024-09-13T17:13:07.820971+0000","last_became_peered":"2024-09-13T17:13:07.820971+0000","last_unstale":"2024-09-13T17:13:12.193832+0000","last_undegraded":"2024-09-13T17:13:12.193832+0000","last_fullsized":"2024-09-13T17:13:12.193832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273393+0000","last_change":"2024-09-13T17:13:12.207075+0000","last_active":"2024-09-13T17:13:12.273393+0000","last_peered":"2024-09-13T17:13:12.273393+0000","last_clean":"2024-09-13T17:13:12.273393+0000","last_became_active":"2024-09-13T17:13:12.206675+0000","last_became_peered":"2024-09-13T17:13:12.206675+0000","last_unstale":"2024-09-13T17:13:12.273393+0000","last_undegraded":"2024-09-13T17:13:12.273393+0000","last_fullsized":"2024-09-13T17:13:12.273393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273611+0000","last_change":"2024-09-13T17:13:08.179110+0000","last_active":"2024-09-13T17:13:12.273611+0000","last_peered":"2024-09-13T17:13:12.273611+0000","last_clean":"2024-09-13T17:13:12.273611+0000","last_became_active":"2024-09-13T17:13:08.178363+0000","last_became_peered":"2024-09-13T17:13:08.178363+0000","last_unstale":"2024-09-13T17:13:12.273611+0000","last_undegraded":"2024-09-13T17:13:12.273611+0000","last_fullsized":"2024-09-13T17:13:12.273611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190765+0000","last_change":"2024-09-13T17:13:07.817732+0000","last_active":"2024-09-13T17:13:12.190765+0000","last_peered":"2024-09-13T17:13:12.190765+0000","last_clean":"2024-09-13T17:13:12.190765+0000","last_became_active":"2024-09-13T17:13:07.817449+0000","last_became_peered":"2024-09-13T17:13:07.817449+0000","last_unstale":"2024-09-13T17:13:12.190765+0000","last_undegraded":"2024-09-13T17:13:12.190765+0000","last_fullsized":"2024-09-13T17:13:12.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271705+0000","last_change":"2024-09-13T17:13:12.224085+0000","last_active":"2024-09-13T17:13:12.271705+0000","last_peered":"2024-09-13T17:13:12.271705+0000","last_clean":"2024-09-13T17:13:12.271705+0000","last_became_active":"2024-09-13T17:13:12.223683+0000","last_became_peered":"2024-09-13T17:13:12.223683+0000","last_unstale":"2024-09-13T17:13:12.271705+0000","last_undegraded":"2024-09-13T17:13:12.271705+0000","last_fullsized":"2024-09-13T17:13:12.271705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:49.009307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273320+0000","last_change":"2024-09-13T17:13:08.176665+0000","last_active":"2024-09-13T17:13:12.273320+0000","last_peered":"2024-09-13T17:13:12.273320+0000","last_clean":"2024-09-13T17:13:12.273320+0000","last_became_active":"2024-09-13T17:13:08.176310+0000","last_became_peered":"2024-09-13T17:13:08.176310+0000","last_unstale":"2024-09-13T17:13:12.273320+0000","last_undegraded":"2024-09-13T17:13:12.273320+0000","last_fullsized":"2024-09-13T17:13:12.273320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:08.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220596+0000","last_change":"2024-09-13T17:13:07.823315+0000","last_active":"2024-09-13T17:13:12.220596+0000","last_peered":"2024-09-13T17:13:12.220596+0000","last_clean":"2024-09-13T17:13:12.220596+0000","last_became_active":"2024-09-13T17:13:07.822797+0000","last_became_peered":"2024-09-13T17:13:07.822797+0000","last_unstale":"2024-09-13T17:13:12.220596+0000","last_undegraded":"2024-09-13T17:13:12.220596+0000","last_fullsized":"2024-09-13T17:13:12.220596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:23.750435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273442+0000","last_change":"2024-09-13T17:13:12.205036+0000","last_active":"2024-09-13T17:13:12.273442+0000","last_peered":"2024-09-13T17:13:12.273442+0000","last_clean":"2024-09-13T17:13:12.273442+0000","last_became_active":"2024-09-13T17:13:12.204585+0000","last_became_peered":"2024-09-13T17:13:12.204585+0000","last_unstale":"2024-09-13T17:13:12.273442+0000","last_undegraded":"2024-09-13T17:13:12.273442+0000","last_fullsized":"2024-09-13T17:13:12.273442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270653+0000","last_change":"2024-09-13T17:13:08.177098+0000","last_active":"2024-09-13T17:13:12.270653+0000","last_peered":"2024-09-13T17:13:12.270653+0000","last_clean":"2024-09-13T17:13:12.270653+0000","last_became_active":"2024-09-13T17:13:08.176776+0000","last_became_peered":"2024-09-13T17:13:08.176776+0000","last_unstale":"2024-09-13T17:13:12.270653+0000","last_undegraded":"2024-09-13T17:13:12.270653+0000","last_fullsized":"2024-09-13T17:13:12.270653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195520+0000","last_change":"2024-09-13T17:13:07.824199+0000","last_active":"2024-09-13T17:13:12.195520+0000","last_peered":"2024-09-13T17:13:12.195520+0000","last_clean":"2024-09-13T17:13:12.195520+0000","last_became_active":"2024-09-13T17:13:07.823911+0000","last_became_peered":"2024-09-13T17:13:07.823911+0000","last_unstale":"2024-09-13T17:13:12.195520+0000","last_undegraded":"2024-09-13T17:13:12.195520+0000","last_fullsized":"2024-09-13T17:13:12.195520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273309+0000","last_change":"2024-09-13T17:13:12.225869+0000","last_active":"2024-09-13T17:13:12.273309+0000","last_peered":"2024-09-13T17:13:12.273309+0000","last_clean":"2024-09-13T17:13:12.273309+0000","last_became_active":"2024-09-13T17:13:12.225019+0000","last_became_peered":"2024-09-13T17:13:12.225019+0000","last_unstale":"2024-09-13T17:13:12.273309+0000","last_undegraded":"2024-09-13T17:13:12.273309+0000","last_fullsized":"2024-09-13T17:13:12.273309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273755+0000","last_change":"2024-09-13T17:13:08.191978+0000","last_active":"2024-09-13T17:13:12.273755+0000","last_peered":"2024-09-13T17:13:12.273755+0000","last_clean":"2024-09-13T17:13:12.273755+0000","last_became_active":"2024-09-13T17:13:08.191706+0000","last_became_peered":"2024-09-13T17:13:08.191706+0000","last_unstale":"2024-09-13T17:13:12.273755+0000","last_undegraded":"2024-09-13T17:13:12.273755+0000","last_fullsized":"2024-09-13T17:13:12.273755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.397971+0000","last_change":"2024-09-13T17:13:07.818785+0000","last_active":"2024-09-13T17:13:12.397971+0000","last_peered":"2024-09-13T17:13:12.397971+0000","last_clean":"2024-09-13T17:13:12.397971+0000","last_became_active":"2024-09-13T17:13:07.818279+0000","last_became_peered":"2024-09-13T17:13:07.818279+0000","last_unstale":"2024-09-13T17:13:12.397971+0000","last_undegraded":"2024-09-13T17:13:12.397971+0000","last_fullsized":"2024-09-13T17:13:12.397971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273550+0000","last_change":"2024-09-13T17:13:12.224503+0000","last_active":"2024-09-13T17:13:12.273550+0000","last_peered":"2024-09-13T17:13:12.273550+0000","last_clean":"2024-09-13T17:13:12.273550+0000","last_became_active":"2024-09-13T17:13:12.224159+0000","last_became_peered":"2024-09-13T17:13:12.224159+0000","last_unstale":"2024-09-13T17:13:12.273550+0000","last_undegraded":"2024-09-13T17:13:12.273550+0000","last_fullsized":"2024-09-13T17:13:12.273550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.258345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271614+0000","last_change":"2024-09-13T17:13:08.175329+0000","last_active":"2024-09-13T17:13:12.271614+0000","last_peered":"2024-09-13T17:13:12.271614+0000","last_clean":"2024-09-13T17:13:12.271614+0000","last_became_active":"2024-09-13T17:13:08.174912+0000","last_became_peered":"2024-09-13T17:13:08.174912+0000","last_unstale":"2024-09-13T17:13:12.271614+0000","last_undegraded":"2024-09-13T17:13:12.271614+0000","last_fullsized":"2024-09-13T17:13:12.271614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221792+0000","last_change":"2024-09-13T17:13:07.823709+0000","last_active":"2024-09-13T17:13:12.221792+0000","last_peered":"2024-09-13T17:13:12.221792+0000","last_clean":"2024-09-13T17:13:12.221792+0000","last_became_active":"2024-09-13T17:13:07.823325+0000","last_became_peered":"2024-09-13T17:13:07.823325+0000","last_unstale":"2024-09-13T17:13:12.221792+0000","last_undegraded":"2024-09-13T17:13:12.221792+0000","last_fullsized":"2024-09-13T17:13:12.221792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270544+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.270544+0000","last_peered":"2024-09-13T17:13:12.270544+0000","last_clean":"2024-09-13T17:13:12.270544+0000","last_became_active":"2024-09-13T17:13:12.221821+0000","last_became_peered":"2024-09-13T17:13:12.221821+0000","last_unstale":"2024-09-13T17:13:12.270544+0000","last_undegraded":"2024-09-13T17:13:12.270544+0000","last_fullsized":"2024-09-13T17:13:12.270544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272069+0000","last_change":"2024-09-13T17:13:08.181489+0000","last_active":"2024-09-13T17:13:12.272069+0000","last_peered":"2024-09-13T17:13:12.272069+0000","last_clean":"2024-09-13T17:13:12.272069+0000","last_became_active":"2024-09-13T17:13:08.181204+0000","last_became_peered":"2024-09-13T17:13:08.181204+0000","last_unstale":"2024-09-13T17:13:12.272069+0000","last_undegraded":"2024-09-13T17:13:12.272069+0000","last_fullsized":"2024-09-13T17:13:12.272069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.197571+0000","last_change":"2024-09-13T17:13:07.818661+0000","last_active":"2024-09-13T17:13:12.197571+0000","last_peered":"2024-09-13T17:13:12.197571+0000","last_clean":"2024-09-13T17:13:12.197571+0000","last_became_active":"2024-09-13T17:13:07.818317+0000","last_became_peered":"2024-09-13T17:13:07.818317+0000","last_unstale":"2024-09-13T17:13:12.197571+0000","last_undegraded":"2024-09-13T17:13:12.197571+0000","last_fullsized":"2024-09-13T17:13:12.197571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271543+0000","last_change":"2024-09-13T17:13:12.202522+0000","last_active":"2024-09-13T17:13:12.271543+0000","last_peered":"2024-09-13T17:13:12.271543+0000","last_clean":"2024-09-13T17:13:12.271543+0000","last_became_active":"2024-09-13T17:13:12.202110+0000","last_became_peered":"2024-09-13T17:13:12.202110+0000","last_unstale":"2024-09-13T17:13:12.271543+0000","last_undegraded":"2024-09-13T17:13:12.271543+0000","last_fullsized":"2024-09-13T17:13:12.271543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273382+0000","last_change":"2024-09-13T17:13:08.179940+0000","last_active":"2024-09-13T17:13:12.273382+0000","last_peered":"2024-09-13T17:13:12.273382+0000","last_clean":"2024-09-13T17:13:12.273382+0000","last_became_active":"2024-09-13T17:13:08.179628+0000","last_became_peered":"2024-09-13T17:13:08.179628+0000","last_unstale":"2024-09-13T17:13:12.273382+0000","last_undegraded":"2024-09-13T17:13:12.273382+0000","last_fullsized":"2024-09-13T17:13:12.273382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:11.564848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190045+0000","last_change":"2024-09-13T17:13:07.821156+0000","last_active":"2024-09-13T17:13:12.190045+0000","last_peered":"2024-09-13T17:13:12.190045+0000","last_clean":"2024-09-13T17:13:12.190045+0000","last_became_active":"2024-09-13T17:13:07.820920+0000","last_became_peered":"2024-09-13T17:13:07.820920+0000","last_unstale":"2024-09-13T17:13:12.190045+0000","last_undegraded":"2024-09-13T17:13:12.190045+0000","last_fullsized":"2024-09-13T17:13:12.190045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271588+0000","last_change":"2024-09-13T17:13:12.210655+0000","last_active":"2024-09-13T17:13:12.271588+0000","last_peered":"2024-09-13T17:13:12.271588+0000","last_clean":"2024-09-13T17:13:12.271588+0000","last_became_active":"2024-09-13T17:13:12.209944+0000","last_became_peered":"2024-09-13T17:13:12.209944+0000","last_unstale":"2024-09-13T17:13:12.271588+0000","last_undegraded":"2024-09-13T17:13:12.271588+0000","last_fullsized":"2024-09-13T17:13:12.271588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271470+0000","last_change":"2024-09-13T17:13:08.175084+0000","last_active":"2024-09-13T17:13:12.271470+0000","last_peered":"2024-09-13T17:13:12.271470+0000","last_clean":"2024-09-13T17:13:12.271470+0000","last_became_active":"2024-09-13T17:13:08.174696+0000","last_became_peered":"2024-09-13T17:13:08.174696+0000","last_unstale":"2024-09-13T17:13:12.271470+0000","last_undegraded":"2024-09-13T17:13:12.271470+0000","last_fullsized":"2024-09-13T17:13:12.271470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186429+0000","last_change":"2024-09-13T17:13:07.820916+0000","last_active":"2024-09-13T17:13:12.186429+0000","last_peered":"2024-09-13T17:13:12.186429+0000","last_clean":"2024-09-13T17:13:12.186429+0000","last_became_active":"2024-09-13T17:13:07.820607+0000","last_became_peered":"2024-09-13T17:13:07.820607+0000","last_unstale":"2024-09-13T17:13:12.186429+0000","last_undegraded":"2024-09-13T17:13:12.186429+0000","last_fullsized":"2024-09-13T17:13:12.186429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271720+0000","last_change":"2024-09-13T17:13:12.209459+0000","last_active":"2024-09-13T17:13:12.271720+0000","last_peered":"2024-09-13T17:13:12.271720+0000","last_clean":"2024-09-13T17:13:12.271720+0000","last_became_active":"2024-09-13T17:13:12.208931+0000","last_became_peered":"2024-09-13T17:13:12.208931+0000","last_unstale":"2024-09-13T17:13:12.271720+0000","last_undegraded":"2024-09-13T17:13:12.271720+0000","last_fullsized":"2024-09-13T17:13:12.271720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270503+0000","last_change":"2024-09-13T17:13:08.180268+0000","last_active":"2024-09-13T17:13:12.270503+0000","last_peered":"2024-09-13T17:13:12.270503+0000","last_clean":"2024-09-13T17:13:12.270503+0000","last_became_active":"2024-09-13T17:13:08.179711+0000","last_became_peered":"2024-09-13T17:13:08.179711+0000","last_unstale":"2024-09-13T17:13:12.270503+0000","last_undegraded":"2024-09-13T17:13:12.270503+0000","last_fullsized":"2024-09-13T17:13:12.270503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:07.540508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220632+0000","last_change":"2024-09-13T17:13:07.823838+0000","last_active":"2024-09-13T17:13:12.220632+0000","last_peered":"2024-09-13T17:13:12.220632+0000","last_clean":"2024-09-13T17:13:12.220632+0000","last_became_active":"2024-09-13T17:13:07.823558+0000","last_became_peered":"2024-09-13T17:13:07.823558+0000","last_unstale":"2024-09-13T17:13:12.220632+0000","last_undegraded":"2024-09-13T17:13:12.220632+0000","last_fullsized":"2024-09-13T17:13:12.220632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270643+0000","last_change":"2024-09-13T17:13:12.222477+0000","last_active":"2024-09-13T17:13:12.270643+0000","last_peered":"2024-09-13T17:13:12.270643+0000","last_clean":"2024-09-13T17:13:12.270643+0000","last_became_active":"2024-09-13T17:13:12.221879+0000","last_became_peered":"2024-09-13T17:13:12.221879+0000","last_unstale":"2024-09-13T17:13:12.270643+0000","last_undegraded":"2024-09-13T17:13:12.270643+0000","last_fullsized":"2024-09-13T17:13:12.270643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273658+0000","last_change":"2024-09-13T17:13:08.185879+0000","last_active":"2024-09-13T17:13:12.273658+0000","last_peered":"2024-09-13T17:13:12.273658+0000","last_clean":"2024-09-13T17:13:12.273658+0000","last_became_active":"2024-09-13T17:13:08.185632+0000","last_became_peered":"2024-09-13T17:13:08.185632+0000","last_unstale":"2024-09-13T17:13:12.273658+0000","last_undegraded":"2024-09-13T17:13:12.273658+0000","last_fullsized":"2024-09-13T17:13:12.273658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.187815+0000","last_change":"2024-09-13T17:13:07.811868+0000","last_active":"2024-09-13T17:13:12.187815+0000","last_peered":"2024-09-13T17:13:12.187815+0000","last_clean":"2024-09-13T17:13:12.187815+0000","last_became_active":"2024-09-13T17:13:07.811535+0000","last_became_peered":"2024-09-13T17:13:07.811535+0000","last_unstale":"2024-09-13T17:13:12.187815+0000","last_undegraded":"2024-09-13T17:13:12.187815+0000","last_fullsized":"2024-09-13T17:13:12.187815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220708+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:13:12.220708+0000","last_peered":"2024-09-13T17:13:12.220708+0000","last_clean":"2024-09-13T17:13:12.220708+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:13:12.220708+0000","last_undegraded":"2024-09-13T17:13:12.220708+0000","last_fullsized":"2024-09-13T17:13:12.220708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272664+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.272664+0000","last_peered":"2024-09-13T17:13:12.272664+0000","last_clean":"2024-09-13T17:13:12.272664+0000","last_became_active":"2024-09-13T17:13:12.223344+0000","last_became_peered":"2024-09-13T17:13:12.223344+0000","last_unstale":"2024-09-13T17:13:12.272664+0000","last_undegraded":"2024-09-13T17:13:12.272664+0000","last_fullsized":"2024-09-13T17:13:12.272664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.318166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272521+0000","last_change":"2024-09-13T17:13:08.195358+0000","last_active":"2024-09-13T17:13:12.272521+0000","last_peered":"2024-09-13T17:13:12.272521+0000","last_clean":"2024-09-13T17:13:12.272521+0000","last_became_active":"2024-09-13T17:13:08.194963+0000","last_became_peered":"2024-09-13T17:13:08.194963+0000","last_unstale":"2024-09-13T17:13:12.272521+0000","last_undegraded":"2024-09-13T17:13:12.272521+0000","last_fullsized":"2024-09-13T17:13:12.272521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186435+0000","last_change":"2024-09-13T17:13:07.814854+0000","last_active":"2024-09-13T17:13:12.186435+0000","last_peered":"2024-09-13T17:13:12.186435+0000","last_clean":"2024-09-13T17:13:12.186435+0000","last_became_active":"2024-09-13T17:13:07.814526+0000","last_became_peered":"2024-09-13T17:13:07.814526+0000","last_unstale":"2024-09-13T17:13:12.186435+0000","last_undegraded":"2024-09-13T17:13:12.186435+0000","last_fullsized":"2024-09-13T17:13:12.186435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272579+0000","last_change":"2024-09-13T17:13:12.222081+0000","last_active":"2024-09-13T17:13:12.272579+0000","last_peered":"2024-09-13T17:13:12.272579+0000","last_clean":"2024-09-13T17:13:12.272579+0000","last_became_active":"2024-09-13T17:13:12.221687+0000","last_became_peered":"2024-09-13T17:13:12.221687+0000","last_unstale":"2024-09-13T17:13:12.272579+0000","last_undegraded":"2024-09-13T17:13:12.272579+0000","last_fullsized":"2024-09-13T17:13:12.272579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272033+0000","last_change":"2024-09-13T17:13:08.181540+0000","last_active":"2024-09-13T17:13:12.272033+0000","last_peered":"2024-09-13T17:13:12.272033+0000","last_clean":"2024-09-13T17:13:12.272033+0000","last_became_active":"2024-09-13T17:13:08.181238+0000","last_became_peered":"2024-09-13T17:13:08.181238+0000","last_unstale":"2024-09-13T17:13:12.272033+0000","last_undegraded":"2024-09-13T17:13:12.272033+0000","last_fullsized":"2024-09-13T17:13:12.272033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191480+0000","last_change":"2024-09-13T17:13:07.818858+0000","last_active":"2024-09-13T17:13:12.191480+0000","last_peered":"2024-09-13T17:13:12.191480+0000","last_clean":"2024-09-13T17:13:12.191480+0000","last_became_active":"2024-09-13T17:13:07.818565+0000","last_became_peered":"2024-09-13T17:13:07.818565+0000","last_unstale":"2024-09-13T17:13:12.191480+0000","last_undegraded":"2024-09-13T17:13:12.191480+0000","last_fullsized":"2024-09-13T17:13:12.191480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270562+0000","last_change":"2024-09-13T17:13:12.203489+0000","last_active":"2024-09-13T17:13:12.270562+0000","last_peered":"2024-09-13T17:13:12.270562+0000","last_clean":"2024-09-13T17:13:12.270562+0000","last_became_active":"2024-09-13T17:13:12.203032+0000","last_became_peered":"2024-09-13T17:13:12.203032+0000","last_unstale":"2024-09-13T17:13:12.270562+0000","last_undegraded":"2024-09-13T17:13:12.270562+0000","last_fullsized":"2024-09-13T17:13:12.270562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272603+0000","last_change":"2024-09-13T17:13:08.194162+0000","last_active":"2024-09-13T17:13:12.272603+0000","last_peered":"2024-09-13T17:13:12.272603+0000","last_clean":"2024-09-13T17:13:12.272603+0000","last_became_active":"2024-09-13T17:13:08.193901+0000","last_became_peered":"2024-09-13T17:13:08.193901+0000","last_unstale":"2024-09-13T17:13:12.272603+0000","last_undegraded":"2024-09-13T17:13:12.272603+0000","last_fullsized":"2024-09-13T17:13:12.272603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186482+0000","last_change":"2024-09-13T17:13:07.821914+0000","last_active":"2024-09-13T17:13:12.186482+0000","last_peered":"2024-09-13T17:13:12.186482+0000","last_clean":"2024-09-13T17:13:12.186482+0000","last_became_active":"2024-09-13T17:13:07.821626+0000","last_became_peered":"2024-09-13T17:13:07.821626+0000","last_unstale":"2024-09-13T17:13:12.186482+0000","last_undegraded":"2024-09-13T17:13:12.186482+0000","last_fullsized":"2024-09-13T17:13:12.186482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271889+0000","last_change":"2024-09-13T17:13:12.223827+0000","last_active":"2024-09-13T17:13:12.271889+0000","last_peered":"2024-09-13T17:13:12.271889+0000","last_clean":"2024-09-13T17:13:12.271889+0000","last_became_active":"2024-09-13T17:13:12.223230+0000","last_became_peered":"2024-09-13T17:13:12.223230+0000","last_unstale":"2024-09-13T17:13:12.271889+0000","last_undegraded":"2024-09-13T17:13:12.271889+0000","last_fullsized":"2024-09-13T17:13:12.271889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272574+0000","last_change":"2024-09-13T17:13:08.194775+0000","last_active":"2024-09-13T17:13:12.272574+0000","last_peered":"2024-09-13T17:13:12.272574+0000","last_clean":"2024-09-13T17:13:12.272574+0000","last_became_active":"2024-09-13T17:13:08.194500+0000","last_became_peered":"2024-09-13T17:13:08.194500+0000","last_unstale":"2024-09-13T17:13:12.272574+0000","last_undegraded":"2024-09-13T17:13:12.272574+0000","last_fullsized":"2024-09-13T17:13:12.272574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188626+0000","last_change":"2024-09-13T17:13:07.812760+0000","last_active":"2024-09-13T17:13:12.188626+0000","last_peered":"2024-09-13T17:13:12.188626+0000","last_clean":"2024-09-13T17:13:12.188626+0000","last_became_active":"2024-09-13T17:13:07.812481+0000","last_became_peered":"2024-09-13T17:13:07.812481+0000","last_unstale":"2024-09-13T17:13:12.188626+0000","last_undegraded":"2024-09-13T17:13:12.188626+0000","last_fullsized":"2024-09-13T17:13:12.188626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273298+0000","last_change":"2024-09-13T17:13:12.203001+0000","last_active":"2024-09-13T17:13:12.273298+0000","last_peered":"2024-09-13T17:13:12.273298+0000","last_clean":"2024-09-13T17:13:12.273298+0000","last_became_active":"2024-09-13T17:13:12.201855+0000","last_became_peered":"2024-09-13T17:13:12.201855+0000","last_unstale":"2024-09-13T17:13:12.273298+0000","last_undegraded":"2024-09-13T17:13:12.273298+0000","last_fullsized":"2024-09-13T17:13:12.273298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272432+0000","last_change":"2024-09-13T17:13:08.195578+0000","last_active":"2024-09-13T17:13:12.272432+0000","last_peered":"2024-09-13T17:13:12.272432+0000","last_clean":"2024-09-13T17:13:12.272432+0000","last_became_active":"2024-09-13T17:13:08.195118+0000","last_became_peered":"2024-09-13T17:13:08.195118+0000","last_unstale":"2024-09-13T17:13:12.272432+0000","last_undegraded":"2024-09-13T17:13:12.272432+0000","last_fullsized":"2024-09-13T17:13:12.272432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186263+0000","last_change":"2024-09-13T17:13:07.819737+0000","last_active":"2024-09-13T17:13:12.186263+0000","last_peered":"2024-09-13T17:13:12.186263+0000","last_clean":"2024-09-13T17:13:12.186263+0000","last_became_active":"2024-09-13T17:13:07.819435+0000","last_became_peered":"2024-09-13T17:13:07.819435+0000","last_unstale":"2024-09-13T17:13:12.186263+0000","last_undegraded":"2024-09-13T17:13:12.186263+0000","last_fullsized":"2024-09-13T17:13:12.186263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270633+0000","last_change":"2024-09-13T17:13:12.204881+0000","last_active":"2024-09-13T17:13:12.270633+0000","last_peered":"2024-09-13T17:13:12.270633+0000","last_clean":"2024-09-13T17:13:12.270633+0000","last_became_active":"2024-09-13T17:13:12.204492+0000","last_became_peered":"2024-09-13T17:13:12.204492+0000","last_unstale":"2024-09-13T17:13:12.270633+0000","last_undegraded":"2024-09-13T17:13:12.270633+0000","last_fullsized":"2024-09-13T17:13:12.270633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:26.315225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272551+0000","last_change":"2024-09-13T17:13:08.187413+0000","last_active":"2024-09-13T17:13:12.272551+0000","last_peered":"2024-09-13T17:13:12.272551+0000","last_clean":"2024-09-13T17:13:12.272551+0000","last_became_active":"2024-09-13T17:13:08.187156+0000","last_became_peered":"2024-09-13T17:13:08.187156+0000","last_unstale":"2024-09-13T17:13:12.272551+0000","last_undegraded":"2024-09-13T17:13:12.272551+0000","last_fullsized":"2024-09-13T17:13:12.272551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194011+0000","last_change":"2024-09-13T17:13:07.816811+0000","last_active":"2024-09-13T17:13:12.194011+0000","last_peered":"2024-09-13T17:13:12.194011+0000","last_clean":"2024-09-13T17:13:12.194011+0000","last_became_active":"2024-09-13T17:13:07.816486+0000","last_became_peered":"2024-09-13T17:13:07.816486+0000","last_unstale":"2024-09-13T17:13:12.194011+0000","last_undegraded":"2024-09-13T17:13:12.194011+0000","last_fullsized":"2024-09-13T17:13:12.194011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273738+0000","last_change":"2024-09-13T17:13:12.222779+0000","last_active":"2024-09-13T17:13:12.273738+0000","last_peered":"2024-09-13T17:13:12.273738+0000","last_clean":"2024-09-13T17:13:12.273738+0000","last_became_active":"2024-09-13T17:13:12.222431+0000","last_became_peered":"2024-09-13T17:13:12.222431+0000","last_unstale":"2024-09-13T17:13:12.273738+0000","last_undegraded":"2024-09-13T17:13:12.273738+0000","last_fullsized":"2024-09-13T17:13:12.273738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:07.973247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272468+0000","last_change":"2024-09-13T17:13:08.195864+0000","last_active":"2024-09-13T17:13:12.272468+0000","last_peered":"2024-09-13T17:13:12.272468+0000","last_clean":"2024-09-13T17:13:12.272468+0000","last_became_active":"2024-09-13T17:13:08.195589+0000","last_became_peered":"2024-09-13T17:13:08.195589+0000","last_unstale":"2024-09-13T17:13:12.272468+0000","last_undegraded":"2024-09-13T17:13:12.272468+0000","last_fullsized":"2024-09-13T17:13:12.272468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.189968+0000","last_change":"2024-09-13T17:13:07.820905+0000","last_active":"2024-09-13T17:13:12.189968+0000","last_peered":"2024-09-13T17:13:12.189968+0000","last_clean":"2024-09-13T17:13:12.189968+0000","last_became_active":"2024-09-13T17:13:07.820577+0000","last_became_peered":"2024-09-13T17:13:07.820577+0000","last_unstale":"2024-09-13T17:13:12.189968+0000","last_undegraded":"2024-09-13T17:13:12.189968+0000","last_fullsized":"2024-09-13T17:13:12.189968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273689+0000","last_change":"2024-09-13T17:13:12.222206+0000","last_active":"2024-09-13T17:13:12.273689+0000","last_peered":"2024-09-13T17:13:12.273689+0000","last_clean":"2024-09-13T17:13:12.273689+0000","last_became_active":"2024-09-13T17:13:12.221832+0000","last_became_peered":"2024-09-13T17:13:12.221832+0000","last_unstale":"2024-09-13T17:13:12.273689+0000","last_undegraded":"2024-09-13T17:13:12.273689+0000","last_fullsized":"2024-09-13T17:13:12.273689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:24.267854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270533+0000","last_change":"2024-09-13T17:13:08.188169+0000","last_active":"2024-09-13T17:13:12.270533+0000","last_peered":"2024-09-13T17:13:12.270533+0000","last_clean":"2024-09-13T17:13:12.270533+0000","last_became_active":"2024-09-13T17:13:08.183992+0000","last_became_peered":"2024-09-13T17:13:08.183992+0000","last_unstale":"2024-09-13T17:13:12.270533+0000","last_undegraded":"2024-09-13T17:13:12.270533+0000","last_fullsized":"2024-09-13T17:13:12.270533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.196619+0000","last_change":"2024-09-13T17:13:07.809275+0000","last_active":"2024-09-13T17:13:12.196619+0000","last_peered":"2024-09-13T17:13:12.196619+0000","last_clean":"2024-09-13T17:13:12.196619+0000","last_became_active":"2024-09-13T17:13:07.808983+0000","last_became_peered":"2024-09-13T17:13:07.808983+0000","last_unstale":"2024-09-13T17:13:12.196619+0000","last_undegraded":"2024-09-13T17:13:12.196619+0000","last_fullsized":"2024-09-13T17:13:12.196619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272043+0000","last_change":"2024-09-13T17:13:12.223022+0000","last_active":"2024-09-13T17:13:12.272043+0000","last_peered":"2024-09-13T17:13:12.272043+0000","last_clean":"2024-09-13T17:13:12.272043+0000","last_became_active":"2024-09-13T17:13:12.222587+0000","last_became_peered":"2024-09-13T17:13:12.222587+0000","last_unstale":"2024-09-13T17:13:12.272043+0000","last_undegraded":"2024-09-13T17:13:12.272043+0000","last_fullsized":"2024-09-13T17:13:12.272043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272504+0000","last_change":"2024-09-13T17:13:08.191872+0000","last_active":"2024-09-13T17:13:12.272504+0000","last_peered":"2024-09-13T17:13:12.272504+0000","last_clean":"2024-09-13T17:13:12.272504+0000","last_became_active":"2024-09-13T17:13:08.191600+0000","last_became_peered":"2024-09-13T17:13:08.191600+0000","last_unstale":"2024-09-13T17:13:12.272504+0000","last_undegraded":"2024-09-13T17:13:12.272504+0000","last_fullsized":"2024-09-13T17:13:12.272504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:10.848695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:13:16.967984+0000","last_change":"2024-09-13T17:13:07.818187+0000","last_active":"2024-09-13T17:13:16.967984+0000","last_peered":"2024-09-13T17:13:16.967984+0000","last_clean":"2024-09-13T17:13:16.967984+0000","last_became_active":"2024-09-13T17:13:07.817767+0000","last_became_peered":"2024-09-13T17:13:07.817767+0000","last_unstale":"2024-09-13T17:13:16.967984+0000","last_undegraded":"2024-09-13T17:13:16.967984+0000","last_fullsized":"2024-09-13T17:13:16.967984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271560+0000","last_change":"2024-09-13T17:13:12.198787+0000","last_active":"2024-09-13T17:13:12.271560+0000","last_peered":"2024-09-13T17:13:12.271560+0000","last_clean":"2024-09-13T17:13:12.271560+0000","last_became_active":"2024-09-13T17:13:12.198435+0000","last_became_peered":"2024-09-13T17:13:12.198435+0000","last_unstale":"2024-09-13T17:13:12.271560+0000","last_undegraded":"2024-09-13T17:13:12.271560+0000","last_fullsized":"2024-09-13T17:13:12.271560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273414+0000","last_change":"2024-09-13T17:13:08.188875+0000","last_active":"2024-09-13T17:13:12.273414+0000","last_peered":"2024-09-13T17:13:12.273414+0000","last_clean":"2024-09-13T17:13:12.273414+0000","last_became_active":"2024-09-13T17:13:08.187520+0000","last_became_peered":"2024-09-13T17:13:08.187520+0000","last_unstale":"2024-09-13T17:13:12.273414+0000","last_undegraded":"2024-09-13T17:13:12.273414+0000","last_fullsized":"2024-09-13T17:13:12.273414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191401+0000","last_change":"2024-09-13T17:13:07.819358+0000","last_active":"2024-09-13T17:13:12.191401+0000","last_peered":"2024-09-13T17:13:12.191401+0000","last_clean":"2024-09-13T17:13:12.191401+0000","last_became_active":"2024-09-13T17:13:07.819090+0000","last_became_peered":"2024-09-13T17:13:07.819090+0000","last_unstale":"2024-09-13T17:13:12.191401+0000","last_undegraded":"2024-09-13T17:13:12.191401+0000","last_fullsized":"2024-09-13T17:13:12.191401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273371+0000","last_change":"2024-09-13T17:13:12.198537+0000","last_active":"2024-09-13T17:13:12.273371+0000","last_peered":"2024-09-13T17:13:12.273371+0000","last_clean":"2024-09-13T17:13:12.273371+0000","last_became_active":"2024-09-13T17:13:12.198097+0000","last_became_peered":"2024-09-13T17:13:12.198097+0000","last_unstale":"2024-09-13T17:13:12.273371+0000","last_undegraded":"2024-09-13T17:13:12.273371+0000","last_fullsized":"2024-09-13T17:13:12.273371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270678+0000","last_change":"2024-09-13T17:13:08.188117+0000","last_active":"2024-09-13T17:13:12.270678+0000","last_peered":"2024-09-13T17:13:12.270678+0000","last_clean":"2024-09-13T17:13:12.270678+0000","last_became_active":"2024-09-13T17:13:08.187895+0000","last_became_peered":"2024-09-13T17:13:08.187895+0000","last_unstale":"2024-09-13T17:13:12.270678+0000","last_undegraded":"2024-09-13T17:13:12.270678+0000","last_fullsized":"2024-09-13T17:13:12.270678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188395+0000","last_change":"2024-09-13T17:13:07.816509+0000","last_active":"2024-09-13T17:13:12.188395+0000","last_peered":"2024-09-13T17:13:12.188395+0000","last_clean":"2024-09-13T17:13:12.188395+0000","last_became_active":"2024-09-13T17:13:07.816220+0000","last_became_peered":"2024-09-13T17:13:07.816220+0000","last_unstale":"2024-09-13T17:13:12.188395+0000","last_undegraded":"2024-09-13T17:13:12.188395+0000","last_fullsized":"2024-09-13T17:13:12.188395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273587+0000","last_change":"2024-09-13T17:13:12.211455+0000","last_active":"2024-09-13T17:13:12.273587+0000","last_peered":"2024-09-13T17:13:12.273587+0000","last_clean":"2024-09-13T17:13:12.273587+0000","last_became_active":"2024-09-13T17:13:12.211134+0000","last_became_peered":"2024-09-13T17:13:12.211134+0000","last_unstale":"2024-09-13T17:13:12.273587+0000","last_undegraded":"2024-09-13T17:13:12.273587+0000","last_fullsized":"2024-09-13T17:13:12.273587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:01.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272080+0000","last_change":"2024-09-13T17:13:08.186199+0000","last_active":"2024-09-13T17:13:12.272080+0000","last_peered":"2024-09-13T17:13:12.272080+0000","last_clean":"2024-09-13T17:13:12.272080+0000","last_became_active":"2024-09-13T17:13:08.185905+0000","last_became_peered":"2024-09-13T17:13:08.185905+0000","last_unstale":"2024-09-13T17:13:12.272080+0000","last_undegraded":"2024-09-13T17:13:12.272080+0000","last_fullsized":"2024-09-13T17:13:12.272080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195432+0000","last_change":"2024-09-13T17:13:07.818508+0000","last_active":"2024-09-13T17:13:12.195432+0000","last_peered":"2024-09-13T17:13:12.195432+0000","last_clean":"2024-09-13T17:13:12.195432+0000","last_became_active":"2024-09-13T17:13:07.818195+0000","last_became_peered":"2024-09-13T17:13:07.818195+0000","last_unstale":"2024-09-13T17:13:12.195432+0000","last_undegraded":"2024-09-13T17:13:12.195432+0000","last_fullsized":"2024-09-13T17:13:12.195432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273629+0000","last_change":"2024-09-13T17:13:12.225297+0000","last_active":"2024-09-13T17:13:12.273629+0000","last_peered":"2024-09-13T17:13:12.273629+0000","last_clean":"2024-09-13T17:13:12.273629+0000","last_became_active":"2024-09-13T17:13:12.224933+0000","last_became_peered":"2024-09-13T17:13:12.224933+0000","last_unstale":"2024-09-13T17:13:12.273629+0000","last_undegraded":"2024-09-13T17:13:12.273629+0000","last_fullsized":"2024-09-13T17:13:12.273629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270623+0000","last_change":"2024-09-13T17:13:12.224462+0000","last_active":"2024-09-13T17:13:12.270623+0000","last_peered":"2024-09-13T17:13:12.270623+0000","last_clean":"2024-09-13T17:13:12.270623+0000","last_became_active":"2024-09-13T17:13:12.223084+0000","last_became_peered":"2024-09-13T17:13:12.223084+0000","last_unstale":"2024-09-13T17:13:12.270623+0000","last_undegraded":"2024-09-13T17:13:12.270623+0000","last_fullsized":"2024-09-13T17:13:12.270623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271489+0000","last_change":"2024-09-13T17:13:08.179431+0000","last_active":"2024-09-13T17:13:12.271489+0000","last_peered":"2024-09-13T17:13:12.271489+0000","last_clean":"2024-09-13T17:13:12.271489+0000","last_became_active":"2024-09-13T17:13:08.178872+0000","last_became_peered":"2024-09-13T17:13:08.178872+0000","last_unstale":"2024-09-13T17:13:12.271489+0000","last_undegraded":"2024-09-13T17:13:12.271489+0000","last_fullsized":"2024-09-13T17:13:12.271489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188486+0000","last_change":"2024-09-13T17:13:07.808744+0000","last_active":"2024-09-13T17:13:12.188486+0000","last_peered":"2024-09-13T17:13:12.188486+0000","last_clean":"2024-09-13T17:13:12.188486+0000","last_became_active":"2024-09-13T17:13:07.808479+0000","last_became_peered":"2024-09-13T17:13:07.808479+0000","last_unstale":"2024-09-13T17:13:12.188486+0000","last_undegraded":"2024-09-13T17:13:12.188486+0000","last_fullsized":"2024-09-13T17:13:12.188486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272723+0000","last_change":"2024-09-13T17:13:12.202980+0000","last_active":"2024-09-13T17:13:12.272723+0000","last_peered":"2024-09-13T17:13:12.272723+0000","last_clean":"2024-09-13T17:13:12.272723+0000","last_became_active":"2024-09-13T17:13:12.202568+0000","last_became_peered":"2024-09-13T17:13:12.202568+0000","last_unstale":"2024-09-13T17:13:12.272723+0000","last_undegraded":"2024-09-13T17:13:12.272723+0000","last_fullsized":"2024-09-13T17:13:12.272723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:08.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273602+0000","last_change":"2024-09-13T17:13:08.184455+0000","last_active":"2024-09-13T17:13:12.273602+0000","last_peered":"2024-09-13T17:13:12.273602+0000","last_clean":"2024-09-13T17:13:12.273602+0000","last_became_active":"2024-09-13T17:13:08.184221+0000","last_became_peered":"2024-09-13T17:13:08.184221+0000","last_unstale":"2024-09-13T17:13:12.273602+0000","last_undegraded":"2024-09-13T17:13:12.273602+0000","last_fullsized":"2024-09-13T17:13:12.273602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191347+0000","last_change":"2024-09-13T17:13:07.816989+0000","last_active":"2024-09-13T17:13:12.191347+0000","last_peered":"2024-09-13T17:13:12.191347+0000","last_clean":"2024-09-13T17:13:12.191347+0000","last_became_active":"2024-09-13T17:13:07.816688+0000","last_became_peered":"2024-09-13T17:13:07.816688+0000","last_unstale":"2024-09-13T17:13:12.191347+0000","last_undegraded":"2024-09-13T17:13:12.191347+0000","last_fullsized":"2024-09-13T17:13:12.191347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194332+0000","last_change":"2024-09-13T17:13:07.814845+0000","last_active":"2024-09-13T17:13:12.194332+0000","last_peered":"2024-09-13T17:13:12.194332+0000","last_clean":"2024-09-13T17:13:12.194332+0000","last_became_active":"2024-09-13T17:13:07.814565+0000","last_became_peered":"2024-09-13T17:13:07.814565+0000","last_unstale":"2024-09-13T17:13:12.194332+0000","last_undegraded":"2024-09-13T17:13:12.194332+0000","last_fullsized":"2024-09-13T17:13:12.194332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270586+0000","last_change":"2024-09-13T17:13:08.181292+0000","last_active":"2024-09-13T17:13:12.270586+0000","last_peered":"2024-09-13T17:13:12.270586+0000","last_clean":"2024-09-13T17:13:12.270586+0000","last_became_active":"2024-09-13T17:13:08.180800+0000","last_became_peered":"2024-09-13T17:13:08.180800+0000","last_unstale":"2024-09-13T17:13:12.270586+0000","last_undegraded":"2024-09-13T17:13:12.270586+0000","last_fullsized":"2024-09-13T17:13:12.270586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:53.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273547+0000","last_change":"2024-09-13T17:13:12.205700+0000","last_active":"2024-09-13T17:13:12.273547+0000","last_peered":"2024-09-13T17:13:12.273547+0000","last_clean":"2024-09-13T17:13:12.273547+0000","last_became_active":"2024-09-13T17:13:12.205330+0000","last_became_peered":"2024-09-13T17:13:12.205330+0000","last_unstale":"2024-09-13T17:13:12.273547+0000","last_undegraded":"2024-09-13T17:13:12.273547+0000","last_fullsized":"2024-09-13T17:13:12.273547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:55.349358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193464+0000","last_change":"2024-09-13T17:13:07.822962+0000","last_active":"2024-09-13T17:13:12.193464+0000","last_peered":"2024-09-13T17:13:12.193464+0000","last_clean":"2024-09-13T17:13:12.193464+0000","last_became_active":"2024-09-13T17:13:07.822676+0000","last_became_peered":"2024-09-13T17:13:07.822676+0000","last_unstale":"2024-09-13T17:13:12.193464+0000","last_undegraded":"2024-09-13T17:13:12.193464+0000","last_fullsized":"2024-09-13T17:13:12.193464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273347+0000","last_change":"2024-09-13T17:13:08.176946+0000","last_active":"2024-09-13T17:13:12.273347+0000","last_peered":"2024-09-13T17:13:12.273347+0000","last_clean":"2024-09-13T17:13:12.273347+0000","last_became_active":"2024-09-13T17:13:08.176653+0000","last_became_peered":"2024-09-13T17:13:08.176653+0000","last_unstale":"2024-09-13T17:13:12.273347+0000","last_undegraded":"2024-09-13T17:13:12.273347+0000","last_fullsized":"2024-09-13T17:13:12.273347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273706+0000","last_change":"2024-09-13T17:13:12.211076+0000","last_active":"2024-09-13T17:13:12.273706+0000","last_peered":"2024-09-13T17:13:12.273706+0000","last_clean":"2024-09-13T17:13:12.273706+0000","last_became_active":"2024-09-13T17:13:12.210718+0000","last_became_peered":"2024-09-13T17:13:12.210718+0000","last_unstale":"2024-09-13T17:13:12.273706+0000","last_undegraded":"2024-09-13T17:13:12.273706+0000","last_fullsized":"2024-09-13T17:13:12.273706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:57.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272535+0000","last_change":"2024-09-13T17:13:08.186992+0000","last_active":"2024-09-13T17:13:12.272535+0000","last_peered":"2024-09-13T17:13:12.272535+0000","last_clean":"2024-09-13T17:13:12.272535+0000","last_became_active":"2024-09-13T17:13:08.186730+0000","last_became_peered":"2024-09-13T17:13:08.186730+0000","last_unstale":"2024-09-13T17:13:12.272535+0000","last_undegraded":"2024-09-13T17:13:12.272535+0000","last_fullsized":"2024-09-13T17:13:12.272535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273527+0000","last_change":"2024-09-13T17:13:08.185076+0000","last_active":"2024-09-13T17:13:12.273527+0000","last_peered":"2024-09-13T17:13:12.273527+0000","last_clean":"2024-09-13T17:13:12.273527+0000","last_became_active":"2024-09-13T17:13:08.184807+0000","last_became_peered":"2024-09-13T17:13:08.184807+0000","last_unstale":"2024-09-13T17:13:12.273527+0000","last_undegraded":"2024-09-13T17:13:12.273527+0000","last_fullsized":"2024-09-13T17:13:12.273527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271978+0000","last_change":"2024-09-13T17:13:08.182381+0000","last_active":"2024-09-13T17:13:12.271978+0000","last_peered":"2024-09-13T17:13:12.271978+0000","last_clean":"2024-09-13T17:13:12.271978+0000","last_became_active":"2024-09-13T17:13:08.181851+0000","last_became_peered":"2024-09-13T17:13:08.181851+0000","last_unstale":"2024-09-13T17:13:12.271978+0000","last_undegraded":"2024-09-13T17:13:12.271978+0000","last_fullsized":"2024-09-13T17:13:12.271978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270578+0000","last_change":"2024-09-13T17:13:08.179038+0000","last_active":"2024-09-13T17:13:12.270578+0000","last_peered":"2024-09-13T17:13:12.270578+0000","last_clean":"2024-09-13T17:13:12.270578+0000","last_became_active":"2024-09-13T17:13:08.178609+0000","last_became_peered":"2024-09-13T17:13:08.178609+0000","last_unstale":"2024-09-13T17:13:12.270578+0000","last_undegraded":"2024-09-13T17:13:12.270578+0000","last_fullsized":"2024-09-13T17:13:12.270578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273698+0000","last_change":"2024-09-13T17:13:08.179834+0000","last_active":"2024-09-13T17:13:12.273698+0000","last_peered":"2024-09-13T17:13:12.273698+0000","last_clean":"2024-09-13T17:13:12.273698+0000","last_became_active":"2024-09-13T17:13:08.179568+0000","last_became_peered":"2024-09-13T17:13:08.179568+0000","last_unstale":"2024-09-13T17:13:12.273698+0000","last_undegraded":"2024-09-13T17:13:12.273698+0000","last_fullsized":"2024-09-13T17:13:12.273698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271641+0000","last_change":"2024-09-13T17:13:08.178962+0000","last_active":"2024-09-13T17:13:12.271641+0000","last_peered":"2024-09-13T17:13:12.271641+0000","last_clean":"2024-09-13T17:13:12.271641+0000","last_became_active":"2024-09-13T17:13:08.178519+0000","last_became_peered":"2024-09-13T17:13:08.178519+0000","last_unstale":"2024-09-13T17:13:12.271641+0000","last_undegraded":"2024-09-13T17:13:12.271641+0000","last_fullsized":"2024-09-13T17:13:12.271641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272698+0000","last_change":"2024-09-13T17:13:08.189740+0000","last_active":"2024-09-13T17:13:12.272698+0000","last_peered":"2024-09-13T17:13:12.272698+0000","last_clean":"2024-09-13T17:13:12.272698+0000","last_became_active":"2024-09-13T17:13:08.189493+0000","last_became_peered":"2024-09-13T17:13:08.189493+0000","last_unstale":"2024-09-13T17:13:12.272698+0000","last_undegraded":"2024-09-13T17:13:12.272698+0000","last_fullsized":"2024-09-13T17:13:12.272698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273747+0000","last_change":"2024-09-13T17:13:08.187313+0000","last_active":"2024-09-13T17:13:12.273747+0000","last_peered":"2024-09-13T17:13:12.273747+0000","last_clean":"2024-09-13T17:13:12.273747+0000","last_became_active":"2024-09-13T17:13:08.186547+0000","last_became_peered":"2024-09-13T17:13:08.186547+0000","last_unstale":"2024-09-13T17:13:12.273747+0000","last_undegraded":"2024-09-13T17:13:12.273747+0000","last_fullsized":"2024-09-13T17:13:12.273747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271935+0000","last_change":"2024-09-13T17:13:08.181762+0000","last_active":"2024-09-13T17:13:12.271935+0000","last_peered":"2024-09-13T17:13:12.271935+0000","last_clean":"2024-09-13T17:13:12.271935+0000","last_became_active":"2024-09-13T17:13:08.181207+0000","last_became_peered":"2024-09-13T17:13:08.181207+0000","last_unstale":"2024-09-13T17:13:12.271935+0000","last_undegraded":"2024-09-13T17:13:12.271935+0000","last_fullsized":"2024-09-13T17:13:12.271935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273638+0000","last_change":"2024-09-13T17:13:08.180419+0000","last_active":"2024-09-13T17:13:12.273638+0000","last_peered":"2024-09-13T17:13:12.273638+0000","last_clean":"2024-09-13T17:13:12.273638+0000","last_became_active":"2024-09-13T17:13:08.179973+0000","last_became_peered":"2024-09-13T17:13:08.179973+0000","last_unstale":"2024-09-13T17:13:12.273638+0000","last_undegraded":"2024-09-13T17:13:12.273638+0000","last_fullsized":"2024-09-13T17:13:12.273638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271966+0000","last_change":"2024-09-13T17:13:08.187243+0000","last_active":"2024-09-13T17:13:12.271966+0000","last_peered":"2024-09-13T17:13:12.271966+0000","last_clean":"2024-09-13T17:13:12.271966+0000","last_became_active":"2024-09-13T17:13:08.185915+0000","last_became_peered":"2024-09-13T17:13:08.185915+0000","last_unstale":"2024-09-13T17:13:12.271966+0000","last_undegraded":"2024-09-13T17:13:12.271966+0000","last_fullsized":"2024-09-13T17:13:12.271966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270553+0000","last_change":"2024-09-13T17:13:08.183725+0000","last_active":"2024-09-13T17:13:12.270553+0000","last_peered":"2024-09-13T17:13:12.270553+0000","last_clean":"2024-09-13T17:13:12.270553+0000","last_became_active":"2024-09-13T17:13:08.183369+0000","last_became_peered":"2024-09-13T17:13:08.183369+0000","last_unstale":"2024-09-13T17:13:12.270553+0000","last_undegraded":"2024-09-13T17:13:12.270553+0000","last_fullsized":"2024-09-13T17:13:12.270553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272636+0000","last_change":"2024-09-13T17:13:08.184578+0000","last_active":"2024-09-13T17:13:12.272636+0000","last_peered":"2024-09-13T17:13:12.272636+0000","last_clean":"2024-09-13T17:13:12.272636+0000","last_became_active":"2024-09-13T17:13:08.184328+0000","last_became_peered":"2024-09-13T17:13:08.184328+0000","last_unstale":"2024-09-13T17:13:12.272636+0000","last_undegraded":"2024-09-13T17:13:12.272636+0000","last_fullsized":"2024-09-13T17:13:12.272636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272553+0000","last_change":"2024-09-13T17:13:08.183549+0000","last_active":"2024-09-13T17:13:12.272553+0000","last_peered":"2024-09-13T17:13:12.272553+0000","last_clean":"2024-09-13T17:13:12.272553+0000","last_became_active":"2024-09-13T17:13:08.183301+0000","last_became_peered":"2024-09-13T17:13:08.183301+0000","last_unstale":"2024-09-13T17:13:12.272553+0000","last_undegraded":"2024-09-13T17:13:12.272553+0000","last_fullsized":"2024-09-13T17:13:12.272553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273561+0000","last_change":"2024-09-13T17:13:08.182679+0000","last_active":"2024-09-13T17:13:12.273561+0000","last_peered":"2024-09-13T17:13:12.273561+0000","last_clean":"2024-09-13T17:13:12.273561+0000","last_became_active":"2024-09-13T17:13:08.182412+0000","last_became_peered":"2024-09-13T17:13:08.182412+0000","last_unstale":"2024-09-13T17:13:12.273561+0000","last_undegraded":"2024-09-13T17:13:12.273561+0000","last_fullsized":"2024-09-13T17:13:12.273561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272096+0000","last_change":"2024-09-13T17:13:08.189128+0000","last_active":"2024-09-13T17:13:12.272096+0000","last_peered":"2024-09-13T17:13:12.272096+0000","last_clean":"2024-09-13T17:13:12.272096+0000","last_became_active":"2024-09-13T17:13:08.188829+0000","last_became_peered":"2024-09-13T17:13:08.188829+0000","last_unstale":"2024-09-13T17:13:12.272096+0000","last_undegraded":"2024-09-13T17:13:12.272096+0000","last_fullsized":"2024-09-13T17:13:12.272096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271915+0000","last_change":"2024-09-13T17:13:08.181955+0000","last_active":"2024-09-13T17:13:12.271915+0000","last_peered":"2024-09-13T17:13:12.271915+0000","last_clean":"2024-09-13T17:13:12.271915+0000","last_became_active":"2024-09-13T17:13:08.180834+0000","last_became_peered":"2024-09-13T17:13:08.180834+0000","last_unstale":"2024-09-13T17:13:12.271915+0000","last_undegraded":"2024-09-13T17:13:12.271915+0000","last_fullsized":"2024-09-13T17:13:12.271915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271506+0000","last_change":"2024-09-13T17:13:08.177678+0000","last_active":"2024-09-13T17:13:12.271506+0000","last_peered":"2024-09-13T17:13:12.271506+0000","last_clean":"2024-09-13T17:13:12.271506+0000","last_became_active":"2024-09-13T17:13:08.177367+0000","last_became_peered":"2024-09-13T17:13:08.177367+0000","last_unstale":"2024-09-13T17:13:12.271506+0000","last_undegraded":"2024-09-13T17:13:12.271506+0000","last_fullsized":"2024-09-13T17:13:12.271506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270519+0000","last_change":"2024-09-13T17:13:08.177377+0000","last_active":"2024-09-13T17:13:12.270519+0000","last_peered":"2024-09-13T17:13:12.270519+0000","last_clean":"2024-09-13T17:13:12.270519+0000","last_became_active":"2024-09-13T17:13:08.176410+0000","last_became_peered":"2024-09-13T17:13:08.176410+0000","last_unstale":"2024-09-13T17:13:12.270519+0000","last_undegraded":"2024-09-13T17:13:12.270519+0000","last_fullsized":"2024-09-13T17:13:12.270519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273666+0000","last_change":"2024-09-13T17:13:08.183002+0000","last_active":"2024-09-13T17:13:12.273666+0000","last_peered":"2024-09-13T17:13:12.273666+0000","last_clean":"2024-09-13T17:13:12.273666+0000","last_became_active":"2024-09-13T17:13:08.181898+0000","last_became_peered":"2024-09-13T17:13:08.181898+0000","last_unstale":"2024-09-13T17:13:12.273666+0000","last_undegraded":"2024-09-13T17:13:12.273666+0000","last_fullsized":"2024-09-13T17:13:12.273666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273404+0000","last_change":"2024-09-13T17:13:08.183228+0000","last_active":"2024-09-13T17:13:12.273404+0000","last_peered":"2024-09-13T17:13:12.273404+0000","last_clean":"2024-09-13T17:13:12.273404+0000","last_became_active":"2024-09-13T17:13:08.182942+0000","last_became_peered":"2024-09-13T17:13:08.182942+0000","last_unstale":"2024-09-13T17:13:12.273404+0000","last_undegraded":"2024-09-13T17:13:12.273404+0000","last_fullsized":"2024-09-13T17:13:12.273404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:15.542986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272676+0000","last_change":"2024-09-13T17:13:08.192671+0000","last_active":"2024-09-13T17:13:12.272676+0000","last_peered":"2024-09-13T17:13:12.272676+0000","last_clean":"2024-09-13T17:13:12.272676+0000","last_became_active":"2024-09-13T17:13:08.192366+0000","last_became_peered":"2024-09-13T17:13:08.192366+0000","last_unstale":"2024-09-13T17:13:12.272676+0000","last_undegraded":"2024-09-13T17:13:12.272676+0000","last_fullsized":"2024-09-13T17:13:12.272676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272687+0000","last_change":"2024-09-13T17:13:08.193253+0000","last_active":"2024-09-13T17:13:12.272687+0000","last_peered":"2024-09-13T17:13:12.272687+0000","last_clean":"2024-09-13T17:13:12.272687+0000","last_became_active":"2024-09-13T17:13:08.192969+0000","last_became_peered":"2024-09-13T17:13:08.192969+0000","last_unstale":"2024-09-13T17:13:12.272687+0000","last_undegraded":"2024-09-13T17:13:12.272687+0000","last_fullsized":"2024-09-13T17:13:12.272687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272593+0000","last_change":"2024-09-13T17:13:08.195764+0000","last_active":"2024-09-13T17:13:12.272593+0000","last_peered":"2024-09-13T17:13:12.272593+0000","last_clean":"2024-09-13T17:13:12.272593+0000","last_became_active":"2024-09-13T17:13:08.195102+0000","last_became_peered":"2024-09-13T17:13:08.195102+0000","last_unstale":"2024-09-13T17:13:12.272593+0000","last_undegraded":"2024-09-13T17:13:12.272593+0000","last_fullsized":"2024-09-13T17:13:12.272593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273574+0000","last_change":"2024-09-13T17:13:08.192409+0000","last_active":"2024-09-13T17:13:12.273574+0000","last_peered":"2024-09-13T17:13:12.273574+0000","last_clean":"2024-09-13T17:13:12.273574+0000","last_became_active":"2024-09-13T17:13:08.192135+0000","last_became_peered":"2024-09-13T17:13:08.192135+0000","last_unstale":"2024-09-13T17:13:12.273574+0000","last_undegraded":"2024-09-13T17:13:12.273574+0000","last_fullsized":"2024-09-13T17:13:12.273574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272414+0000","last_change":"2024-09-13T17:13:08.188381+0000","last_active":"2024-09-13T17:13:12.272414+0000","last_peered":"2024-09-13T17:13:12.272414+0000","last_clean":"2024-09-13T17:13:12.272414+0000","last_became_active":"2024-09-13T17:13:08.188091+0000","last_became_peered":"2024-09-13T17:13:08.188091+0000","last_unstale":"2024-09-13T17:13:12.272414+0000","last_undegraded":"2024-09-13T17:13:12.272414+0000","last_fullsized":"2024-09-13T17:13:12.272414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271956+0000","last_change":"2024-09-13T17:13:08.181573+0000","last_active":"2024-09-13T17:13:12.271956+0000","last_peered":"2024-09-13T17:13:12.271956+0000","last_clean":"2024-09-13T17:13:12.271956+0000","last_became_active":"2024-09-13T17:13:08.180771+0000","last_became_peered":"2024-09-13T17:13:08.180771+0000","last_unstale":"2024-09-13T17:13:12.271956+0000","last_undegraded":"2024-09-13T17:13:12.271956+0000","last_fullsized":"2024-09-13T17:13:12.271956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272451+0000","last_change":"2024-09-13T17:13:08.182931+0000","last_active":"2024-09-13T17:13:12.272451+0000","last_peered":"2024-09-13T17:13:12.272451+0000","last_clean":"2024-09-13T17:13:12.272451+0000","last_became_active":"2024-09-13T17:13:08.182550+0000","last_became_peered":"2024-09-13T17:13:08.182550+0000","last_unstale":"2024-09-13T17:13:12.272451+0000","last_undegraded":"2024-09-13T17:13:12.272451+0000","last_fullsized":"2024-09-13T17:13:12.272451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272014+0000","last_change":"2024-09-13T17:13:08.183116+0000","last_active":"2024-09-13T17:13:12.272014+0000","last_peered":"2024-09-13T17:13:12.272014+0000","last_clean":"2024-09-13T17:13:12.272014+0000","last_became_active":"2024-09-13T17:13:08.182806+0000","last_became_peered":"2024-09-13T17:13:08.182806+0000","last_unstale":"2024-09-13T17:13:12.272014+0000","last_undegraded":"2024-09-13T17:13:12.272014+0000","last_fullsized":"2024-09-13T17:13:12.272014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270613+0000","last_change":"2024-09-13T17:13:08.175847+0000","last_active":"2024-09-13T17:13:12.270613+0000","last_peered":"2024-09-13T17:13:12.270613+0000","last_clean":"2024-09-13T17:13:12.270613+0000","last_became_active":"2024-09-13T17:13:08.175560+0000","last_became_peered":"2024-09-13T17:13:08.175560+0000","last_unstale":"2024-09-13T17:13:12.270613+0000","last_undegraded":"2024-09-13T17:13:12.270613+0000","last_fullsized":"2024-09-13T17:13:12.270613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271680+0000","last_change":"2024-09-13T17:13:08.178668+0000","last_active":"2024-09-13T17:13:12.271680+0000","last_peered":"2024-09-13T17:13:12.271680+0000","last_clean":"2024-09-13T17:13:12.271680+0000","last_became_active":"2024-09-13T17:13:08.178371+0000","last_became_peered":"2024-09-13T17:13:08.178371+0000","last_unstale":"2024-09-13T17:13:12.271680+0000","last_undegraded":"2024-09-13T17:13:12.271680+0000","last_fullsized":"2024-09-13T17:13:12.271680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272583+0000","last_change":"2024-09-13T17:13:08.193114+0000","last_active":"2024-09-13T17:13:12.272583+0000","last_peered":"2024-09-13T17:13:12.272583+0000","last_clean":"2024-09-13T17:13:12.272583+0000","last_became_active":"2024-09-13T17:13:08.192630+0000","last_became_peered":"2024-09-13T17:13:08.192630+0000","last_unstale":"2024-09-13T17:13:12.272583+0000","last_undegraded":"2024-09-13T17:13:12.272583+0000","last_fullsized":"2024-09-13T17:13:12.272583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:07.796374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:34.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.783+0000 7fa23f619640 1 Processor -- start 2024-09-13T17:13:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.783+0000 7fa23f619640 1 -- start start 2024-09-13T17:13:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23f619640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa238156f40 0x7fa23815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23f619640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa23806e1c0 0x7fa2380aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23f619640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380b2390 con 0x7fa2380b1080 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23f619640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380b14c0 con 0x7fa23806e1c0 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23f619640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380b1780 con 0x7fa238156f40 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23dbb6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa23806e1c0 0x7fa2380aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23dbb6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa23806e1c0 0x7fa2380aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59262/0 (socket says 172.21.15.5:59262) 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23dbb6640 1 -- 172.21.15.5:0/2523205430 learned_addr learned my addr 172.21.15.5:0/2523205430 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.784+0000 7fa23d3b5640 1 --2- 172.21.15.5:0/2523205430 >> v2:172.21.15.179:3300/0 conn(0x7fa238156f40 0x7fa23815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa23dbb6640 1 -- 172.21.15.5:0/2523205430 >> v2:172.21.15.179:3300/0 conn(0x7fa238156f40 msgr2=0x7fa23815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa23dbb6640 1 --2- 172.21.15.5:0/2523205430 >> v2:172.21.15.179:3300/0 conn(0x7fa238156f40 0x7fa23815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa23dbb6640 1 -- 172.21.15.5:0/2523205430 >> v1:172.21.15.179:6789/0 conn(0x7fa2380b1080 legacy=0x7fa23806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa23dbb6640 1 -- 172.21.15.5:0/2523205430 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380b1a60 con 0x7fa23806e1c0 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa23dbb6640 1 --2- 172.21.15.5:0/2523205430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23806e1c0 0x7fa2380aced0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa23806aea0 tx=0x7fa23002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ee148b9958a936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa22ffff640 1 -- 172.21.15.5:0/2523205430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230031600 con 0x7fa23806e1c0 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa22ffff640 1 -- 172.21.15.5:0/2523205430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23002d050 con 0x7fa23806e1c0 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.785+0000 7fa22ffff640 1 -- 172.21.15.5:0/2523205430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230031980 con 0x7fa23806e1c0 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 -- 172.21.15.5:0/2523205430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23806e1c0 msgr2=0x7fa2380aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 --2- 172.21.15.5:0/2523205430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23806e1c0 0x7fa2380aced0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa23806aea0 tx=0x7fa23002a730 comp rx=0 tx=0).stop 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 -- 172.21.15.5:0/2523205430 shutdown_connections 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 --2- 172.21.15.5:0/2523205430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa23806e1c0 0x7fa2380aced0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 --2- 172.21.15.5:0/2523205430 >> v2:172.21.15.179:3300/0 conn(0x7fa238156f40 0x7fa23815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 -- 172.21.15.5:0/2523205430 >> 172.21.15.5:0/2523205430 conn(0x7fa2380ce0d0 msgr2=0x7fa2380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 -- 172.21.15.5:0/2523205430 shutdown_connections 2024-09-13T17:13:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.786+0000 7fa23f619640 1 -- 172.21.15.5:0/2523205430 wait complete. 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.787+0000 7fa23f619640 1 Processor -- start 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.787+0000 7fa23f619640 1 -- start start 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 0x7fa2381511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa238156f40 0x7fa2380cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23813d250 con 0x7fa2380b1080 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23813d460 con 0x7fa238156f40 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23f619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23813d740 con 0x7fa23806e1c0 2024-09-13T17:13:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59266/0 (socket says 172.21.15.5:59266) 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 -- 172.21.15.5:0/1262180977 learned_addr learned my addr 172.21.15.5:0/1262180977 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23dbb6640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa238156f40 0x7fa2380cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23d3b5640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 0x7fa2381511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 -- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 msgr2=0x7fa2381511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 0x7fa2381511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 -- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa238156f40 msgr2=0x7fa2380cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa238156f40 0x7fa2380cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23cbb4640 1 -- 172.21.15.5:0/1262180977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009b30 con 0x7fa2380b1080 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.788+0000 7fa23d3b5640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 0x7fa2381511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa23cbb4640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c450 tx=0x7fa22800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280052d0 con 0x7fa2380b1080 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228005430 con 0x7fa2380b1080 2024-09-13T17:13:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228012870 con 0x7fa2380b1080 2024-09-13T17:13:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23813da20 con 0x7fa2380b1080 2024-09-13T17:13:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.789+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238151850 con 0x7fa2380b1080 2024-09-13T17:13:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.790+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2380672a0 con 0x7fa2380b1080 2024-09-13T17:13:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.790+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2280129d0 con 0x7fa2380b1080 2024-09-13T17:13:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.791+0000 7fa22dffb640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 0x7fa21c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.791+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2280890a0 con 0x7fa2380b1080 2024-09-13T17:13:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.791+0000 7fa23d3b5640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 0x7fa21c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.791+0000 7fa23d3b5640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 0x7fa21c06d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa234009af0 tx=0x7fa234008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.795+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa228053f90 con 0x7fa2380b1080 2024-09-13T17:13:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.962+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2380cc620 con 0x7fa21c06ac00 2024-09-13T17:13:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.971+0000 7fa22dffb640 1 -- 172.21.15.5:0/1262180977 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345283 (secure 0 0 0) 0x7fa2380cc620 con 0x7fa21c06ac00 2024-09-13T17:13:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 msgr2=0x7fa21c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 0x7fa21c06d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa234009af0 tx=0x7fa234008040 comp rx=0 tx=0).stop 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 msgr2=0x7fa2380cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa22800c450 tx=0x7fa22800c910 comp rx=0 tx=0).stop 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 shutdown_connections 2024-09-13T17:13:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa238156f40 0x7fa2380cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa21c06ac00 0x7fa21c06d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2380b1080 0x7fa2380cd380 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 --2- 172.21.15.5:0/1262180977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa23806e1c0 0x7fa2381511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 >> 172.21.15.5:0/1262180977 conn(0x7fa2380ce0d0 msgr2=0x7fa2380b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 shutdown_connections 2024-09-13T17:13:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:34.974+0000 7fa23f619640 1 -- 172.21.15.5:0/1262180977 wait complete. 2024-09-13T17:13:34.987 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T17:13:33.260876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3383296,"data_stored":2025530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003266"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195149+0000","last_change":"2024-09-13T17:13:07.818703+0000","last_active":"2024-09-13T17:13:12.195149+0000","last_peered":"2024-09-13T17:13:12.195149+0000","last_clean":"2024-09-13T17:13:12.195149+0000","last_became_active":"2024-09-13T17:13:07.818425+0000","last_became_peered":"2024-09-13T17:13:07.818425+0000","last_unstale":"2024-09-13T17:13:12.195149+0000","last_undegraded":"2024-09-13T17:13:12.195149+0000","last_fullsized":"2024-09-13T17:13:12.195149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273719+0000","last_change":"2024-09-13T17:13:08.182685+0000","last_active":"2024-09-13T17:13:12.273719+0000","last_peered":"2024-09-13T17:13:12.273719+0000","last_clean":"2024-09-13T17:13:12.273719+0000","last_became_active":"2024-09-13T17:13:08.182447+0000","last_became_peered":"2024-09-13T17:13:08.182447+0000","last_unstale":"2024-09-13T17:13:12.273719+0000","last_undegraded":"2024-09-13T17:13:12.273719+0000","last_fullsized":"2024-09-13T17:13:12.273719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273620+0000","last_change":"2024-09-13T17:13:12.223668+0000","last_active":"2024-09-13T17:13:12.273620+0000","last_peered":"2024-09-13T17:13:12.273620+0000","last_clean":"2024-09-13T17:13:12.273620+0000","last_became_active":"2024-09-13T17:13:12.223255+0000","last_became_peered":"2024-09-13T17:13:12.223255+0000","last_unstale":"2024-09-13T17:13:12.273620+0000","last_undegraded":"2024-09-13T17:13:12.273620+0000","last_fullsized":"2024-09-13T17:13:12.273620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193136+0000","last_change":"2024-09-13T17:13:07.820516+0000","last_active":"2024-09-13T17:13:12.193136+0000","last_peered":"2024-09-13T17:13:12.193136+0000","last_clean":"2024-09-13T17:13:12.193136+0000","last_became_active":"2024-09-13T17:13:07.820233+0000","last_became_peered":"2024-09-13T17:13:07.820233+0000","last_unstale":"2024-09-13T17:13:12.193136+0000","last_undegraded":"2024-09-13T17:13:12.193136+0000","last_fullsized":"2024-09-13T17:13:12.193136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270669+0000","last_change":"2024-09-13T17:13:08.185959+0000","last_active":"2024-09-13T17:13:12.270669+0000","last_peered":"2024-09-13T17:13:12.270669+0000","last_clean":"2024-09-13T17:13:12.270669+0000","last_became_active":"2024-09-13T17:13:08.185705+0000","last_became_peered":"2024-09-13T17:13:08.185705+0000","last_unstale":"2024-09-13T17:13:12.270669+0000","last_undegraded":"2024-09-13T17:13:12.270669+0000","last_fullsized":"2024-09-13T17:13:12.270669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273272+0000","last_change":"2024-09-13T17:13:12.202324+0000","last_active":"2024-09-13T17:13:12.273272+0000","last_peered":"2024-09-13T17:13:12.273272+0000","last_clean":"2024-09-13T17:13:12.273272+0000","last_became_active":"2024-09-13T17:13:12.201852+0000","last_became_peered":"2024-09-13T17:13:12.201852+0000","last_unstale":"2024-09-13T17:13:12.273272+0000","last_undegraded":"2024-09-13T17:13:12.273272+0000","last_fullsized":"2024-09-13T17:13:12.273272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.222040+0000","last_change":"2024-09-13T17:13:07.823003+0000","last_active":"2024-09-13T17:13:12.222040+0000","last_peered":"2024-09-13T17:13:12.222040+0000","last_clean":"2024-09-13T17:13:12.222040+0000","last_became_active":"2024-09-13T17:13:07.822719+0000","last_became_peered":"2024-09-13T17:13:07.822719+0000","last_unstale":"2024-09-13T17:13:12.222040+0000","last_undegraded":"2024-09-13T17:13:12.222040+0000","last_fullsized":"2024-09-13T17:13:12.222040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:18.156159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272024+0000","last_change":"2024-09-13T17:13:08.183825+0000","last_active":"2024-09-13T17:13:12.272024+0000","last_peered":"2024-09-13T17:13:12.272024+0000","last_clean":"2024-09-13T17:13:12.272024+0000","last_became_active":"2024-09-13T17:13:08.183509+0000","last_became_peered":"2024-09-13T17:13:08.183509+0000","last_unstale":"2024-09-13T17:13:12.272024+0000","last_undegraded":"2024-09-13T17:13:12.272024+0000","last_fullsized":"2024-09-13T17:13:12.272024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273360+0000","last_change":"2024-09-13T17:13:12.204784+0000","last_active":"2024-09-13T17:13:12.273360+0000","last_peered":"2024-09-13T17:13:12.273360+0000","last_clean":"2024-09-13T17:13:12.273360+0000","last_became_active":"2024-09-13T17:13:12.203462+0000","last_became_peered":"2024-09-13T17:13:12.203462+0000","last_unstale":"2024-09-13T17:13:12.273360+0000","last_undegraded":"2024-09-13T17:13:12.273360+0000","last_fullsized":"2024-09-13T17:13:12.273360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221256+0000","last_change":"2024-09-13T17:13:07.822927+0000","last_active":"2024-09-13T17:13:12.221256+0000","last_peered":"2024-09-13T17:13:12.221256+0000","last_clean":"2024-09-13T17:13:12.221256+0000","last_became_active":"2024-09-13T17:13:07.822552+0000","last_became_peered":"2024-09-13T17:13:07.822552+0000","last_unstale":"2024-09-13T17:13:12.221256+0000","last_undegraded":"2024-09-13T17:13:12.221256+0000","last_fullsized":"2024-09-13T17:13:12.221256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272055+0000","last_change":"2024-09-13T17:13:08.184922+0000","last_active":"2024-09-13T17:13:12.272055+0000","last_peered":"2024-09-13T17:13:12.272055+0000","last_clean":"2024-09-13T17:13:12.272055+0000","last_became_active":"2024-09-13T17:13:08.184640+0000","last_became_peered":"2024-09-13T17:13:08.184640+0000","last_unstale":"2024-09-13T17:13:12.272055+0000","last_undegraded":"2024-09-13T17:13:12.272055+0000","last_fullsized":"2024-09-13T17:13:12.272055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273329+0000","last_change":"2024-09-13T17:13:12.202312+0000","last_active":"2024-09-13T17:13:12.273329+0000","last_peered":"2024-09-13T17:13:12.273329+0000","last_clean":"2024-09-13T17:13:12.273329+0000","last_became_active":"2024-09-13T17:13:12.201870+0000","last_became_peered":"2024-09-13T17:13:12.201870+0000","last_unstale":"2024-09-13T17:13:12.273329+0000","last_undegraded":"2024-09-13T17:13:12.273329+0000","last_fullsized":"2024-09-13T17:13:12.273329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:13.831220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272599+0000","last_change":"2024-09-13T17:13:08.183978+0000","last_active":"2024-09-13T17:13:12.272599+0000","last_peered":"2024-09-13T17:13:12.272599+0000","last_clean":"2024-09-13T17:13:12.272599+0000","last_became_active":"2024-09-13T17:13:08.183697+0000","last_became_peered":"2024-09-13T17:13:08.183697+0000","last_unstale":"2024-09-13T17:13:12.272599+0000","last_undegraded":"2024-09-13T17:13:12.272599+0000","last_fullsized":"2024-09-13T17:13:12.272599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221213+0000","last_change":"2024-09-13T17:13:07.823217+0000","last_active":"2024-09-13T17:13:12.221213+0000","last_peered":"2024-09-13T17:13:12.221213+0000","last_clean":"2024-09-13T17:13:12.221213+0000","last_became_active":"2024-09-13T17:13:07.822960+0000","last_became_peered":"2024-09-13T17:13:07.822960+0000","last_unstale":"2024-09-13T17:13:12.221213+0000","last_undegraded":"2024-09-13T17:13:12.221213+0000","last_fullsized":"2024-09-13T17:13:12.221213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273425+0000","last_change":"2024-09-13T17:13:12.203048+0000","last_active":"2024-09-13T17:13:12.273425+0000","last_peered":"2024-09-13T17:13:12.273425+0000","last_clean":"2024-09-13T17:13:12.273425+0000","last_became_active":"2024-09-13T17:13:12.202566+0000","last_became_peered":"2024-09-13T17:13:12.202566+0000","last_unstale":"2024-09-13T17:13:12.273425+0000","last_undegraded":"2024-09-13T17:13:12.273425+0000","last_fullsized":"2024-09-13T17:13:12.273425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:22.271791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273675+0000","last_change":"2024-09-13T17:13:08.185754+0000","last_active":"2024-09-13T17:13:12.273675+0000","last_peered":"2024-09-13T17:13:12.273675+0000","last_clean":"2024-09-13T17:13:12.273675+0000","last_became_active":"2024-09-13T17:13:08.184827+0000","last_became_peered":"2024-09-13T17:13:08.184827+0000","last_unstale":"2024-09-13T17:13:12.273675+0000","last_undegraded":"2024-09-13T17:13:12.273675+0000","last_fullsized":"2024-09-13T17:13:12.273675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:21.171723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193832+0000","last_change":"2024-09-13T17:13:07.821299+0000","last_active":"2024-09-13T17:13:12.193832+0000","last_peered":"2024-09-13T17:13:12.193832+0000","last_clean":"2024-09-13T17:13:12.193832+0000","last_became_active":"2024-09-13T17:13:07.820971+0000","last_became_peered":"2024-09-13T17:13:07.820971+0000","last_unstale":"2024-09-13T17:13:12.193832+0000","last_undegraded":"2024-09-13T17:13:12.193832+0000","last_fullsized":"2024-09-13T17:13:12.193832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273393+0000","last_change":"2024-09-13T17:13:12.207075+0000","last_active":"2024-09-13T17:13:12.273393+0000","last_peered":"2024-09-13T17:13:12.273393+0000","last_clean":"2024-09-13T17:13:12.273393+0000","last_became_active":"2024-09-13T17:13:12.206675+0000","last_became_peered":"2024-09-13T17:13:12.206675+0000","last_unstale":"2024-09-13T17:13:12.273393+0000","last_undegraded":"2024-09-13T17:13:12.273393+0000","last_fullsized":"2024-09-13T17:13:12.273393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273611+0000","last_change":"2024-09-13T17:13:08.179110+0000","last_active":"2024-09-13T17:13:12.273611+0000","last_peered":"2024-09-13T17:13:12.273611+0000","last_clean":"2024-09-13T17:13:12.273611+0000","last_became_active":"2024-09-13T17:13:08.178363+0000","last_became_peered":"2024-09-13T17:13:08.178363+0000","last_unstale":"2024-09-13T17:13:12.273611+0000","last_undegraded":"2024-09-13T17:13:12.273611+0000","last_fullsized":"2024-09-13T17:13:12.273611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190765+0000","last_change":"2024-09-13T17:13:07.817732+0000","last_active":"2024-09-13T17:13:12.190765+0000","last_peered":"2024-09-13T17:13:12.190765+0000","last_clean":"2024-09-13T17:13:12.190765+0000","last_became_active":"2024-09-13T17:13:07.817449+0000","last_became_peered":"2024-09-13T17:13:07.817449+0000","last_unstale":"2024-09-13T17:13:12.190765+0000","last_undegraded":"2024-09-13T17:13:12.190765+0000","last_fullsized":"2024-09-13T17:13:12.190765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271705+0000","last_change":"2024-09-13T17:13:12.224085+0000","last_active":"2024-09-13T17:13:12.271705+0000","last_peered":"2024-09-13T17:13:12.271705+0000","last_clean":"2024-09-13T17:13:12.271705+0000","last_became_active":"2024-09-13T17:13:12.223683+0000","last_became_peered":"2024-09-13T17:13:12.223683+0000","last_unstale":"2024-09-13T17:13:12.271705+0000","last_undegraded":"2024-09-13T17:13:12.271705+0000","last_fullsized":"2024-09-13T17:13:12.271705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:49.009307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273320+0000","last_change":"2024-09-13T17:13:08.176665+0000","last_active":"2024-09-13T17:13:12.273320+0000","last_peered":"2024-09-13T17:13:12.273320+0000","last_clean":"2024-09-13T17:13:12.273320+0000","last_became_active":"2024-09-13T17:13:08.176310+0000","last_became_peered":"2024-09-13T17:13:08.176310+0000","last_unstale":"2024-09-13T17:13:12.273320+0000","last_undegraded":"2024-09-13T17:13:12.273320+0000","last_fullsized":"2024-09-13T17:13:12.273320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:08.591004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220596+0000","last_change":"2024-09-13T17:13:07.823315+0000","last_active":"2024-09-13T17:13:12.220596+0000","last_peered":"2024-09-13T17:13:12.220596+0000","last_clean":"2024-09-13T17:13:12.220596+0000","last_became_active":"2024-09-13T17:13:07.822797+0000","last_became_peered":"2024-09-13T17:13:07.822797+0000","last_unstale":"2024-09-13T17:13:12.220596+0000","last_undegraded":"2024-09-13T17:13:12.220596+0000","last_fullsized":"2024-09-13T17:13:12.220596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:23.750435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273442+0000","last_change":"2024-09-13T17:13:12.205036+0000","last_active":"2024-09-13T17:13:12.273442+0000","last_peered":"2024-09-13T17:13:12.273442+0000","last_clean":"2024-09-13T17:13:12.273442+0000","last_became_active":"2024-09-13T17:13:12.204585+0000","last_became_peered":"2024-09-13T17:13:12.204585+0000","last_unstale":"2024-09-13T17:13:12.273442+0000","last_undegraded":"2024-09-13T17:13:12.273442+0000","last_fullsized":"2024-09-13T17:13:12.273442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270653+0000","last_change":"2024-09-13T17:13:08.177098+0000","last_active":"2024-09-13T17:13:12.270653+0000","last_peered":"2024-09-13T17:13:12.270653+0000","last_clean":"2024-09-13T17:13:12.270653+0000","last_became_active":"2024-09-13T17:13:08.176776+0000","last_became_peered":"2024-09-13T17:13:08.176776+0000","last_unstale":"2024-09-13T17:13:12.270653+0000","last_undegraded":"2024-09-13T17:13:12.270653+0000","last_fullsized":"2024-09-13T17:13:12.270653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195520+0000","last_change":"2024-09-13T17:13:07.824199+0000","last_active":"2024-09-13T17:13:12.195520+0000","last_peered":"2024-09-13T17:13:12.195520+0000","last_clean":"2024-09-13T17:13:12.195520+0000","last_became_active":"2024-09-13T17:13:07.823911+0000","last_became_peered":"2024-09-13T17:13:07.823911+0000","last_unstale":"2024-09-13T17:13:12.195520+0000","last_undegraded":"2024-09-13T17:13:12.195520+0000","last_fullsized":"2024-09-13T17:13:12.195520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273309+0000","last_change":"2024-09-13T17:13:12.225869+0000","last_active":"2024-09-13T17:13:12.273309+0000","last_peered":"2024-09-13T17:13:12.273309+0000","last_clean":"2024-09-13T17:13:12.273309+0000","last_became_active":"2024-09-13T17:13:12.225019+0000","last_became_peered":"2024-09-13T17:13:12.225019+0000","last_unstale":"2024-09-13T17:13:12.273309+0000","last_undegraded":"2024-09-13T17:13:12.273309+0000","last_fullsized":"2024-09-13T17:13:12.273309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273755+0000","last_change":"2024-09-13T17:13:08.191978+0000","last_active":"2024-09-13T17:13:12.273755+0000","last_peered":"2024-09-13T17:13:12.273755+0000","last_clean":"2024-09-13T17:13:12.273755+0000","last_became_active":"2024-09-13T17:13:08.191706+0000","last_became_peered":"2024-09-13T17:13:08.191706+0000","last_unstale":"2024-09-13T17:13:12.273755+0000","last_undegraded":"2024-09-13T17:13:12.273755+0000","last_fullsized":"2024-09-13T17:13:12.273755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.397971+0000","last_change":"2024-09-13T17:13:07.818785+0000","last_active":"2024-09-13T17:13:12.397971+0000","last_peered":"2024-09-13T17:13:12.397971+0000","last_clean":"2024-09-13T17:13:12.397971+0000","last_became_active":"2024-09-13T17:13:07.818279+0000","last_became_peered":"2024-09-13T17:13:07.818279+0000","last_unstale":"2024-09-13T17:13:12.397971+0000","last_undegraded":"2024-09-13T17:13:12.397971+0000","last_fullsized":"2024-09-13T17:13:12.397971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273550+0000","last_change":"2024-09-13T17:13:12.224503+0000","last_active":"2024-09-13T17:13:12.273550+0000","last_peered":"2024-09-13T17:13:12.273550+0000","last_clean":"2024-09-13T17:13:12.273550+0000","last_became_active":"2024-09-13T17:13:12.224159+0000","last_became_peered":"2024-09-13T17:13:12.224159+0000","last_unstale":"2024-09-13T17:13:12.273550+0000","last_undegraded":"2024-09-13T17:13:12.273550+0000","last_fullsized":"2024-09-13T17:13:12.273550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.258345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271614+0000","last_change":"2024-09-13T17:13:08.175329+0000","last_active":"2024-09-13T17:13:12.271614+0000","last_peered":"2024-09-13T17:13:12.271614+0000","last_clean":"2024-09-13T17:13:12.271614+0000","last_became_active":"2024-09-13T17:13:08.174912+0000","last_became_peered":"2024-09-13T17:13:08.174912+0000","last_unstale":"2024-09-13T17:13:12.271614+0000","last_undegraded":"2024-09-13T17:13:12.271614+0000","last_fullsized":"2024-09-13T17:13:12.271614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.221792+0000","last_change":"2024-09-13T17:13:07.823709+0000","last_active":"2024-09-13T17:13:12.221792+0000","last_peered":"2024-09-13T17:13:12.221792+0000","last_clean":"2024-09-13T17:13:12.221792+0000","last_became_active":"2024-09-13T17:13:07.823325+0000","last_became_peered":"2024-09-13T17:13:07.823325+0000","last_unstale":"2024-09-13T17:13:12.221792+0000","last_undegraded":"2024-09-13T17:13:12.221792+0000","last_fullsized":"2024-09-13T17:13:12.221792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:14.540622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270544+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.270544+0000","last_peered":"2024-09-13T17:13:12.270544+0000","last_clean":"2024-09-13T17:13:12.270544+0000","last_became_active":"2024-09-13T17:13:12.221821+0000","last_became_peered":"2024-09-13T17:13:12.221821+0000","last_unstale":"2024-09-13T17:13:12.270544+0000","last_undegraded":"2024-09-13T17:13:12.270544+0000","last_fullsized":"2024-09-13T17:13:12.270544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272069+0000","last_change":"2024-09-13T17:13:08.181489+0000","last_active":"2024-09-13T17:13:12.272069+0000","last_peered":"2024-09-13T17:13:12.272069+0000","last_clean":"2024-09-13T17:13:12.272069+0000","last_became_active":"2024-09-13T17:13:08.181204+0000","last_became_peered":"2024-09-13T17:13:08.181204+0000","last_unstale":"2024-09-13T17:13:12.272069+0000","last_undegraded":"2024-09-13T17:13:12.272069+0000","last_fullsized":"2024-09-13T17:13:12.272069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.197571+0000","last_change":"2024-09-13T17:13:07.818661+0000","last_active":"2024-09-13T17:13:12.197571+0000","last_peered":"2024-09-13T17:13:12.197571+0000","last_clean":"2024-09-13T17:13:12.197571+0000","last_became_active":"2024-09-13T17:13:07.818317+0000","last_became_peered":"2024-09-13T17:13:07.818317+0000","last_unstale":"2024-09-13T17:13:12.197571+0000","last_undegraded":"2024-09-13T17:13:12.197571+0000","last_fullsized":"2024-09-13T17:13:12.197571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271543+0000","last_change":"2024-09-13T17:13:12.202522+0000","last_active":"2024-09-13T17:13:12.271543+0000","last_peered":"2024-09-13T17:13:12.271543+0000","last_clean":"2024-09-13T17:13:12.271543+0000","last_became_active":"2024-09-13T17:13:12.202110+0000","last_became_peered":"2024-09-13T17:13:12.202110+0000","last_unstale":"2024-09-13T17:13:12.271543+0000","last_undegraded":"2024-09-13T17:13:12.271543+0000","last_fullsized":"2024-09-13T17:13:12.271543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:22.456678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273382+0000","last_change":"2024-09-13T17:13:08.179940+0000","last_active":"2024-09-13T17:13:12.273382+0000","last_peered":"2024-09-13T17:13:12.273382+0000","last_clean":"2024-09-13T17:13:12.273382+0000","last_became_active":"2024-09-13T17:13:08.179628+0000","last_became_peered":"2024-09-13T17:13:08.179628+0000","last_unstale":"2024-09-13T17:13:12.273382+0000","last_undegraded":"2024-09-13T17:13:12.273382+0000","last_fullsized":"2024-09-13T17:13:12.273382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:11.564848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.190045+0000","last_change":"2024-09-13T17:13:07.821156+0000","last_active":"2024-09-13T17:13:12.190045+0000","last_peered":"2024-09-13T17:13:12.190045+0000","last_clean":"2024-09-13T17:13:12.190045+0000","last_became_active":"2024-09-13T17:13:07.820920+0000","last_became_peered":"2024-09-13T17:13:07.820920+0000","last_unstale":"2024-09-13T17:13:12.190045+0000","last_undegraded":"2024-09-13T17:13:12.190045+0000","last_fullsized":"2024-09-13T17:13:12.190045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:07.588640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271588+0000","last_change":"2024-09-13T17:13:12.210655+0000","last_active":"2024-09-13T17:13:12.271588+0000","last_peered":"2024-09-13T17:13:12.271588+0000","last_clean":"2024-09-13T17:13:12.271588+0000","last_became_active":"2024-09-13T17:13:12.209944+0000","last_became_peered":"2024-09-13T17:13:12.209944+0000","last_unstale":"2024-09-13T17:13:12.271588+0000","last_undegraded":"2024-09-13T17:13:12.271588+0000","last_fullsized":"2024-09-13T17:13:12.271588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271470+0000","last_change":"2024-09-13T17:13:08.175084+0000","last_active":"2024-09-13T17:13:12.271470+0000","last_peered":"2024-09-13T17:13:12.271470+0000","last_clean":"2024-09-13T17:13:12.271470+0000","last_became_active":"2024-09-13T17:13:08.174696+0000","last_became_peered":"2024-09-13T17:13:08.174696+0000","last_unstale":"2024-09-13T17:13:12.271470+0000","last_undegraded":"2024-09-13T17:13:12.271470+0000","last_fullsized":"2024-09-13T17:13:12.271470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186429+0000","last_change":"2024-09-13T17:13:07.820916+0000","last_active":"2024-09-13T17:13:12.186429+0000","last_peered":"2024-09-13T17:13:12.186429+0000","last_clean":"2024-09-13T17:13:12.186429+0000","last_became_active":"2024-09-13T17:13:07.820607+0000","last_became_peered":"2024-09-13T17:13:07.820607+0000","last_unstale":"2024-09-13T17:13:12.186429+0000","last_undegraded":"2024-09-13T17:13:12.186429+0000","last_fullsized":"2024-09-13T17:13:12.186429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271720+0000","last_change":"2024-09-13T17:13:12.209459+0000","last_active":"2024-09-13T17:13:12.271720+0000","last_peered":"2024-09-13T17:13:12.271720+0000","last_clean":"2024-09-13T17:13:12.271720+0000","last_became_active":"2024-09-13T17:13:12.208931+0000","last_became_peered":"2024-09-13T17:13:12.208931+0000","last_unstale":"2024-09-13T17:13:12.271720+0000","last_undegraded":"2024-09-13T17:13:12.271720+0000","last_fullsized":"2024-09-13T17:13:12.271720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270503+0000","last_change":"2024-09-13T17:13:08.180268+0000","last_active":"2024-09-13T17:13:12.270503+0000","last_peered":"2024-09-13T17:13:12.270503+0000","last_clean":"2024-09-13T17:13:12.270503+0000","last_became_active":"2024-09-13T17:13:08.179711+0000","last_became_peered":"2024-09-13T17:13:08.179711+0000","last_unstale":"2024-09-13T17:13:12.270503+0000","last_undegraded":"2024-09-13T17:13:12.270503+0000","last_fullsized":"2024-09-13T17:13:12.270503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:07.540508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220632+0000","last_change":"2024-09-13T17:13:07.823838+0000","last_active":"2024-09-13T17:13:12.220632+0000","last_peered":"2024-09-13T17:13:12.220632+0000","last_clean":"2024-09-13T17:13:12.220632+0000","last_became_active":"2024-09-13T17:13:07.823558+0000","last_became_peered":"2024-09-13T17:13:07.823558+0000","last_unstale":"2024-09-13T17:13:12.220632+0000","last_undegraded":"2024-09-13T17:13:12.220632+0000","last_fullsized":"2024-09-13T17:13:12.220632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270643+0000","last_change":"2024-09-13T17:13:12.222477+0000","last_active":"2024-09-13T17:13:12.270643+0000","last_peered":"2024-09-13T17:13:12.270643+0000","last_clean":"2024-09-13T17:13:12.270643+0000","last_became_active":"2024-09-13T17:13:12.221879+0000","last_became_peered":"2024-09-13T17:13:12.221879+0000","last_unstale":"2024-09-13T17:13:12.270643+0000","last_undegraded":"2024-09-13T17:13:12.270643+0000","last_fullsized":"2024-09-13T17:13:12.270643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273658+0000","last_change":"2024-09-13T17:13:08.185879+0000","last_active":"2024-09-13T17:13:12.273658+0000","last_peered":"2024-09-13T17:13:12.273658+0000","last_clean":"2024-09-13T17:13:12.273658+0000","last_became_active":"2024-09-13T17:13:08.185632+0000","last_became_peered":"2024-09-13T17:13:08.185632+0000","last_unstale":"2024-09-13T17:13:12.273658+0000","last_undegraded":"2024-09-13T17:13:12.273658+0000","last_fullsized":"2024-09-13T17:13:12.273658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.187815+0000","last_change":"2024-09-13T17:13:07.811868+0000","last_active":"2024-09-13T17:13:12.187815+0000","last_peered":"2024-09-13T17:13:12.187815+0000","last_clean":"2024-09-13T17:13:12.187815+0000","last_became_active":"2024-09-13T17:13:07.811535+0000","last_became_peered":"2024-09-13T17:13:07.811535+0000","last_unstale":"2024-09-13T17:13:12.187815+0000","last_undegraded":"2024-09-13T17:13:12.187815+0000","last_fullsized":"2024-09-13T17:13:12.187815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.220708+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:13:12.220708+0000","last_peered":"2024-09-13T17:13:12.220708+0000","last_clean":"2024-09-13T17:13:12.220708+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:13:12.220708+0000","last_undegraded":"2024-09-13T17:13:12.220708+0000","last_fullsized":"2024-09-13T17:13:12.220708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272664+0000","last_change":"2024-09-13T17:13:12.223747+0000","last_active":"2024-09-13T17:13:12.272664+0000","last_peered":"2024-09-13T17:13:12.272664+0000","last_clean":"2024-09-13T17:13:12.272664+0000","last_became_active":"2024-09-13T17:13:12.223344+0000","last_became_peered":"2024-09-13T17:13:12.223344+0000","last_unstale":"2024-09-13T17:13:12.272664+0000","last_undegraded":"2024-09-13T17:13:12.272664+0000","last_fullsized":"2024-09-13T17:13:12.272664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:00.318166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272521+0000","last_change":"2024-09-13T17:13:08.195358+0000","last_active":"2024-09-13T17:13:12.272521+0000","last_peered":"2024-09-13T17:13:12.272521+0000","last_clean":"2024-09-13T17:13:12.272521+0000","last_became_active":"2024-09-13T17:13:08.194963+0000","last_became_peered":"2024-09-13T17:13:08.194963+0000","last_unstale":"2024-09-13T17:13:12.272521+0000","last_undegraded":"2024-09-13T17:13:12.272521+0000","last_fullsized":"2024-09-13T17:13:12.272521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186435+0000","last_change":"2024-09-13T17:13:07.814854+0000","last_active":"2024-09-13T17:13:12.186435+0000","last_peered":"2024-09-13T17:13:12.186435+0000","last_clean":"2024-09-13T17:13:12.186435+0000","last_became_active":"2024-09-13T17:13:07.814526+0000","last_became_peered":"2024-09-13T17:13:07.814526+0000","last_unstale":"2024-09-13T17:13:12.186435+0000","last_undegraded":"2024-09-13T17:13:12.186435+0000","last_fullsized":"2024-09-13T17:13:12.186435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272579+0000","last_change":"2024-09-13T17:13:12.222081+0000","last_active":"2024-09-13T17:13:12.272579+0000","last_peered":"2024-09-13T17:13:12.272579+0000","last_clean":"2024-09-13T17:13:12.272579+0000","last_became_active":"2024-09-13T17:13:12.221687+0000","last_became_peered":"2024-09-13T17:13:12.221687+0000","last_unstale":"2024-09-13T17:13:12.272579+0000","last_undegraded":"2024-09-13T17:13:12.272579+0000","last_fullsized":"2024-09-13T17:13:12.272579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:21.997233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272033+0000","last_change":"2024-09-13T17:13:08.181540+0000","last_active":"2024-09-13T17:13:12.272033+0000","last_peered":"2024-09-13T17:13:12.272033+0000","last_clean":"2024-09-13T17:13:12.272033+0000","last_became_active":"2024-09-13T17:13:08.181238+0000","last_became_peered":"2024-09-13T17:13:08.181238+0000","last_unstale":"2024-09-13T17:13:12.272033+0000","last_undegraded":"2024-09-13T17:13:12.272033+0000","last_fullsized":"2024-09-13T17:13:12.272033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191480+0000","last_change":"2024-09-13T17:13:07.818858+0000","last_active":"2024-09-13T17:13:12.191480+0000","last_peered":"2024-09-13T17:13:12.191480+0000","last_clean":"2024-09-13T17:13:12.191480+0000","last_became_active":"2024-09-13T17:13:07.818565+0000","last_became_peered":"2024-09-13T17:13:07.818565+0000","last_unstale":"2024-09-13T17:13:12.191480+0000","last_undegraded":"2024-09-13T17:13:12.191480+0000","last_fullsized":"2024-09-13T17:13:12.191480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270562+0000","last_change":"2024-09-13T17:13:12.203489+0000","last_active":"2024-09-13T17:13:12.270562+0000","last_peered":"2024-09-13T17:13:12.270562+0000","last_clean":"2024-09-13T17:13:12.270562+0000","last_became_active":"2024-09-13T17:13:12.203032+0000","last_became_peered":"2024-09-13T17:13:12.203032+0000","last_unstale":"2024-09-13T17:13:12.270562+0000","last_undegraded":"2024-09-13T17:13:12.270562+0000","last_fullsized":"2024-09-13T17:13:12.270562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:38.955559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272603+0000","last_change":"2024-09-13T17:13:08.194162+0000","last_active":"2024-09-13T17:13:12.272603+0000","last_peered":"2024-09-13T17:13:12.272603+0000","last_clean":"2024-09-13T17:13:12.272603+0000","last_became_active":"2024-09-13T17:13:08.193901+0000","last_became_peered":"2024-09-13T17:13:08.193901+0000","last_unstale":"2024-09-13T17:13:12.272603+0000","last_undegraded":"2024-09-13T17:13:12.272603+0000","last_fullsized":"2024-09-13T17:13:12.272603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186482+0000","last_change":"2024-09-13T17:13:07.821914+0000","last_active":"2024-09-13T17:13:12.186482+0000","last_peered":"2024-09-13T17:13:12.186482+0000","last_clean":"2024-09-13T17:13:12.186482+0000","last_became_active":"2024-09-13T17:13:07.821626+0000","last_became_peered":"2024-09-13T17:13:07.821626+0000","last_unstale":"2024-09-13T17:13:12.186482+0000","last_undegraded":"2024-09-13T17:13:12.186482+0000","last_fullsized":"2024-09-13T17:13:12.186482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271889+0000","last_change":"2024-09-13T17:13:12.223827+0000","last_active":"2024-09-13T17:13:12.271889+0000","last_peered":"2024-09-13T17:13:12.271889+0000","last_clean":"2024-09-13T17:13:12.271889+0000","last_became_active":"2024-09-13T17:13:12.223230+0000","last_became_peered":"2024-09-13T17:13:12.223230+0000","last_unstale":"2024-09-13T17:13:12.271889+0000","last_undegraded":"2024-09-13T17:13:12.271889+0000","last_fullsized":"2024-09-13T17:13:12.271889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:38.101270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272574+0000","last_change":"2024-09-13T17:13:08.194775+0000","last_active":"2024-09-13T17:13:12.272574+0000","last_peered":"2024-09-13T17:13:12.272574+0000","last_clean":"2024-09-13T17:13:12.272574+0000","last_became_active":"2024-09-13T17:13:08.194500+0000","last_became_peered":"2024-09-13T17:13:08.194500+0000","last_unstale":"2024-09-13T17:13:12.272574+0000","last_undegraded":"2024-09-13T17:13:12.272574+0000","last_fullsized":"2024-09-13T17:13:12.272574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188626+0000","last_change":"2024-09-13T17:13:07.812760+0000","last_active":"2024-09-13T17:13:12.188626+0000","last_peered":"2024-09-13T17:13:12.188626+0000","last_clean":"2024-09-13T17:13:12.188626+0000","last_became_active":"2024-09-13T17:13:07.812481+0000","last_became_peered":"2024-09-13T17:13:07.812481+0000","last_unstale":"2024-09-13T17:13:12.188626+0000","last_undegraded":"2024-09-13T17:13:12.188626+0000","last_fullsized":"2024-09-13T17:13:12.188626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273298+0000","last_change":"2024-09-13T17:13:12.203001+0000","last_active":"2024-09-13T17:13:12.273298+0000","last_peered":"2024-09-13T17:13:12.273298+0000","last_clean":"2024-09-13T17:13:12.273298+0000","last_became_active":"2024-09-13T17:13:12.201855+0000","last_became_peered":"2024-09-13T17:13:12.201855+0000","last_unstale":"2024-09-13T17:13:12.273298+0000","last_undegraded":"2024-09-13T17:13:12.273298+0000","last_fullsized":"2024-09-13T17:13:12.273298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:19:06.249682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272432+0000","last_change":"2024-09-13T17:13:08.195578+0000","last_active":"2024-09-13T17:13:12.272432+0000","last_peered":"2024-09-13T17:13:12.272432+0000","last_clean":"2024-09-13T17:13:12.272432+0000","last_became_active":"2024-09-13T17:13:08.195118+0000","last_became_peered":"2024-09-13T17:13:08.195118+0000","last_unstale":"2024-09-13T17:13:12.272432+0000","last_undegraded":"2024-09-13T17:13:12.272432+0000","last_fullsized":"2024-09-13T17:13:12.272432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.186263+0000","last_change":"2024-09-13T17:13:07.819737+0000","last_active":"2024-09-13T17:13:12.186263+0000","last_peered":"2024-09-13T17:13:12.186263+0000","last_clean":"2024-09-13T17:13:12.186263+0000","last_became_active":"2024-09-13T17:13:07.819435+0000","last_became_peered":"2024-09-13T17:13:07.819435+0000","last_unstale":"2024-09-13T17:13:12.186263+0000","last_undegraded":"2024-09-13T17:13:12.186263+0000","last_fullsized":"2024-09-13T17:13:12.186263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270633+0000","last_change":"2024-09-13T17:13:12.204881+0000","last_active":"2024-09-13T17:13:12.270633+0000","last_peered":"2024-09-13T17:13:12.270633+0000","last_clean":"2024-09-13T17:13:12.270633+0000","last_became_active":"2024-09-13T17:13:12.204492+0000","last_became_peered":"2024-09-13T17:13:12.204492+0000","last_unstale":"2024-09-13T17:13:12.270633+0000","last_undegraded":"2024-09-13T17:13:12.270633+0000","last_fullsized":"2024-09-13T17:13:12.270633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:26.315225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272551+0000","last_change":"2024-09-13T17:13:08.187413+0000","last_active":"2024-09-13T17:13:12.272551+0000","last_peered":"2024-09-13T17:13:12.272551+0000","last_clean":"2024-09-13T17:13:12.272551+0000","last_became_active":"2024-09-13T17:13:08.187156+0000","last_became_peered":"2024-09-13T17:13:08.187156+0000","last_unstale":"2024-09-13T17:13:12.272551+0000","last_undegraded":"2024-09-13T17:13:12.272551+0000","last_fullsized":"2024-09-13T17:13:12.272551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194011+0000","last_change":"2024-09-13T17:13:07.816811+0000","last_active":"2024-09-13T17:13:12.194011+0000","last_peered":"2024-09-13T17:13:12.194011+0000","last_clean":"2024-09-13T17:13:12.194011+0000","last_became_active":"2024-09-13T17:13:07.816486+0000","last_became_peered":"2024-09-13T17:13:07.816486+0000","last_unstale":"2024-09-13T17:13:12.194011+0000","last_undegraded":"2024-09-13T17:13:12.194011+0000","last_fullsized":"2024-09-13T17:13:12.194011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:44.933740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273738+0000","last_change":"2024-09-13T17:13:12.222779+0000","last_active":"2024-09-13T17:13:12.273738+0000","last_peered":"2024-09-13T17:13:12.273738+0000","last_clean":"2024-09-13T17:13:12.273738+0000","last_became_active":"2024-09-13T17:13:12.222431+0000","last_became_peered":"2024-09-13T17:13:12.222431+0000","last_unstale":"2024-09-13T17:13:12.273738+0000","last_undegraded":"2024-09-13T17:13:12.273738+0000","last_fullsized":"2024-09-13T17:13:12.273738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:07.973247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272468+0000","last_change":"2024-09-13T17:13:08.195864+0000","last_active":"2024-09-13T17:13:12.272468+0000","last_peered":"2024-09-13T17:13:12.272468+0000","last_clean":"2024-09-13T17:13:12.272468+0000","last_became_active":"2024-09-13T17:13:08.195589+0000","last_became_peered":"2024-09-13T17:13:08.195589+0000","last_unstale":"2024-09-13T17:13:12.272468+0000","last_undegraded":"2024-09-13T17:13:12.272468+0000","last_fullsized":"2024-09-13T17:13:12.272468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.189968+0000","last_change":"2024-09-13T17:13:07.820905+0000","last_active":"2024-09-13T17:13:12.189968+0000","last_peered":"2024-09-13T17:13:12.189968+0000","last_clean":"2024-09-13T17:13:12.189968+0000","last_became_active":"2024-09-13T17:13:07.820577+0000","last_became_peered":"2024-09-13T17:13:07.820577+0000","last_unstale":"2024-09-13T17:13:12.189968+0000","last_undegraded":"2024-09-13T17:13:12.189968+0000","last_fullsized":"2024-09-13T17:13:12.189968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273689+0000","last_change":"2024-09-13T17:13:12.222206+0000","last_active":"2024-09-13T17:13:12.273689+0000","last_peered":"2024-09-13T17:13:12.273689+0000","last_clean":"2024-09-13T17:13:12.273689+0000","last_became_active":"2024-09-13T17:13:12.221832+0000","last_became_peered":"2024-09-13T17:13:12.221832+0000","last_unstale":"2024-09-13T17:13:12.273689+0000","last_undegraded":"2024-09-13T17:13:12.273689+0000","last_fullsized":"2024-09-13T17:13:12.273689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:24.267854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270533+0000","last_change":"2024-09-13T17:13:08.188169+0000","last_active":"2024-09-13T17:13:12.270533+0000","last_peered":"2024-09-13T17:13:12.270533+0000","last_clean":"2024-09-13T17:13:12.270533+0000","last_became_active":"2024-09-13T17:13:08.183992+0000","last_became_peered":"2024-09-13T17:13:08.183992+0000","last_unstale":"2024-09-13T17:13:12.270533+0000","last_undegraded":"2024-09-13T17:13:12.270533+0000","last_fullsized":"2024-09-13T17:13:12.270533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.196619+0000","last_change":"2024-09-13T17:13:07.809275+0000","last_active":"2024-09-13T17:13:12.196619+0000","last_peered":"2024-09-13T17:13:12.196619+0000","last_clean":"2024-09-13T17:13:12.196619+0000","last_became_active":"2024-09-13T17:13:07.808983+0000","last_became_peered":"2024-09-13T17:13:07.808983+0000","last_unstale":"2024-09-13T17:13:12.196619+0000","last_undegraded":"2024-09-13T17:13:12.196619+0000","last_fullsized":"2024-09-13T17:13:12.196619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:36.776872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272043+0000","last_change":"2024-09-13T17:13:12.223022+0000","last_active":"2024-09-13T17:13:12.272043+0000","last_peered":"2024-09-13T17:13:12.272043+0000","last_clean":"2024-09-13T17:13:12.272043+0000","last_became_active":"2024-09-13T17:13:12.222587+0000","last_became_peered":"2024-09-13T17:13:12.222587+0000","last_unstale":"2024-09-13T17:13:12.272043+0000","last_undegraded":"2024-09-13T17:13:12.272043+0000","last_fullsized":"2024-09-13T17:13:12.272043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:38.701616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272504+0000","last_change":"2024-09-13T17:13:08.191872+0000","last_active":"2024-09-13T17:13:12.272504+0000","last_peered":"2024-09-13T17:13:12.272504+0000","last_clean":"2024-09-13T17:13:12.272504+0000","last_became_active":"2024-09-13T17:13:08.191600+0000","last_became_peered":"2024-09-13T17:13:08.191600+0000","last_unstale":"2024-09-13T17:13:12.272504+0000","last_undegraded":"2024-09-13T17:13:12.272504+0000","last_fullsized":"2024-09-13T17:13:12.272504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:10.848695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T17:13:16.967984+0000","last_change":"2024-09-13T17:13:07.818187+0000","last_active":"2024-09-13T17:13:16.967984+0000","last_peered":"2024-09-13T17:13:16.967984+0000","last_clean":"2024-09-13T17:13:16.967984+0000","last_became_active":"2024-09-13T17:13:07.817767+0000","last_became_peered":"2024-09-13T17:13:07.817767+0000","last_unstale":"2024-09-13T17:13:16.967984+0000","last_undegraded":"2024-09-13T17:13:16.967984+0000","last_fullsized":"2024-09-13T17:13:16.967984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:52.877174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271560+0000","last_change":"2024-09-13T17:13:12.198787+0000","last_active":"2024-09-13T17:13:12.271560+0000","last_peered":"2024-09-13T17:13:12.271560+0000","last_clean":"2024-09-13T17:13:12.271560+0000","last_became_active":"2024-09-13T17:13:12.198435+0000","last_became_peered":"2024-09-13T17:13:12.198435+0000","last_unstale":"2024-09-13T17:13:12.271560+0000","last_undegraded":"2024-09-13T17:13:12.271560+0000","last_fullsized":"2024-09-13T17:13:12.271560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273414+0000","last_change":"2024-09-13T17:13:08.188875+0000","last_active":"2024-09-13T17:13:12.273414+0000","last_peered":"2024-09-13T17:13:12.273414+0000","last_clean":"2024-09-13T17:13:12.273414+0000","last_became_active":"2024-09-13T17:13:08.187520+0000","last_became_peered":"2024-09-13T17:13:08.187520+0000","last_unstale":"2024-09-13T17:13:12.273414+0000","last_undegraded":"2024-09-13T17:13:12.273414+0000","last_fullsized":"2024-09-13T17:13:12.273414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191401+0000","last_change":"2024-09-13T17:13:07.819358+0000","last_active":"2024-09-13T17:13:12.191401+0000","last_peered":"2024-09-13T17:13:12.191401+0000","last_clean":"2024-09-13T17:13:12.191401+0000","last_became_active":"2024-09-13T17:13:07.819090+0000","last_became_peered":"2024-09-13T17:13:07.819090+0000","last_unstale":"2024-09-13T17:13:12.191401+0000","last_undegraded":"2024-09-13T17:13:12.191401+0000","last_fullsized":"2024-09-13T17:13:12.191401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273371+0000","last_change":"2024-09-13T17:13:12.198537+0000","last_active":"2024-09-13T17:13:12.273371+0000","last_peered":"2024-09-13T17:13:12.273371+0000","last_clean":"2024-09-13T17:13:12.273371+0000","last_became_active":"2024-09-13T17:13:12.198097+0000","last_became_peered":"2024-09-13T17:13:12.198097+0000","last_unstale":"2024-09-13T17:13:12.273371+0000","last_undegraded":"2024-09-13T17:13:12.273371+0000","last_fullsized":"2024-09-13T17:13:12.273371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270678+0000","last_change":"2024-09-13T17:13:08.188117+0000","last_active":"2024-09-13T17:13:12.270678+0000","last_peered":"2024-09-13T17:13:12.270678+0000","last_clean":"2024-09-13T17:13:12.270678+0000","last_became_active":"2024-09-13T17:13:08.187895+0000","last_became_peered":"2024-09-13T17:13:08.187895+0000","last_unstale":"2024-09-13T17:13:12.270678+0000","last_undegraded":"2024-09-13T17:13:12.270678+0000","last_fullsized":"2024-09-13T17:13:12.270678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188395+0000","last_change":"2024-09-13T17:13:07.816509+0000","last_active":"2024-09-13T17:13:12.188395+0000","last_peered":"2024-09-13T17:13:12.188395+0000","last_clean":"2024-09-13T17:13:12.188395+0000","last_became_active":"2024-09-13T17:13:07.816220+0000","last_became_peered":"2024-09-13T17:13:07.816220+0000","last_unstale":"2024-09-13T17:13:12.188395+0000","last_undegraded":"2024-09-13T17:13:12.188395+0000","last_fullsized":"2024-09-13T17:13:12.188395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:39:10.562485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273587+0000","last_change":"2024-09-13T17:13:12.211455+0000","last_active":"2024-09-13T17:13:12.273587+0000","last_peered":"2024-09-13T17:13:12.273587+0000","last_clean":"2024-09-13T17:13:12.273587+0000","last_became_active":"2024-09-13T17:13:12.211134+0000","last_became_peered":"2024-09-13T17:13:12.211134+0000","last_unstale":"2024-09-13T17:13:12.273587+0000","last_undegraded":"2024-09-13T17:13:12.273587+0000","last_fullsized":"2024-09-13T17:13:12.273587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:01.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272080+0000","last_change":"2024-09-13T17:13:08.186199+0000","last_active":"2024-09-13T17:13:12.272080+0000","last_peered":"2024-09-13T17:13:12.272080+0000","last_clean":"2024-09-13T17:13:12.272080+0000","last_became_active":"2024-09-13T17:13:08.185905+0000","last_became_peered":"2024-09-13T17:13:08.185905+0000","last_unstale":"2024-09-13T17:13:12.272080+0000","last_undegraded":"2024-09-13T17:13:12.272080+0000","last_fullsized":"2024-09-13T17:13:12.272080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:00.586871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.195432+0000","last_change":"2024-09-13T17:13:07.818508+0000","last_active":"2024-09-13T17:13:12.195432+0000","last_peered":"2024-09-13T17:13:12.195432+0000","last_clean":"2024-09-13T17:13:12.195432+0000","last_became_active":"2024-09-13T17:13:07.818195+0000","last_became_peered":"2024-09-13T17:13:07.818195+0000","last_unstale":"2024-09-13T17:13:12.195432+0000","last_undegraded":"2024-09-13T17:13:12.195432+0000","last_fullsized":"2024-09-13T17:13:12.195432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273629+0000","last_change":"2024-09-13T17:13:12.225297+0000","last_active":"2024-09-13T17:13:12.273629+0000","last_peered":"2024-09-13T17:13:12.273629+0000","last_clean":"2024-09-13T17:13:12.273629+0000","last_became_active":"2024-09-13T17:13:12.224933+0000","last_became_peered":"2024-09-13T17:13:12.224933+0000","last_unstale":"2024-09-13T17:13:12.273629+0000","last_undegraded":"2024-09-13T17:13:12.273629+0000","last_fullsized":"2024-09-13T17:13:12.273629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:39.207517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270623+0000","last_change":"2024-09-13T17:13:12.224462+0000","last_active":"2024-09-13T17:13:12.270623+0000","last_peered":"2024-09-13T17:13:12.270623+0000","last_clean":"2024-09-13T17:13:12.270623+0000","last_became_active":"2024-09-13T17:13:12.223084+0000","last_became_peered":"2024-09-13T17:13:12.223084+0000","last_unstale":"2024-09-13T17:13:12.270623+0000","last_undegraded":"2024-09-13T17:13:12.270623+0000","last_fullsized":"2024-09-13T17:13:12.270623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:00.453950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271489+0000","last_change":"2024-09-13T17:13:08.179431+0000","last_active":"2024-09-13T17:13:12.271489+0000","last_peered":"2024-09-13T17:13:12.271489+0000","last_clean":"2024-09-13T17:13:12.271489+0000","last_became_active":"2024-09-13T17:13:08.178872+0000","last_became_peered":"2024-09-13T17:13:08.178872+0000","last_unstale":"2024-09-13T17:13:12.271489+0000","last_undegraded":"2024-09-13T17:13:12.271489+0000","last_fullsized":"2024-09-13T17:13:12.271489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.188486+0000","last_change":"2024-09-13T17:13:07.808744+0000","last_active":"2024-09-13T17:13:12.188486+0000","last_peered":"2024-09-13T17:13:12.188486+0000","last_clean":"2024-09-13T17:13:12.188486+0000","last_became_active":"2024-09-13T17:13:07.808479+0000","last_became_peered":"2024-09-13T17:13:07.808479+0000","last_unstale":"2024-09-13T17:13:12.188486+0000","last_undegraded":"2024-09-13T17:13:12.188486+0000","last_fullsized":"2024-09-13T17:13:12.188486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:34.134390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272723+0000","last_change":"2024-09-13T17:13:12.202980+0000","last_active":"2024-09-13T17:13:12.272723+0000","last_peered":"2024-09-13T17:13:12.272723+0000","last_clean":"2024-09-13T17:13:12.272723+0000","last_became_active":"2024-09-13T17:13:12.202568+0000","last_became_peered":"2024-09-13T17:13:12.202568+0000","last_unstale":"2024-09-13T17:13:12.272723+0000","last_undegraded":"2024-09-13T17:13:12.272723+0000","last_fullsized":"2024-09-13T17:13:12.272723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:08.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273602+0000","last_change":"2024-09-13T17:13:08.184455+0000","last_active":"2024-09-13T17:13:12.273602+0000","last_peered":"2024-09-13T17:13:12.273602+0000","last_clean":"2024-09-13T17:13:12.273602+0000","last_became_active":"2024-09-13T17:13:08.184221+0000","last_became_peered":"2024-09-13T17:13:08.184221+0000","last_unstale":"2024-09-13T17:13:12.273602+0000","last_undegraded":"2024-09-13T17:13:12.273602+0000","last_fullsized":"2024-09-13T17:13:12.273602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.191347+0000","last_change":"2024-09-13T17:13:07.816989+0000","last_active":"2024-09-13T17:13:12.191347+0000","last_peered":"2024-09-13T17:13:12.191347+0000","last_clean":"2024-09-13T17:13:12.191347+0000","last_became_active":"2024-09-13T17:13:07.816688+0000","last_became_peered":"2024-09-13T17:13:07.816688+0000","last_unstale":"2024-09-13T17:13:12.191347+0000","last_undegraded":"2024-09-13T17:13:12.191347+0000","last_fullsized":"2024-09-13T17:13:12.191347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:16.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.194332+0000","last_change":"2024-09-13T17:13:07.814845+0000","last_active":"2024-09-13T17:13:12.194332+0000","last_peered":"2024-09-13T17:13:12.194332+0000","last_clean":"2024-09-13T17:13:12.194332+0000","last_became_active":"2024-09-13T17:13:07.814565+0000","last_became_peered":"2024-09-13T17:13:07.814565+0000","last_unstale":"2024-09-13T17:13:12.194332+0000","last_undegraded":"2024-09-13T17:13:12.194332+0000","last_fullsized":"2024-09-13T17:13:12.194332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:17.053913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270586+0000","last_change":"2024-09-13T17:13:08.181292+0000","last_active":"2024-09-13T17:13:12.270586+0000","last_peered":"2024-09-13T17:13:12.270586+0000","last_clean":"2024-09-13T17:13:12.270586+0000","last_became_active":"2024-09-13T17:13:08.180800+0000","last_became_peered":"2024-09-13T17:13:08.180800+0000","last_unstale":"2024-09-13T17:13:12.270586+0000","last_undegraded":"2024-09-13T17:13:12.270586+0000","last_fullsized":"2024-09-13T17:13:12.270586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:53.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273547+0000","last_change":"2024-09-13T17:13:12.205700+0000","last_active":"2024-09-13T17:13:12.273547+0000","last_peered":"2024-09-13T17:13:12.273547+0000","last_clean":"2024-09-13T17:13:12.273547+0000","last_became_active":"2024-09-13T17:13:12.205330+0000","last_became_peered":"2024-09-13T17:13:12.205330+0000","last_unstale":"2024-09-13T17:13:12.273547+0000","last_undegraded":"2024-09-13T17:13:12.273547+0000","last_fullsized":"2024-09-13T17:13:12.273547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:55.349358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.193464+0000","last_change":"2024-09-13T17:13:07.822962+0000","last_active":"2024-09-13T17:13:12.193464+0000","last_peered":"2024-09-13T17:13:12.193464+0000","last_clean":"2024-09-13T17:13:12.193464+0000","last_became_active":"2024-09-13T17:13:07.822676+0000","last_became_peered":"2024-09-13T17:13:07.822676+0000","last_unstale":"2024-09-13T17:13:12.193464+0000","last_undegraded":"2024-09-13T17:13:12.193464+0000","last_fullsized":"2024-09-13T17:13:12.193464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:06.792088+0000","last_clean_scrub_stamp":"2024-09-13T17:13:06.792088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:12.577197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273347+0000","last_change":"2024-09-13T17:13:08.176946+0000","last_active":"2024-09-13T17:13:12.273347+0000","last_peered":"2024-09-13T17:13:12.273347+0000","last_clean":"2024-09-13T17:13:12.273347+0000","last_became_active":"2024-09-13T17:13:08.176653+0000","last_became_peered":"2024-09-13T17:13:08.176653+0000","last_unstale":"2024-09-13T17:13:12.273347+0000","last_undegraded":"2024-09-13T17:13:12.273347+0000","last_fullsized":"2024-09-13T17:13:12.273347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273706+0000","last_change":"2024-09-13T17:13:12.211076+0000","last_active":"2024-09-13T17:13:12.273706+0000","last_peered":"2024-09-13T17:13:12.273706+0000","last_clean":"2024-09-13T17:13:12.273706+0000","last_became_active":"2024-09-13T17:13:12.210718+0000","last_became_peered":"2024-09-13T17:13:12.210718+0000","last_unstale":"2024-09-13T17:13:12.273706+0000","last_undegraded":"2024-09-13T17:13:12.273706+0000","last_fullsized":"2024-09-13T17:13:12.273706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:11.178837+0000","last_clean_scrub_stamp":"2024-09-13T17:13:11.178837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:57.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272535+0000","last_change":"2024-09-13T17:13:08.186992+0000","last_active":"2024-09-13T17:13:12.272535+0000","last_peered":"2024-09-13T17:13:12.272535+0000","last_clean":"2024-09-13T17:13:12.272535+0000","last_became_active":"2024-09-13T17:13:08.186730+0000","last_became_peered":"2024-09-13T17:13:08.186730+0000","last_unstale":"2024-09-13T17:13:12.272535+0000","last_undegraded":"2024-09-13T17:13:12.272535+0000","last_fullsized":"2024-09-13T17:13:12.272535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273527+0000","last_change":"2024-09-13T17:13:08.185076+0000","last_active":"2024-09-13T17:13:12.273527+0000","last_peered":"2024-09-13T17:13:12.273527+0000","last_clean":"2024-09-13T17:13:12.273527+0000","last_became_active":"2024-09-13T17:13:08.184807+0000","last_became_peered":"2024-09-13T17:13:08.184807+0000","last_unstale":"2024-09-13T17:13:12.273527+0000","last_undegraded":"2024-09-13T17:13:12.273527+0000","last_fullsized":"2024-09-13T17:13:12.273527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:19.158522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271978+0000","last_change":"2024-09-13T17:13:08.182381+0000","last_active":"2024-09-13T17:13:12.271978+0000","last_peered":"2024-09-13T17:13:12.271978+0000","last_clean":"2024-09-13T17:13:12.271978+0000","last_became_active":"2024-09-13T17:13:08.181851+0000","last_became_peered":"2024-09-13T17:13:08.181851+0000","last_unstale":"2024-09-13T17:13:12.271978+0000","last_undegraded":"2024-09-13T17:13:12.271978+0000","last_fullsized":"2024-09-13T17:13:12.271978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.688927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270578+0000","last_change":"2024-09-13T17:13:08.179038+0000","last_active":"2024-09-13T17:13:12.270578+0000","last_peered":"2024-09-13T17:13:12.270578+0000","last_clean":"2024-09-13T17:13:12.270578+0000","last_became_active":"2024-09-13T17:13:08.178609+0000","last_became_peered":"2024-09-13T17:13:08.178609+0000","last_unstale":"2024-09-13T17:13:12.270578+0000","last_undegraded":"2024-09-13T17:13:12.270578+0000","last_fullsized":"2024-09-13T17:13:12.270578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273698+0000","last_change":"2024-09-13T17:13:08.179834+0000","last_active":"2024-09-13T17:13:12.273698+0000","last_peered":"2024-09-13T17:13:12.273698+0000","last_clean":"2024-09-13T17:13:12.273698+0000","last_became_active":"2024-09-13T17:13:08.179568+0000","last_became_peered":"2024-09-13T17:13:08.179568+0000","last_unstale":"2024-09-13T17:13:12.273698+0000","last_undegraded":"2024-09-13T17:13:12.273698+0000","last_fullsized":"2024-09-13T17:13:12.273698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271641+0000","last_change":"2024-09-13T17:13:08.178962+0000","last_active":"2024-09-13T17:13:12.271641+0000","last_peered":"2024-09-13T17:13:12.271641+0000","last_clean":"2024-09-13T17:13:12.271641+0000","last_became_active":"2024-09-13T17:13:08.178519+0000","last_became_peered":"2024-09-13T17:13:08.178519+0000","last_unstale":"2024-09-13T17:13:12.271641+0000","last_undegraded":"2024-09-13T17:13:12.271641+0000","last_fullsized":"2024-09-13T17:13:12.271641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272698+0000","last_change":"2024-09-13T17:13:08.189740+0000","last_active":"2024-09-13T17:13:12.272698+0000","last_peered":"2024-09-13T17:13:12.272698+0000","last_clean":"2024-09-13T17:13:12.272698+0000","last_became_active":"2024-09-13T17:13:08.189493+0000","last_became_peered":"2024-09-13T17:13:08.189493+0000","last_unstale":"2024-09-13T17:13:12.272698+0000","last_undegraded":"2024-09-13T17:13:12.272698+0000","last_fullsized":"2024-09-13T17:13:12.272698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273747+0000","last_change":"2024-09-13T17:13:08.187313+0000","last_active":"2024-09-13T17:13:12.273747+0000","last_peered":"2024-09-13T17:13:12.273747+0000","last_clean":"2024-09-13T17:13:12.273747+0000","last_became_active":"2024-09-13T17:13:08.186547+0000","last_became_peered":"2024-09-13T17:13:08.186547+0000","last_unstale":"2024-09-13T17:13:12.273747+0000","last_undegraded":"2024-09-13T17:13:12.273747+0000","last_fullsized":"2024-09-13T17:13:12.273747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271935+0000","last_change":"2024-09-13T17:13:08.181762+0000","last_active":"2024-09-13T17:13:12.271935+0000","last_peered":"2024-09-13T17:13:12.271935+0000","last_clean":"2024-09-13T17:13:12.271935+0000","last_became_active":"2024-09-13T17:13:08.181207+0000","last_became_peered":"2024-09-13T17:13:08.181207+0000","last_unstale":"2024-09-13T17:13:12.271935+0000","last_undegraded":"2024-09-13T17:13:12.271935+0000","last_fullsized":"2024-09-13T17:13:12.271935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:30.602088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273638+0000","last_change":"2024-09-13T17:13:08.180419+0000","last_active":"2024-09-13T17:13:12.273638+0000","last_peered":"2024-09-13T17:13:12.273638+0000","last_clean":"2024-09-13T17:13:12.273638+0000","last_became_active":"2024-09-13T17:13:08.179973+0000","last_became_peered":"2024-09-13T17:13:08.179973+0000","last_unstale":"2024-09-13T17:13:12.273638+0000","last_undegraded":"2024-09-13T17:13:12.273638+0000","last_fullsized":"2024-09-13T17:13:12.273638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271966+0000","last_change":"2024-09-13T17:13:08.187243+0000","last_active":"2024-09-13T17:13:12.271966+0000","last_peered":"2024-09-13T17:13:12.271966+0000","last_clean":"2024-09-13T17:13:12.271966+0000","last_became_active":"2024-09-13T17:13:08.185915+0000","last_became_peered":"2024-09-13T17:13:08.185915+0000","last_unstale":"2024-09-13T17:13:12.271966+0000","last_undegraded":"2024-09-13T17:13:12.271966+0000","last_fullsized":"2024-09-13T17:13:12.271966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:50.474035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270553+0000","last_change":"2024-09-13T17:13:08.183725+0000","last_active":"2024-09-13T17:13:12.270553+0000","last_peered":"2024-09-13T17:13:12.270553+0000","last_clean":"2024-09-13T17:13:12.270553+0000","last_became_active":"2024-09-13T17:13:08.183369+0000","last_became_peered":"2024-09-13T17:13:08.183369+0000","last_unstale":"2024-09-13T17:13:12.270553+0000","last_undegraded":"2024-09-13T17:13:12.270553+0000","last_fullsized":"2024-09-13T17:13:12.270553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:47:51.587456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272636+0000","last_change":"2024-09-13T17:13:08.184578+0000","last_active":"2024-09-13T17:13:12.272636+0000","last_peered":"2024-09-13T17:13:12.272636+0000","last_clean":"2024-09-13T17:13:12.272636+0000","last_became_active":"2024-09-13T17:13:08.184328+0000","last_became_peered":"2024-09-13T17:13:08.184328+0000","last_unstale":"2024-09-13T17:13:12.272636+0000","last_undegraded":"2024-09-13T17:13:12.272636+0000","last_fullsized":"2024-09-13T17:13:12.272636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272553+0000","last_change":"2024-09-13T17:13:08.183549+0000","last_active":"2024-09-13T17:13:12.272553+0000","last_peered":"2024-09-13T17:13:12.272553+0000","last_clean":"2024-09-13T17:13:12.272553+0000","last_became_active":"2024-09-13T17:13:08.183301+0000","last_became_peered":"2024-09-13T17:13:08.183301+0000","last_unstale":"2024-09-13T17:13:12.272553+0000","last_undegraded":"2024-09-13T17:13:12.272553+0000","last_fullsized":"2024-09-13T17:13:12.272553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:54.192136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273561+0000","last_change":"2024-09-13T17:13:08.182679+0000","last_active":"2024-09-13T17:13:12.273561+0000","last_peered":"2024-09-13T17:13:12.273561+0000","last_clean":"2024-09-13T17:13:12.273561+0000","last_became_active":"2024-09-13T17:13:08.182412+0000","last_became_peered":"2024-09-13T17:13:08.182412+0000","last_unstale":"2024-09-13T17:13:12.273561+0000","last_undegraded":"2024-09-13T17:13:12.273561+0000","last_fullsized":"2024-09-13T17:13:12.273561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:24.752799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272096+0000","last_change":"2024-09-13T17:13:08.189128+0000","last_active":"2024-09-13T17:13:12.272096+0000","last_peered":"2024-09-13T17:13:12.272096+0000","last_clean":"2024-09-13T17:13:12.272096+0000","last_became_active":"2024-09-13T17:13:08.188829+0000","last_became_peered":"2024-09-13T17:13:08.188829+0000","last_unstale":"2024-09-13T17:13:12.272096+0000","last_undegraded":"2024-09-13T17:13:12.272096+0000","last_fullsized":"2024-09-13T17:13:12.272096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:29.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271915+0000","last_change":"2024-09-13T17:13:08.181955+0000","last_active":"2024-09-13T17:13:12.271915+0000","last_peered":"2024-09-13T17:13:12.271915+0000","last_clean":"2024-09-13T17:13:12.271915+0000","last_became_active":"2024-09-13T17:13:08.180834+0000","last_became_peered":"2024-09-13T17:13:08.180834+0000","last_unstale":"2024-09-13T17:13:12.271915+0000","last_undegraded":"2024-09-13T17:13:12.271915+0000","last_fullsized":"2024-09-13T17:13:12.271915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.845280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271506+0000","last_change":"2024-09-13T17:13:08.177678+0000","last_active":"2024-09-13T17:13:12.271506+0000","last_peered":"2024-09-13T17:13:12.271506+0000","last_clean":"2024-09-13T17:13:12.271506+0000","last_became_active":"2024-09-13T17:13:08.177367+0000","last_became_peered":"2024-09-13T17:13:08.177367+0000","last_unstale":"2024-09-13T17:13:12.271506+0000","last_undegraded":"2024-09-13T17:13:12.271506+0000","last_fullsized":"2024-09-13T17:13:12.271506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:51.964973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270519+0000","last_change":"2024-09-13T17:13:08.177377+0000","last_active":"2024-09-13T17:13:12.270519+0000","last_peered":"2024-09-13T17:13:12.270519+0000","last_clean":"2024-09-13T17:13:12.270519+0000","last_became_active":"2024-09-13T17:13:08.176410+0000","last_became_peered":"2024-09-13T17:13:08.176410+0000","last_unstale":"2024-09-13T17:13:12.270519+0000","last_undegraded":"2024-09-13T17:13:12.270519+0000","last_fullsized":"2024-09-13T17:13:12.270519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273666+0000","last_change":"2024-09-13T17:13:08.183002+0000","last_active":"2024-09-13T17:13:12.273666+0000","last_peered":"2024-09-13T17:13:12.273666+0000","last_clean":"2024-09-13T17:13:12.273666+0000","last_became_active":"2024-09-13T17:13:08.181898+0000","last_became_peered":"2024-09-13T17:13:08.181898+0000","last_unstale":"2024-09-13T17:13:12.273666+0000","last_undegraded":"2024-09-13T17:13:12.273666+0000","last_fullsized":"2024-09-13T17:13:12.273666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:33.170750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273404+0000","last_change":"2024-09-13T17:13:08.183228+0000","last_active":"2024-09-13T17:13:12.273404+0000","last_peered":"2024-09-13T17:13:12.273404+0000","last_clean":"2024-09-13T17:13:12.273404+0000","last_became_active":"2024-09-13T17:13:08.182942+0000","last_became_peered":"2024-09-13T17:13:08.182942+0000","last_unstale":"2024-09-13T17:13:12.273404+0000","last_undegraded":"2024-09-13T17:13:12.273404+0000","last_fullsized":"2024-09-13T17:13:12.273404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:15.542986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272676+0000","last_change":"2024-09-13T17:13:08.192671+0000","last_active":"2024-09-13T17:13:12.272676+0000","last_peered":"2024-09-13T17:13:12.272676+0000","last_clean":"2024-09-13T17:13:12.272676+0000","last_became_active":"2024-09-13T17:13:08.192366+0000","last_became_peered":"2024-09-13T17:13:08.192366+0000","last_unstale":"2024-09-13T17:13:12.272676+0000","last_undegraded":"2024-09-13T17:13:12.272676+0000","last_fullsized":"2024-09-13T17:13:12.272676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272687+0000","last_change":"2024-09-13T17:13:08.193253+0000","last_active":"2024-09-13T17:13:12.272687+0000","last_peered":"2024-09-13T17:13:12.272687+0000","last_clean":"2024-09-13T17:13:12.272687+0000","last_became_active":"2024-09-13T17:13:08.192969+0000","last_became_peered":"2024-09-13T17:13:08.192969+0000","last_unstale":"2024-09-13T17:13:12.272687+0000","last_undegraded":"2024-09-13T17:13:12.272687+0000","last_fullsized":"2024-09-13T17:13:12.272687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:09.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272593+0000","last_change":"2024-09-13T17:13:08.195764+0000","last_active":"2024-09-13T17:13:12.272593+0000","last_peered":"2024-09-13T17:13:12.272593+0000","last_clean":"2024-09-13T17:13:12.272593+0000","last_became_active":"2024-09-13T17:13:08.195102+0000","last_became_peered":"2024-09-13T17:13:08.195102+0000","last_unstale":"2024-09-13T17:13:12.272593+0000","last_undegraded":"2024-09-13T17:13:12.272593+0000","last_fullsized":"2024-09-13T17:13:12.272593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.273574+0000","last_change":"2024-09-13T17:13:08.192409+0000","last_active":"2024-09-13T17:13:12.273574+0000","last_peered":"2024-09-13T17:13:12.273574+0000","last_clean":"2024-09-13T17:13:12.273574+0000","last_became_active":"2024-09-13T17:13:08.192135+0000","last_became_peered":"2024-09-13T17:13:08.192135+0000","last_unstale":"2024-09-13T17:13:12.273574+0000","last_undegraded":"2024-09-13T17:13:12.273574+0000","last_fullsized":"2024-09-13T17:13:12.273574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:51.549515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272414+0000","last_change":"2024-09-13T17:13:08.188381+0000","last_active":"2024-09-13T17:13:12.272414+0000","last_peered":"2024-09-13T17:13:12.272414+0000","last_clean":"2024-09-13T17:13:12.272414+0000","last_became_active":"2024-09-13T17:13:08.188091+0000","last_became_peered":"2024-09-13T17:13:08.188091+0000","last_unstale":"2024-09-13T17:13:12.272414+0000","last_undegraded":"2024-09-13T17:13:12.272414+0000","last_fullsized":"2024-09-13T17:13:12.272414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:57.438413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271956+0000","last_change":"2024-09-13T17:13:08.181573+0000","last_active":"2024-09-13T17:13:12.271956+0000","last_peered":"2024-09-13T17:13:12.271956+0000","last_clean":"2024-09-13T17:13:12.271956+0000","last_became_active":"2024-09-13T17:13:08.180771+0000","last_became_peered":"2024-09-13T17:13:08.180771+0000","last_unstale":"2024-09-13T17:13:12.271956+0000","last_undegraded":"2024-09-13T17:13:12.271956+0000","last_fullsized":"2024-09-13T17:13:12.271956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272451+0000","last_change":"2024-09-13T17:13:08.182931+0000","last_active":"2024-09-13T17:13:12.272451+0000","last_peered":"2024-09-13T17:13:12.272451+0000","last_clean":"2024-09-13T17:13:12.272451+0000","last_became_active":"2024-09-13T17:13:08.182550+0000","last_became_peered":"2024-09-13T17:13:08.182550+0000","last_unstale":"2024-09-13T17:13:12.272451+0000","last_undegraded":"2024-09-13T17:13:12.272451+0000","last_fullsized":"2024-09-13T17:13:12.272451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:37.203148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272014+0000","last_change":"2024-09-13T17:13:08.183116+0000","last_active":"2024-09-13T17:13:12.272014+0000","last_peered":"2024-09-13T17:13:12.272014+0000","last_clean":"2024-09-13T17:13:12.272014+0000","last_became_active":"2024-09-13T17:13:08.182806+0000","last_became_peered":"2024-09-13T17:13:08.182806+0000","last_unstale":"2024-09-13T17:13:12.272014+0000","last_undegraded":"2024-09-13T17:13:12.272014+0000","last_fullsized":"2024-09-13T17:13:12.272014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:20.378328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.270613+0000","last_change":"2024-09-13T17:13:08.175847+0000","last_active":"2024-09-13T17:13:12.270613+0000","last_peered":"2024-09-13T17:13:12.270613+0000","last_clean":"2024-09-13T17:13:12.270613+0000","last_became_active":"2024-09-13T17:13:08.175560+0000","last_became_peered":"2024-09-13T17:13:08.175560+0000","last_unstale":"2024-09-13T17:13:12.270613+0000","last_undegraded":"2024-09-13T17:13:12.270613+0000","last_fullsized":"2024-09-13T17:13:12.270613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:56.886435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.271680+0000","last_change":"2024-09-13T17:13:08.178668+0000","last_active":"2024-09-13T17:13:12.271680+0000","last_peered":"2024-09-13T17:13:12.271680+0000","last_clean":"2024-09-13T17:13:12.271680+0000","last_became_active":"2024-09-13T17:13:08.178371+0000","last_became_peered":"2024-09-13T17:13:08.178371+0000","last_unstale":"2024-09-13T17:13:12.271680+0000","last_undegraded":"2024-09-13T17:13:12.271680+0000","last_fullsized":"2024-09-13T17:13:12.271680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:17.574204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:13:12.272583+0000","last_change":"2024-09-13T17:13:08.193114+0000","last_active":"2024-09-13T17:13:12.272583+0000","last_peered":"2024-09-13T17:13:12.272583+0000","last_clean":"2024-09-13T17:13:12.272583+0000","last_became_active":"2024-09-13T17:13:08.192630+0000","last_became_peered":"2024-09-13T17:13:08.192630+0000","last_unstale":"2024-09-13T17:13:12.272583+0000","last_undegraded":"2024-09-13T17:13:12.272583+0000","last_fullsized":"2024-09-13T17:13:12.272583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:07.794452+0000","last_clean_scrub_stamp":"2024-09-13T17:13:07.794452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:07.796374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:34.992 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:13:34.992 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:13:34.992 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:13:34.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T17:13:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.125+0000 7fcc3f3b5640 1 Processor -- start 2024-09-13T17:13:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.125+0000 7fcc3f3b5640 1 -- start start 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3f3b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc380abe60 0x7fcc380b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3f3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 0x7fcc3806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3f3b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380ad050 con 0x7fcc381591e0 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3f3b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3806e400 con 0x7fcc380abe60 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3f3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380ac440 con 0x7fcc3806da30 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3c950640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc380abe60 0x7fcc380b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3c950640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc380abe60 0x7fcc380b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59282/0 (socket says 172.21.15.5:59282) 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3c950640 1 -- 172.21.15.5:0/3861122468 learned_addr learned my addr 172.21.15.5:0/3861122468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.126+0000 7fcc3d952640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 0x7fcc3806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3c950640 1 -- 172.21.15.5:0/3861122468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 msgr2=0x7fcc3806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3c950640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 0x7fcc3806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3c950640 1 -- 172.21.15.5:0/3861122468 >> v1:172.21.15.179:6789/0 conn(0x7fcc381591e0 legacy=0x7fcc380ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3c950640 1 -- 172.21.15.5:0/3861122468 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380ac720 con 0x7fcc380abe60 2024-09-13T17:13:35.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3d952640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 0x7fcc3806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.127+0000 7fcc3c950640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc380b1b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009870 tx=0x7fcc2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac2c5454741aed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc2ffff640 1 -- 172.21.15.5:0/3861122468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28032440 con 0x7fcc380abe60 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc2ffff640 1 -- 172.21.15.5:0/3861122468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc280325a0 con 0x7fcc380abe60 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc2ffff640 1 -- 172.21.15.5:0/3861122468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28032930 con 0x7fcc380abe60 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/3861122468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 msgr2=0x7fcc380b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc380b1b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009870 tx=0x7fcc2802a270 comp rx=0 tx=0).stop 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/3861122468 shutdown_connections 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc3806da30 0x7fcc3806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/3861122468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc380b1b30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/3861122468 >> 172.21.15.5:0/3861122468 conn(0x7fcc380ce130 msgr2=0x7fcc380ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/3861122468 shutdown_connections 2024-09-13T17:13:35.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.128+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/3861122468 wait complete. 2024-09-13T17:13:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.129+0000 7fcc3f3b5640 1 Processor -- start 2024-09-13T17:13:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.129+0000 7fcc3f3b5640 1 -- start start 2024-09-13T17:13:35.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 0x7fcc3814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc381591e0 0x7fcc381f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38156c10 con 0x7fcc380abe60 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3814ebe0 con 0x7fcc3806da30 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3f3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3814e340 con 0x7fcc381591e0 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3c950640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3c950640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59286/0 (socket says 172.21.15.5:59286) 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3c950640 1 -- 172.21.15.5:0/2434263006 learned_addr learned my addr 172.21.15.5:0/2434263006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3d151640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 0x7fcc3814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3d952640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc381591e0 0x7fcc381f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.130+0000 7fcc3c950640 1 -- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc381591e0 msgr2=0x7fcc381f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3c950640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc381591e0 0x7fcc381f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3c950640 1 -- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 msgr2=0x7fcc3814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3c950640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 0x7fcc3814b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3c950640 1 -- 172.21.15.5:0/2434263006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280094d0 con 0x7fcc380abe60 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3d151640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 0x7fcc3814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3c950640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28032440 con 0x7fcc380abe60 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28030b80 con 0x7fcc380abe60 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3814e620 con 0x7fcc380abe60 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803d440 con 0x7fcc380abe60 2024-09-13T17:13:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.131+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc38156e20 con 0x7fcc380abe60 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.132+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc380672a0 con 0x7fcc380abe60 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.132+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc28039040 con 0x7fcc380abe60 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.133+0000 7fcc2dffb640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 0x7fcc1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.133+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc280aa220 con 0x7fcc380abe60 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.133+0000 7fcc3d151640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 0x7fcc1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.134+0000 7fcc3d151640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 0x7fcc1c06d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc34007fd0 tx=0x7fcc34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.137+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc28075070 con 0x7fcc380abe60 2024-09-13T17:13:35.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.342+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcc3806dec0 con 0x7fcc380abe60 2024-09-13T17:13:35.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.342+0000 7fcc2dffb640 1 -- 172.21.15.5:0/2434263006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcc28078690 con 0x7fcc380abe60 2024-09-13T17:13:35.344 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:35.344 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:13:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 msgr2=0x7fcc1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 0x7fcc1c06d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc34007fd0 tx=0x7fcc34009040 comp rx=0 tx=0).stop 2024-09-13T17:13:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 msgr2=0x7fcc3814d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc280046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 shutdown_connections 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc381591e0 0x7fcc381f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc1c06ac00 0x7fcc1c06d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc380abe60 0x7fcc3814d9a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 --2- 172.21.15.5:0/2434263006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc3806da30 0x7fcc3814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 >> 172.21.15.5:0/2434263006 conn(0x7fcc380ce130 msgr2=0x7fcc380ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 shutdown_connections 2024-09-13T17:13:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.344+0000 7fcc3f3b5640 1 -- 172.21.15.5:0/2434263006 wait complete. 2024-09-13T17:13:35.356 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:13:35.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.455+0000 7f751cd9c640 1 Processor -- start 2024-09-13T17:13:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.456+0000 7f751cd9c640 1 -- start start 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751cd9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518143740 0x7f75180ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751cd9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f751815aaa0 0x7f75180ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751cd9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180ac650 con 0x7f7518069e90 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751cd9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7518144100 con 0x7f751815aaa0 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751cd9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7518143b20 con 0x7f7518143740 2024-09-13T17:13:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f751815aaa0 0x7f75180ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f751815aaa0 0x7f75180ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59290/0 (socket says 172.21.15.5:59290) 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 -- 172.21.15.5:0/1974662652 learned_addr learned my addr 172.21.15.5:0/1974662652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f751659c640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518143740 0x7f75180ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 -- 172.21.15.5:0/1974662652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518143740 msgr2=0x7f75180ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518143740 0x7f75180ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 -- 172.21.15.5:0/1974662652 >> v1:172.21.15.179:6789/0 conn(0x7f7518069e90 legacy=0x7f75180cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.457+0000 7f7515d9b640 1 -- 172.21.15.5:0/1974662652 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180b2130 con 0x7f751815aaa0 2024-09-13T17:13:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f7515d9b640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75180ac110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7500009870 tx=0x7f750002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522097c06b14b9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f751559a640 1 -- 172.21.15.5:0/1974662652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500032440 con 0x7f751815aaa0 2024-09-13T17:13:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f751559a640 1 -- 172.21.15.5:0/1974662652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75000325a0 con 0x7f751815aaa0 2024-09-13T17:13:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f751559a640 1 -- 172.21.15.5:0/1974662652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500032930 con 0x7f751815aaa0 2024-09-13T17:13:35.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f751cd9c640 1 -- 172.21.15.5:0/1974662652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 msgr2=0x7f75180ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.458+0000 7f751cd9c640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75180ac110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7500009870 tx=0x7f750002a2a0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 -- 172.21.15.5:0/1974662652 shutdown_connections 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75180ac110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 --2- 172.21.15.5:0/1974662652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518143740 0x7f75180ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 -- 172.21.15.5:0/1974662652 >> 172.21.15.5:0/1974662652 conn(0x7f75180b4650 msgr2=0x7f75180b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 -- 172.21.15.5:0/1974662652 shutdown_connections 2024-09-13T17:13:35.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.459+0000 7f751cd9c640 1 -- 172.21.15.5:0/1974662652 wait complete. 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.460+0000 7f751cd9c640 1 Processor -- start 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.460+0000 7f751cd9c640 1 -- start start 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518069e90 0x7f75181ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518143740 0x7f75181f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75181f1e60 con 0x7f751815aaa0 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75181f0b50 con 0x7f7518143740 2024-09-13T17:13:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751cd9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75181f11e0 con 0x7f7518069e90 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f751659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518069e90 0x7f75181ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7515d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518143740 0x7f75181f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59296/0 (socket says 172.21.15.5:59296) 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 -- 172.21.15.5:0/705933677 learned_addr learned my addr 172.21.15.5:0/705933677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 -- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518069e90 msgr2=0x7f75181ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518069e90 0x7f75181ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 -- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518143740 msgr2=0x7f75181f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518143740 0x7f75181f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 -- 172.21.15.5:0/705933677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000094d0 con 0x7f751815aaa0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.461+0000 7f7516d9d640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f751000c780 tx=0x7f751000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.462+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510004b60 con 0x7f751815aaa0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.462+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000ce90 con 0x7f751815aaa0 2024-09-13T17:13:35.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.462+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000a850 con 0x7f751815aaa0 2024-09-13T17:13:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.462+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75181f14c0 con 0x7f751815aaa0 2024-09-13T17:13:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.462+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75181f1a80 con 0x7f751815aaa0 2024-09-13T17:13:35.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.463+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75180b3cf0 con 0x7f751815aaa0 2024-09-13T17:13:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.463+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f751000a9b0 con 0x7f751815aaa0 2024-09-13T17:13:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.464+0000 7f750effd640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 0x7f74f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.464+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7510089650 con 0x7f751815aaa0 2024-09-13T17:13:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.464+0000 7f751659c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 0x7f74f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.465+0000 7f751659c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 0x7f74f806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f750800aac0 tx=0x7f7508008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.468+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75180b3cf0 con 0x7f751815aaa0 2024-09-13T17:13:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.639+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75180672a0 con 0x7f751815aaa0 2024-09-13T17:13:35.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.640+0000 7f750effd640 1 -- 172.21.15.5:0/705933677 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f7510054680 con 0x7f751815aaa0 2024-09-13T17:13:35.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:35.642 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 msgr2=0x7f74f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 0x7f74f806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f750800aac0 tx=0x7f7508008040 comp rx=0 tx=0).stop 2024-09-13T17:13:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 msgr2=0x7f75181dfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f751000c780 tx=0x7f751000cc40 comp rx=0 tx=0).stop 2024-09-13T17:13:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 shutdown_connections 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74f806ac00 0x7f74f806d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751815aaa0 0x7f75181dfe90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7518143740 0x7f75181f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 --2- 172.21.15.5:0/705933677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7518069e90 0x7f75181ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 >> 172.21.15.5:0/705933677 conn(0x7f75180b4650 msgr2=0x7f751813eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 shutdown_connections 2024-09-13T17:13:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.642+0000 7f751cd9c640 1 -- 172.21.15.5:0/705933677 wait complete. 2024-09-13T17:13:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:35.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.757+0000 7f555a733640 1 Processor -- start 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.757+0000 7f555a733640 1 -- start start 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f555a733640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 0x7f55540b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f555a733640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55540ae7b0 0x7f55540ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f555a733640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540b27f0 con 0x7f5554069e90 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f555a733640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555406ed60 con 0x7f55540ae7b0 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f555a733640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540b40d0 con 0x7f555415d850 2024-09-13T17:13:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f5553fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5554069e90 0x7f555406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33614/0 (socket says 172.21.15.5:33614) 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f5553fff640 1 -- 172.21.15.5:0/3365713474 learned_addr learned my addr 172.21.15.5:0/3365713474 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f5558cd0640 1 --2- 172.21.15.5:0/3365713474 >> v2:172.21.15.179:3300/0 conn(0x7f55540ae7b0 0x7f55540ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.758+0000 7f554bfff640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 0x7f55540b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896177418 0 0) 0x7f55540b27f0 con 0x7f5554069e90 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5540003520 con 0x7f5554069e90 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f5558cd0640 1 -- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 msgr2=0x7f55540b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f5558cd0640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 0x7f55540b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f5558cd0640 1 -- 172.21.15.5:0/3365713474 >> v1:172.21.15.5:6789/0 conn(0x7f5554069e90 legacy=0x7f555406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529145212 0 0) 0x7f5540003520 con 0x7f5554069e90 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f5558cd0640 1 -- 172.21.15.5:0/3365713474 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540ae390 con 0x7f55540ae7b0 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.759+0000 7f554bfff640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 0x7f55540b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f5558cd0640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f55540ac110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d72570185945162 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544001670 con 0x7f55540ae7b0 2024-09-13T17:13:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c02d050 con 0x7f55540ae7b0 2024-09-13T17:13:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f55537fe640 1 -- 172.21.15.5:0/3365713474 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c007760 con 0x7f55540ae7b0 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 -- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 msgr2=0x7f55540ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f55540ac110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c02a5f0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 -- 172.21.15.5:0/3365713474 shutdown_connections 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f555415d850 0x7f55540b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 --2- 172.21.15.5:0/3365713474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f55540ac110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.760+0000 7f555a733640 1 -- 172.21.15.5:0/3365713474 >> 172.21.15.5:0/3365713474 conn(0x7f55540b4650 msgr2=0x7f55540b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.761+0000 7f555a733640 1 -- 172.21.15.5:0/3365713474 shutdown_connections 2024-09-13T17:13:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.761+0000 7f555a733640 1 -- 172.21.15.5:0/3365713474 wait complete. 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 Processor -- start 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 -- start start 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5554069e90 0x7f55541f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f555409cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55541515a0 con 0x7f555415d850 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55541f25f0 con 0x7f55540ae7b0 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.762+0000 7f555a733640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55541f28d0 con 0x7f5554069e90 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59302/0 (socket says 172.21.15.5:59302) 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 -- 172.21.15.5:0/1441216281 learned_addr learned my addr 172.21.15.5:0/1441216281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5553fff640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5554069e90 0x7f55541f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f554bfff640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f555409cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 -- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5554069e90 msgr2=0x7f55541f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5554069e90 0x7f55541f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 -- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 msgr2=0x7f555409cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f555409cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 -- 172.21.15.5:0/1441216281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009400 con 0x7f555415d850 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f5558cd0640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c03c830 con 0x7f555415d850 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c03c990 con 0x7f555415d850 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c03cd00 con 0x7f555415d850 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c009a70 con 0x7f555415d850 2024-09-13T17:13:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.763+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55541f2e90 con 0x7f555415d850 2024-09-13T17:13:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.764+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55540672a0 con 0x7f555415d850 2024-09-13T17:13:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.765+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f554c02ad50 con 0x7f555415d850 2024-09-13T17:13:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.765+0000 7f55517fa640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 0x7f553406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.766+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f554c0aaea0 con 0x7f555415d850 2024-09-13T17:13:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.766+0000 7f5553fff640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 0x7f553406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.766+0000 7f5553fff640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 0x7f553406d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5544000f60 tx=0x7f5544009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.770+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f554c075e20 con 0x7f555415d850 2024-09-13T17:13:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.939+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55540ac110 con 0x7f555415d850 2024-09-13T17:13:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.940+0000 7f55517fa640 1 -- 172.21.15.5:0/1441216281 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f554c04a020 con 0x7f555415d850 2024-09-13T17:13:35.942 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 msgr2=0x7f553406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 0x7f553406d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5544000f60 tx=0x7f5544009040 comp rx=0 tx=0).stop 2024-09-13T17:13:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 msgr2=0x7f555415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 shutdown_connections 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f553406ac30 0x7f553406d0f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f555415d850 0x7f555415abf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55540ae7b0 0x7f555409cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 --2- 172.21.15.5:0/1441216281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5554069e90 0x7f55541f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 >> 172.21.15.5:0/1441216281 conn(0x7f55540b4650 msgr2=0x7f55540b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 shutdown_connections 2024-09-13T17:13:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:35.942+0000 7f555a733640 1 -- 172.21.15.5:0/1441216281 wait complete. 2024-09-13T17:13:35.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:36.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.056+0000 7fc05dca3640 1 Processor -- start 2024-09-13T17:13:36.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.056+0000 7fc05dca3640 1 -- start start 2024-09-13T17:13:36.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc05dca3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc05815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc05dca3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05806c520 con 0x7fc0580ad720 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc05dca3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05806c800 con 0x7fc05806c090 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc05dca3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05815b900 con 0x7fc058157e20 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc057fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0580ad720 0x7fc0580b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33628/0 (socket says 172.21.15.5:33628) 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc057fff640 1 -- 172.21.15.5:0/738389099 learned_addr learned my addr 172.21.15.5:0/738389099 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0577fe640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc05815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517587664 0 0) 0x7fc05806c520 con 0x7fc0580ad720 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc040003520 con 0x7fc0580ad720 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003999417 0 0) 0x7fc040003520 con 0x7fc0580ad720 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 msgr2=0x7fc05815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc05815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 >> v1:172.21.15.179:6789/0 conn(0x7fc05806c090 legacy=0x7fc0580ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05806cae0 con 0x7fc0580ad720 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0577fe640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc05815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fc0500019f0 con 0x7fc0580ad720 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 >> v1:172.21.15.5:6789/0 conn(0x7fc0580ad720 legacy=0x7fc0580b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0400039a0 0x7fc040003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc040004350 0x7fc040004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc040005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.057+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05815b900 con 0x7fc040004350 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04000b980 con 0x7fc0400039a0 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04000baf0 con 0x7fc058157e20 2024-09-13T17:13:36.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc040004350 0x7fc040004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc0577fe640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0400039a0 0x7fc040003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc057fff640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc040005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 -- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 msgr2=0x7fc040005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc058157e20 0x7fc040005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 -- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0400039a0 msgr2=0x7fc040003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0400039a0 0x7fc040003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.058+0000 7fc056ffd640 1 -- 172.21.15.5:0/738389099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009400 con 0x7fc040004350 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc056ffd640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc040004350 0x7fc040004820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc05806de30 tx=0x7fc0400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3e24ac62bd491f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c02ab70 con 0x7fc040004350 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c02acd0 con 0x7fc040004350 2024-09-13T17:13:36.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc0567fc640 1 -- 172.21.15.5:0/738389099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c032640 con 0x7fc040004350 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 -- 172.21.15.5:0/738389099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc040004350 msgr2=0x7fc040004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 --2- 172.21.15.5:0/738389099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc040004350 0x7fc040004820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc05806de30 tx=0x7fc0400057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc057fff640 1 -- 172.21.15.5:0/738389099 reap_dead start 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 -- 172.21.15.5:0/738389099 shutdown_connections 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 -- 172.21.15.5:0/738389099 >> 172.21.15.5:0/738389099 conn(0x7fc0580ce130 msgr2=0x7fc0580ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 -- 172.21.15.5:0/738389099 shutdown_connections 2024-09-13T17:13:36.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.059+0000 7fc05dca3640 1 -- 172.21.15.5:0/738389099 wait complete. 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.060+0000 7fc05dca3640 1 Processor -- start 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- start start 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc040004350 0x7fc0581f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0580ae2e0 0x7fc0580ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580aeca0 con 0x7fc05809a4b0 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05809bea0 con 0x7fc040004350 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05809b290 con 0x7fc0580ae2e0 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59324/0 (socket says 172.21.15.5:59324) 2024-09-13T17:13:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 -- 172.21.15.5:0/3840515356 learned_addr learned my addr 172.21.15.5:0/3840515356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc0577fe640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc040004350 0x7fc0581f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc056ffd640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0580ae2e0 0x7fc0580ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 -- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0580ae2e0 msgr2=0x7fc0580ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0580ae2e0 0x7fc0580ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 -- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc040004350 msgr2=0x7fc0581f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc040004350 0x7fc0581f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 -- 172.21.15.5:0/3840515356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05809b570 con 0x7fc05809a4b0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc057fff640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc058140ca0 tx=0x7fc05000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05000ec40 con 0x7fc05809a4b0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000edc0 con 0x7fc05809a4b0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05809b850 con 0x7fc05809a4b0 2024-09-13T17:13:36.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050014670 con 0x7fc05809a4b0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.062+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581f2470 con 0x7fc05809a4b0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.063+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0580672a0 con 0x7fc05809a4b0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.064+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc0500147d0 con 0x7fc05809a4b0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.064+0000 7fc03ffff640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 0x7fc04406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.065+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc050089480 con 0x7fc05809a4b0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.065+0000 7fc0577fe640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 0x7fc04406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.065+0000 7fc0577fe640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 0x7fc04406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0581f5be0 tx=0x7fc048008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.070+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc050054370 con 0x7fc05809a4b0 2024-09-13T17:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.242+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc05809bfe0 con 0x7fc05809a4b0 2024-09-13T17:13:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.242+0000 7fc03ffff640 1 -- 172.21.15.5:0/3840515356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc050057990 con 0x7fc05809a4b0 2024-09-13T17:13:36.245 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 msgr2=0x7fc04406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 0x7fc04406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0581f5be0 tx=0x7fc048008040 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 msgr2=0x7fc05809a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc058140ca0 tx=0x7fc05000e530 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 shutdown_connections 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc04406ac00 0x7fc04406d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc05809a4b0 0x7fc05809a930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0580ae2e0 0x7fc0580ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 --2- 172.21.15.5:0/3840515356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc040004350 0x7fc0581f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 >> 172.21.15.5:0/3840515356 conn(0x7fc0580ce130 msgr2=0x7fc05815dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 shutdown_connections 2024-09-13T17:13:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.244+0000 7fc05dca3640 1 -- 172.21.15.5:0/3840515356 wait complete. 2024-09-13T17:13:36.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.359+0000 7f4cd7b25640 1 Processor -- start 2024-09-13T17:13:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.359+0000 7f4cd7b25640 1 -- start start 2024-09-13T17:13:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd7b25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4cd015fd80 0x7f4cd00cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd7b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd00d0e30 0x7f4cd0098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd7b25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd00704a0 con 0x7f4cd0098f40 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd7b25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd00993f0 con 0x7f4cd015fd80 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd7b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd006cc10 con 0x7f4cd00d0e30 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd60c2640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4cd0098f40 0x7f4cd00ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:47636/0 (socket says 172.21.15.5:47636) 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd60c2640 1 -- 172.21.15.5:0/193007252 learned_addr learned my addr 172.21.15.5:0/193007252 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd58c1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4cd015fd80 0x7f4cd00cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.360+0000 7f4cd50c0640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd00d0e30 0x7f4cd0098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd48bf640 1 -- 172.21.15.5:0/193007252 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795832094 0 0) 0x7f4cd00704a0 con 0x7f4cd0098f40 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd48bf640 1 -- 172.21.15.5:0/193007252 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc003520 con 0x7f4cd0098f40 2024-09-13T17:13:36.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd58c1640 1 -- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd00d0e30 msgr2=0x7f4cd0098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd58c1640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd00d0e30 0x7f4cd0098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd58c1640 1 -- 172.21.15.5:0/193007252 >> v1:172.21.15.179:6789/0 conn(0x7f4cd0098f40 legacy=0x7f4cd00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd58c1640 1 -- 172.21.15.5:0/193007252 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd006bd80 con 0x7f4cd015fd80 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.361+0000 7f4cd58c1640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd00cfd30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40097a0 tx=0x7f4cc402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89cb3b20d40311c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd48bf640 1 -- 172.21.15.5:0/193007252 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc402ae50 con 0x7f4cd015fd80 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd48bf640 1 -- 172.21.15.5:0/193007252 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc4032440 con 0x7f4cd015fd80 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd48bf640 1 -- 172.21.15.5:0/193007252 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40327b0 con 0x7f4cd015fd80 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 -- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 msgr2=0x7f4cd00cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd00cfd30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40097a0 tx=0x7f4cc402a100 comp rx=0 tx=0).stop 2024-09-13T17:13:36.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 -- 172.21.15.5:0/193007252 shutdown_connections 2024-09-13T17:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd00d0e30 0x7f4cd0098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/193007252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd00cfd30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 -- 172.21.15.5:0/193007252 >> 172.21.15.5:0/193007252 conn(0x7f4cd00d0310 msgr2=0x7f4cd00d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 -- 172.21.15.5:0/193007252 shutdown_connections 2024-09-13T17:13:36.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.362+0000 7f4cd7b25640 1 -- 172.21.15.5:0/193007252 wait complete. 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 Processor -- start 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 -- start start 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd0098f40 0x7f4cd01472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd014a830 con 0x7f4cd00d0e30 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0149c20 con 0x7f4cd015fd80 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.364+0000 7f4cd7b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0149f00 con 0x7f4cd0098f40 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59338/0 (socket says 172.21.15.5:59338) 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 -- 172.21.15.5:0/118994991 learned_addr learned my addr 172.21.15.5:0/118994991 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd58c1640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd0098f40 0x7f4cd01472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd60c2640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 -- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd0098f40 msgr2=0x7f4cd01472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd0098f40 0x7f4cd01472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 -- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 msgr2=0x7f4cd015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 -- 172.21.15.5:0/118994991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4009400 con 0x7f4cd00d0e30 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd50c0640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e840 tx=0x7f4ccc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0094f0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc00c940 con 0x7f4cd00d0e30 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd014a1e0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00ccd0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.365+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd01477f0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.366+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd0099da0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.367+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ccc013470 con 0x7f4cd00d0e30 2024-09-13T17:13:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.367+0000 7f4cc27fc640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 0x7f4cb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.367+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ccc0896c0 con 0x7f4cd00d0e30 2024-09-13T17:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.368+0000 7f4cd58c1640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 0x7f4cb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.368+0000 7f4cd58c1640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 0x7f4cb406d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.372+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4ccc054650 con 0x7f4cd00d0e30 2024-09-13T17:13:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.542+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cd0160160 con 0x7f4cd00d0e30 2024-09-13T17:13:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.543+0000 7f4cc27fc640 1 -- 172.21.15.5:0/118994991 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ccc057c70 con 0x7f4cd00d0e30 2024-09-13T17:13:36.545 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 msgr2=0x7f4cb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 0x7f4cb406d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 msgr2=0x7f4cd015b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e840 tx=0x7f4ccc00ed00 comp rx=0 tx=0).stop 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 shutdown_connections 2024-09-13T17:13:36.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cd015fd80 0x7f4cd015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cb406ac00 0x7f4cb406d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd00d0e30 0x7f4cd015b820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 --2- 172.21.15.5:0/118994991 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cd0098f40 0x7f4cd01472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.544+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 >> 172.21.15.5:0/118994991 conn(0x7f4cd00d0310 msgr2=0x7f4cd006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.545+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 shutdown_connections 2024-09-13T17:13:36.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.545+0000 7f4cd7b25640 1 -- 172.21.15.5:0/118994991 wait complete. 2024-09-13T17:13:36.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 Processor -- start 2024-09-13T17:13:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 -- start start 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e4157e20 0x7fe1e415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1e40ad720 0x7fe1e406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406c520 con 0x7fe1e406c090 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e415b900 con 0x7fe1e40ad720 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.660+0000 7fe1eabce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e406db00 con 0x7fe1e4157e20 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e916b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1e40ad720 0x7fe1e406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe1e406c090 0x7fe1e40ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33644/0 (socket says 172.21.15.5:33644) 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e3fff640 1 -- 172.21.15.5:0/97046855 learned_addr learned my addr 172.21.15.5:0/97046855 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e896a640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e4157e20 0x7fe1e415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e37fe640 1 -- 172.21.15.5:0/97046855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165251938 0 0) 0x7fe1e406c520 con 0x7fe1e406c090 2024-09-13T17:13:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e37fe640 1 -- 172.21.15.5:0/97046855 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d4003520 con 0x7fe1e406c090 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e916b640 1 -- 172.21.15.5:0/97046855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e4157e20 msgr2=0x7fe1e415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e916b640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e4157e20 0x7fe1e415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e916b640 1 -- 172.21.15.5:0/97046855 >> v1:172.21.15.5:6789/0 conn(0x7fe1e406c090 legacy=0x7fe1e40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.661+0000 7fe1e916b640 1 -- 172.21.15.5:0/97046855 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e406c800 con 0x7fe1e40ad720 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1e916b640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40ad720 0x7fe1e406d5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a1988271c448d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1e37fe640 1 -- 172.21.15.5:0/97046855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007740 con 0x7fe1e40ad720 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1e37fe640 1 -- 172.21.15.5:0/97046855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc02d050 con 0x7fe1e40ad720 2024-09-13T17:13:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1e37fe640 1 -- 172.21.15.5:0/97046855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007aa0 con 0x7fe1e40ad720 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 -- 172.21.15.5:0/97046855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40ad720 msgr2=0x7fe1e406d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40ad720 0x7fe1e406d5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc02a660 comp rx=0 tx=0).stop 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 -- 172.21.15.5:0/97046855 shutdown_connections 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40ad720 0x7fe1e406d5c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 --2- 172.21.15.5:0/97046855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e4157e20 0x7fe1e415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 -- 172.21.15.5:0/97046855 >> 172.21.15.5:0/97046855 conn(0x7fe1e40ce130 msgr2=0x7fe1e40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 -- 172.21.15.5:0/97046855 shutdown_connections 2024-09-13T17:13:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.662+0000 7fe1eabce640 1 -- 172.21.15.5:0/97046855 wait complete. 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.664+0000 7fe1eabce640 1 Processor -- start 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.664+0000 7fe1eabce640 1 -- start start 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e40ad720 0x7fe1e4152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e4157e20 0x7fe1e40990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4099620 con 0x7fe1e40b3030 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4141fe0 con 0x7fe1e4157e20 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1eabce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4141d00 con 0x7fe1e40ad720 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59356/0 (socket says 172.21.15.5:59356) 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 -- 172.21.15.5:0/1302787583 learned_addr learned my addr 172.21.15.5:0/1302787583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:36.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e896a640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e40ad720 0x7fe1e4152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e3fff640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e4157e20 0x7fe1e40990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 -- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e40ad720 msgr2=0x7fe1e4152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e40ad720 0x7fe1e4152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 -- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e4157e20 msgr2=0x7fe1e40990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e4157e20 0x7fe1e40990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 -- 172.21.15.5:0/1302787583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009a70 con 0x7fe1e40b3030 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.665+0000 7fe1e916b640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009eb0 tx=0x7fe1dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.666+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc03c830 con 0x7fe1e40b3030 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.666+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc03c990 con 0x7fe1e40b3030 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.666+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc03cd40 con 0x7fe1e40b3030 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.666+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40b1570 con 0x7fe1e40b3030 2024-09-13T17:13:36.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.666+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40b1b30 con 0x7fe1e40b3030 2024-09-13T17:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.668+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40672a0 con 0x7fe1e40b3030 2024-09-13T17:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.668+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe1dc044410 con 0x7fe1e40b3030 2024-09-13T17:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.669+0000 7fe1e17fa640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 0x7fe1c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.669+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1dc0aad90 con 0x7fe1e40b3030 2024-09-13T17:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.669+0000 7fe1e896a640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 0x7fe1c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.669+0000 7fe1e896a640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 0x7fe1c806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80079a0 tx=0x7fe1d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.673+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe1dc075d40 con 0x7fe1e40b3030 2024-09-13T17:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.842+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe1e4158200 con 0x7fe1e40b3030 2024-09-13T17:13:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.843+0000 7fe1e17fa640 1 -- 172.21.15.5:0/1302787583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe1dc079360 con 0x7fe1e40b3030 2024-09-13T17:13:36.844 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 msgr2=0x7fe1c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 0x7fe1c806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80079a0 tx=0x7fe1d8008040 comp rx=0 tx=0).stop 2024-09-13T17:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 msgr2=0x7fe1e4140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009eb0 tx=0x7fe1dc004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 shutdown_connections 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe1c806ac00 0x7fe1c806d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e40b3030 0x7fe1e4140cd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e4157e20 0x7fe1e40990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 --2- 172.21.15.5:0/1302787583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e40ad720 0x7fe1e4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 >> 172.21.15.5:0/1302787583 conn(0x7fe1e40ce130 msgr2=0x7fe1e4156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 shutdown_connections 2024-09-13T17:13:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.845+0000 7fe1eabce640 1 -- 172.21.15.5:0/1302787583 wait complete. 2024-09-13T17:13:36.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.957+0000 7fa2db565640 1 Processor -- start 2024-09-13T17:13:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.957+0000 7fa2db565640 1 -- start start 2024-09-13T17:13:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2db565640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2d40ccdc0 0x7fa2d40cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2db565640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2d406e420 0x7fa2d40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2db565640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40701d0 con 0x7fa2d40cd6e0 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2db565640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40704b0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2db565640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40ccc00 con 0x7fa2d406e420 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2d9301640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2d40ccdc0 0x7fa2d40cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2d9301640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2d40ccdc0 0x7fa2d40cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59364/0 (socket says 172.21.15.5:59364) 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2d9301640 1 -- 172.21.15.5:0/1295502434 learned_addr learned my addr 172.21.15.5:0/1295502434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2d8b00640 1 --2- 172.21.15.5:0/1295502434 >> v2:172.21.15.179:3300/0 conn(0x7fa2d406e420 0x7fa2d40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.958+0000 7fa2d9301640 1 -- 172.21.15.5:0/1295502434 >> v2:172.21.15.179:3300/0 conn(0x7fa2d406e420 msgr2=0x7fa2d40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2d9301640 1 --2- 172.21.15.5:0/1295502434 >> v2:172.21.15.179:3300/0 conn(0x7fa2d406e420 0x7fa2d40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2d9301640 1 -- 172.21.15.5:0/1295502434 >> v1:172.21.15.179:6789/0 conn(0x7fa2d40cd6e0 legacy=0x7fa2d40b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2d9301640 1 -- 172.21.15.5:0/1295502434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40cfc70 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2d9301640 1 --2- 172.21.15.5:0/1295502434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d40cf060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4071440 tx=0x7fa2d002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e3a197fb7e3676 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2cbfff640 1 -- 172.21.15.5:0/1295502434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0032640 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2cbfff640 1 -- 172.21.15.5:0/1295502434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00327a0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.959+0000 7fa2cbfff640 1 -- 172.21.15.5:0/1295502434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0032b30 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 -- 172.21.15.5:0/1295502434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 msgr2=0x7fa2d40cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 --2- 172.21.15.5:0/1295502434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d40cf060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4071440 tx=0x7fa2d002a300 comp rx=0 tx=0).stop 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 -- 172.21.15.5:0/1295502434 shutdown_connections 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 --2- 172.21.15.5:0/1295502434 >> v2:172.21.15.179:3300/0 conn(0x7fa2d406e420 0x7fa2d40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 --2- 172.21.15.5:0/1295502434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d40cf060 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 -- 172.21.15.5:0/1295502434 >> 172.21.15.5:0/1295502434 conn(0x7fa2d40b1fa0 msgr2=0x7fa2d40b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 -- 172.21.15.5:0/1295502434 shutdown_connections 2024-09-13T17:13:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.960+0000 7fa2db565640 1 -- 172.21.15.5:0/1295502434 wait complete. 2024-09-13T17:13:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.961+0000 7fa2db565640 1 Processor -- start 2024-09-13T17:13:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.961+0000 7fa2db565640 1 -- start start 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2d406e420 0x7fa2d414b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d40cd6e0 0x7fa2d40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41f6b10 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41e3c20 con 0x7fa2d40cd6e0 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2db565640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41f6550 con 0x7fa2d406e420 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59374/0 (socket says 172.21.15.5:59374) 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 -- 172.21.15.5:0/1102491987 learned_addr learned my addr 172.21.15.5:0/1102491987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d9b02640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d40cd6e0 0x7fa2d40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d9301640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2d406e420 0x7fa2d414b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 -- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2d406e420 msgr2=0x7fa2d414b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2d406e420 0x7fa2d414b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 -- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d40cd6e0 msgr2=0x7fa2d40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d40cd6e0 0x7fa2d40c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.962+0000 7fa2d8b00640 1 -- 172.21.15.5:0/1102491987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00094d0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2d8b00640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400e870 tx=0x7fa2c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40094f0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400c940 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d41f6830 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400ccf0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.963+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41e41a0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.964+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d415a760 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.965+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2c4013470 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.965+0000 7fa2c9ffb640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 0x7fa2b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.965+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2c40895e0 con 0x7fa2d40ccdc0 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.965+0000 7fa2d9301640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 0x7fa2b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.966+0000 7fa2d9301640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 0x7fa2b806d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0034000 tx=0x7fa2d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:36.969+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa2c4054610 con 0x7fa2d40ccdc0 2024-09-13T17:13:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.174+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2d40b55a0 con 0x7fa2d40ccdc0 2024-09-13T17:13:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.174+0000 7fa2c9ffb640 1 -- 172.21.15.5:0/1102491987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7fa2c4057c30 con 0x7fa2d40ccdc0 2024-09-13T17:13:37.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:37.176 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 msgr2=0x7fa2b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 0x7fa2b806d0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0034000 tx=0x7fa2d002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 msgr2=0x7fa2d41f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400e870 tx=0x7fa2c400ed30 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 shutdown_connections 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d40cd6e0 0x7fa2d40c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa2b806ac30 0x7fa2b806d0f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2d40ccdc0 0x7fa2d41f5b70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 --2- 172.21.15.5:0/1102491987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2d406e420 0x7fa2d414b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.176+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 >> 172.21.15.5:0/1102491987 conn(0x7fa2d40b1fa0 msgr2=0x7fa2d4158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.177+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 shutdown_connections 2024-09-13T17:13:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.177+0000 7fa2db565640 1 -- 172.21.15.5:0/1102491987 wait complete. 2024-09-13T17:13:37.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:37.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.290+0000 7f56e830f640 1 Processor -- start 2024-09-13T17:13:37.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.290+0000 7f56e830f640 1 -- start start 2024-09-13T17:13:37.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e830f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56e0069e90 0x7f56e00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e830f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f56e015d850 0x7f56e00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e830f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00b27f0 con 0x7f56e00ae7b0 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e830f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e006ed60 con 0x7f56e0069e90 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e830f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00b40d0 con 0x7f56e015d850 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56e0069e90 0x7f56e00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e58aa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56e00ae7b0 0x7f56e006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33658/0 (socket says 172.21.15.5:33658) 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56e0069e90 0x7f56e00b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59380/0 (socket says 172.21.15.5:59380) 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e58aa640 1 -- 172.21.15.5:0/3174758230 learned_addr learned my addr 172.21.15.5:0/3174758230 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e68ac640 1 --2- 172.21.15.5:0/3174758230 >> v2:172.21.15.179:3300/0 conn(0x7f56e015d850 0x7f56e00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 -- 172.21.15.5:0/3174758230 >> v2:172.21.15.179:3300/0 conn(0x7f56e015d850 msgr2=0x7f56e00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 --2- 172.21.15.5:0/3174758230 >> v2:172.21.15.179:3300/0 conn(0x7f56e015d850 0x7f56e00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 -- 172.21.15.5:0/3174758230 >> v1:172.21.15.5:6789/0 conn(0x7f56e00ae7b0 legacy=0x7f56e006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e60ab640 1 -- 172.21.15.5:0/3174758230 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00ae390 con 0x7f56e0069e90 2024-09-13T17:13:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.291+0000 7f56e50a9640 1 -- 172.21.15.5:0/3174758230 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600048779 0 0) 0x7f56e00b27f0 con 0x7f56e00ae7b0 2024-09-13T17:13:37.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.292+0000 7f56e60ab640 1 --2- 172.21.15.5:0/3174758230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e00b2130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56e006bf20 tx=0x7f56dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918dc94c210074d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.292+0000 7f56e50a9640 1 -- 172.21.15.5:0/3174758230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc032440 con 0x7f56e0069e90 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.292+0000 7f56e50a9640 1 -- 172.21.15.5:0/3174758230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc0325a0 con 0x7f56e0069e90 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.292+0000 7f56e50a9640 1 -- 172.21.15.5:0/3174758230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc032930 con 0x7f56e0069e90 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 -- 172.21.15.5:0/3174758230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 msgr2=0x7f56e00b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 --2- 172.21.15.5:0/3174758230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e00b2130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56e006bf20 tx=0x7f56dc02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 -- 172.21.15.5:0/3174758230 shutdown_connections 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 --2- 172.21.15.5:0/3174758230 >> v2:172.21.15.179:3300/0 conn(0x7f56e015d850 0x7f56e00ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 --2- 172.21.15.5:0/3174758230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e00b2130 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 -- 172.21.15.5:0/3174758230 >> 172.21.15.5:0/3174758230 conn(0x7f56e00b4650 msgr2=0x7f56e00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 -- 172.21.15.5:0/3174758230 shutdown_connections 2024-09-13T17:13:37.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.293+0000 7f56e830f640 1 -- 172.21.15.5:0/3174758230 wait complete. 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.294+0000 7f56e830f640 1 Processor -- start 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.294+0000 7f56e830f640 1 -- start start 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00ae7b0 0x7f56e00ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e015d850 0x7f56e01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00cae80 con 0x7f56e0069e90 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0159430 con 0x7f56e015d850 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e830f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00cb0c0 con 0x7f56e00ae7b0 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59396/0 (socket says 172.21.15.5:59396) 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 -- 172.21.15.5:0/3633561429 learned_addr learned my addr 172.21.15.5:0/3633561429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e68ac640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e015d850 0x7f56e01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e58aa640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00ae7b0 0x7f56e00ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 -- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00ae7b0 msgr2=0x7f56e00ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00ae7b0 0x7f56e00ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 -- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e015d850 msgr2=0x7f56e01560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e015d850 0x7f56e01560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 -- 172.21.15.5:0/3633561429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc009400 con 0x7f56e0069e90 2024-09-13T17:13:37.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56e60ab640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.295+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc030b80 con 0x7f56e0069e90 2024-09-13T17:13:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.296+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc032e90 con 0x7f56e0069e90 2024-09-13T17:13:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.296+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e00cb3a0 con 0x7f56e0069e90 2024-09-13T17:13:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.296+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc006e10 con 0x7f56e0069e90 2024-09-13T17:13:37.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.296+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e0153a20 con 0x7f56e0069e90 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.297+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e00672a0 con 0x7f56e0069e90 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.297+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f56dc039040 con 0x7f56e0069e90 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.297+0000 7f56d6ffd640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 0x7f56c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.298+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56dc0aa080 con 0x7f56e0069e90 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.298+0000 7f56e58aa640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 0x7f56c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.298+0000 7f56e58aa640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 0x7f56c406d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f56e01536d0 tx=0x7f56d0007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.302+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f56dc0dd9c0 con 0x7f56e0069e90 2024-09-13T17:13:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.474+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e00ac110 con 0x7f56e0069e90 2024-09-13T17:13:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.475+0000 7f56d6ffd640 1 -- 172.21.15.5:0/3633561429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f56dc041090 con 0x7f56e0069e90 2024-09-13T17:13:37.476 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:37.476 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 msgr2=0x7f56c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 0x7f56c406d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f56e01536d0 tx=0x7f56d0007d50 comp rx=0 tx=0).stop 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 msgr2=0x7f56e0149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 shutdown_connections 2024-09-13T17:13:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56e015d850 0x7f56e01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56e00ae7b0 0x7f56e00ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f56c406ac00 0x7f56c406d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 --2- 172.21.15.5:0/3633561429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e0069e90 0x7f56e0149c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 >> 172.21.15.5:0/3633561429 conn(0x7f56e00b4650 msgr2=0x7f56e006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 shutdown_connections 2024-09-13T17:13:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.477+0000 7f56e830f640 1 -- 172.21.15.5:0/3633561429 wait complete. 2024-09-13T17:13:37.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:37.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.592+0000 7f4495108640 1 Processor -- start 2024-09-13T17:13:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.592+0000 7f4495108640 1 -- start start 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f4495108640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4490099110 0x7f44900cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f4495108640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44900d0e30 0x7f449006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f4495108640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900704a0 con 0x7f449015fd80 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f4495108640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449006cc10 con 0x7f44900d0e30 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f4495108640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44900d12c0 con 0x7f4490099110 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44900d0e30 0x7f449006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f449015fd80 0x7f4490098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33662/0 (socket says 172.21.15.5:33662) 2024-09-13T17:13:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44900d0e30 0x7f449006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59398/0 (socket says 172.21.15.5:59398) 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448ed9d640 1 -- 172.21.15.5:0/757146599 learned_addr learned my addr 172.21.15.5:0/757146599 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448e59c640 1 --2- 172.21.15.5:0/757146599 >> v2:172.21.15.179:3300/0 conn(0x7f4490099110 0x7f44900cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 -- 172.21.15.5:0/757146599 >> v2:172.21.15.179:3300/0 conn(0x7f4490099110 msgr2=0x7f44900cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 --2- 172.21.15.5:0/757146599 >> v2:172.21.15.179:3300/0 conn(0x7f4490099110 0x7f44900cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 -- 172.21.15.5:0/757146599 >> v1:172.21.15.5:6789/0 conn(0x7f449015fd80 legacy=0x7f4490098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448f59e640 1 -- 172.21.15.5:0/757146599 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449006bd80 con 0x7f44900d0e30 2024-09-13T17:13:37.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.593+0000 7f448dd9b640 1 -- 172.21.15.5:0/757146599 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266322913 0 0) 0x7f44900704a0 con 0x7f449015fd80 2024-09-13T17:13:37.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.594+0000 7f448f59e640 1 --2- 172.21.15.5:0/757146599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449006e870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f449006cb60 tx=0x7f448802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7ee0589f7b250e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.594+0000 7f448dd9b640 1 -- 172.21.15.5:0/757146599 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448802ae50 con 0x7f44900d0e30 2024-09-13T17:13:37.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.594+0000 7f448dd9b640 1 -- 172.21.15.5:0/757146599 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488032440 con 0x7f44900d0e30 2024-09-13T17:13:37.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.594+0000 7f448dd9b640 1 -- 172.21.15.5:0/757146599 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880327d0 con 0x7f44900d0e30 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 -- 172.21.15.5:0/757146599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 msgr2=0x7f449006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 --2- 172.21.15.5:0/757146599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449006e870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f449006cb60 tx=0x7f448802a140 comp rx=0 tx=0).stop 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 -- 172.21.15.5:0/757146599 shutdown_connections 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 --2- 172.21.15.5:0/757146599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449006e870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 --2- 172.21.15.5:0/757146599 >> v2:172.21.15.179:3300/0 conn(0x7f4490099110 0x7f44900cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 -- 172.21.15.5:0/757146599 >> 172.21.15.5:0/757146599 conn(0x7f44900d0310 msgr2=0x7f44900d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 -- 172.21.15.5:0/757146599 shutdown_connections 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.595+0000 7f4495108640 1 -- 172.21.15.5:0/757146599 wait complete. 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.596+0000 7f4495108640 1 Processor -- start 2024-09-13T17:13:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.596+0000 7f4495108640 1 -- start start 2024-09-13T17:13:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4490099110 0x7f44900c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449015fd80 0x7f449015c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490151320 con 0x7f44900d0e30 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900c52e0 con 0x7f449015fd80 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f4495108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900c55c0 con 0x7f4490099110 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f448e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f448e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59406/0 (socket says 172.21.15.5:59406) 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f448e59c640 1 -- 172.21.15.5:0/805430881 learned_addr learned my addr 172.21.15.5:0/805430881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f448f59e640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449015fd80 0x7f449015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.597+0000 7f448ed9d640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4490099110 0x7f44900c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 -- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4490099110 msgr2=0x7f44900c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4490099110 0x7f44900c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 -- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449015fd80 msgr2=0x7f449015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449015fd80 0x7f449015c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 -- 172.21.15.5:0/805430881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009400 con 0x7f44900d0e30 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f448e59c640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f447800d5f0 tx=0x7f447800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780125f0 con 0x7f44900d0e30 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4478012750 con 0x7f44900d0e30 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900c58a0 con 0x7f44900d0e30 2024-09-13T17:13:37.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478012b00 con 0x7f44900d0e30 2024-09-13T17:13:37.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.598+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44900c5e60 con 0x7f44900d0e30 2024-09-13T17:13:37.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.599+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44900c6020 con 0x7f44900d0e30 2024-09-13T17:13:37.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.599+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4478012c60 con 0x7f44900d0e30 2024-09-13T17:13:37.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.600+0000 7f44877fe640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 0x7f447006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.600+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44780899e0 con 0x7f44900d0e30 2024-09-13T17:13:37.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.600+0000 7f448ed9d640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 0x7f447006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.601+0000 7f448ed9d640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 0x7f447006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44800012e0 tx=0x7f4480001700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.604+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4478054980 con 0x7f44900d0e30 2024-09-13T17:13:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.774+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f449006c1f0 con 0x7f44900d0e30 2024-09-13T17:13:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.774+0000 7f44877fe640 1 -- 172.21.15.5:0/805430881 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f449006c1f0 con 0x7f44900d0e30 2024-09-13T17:13:37.775 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 msgr2=0x7f447006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 0x7f447006d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44800012e0 tx=0x7f4480001700 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 msgr2=0x7f449015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f447800d5f0 tx=0x7f447800dab0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 shutdown_connections 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f449015fd80 0x7f449015c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f447006ac00 0x7f447006d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900d0e30 0x7f449015bf40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 --2- 172.21.15.5:0/805430881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4490099110 0x7f44900c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 >> 172.21.15.5:0/805430881 conn(0x7f44900d0310 msgr2=0x7f4490098a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 shutdown_connections 2024-09-13T17:13:37.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.776+0000 7f4495108640 1 -- 172.21.15.5:0/805430881 wait complete. 2024-09-13T17:13:37.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:37.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.891+0000 7f2868a3d640 1 Processor -- start 2024-09-13T17:13:37.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.891+0000 7f2868a3d640 1 -- start start 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2868a3d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f28640ad720 0x7f286415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2868a3d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286406c520 con 0x7f286406c090 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2868a3d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286406c800 con 0x7f2864157e20 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2868a3d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286415b900 con 0x7f28640ad720 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2861d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f286406c090 0x7f28640b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33674/0 (socket says 172.21.15.5:33674) 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2861d9b640 1 -- 172.21.15.5:0/1736799310 learned_addr learned my addr 172.21.15.5:0/1736799310 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f2862d9d640 1 --2- 172.21.15.5:0/1736799310 >> v2:172.21.15.179:3300/0 conn(0x7f28640ad720 0x7f286415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910137753 0 0) 0x7f286406c520 con 0x7f286406c090 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.892+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c003520 con 0x7f286406c090 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127562067 0 0) 0x7f286406c800 con 0x7f2864157e20 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286406c520 con 0x7f2864157e20 2024-09-13T17:13:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f2862d9d640 1 -- 172.21.15.5:0/1736799310 >> v1:172.21.15.179:6789/0 conn(0x7f2864157e20 legacy=0x7f28640ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f2862d9d640 1 -- 172.21.15.5:0/1736799310 >> v1:172.21.15.5:6789/0 conn(0x7f286406c090 legacy=0x7f28640b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f2862d9d640 1 -- 172.21.15.5:0/1736799310 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286406cae0 con 0x7f28640ad720 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.893+0000 7f2862d9d640 1 --2- 172.21.15.5:0/1736799310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f286415b3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097a0 tx=0x7f285c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b275c279d94906 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c032440 con 0x7f28640ad720 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0325a0 con 0x7f28640ad720 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f286159a640 1 -- 172.21.15.5:0/1736799310 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c032930 con 0x7f28640ad720 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 -- 172.21.15.5:0/1736799310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 msgr2=0x7f286415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1736799310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f286415b3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097a0 tx=0x7f285c02a230 comp rx=0 tx=0).stop 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 -- 172.21.15.5:0/1736799310 shutdown_connections 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1736799310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f286415b3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 -- 172.21.15.5:0/1736799310 >> 172.21.15.5:0/1736799310 conn(0x7f28640ce130 msgr2=0x7f28640ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 -- 172.21.15.5:0/1736799310 shutdown_connections 2024-09-13T17:13:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.894+0000 7f2868a3d640 1 -- 172.21.15.5:0/1736799310 wait complete. 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.895+0000 7f2868a3d640 1 Processor -- start 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 -- start start 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f28641f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 0x7f28641529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641f42b0 con 0x7f2864157e20 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2864099730 con 0x7f28640ad720 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2868a3d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28641f33e0 con 0x7f28641537e0 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2861d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2861d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59408/0 (socket says 172.21.15.5:59408) 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.896+0000 7f2861d9b640 1 -- 172.21.15.5:0/1379085837 learned_addr learned my addr 172.21.15.5:0/1379085837 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f286259c640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f28641f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2862d9d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 0x7f28641529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 -- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 msgr2=0x7f28641529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 0x7f28641529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 -- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 msgr2=0x7f28641f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f28641f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 -- 172.21.15.5:0/1379085837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009400 con 0x7f2864157e20 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2862d9d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 0x7f28641529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2861d9b640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f285800cbf0 tx=0x7f285800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800acf0 con 0x7f2864157e20 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800ae50 con 0x7f2864157e20 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28641f3630 con 0x7f2864157e20 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858012620 con 0x7f2864157e20 2024-09-13T17:13:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.897+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28641f3bf0 con 0x7f2864157e20 2024-09-13T17:13:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.898+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28640672a0 con 0x7f2864157e20 2024-09-13T17:13:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.899+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2858007070 con 0x7f2864157e20 2024-09-13T17:13:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.899+0000 7f2852ffd640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 0x7f284406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.899+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28580895f0 con 0x7f2864157e20 2024-09-13T17:13:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.899+0000 7f286259c640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 0x7f284406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.900+0000 7f286259c640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 0x7f284406d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28540011e0 tx=0x7f2854009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:37.903+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2858058020 con 0x7f2864157e20 2024-09-13T17:13:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.072+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28640b1220 con 0x7f2864157e20 2024-09-13T17:13:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.073+0000 7f2852ffd640 1 -- 172.21.15.5:0/1379085837 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2858057bb0 con 0x7f2864157e20 2024-09-13T17:13:38.074 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 msgr2=0x7f284406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 0x7f284406d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28540011e0 tx=0x7f2854009040 comp rx=0 tx=0).stop 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 msgr2=0x7f2864098280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f285800cbf0 tx=0x7f285800a430 comp rx=0 tx=0).stop 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 shutdown_connections 2024-09-13T17:13:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28641537e0 0x7f28641529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f284406ac00 0x7f284406d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2864157e20 0x7f2864098280 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 --2- 172.21.15.5:0/1379085837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28640ad720 0x7f28641f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 >> 172.21.15.5:0/1379085837 conn(0x7f28640ce130 msgr2=0x7f2864073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 shutdown_connections 2024-09-13T17:13:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.075+0000 7f2868a3d640 1 -- 172.21.15.5:0/1379085837 wait complete. 2024-09-13T17:13:38.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.190+0000 7f7f09ed0640 1 Processor -- start 2024-09-13T17:13:38.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.190+0000 7f7f09ed0640 1 -- start start 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f09ed0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f0415d850 0x7f7f040b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f09ed0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040b27f0 con 0x7f7f04069e90 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f09ed0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0406ed60 con 0x7f7f040ae7b0 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f09ed0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040b40d0 con 0x7f7f0415d850 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f02ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f0415d850 0x7f7f040b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f037fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f04069e90 0x7f7f0406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33688/0 (socket says 172.21.15.5:33688) 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.191+0000 7f7f037fe640 1 -- 172.21.15.5:0/1276096401 learned_addr learned my addr 172.21.15.5:0/1276096401 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f02ffd640 1 -- 172.21.15.5:0/1276096401 >> v1:172.21.15.179:6789/0 conn(0x7f7f040ae7b0 legacy=0x7f7f040ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f02ffd640 1 -- 172.21.15.5:0/1276096401 >> v1:172.21.15.5:6789/0 conn(0x7f7f04069e90 legacy=0x7f7f0406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f02ffd640 1 -- 172.21.15.5:0/1276096401 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040ae390 con 0x7f7f0415d850 2024-09-13T17:13:38.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f02ffd640 1 --2- 172.21.15.5:0/1276096401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0415d850 0x7f7f040b2130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80097a0 tx=0x7f7ef802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f4032620291a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f027fc640 1 -- 172.21.15.5:0/1276096401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef802ae50 con 0x7f7f0415d850 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f027fc640 1 -- 172.21.15.5:0/1276096401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8032440 con 0x7f7f0415d850 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.192+0000 7f7f027fc640 1 -- 172.21.15.5:0/1276096401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80327d0 con 0x7f7f0415d850 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 -- 172.21.15.5:0/1276096401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0415d850 msgr2=0x7f7f040b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/1276096401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0415d850 0x7f7f040b2130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80097a0 tx=0x7f7ef802a140 comp rx=0 tx=0).stop 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 -- 172.21.15.5:0/1276096401 shutdown_connections 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/1276096401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0415d850 0x7f7f040b2130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 -- 172.21.15.5:0/1276096401 >> 172.21.15.5:0/1276096401 conn(0x7f7f040b4650 msgr2=0x7f7f040b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 -- 172.21.15.5:0/1276096401 shutdown_connections 2024-09-13T17:13:38.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.193+0000 7f7f09ed0640 1 -- 172.21.15.5:0/1276096401 wait complete. 2024-09-13T17:13:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.194+0000 7f7f09ed0640 1 Processor -- start 2024-09-13T17:13:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.194+0000 7f7f09ed0640 1 -- start start 2024-09-13T17:13:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f04069e90 0x7f7f040b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0415d850 0x7f7f0414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04157800 con 0x7f7f040ae7b0 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04156bf0 con 0x7f7f04069e90 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f09ed0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04156ed0 con 0x7f7f0415d850 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59426/0 (socket says 172.21.15.5:59426) 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f02ffd640 1 -- 172.21.15.5:0/76833263 learned_addr learned my addr 172.21.15.5:0/76833263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f037fe640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f04069e90 0x7f7f040b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.195+0000 7f7f03fff640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0415d850 0x7f7f0414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 -- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0415d850 msgr2=0x7f7f0414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0415d850 0x7f7f0414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 -- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f04069e90 msgr2=0x7f7f040b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f04069e90 0x7f7f040b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 -- 172.21.15.5:0/76833263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8009400 con 0x7f7f040ae7b0 2024-09-13T17:13:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f02ffd640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef803d910 con 0x7f7f040ae7b0 2024-09-13T17:13:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef803da70 con 0x7f7f040ae7b0 2024-09-13T17:13:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f041571b0 con 0x7f7f040ae7b0 2024-09-13T17:13:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef803de20 con 0x7f7f040ae7b0 2024-09-13T17:13:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.196+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f041583a0 con 0x7f7f040ae7b0 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.197+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f040672a0 con 0x7f7f040ae7b0 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.197+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7ef8039040 con 0x7f7f040ae7b0 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.198+0000 7f7eebfff640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.198+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ef8032e40 con 0x7f7f040ae7b0 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.198+0000 7f7f037fe640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.199+0000 7f7f037fe640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 0x7f7ef006d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005880 tx=0x7f7ef4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.202+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7ef8074dd0 con 0x7f7f040ae7b0 2024-09-13T17:13:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.374+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f04153f40 con 0x7f7f040ae7b0 2024-09-13T17:13:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.374+0000 7f7eebfff640 1 -- 172.21.15.5:0/76833263 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ef80410a0 con 0x7f7f040ae7b0 2024-09-13T17:13:38.376 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 msgr2=0x7f7ef006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 0x7f7ef006d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005880 tx=0x7f7ef4009040 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 msgr2=0x7f7f041561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef80046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 shutdown_connections 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0415d850 0x7f7f0414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ef006ac00 0x7f7ef006d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f040ae7b0 0x7f7f041561a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 --2- 172.21.15.5:0/76833263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f04069e90 0x7f7f040b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 >> 172.21.15.5:0/76833263 conn(0x7f7f040b4650 msgr2=0x7f7f0406dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.376+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 shutdown_connections 2024-09-13T17:13:38.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.377+0000 7f7f09ed0640 1 -- 172.21.15.5:0/76833263 wait complete. 2024-09-13T17:13:38.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.492+0000 7f5a1579c640 1 Processor -- start 2024-09-13T17:13:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.492+0000 7f5a1579c640 1 -- start start 2024-09-13T17:13:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a1015fd80 0x7f5a100cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a100d0e30 0x7f5a10098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a10098f40 0x7f5a100ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a100993f0 con 0x7f5a1015fd80 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1006cc10 con 0x7f5a10098f40 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a1579c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100704a0 con 0x7f5a100d0e30 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a1015fd80 0x7f5a100cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a1015fd80 0x7f5a100cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59430/0 (socket says 172.21.15.5:59430) 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 -- 172.21.15.5:0/2581153832 learned_addr learned my addr 172.21.15.5:0/2581153832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 -- 172.21.15.5:0/2581153832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a100d0e30 msgr2=0x7f5a10098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 --2- 172.21.15.5:0/2581153832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a100d0e30 0x7f5a10098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 -- 172.21.15.5:0/2581153832 >> v2:172.21.15.179:3300/0 conn(0x7f5a10098f40 msgr2=0x7f5a100ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 --2- 172.21.15.5:0/2581153832 >> v2:172.21.15.179:3300/0 conn(0x7f5a10098f40 0x7f5a100ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.493+0000 7f5a0effd640 1 -- 172.21.15.5:0/2581153832 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1006bd80 con 0x7f5a1015fd80 2024-09-13T17:13:38.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.494+0000 7f5a0effd640 1 --2- 172.21.15.5:0/2581153832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a1015fd80 0x7f5a100cfd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a10067840 tx=0x7f5a0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3550e1edd0ced5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.494+0000 7f5a0dffb640 1 -- 172.21.15.5:0/2581153832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0002ae90 con 0x7f5a1015fd80 2024-09-13T17:13:38.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.494+0000 7f5a0dffb640 1 -- 172.21.15.5:0/2581153832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a00032440 con 0x7f5a1015fd80 2024-09-13T17:13:38.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.494+0000 7f5a0dffb640 1 -- 172.21.15.5:0/2581153832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000327d0 con 0x7f5a1015fd80 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 -- 172.21.15.5:0/2581153832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a1015fd80 msgr2=0x7f5a100cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 --2- 172.21.15.5:0/2581153832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a1015fd80 0x7f5a100cfd30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a10067840 tx=0x7f5a0002a140 comp rx=0 tx=0).stop 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 -- 172.21.15.5:0/2581153832 shutdown_connections 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 --2- 172.21.15.5:0/2581153832 >> v2:172.21.15.179:3300/0 conn(0x7f5a10098f40 0x7f5a100ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 --2- 172.21.15.5:0/2581153832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a100d0e30 0x7f5a10098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 --2- 172.21.15.5:0/2581153832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a1015fd80 0x7f5a100cfd30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 -- 172.21.15.5:0/2581153832 >> 172.21.15.5:0/2581153832 conn(0x7f5a100d0310 msgr2=0x7f5a100d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 -- 172.21.15.5:0/2581153832 shutdown_connections 2024-09-13T17:13:38.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.495+0000 7f5a1579c640 1 -- 172.21.15.5:0/2581153832 wait complete. 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.496+0000 7f5a1579c640 1 Processor -- start 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.496+0000 7f5a1579c640 1 -- start start 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a10098f40 0x7f5a10157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1015fd80 0x7f5a100b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101597e0 con 0x7f5a100d0e30 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100b4c20 con 0x7f5a10098f40 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a1579c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100b4f00 con 0x7f5a1015fd80 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59436/0 (socket says 172.21.15.5:59436) 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 -- 172.21.15.5:0/756116163 learned_addr learned my addr 172.21.15.5:0/756116163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:38.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0f7fe640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1015fd80 0x7f5a100b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0effd640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a10098f40 0x7f5a10157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 -- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1015fd80 msgr2=0x7f5a100b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1015fd80 0x7f5a100b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 -- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a10098f40 msgr2=0x7f5a10157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a10098f40 0x7f5a10157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.497+0000 7f5a0e7fc640 1 -- 172.21.15.5:0/756116163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000094d0 con 0x7f5a100d0e30 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f5a0e7fc640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b450 tx=0x7f5a0400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04011890 con 0x7f5a100d0e30 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a040119f0 con 0x7f5a100d0e30 2024-09-13T17:13:38.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a100b51e0 con 0x7f5a100d0e30 2024-09-13T17:13:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04011da0 con 0x7f5a100d0e30 2024-09-13T17:13:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.498+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10157aa0 con 0x7f5a100d0e30 2024-09-13T17:13:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.499+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1006c1f0 con 0x7f5a100d0e30 2024-09-13T17:13:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.499+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a0401a400 con 0x7f5a100d0e30 2024-09-13T17:13:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.500+0000 7f59f77fe640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 0x7f59fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.500+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a040899a0 con 0x7f5a100d0e30 2024-09-13T17:13:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.500+0000 7f5a0effd640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 0x7f59fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.501+0000 7f5a0effd640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 0x7f59fc06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a00034000 tx=0x7f5a0002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.504+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a1006c1f0 con 0x7f5a100d0e30 2024-09-13T17:13:38.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.674+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5a1006c1f0 con 0x7f5a100d0e30 2024-09-13T17:13:38.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.675+0000 7f59f77fe640 1 -- 172.21.15.5:0/756116163 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5a1006c1f0 con 0x7f5a100d0e30 2024-09-13T17:13:38.676 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.676+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 msgr2=0x7f59fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.676+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 0x7f59fc06d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a00034000 tx=0x7f5a0002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 msgr2=0x7f5a100b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b450 tx=0x7f5a0400b910 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 shutdown_connections 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a1015fd80 0x7f5a100b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f59fc06ac00 0x7f59fc06d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a100d0e30 0x7f5a100b40a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 --2- 172.21.15.5:0/756116163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a10098f40 0x7f5a10157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 >> 172.21.15.5:0/756116163 conn(0x7f5a100d0310 msgr2=0x7f5a1015dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 shutdown_connections 2024-09-13T17:13:38.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.677+0000 7f5a1579c640 1 -- 172.21.15.5:0/756116163 wait complete. 2024-09-13T17:13:38.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.789+0000 7fa8a099d640 1 Processor -- start 2024-09-13T17:13:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.789+0000 7fa8a099d640 1 -- start start 2024-09-13T17:13:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa8a099d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c143c40 0x7fa89c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa8a099d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa89c0b5550 0x7fa89c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa8a099d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c070aa0 con 0x7fa89c0cd070 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa8a099d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0cd520 con 0x7fa89c0b5550 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa8a099d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0707c0 con 0x7fa89c143c40 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa89c0b5550 0x7fa89c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa89c0b5550 0x7fa89c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59446/0 (socket says 172.21.15.5:59446) 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 -- 172.21.15.5:0/3407002906 learned_addr learned my addr 172.21.15.5:0/3407002906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89b7fe640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c143c40 0x7fa89c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 -- 172.21.15.5:0/3407002906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c143c40 msgr2=0x7fa89c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c143c40 0x7fa89c0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 -- 172.21.15.5:0/3407002906 >> v1:172.21.15.179:6789/0 conn(0x7fa89c0cd070 legacy=0x7fa89c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.790+0000 7fa89affd640 1 -- 172.21.15.5:0/3407002906 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0b4530 con 0x7fa89c0b5550 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.791+0000 7fa89affd640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0b5550 0x7fa89c0ccb30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa89002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e286d7e67b7916a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.791+0000 7fa89a7fc640 1 -- 172.21.15.5:0/3407002906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890032440 con 0x7fa89c0b5550 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.791+0000 7fa89a7fc640 1 -- 172.21.15.5:0/3407002906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900325a0 con 0x7fa89c0b5550 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.791+0000 7fa89a7fc640 1 -- 172.21.15.5:0/3407002906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890032930 con 0x7fa89c0b5550 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 -- 172.21.15.5:0/3407002906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0b5550 msgr2=0x7fa89c0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0b5550 0x7fa89c0ccb30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa89002a270 comp rx=0 tx=0).stop 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 -- 172.21.15.5:0/3407002906 shutdown_connections 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0b5550 0x7fa89c0ccb30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 --2- 172.21.15.5:0/3407002906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c143c40 0x7fa89c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 -- 172.21.15.5:0/3407002906 >> 172.21.15.5:0/3407002906 conn(0x7fa89c0b1e70 msgr2=0x7fa89c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 -- 172.21.15.5:0/3407002906 shutdown_connections 2024-09-13T17:13:38.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.792+0000 7fa8a099d640 1 -- 172.21.15.5:0/3407002906 wait complete. 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.793+0000 7fa8a099d640 1 Processor -- start 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.793+0000 7fa8a099d640 1 -- start start 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c0b5550 0x7fa89c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa89c143c40 0x7fa89c152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c152c00 con 0x7fa89c0cd070 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c152ee0 con 0x7fa89c143c40 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa8a099d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1531c0 con 0x7fa89c0b5550 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa89affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa89affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59460/0 (socket says 172.21.15.5:59460) 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa89affd640 1 -- 172.21.15.5:0/2519996201 learned_addr learned my addr 172.21.15.5:0/2519996201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa89b7fe640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c0b5550 0x7fa89c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.794+0000 7fa89bfff640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa89c143c40 0x7fa89c152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 -- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c0b5550 msgr2=0x7fa89c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c0b5550 0x7fa89c153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 -- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa89c143c40 msgr2=0x7fa89c152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa89c143c40 0x7fa89c152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 -- 172.21.15.5:0/2519996201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900094d0 con 0x7fa89c0cd070 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa89affd640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa8900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890032440 con 0x7fa89c0cd070 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890030ba0 con 0x7fa89c0cd070 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89003b400 con 0x7fa89c0cd070 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c1534a0 con 0x7fa89c0cd070 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.795+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c1541e0 con 0x7fa89c0cd070 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.796+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c0ccb30 con 0x7fa89c0cd070 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.796+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa890039040 con 0x7fa89c0cd070 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.797+0000 7fa883fff640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 0x7fa88806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.797+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8900a9d10 con 0x7fa89c0cd070 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.797+0000 7fa89b7fe640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 0x7fa88806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.798+0000 7fa89b7fe640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 0x7fa88806d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:38.801+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa890074d40 con 0x7fa89c0cd070 2024-09-13T17:13:39.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.004+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89c1e0590 con 0x7fa89c0cd070 2024-09-13T17:13:39.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.005+0000 7fa883fff640 1 -- 172.21.15.5:0/2519996201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7fa890037090 con 0x7fa89c0cd070 2024-09-13T17:13:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:39.006 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:39.007 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:13:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 msgr2=0x7fa88806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 0x7fa88806d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c008040 comp rx=0 tx=0).stop 2024-09-13T17:13:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 msgr2=0x7fa89c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa890009870 tx=0x7fa8900046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 shutdown_connections 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa89c143c40 0x7fa89c152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa88806ac00 0x7fa88806d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa89c0cd070 0x7fa89c151a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 --2- 172.21.15.5:0/2519996201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa89c0b5550 0x7fa89c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 >> 172.21.15.5:0/2519996201 conn(0x7fa89c0b1e70 msgr2=0x7fa89c0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 shutdown_connections 2024-09-13T17:13:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.007+0000 7fa8a099d640 1 -- 172.21.15.5:0/2519996201 wait complete. 2024-09-13T17:13:39.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.119+0000 7f048a5db640 1 Processor -- start 2024-09-13T17:13:39.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.119+0000 7f048a5db640 1 -- start start 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f048a5db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 0x7f04840ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f048a5db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048406a5a0 0x7f04840ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f048a5db640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04840ac650 con 0x7f048415aaa0 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f048a5db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0484144100 con 0x7f048406a5a0 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f048a5db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0484143b20 con 0x7f0484143740 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f0488b78640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048406a5a0 0x7f04840ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f0488b78640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f048406a5a0 0x7f04840ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59472/0 (socket says 172.21.15.5:59472) 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f0488b78640 1 -- 172.21.15.5:0/2590706378 learned_addr learned my addr 172.21.15.5:0/2590706378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.120+0000 7f0483fff640 1 --2- 172.21.15.5:0/2590706378 >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 0x7f04840ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0488b78640 1 -- 172.21.15.5:0/2590706378 >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 msgr2=0x7f04840ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:39.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0488b78640 1 --2- 172.21.15.5:0/2590706378 >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 0x7f04840ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0488b78640 1 -- 172.21.15.5:0/2590706378 >> v1:172.21.15.179:6789/0 conn(0x7f048415aaa0 legacy=0x7f0484069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0488b78640 1 -- 172.21.15.5:0/2590706378 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840b2130 con 0x7f048406a5a0 2024-09-13T17:13:39.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0483fff640 1 --2- 172.21.15.5:0/2590706378 >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 0x7f04840ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0488b78640 1 --2- 172.21.15.5:0/2590706378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048406a5a0 0x7f04840ac110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04840d0220 tx=0x7f047c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569b5168038f1f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.121+0000 7f0482ffd640 1 -- 172.21.15.5:0/2590706378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c031600 con 0x7f048406a5a0 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f0482ffd640 1 -- 172.21.15.5:0/2590706378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c02d050 con 0x7f048406a5a0 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f0482ffd640 1 -- 172.21.15.5:0/2590706378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c0319a0 con 0x7f048406a5a0 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 -- 172.21.15.5:0/2590706378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048406a5a0 msgr2=0x7f04840ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 --2- 172.21.15.5:0/2590706378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048406a5a0 0x7f04840ac110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04840d0220 tx=0x7f047c02a7c0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 -- 172.21.15.5:0/2590706378 shutdown_connections 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 --2- 172.21.15.5:0/2590706378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048406a5a0 0x7f04840ac110 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 --2- 172.21.15.5:0/2590706378 >> v2:172.21.15.179:3300/0 conn(0x7f0484143740 0x7f04840ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 -- 172.21.15.5:0/2590706378 >> 172.21.15.5:0/2590706378 conn(0x7f04840b4650 msgr2=0x7f04840b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 -- 172.21.15.5:0/2590706378 shutdown_connections 2024-09-13T17:13:39.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.122+0000 7f048a5db640 1 -- 172.21.15.5:0/2590706378 wait complete. 2024-09-13T17:13:39.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.123+0000 7f048a5db640 1 Processor -- start 2024-09-13T17:13:39.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.123+0000 7f048a5db640 1 -- start start 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048406a5a0 0x7f0484099e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0484143740 0x7f048413d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04840c45e0 con 0x7f048415aaa0 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04840c4810 con 0x7f048406a5a0 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f048a5db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04840c4af0 con 0x7f0484143740 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f0488b78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f0488b78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59482/0 (socket says 172.21.15.5:59482) 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.124+0000 7f0488b78640 1 -- 172.21.15.5:0/2517238010 learned_addr learned my addr 172.21.15.5:0/2517238010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f04837fe640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0484143740 0x7f048413d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 -- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0484143740 msgr2=0x7f048413d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0483fff640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048406a5a0 0x7f0484099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0484143740 0x7f048413d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 -- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048406a5a0 msgr2=0x7f0484099e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048406a5a0 0x7f0484099e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 -- 172.21.15.5:0/2517238010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c009b30 con 0x7f048415aaa0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0488b78640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f047c009f40 tx=0x7f047c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c03b600 con 0x7f048415aaa0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c03b760 con 0x7f048415aaa0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c03bb10 con 0x7f048415aaa0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048409acd0 con 0x7f048415aaa0 2024-09-13T17:13:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.125+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04840c4dd0 con 0x7f048415aaa0 2024-09-13T17:13:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.126+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048409b1f0 con 0x7f048415aaa0 2024-09-13T17:13:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.127+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f047c03bc70 con 0x7f048415aaa0 2024-09-13T17:13:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.127+0000 7f0480ff9640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 0x7f047006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.127+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f047c0a9bc0 con 0x7f048415aaa0 2024-09-13T17:13:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.128+0000 7f0483fff640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 0x7f047006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.128+0000 7f0483fff640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 0x7f047006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f047400d8b0 tx=0x7f0474008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.131+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f048409b1f0 con 0x7f048415aaa0 2024-09-13T17:13:39.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.302+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f048409b1f0 con 0x7f048415aaa0 2024-09-13T17:13:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.303+0000 7f0480ff9640 1 -- 172.21.15.5:0/2517238010 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f048409b1f0 con 0x7f048415aaa0 2024-09-13T17:13:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:39.305 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 msgr2=0x7f047006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 0x7f047006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f047400d8b0 tx=0x7f0474008040 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 msgr2=0x7f04840c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f047c009f40 tx=0x7f047c004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 shutdown_connections 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f047006ac00 0x7f047006d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f048415aaa0 0x7f04840c40a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0484143740 0x7f048413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 --2- 172.21.15.5:0/2517238010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f048406a5a0 0x7f0484099e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.305+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 >> 172.21.15.5:0/2517238010 conn(0x7f04840b4650 msgr2=0x7f048413eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.306+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 shutdown_connections 2024-09-13T17:13:39.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.306+0000 7f048a5db640 1 -- 172.21.15.5:0/2517238010 wait complete. 2024-09-13T17:13:39.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.419+0000 7f29f759e640 1 Processor -- start 2024-09-13T17:13:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.419+0000 7f29f759e640 1 -- start start 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29f81438f0 0x7f29f815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8069e90 0x7f29f806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f759e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f806a820 con 0x7f29f8070fc0 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f759e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f815bed0 con 0x7f29f81438f0 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f806f9a0 con 0x7f29f8069e90 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.420+0000 7f29f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29f81438f0 0x7f29f815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f29f81438f0 0x7f29f815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59484/0 (socket says 172.21.15.5:59484) 2024-09-13T17:13:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 -- 172.21.15.5:0/3203862275 learned_addr learned my addr 172.21.15.5:0/3203862275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f6d9d640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8069e90 0x7f29f806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 -- 172.21.15.5:0/3203862275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8069e90 msgr2=0x7f29f806a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8069e90 0x7f29f806a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 -- 172.21.15.5:0/3203862275 >> v1:172.21.15.179:6789/0 conn(0x7f29f8070fc0 legacy=0x7f29f815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.421+0000 7f29f659c640 1 -- 172.21.15.5:0/3203862275 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f815acc0 con 0x7f29f81438f0 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f659c640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f81438f0 0x7f29f815a600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29f00098a0 tx=0x7f29f002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acc76f3bffb56cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f559a640 1 -- 172.21.15.5:0/3203862275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0032440 con 0x7f29f81438f0 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f559a640 1 -- 172.21.15.5:0/3203862275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f00325a0 con 0x7f29f81438f0 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f559a640 1 -- 172.21.15.5:0/3203862275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0032930 con 0x7f29f81438f0 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 -- 172.21.15.5:0/3203862275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f81438f0 msgr2=0x7f29f815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f81438f0 0x7f29f815a600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29f00098a0 tx=0x7f29f002a290 comp rx=0 tx=0).stop 2024-09-13T17:13:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 -- 172.21.15.5:0/3203862275 shutdown_connections 2024-09-13T17:13:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f8069e90 0x7f29f806a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 --2- 172.21.15.5:0/3203862275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f81438f0 0x7f29f815a600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 -- 172.21.15.5:0/3203862275 >> 172.21.15.5:0/3203862275 conn(0x7f29f80b0de0 msgr2=0x7f29f80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 -- 172.21.15.5:0/3203862275 shutdown_connections 2024-09-13T17:13:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.422+0000 7f29f759e640 1 -- 172.21.15.5:0/3203862275 wait complete. 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 Processor -- start 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 -- start start 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f8069e90 0x7f29f813cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f81438f0 0x7f29f813f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80a8950 con 0x7f29f8070fc0 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80a7d40 con 0x7f29f8069e90 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.424+0000 7f29f759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80a8020 con 0x7f29f81438f0 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59494/0 (socket says 172.21.15.5:59494) 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 -- 172.21.15.5:0/650840419 learned_addr learned my addr 172.21.15.5:0/650840419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f659c640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f8069e90 0x7f29f813cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f6d9d640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f81438f0 0x7f29f813f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 -- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f81438f0 msgr2=0x7f29f813f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f81438f0 0x7f29f813f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 -- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f8069e90 msgr2=0x7f29f813cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f8069e90 0x7f29f813cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 -- 172.21.15.5:0/650840419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00094d0 con 0x7f29f8070fc0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f5d9b640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c480 tx=0x7f29e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e00052d0 con 0x7f29f8070fc0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0005430 con 0x7f29f8070fc0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80a8300 con 0x7f29f8070fc0 2024-09-13T17:13:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0012870 con 0x7f29f8070fc0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.425+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80a79a0 con 0x7f29f8070fc0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.426+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80a8b00 con 0x7f29f8070fc0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.427+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29e00129d0 con 0x7f29f8070fc0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.427+0000 7f29eeffd640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 0x7f29d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.428+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29e0088f00 con 0x7f29f8070fc0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.428+0000 7f29f659c640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 0x7f29d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.428+0000 7f29f659c640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 0x7f29d806d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f29f0034000 tx=0x7f29f002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.432+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f29f80a8b00 con 0x7f29f8070fc0 2024-09-13T17:13:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.638+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29f806a820 con 0x7f29f8070fc0 2024-09-13T17:13:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.638+0000 7f29eeffd640 1 -- 172.21.15.5:0/650840419 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7f29f806a820 con 0x7f29f8070fc0 2024-09-13T17:13:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:39.640 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 msgr2=0x7f29d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 0x7f29d806d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f29f0034000 tx=0x7f29f002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 msgr2=0x7f29f80a7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c480 tx=0x7f29e000c940 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 shutdown_connections 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29f81438f0 0x7f29f813f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f29d806ac00 0x7f29d806d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29f8070fc0 0x7f29f80a7460 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 --2- 172.21.15.5:0/650840419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f8069e90 0x7f29f813cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 >> 172.21.15.5:0/650840419 conn(0x7f29f80b0de0 msgr2=0x7f29f80af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 shutdown_connections 2024-09-13T17:13:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:39.640+0000 7f29f759e640 1 -- 172.21.15.5:0/650840419 wait complete. 2024-09-13T17:13:40.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:13:08.163883+0000', 'modified': '2024-09-13T17:13:29.339757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6836/90966651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 90966651}, {'type': 'v1', 'addr': '172.21.15.179:6836', 'nonce': 90966651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:13:40.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:13:40.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T17:13:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.160+0000 7fb2abdb5640 1 Processor -- start 2024-09-13T17:13:40.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.160+0000 7fb2abdb5640 1 -- start start 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2abdb5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2a4143740 0x7fb2a40ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2abdb5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2a415aaa0 0x7fb2a40ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2abdb5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40ac650 con 0x7fb2a4069e90 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2abdb5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4144100 con 0x7fb2a415aaa0 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2abdb5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4143b20 con 0x7fb2a4143740 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2a415aaa0 0x7fb2a40ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2a415aaa0 0x7fb2a40ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59500/0 (socket says 172.21.15.5:59500) 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 -- 172.21.15.5:0/3914666210 learned_addr learned my addr 172.21.15.5:0/3914666210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/3914666210 >> v2:172.21.15.179:3300/0 conn(0x7fb2a4143740 0x7fb2a40ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 -- 172.21.15.5:0/3914666210 >> v2:172.21.15.179:3300/0 conn(0x7fb2a4143740 msgr2=0x7fb2a40ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 --2- 172.21.15.5:0/3914666210 >> v2:172.21.15.179:3300/0 conn(0x7fb2a4143740 0x7fb2a40ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 -- 172.21.15.5:0/3914666210 >> v1:172.21.15.179:6789/0 conn(0x7fb2a4069e90 legacy=0x7fb2a406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.161+0000 7fb2a9350640 1 -- 172.21.15.5:0/3914666210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40b2130 con 0x7fb2a415aaa0 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.162+0000 7fb2a9350640 1 --2- 172.21.15.5:0/3914666210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a415aaa0 0x7fb2a40ac110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40d0220 tx=0x7fb29402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950ecba1a87e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.162+0000 7fb2a8b4f640 1 -- 172.21.15.5:0/3914666210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294032440 con 0x7fb2a415aaa0 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.162+0000 7fb2a8b4f640 1 -- 172.21.15.5:0/3914666210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2940325a0 con 0x7fb2a415aaa0 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.162+0000 7fb2a8b4f640 1 -- 172.21.15.5:0/3914666210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294032930 con 0x7fb2a415aaa0 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 -- 172.21.15.5:0/3914666210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a415aaa0 msgr2=0x7fb2a40ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/3914666210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a415aaa0 0x7fb2a40ac110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40d0220 tx=0x7fb29402a2c0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 -- 172.21.15.5:0/3914666210 shutdown_connections 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/3914666210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a415aaa0 0x7fb2a40ac110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/3914666210 >> v2:172.21.15.179:3300/0 conn(0x7fb2a4143740 0x7fb2a40ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 -- 172.21.15.5:0/3914666210 >> 172.21.15.5:0/3914666210 conn(0x7fb2a40b4650 msgr2=0x7fb2a40b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 -- 172.21.15.5:0/3914666210 shutdown_connections 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.163+0000 7fb2abdb5640 1 -- 172.21.15.5:0/3914666210 wait complete. 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.164+0000 7fb2abdb5640 1 Processor -- start 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.164+0000 7fb2abdb5640 1 -- start start 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 0x7fb2a413da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 0x7fb2a40ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a409b440 con 0x7fb2a4069e90 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a409b720 con 0x7fb2a4143740 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2abdb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a409ba00 con 0x7fb2a415aaa0 2024-09-13T17:13:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59506/0 (socket says 172.21.15.5:59506) 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 -- 172.21.15.5:0/1687593247 learned_addr learned my addr 172.21.15.5:0/1687593247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 0x7fb2a413da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2aa352640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 0x7fb2a40ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 -- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 msgr2=0x7fb2a40ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 0x7fb2a40ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 -- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 msgr2=0x7fb2a413da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 0x7fb2a413da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 -- 172.21.15.5:0/1687593247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940094d0 con 0x7fb2a4069e90 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 0x7fb2a413da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2aa352640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 0x7fb2a40ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c7f0 tx=0x7fb2a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb29a7fc640 1 -- 172.21.15.5:0/1687593247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0004220 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.165+0000 7fb29a7fc640 1 -- 172.21.15.5:0/1687593247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00043a0 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.166+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a409bce0 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.166+0000 7fb29a7fc640 1 -- 172.21.15.5:0/1687593247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0007860 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.166+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a413dfd0 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.167+0000 7fb29a7fc640 1 -- 172.21.15.5:0/1687593247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2a0007bd0 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.168+0000 7fb29a7fc640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 0x7fb28806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.168+0000 7fb29a7fc640 1 -- 172.21.15.5:0/1687593247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2a0089560 con 0x7fb2a4069e90 2024-09-13T17:13:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.168+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 0x7fb28806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.169+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 0x7fb28806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb294034000 tx=0x7fb29402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.169+0000 7fb2aeada740 1 Processor -- start 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.169+0000 7fb2aeada740 1 -- start start 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc49295480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc491ef7c0 con 0x55dc49292860 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc491feb70 con 0x55dc492bc550 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc491fc300 con 0x55dc492950a0 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59510/0 (socket says 172.21.15.5:59510) 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 -- 172.21.15.5:0/835143815 learned_addr learned my addr 172.21.15.5:0/835143815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc49295480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aa352640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 -- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 msgr2=0x55dc49295480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc49295480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 -- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 msgr2=0x55dc492e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 -- 172.21.15.5:0/835143815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc491844b0 con 0x55dc49292860 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2aa352640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2a9350640 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb29402a8b0 tx=0x7fb29402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e538f62d6873ed44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2877fe640 1 -- 172.21.15.5:0/835143815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29403c890 con 0x55dc49292860 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2877fe640 1 -- 172.21.15.5:0/835143815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294042070 con 0x55dc49292860 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.170+0000 7fb2877fe640 1 -- 172.21.15.5:0/835143815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29403cbf0 con 0x55dc49292860 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 -- 172.21.15.5:0/835143815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 msgr2=0x55dc492e2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb29402a8b0 tx=0x7fb29402c000 comp rx=0 tx=0).stop 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 -- 172.21.15.5:0/835143815 shutdown_connections 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc49292860 0x55dc492e2570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 --2- 172.21.15.5:0/835143815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc49295480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 -- 172.21.15.5:0/835143815 >> 172.21.15.5:0/835143815 conn(0x55dc492917d0 msgr2=0x55dc492d9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 -- 172.21.15.5:0/835143815 shutdown_connections 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.171+0000 7fb2aeada740 1 -- 172.21.15.5:0/835143815 wait complete. 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.172+0000 7fb2aeada740 1 -- start start 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.172+0000 7fb2aeada740 1 Processor -- start 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc491f7bf0 con 0x55dc492950a0 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc491b6250 con 0x55dc492bc550 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc491b5ef0 con 0x55dc492e1b10 2024-09-13T17:13:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 10 client.0 _ll_register_callbacks cb 0x55dc491e8740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59524/0 (socket says 172.21.15.5:59524) 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 -- 172.21.15.5:0/2363532709 learned_addr learned my addr 172.21.15.5:0/2363532709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9350640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aa352640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 -- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 msgr2=0x55dc492b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 -- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 msgr2=0x55dc492e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 -- 172.21.15.5:0/2363532709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40b2130 con 0x55dc492950a0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000afd0 tx=0x7fb2a00589e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf5a53cb2937e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb284ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a005e2b0 con 0x55dc492950a0 2024-09-13T17:13:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2a0060100 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.173+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc48eeb3c0 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a00602c0 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 10 client.4800 fetch_fsmap learned FSMap version 9 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55dc491f6270 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0073020 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb2a0087bc0 con 0x55dc492950a0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 10 client.4800 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 20 client.4800 populate_metadata read hostname 'smithi005' 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492f8fa0 0x55dc492fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 4 client.4800 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 --> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc48efc6c0 con 0x55dc492f8fa0 2024-09-13T17:13:40.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.174+0000 7fb2a9350640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492f8fa0 0x55dc492fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb284ff9640 10 client.4800 ms_handle_connect on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb2a9350640 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492f8fa0 0x55dc492fb390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938714c144ad674e server_cookie=7e73a9ad3d449e9b in_seq=0 out_seq=0 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb284ff9640 1 -- 172.21.15.5:0/2363532709 <== mds.0 v2:172.21.15.179:6834/90966651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55dc48efc6c0 con 0x55dc492f8fa0 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb284ff9640 10 client.4800 handle_command_reply: tid=0 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb2aeada740 1 client.4800 shutdown 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.175+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 msgr2=0x55dc492bd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000afd0 tx=0x7fb2a00589e0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 shutdown_connections 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492f8fa0 0x55dc492fb390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492bc550 0x55dc492e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 --2- 172.21.15.5:0/2363532709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492950a0 0x55dc492bd2d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb284ff9640 0 client.4800 ms_handle_reset on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 >> 172.21.15.5:0/2363532709 conn(0x55dc49292860 msgr2=0x55dc492d9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 shutdown_connections 2024-09-13T17:13:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 1 -- 172.21.15.5:0/2363532709 wait complete. 2024-09-13T17:13:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.176+0000 7fb2aeada740 20 client.4800 trim_cache size 0 max 16384 2024-09-13T17:13:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 Processor -- start 2024-09-13T17:13:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 -- start start 2024-09-13T17:13:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc492dbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492e1b10 0x55dc492de350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4917b460 con 0x55dc492bc550 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc492bd9a0 con 0x55dc492e1b10 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc492dc220 con 0x55dc492950a0 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.193+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9b51640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc492dbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59528/0 (socket says 172.21.15.5:59528) 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 -- 172.21.15.5:0/1698200369 learned_addr learned my addr 172.21.15.5:0/1698200369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2aa352640 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492e1b10 0x55dc492de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 -- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 msgr2=0x55dc492dbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc492dbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 -- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492e1b10 msgr2=0x55dc492de350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492e1b10 0x55dc492de350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 -- 172.21.15.5:0/1698200369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc491985f0 con 0x55dc492bc550 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb29402a8b0 tx=0x7fb29403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70cf29169e251b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb287fff640 1 -- 172.21.15.5:0/1698200369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294058ea0 con 0x55dc492bc550 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb287fff640 1 -- 172.21.15.5:0/1698200369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294004420 con 0x55dc492bc550 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.194+0000 7fb287fff640 1 -- 172.21.15.5:0/1698200369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29403c890 con 0x55dc492bc550 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- 172.21.15.5:0/1698200369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 msgr2=0x55dc492ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb29402a8b0 tx=0x7fb29403b000 comp rx=0 tx=0).stop 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- 172.21.15.5:0/1698200369 shutdown_connections 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492e1b10 0x55dc492de350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc492ff5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1698200369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492950a0 0x55dc492dbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- 172.21.15.5:0/1698200369 >> 172.21.15.5:0/1698200369 conn(0x55dc49292860 msgr2=0x55dc49290740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- 172.21.15.5:0/1698200369 shutdown_connections 2024-09-13T17:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- 172.21.15.5:0/1698200369 wait complete. 2024-09-13T17:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.195+0000 7fb2aeada740 1 -- start start 2024-09-13T17:13:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 Processor -- start 2024-09-13T17:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492950a0 0x55dc49293810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc49293d50 con 0x55dc492bc550 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc492ddda0 con 0x55dc492950a0 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.196+0000 7fb2aeada740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc492d6900 con 0x55dc492e1b10 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2aeada740 10 client.0 _ll_register_callbacks cb 0x7fb294035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59532/0 (socket says 172.21.15.5:59532) 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 -- 172.21.15.5:0/1796979970 learned_addr learned my addr 172.21.15.5:0/1796979970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492950a0 0x55dc49293810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2aa352640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 -- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 msgr2=0x55dc492b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 -- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492950a0 msgr2=0x55dc49293810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492950a0 0x55dc49293810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 -- 172.21.15.5:0/1796979970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc491844b0 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2a9350640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2940090b0 tx=0x7fb294004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed3508aab4ee80d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb284ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294058ea0 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb29403c890 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb294042070 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb29403ca50 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2aeada740 10 client.4806 fetch_fsmap learned FSMap version 9 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.197+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55dc491bdd00 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294042070 con 0x55dc492bc550 2024-09-13T17:13:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb29403cbb0 con 0x55dc492bc550 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 10 client.4806 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 20 client.4806 populate_metadata read hostname 'smithi005' 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492b5320 0x55dc492dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 4 client.4806 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 --> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc48f4fd10 con 0x55dc492b5320 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492b5320 0x55dc492dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb284ff9640 10 client.4806 ms_handle_connect on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.198+0000 7fb2a9b51640 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492b5320 0x55dc492dd0f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=883e9b20eb7d11d6 server_cookie=d269498cb315906e in_seq=0 out_seq=0 2024-09-13T17:13:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb284ff9640 1 -- 172.21.15.5:0/1796979970 <== mds.0 v2:172.21.15.179:6834/90966651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55dc48f4fd10 con 0x55dc492b5320 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb284ff9640 10 client.4806 handle_command_reply: tid=0 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 client.4806 shutdown 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 msgr2=0x55dc49347f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2940090b0 tx=0x7fb294004730 comp rx=0 tx=0).stop 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 shutdown_connections 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dc492e1b10 0x55dc492b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc492bc550 0x55dc49347f30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:6834/90966651,v1:172.21.15.179:6836/90966651] conn(0x55dc492b5320 0x55dc492dd0f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 --2- 172.21.15.5:0/1796979970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc492950a0 0x55dc49293810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb284ff9640 0 client.4806 ms_handle_reset on v2:172.21.15.179:6834/90966651 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 >> 172.21.15.5:0/1796979970 conn(0x55dc49292860 msgr2=0x55dc492dba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 shutdown_connections 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 1 -- 172.21.15.5:0/1796979970 wait complete. 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2aeada740 20 client.4806 trim_cache size 0 max 16384 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:13:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4276, 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 32.033185254000003, 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 9, 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 25, 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 37.805616276999999 2024-09-13T17:13:40.210 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 msgr2=0x7fb28806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 0x7fb28806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb294034000 tx=0x7fb29402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 msgr2=0x7fb2a41f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c7f0 tx=0x7fb2a000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 shutdown_connections 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2a415aaa0 0x7fb2a40ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2a4143740 0x7fb2a413da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb28806ac30 0x7fb28806d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.199+0000 7fb2abdb5640 1 --2- 172.21.15.5:0/1687593247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a4069e90 0x7fb2a41f11e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.200+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 >> 172.21.15.5:0/1687593247 conn(0x7fb2a40b4650 msgr2=0x7fb2a40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.200+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 shutdown_connections 2024-09-13T17:13:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.200+0000 7fb2abdb5640 1 -- 172.21.15.5:0/1687593247 wait complete. 2024-09-13T17:13:40.214 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:13:40.222 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:13:40.223 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:13:40.223 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:13:40.223 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T17:13:40.316 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T17:13:40.316 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T17:13:40.316 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T17:13:40.316 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:40.316 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:40.316 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-13T17:13:40.316 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:40.316 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:40.316 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T17:13:40.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:40.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:40.317 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-13T17:13:40.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:40.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:40.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.317 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:13:40.333 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T17:13:40.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:13:40.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-13T17:13:40.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.496 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:13:40.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.515 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-13T17:13:40.587 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-09-13T17:13:40.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:13:40.588 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T17:13:40.589 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:13:40.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:13:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.691+0000 7f3ab3072640 1 Processor -- start 2024-09-13T17:13:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.691+0000 7f3ab3072640 1 -- start start 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.692+0000 7f3ab3072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac0b1ac0 0x7f3aac15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.692+0000 7f3ab3072640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3aac06eed0 0x7f3aac06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.692+0000 7f3ab3072640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0b35f0 con 0x7f3aac06eaf0 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab3072640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac160020 con 0x7f3aac06eed0 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab3072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac156f50 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab0e0e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3aac06eaf0 0x7f3aac0b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33692/0 (socket says 172.21.15.5:33692) 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab0e0e640 1 -- 172.21.15.5:0/32460390 learned_addr learned my addr 172.21.15.5:0/32460390 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab160f640 1 --2- 172.21.15.5:0/32460390 >> v2:172.21.15.5:3300/0 conn(0x7f3aac06eed0 0x7f3aac06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3aabfff640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac0b1ac0 0x7f3aac15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3aab7fe640 1 -- 172.21.15.5:0/32460390 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660948573 0 0) 0x7f3aac0b35f0 con 0x7f3aac06eaf0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3aab7fe640 1 -- 172.21.15.5:0/32460390 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a94003520 con 0x7f3aac06eaf0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab160f640 1 -- 172.21.15.5:0/32460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac0b1ac0 msgr2=0x7f3aac15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab160f640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac0b1ac0 0x7f3aac15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab160f640 1 -- 172.21.15.5:0/32460390 >> v1:172.21.15.5:6789/0 conn(0x7f3aac06eaf0 legacy=0x7f3aac0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.693+0000 7f3ab160f640 1 -- 172.21.15.5:0/32460390 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0b1fa0 con 0x7f3aac06eed0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab160f640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac06eed0 0x7f3aac06aea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009d90 tx=0x7f3aa402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a2bceb3de183c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3aab7fe640 1 -- 172.21.15.5:0/32460390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4007740 con 0x7f3aac06eed0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3aab7fe640 1 -- 172.21.15.5:0/32460390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa402d050 con 0x7f3aac06eed0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3aab7fe640 1 -- 172.21.15.5:0/32460390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4007ac0 con 0x7f3aac06eed0 2024-09-13T17:13:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 -- 172.21.15.5:0/32460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac06eed0 msgr2=0x7f3aac06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac06eed0 0x7f3aac06aea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009d90 tx=0x7f3aa402a660 comp rx=0 tx=0).stop 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 -- 172.21.15.5:0/32460390 shutdown_connections 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac06eed0 0x7f3aac06aea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 --2- 172.21.15.5:0/32460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac0b1ac0 0x7f3aac15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.694+0000 7f3ab3072640 1 -- 172.21.15.5:0/32460390 >> 172.21.15.5:0/32460390 conn(0x7f3aac070af0 msgr2=0x7f3aac070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.695+0000 7f3ab3072640 1 -- 172.21.15.5:0/32460390 shutdown_connections 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.695+0000 7f3ab3072640 1 -- 172.21.15.5:0/32460390 wait complete. 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.696+0000 7f3ab3072640 1 Processor -- start 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.696+0000 7f3ab3072640 1 -- start start 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac06eaf0 0x7f3aac1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 0x7f3aac0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac146900 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac157a50 con 0x7f3aac06eed0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab3072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac157190 con 0x7f3aac06eaf0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59552/0 (socket says 172.21.15.5:59552) 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 -- 172.21.15.5:0/3578781130 learned_addr learned my addr 172.21.15.5:0/3578781130 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab0e0e640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac06eaf0 0x7f3aac1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3aabfff640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 0x7f3aac0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 -- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac06eaf0 msgr2=0x7f3aac1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac06eaf0 0x7f3aac1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 -- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 msgr2=0x7f3aac0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 0x7f3aac0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 -- 172.21.15.5:0/3578781130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa4009a70 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3aabfff640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 0x7f3aac0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3ab160f640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3aa402ac50 tx=0x7f3aa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.697+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa403c830 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.698+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa403c990 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.698+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa403cd00 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.698+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac15bf60 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.698+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac1576e0 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.699+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac1578a0 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.699+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3aa4031400 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.700+0000 7f3aa97fa640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.700+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3aa40ab0e0 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.700+0000 7f3ab0e0e640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.701+0000 7f3ab0e0e640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 0x7f3a9806d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0011e0 tx=0x7f3a9c007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.704+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3aa40760f0 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.909+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3aac0672e0 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.910+0000 7f3aa97fa640 1 -- 172.21.15.5:0/3578781130 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3aa403ce60 con 0x7f3aac0b1ac0 2024-09-13T17:13:40.911 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 msgr2=0x7f3a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 0x7f3a9806d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0011e0 tx=0x7f3a9c007d30 comp rx=0 tx=0).stop 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 msgr2=0x7f3aac157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3aa402ac50 tx=0x7f3aa4004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 shutdown_connections 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0b1ac0 0x7f3aac157ee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3aac06eed0 0x7f3aac0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 --2- 172.21.15.5:0/3578781130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3aac06eaf0 0x7f3aac1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 >> 172.21.15.5:0/3578781130 conn(0x7f3aac070af0 msgr2=0x7f3aac15f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 shutdown_connections 2024-09-13T17:13:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:40.912+0000 7f3ab3072640 1 -- 172.21.15.5:0/3578781130 wait complete. 2024-09-13T17:13:40.923 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:13:40.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:40.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:40.924 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:13:40.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.924 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:13:40.940 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:40.940 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:40.940 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:40.940 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:40.940 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:13:40.941 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:40.942 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:40.942 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:40.942 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:13:40.942 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:13:40.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:40.942 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:40.942 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:40.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:13:40.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-09-13T17:13:40.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-09-13T17:13:40.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:13:40.943 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:41.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.042 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:41.067 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:13:41.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.069 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:13:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:13:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:13:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:13:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:41.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:13:41.127 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:41.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.215 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:13:41.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.231 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-13T17:13:41.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.288 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:41.288 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:41.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:13:41.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:13:41.288 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:41.367 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:13:41.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:13:41.368 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:41.484 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:41.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:13:41.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:13:41.485 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:41.523 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:13:41.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:41.524 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:41.580 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:13:41.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:41.580 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:41.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:41.702 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:41.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:41.768 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:41.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.769 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:41.825 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:13:41.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:13:41.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:41.892 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:41.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:41.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:13:41.950+0000 7fb615f56480 -1 init, newargv = 0x556beec45100 newargc=15 2024-09-13T17:13:41.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[46313]: starting ceph client 2024-09-13T17:13:41.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[46313]: starting fuse 2024-09-13T17:13:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:41.962 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:41.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:41.963 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:42.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:13:42.019 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:13:42.019 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:13:42.020 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:42.021 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:42.022 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:13:42.022 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:13:42.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:13:42.138 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.46313.asok 2024-09-13T17:13:42.325 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46313.asok 2024-09-13T17:13:42.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:42.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46313.asok status 2024-09-13T17:13:42.464 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:13:42.464 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:13:42.464 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "46313", 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4824, 2024-09-13T17:13:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4824 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1752524697 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1752524697 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4824 192.168.0.1:0/1752524697", 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/1752524697", 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 9, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 25, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:13:42.467 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:13:42.473 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:13:42.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:13:42.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.579+0000 7f5b8f733640 1 Processor -- start 2024-09-13T17:13:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 -- start start 2024-09-13T17:13:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b8815c810 0x7f5b880cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b880d06d0 0x7f5b880b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880b4f30 con 0x7f5b880b4b20 2024-09-13T17:13:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880d1e80 con 0x7f5b880d06d0 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8f733640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880d1750 con 0x7f5b8815c810 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.580+0000 7f5b8ccce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b880d06d0 0x7f5b880b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b880d06d0 0x7f5b880b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59562/0 (socket says 172.21.15.5:59562) 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 -- 172.21.15.5:0/3345918854 learned_addr learned my addr 172.21.15.5:0/3345918854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8d4cf640 1 --2- 172.21.15.5:0/3345918854 >> v2:172.21.15.179:3300/0 conn(0x7f5b8815c810 0x7f5b880cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 -- 172.21.15.5:0/3345918854 >> v2:172.21.15.179:3300/0 conn(0x7f5b8815c810 msgr2=0x7f5b880cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 --2- 172.21.15.5:0/3345918854 >> v2:172.21.15.179:3300/0 conn(0x7f5b8815c810 0x7f5b880cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 -- 172.21.15.5:0/3345918854 >> v1:172.21.15.179:6789/0 conn(0x7f5b880b4b20 legacy=0x7f5b880d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.581+0000 7f5b8ccce640 1 -- 172.21.15.5:0/3345918854 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880d0bd0 con 0x7f5b880d06d0 2024-09-13T17:13:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b8ccce640 1 --2- 172.21.15.5:0/3345918854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880b45e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b88072540 tx=0x7f5b7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55234bdbac06df86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b7bfff640 1 -- 172.21.15.5:0/3345918854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c032440 con 0x7f5b880d06d0 2024-09-13T17:13:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b7bfff640 1 -- 172.21.15.5:0/3345918854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0325a0 con 0x7f5b880d06d0 2024-09-13T17:13:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b7bfff640 1 -- 172.21.15.5:0/3345918854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c032930 con 0x7f5b880d06d0 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b8f733640 1 -- 172.21.15.5:0/3345918854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 msgr2=0x7f5b880b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.582+0000 7f5b8f733640 1 --2- 172.21.15.5:0/3345918854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880b45e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b88072540 tx=0x7f5b7c02a270 comp rx=0 tx=0).stop 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 -- 172.21.15.5:0/3345918854 shutdown_connections 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 --2- 172.21.15.5:0/3345918854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880b45e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 --2- 172.21.15.5:0/3345918854 >> v2:172.21.15.179:3300/0 conn(0x7f5b8815c810 0x7f5b880cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 -- 172.21.15.5:0/3345918854 >> 172.21.15.5:0/3345918854 conn(0x7f5b880717a0 msgr2=0x7f5b88071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 -- 172.21.15.5:0/3345918854 shutdown_connections 2024-09-13T17:13:42.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.583+0000 7f5b8f733640 1 -- 172.21.15.5:0/3345918854 wait complete. 2024-09-13T17:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.584+0000 7f5b8f733640 1 Processor -- start 2024-09-13T17:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.584+0000 7f5b8f733640 1 -- start start 2024-09-13T17:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b4b20 0x7f5b8814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 0x7f5b880a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8814c100 con 0x7f5b880d06d0 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88157e70 con 0x7f5b8815c810 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8f733640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88157260 con 0x7f5b880b4b20 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59564/0 (socket says 172.21.15.5:59564) 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 -- 172.21.15.5:0/986473679 learned_addr learned my addr 172.21.15.5:0/986473679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8d4cf640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b4b20 0x7f5b8814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8dcd0640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 0x7f5b880a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 -- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b4b20 msgr2=0x7f5b8814bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b4b20 0x7f5b8814bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 -- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 msgr2=0x7f5b880a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 0x7f5b880a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 -- 172.21.15.5:0/986473679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0094d0 con 0x7f5b880d06d0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8dcd0640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 0x7f5b880a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b8ccce640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c02a2b0 tx=0x7f5b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.585+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c032440 con 0x7f5b880d06d0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.586+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c030ba0 con 0x7f5b880d06d0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.586+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b88157540 con 0x7f5b880d06d0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.586+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c03d440 con 0x7f5b880d06d0 2024-09-13T17:13:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.586+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b88157b00 con 0x7f5b880d06d0 2024-09-13T17:13:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.587+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880672a0 con 0x7f5b880d06d0 2024-09-13T17:13:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.587+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b7c039040 con 0x7f5b880d06d0 2024-09-13T17:13:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.588+0000 7f5b79ffb640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.588+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b7c0aa190 con 0x7f5b880d06d0 2024-09-13T17:13:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.588+0000 7f5b8d4cf640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.589+0000 7f5b8d4cf640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b84006fd0 tx=0x7f5b84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.596+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5b7c075070 con 0x7f5b880d06d0 2024-09-13T17:13:42.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.803+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b880b6a50 con 0x7f5b880d06d0 2024-09-13T17:13:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.804+0000 7f5b79ffb640 1 -- 172.21.15.5:0/986473679 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5b7c078690 con 0x7f5b880d06d0 2024-09-13T17:13:42.805 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:42.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 msgr2=0x7f5b6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b84006fd0 tx=0x7f5b84008040 comp rx=0 tx=0).stop 2024-09-13T17:13:42.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 msgr2=0x7f5b880a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c02a2b0 tx=0x7f5b7c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 shutdown_connections 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b8815c810 0x7f5b880a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5b6c06ac00 0x7f5b6c06d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b880d06d0 0x7f5b880a9140 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 --2- 172.21.15.5:0/986473679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b4b20 0x7f5b8814bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 >> 172.21.15.5:0/986473679 conn(0x7f5b880717a0 msgr2=0x7f5b880730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 shutdown_connections 2024-09-13T17:13:42.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:42.806+0000 7f5b8f733640 1 -- 172.21.15.5:0/986473679 wait complete. 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:42.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:13:42.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:42.819 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42707sec preferred_lft 42707sec 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:42.836 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:42.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:42.838 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:42.899 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:13:42.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:42.901 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:42.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:13:42.959 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.047 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:13:43.063 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:13:43.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.064 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-13T17:13:43.119 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T17:13:43.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:43.120 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:43.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:13:43.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T17:13:43.120 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:43.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:19:ab:4b:3a:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.266 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2419:abff:fe4b:3aec/64 scope link 2024-09-13T17:13:43.267 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 26:19:ab:4b:3a:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::2419:abff:fe4b:3aec/64 scope link 2024-09-13T17:13:43.334 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:43.336 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T17:13:43.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T17:13:43.336 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:43.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.453 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:13:43.453 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:13:43.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2024-09-13T17:13:43.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:13:43.453 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:13:43.492 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-13T17:13:43.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:43.492 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:43.553 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:13:43.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:43.553 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:43.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:43.676 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:43.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:43.741 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:43.743 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:43.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.743 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:43.800 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:13:43.800 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-13T17:13:43.800 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-13T17:13:43.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:13:43.868 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:43.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:43.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi005.stderr:2024-09-13T17:13:43.925+0000 7f54c937a480 -1 init, newargv = 0x5567a4cc60f0 newargc=15 2024-09-13T17:13:43.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi005.stderr:ceph-fuse[46838]: starting ceph client 2024-09-13T17:13:43.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi005.stderr:ceph-fuse[46838]: starting fuse 2024-09-13T17:13:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:43.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:43.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:43.938 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:13:43.993 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:13:43.994 INFO:teuthology.orchestra.run.smithi005.stdout:44 2024-09-13T17:13:43.994 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:13:43.994 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:43.995 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.2")) 2024-09-13T17:13:43.996 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:13:44.110 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.2.46838.asok 2024-09-13T17:13:44.296 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46838.asok 2024-09-13T17:13:44.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46838.asok status 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "2", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "46838", 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:13:44.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4836, 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4836 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:44.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:44.436 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:13:44.436 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2471022071 2024-09-13T17:13:44.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2471022071 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4836 192.168.0.2:0/2471022071", 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.2:0/2471022071", 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 9, 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 25, 2024-09-13T17:13:44.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:44.438 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:13:44.438 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:13:44.438 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:13:44.442 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:13:44.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:13:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.543+0000 7fc77b2c9640 1 Processor -- start 2024-09-13T17:13:44.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.543+0000 7fc77b2c9640 1 -- start start 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc77b2c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 0x7fc77406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc77b2c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77406d410 con 0x7fc7740ab770 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc77b2c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77406cb70 con 0x7fc77406c320 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc77b2c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77406ce50 con 0x7fc77415a3e0 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc779866640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7740ab770 0x7fc7740b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45192/0 (socket says 172.21.15.5:45192) 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc779866640 1 -- 172.21.15.5:0/2525802431 learned_addr learned my addr 172.21.15.5:0/2525802431 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc779065640 1 --2- 172.21.15.5:0/2525802431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 0x7fc77406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113582184 0 0) 0x7fc77406d410 con 0x7fc7740ab770 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.544+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc760003520 con 0x7fc7740ab770 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783194606 0 0) 0x7fc77406cb70 con 0x7fc77406c320 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc77406d410 con 0x7fc77406c320 2024-09-13T17:13:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc779065640 1 -- 172.21.15.5:0/2525802431 >> v1:172.21.15.179:6789/0 conn(0x7fc77406c320 legacy=0x7fc7740ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165751402 0 0) 0x7fc760003520 con 0x7fc7740ab770 2024-09-13T17:13:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc779065640 1 -- 172.21.15.5:0/2525802431 >> v1:172.21.15.5:6789/0 conn(0x7fc7740ab770 legacy=0x7fc7740b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc779065640 1 -- 172.21.15.5:0/2525802431 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77406d130 con 0x7fc77415a3e0 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.545+0000 7fc779065640 1 --2- 172.21.15.5:0/2525802431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 0x7fc77406e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7700097d0 tx=0x7fc77002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b123d5688ab58b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0019f0 con 0x7fc77415a3e0 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77002ac30 con 0x7fc77415a3e0 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc76bfff640 1 -- 172.21.15.5:0/2525802431 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770032440 con 0x7fc77415a3e0 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2525802431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 msgr2=0x7fc77406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2525802431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 0x7fc77406e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7700097d0 tx=0x7fc77002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2525802431 shutdown_connections 2024-09-13T17:13:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2525802431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77415a3e0 0x7fc77406e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2525802431 >> 172.21.15.5:0/2525802431 conn(0x7fc7740ce0d0 msgr2=0x7fc7740ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2525802431 shutdown_connections 2024-09-13T17:13:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.546+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2525802431 wait complete. 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.547+0000 7fc77b2c9640 1 Processor -- start 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 -- start start 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77406c320 0x7fc774148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77415a3e0 0x7fc774158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774098170 con 0x7fc7740ab770 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77409bbd0 con 0x7fc77415a3e0 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc77b2c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc774157b90 con 0x7fc77406c320 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc778864640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc778864640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56364/0 (socket says 172.21.15.5:56364) 2024-09-13T17:13:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc778864640 1 -- 172.21.15.5:0/2406684843 learned_addr learned my addr 172.21.15.5:0/2406684843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc779065640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77406c320 0x7fc774148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.548+0000 7fc779866640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77415a3e0 0x7fc774158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 -- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77406c320 msgr2=0x7fc774148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77406c320 0x7fc774148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 -- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77415a3e0 msgr2=0x7fc774158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77415a3e0 0x7fc774158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 -- 172.21.15.5:0/2406684843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009400 con 0x7fc7740ab770 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc778864640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c450 tx=0x7fc76400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640052d0 con 0x7fc7740ab770 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764005430 con 0x7fc7740ab770 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc774157e70 con 0x7fc7740ab770 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764012870 con 0x7fc7740ab770 2024-09-13T17:13:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.549+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7740986a0 con 0x7fc7740ab770 2024-09-13T17:13:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.550+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7740988c0 con 0x7fc7740ab770 2024-09-13T17:13:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.551+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7640129d0 con 0x7fc7740ab770 2024-09-13T17:13:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.551+0000 7fc769ffb640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.551+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc764088fe0 con 0x7fc7740ab770 2024-09-13T17:13:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.552+0000 7fc779065640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.552+0000 7fc779065640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 0x7fc75806d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc770034000 tx=0x7fc77002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.555+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc7640540d0 con 0x7fc7740ab770 2024-09-13T17:13:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.762+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7740672a0 con 0x7fc7740ab770 2024-09-13T17:13:44.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.763+0000 7fc769ffb640 1 -- 172.21.15.5:0/2406684843 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc7640576f0 con 0x7fc7740ab770 2024-09-13T17:13:44.765 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 msgr2=0x7fc75806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 0x7fc75806d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc770034000 tx=0x7fc77002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 msgr2=0x7fc774158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c450 tx=0x7fc76400c910 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 shutdown_connections 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77415a3e0 0x7fc774158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7740ab770 0x7fc774158a40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 --2- 172.21.15.5:0/2406684843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77406c320 0x7fc774148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 >> 172.21.15.5:0/2406684843 conn(0x7fc7740ce0d0 msgr2=0x7fc7740af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 shutdown_connections 2024-09-13T17:13:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:44.765+0000 7fc77b2c9640 1 -- 172.21.15.5:0/2406684843 wait complete. 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:44.777 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:13:44.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:44.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:44.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:13:44.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.778 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:13:44.797 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:44.797 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:44.797 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:44.798 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:44.799 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:13:44.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.799 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:13:44.800 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:45.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.064 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:45.090 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:13:45.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.092 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:13:45.170 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:13:45.171 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:45.171 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:13:45.171 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:13:45.171 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:45.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.171 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:45.171 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:45.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:13:45.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:13:45.172 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:13:45.172 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:45.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.429 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:13:45.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.444 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-09-13T17:13:45.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.499 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:45.499 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:45.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:13:45.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T17:13:45.499 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:45.577 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T17:13:45.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T17:13:45.578 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:45.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.702 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:45.702 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:45.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:13:45.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:13:45.703 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:45.739 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:13:45.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:45.739 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:45.794 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:13:45.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:45.795 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:45.850 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:13:45.915 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:45.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:45.979 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:45.980 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:45.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:45.981 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:13:46.036 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:13:46.036 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:13:46.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:13:46.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:46.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:46.168 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:46.169 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:46.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:46.170 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:13:46.170 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:13:46.169+0000 7f7924a0b480 -1 init, newargv = 0x55da6f1cafb0 newargc=15 2024-09-13T17:13:46.171 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[42609]: starting ceph client 2024-09-13T17:13:46.175 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[42609]: starting fuse 2024-09-13T17:13:46.190 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:13:46.190 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:46.190 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:46.191 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:13:46.192 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:13:46.303 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.42609.asok 2024-09-13T17:13:46.490 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42609.asok 2024-09-13T17:13:46.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:46.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42609.asok status 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "42609", 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:13:46.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4834, 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 4834 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1330607197 2024-09-13T17:13:46.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1330607197 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.4834 192.168.0.1:0/1330607197", 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/1330607197", 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 9, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 25, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:13:46.626 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:13:46.632 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:13:46.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:13:46.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 Processor -- start 2024-09-13T17:13:46.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 -- start start 2024-09-13T17:13:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f663015c810 0x7f66300cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300d1e80 con 0x7f66300b4cf0 2024-09-13T17:13:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300d1750 con 0x7f66300d06d0 2024-09-13T17:13:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.746+0000 7f6636f9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66300d0bd0 con 0x7f663015c810 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f6635539640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f66300b4cf0 0x7f66300b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45194/0 (socket says 172.21.15.5:45194) 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f6635539640 1 -- 172.21.15.5:0/2666584942 learned_addr learned my addr 172.21.15.5:0/2666584942 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f6634d38640 1 --2- 172.21.15.5:0/2666584942 >> v2:172.21.15.179:3300/0 conn(0x7f663015c810 0x7f66300cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958702003 0 0) 0x7f66300d1e80 con 0x7f66300b4cf0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6618003520 con 0x7f66300b4cf0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309976824 0 0) 0x7f6618003520 con 0x7f66300b4cf0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 >> v2:172.21.15.179:3300/0 conn(0x7f663015c810 msgr2=0x7f66300cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 --2- 172.21.15.5:0/2666584942 >> v2:172.21.15.179:3300/0 conn(0x7f663015c810 0x7f66300cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 >> v1:172.21.15.179:6789/0 conn(0x7f66300d06d0 legacy=0x7f66300b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300d0eb0 con 0x7f66300b4cf0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f66280019f0 con 0x7f66300b4cf0 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 >> v1:172.21.15.5:6789/0 conn(0x7f66300b4cf0 legacy=0x7f66300b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 0x7f6618003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6618004370 0x7f6618004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618005040 0x7f661800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300d0bd0 con 0x7f6618004370 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661800bfa0 con 0x7f6618003970 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661800c160 con 0x7f6618005040 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f662ffff640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6618004370 0x7f6618004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.747+0000 7f6634d38640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 0x7f6618003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6635539640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618005040 0x7f661800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6634d38640 1 -- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618005040 msgr2=0x7f661800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6634d38640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618005040 0x7f661800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6634d38640 1 -- 172.21.15.5:0/2666584942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6618004370 msgr2=0x7f6618004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6634d38640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6618004370 0x7f6618004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6634d38640 1 -- 172.21.15.5:0/2666584942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618003520 con 0x7f6618003970 2024-09-13T17:13:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f662ffff640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6618004370 0x7f6618004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6635539640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618005040 0x7f661800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.748+0000 7f6635539640 1 -- 172.21.15.5:0/2666584942 reap_dead start 2024-09-13T17:13:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6634d38640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 0x7f6618003d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6620009ac0 tx=0x7f66180057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d302cfbbef20a947 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620031400 con 0x7f6618003970 2024-09-13T17:13:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662002d050 con 0x7f6618003970 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f662f7fe640 1 -- 172.21.15.5:0/2666584942 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620031780 con 0x7f6618003970 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 -- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 msgr2=0x7f6618003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 0x7f6618003d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6620009ac0 tx=0x7f66180057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 -- 172.21.15.5:0/2666584942 shutdown_connections 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 --2- 172.21.15.5:0/2666584942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6618003970 0x7f6618003d50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 -- 172.21.15.5:0/2666584942 >> 172.21.15.5:0/2666584942 conn(0x7f66300717a0 msgr2=0x7f6630071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 -- 172.21.15.5:0/2666584942 shutdown_connections 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.749+0000 7f6636f9c640 1 -- 172.21.15.5:0/2666584942 wait complete. 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.751+0000 7f6636f9c640 1 Processor -- start 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.751+0000 7f6636f9c640 1 -- start start 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.751+0000 7f6636f9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618003970 0x7f6630152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6630155890 0x7f6630151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6630153d30 con 0x7f66301f5180 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66301f5b70 con 0x7f6630155890 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66301530b0 con 0x7f6618003970 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56376/0 (socket says 172.21.15.5:56376) 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 -- 172.21.15.5:0/4136599315 learned_addr learned my addr 172.21.15.5:0/4136599315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6634d38640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618003970 0x7f6630152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f662ffff640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6630155890 0x7f6630151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 -- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618003970 msgr2=0x7f6630152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618003970 0x7f6630152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 -- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6630155890 msgr2=0x7f6630151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6630155890 0x7f6630151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 -- 172.21.15.5:0/4136599315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6630153390 con 0x7f66301f5180 2024-09-13T17:13:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6635539640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f663008bab0 tx=0x7f662800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800eb90 con 0x7f66301f5180 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6630153670 con 0x7f66301f5180 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800ecf0 con 0x7f66301f5180 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628013640 con 0x7f66301f5180 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.752+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6630154150 con 0x7f66301f5180 2024-09-13T17:13:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.754+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66301542e0 con 0x7f66301f5180 2024-09-13T17:13:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.754+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f66280137a0 con 0x7f66301f5180 2024-09-13T17:13:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.754+0000 7f662d7fa640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 0x7f661c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.755+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6628089730 con 0x7f66301f5180 2024-09-13T17:13:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.755+0000 7f6634d38640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 0x7f661c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.755+0000 7f6634d38640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 0x7f661c06d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6620033000 tx=0x7f6620008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:46.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.759+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6628054650 con 0x7f66301f5180 2024-09-13T17:13:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.963+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6630153e70 con 0x7f66301f5180 2024-09-13T17:13:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.963+0000 7f662d7fa640 1 -- 172.21.15.5:0/4136599315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6630153e70 con 0x7f66301f5180 2024-09-13T17:13:46.965 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 msgr2=0x7f661c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 0x7f661c06d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6620033000 tx=0x7f6620008030 comp rx=0 tx=0).stop 2024-09-13T17:13:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 msgr2=0x7f66301f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f663008bab0 tx=0x7f662800e530 comp rx=0 tx=0).stop 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 shutdown_connections 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f661c06ac30 0x7f661c06d0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66301f5180 0x7f66301f5630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6630155890 0x7f6630151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 --2- 172.21.15.5:0/4136599315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6618003970 0x7f6630152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 >> 172.21.15.5:0/4136599315 conn(0x7f66300717a0 msgr2=0x7f663015d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 shutdown_connections 2024-09-13T17:13:46.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:46.965+0000 7f6636f9c640 1 -- 172.21.15.5:0/4136599315 wait complete. 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:46.977 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:13:46.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:46.978 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:13:46.994 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:46.994 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:46.994 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:46.994 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.994 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:13:46.995 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link tentative 2024-09-13T17:13:46.996 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:46.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:46.997 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:47.058 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:13:47.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.061 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:13:47.116 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:13:47.116 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:47.116 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:13:47.116 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:13:47.116 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:47.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:13:47.117 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:47.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.203 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:13:47.218 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:13:47.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.219 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-09-13T17:13:47.274 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T17:13:47.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.274 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:47.274 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:47.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:13:47.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T17:13:47.274 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:47.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:13:47.416 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether c2:88:09:59:10:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c088:9ff:fe59:1079/64 scope link 2024-09-13T17:13:47.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether c2:88:09:59:10:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:13:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:13:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::c088:9ff:fe59:1079/64 scope link 2024-09-13T17:13:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.487 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T17:13:47.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T17:13:47.488 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:47.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.598 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:13:47.598 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:13:47.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2024-09-13T17:13:47.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:13:47.598 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:13:47.635 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-13T17:13:47.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:47.635 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:47.690 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:13:47.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:47.691 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:47.745 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:13:47.811 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:47.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:47.875 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:47.876 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:47.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.877 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:13:47.932 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:13:47.933 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-13T17:13:47.933 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-13T17:13:47.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:13:48.000 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:48.000 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:48.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:2024-09-13T17:13:48.055+0000 7fe539ee7480 -1 init, newargv = 0x555e6bf95190 newargc=15 2024-09-13T17:13:48.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:ceph-fuse[43059]: starting ceph client 2024-09-13T17:13:48.061 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi179.stderr:ceph-fuse[43059]: starting fuse 2024-09-13T17:13:48.065 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:48.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:48.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.068 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:13:48.125 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:13:48.125 INFO:teuthology.orchestra.run.smithi179.stdout:44 2024-09-13T17:13:48.125 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:13:48.126 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.3")) 2024-09-13T17:13:48.127 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:13:48.240 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.3.43059.asok 2024-09-13T17:13:48.427 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43059.asok 2024-09-13T17:13:48.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43059.asok status 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "3", 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:13:48.560 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "43059", 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4658, 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 4658 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:13:48.561 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 2677514477 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.2:0", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 2677514477 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.4658 192.168.0.2:0/2677514477", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.2:0/2677514477", 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:13:48.562 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 9, 2024-09-13T17:13:48.563 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 25, 2024-09-13T17:13:48.563 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:48.563 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:13:48.563 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:13:48.563 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:13:48.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.568 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:13:48.568 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.589 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:13:48.590 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.661 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:13:48.661 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:48.721 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:13:48.721 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:48.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:13:48.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.790 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:13:48.790 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:48.806 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:13:48.807 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:48.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.807 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:13:48.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.872 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:13:48.872 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:48.928 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:13:48.928 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:48.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.928 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:13:48.992 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T17:13:49.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:49.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.125+0000 7f3000108640 1 Processor -- start 2024-09-13T17:13:49.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.126+0000 7f3000108640 1 -- start start 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.126+0000 7f3000108640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ff80ce1f0 0x7f2ff81674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.126+0000 7f3000108640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80b0be0 con 0x7f2ff815fb90 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.126+0000 7f3000108640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80affd0 con 0x7f2ff815ff70 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.126+0000 7f3000108640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80b02b0 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffe6a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ff80ce1f0 0x7f2ff81674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffdea4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ff815fb90 0x7f2ff80b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45200/0 (socket says 172.21.15.5:45200) 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffdea4640 1 -- 172.21.15.5:0/3765464322 learned_addr learned my addr 172.21.15.5:0/3765464322 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffe6a5640 1 -- 172.21.15.5:0/3765464322 >> v1:172.21.15.179:6789/0 conn(0x7f2ff815ff70 legacy=0x7f2ff80b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffe6a5640 1 -- 172.21.15.5:0/3765464322 >> v1:172.21.15.5:6789/0 conn(0x7f2ff815fb90 legacy=0x7f2ff80b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.127+0000 7f2ffe6a5640 1 -- 172.21.15.5:0/3765464322 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80b0590 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f2ffe6a5640 1 --2- 172.21.15.5:0/3765464322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff80ce1f0 0x7f2ff81674e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009d90 tx=0x7f2ff002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3a5ead9b54d625 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f2ffcea2640 1 -- 172.21.15.5:0/3765464322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0007740 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f2ffcea2640 1 -- 172.21.15.5:0/3765464322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff002d050 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f2ffcea2640 1 -- 172.21.15.5:0/3765464322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0007ac0 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f3000108640 1 -- 172.21.15.5:0/3765464322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff80ce1f0 msgr2=0x7f2ff81674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f3000108640 1 --2- 172.21.15.5:0/3765464322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff80ce1f0 0x7f2ff81674e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009d90 tx=0x7f2ff002a6f0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f3000108640 1 -- 172.21.15.5:0/3765464322 shutdown_connections 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f3000108640 1 --2- 172.21.15.5:0/3765464322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff80ce1f0 0x7f2ff81674e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.128+0000 7f3000108640 1 -- 172.21.15.5:0/3765464322 >> 172.21.15.5:0/3765464322 conn(0x7f2ff8089f90 msgr2=0x7f2ff80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.129+0000 7f3000108640 1 -- 172.21.15.5:0/3765464322 shutdown_connections 2024-09-13T17:13:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.129+0000 7f3000108640 1 -- 172.21.15.5:0/3765464322 wait complete. 2024-09-13T17:13:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 Processor -- start 2024-09-13T17:13:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 -- start start 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff80ce1f0 0x7f2ff80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815ff70 0x7f2ff815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815d670 con 0x7f2ff815fb90 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff81f2660 con 0x7f2ff815ff70 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.130+0000 7f3000108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff81f2940 con 0x7f2ff80ce1f0 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56396/0 (socket says 172.21.15.5:56396) 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 -- 172.21.15.5:0/3661632312 learned_addr learned my addr 172.21.15.5:0/3661632312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffe6a5640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815ff70 0x7f2ff815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffdea4640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff80ce1f0 0x7f2ff80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 -- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff80ce1f0 msgr2=0x7f2ff80b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff80ce1f0 0x7f2ff80b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 -- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815ff70 msgr2=0x7f2ff815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815ff70 0x7f2ff815d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 -- 172.21.15.5:0/3661632312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009a70 con 0x7f2ff815fb90 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2ffd6a3640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c450 tx=0x7f2fe800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80052d0 con 0x7f2ff815fb90 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8005450 con 0x7f2ff815fb90 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8003880 con 0x7f2ff815fb90 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff81f2c20 con 0x7f2ff815fb90 2024-09-13T17:13:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.131+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff81f31e0 con 0x7f2ff815fb90 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.132+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80b5350 con 0x7f2ff815fb90 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.133+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fe80039e0 con 0x7f2ff815fb90 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.133+0000 7f2fee7fc640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 0x7f2fdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.133+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fe8089080 con 0x7f2ff815fb90 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.134+0000 7f2ffdea4640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 0x7f2fdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.134+0000 7f2ffdea4640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 0x7f2fdc06d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005880 tx=0x7f2ff4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.138+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2fe8054020 con 0x7f2ff815fb90 2024-09-13T17:13:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.310+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff80b6ce0 con 0x7f2ff815fb90 2024-09-13T17:13:49.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.311+0000 7f2fee7fc640 1 -- 172.21.15.5:0/3661632312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f2fe8057640 con 0x7f2ff815fb90 2024-09-13T17:13:49.313 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:49.313 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 msgr2=0x7f2fdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 0x7f2fdc06d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005880 tx=0x7f2ff4009040 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 msgr2=0x7f2ff809fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c450 tx=0x7f2fe800c910 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 shutdown_connections 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff815ff70 0x7f2ff815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fdc06ac00 0x7f2fdc06d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ff815fb90 0x7f2ff809fda0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 --2- 172.21.15.5:0/3661632312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff80ce1f0 0x7f2ff80b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 >> 172.21.15.5:0/3661632312 conn(0x7f2ff8089f90 msgr2=0x7f2ff80b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.313+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 shutdown_connections 2024-09-13T17:13:49.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.314+0000 7f3000108640 1 -- 172.21.15.5:0/3661632312 wait complete. 2024-09-13T17:13:49.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:49.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.430+0000 7fbca74d7640 1 Processor -- start 2024-09-13T17:13:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.430+0000 7fbca74d7640 1 -- start start 2024-09-13T17:13:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca74d7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbca00abe60 0x7fbca00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca74d7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00ad050 con 0x7fbca006da30 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca74d7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca00ac440 con 0x7fbca01591e0 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca74d7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca00ac720 con 0x7fbca00abe60 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca5a74640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbca006da30 0x7fbca00700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45210/0 (socket says 172.21.15.5:45210) 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca5a74640 1 -- 172.21.15.5:0/171313411 learned_addr learned my addr 172.21.15.5:0/171313411 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca4a72640 1 --2- 172.21.15.5:0/171313411 >> v2:172.21.15.179:3300/0 conn(0x7fbca00abe60 0x7fbca00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825484446 0 0) 0x7fbca00ad050 con 0x7fbca006da30 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc88005730 con 0x7fbca006da30 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca4a72640 1 -- 172.21.15.5:0/171313411 >> v1:172.21.15.179:6789/0 conn(0x7fbca01591e0 legacy=0x7fbca00ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921757540 0 0) 0x7fbca00ac440 con 0x7fbca01591e0 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca4a72640 1 -- 172.21.15.5:0/171313411 >> v1:172.21.15.5:6789/0 conn(0x7fbca006da30 legacy=0x7fbca00700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.431+0000 7fbca4a72640 1 -- 172.21.15.5:0/171313411 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00aca00 con 0x7fbca00abe60 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.432+0000 7fbca4a72640 1 --2- 172.21.15.5:0/171313411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00abe60 0x7fbca00b1b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097a0 tx=0x7fbc9402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21826ced6d71692d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.432+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032440 con 0x7fbca00abe60 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.432+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc940325a0 con 0x7fbca00abe60 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.432+0000 7fbc9ffff640 1 -- 172.21.15.5:0/171313411 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032930 con 0x7fbca00abe60 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 -- 172.21.15.5:0/171313411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00abe60 msgr2=0x7fbca00b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 --2- 172.21.15.5:0/171313411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00abe60 0x7fbca00b1b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097a0 tx=0x7fbc9402a230 comp rx=0 tx=0).stop 2024-09-13T17:13:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 -- 172.21.15.5:0/171313411 shutdown_connections 2024-09-13T17:13:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 --2- 172.21.15.5:0/171313411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca00abe60 0x7fbca00b1b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 -- 172.21.15.5:0/171313411 >> 172.21.15.5:0/171313411 conn(0x7fbca00ce130 msgr2=0x7fbca00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 -- 172.21.15.5:0/171313411 shutdown_connections 2024-09-13T17:13:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.433+0000 7fbca74d7640 1 -- 172.21.15.5:0/171313411 wait complete. 2024-09-13T17:13:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.434+0000 7fbca74d7640 1 Processor -- start 2024-09-13T17:13:49.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.434+0000 7fbca74d7640 1 -- start start 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca006da30 0x7fbca01437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00abe60 0x7fbca01ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0141c90 con 0x7fbca01591e0 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0143cf0 con 0x7fbca006da30 2024-09-13T17:13:49.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca74d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0141080 con 0x7fbca00abe60 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56402/0 (socket says 172.21.15.5:56402) 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 -- 172.21.15.5:0/821311890 learned_addr learned my addr 172.21.15.5:0/821311890 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5273640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca006da30 0x7fbca01437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca4a72640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00abe60 0x7fbca01ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 -- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00abe60 msgr2=0x7fbca01ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00abe60 0x7fbca01ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 -- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca006da30 msgr2=0x7fbca01437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca006da30 0x7fbca01437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 -- 172.21.15.5:0/821311890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94009400 con 0x7fbca01591e0 2024-09-13T17:13:49.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.435+0000 7fbca5a74640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c430 tx=0x7fbc9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.436+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98005ce0 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.436+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98005e40 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.436+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98007310 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.436+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca0141360 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.436+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca0141920 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.437+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca00672a0 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.437+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc98007470 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.437+0000 7fbc9dffb640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 0x7fbc8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.438+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc98088bf0 con 0x7fbca01591e0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.438+0000 7fbca5273640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 0x7fbc8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.438+0000 7fbca5273640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 0x7fbc8c06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbc900012e0 tx=0x7fbc90009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.442+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc98053c20 con 0x7fbca01591e0 2024-09-13T17:13:49.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.610+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbca006e130 con 0x7fbca01591e0 2024-09-13T17:13:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.611+0000 7fbc9dffb640 1 -- 172.21.15.5:0/821311890 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc980170a0 con 0x7fbca01591e0 2024-09-13T17:13:49.612 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 msgr2=0x7fbc8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 0x7fbc8c06d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbc900012e0 tx=0x7fbc90009040 comp rx=0 tx=0).stop 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 msgr2=0x7fbca009a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c430 tx=0x7fbc9800c8f0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 shutdown_connections 2024-09-13T17:13:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8c06ac00 0x7fbc8c06d0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca01591e0 0x7fbca009a080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbca00abe60 0x7fbca01ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 --2- 172.21.15.5:0/821311890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbca006da30 0x7fbca01437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 >> 172.21.15.5:0/821311890 conn(0x7fbca00ce130 msgr2=0x7fbca0154670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 shutdown_connections 2024-09-13T17:13:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.613+0000 7fbca74d7640 1 -- 172.21.15.5:0/821311890 wait complete. 2024-09-13T17:13:49.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.728+0000 7fd14559c640 1 Processor -- start 2024-09-13T17:13:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.728+0000 7fd14559c640 1 -- start start 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.729+0000 7fd14559c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd14015fce0 0x7fd1400cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.729+0000 7fd14559c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400d13f0 0x7fd1400b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.729+0000 7fd14559c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400ce590 con 0x7fd1400b1230 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.729+0000 7fd14559c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400b4fc0 con 0x7fd14015fce0 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.729+0000 7fd14559c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400ccd80 con 0x7fd1400d13f0 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd14015fce0 0x7fd1400cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd14015fce0 0x7fd1400cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56416/0 (socket says 172.21.15.5:56416) 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1400b1230 0x7fd1400b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45220/0 (socket says 172.21.15.5:45220) 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 -- 172.21.15.5:0/1381826256 learned_addr learned my addr 172.21.15.5:0/1381826256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13f7fe640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400d13f0 0x7fd1400b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 -- 172.21.15.5:0/1381826256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400d13f0 msgr2=0x7fd1400b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400d13f0 0x7fd1400b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 -- 172.21.15.5:0/1381826256 >> v1:172.21.15.5:6789/0 conn(0x7fd1400b1230 legacy=0x7fd1400b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13dffb640 1 -- 172.21.15.5:0/1381826256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898222193 0 0) 0x7fd1400ce590 con 0x7fd1400b1230 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.730+0000 7fd13effd640 1 -- 172.21.15.5:0/1381826256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400d3340 con 0x7fd14015fce0 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd13effd640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd1400cea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd130009e50 tx=0x7fd13002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17285730d647a092 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd13dffb640 1 -- 172.21.15.5:0/1381826256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13002aea0 con 0x7fd14015fce0 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd13dffb640 1 -- 172.21.15.5:0/1381826256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13002d050 con 0x7fd14015fce0 2024-09-13T17:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd13dffb640 1 -- 172.21.15.5:0/1381826256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130031820 con 0x7fd14015fce0 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 -- 172.21.15.5:0/1381826256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 msgr2=0x7fd1400cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd1400cea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd130009e50 tx=0x7fd13002a680 comp rx=0 tx=0).stop 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 -- 172.21.15.5:0/1381826256 shutdown_connections 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400d13f0 0x7fd1400b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 --2- 172.21.15.5:0/1381826256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd1400cea20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 -- 172.21.15.5:0/1381826256 >> 172.21.15.5:0/1381826256 conn(0x7fd140089f90 msgr2=0x7fd1400d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 -- 172.21.15.5:0/1381826256 shutdown_connections 2024-09-13T17:13:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.731+0000 7fd14559c640 1 -- 172.21.15.5:0/1381826256 wait complete. 2024-09-13T17:13:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.733+0000 7fd14559c640 1 Processor -- start 2024-09-13T17:13:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.733+0000 7fd14559c640 1 -- start start 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.733+0000 7fd14559c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400b1230 0x7fd1400b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.733+0000 7fd14559c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1400d13f0 0x7fd1400b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.733+0000 7fd14559c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd14559c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c72c0 con 0x7fd14015fce0 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd14559c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015be00 con 0x7fd1400d13f0 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd14559c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400b8420 con 0x7fd1400b1230 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56428/0 (socket says 172.21.15.5:56428) 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 -- 172.21.15.5:0/103845085 learned_addr learned my addr 172.21.15.5:0/103845085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13effd640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400b1230 0x7fd1400b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13e7fc640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1400d13f0 0x7fd1400b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 -- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400b1230 msgr2=0x7fd1400b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400b1230 0x7fd1400b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 -- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1400d13f0 msgr2=0x7fd1400b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1400d13f0 0x7fd1400b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 -- 172.21.15.5:0/103845085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009b30 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd13f7fe640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e960 tx=0x7fd13800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138009690 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800c920 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1400b4420 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800ccd0 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.734+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400c6e90 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.735+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400c7400 con 0x7fd14015fce0 2024-09-13T17:13:49.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.736+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd138013470 con 0x7fd14015fce0 2024-09-13T17:13:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.736+0000 7fd1377fe640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.736+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1380896b0 con 0x7fd14015fce0 2024-09-13T17:13:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.736+0000 7fd13effd640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.737+0000 7fd13effd640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 0x7fd12006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd130033000 tx=0x7fd130009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.740+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd1400c7400 con 0x7fd14015fce0 2024-09-13T17:13:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.912+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1400c7400 con 0x7fd14015fce0 2024-09-13T17:13:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.912+0000 7fd1377fe640 1 -- 172.21.15.5:0/103845085 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1400c7400 con 0x7fd14015fce0 2024-09-13T17:13:49.914 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.914+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 msgr2=0x7fd12006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.914+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 0x7fd12006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd130033000 tx=0x7fd130009000 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.914+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 msgr2=0x7fd14014c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.914+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e960 tx=0x7fd13800ee20 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 shutdown_connections 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd12006ac00 0x7fd12006d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd14015fce0 0x7fd14014c030 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1400d13f0 0x7fd1400b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 --2- 172.21.15.5:0/103845085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1400b1230 0x7fd1400b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 >> 172.21.15.5:0/103845085 conn(0x7fd140089f90 msgr2=0x7fd14015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 shutdown_connections 2024-09-13T17:13:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:49.915+0000 7fd14559c640 1 -- 172.21.15.5:0/103845085 wait complete. 2024-09-13T17:13:49.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.030+0000 7f4ced03d640 1 Processor -- start 2024-09-13T17:13:50.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.030+0000 7f4ced03d640 1 -- start start 2024-09-13T17:13:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ce8069e90 0x7f4ce80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4ce80ae7b0 0x7f4ce806a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce80ac110 0x7f4ce80ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b27f0 con 0x7f4ce8069e90 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce806ed60 con 0x7f4ce80ae7b0 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ced03d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80b40d0 con 0x7f4ce80ac110 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ce8069e90 0x7f4ce80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ce8069e90 0x7f4ce80b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56438/0 (socket says 172.21.15.5:56438) 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 -- 172.21.15.5:0/3278997108 learned_addr learned my addr 172.21.15.5:0/3278997108 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4cde59c640 1 --2- 172.21.15.5:0/3278997108 >> v2:172.21.15.179:3300/0 conn(0x7f4ce80ae7b0 0x7f4ce806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce759e640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce80ac110 0x7f4ce80ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 -- 172.21.15.5:0/3278997108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce80ac110 msgr2=0x7f4ce80ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce80ac110 0x7f4ce80ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 -- 172.21.15.5:0/3278997108 >> v2:172.21.15.179:3300/0 conn(0x7f4ce80ae7b0 msgr2=0x7f4ce806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/3278997108 >> v2:172.21.15.179:3300/0 conn(0x7f4ce80ae7b0 0x7f4ce806a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.031+0000 7f4ce6d9d640 1 -- 172.21.15.5:0/3278997108 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80ae390 con 0x7f4ce8069e90 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce8069e90 0x7f4ce80b2130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071680 tx=0x7f4cd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750bfcb377c8a6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ce659c640 1 -- 172.21.15.5:0/3278997108 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8032440 con 0x7f4ce8069e90 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ce659c640 1 -- 172.21.15.5:0/3278997108 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd80325a0 con 0x7f4ce8069e90 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ce659c640 1 -- 172.21.15.5:0/3278997108 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8032930 con 0x7f4ce8069e90 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ced03d640 1 -- 172.21.15.5:0/3278997108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce8069e90 msgr2=0x7f4ce80b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.032+0000 7f4ced03d640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce8069e90 0x7f4ce80b2130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071680 tx=0x7f4cd802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 -- 172.21.15.5:0/3278997108 shutdown_connections 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce80ac110 0x7f4ce80ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 --2- 172.21.15.5:0/3278997108 >> v2:172.21.15.179:3300/0 conn(0x7f4ce80ae7b0 0x7f4ce806a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 --2- 172.21.15.5:0/3278997108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce8069e90 0x7f4ce80b2130 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 -- 172.21.15.5:0/3278997108 >> 172.21.15.5:0/3278997108 conn(0x7f4ce80b4650 msgr2=0x7f4ce80b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 -- 172.21.15.5:0/3278997108 shutdown_connections 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.033+0000 7f4ced03d640 1 -- 172.21.15.5:0/3278997108 wait complete. 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.034+0000 7f4ced03d640 1 Processor -- start 2024-09-13T17:13:50.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.034+0000 7f4ced03d640 1 -- start start 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce8069e90 0x7f4ce806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce80ae7b0 0x7f4ce81e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c96d0 con 0x7f4ce80ac110 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80ca9c0 con 0x7f4ce80ae7b0 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ced03d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c9920 con 0x7f4ce8069e90 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56454/0 (socket says 172.21.15.5:56454) 2024-09-13T17:13:50.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 -- 172.21.15.5:0/2549871587 learned_addr learned my addr 172.21.15.5:0/2549871587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce8069e90 0x7f4ce806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4ce759e640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce80ae7b0 0x7f4ce81e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 -- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce8069e90 msgr2=0x7f4ce806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce8069e90 0x7f4ce806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 -- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce80ae7b0 msgr2=0x7f4ce81e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce80ae7b0 0x7f4ce81e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.035+0000 7f4cde59c640 1 -- 172.21.15.5:0/2549871587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd80094d0 con 0x7f4ce80ac110 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4cde59c640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000d620 tx=0x7f4cd000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000b620 con 0x7f4ce80ac110 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000b780 con 0x7f4ce80ac110 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce80c9c00 con 0x7f4ce80ac110 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000bb30 con 0x7f4ce80ac110 2024-09-13T17:13:50.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.036+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80c9f90 con 0x7f4ce80ac110 2024-09-13T17:13:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.037+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce80672a0 con 0x7f4ce80ac110 2024-09-13T17:13:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.037+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4cd000bc90 con 0x7f4ce80ac110 2024-09-13T17:13:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.038+0000 7f4cdffff640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 0x7f4cc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.038+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4cd00899a0 con 0x7f4ce80ac110 2024-09-13T17:13:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.038+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 0x7f4cc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.039+0000 7f4ce6d9d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 0x7f4cc806d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8034000 tx=0x7f4cd802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.042+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4cd0054940 con 0x7f4ce80ac110 2024-09-13T17:13:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.215+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ce80ac5a0 con 0x7f4ce80ac110 2024-09-13T17:13:50.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.216+0000 7f4cdffff640 1 -- 172.21.15.5:0/2549871587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cd0057f60 con 0x7f4ce80ac110 2024-09-13T17:13:50.217 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 msgr2=0x7f4cc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 0x7f4cc806d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8034000 tx=0x7f4cd802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 msgr2=0x7f4ce81e35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000d620 tx=0x7f4cd000dae0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 shutdown_connections 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce80ae7b0 0x7f4ce81e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4cc806ac00 0x7f4cc806d0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ce80ac110 0x7f4ce81e35d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 --2- 172.21.15.5:0/2549871587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ce8069e90 0x7f4ce806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 >> 172.21.15.5:0/2549871587 conn(0x7f4ce80b4650 msgr2=0x7f4ce80b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 shutdown_connections 2024-09-13T17:13:50.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.218+0000 7f4ced03d640 1 -- 172.21.15.5:0/2549871587 wait complete. 2024-09-13T17:13:50.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.333+0000 7ff08f19c640 1 Processor -- start 2024-09-13T17:13:50.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.333+0000 7ff08f19c640 1 -- start start 2024-09-13T17:13:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08f19c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff08815d850 0x7ff0880b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08f19c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff0880ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08f19c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880b27f0 con 0x7ff088069e90 2024-09-13T17:13:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08f19c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08806ed60 con 0x7ff08815d850 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08f19c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b40d0 con 0x7ff0880ae7b0 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08cf38640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff088069e90 0x7ff08806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45234/0 (socket says 172.21.15.5:45234) 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08cf38640 1 -- 172.21.15.5:0/1408091000 learned_addr learned my addr 172.21.15.5:0/1408091000 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff087fff640 1 --2- 172.21.15.5:0/1408091000 >> v2:172.21.15.179:3300/0 conn(0x7ff08815d850 0x7ff0880b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678884264 0 0) 0x7ff0880b27f0 con 0x7ff088069e90 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff078003520 con 0x7ff088069e90 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08d739640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff0880ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199574836 0 0) 0x7ff078003520 con 0x7ff088069e90 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 msgr2=0x7ff0880ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff0880ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 >> v2:172.21.15.179:3300/0 conn(0x7ff08815d850 msgr2=0x7ff0880b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 --2- 172.21.15.5:0/1408091000 >> v2:172.21.15.179:3300/0 conn(0x7ff08815d850 0x7ff0880b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880ae390 con 0x7ff088069e90 2024-09-13T17:13:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff07c001670 con 0x7ff088069e90 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 >> v1:172.21.15.5:6789/0 conn(0x7ff088069e90 legacy=0x7ff08806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003970 0x7ff078003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0780047c0 0x7ff078004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff078005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806ed60 con 0x7ff078003970 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b40d0 con 0x7ff0780047c0 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07800b980 con 0x7ff0880ae7b0 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.334+0000 7ff08cf38640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003970 0x7ff078003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff087fff640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0780047c0 0x7ff078004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08d739640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff078005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 -- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 msgr2=0x7ff078005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff078005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 -- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0780047c0 msgr2=0x7ff078004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0780047c0 0x7ff078004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 -- 172.21.15.5:0/1408091000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078003520 con 0x7ff078003970 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08d739640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0880ae7b0 0x7ff078005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.335+0000 7ff08cf38640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003970 0x7ff078003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c240 tx=0x7ff0780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5fae32a9ccd280 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c005ad0 con 0x7ff078003970 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c005c30 con 0x7ff078003970 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff0877fe640 1 -- 172.21.15.5:0/1408091000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007070 con 0x7ff078003970 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 -- 172.21.15.5:0/1408091000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003970 msgr2=0x7ff078003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 --2- 172.21.15.5:0/1408091000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff078003970 0x7ff078003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c240 tx=0x7ff0780057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08d739640 1 -- 172.21.15.5:0/1408091000 reap_dead start 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 -- 172.21.15.5:0/1408091000 shutdown_connections 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 -- 172.21.15.5:0/1408091000 >> 172.21.15.5:0/1408091000 conn(0x7ff0880b4650 msgr2=0x7ff0880b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 -- 172.21.15.5:0/1408091000 shutdown_connections 2024-09-13T17:13:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.336+0000 7ff08f19c640 1 -- 172.21.15.5:0/1408091000 wait complete. 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.337+0000 7ff08f19c640 1 Processor -- start 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.337+0000 7ff08f19c640 1 -- start start 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff078003970 0x7ff08813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff088140cd0 0x7ff08806e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881417f0 con 0x7ff088140850 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088152b00 con 0x7ff088140cd0 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff08f19c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08813e4b0 con 0x7ff078003970 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.338+0000 7ff087fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56470/0 (socket says 172.21.15.5:56470) 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 -- 172.21.15.5:0/2531611163 learned_addr learned my addr 172.21.15.5:0/2531611163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff08cf38640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff078003970 0x7ff08813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff08d739640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff088140cd0 0x7ff08806e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 -- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff078003970 msgr2=0x7ff08813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff078003970 0x7ff08813df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 -- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff088140cd0 msgr2=0x7ff08806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff088140cd0 0x7ff08806e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 -- 172.21.15.5:0/2531611163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088141230 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff087fff640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff074011960 tx=0x7ff074011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074004240 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0740043a0 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff088141510 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400faa0 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.339+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff088153080 con 0x7ff088140850 2024-09-13T17:13:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.340+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880672a0 con 0x7ff088140850 2024-09-13T17:13:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.341+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff07400fc00 con 0x7ff088140850 2024-09-13T17:13:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.341+0000 7ff0857fa640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.341+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff074089b10 con 0x7ff088140850 2024-09-13T17:13:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.341+0000 7ff08cf38640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.342+0000 7ff08cf38640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 0x7ff06c06d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff07c033000 tx=0x7ff07c009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.345+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff074054ab0 con 0x7ff088140850 2024-09-13T17:13:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.519+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff0880ac570 con 0x7ff088140850 2024-09-13T17:13:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.519+0000 7ff0857fa640 1 -- 172.21.15.5:0/2531611163 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0740230a0 con 0x7ff088140850 2024-09-13T17:13:50.520 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 msgr2=0x7ff06c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 0x7ff06c06d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff07c033000 tx=0x7ff07c009030 comp rx=0 tx=0).stop 2024-09-13T17:13:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 msgr2=0x7ff08806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff074011960 tx=0x7ff074011e20 comp rx=0 tx=0).stop 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 shutdown_connections 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff088140cd0 0x7ff08806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff088140850 0x7ff08806ddc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 --2- 172.21.15.5:0/2531611163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff078003970 0x7ff08813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 >> 172.21.15.5:0/2531611163 conn(0x7ff0880b4650 msgr2=0x7ff088073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 shutdown_connections 2024-09-13T17:13:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.521+0000 7ff08f19c640 1 -- 172.21.15.5:0/2531611163 wait complete. 2024-09-13T17:13:50.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:50.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.633+0000 7fac6e926640 1 Processor -- start 2024-09-13T17:13:50.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.633+0000 7fac6e926640 1 -- start start 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac6e926640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac6815fd80 0x7fac680cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac6e926640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 0x7fac6806e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac6e926640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac680704a0 con 0x7fac680d0e30 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac6e926640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6806cc10 con 0x7fac6815fd80 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac6e926640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6806bd80 con 0x7fac68099110 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac67fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac6815fd80 0x7fac680cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac67fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac6815fd80 0x7fac680cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56482/0 (socket says 172.21.15.5:56482) 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.634+0000 7fac67fff640 1 -- 172.21.15.5:0/4148056770 learned_addr learned my addr 172.21.15.5:0/4148056770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac67fff640 1 -- 172.21.15.5:0/4148056770 >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 msgr2=0x7fac6806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac6cec3640 1 --2- 172.21.15.5:0/4148056770 >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 0x7fac6806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac67fff640 1 --2- 172.21.15.5:0/4148056770 >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 0x7fac6806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac67fff640 1 -- 172.21.15.5:0/4148056770 >> v1:172.21.15.179:6789/0 conn(0x7fac680d0e30 legacy=0x7fac68098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac67fff640 1 -- 172.21.15.5:0/4148056770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac680d1270 con 0x7fac6815fd80 2024-09-13T17:13:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.635+0000 7fac6cec3640 1 --2- 172.21.15.5:0/4148056770 >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 0x7fac6806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac67fff640 1 --2- 172.21.15.5:0/4148056770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac680cfd30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac68071b10 tx=0x7fac5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17f923256b3817b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac66ffd640 1 -- 172.21.15.5:0/4148056770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58032440 con 0x7fac6815fd80 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac66ffd640 1 -- 172.21.15.5:0/4148056770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac580325a0 con 0x7fac6815fd80 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac66ffd640 1 -- 172.21.15.5:0/4148056770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58032930 con 0x7fac6815fd80 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 -- 172.21.15.5:0/4148056770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 msgr2=0x7fac680cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 --2- 172.21.15.5:0/4148056770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac680cfd30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac68071b10 tx=0x7fac5802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 -- 172.21.15.5:0/4148056770 shutdown_connections 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 --2- 172.21.15.5:0/4148056770 >> v2:172.21.15.179:3300/0 conn(0x7fac68099110 0x7fac6806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 --2- 172.21.15.5:0/4148056770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac680cfd30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 -- 172.21.15.5:0/4148056770 >> 172.21.15.5:0/4148056770 conn(0x7fac680d0310 msgr2=0x7fac680d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 -- 172.21.15.5:0/4148056770 shutdown_connections 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.636+0000 7fac6e926640 1 -- 172.21.15.5:0/4148056770 wait complete. 2024-09-13T17:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.637+0000 7fac6e926640 1 Processor -- start 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 -- start start 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac68099110 0x7fac6809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac680d0e30 0x7fac6809d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68149210 con 0x7fac6815fd80 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac68149450 con 0x7fac68099110 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6e926640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6815a830 con 0x7fac680d0e30 2024-09-13T17:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.638+0000 7fac6cec3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56486/0 (socket says 172.21.15.5:56486) 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 -- 172.21.15.5:0/1959198455 learned_addr learned my addr 172.21.15.5:0/1959198455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac67fff640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac68099110 0x7fac6809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac677fe640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac680d0e30 0x7fac6809d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 -- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac680d0e30 msgr2=0x7fac6809d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac680d0e30 0x7fac6809d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 -- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac68099110 msgr2=0x7fac6809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac68099110 0x7fac6809ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 -- 172.21.15.5:0/1959198455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580094d0 con 0x7fac6815fd80 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6cec3640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac6000ce70 tx=0x7fac6000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60003b90 con 0x7fac6815fd80 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60003d10 con 0x7fac6815fd80 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60004260 con 0x7fac6815fd80 2024-09-13T17:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac680c5de0 con 0x7fac6815fd80 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.639+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac681496a0 con 0x7fac6815fd80 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.640+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6806c1f0 con 0x7fac6815fd80 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.641+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac600043c0 con 0x7fac6815fd80 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.641+0000 7fac64ff9640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 0x7fac5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.642+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac60089ea0 con 0x7fac6815fd80 2024-09-13T17:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.642+0000 7fac67fff640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 0x7fac5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.642+0000 7fac67fff640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 0x7fac5406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fac58034000 tx=0x7fac5802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.646+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac6806c1f0 con 0x7fac6815fd80 2024-09-13T17:13:50.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.817+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac6806c1f0 con 0x7fac6815fd80 2024-09-13T17:13:50.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.818+0000 7fac64ff9640 1 -- 172.21.15.5:0/1959198455 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fac6806c1f0 con 0x7fac6815fd80 2024-09-13T17:13:50.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:50.820 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 msgr2=0x7fac5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 0x7fac5406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fac58034000 tx=0x7fac5802e000 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 msgr2=0x7fac6814b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac6000ce70 tx=0x7fac6000a710 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 shutdown_connections 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac5406ac00 0x7fac5406d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac6815fd80 0x7fac6814b490 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac680d0e30 0x7fac6809d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 --2- 172.21.15.5:0/1959198455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac68099110 0x7fac6809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 >> 172.21.15.5:0/1959198455 conn(0x7fac680d0310 msgr2=0x7fac680d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 shutdown_connections 2024-09-13T17:13:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.820+0000 7fac6e926640 1 -- 172.21.15.5:0/1959198455 wait complete. 2024-09-13T17:13:50.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:50.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.936+0000 7f267b59e640 1 Processor -- start 2024-09-13T17:13:50.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.936+0000 7f267b59e640 1 -- start start 2024-09-13T17:13:50.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267b59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267b59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f267c0d0f40 0x7f267c0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267b59e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c0cd7d0 con 0x7f267c0d03f0 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267b59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0cdab0 con 0x7f267c0d0f40 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267b59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cdd90 con 0x7f267c15faf0 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f267c0d0f40 0x7f267c0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f267c0d0f40 0x7f267c0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56488/0 (socket says 172.21.15.5:56488) 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 -- 172.21.15.5:0/5229271 learned_addr learned my addr 172.21.15.5:0/5229271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267a59c640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 -- 172.21.15.5:0/5229271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 msgr2=0x7f267c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 -- 172.21.15.5:0/5229271 >> v1:172.21.15.179:6789/0 conn(0x7f267c0d03f0 legacy=0x7f267c0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:50.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.937+0000 7f267ad9d640 1 -- 172.21.15.5:0/5229271 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0ce070 con 0x7f267c0d0f40 2024-09-13T17:13:50.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.938+0000 7f267ad9d640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0b2020 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2674009e50 tx=0x7f267402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf93c3ca9dea9d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.938+0000 7f267959a640 1 -- 172.21.15.5:0/5229271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674031600 con 0x7f267c0d0f40 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.938+0000 7f267959a640 1 -- 172.21.15.5:0/5229271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267402d050 con 0x7f267c0d0f40 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.938+0000 7f267959a640 1 -- 172.21.15.5:0/5229271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674031980 con 0x7f267c0d0f40 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 -- 172.21.15.5:0/5229271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 msgr2=0x7f267c0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0b2020 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2674009e50 tx=0x7f267402a630 comp rx=0 tx=0).stop 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 -- 172.21.15.5:0/5229271 shutdown_connections 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0b2020 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 --2- 172.21.15.5:0/5229271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 -- 172.21.15.5:0/5229271 >> 172.21.15.5:0/5229271 conn(0x7f267c089f90 msgr2=0x7f267c0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 -- 172.21.15.5:0/5229271 shutdown_connections 2024-09-13T17:13:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.939+0000 7f267b59e640 1 -- 172.21.15.5:0/5229271 wait complete. 2024-09-13T17:13:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.940+0000 7f267b59e640 1 Processor -- start 2024-09-13T17:13:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.940+0000 7f267b59e640 1 -- start start 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f267c0d03f0 0x7f267c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0c9450 con 0x7f267c0d0f40 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0c9730 con 0x7f267c0d03f0 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267b59e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0c9a10 con 0x7f267c15faf0 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f2679d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f2679d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56496/0 (socket says 172.21.15.5:56496) 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f2679d9b640 1 -- 172.21.15.5:0/902642436 learned_addr learned my addr 172.21.15.5:0/902642436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267ad9d640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.941+0000 7f267a59c640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f267c0d03f0 0x7f267c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 -- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 msgr2=0x7f267c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 -- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f267c0d03f0 msgr2=0x7f267c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f267c0d03f0 0x7f267c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 -- 172.21.15.5:0/902642436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009b30 con 0x7f267c0d0f40 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f2679d9b640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267000c400 tx=0x7f267000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670011790 con 0x7f267c0d0f40 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670011930 con 0x7f267c0d0f40 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670011ce0 con 0x7f267c0d0f40 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0c9cf0 con 0x7f267c0d0f40 2024-09-13T17:13:50.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.942+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c154ff0 con 0x7f267c0d0f40 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.943+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c0b2020 con 0x7f267c0d0f40 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.944+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f267001c460 con 0x7f267c0d0f40 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.944+0000 7f266affd640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 0x7f265c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.944+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2670089520 con 0x7f267c0d0f40 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.944+0000 7f267a59c640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 0x7f265c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.945+0000 7f267a59c640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 0x7f265c06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:50.948+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26700544a0 con 0x7f267c0d0f40 2024-09-13T17:13:51.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.118+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f267c0c9050 con 0x7f267c0d0f40 2024-09-13T17:13:51.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.119+0000 7f266affd640 1 -- 172.21.15.5:0/902642436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2670057ac0 con 0x7f267c0d0f40 2024-09-13T17:13:51.120 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 msgr2=0x7f265c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 0x7f265c06d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c008040 comp rx=0 tx=0).stop 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 msgr2=0x7f267c0cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267000c400 tx=0x7f267000c8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 shutdown_connections 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f267c15faf0 0x7f267c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f265c06ac30 0x7f265c06d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c0d0f40 0x7f267c0cae80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 --2- 172.21.15.5:0/902642436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f267c0d03f0 0x7f267c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 >> 172.21.15.5:0/902642436 conn(0x7f267c089f90 msgr2=0x7f267c06c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 shutdown_connections 2024-09-13T17:13:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.121+0000 7f267b59e640 1 -- 172.21.15.5:0/902642436 wait complete. 2024-09-13T17:13:51.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.236+0000 7efc92101640 1 Processor -- start 2024-09-13T17:13:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.236+0000 7efc92101640 1 -- start start 2024-09-13T17:13:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.236+0000 7efc92101640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc8c0abe60 0x7efc8c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.236+0000 7efc92101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c06da30 0x7efc8c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.236+0000 7efc92101640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c0ad050 con 0x7efc8c1591e0 2024-09-13T17:13:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc92101640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c06e400 con 0x7efc8c0abe60 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc92101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0ac440 con 0x7efc8c06da30 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc8c0abe60 0x7efc8c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc8c1591e0 0x7efc8c0ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45248/0 (socket says 172.21.15.5:45248) 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8b7fe640 1 -- 172.21.15.5:0/3174814528 learned_addr learned my addr 172.21.15.5:0/3174814528 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8bfff640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c06da30 0x7efc8c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8affd640 1 -- 172.21.15.5:0/3174814528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c06da30 msgr2=0x7efc8c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8affd640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c06da30 0x7efc8c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8affd640 1 -- 172.21.15.5:0/3174814528 >> v1:172.21.15.5:6789/0 conn(0x7efc8c1591e0 legacy=0x7efc8c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8affd640 1 -- 172.21.15.5:0/3174814528 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0ac720 con 0x7efc8c0abe60 2024-09-13T17:13:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.237+0000 7efc8a7fc640 1 -- 172.21.15.5:0/3174814528 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970051053 0 0) 0x7efc8c0ad050 con 0x7efc8c1591e0 2024-09-13T17:13:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc8affd640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c0abe60 0x7efc8c0b1b30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efc740097a0 tx=0x7efc7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f04fa8283eaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc8a7fc640 1 -- 172.21.15.5:0/3174814528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74032440 con 0x7efc8c0abe60 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc8a7fc640 1 -- 172.21.15.5:0/3174814528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc740325a0 con 0x7efc8c0abe60 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc8a7fc640 1 -- 172.21.15.5:0/3174814528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74032930 con 0x7efc8c0abe60 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 -- 172.21.15.5:0/3174814528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c0abe60 msgr2=0x7efc8c0b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c0abe60 0x7efc8c0b1b30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efc740097a0 tx=0x7efc7402a180 comp rx=0 tx=0).stop 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 -- 172.21.15.5:0/3174814528 shutdown_connections 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c06da30 0x7efc8c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 --2- 172.21.15.5:0/3174814528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c0abe60 0x7efc8c0b1b30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.238+0000 7efc92101640 1 -- 172.21.15.5:0/3174814528 >> 172.21.15.5:0/3174814528 conn(0x7efc8c0ce130 msgr2=0x7efc8c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.239+0000 7efc92101640 1 -- 172.21.15.5:0/3174814528 shutdown_connections 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.239+0000 7efc92101640 1 -- 172.21.15.5:0/3174814528 wait complete. 2024-09-13T17:13:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.240+0000 7efc92101640 1 Processor -- start 2024-09-13T17:13:51.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.240+0000 7efc92101640 1 -- start start 2024-09-13T17:13:51.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c0abe60 0x7efc8c09bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c1591e0 0x7efc8c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c1ef860 con 0x7efc8c06da30 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c157e70 con 0x7efc8c1591e0 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c158150 con 0x7efc8c0abe60 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56508/0 (socket says 172.21.15.5:56508) 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 -- 172.21.15.5:0/2827143017 learned_addr learned my addr 172.21.15.5:0/2827143017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8affd640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c0abe60 0x7efc8c09bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8bfff640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c1591e0 0x7efc8c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 -- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c0abe60 msgr2=0x7efc8c09bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c0abe60 0x7efc8c09bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 -- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c1591e0 msgr2=0x7efc8c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c1591e0 0x7efc8c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 -- 172.21.15.5:0/2827143017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009400 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc8b7fe640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c7c0 tx=0x7efc7c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c00a640 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c00a7c0 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.241+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c158430 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.242+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c00ab70 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.242+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c09c120 con 0x7efc8c06da30 2024-09-13T17:13:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.242+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c0672a0 con 0x7efc8c06da30 2024-09-13T17:13:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.243+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc7c00acd0 con 0x7efc8c06da30 2024-09-13T17:13:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.243+0000 7efc83fff640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 0x7efc6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.243+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc7c088d30 con 0x7efc8c06da30 2024-09-13T17:13:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.244+0000 7efc8affd640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 0x7efc6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.244+0000 7efc8affd640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 0x7efc6c06d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.247+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc7c053d60 con 0x7efc8c06da30 2024-09-13T17:13:51.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.418+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc8c06dec0 con 0x7efc8c06da30 2024-09-13T17:13:51.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.418+0000 7efc83fff640 1 -- 172.21.15.5:0/2827143017 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc7c0180a0 con 0x7efc8c06da30 2024-09-13T17:13:51.419 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:51.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 msgr2=0x7efc6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 0x7efc6c06d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc74034000 tx=0x7efc7402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 msgr2=0x7efc8c151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c7c0 tx=0x7efc7c00cc80 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 shutdown_connections 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc8c1591e0 0x7efc8c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc8c0abe60 0x7efc8c09bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc6c06ac00 0x7efc6c06d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 --2- 172.21.15.5:0/2827143017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc8c06da30 0x7efc8c151700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 >> 172.21.15.5:0/2827143017 conn(0x7efc8c0ce130 msgr2=0x7efc8c0ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 shutdown_connections 2024-09-13T17:13:51.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.420+0000 7efc92101640 1 -- 172.21.15.5:0/2827143017 wait complete. 2024-09-13T17:13:51.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.535+0000 7f4e98819640 1 Processor -- start 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.536+0000 7f4e98819640 1 -- start start 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e94071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e941598a0 0x7f4e940b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e940b20e0 0x7f4e9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e94153380 con 0x7f4e941598a0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940b2530 con 0x7f4e940b20e0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e98819640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94070f10 con 0x7f4e94152fa0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e941598a0 0x7f4e940b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e941598a0 0x7f4e940b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56518/0 (socket says 172.21.15.5:56518) 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 -- 172.21.15.5:0/4276451371 learned_addr learned my addr 172.21.15.5:0/4276451371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e92d9d640 1 --2- 172.21.15.5:0/4276451371 >> v2:172.21.15.179:3300/0 conn(0x7f4e940b20e0 0x7f4e9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e9259c640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e94071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 -- 172.21.15.5:0/4276451371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 msgr2=0x7f4e94071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e94071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 -- 172.21.15.5:0/4276451371 >> v2:172.21.15.179:3300/0 conn(0x7f4e940b20e0 msgr2=0x7f4e9406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 --2- 172.21.15.5:0/4276451371 >> v2:172.21.15.179:3300/0 conn(0x7f4e940b20e0 0x7f4e9406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.537+0000 7f4e91d9b640 1 -- 172.21.15.5:0/4276451371 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940711f0 con 0x7f4e941598a0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e91d9b640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e940b1ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e940afdb0 tx=0x7f4e8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32952f08f634fea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e9159a640 1 -- 172.21.15.5:0/4276451371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84032440 con 0x7f4e941598a0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e9159a640 1 -- 172.21.15.5:0/4276451371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840325a0 con 0x7f4e941598a0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e9159a640 1 -- 172.21.15.5:0/4276451371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84032930 con 0x7f4e941598a0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e98819640 1 -- 172.21.15.5:0/4276451371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 msgr2=0x7f4e940b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.538+0000 7f4e98819640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e940b1ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e940afdb0 tx=0x7f4e8402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 -- 172.21.15.5:0/4276451371 shutdown_connections 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 --2- 172.21.15.5:0/4276451371 >> v2:172.21.15.179:3300/0 conn(0x7f4e940b20e0 0x7f4e9406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e940b1ba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 --2- 172.21.15.5:0/4276451371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e94071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 -- 172.21.15.5:0/4276451371 >> 172.21.15.5:0/4276451371 conn(0x7f4e940ce130 msgr2=0x7f4e940ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 -- 172.21.15.5:0/4276451371 shutdown_connections 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.539+0000 7f4e98819640 1 -- 172.21.15.5:0/4276451371 wait complete. 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.540+0000 7f4e98819640 1 Processor -- start 2024-09-13T17:13:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.540+0000 7f4e98819640 1 -- start start 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 0x7f4e94147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e941f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94148990 con 0x7f4e941598a0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94147d80 con 0x7f4e940b20e0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e98819640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94148060 con 0x7f4e94152fa0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56522/0 (socket says 172.21.15.5:56522) 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 -- 172.21.15.5:0/3654516258 learned_addr learned my addr 172.21.15.5:0/3654516258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e9259c640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 0x7f4e94147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e91d9b640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e941f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 -- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 msgr2=0x7f4e941f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e941f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 -- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 msgr2=0x7f4e94147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 0x7f4e94147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 -- 172.21.15.5:0/3654516258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840094d0 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e9259c640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 0x7f4e94147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.541+0000 7f4e92d9d640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c007e60 tx=0x7f4e8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.542+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c014420 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.542+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c0145a0 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.542+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c014950 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.542+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94148340 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.542+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e94147a90 con 0x7f4e941598a0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.543+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940672a0 con 0x7f4e941598a0 2024-09-13T17:13:51.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.543+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e8c014ab0 con 0x7f4e941598a0 2024-09-13T17:13:51.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.543+0000 7f4e8affd640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 0x7f4e7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.544+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e8c089f50 con 0x7f4e941598a0 2024-09-13T17:13:51.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.544+0000 7f4e9259c640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 0x7f4e7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.544+0000 7f4e9259c640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 0x7f4e7406d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c006fd0 tx=0x7f4e7c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.548+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e8c054e40 con 0x7f4e941598a0 2024-09-13T17:13:51.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.717+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e940b12d0 con 0x7f4e941598a0 2024-09-13T17:13:51.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.717+0000 7f4e8affd640 1 -- 172.21.15.5:0/3654516258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e8c058460 con 0x7f4e941598a0 2024-09-13T17:13:51.718 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 msgr2=0x7f4e7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 0x7f4e7406d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c006fd0 tx=0x7f4e7c008040 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 msgr2=0x7f4e941f3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c007e60 tx=0x7f4e8c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 shutdown_connections 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4e7406ac00 0x7f4e7406d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e941598a0 0x7f4e941f3890 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e94152fa0 0x7f4e941f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 --2- 172.21.15.5:0/3654516258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e940b20e0 0x7f4e94147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 >> 172.21.15.5:0/3654516258 conn(0x7f4e940ce130 msgr2=0x7f4e94158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 shutdown_connections 2024-09-13T17:13:51.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.719+0000 7f4e98819640 1 -- 172.21.15.5:0/3654516258 wait complete. 2024-09-13T17:13:51.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.834+0000 7fd19ac7d640 1 Processor -- start 2024-09-13T17:13:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.834+0000 7fd19ac7d640 1 -- start start 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd19ac7d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd19415dc30 0x7fd1940cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd19ac7d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd1940cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd19ac7d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940d0110 con 0x7fd19406e5c0 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd19ac7d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd194099540 con 0x7fd19415dc30 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd19ac7d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194099820 con 0x7fd19406f160 2024-09-13T17:13:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd193fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd19406e5c0 0x7fd19406ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45262/0 (socket says 172.21.15.5:45262) 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.835+0000 7fd193fff640 1 -- 172.21.15.5:0/2560573571 learned_addr learned my addr 172.21.15.5:0/2560573571 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd198a19640 1 --2- 172.21.15.5:0/2560573571 >> v2:172.21.15.179:3300/0 conn(0x7fd19415dc30 0x7fd1940cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd19921a640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd1940cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897531544 0 0) 0x7fd1940d0110 con 0x7fd19406e5c0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003520 con 0x7fd19406e5c0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033847843 0 0) 0x7fd180003520 con 0x7fd19406e5c0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 msgr2=0x7fd1940cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd1940cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 >> v2:172.21.15.179:3300/0 conn(0x7fd19415dc30 msgr2=0x7fd1940cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 --2- 172.21.15.5:0/2560573571 >> v2:172.21.15.179:3300/0 conn(0x7fd19415dc30 0x7fd1940cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194099b00 con 0x7fd19406e5c0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd17c0019f0 con 0x7fd19406e5c0 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 >> v1:172.21.15.5:6789/0 conn(0x7fd19406e5c0 legacy=0x7fd19406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd180003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd180003ef0 0x7fd1800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd180004d00 0x7fd180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194099540 con 0x7fd180003ef0 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194099820 con 0x7fd180004d00 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000ba60 con 0x7fd19406f160 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd180003ef0 0x7fd1800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd198a19640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd180003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd19921a640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd180004d00 0x7fd180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 -- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 msgr2=0x7fd180003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd19406f160 0x7fd180003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 -- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd180004d00 msgr2=0x7fd180005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd180004d00 0x7fd180005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.836+0000 7fd193fff640 1 -- 172.21.15.5:0/2560573571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180003520 con 0x7fd180003ef0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.837+0000 7fd193fff640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd180003ef0 0x7fd1800047c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00a860 tx=0x7fd1800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9166ac4793be76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.837+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c02ba80 con 0x7fd180003ef0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.837+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c02bbe0 con 0x7fd180003ef0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.837+0000 7fd1937fe640 1 -- 172.21.15.5:0/2560573571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c034470 con 0x7fd180003ef0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 -- 172.21.15.5:0/2560573571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd180003ef0 msgr2=0x7fd1800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/2560573571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd180003ef0 0x7fd1800047c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00a860 tx=0x7fd1800057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19921a640 1 -- 172.21.15.5:0/2560573571 reap_dead start 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 -- 172.21.15.5:0/2560573571 shutdown_connections 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 -- 172.21.15.5:0/2560573571 >> 172.21.15.5:0/2560573571 conn(0x7fd1940d0310 msgr2=0x7fd1940d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 -- 172.21.15.5:0/2560573571 shutdown_connections 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.838+0000 7fd19ac7d640 1 -- 172.21.15.5:0/2560573571 wait complete. 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.839+0000 7fd19ac7d640 1 Processor -- start 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.839+0000 7fd19ac7d640 1 -- start start 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 0x7fd1941578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1940c9f00 0x7fd1940ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940cc0d0 con 0x7fd1940cb700 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194157df0 con 0x7fd1940c9f00 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19ac7d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940b3200 con 0x7fd180003ef0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56532/0 (socket says 172.21.15.5:56532) 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 -- 172.21.15.5:0/3930549062 learned_addr learned my addr 172.21.15.5:0/3930549062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd193fff640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1940c9f00 0x7fd1940ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd198a19640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 0x7fd1941578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 -- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 msgr2=0x7fd1941578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 0x7fd1941578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 -- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1940c9f00 msgr2=0x7fd1940ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1940c9f00 0x7fd1940ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd19921a640 1 -- 172.21.15.5:0/3930549062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940b34e0 con 0x7fd1940cb700 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.840+0000 7fd198a19640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 0x7fd1941578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd19921a640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd194071b30 tx=0x7fd18c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011ee0 con 0x7fd1940cb700 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c004240 con 0x7fd1940cb700 2024-09-13T17:13:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1940b37c0 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00f770 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.841+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1940b3d80 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.842+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1940b4710 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.842+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd18c00f8d0 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.843+0000 7fd1917fa640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 0x7fd17406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.843+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd18c0896c0 con 0x7fd1940cb700 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.843+0000 7fd198a19640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 0x7fd17406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.843+0000 7fd198a19640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 0x7fd17406d0f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1940b6200 tx=0x7fd184008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:51.847+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd1940b4710 con 0x7fd1940cb700 2024-09-13T17:13:52.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.015+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd1940b4710 con 0x7fd1940cb700 2024-09-13T17:13:52.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.016+0000 7fd1917fa640 1 -- 172.21.15.5:0/3930549062 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd1940b4710 con 0x7fd1940cb700 2024-09-13T17:13:52.017 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 msgr2=0x7fd17406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 0x7fd17406d0f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1940b6200 tx=0x7fd184008040 comp rx=0 tx=0).stop 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 msgr2=0x7fd1940cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd194071b30 tx=0x7fd18c011cf0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 shutdown_connections 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd17406ac30 0x7fd17406d0f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1940cb700 0x7fd1940cbb90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1940c9f00 0x7fd1940ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 --2- 172.21.15.5:0/3930549062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd180003ef0 0x7fd1941578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 >> 172.21.15.5:0/3930549062 conn(0x7fd1940d0310 msgr2=0x7fd19415af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 shutdown_connections 2024-09-13T17:13:52.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.018+0000 7fd19ac7d640 1 -- 172.21.15.5:0/3930549062 wait complete. 2024-09-13T17:13:52.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.130+0000 7f5ffa441640 1 Processor -- start 2024-09-13T17:13:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 -- start start 2024-09-13T17:13:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 0x7f5ff415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff406e1c0 0x7f5ff40aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40b2390 con 0x7f5ff40b1080 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40b14c0 con 0x7f5ff406e1c0 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ffa441640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40b1780 con 0x7f5ff4156f40 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.131+0000 7f5ff89de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff406e1c0 0x7f5ff40aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff406e1c0 0x7f5ff40aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56534/0 (socket says 172.21.15.5:56534) 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 -- 172.21.15.5:0/3618982647 learned_addr learned my addr 172.21.15.5:0/3618982647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff3fff640 1 --2- 172.21.15.5:0/3618982647 >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 0x7f5ff415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 -- 172.21.15.5:0/3618982647 >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 msgr2=0x7f5ff415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 --2- 172.21.15.5:0/3618982647 >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 0x7f5ff415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 -- 172.21.15.5:0/3618982647 >> v1:172.21.15.179:6789/0 conn(0x7f5ff40b1080 legacy=0x7f5ff406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff89de640 1 -- 172.21.15.5:0/3618982647 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40b1a60 con 0x7f5ff406e1c0 2024-09-13T17:13:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.132+0000 7f5ff3fff640 1 --2- 172.21.15.5:0/3618982647 >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 0x7f5ff415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ff89de640 1 --2- 172.21.15.5:0/3618982647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff40aced0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406aea0 tx=0x7f5fec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d8659eae90e414 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ff2ffd640 1 -- 172.21.15.5:0/3618982647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec031600 con 0x7f5ff406e1c0 2024-09-13T17:13:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ff2ffd640 1 -- 172.21.15.5:0/3618982647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec02d050 con 0x7f5ff406e1c0 2024-09-13T17:13:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ff2ffd640 1 -- 172.21.15.5:0/3618982647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec031980 con 0x7f5ff406e1c0 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 -- 172.21.15.5:0/3618982647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 msgr2=0x7f5ff40aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3618982647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff40aced0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406aea0 tx=0x7f5fec02a6f0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 -- 172.21.15.5:0/3618982647 shutdown_connections 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3618982647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff40aced0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3618982647 >> v2:172.21.15.179:3300/0 conn(0x7f5ff4156f40 0x7f5ff415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 -- 172.21.15.5:0/3618982647 >> 172.21.15.5:0/3618982647 conn(0x7f5ff40ce0d0 msgr2=0x7f5ff40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 -- 172.21.15.5:0/3618982647 shutdown_connections 2024-09-13T17:13:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.133+0000 7f5ffa441640 1 -- 172.21.15.5:0/3618982647 wait complete. 2024-09-13T17:13:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.135+0000 7f5ffa441640 1 Processor -- start 2024-09-13T17:13:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.135+0000 7f5ffa441640 1 -- start start 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.135+0000 7f5ffa441640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.135+0000 7f5ffa441640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff40b1080 0x7f5ff41454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 0x7f5ff40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40adc90 con 0x7f5ff406e1c0 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4145a00 con 0x7f5ff4156f40 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40adf30 con 0x7f5ff40b1080 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56544/0 (socket says 172.21.15.5:56544) 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 -- 172.21.15.5:0/3732011405 learned_addr learned my addr 172.21.15.5:0/3732011405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff37fe640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff40b1080 0x7f5ff41454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff89de640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 0x7f5ff40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 -- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff40b1080 msgr2=0x7f5ff41454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff40b1080 0x7f5ff41454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 -- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 msgr2=0x7f5ff40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 0x7f5ff40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 -- 172.21.15.5:0/3732011405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009b30 con 0x7f5ff406e1c0 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff89de640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 0x7f5ff40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff3fff640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400c7f0 tx=0x7f5fe400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007820 con 0x7f5ff406e1c0 2024-09-13T17:13:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4007980 con 0x7f5ff406e1c0 2024-09-13T17:13:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007cf0 con 0x7f5ff406e1c0 2024-09-13T17:13:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff40ae210 con 0x7f5ff406e1c0 2024-09-13T17:13:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.136+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff40ae7d0 con 0x7f5ff406e1c0 2024-09-13T17:13:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.137+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40ae990 con 0x7f5ff406e1c0 2024-09-13T17:13:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.138+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5fe40113f0 con 0x7f5ff406e1c0 2024-09-13T17:13:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.138+0000 7f5ff0ff9640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 0x7f5fe006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.139+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fe4089970 con 0x7f5ff406e1c0 2024-09-13T17:13:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.139+0000 7f5ff37fe640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 0x7f5fe006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.139+0000 7f5ff37fe640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 0x7f5fe006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4156cf0 tx=0x7f5fe8007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.143+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5fe4054870 con 0x7f5ff406e1c0 2024-09-13T17:13:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.317+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ff40672a0 con 0x7f5ff406e1c0 2024-09-13T17:13:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.318+0000 7f5ff0ff9640 1 -- 172.21.15.5:0/3732011405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f5fe4057e90 con 0x7f5ff406e1c0 2024-09-13T17:13:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:52.320 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.320+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 msgr2=0x7f5fe006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.320+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 0x7f5fe006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4156cf0 tx=0x7f5fe8007e30 comp rx=0 tx=0).stop 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.320+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 msgr2=0x7f5ff4152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.320+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400c7f0 tx=0x7f5fe400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 shutdown_connections 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ff4156f40 0x7f5ff40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ff40b1080 0x7f5ff41454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5fe006ac00 0x7f5fe006d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 --2- 172.21.15.5:0/3732011405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff406e1c0 0x7f5ff4152160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 >> 172.21.15.5:0/3732011405 conn(0x7f5ff40ce0d0 msgr2=0x7f5ff4071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 shutdown_connections 2024-09-13T17:13:52.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.321+0000 7f5ffa441640 1 -- 172.21.15.5:0/3732011405 wait complete. 2024-09-13T17:13:52.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:52.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.437+0000 7fd4f25e2640 1 Processor -- start 2024-09-13T17:13:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.437+0000 7fd4f25e2640 1 -- start start 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4f25e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4ec0b1230 0x7fd4ec0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4f25e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4f25e2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0ce590 con 0x7fd4ec15fce0 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4f25e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0b4fc0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4f25e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0ccd80 con 0x7fd4ec0d13f0 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4eb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4ec0b1230 0x7fd4ec0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4eb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4ec0b1230 0x7fd4ec0cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56552/0 (socket says 172.21.15.5:56552) 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.438+0000 7fd4eb7fe640 1 -- 172.21.15.5:0/2043347143 learned_addr learned my addr 172.21.15.5:0/2043347143 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4f0b7f640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4eb7fe640 1 -- 172.21.15.5:0/2043347143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 msgr2=0x7fd4ec0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4eb7fe640 1 -- 172.21.15.5:0/2043347143 >> v1:172.21.15.179:6789/0 conn(0x7fd4ec15fce0 legacy=0x7fd4ec0b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4eb7fe640 1 -- 172.21.15.5:0/2043347143 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0d3340 con 0x7fd4ec0b1230 2024-09-13T17:13:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4f0b7f640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.439+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec0cea20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009870 tx=0x7fd4e002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d6fa038814668a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4eaffd640 1 -- 172.21.15.5:0/2043347143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0032440 con 0x7fd4ec0b1230 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4eaffd640 1 -- 172.21.15.5:0/2043347143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e00325a0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4eaffd640 1 -- 172.21.15.5:0/2043347143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0032930 con 0x7fd4ec0b1230 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2043347143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 msgr2=0x7fd4ec0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec0cea20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009870 tx=0x7fd4e002a1c0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2043347143 shutdown_connections 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2043347143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec0cea20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2043347143 >> 172.21.15.5:0/2043347143 conn(0x7fd4ec089f90 msgr2=0x7fd4ec0d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2043347143 shutdown_connections 2024-09-13T17:13:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.440+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2043347143 wait complete. 2024-09-13T17:13:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.441+0000 7fd4f25e2640 1 Processor -- start 2024-09-13T17:13:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 -- start start 2024-09-13T17:13:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec15fce0 0x7fd4ec0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0b5e10 con 0x7fd4ec0b1230 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0b6c70 con 0x7fd4ec0d13f0 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4f25e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0c5e00 con 0x7fd4ec15fce0 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56568/0 (socket says 172.21.15.5:56568) 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.442+0000 7fd4ebfff640 1 -- 172.21.15.5:0/2166243646 learned_addr learned my addr 172.21.15.5:0/2166243646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4f0b7f640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec15fce0 0x7fd4ec0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 -- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec15fce0 msgr2=0x7fd4ec0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec15fce0 0x7fd4ec0b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 -- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 msgr2=0x7fd4ec0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 -- 172.21.15.5:0/2166243646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00094d0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4ebfff640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c430 tx=0x7fd4dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0052d0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc005430 con 0x7fd4ec0b1230 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc003830 con 0x7fd4ec0b1230 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0b6060 con 0x7fd4ec0b1230 2024-09-13T17:13:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.443+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec0b6620 con 0x7fd4ec0b1230 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.444+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec0cea20 con 0x7fd4ec0b1230 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.445+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4dc003990 con 0x7fd4ec0b1230 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.445+0000 7fd4e8ff9640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 0x7fd4d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.446+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4dc088b50 con 0x7fd4ec0b1230 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.446+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 0x7fd4d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.446+0000 7fd4eb7fe640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 0x7fd4d806d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034000 tx=0x7fd4e002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.450+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd4dc053ae0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.619+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4ec0d2cf0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.619+0000 7fd4e8ff9640 1 -- 172.21.15.5:0/2166243646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4dc0170a0 con 0x7fd4ec0b1230 2024-09-13T17:13:52.621 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 msgr2=0x7fd4d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 0x7fd4d806d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034000 tx=0x7fd4e002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 msgr2=0x7fd4ec152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c430 tx=0x7fd4dc00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 shutdown_connections 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4ec15fce0 0x7fd4ec0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4ec0d13f0 0x7fd4ec0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4d806ac30 0x7fd4d806d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.621+0000 7fd4f25e2640 1 --2- 172.21.15.5:0/2166243646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4ec0b1230 0x7fd4ec152530 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.622+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 >> 172.21.15.5:0/2166243646 conn(0x7fd4ec089f90 msgr2=0x7fd4ec06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.622+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 shutdown_connections 2024-09-13T17:13:52.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.622+0000 7fd4f25e2640 1 -- 172.21.15.5:0/2166243646 wait complete. 2024-09-13T17:13:52.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.736+0000 7f37a9b5a640 1 Processor -- start 2024-09-13T17:13:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.736+0000 7f37a9b5a640 1 -- start start 2024-09-13T17:13:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a9b5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37a406eb80 0x7f37a40b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a9b5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a9b5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40b35f0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a9b5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a415d140 con 0x7f37a406eb80 2024-09-13T17:13:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a9b5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4160020 con 0x7f37a406ef60 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37a406eb80 0x7f37a40b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37a406eb80 0x7f37a40b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:32784/0 (socket says 172.21.15.5:32784) 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.737+0000 7f37a37fe640 1 -- 172.21.15.5:0/3989291845 learned_addr learned my addr 172.21.15.5:0/3989291845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.738+0000 7f37a37fe640 1 -- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 msgr2=0x7f37a406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.738+0000 7f37a37fe640 1 --2- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.738+0000 7f37a37fe640 1 -- 172.21.15.5:0/3989291845 >> v1:172.21.15.179:6789/0 conn(0x7f37a40b1ac0 legacy=0x7f37a415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.738+0000 7f37a37fe640 1 -- 172.21.15.5:0/3989291845 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4156f50 con 0x7f37a406eb80 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a37fe640 1 --2- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a40b3a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3794009870 tx=0x7f379402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18276bb2a782152c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a27fc640 1 -- 172.21.15.5:0/3989291845 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794032440 con 0x7f37a406eb80 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a27fc640 1 -- 172.21.15.5:0/3989291845 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37940325a0 con 0x7f37a406eb80 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a27fc640 1 -- 172.21.15.5:0/3989291845 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794032930 con 0x7f37a406eb80 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 -- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 msgr2=0x7f37a40b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a40b3a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3794009870 tx=0x7f379402a270 comp rx=0 tx=0).stop 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 -- 172.21.15.5:0/3989291845 shutdown_connections 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a406aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/3989291845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a40b3a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.739+0000 7f37a9b5a640 1 -- 172.21.15.5:0/3989291845 >> 172.21.15.5:0/3989291845 conn(0x7f37a4070af0 msgr2=0x7f37a4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.740+0000 7f37a9b5a640 1 -- 172.21.15.5:0/3989291845 shutdown_connections 2024-09-13T17:13:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.740+0000 7f37a9b5a640 1 -- 172.21.15.5:0/3989291845 wait complete. 2024-09-13T17:13:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.741+0000 7f37a9b5a640 1 Processor -- start 2024-09-13T17:13:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.741+0000 7f37a9b5a640 1 -- start start 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a41518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4153670 con 0x7f37a40b1ac0 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4152ca0 con 0x7f37a406eb80 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a9b5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40ce340 con 0x7f37a406ef60 2024-09-13T17:13:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56574/0 (socket says 172.21.15.5:56574) 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 -- 172.21.15.5:0/1678383893 learned_addr learned my addr 172.21.15.5:0/1678383893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a37fe640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a2ffd640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a41518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 -- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 msgr2=0x7f37a41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a41518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 -- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 msgr2=0x7f37a4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 -- 172.21.15.5:0/1678383893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940094d0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a37fe640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.742+0000 7f37a3fff640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f379c009dd0 tx=0x7f379c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.743+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c014480 con 0x7f37a40b1ac0 2024-09-13T17:13:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.743+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c00f040 con 0x7f37a40b1ac0 2024-09-13T17:13:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.743+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c014840 con 0x7f37a40b1ac0 2024-09-13T17:13:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.743+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a4151df0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.743+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a4152090 con 0x7f37a40b1ac0 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.744+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a40672e0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.744+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f379c0149a0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.745+0000 7f378bfff640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 0x7f379006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.745+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f379c08a350 con 0x7f37a40b1ac0 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.745+0000 7f37a37fe640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 0x7f379006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.746+0000 7f37a37fe640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 0x7f379006d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3794034000 tx=0x7f379402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.749+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f379c0552f0 con 0x7f37a40b1ac0 2024-09-13T17:13:52.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.929+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37a40b3a20 con 0x7f37a40b1ac0 2024-09-13T17:13:52.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.930+0000 7f378bfff640 1 -- 172.21.15.5:0/1678383893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f379c058910 con 0x7f37a40b1ac0 2024-09-13T17:13:52.931 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 msgr2=0x7f379006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 0x7f379006d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3794034000 tx=0x7f379402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 msgr2=0x7f37a41434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f379c009dd0 tx=0x7f379c00c490 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 shutdown_connections 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f379006ac00 0x7f379006d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37a40b1ac0 0x7f37a41434e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37a406ef60 0x7f37a41518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 --2- 172.21.15.5:0/1678383893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a406eb80 0x7f37a4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.931+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 >> 172.21.15.5:0/1678383893 conn(0x7f37a4070af0 msgr2=0x7f37a40affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.932+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 shutdown_connections 2024-09-13T17:13:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:52.932+0000 7f37a9b5a640 1 -- 172.21.15.5:0/1678383893 wait complete. 2024-09-13T17:13:52.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.047+0000 7f51304d0640 1 Processor -- start 2024-09-13T17:13:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.047+0000 7f51304d0640 1 -- start start 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f51304d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 0x7f51280abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f51304d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f512806da30 0x7f512806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f51304d0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280ad050 con 0x7f51280ad4e0 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f51304d0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512806e420 con 0x7f512806da30 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f51304d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280ac440 con 0x7f51281591e0 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f512ea6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f512806da30 0x7f512806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f512ea6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f512806da30 0x7f512806dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56586/0 (socket says 172.21.15.5:56586) 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f512ea6d640 1 -- 172.21.15.5:0/4197463727 learned_addr learned my addr 172.21.15.5:0/4197463727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f512e26c640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 0x7f51280abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.048+0000 7f512ea6d640 1 -- 172.21.15.5:0/4197463727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 msgr2=0x7f51280abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512ea6d640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 0x7f51280abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512ea6d640 1 -- 172.21.15.5:0/4197463727 >> v1:172.21.15.179:6789/0 conn(0x7f51280ad4e0 legacy=0x7f51280b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512ea6d640 1 -- 172.21.15.5:0/4197463727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280ac720 con 0x7f512806da30 2024-09-13T17:13:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512e26c640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 0x7f51280abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512ea6d640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f512806da30 0x7f512806dee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5120009e50 tx=0x7f512002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b6eb3fff438491 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.049+0000 7f512d26a640 1 -- 172.21.15.5:0/4197463727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120031600 con 0x7f512806da30 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f512d26a640 1 -- 172.21.15.5:0/4197463727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512002d050 con 0x7f512806da30 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f512d26a640 1 -- 172.21.15.5:0/4197463727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120031980 con 0x7f512806da30 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 -- 172.21.15.5:0/4197463727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f512806da30 msgr2=0x7f512806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f512806da30 0x7f512806dee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5120009e50 tx=0x7f512002a710 comp rx=0 tx=0).stop 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 -- 172.21.15.5:0/4197463727 shutdown_connections 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f512806da30 0x7f512806dee0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 --2- 172.21.15.5:0/4197463727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51281591e0 0x7f51280abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 -- 172.21.15.5:0/4197463727 >> 172.21.15.5:0/4197463727 conn(0x7f51280ce130 msgr2=0x7f51280ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 -- 172.21.15.5:0/4197463727 shutdown_connections 2024-09-13T17:13:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.050+0000 7f51304d0640 1 -- 172.21.15.5:0/4197463727 wait complete. 2024-09-13T17:13:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.051+0000 7f51304d0640 1 Processor -- start 2024-09-13T17:13:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.051+0000 7f51304d0640 1 -- start start 2024-09-13T17:13:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f512806da30 0x7f5128158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51280ad4e0 0x7f51281f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128156e90 con 0x7f51281591e0 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128157150 con 0x7f512806da30 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f51304d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128157430 con 0x7f51280ad4e0 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56594/0 (socket says 172.21.15.5:56594) 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 -- 172.21.15.5:0/1186619451 learned_addr learned my addr 172.21.15.5:0/1186619451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512da6b640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51280ad4e0 0x7f51281f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512e26c640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f512806da30 0x7f5128158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 -- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51280ad4e0 msgr2=0x7f51281f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51280ad4e0 0x7f51281f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 -- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f512806da30 msgr2=0x7f5128158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f512806da30 0x7f5128158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.052+0000 7f512ea6d640 1 -- 172.21.15.5:0/1186619451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120009b30 con 0x7f51281591e0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f512ea6d640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5120009f70 tx=0x7f5120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120009510 con 0x7f51281591e0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512003c630 con 0x7f51281591e0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512003c9a0 con 0x7f51281591e0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128157710 con 0x7f51281591e0 2024-09-13T17:13:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.053+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512815b570 con 0x7f51281591e0 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.054+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128159a10 con 0x7f51281591e0 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.054+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f512003cb00 con 0x7f51281591e0 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.055+0000 7f511effd640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 0x7f510c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.055+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51200aa2c0 con 0x7f51281591e0 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.055+0000 7f512e26c640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 0x7f510c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.056+0000 7f512e26c640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 0x7f510c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f512815dd20 tx=0x7f5124008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.059+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5128159a10 con 0x7f51281591e0 2024-09-13T17:13:53.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.228+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5128159a10 con 0x7f51281591e0 2024-09-13T17:13:53.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.228+0000 7f511effd640 1 -- 172.21.15.5:0/1186619451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5128159a10 con 0x7f51281591e0 2024-09-13T17:13:53.230 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:53.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 msgr2=0x7f510c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 0x7f510c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f512815dd20 tx=0x7f5124008040 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 msgr2=0x7f51281f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5120009f70 tx=0x7f5120004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 shutdown_connections 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f510c06ac00 0x7f510c06d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51281591e0 0x7f51281f2190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51280ad4e0 0x7f51281f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 --2- 172.21.15.5:0/1186619451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f512806da30 0x7f5128158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 >> 172.21.15.5:0/1186619451 conn(0x7f51280ce130 msgr2=0x7f512815b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 shutdown_connections 2024-09-13T17:13:53.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.230+0000 7f51304d0640 1 -- 172.21.15.5:0/1186619451 wait complete. 2024-09-13T17:13:53.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.349+0000 7f64b1bbc640 1 Processor -- start 2024-09-13T17:13:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.349+0000 7f64b1bbc640 1 -- start start 2024-09-13T17:13:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.349+0000 7f64b1bbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 0x7f64ac0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64b1bbc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac1610e0 con 0x7f64ac0cf000 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64b1bbc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0d0630 con 0x7f64ac0cf440 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64b1bbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0d0910 con 0x7f64ac15c6e0 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64aaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f64ac0cf000 0x7f64ac1602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45264/0 (socket says 172.21.15.5:45264) 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64aaffd640 1 -- 172.21.15.5:0/1898286864 learned_addr learned my addr 172.21.15.5:0/1898286864 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64ab7fe640 1 --2- 172.21.15.5:0/1898286864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 0x7f64ac0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64aa7fc640 1 -- 172.21.15.5:0/1898286864 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368837888 0 0) 0x7f64ac1610e0 con 0x7f64ac0cf000 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64aa7fc640 1 -- 172.21.15.5:0/1898286864 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6494003520 con 0x7f64ac0cf000 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64ab7fe640 1 -- 172.21.15.5:0/1898286864 >> v1:172.21.15.179:6789/0 conn(0x7f64ac0cf440 legacy=0x7f64ac1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64ab7fe640 1 -- 172.21.15.5:0/1898286864 >> v1:172.21.15.5:6789/0 conn(0x7f64ac0cf000 legacy=0x7f64ac1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.350+0000 7f64ab7fe640 1 -- 172.21.15.5:0/1898286864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0d0bf0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.351+0000 7f64ab7fe640 1 --2- 172.21.15.5:0/1898286864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 0x7f64ac0cde60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f649c0097d0 tx=0x7f649c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87db89bc9cf39ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.351+0000 7f64aa7fc640 1 -- 172.21.15.5:0/1898286864 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c032440 con 0x7f64ac15c6e0 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.351+0000 7f64aa7fc640 1 -- 172.21.15.5:0/1898286864 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c0325a0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.351+0000 7f64aa7fc640 1 -- 172.21.15.5:0/1898286864 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c032910 con 0x7f64ac15c6e0 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 -- 172.21.15.5:0/1898286864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 msgr2=0x7f64ac0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/1898286864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 0x7f64ac0cde60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f649c0097d0 tx=0x7f649c02a210 comp rx=0 tx=0).stop 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 -- 172.21.15.5:0/1898286864 shutdown_connections 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/1898286864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac15c6e0 0x7f64ac0cde60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 -- 172.21.15.5:0/1898286864 >> 172.21.15.5:0/1898286864 conn(0x7f64ac089f90 msgr2=0x7f64ac0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 -- 172.21.15.5:0/1898286864 shutdown_connections 2024-09-13T17:13:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.352+0000 7f64b1bbc640 1 -- 172.21.15.5:0/1898286864 wait complete. 2024-09-13T17:13:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.353+0000 7f64b1bbc640 1 Processor -- start 2024-09-13T17:13:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 -- start start 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac0cf000 0x7f64ac145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ac0cf440 0x7f64ac0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac144ff0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1449e0 con 0x7f64ac0cf440 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.354+0000 7f64b1bbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0cc3c0 con 0x7f64ac0cf000 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56606/0 (socket says 172.21.15.5:56606) 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 -- 172.21.15.5:0/2008468448 learned_addr learned my addr 172.21.15.5:0/2008468448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64aaffd640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ac0cf440 0x7f64ac0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64ab7fe640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac0cf000 0x7f64ac145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 -- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac0cf000 msgr2=0x7f64ac145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac0cf000 0x7f64ac145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 -- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ac0cf440 msgr2=0x7f64ac0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ac0cf440 0x7f64ac0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 -- 172.21.15.5:0/2008468448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c009400 con 0x7f64ac15c6e0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64abfff640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c7a0 tx=0x7f64a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4003b70 con 0x7f64ac15c6e0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4003cf0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4003ea0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.355+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac144c80 con 0x7f64ac15c6e0 2024-09-13T17:13:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.356+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0ca350 con 0x7f64ac15c6e0 2024-09-13T17:13:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.357+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac0672e0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.357+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64a400aa90 con 0x7f64ac15c6e0 2024-09-13T17:13:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.358+0000 7f6493fff640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 0x7f649806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.358+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64a4089290 con 0x7f64ac15c6e0 2024-09-13T17:13:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.358+0000 7f64ab7fe640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 0x7f649806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.358+0000 7f64ab7fe640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 0x7f649806d0f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f649c034000 tx=0x7f649c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.362+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f64a40542c0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.536+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64ac15cac0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.536+0000 7f6493fff640 1 -- 172.21.15.5:0/2008468448 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f64a40578e0 con 0x7f64ac15c6e0 2024-09-13T17:13:53.537 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 msgr2=0x7f649806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 0x7f649806d0f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f649c034000 tx=0x7f649c02e000 comp rx=0 tx=0).stop 2024-09-13T17:13:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 msgr2=0x7f64ac0cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c7a0 tx=0x7f64a400cc60 comp rx=0 tx=0).stop 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 shutdown_connections 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f649806ac30 0x7f649806d0f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64ac15c6e0 0x7f64ac0cb840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64ac0cf440 0x7f64ac0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 --2- 172.21.15.5:0/2008468448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64ac0cf000 0x7f64ac145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 >> 172.21.15.5:0/2008468448 conn(0x7f64ac089f90 msgr2=0x7f64ac06aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 shutdown_connections 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.538+0000 7f64b1bbc640 1 -- 172.21.15.5:0/2008468448 wait complete. 2024-09-13T17:13:53.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.651+0000 7f1de1125640 1 Processor -- start 2024-09-13T17:13:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.651+0000 7f1de1125640 1 -- start start 2024-09-13T17:13:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1de1125640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 0x7f1ddc070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1de1125640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ddc070fc0 0x7f1ddc06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1de1125640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc0b1580 con 0x7f1ddc159290 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1de1125640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc071410 con 0x7f1ddc070fc0 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1de1125640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b2ad0 con 0x7f1ddc0b1970 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1ddad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ddc159290 0x7f1ddc159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43288/0 (socket says 172.21.15.5:43288) 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1ddad9d640 1 -- 172.21.15.5:0/2042427159 learned_addr learned my addr 172.21.15.5:0/2042427159 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1ddb59e640 1 --2- 172.21.15.5:0/2042427159 >> v2:172.21.15.179:3300/0 conn(0x7f1ddc070fc0 0x7f1ddc06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dda59c640 1 --2- 172.21.15.5:0/2042427159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 0x7f1ddc070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164247844 0 0) 0x7f1ddc0b1580 con 0x7f1ddc159290 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc4003520 con 0x7f1ddc159290 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dda59c640 1 -- 172.21.15.5:0/2042427159 >> v2:172.21.15.179:3300/0 conn(0x7f1ddc070fc0 msgr2=0x7f1ddc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dda59c640 1 --2- 172.21.15.5:0/2042427159 >> v2:172.21.15.179:3300/0 conn(0x7f1ddc070fc0 0x7f1ddc06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dda59c640 1 -- 172.21.15.5:0/2042427159 >> v1:172.21.15.5:6789/0 conn(0x7f1ddc159290 legacy=0x7f1ddc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397049925 0 0) 0x7f1dc4003520 con 0x7f1ddc159290 2024-09-13T17:13:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.652+0000 7f1dda59c640 1 -- 172.21.15.5:0/2042427159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0b1ec0 con 0x7f1ddc0b1970 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.653+0000 7f1dda59c640 1 --2- 172.21.15.5:0/2042427159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 0x7f1ddc070a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000a940 tx=0x7f1dd002b4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ca09a24558092c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc001670 con 0x7f1ddc0b1970 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd002e050 con 0x7f1ddc0b1970 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1dd9d9b640 1 -- 172.21.15.5:0/2042427159 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0030730 con 0x7f1ddc0b1970 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 -- 172.21.15.5:0/2042427159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 msgr2=0x7f1ddc070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 --2- 172.21.15.5:0/2042427159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 0x7f1ddc070a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000a940 tx=0x7f1dd002b4d0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 -- 172.21.15.5:0/2042427159 shutdown_connections 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 --2- 172.21.15.5:0/2042427159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc0b1970 0x7f1ddc070a80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 --2- 172.21.15.5:0/2042427159 >> v2:172.21.15.179:3300/0 conn(0x7f1ddc070fc0 0x7f1ddc06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 -- 172.21.15.5:0/2042427159 >> 172.21.15.5:0/2042427159 conn(0x7f1ddc0ce0d0 msgr2=0x7f1ddc0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 -- 172.21.15.5:0/2042427159 shutdown_connections 2024-09-13T17:13:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.654+0000 7f1de1125640 1 -- 172.21.15.5:0/2042427159 wait complete. 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 Processor -- start 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 -- start start 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc070fc0 0x7f1ddc1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 0x7f1ddc152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc1526d0 con 0x7f1ddc159290 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc151060 con 0x7f1ddc0b1970 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1de1125640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc147750 con 0x7f1ddc070fc0 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.656+0000 7f1ddb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46686/0 (socket says 172.21.15.5:46686) 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 -- 172.21.15.5:0/2581278629 learned_addr learned my addr 172.21.15.5:0/2581278629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddad9d640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc070fc0 0x7f1ddc1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1dda59c640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 0x7f1ddc152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 -- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc070fc0 msgr2=0x7f1ddc1470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc070fc0 0x7f1ddc1470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 -- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 msgr2=0x7f1ddc152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 0x7f1ddc152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 -- 172.21.15.5:0/2581278629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd000a5a0 con 0x7f1ddc159290 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1dda59c640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 0x7f1ddc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1ddb59e640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400efc0 tx=0x7f1dd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4009ba0 con 0x7f1ddc159290 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400f040 con 0x7f1ddc159290 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40146c0 con 0x7f1ddc159290 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc1512b0 con 0x7f1ddc159290 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.657+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc151870 con 0x7f1ddc159290 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.659+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc0672a0 con 0x7f1ddc159290 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.659+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1dd4014820 con 0x7f1ddc159290 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.659+0000 7f1dc37fe640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 0x7f1dc806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.659+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dd408a030 con 0x7f1ddc159290 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.660+0000 7f1ddad9d640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 0x7f1dc806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.660+0000 7f1ddad9d640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 0x7f1dc806d0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc000f60 tx=0x7f1dcc001de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.664+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1dd4054fb0 con 0x7f1ddc159290 2024-09-13T17:13:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.834+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ddc151a60 con 0x7f1ddc159290 2024-09-13T17:13:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.835+0000 7f1dc37fe640 1 -- 172.21.15.5:0/2581278629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f1dd4018090 con 0x7f1ddc159290 2024-09-13T17:13:53.836 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:53.837 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 msgr2=0x7f1dc806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 0x7f1dc806d0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc000f60 tx=0x7f1dcc001de0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 msgr2=0x7f1ddc0aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400efc0 tx=0x7f1dd400c490 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 shutdown_connections 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dc806ac30 0x7f1dc806d0f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ddc159290 0x7f1ddc0aee70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ddc0b1970 0x7f1ddc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 --2- 172.21.15.5:0/2581278629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ddc070fc0 0x7f1ddc1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 >> 172.21.15.5:0/2581278629 conn(0x7f1ddc0ce0d0 msgr2=0x7f1ddc0adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 shutdown_connections 2024-09-13T17:13:53.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.837+0000 7f1de1125640 1 -- 172.21.15.5:0/2581278629 wait complete. 2024-09-13T17:13:53.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:53.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.954+0000 7fe936d53640 1 Processor -- start 2024-09-13T17:13:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.954+0000 7fe936d53640 1 -- start start 2024-09-13T17:13:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe936d53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe9300cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe936d53640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9301645e0 0x7fe9301669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe936d53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300cf980 con 0x7fe93015c6e0 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe936d53640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300ce570 con 0x7fe9301645e0 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe936d53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d0630 con 0x7fe9300cf000 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe934aef640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe93015c6e0 0x7fe9300cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43292/0 (socket says 172.21.15.5:43292) 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe934aef640 1 -- 172.21.15.5:0/2572045244 learned_addr learned my addr 172.21.15.5:0/2572045244 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:53.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe9352f0640 1 --2- 172.21.15.5:0/2572045244 >> v2:172.21.15.179:3300/0 conn(0x7fe9301645e0 0x7fe9301669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe9300cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397650077 0 0) 0x7fe9300cf980 con 0x7fe93015c6e0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe920003520 con 0x7fe93015c6e0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350487503 0 0) 0x7fe920003520 con 0x7fe93015c6e0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 msgr2=0x7fe9300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe9300cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 >> v2:172.21.15.179:3300/0 conn(0x7fe9301645e0 msgr2=0x7fe9301669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 --2- 172.21.15.5:0/2572045244 >> v2:172.21.15.179:3300/0 conn(0x7fe9301645e0 0x7fe9301669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300d0910 con 0x7fe93015c6e0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.955+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe924001670 con 0x7fe93015c6e0 2024-09-13T17:13:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 >> v1:172.21.15.5:6789/0 conn(0x7fe93015c6e0 legacy=0x7fe9300cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe920003970 0x7fe920003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9200047c0 0x7fe920004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe920005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300ce570 con 0x7fe920003970 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300d0630 con 0x7fe9200047c0 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92000b980 con 0x7fe9300cf000 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe920003970 0x7fe920003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9200047c0 0x7fe920004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe9352f0640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe920005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 -- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 msgr2=0x7fe920005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe920005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 -- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9200047c0 msgr2=0x7fe920004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9200047c0 0x7fe920004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe934aef640 1 -- 172.21.15.5:0/2572045244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920003520 con 0x7fe920003970 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe9352f0640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9300cf000 0x7fe920005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.956+0000 7fe92ffff640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9200047c0 0x7fe920004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe934aef640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe920003970 0x7fe920003d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c240 tx=0x7fe9200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573951db0b761a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924005ad0 con 0x7fe920003970 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924005c30 con 0x7fe920003970 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe92f7fe640 1 -- 172.21.15.5:0/2572045244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924007070 con 0x7fe920003970 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 -- 172.21.15.5:0/2572045244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe920003970 msgr2=0x7fe920003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 --2- 172.21.15.5:0/2572045244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe920003970 0x7fe920003d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c240 tx=0x7fe9200057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe9352f0640 1 -- 172.21.15.5:0/2572045244 reap_dead start 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 -- 172.21.15.5:0/2572045244 shutdown_connections 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 -- 172.21.15.5:0/2572045244 >> 172.21.15.5:0/2572045244 conn(0x7fe930089f90 msgr2=0x7fe9300d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 -- 172.21.15.5:0/2572045244 shutdown_connections 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.957+0000 7fe936d53640 1 -- 172.21.15.5:0/2572045244 wait complete. 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 Processor -- start 2024-09-13T17:13:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 -- start start 2024-09-13T17:13:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe920003970 0x7fe930153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe930163540 0x7fe9301639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301f2310 con 0x7fe93006c3f0 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.959+0000 7fe936d53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930163f00 con 0x7fe930163540 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe936d53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300b6e60 con 0x7fe920003970 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46700/0 (socket says 172.21.15.5:46700) 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 -- 172.21.15.5:0/4161617538 learned_addr learned my addr 172.21.15.5:0/4161617538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe934aef640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe920003970 0x7fe930153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe9352f0640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe930163540 0x7fe9301639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 -- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe920003970 msgr2=0x7fe930153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe920003970 0x7fe930153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 -- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe930163540 msgr2=0x7fe9301639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe930163540 0x7fe9301639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 -- 172.21.15.5:0/4161617538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93006c870 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92ffff640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011540 tx=0x7fe91c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c015870 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0159d0 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9300b36b0 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c015d40 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.960+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300b6530 con 0x7fe93006c3f0 2024-09-13T17:13:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.961+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9300672e0 con 0x7fe93006c3f0 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.962+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe91c01d400 con 0x7fe93006c3f0 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.962+0000 7fe92d7fa640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 0x7fe91406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.962+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe91c089d90 con 0x7fe93006c3f0 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.962+0000 7fe934aef640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 0x7fe91406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.963+0000 7fe934aef640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 0x7fe91406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe924033000 tx=0x7fe924009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:53.966+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe91c054c80 con 0x7fe93006c3f0 2024-09-13T17:13:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.135+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9300b6fd0 con 0x7fe93006c3f0 2024-09-13T17:13:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.135+0000 7fe92d7fa640 1 -- 172.21.15.5:0/4161617538 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe91c0582a0 con 0x7fe93006c3f0 2024-09-13T17:13:54.136 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 msgr2=0x7fe91406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 0x7fe91406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe924033000 tx=0x7fe924009030 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 msgr2=0x7fe9300b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe91c011540 tx=0x7fe91c011a00 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 shutdown_connections 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe930163540 0x7fe9301639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe91406ac00 0x7fe91406d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93006c3f0 0x7fe9300b3170 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 --2- 172.21.15.5:0/4161617538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe920003970 0x7fe930153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 >> 172.21.15.5:0/4161617538 conn(0x7fe930089f90 msgr2=0x7fe9300730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 shutdown_connections 2024-09-13T17:13:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.137+0000 7fe936d53640 1 -- 172.21.15.5:0/4161617538 wait complete. 2024-09-13T17:13:54.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:54.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.252+0000 7fc2f5a80640 1 Processor -- start 2024-09-13T17:13:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.252+0000 7fc2f5a80640 1 -- start start 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2f5a80640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2f006a5a0 0x7fc2f00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2f5a80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f015aaa0 0x7fc2f00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2f5a80640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00ac650 con 0x7fc2f0143740 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2f5a80640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f0144100 con 0x7fc2f006a5a0 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2f5a80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0143b20 con 0x7fc2f015aaa0 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2eeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2f006a5a0 0x7fc2f00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2ef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2f0143740 0x7fc2f0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43304/0 (socket says 172.21.15.5:43304) 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2eeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2f006a5a0 0x7fc2f00ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46704/0 (socket says 172.21.15.5:46704) 2024-09-13T17:13:54.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.253+0000 7fc2ef7fe640 1 -- 172.21.15.5:0/2494943323 learned_addr learned my addr 172.21.15.5:0/2494943323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2effff640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f015aaa0 0x7fc2f00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2eeffd640 1 -- 172.21.15.5:0/2494943323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f015aaa0 msgr2=0x7fc2f00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2eeffd640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f015aaa0 0x7fc2f00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2eeffd640 1 -- 172.21.15.5:0/2494943323 >> v1:172.21.15.5:6789/0 conn(0x7fc2f0143740 legacy=0x7fc2f0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2ee7fc640 1 -- 172.21.15.5:0/2494943323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624571884 0 0) 0x7fc2e0001110 con 0x7fc2f0143740 2024-09-13T17:13:54.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2eeffd640 1 -- 172.21.15.5:0/2494943323 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00b2130 con 0x7fc2f006a5a0 2024-09-13T17:13:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.254+0000 7fc2eeffd640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00ae580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097a0 tx=0x7fc2e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6c9aa07e868d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2ee7fc640 1 -- 172.21.15.5:0/2494943323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4032440 con 0x7fc2f006a5a0 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2ee7fc640 1 -- 172.21.15.5:0/2494943323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40325a0 con 0x7fc2f006a5a0 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2ee7fc640 1 -- 172.21.15.5:0/2494943323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4032930 con 0x7fc2f006a5a0 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 -- 172.21.15.5:0/2494943323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f006a5a0 msgr2=0x7fc2f00ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00ae580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097a0 tx=0x7fc2e402a210 comp rx=0 tx=0).stop 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 -- 172.21.15.5:0/2494943323 shutdown_connections 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f015aaa0 0x7fc2f00ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/2494943323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00ae580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 -- 172.21.15.5:0/2494943323 >> 172.21.15.5:0/2494943323 conn(0x7fc2f00b4650 msgr2=0x7fc2f00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 -- 172.21.15.5:0/2494943323 shutdown_connections 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.255+0000 7fc2f5a80640 1 -- 172.21.15.5:0/2494943323 wait complete. 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.256+0000 7fc2f5a80640 1 Processor -- start 2024-09-13T17:13:54.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 -- start start 2024-09-13T17:13:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0143740 0x7fc2f00b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00aee40 con 0x7fc2f015aaa0 2024-09-13T17:13:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00af0b0 con 0x7fc2f006a5a0 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2f5a80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00af390 con 0x7fc2f0143740 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.257+0000 7fc2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46718/0 (socket says 172.21.15.5:46718) 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 -- 172.21.15.5:0/358513566 learned_addr learned my addr 172.21.15.5:0/358513566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2eeffd640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0143740 0x7fc2f00b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2ef7fe640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 -- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0143740 msgr2=0x7fc2f00b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0143740 0x7fc2f00b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 -- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 msgr2=0x7fc2f00b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 -- 172.21.15.5:0/358513566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009400 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2ef7fe640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2effff640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800efc0 tx=0x7fc2e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8009ba0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800f040 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00af670 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80146c0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.258+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f0159e50 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.259+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f00af8b0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.260+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2e8014820 con 0x7fc2f015aaa0 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.260+0000 7fc2d7fff640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 0x7fc2dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.260+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2e808a0c0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.261+0000 7fc2ef7fe640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 0x7fc2dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.261+0000 7fc2ef7fe640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 0x7fc2dc06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f60 tx=0x7fc2e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.265+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2f00af8b0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.435+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2f00af8b0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.435+0000 7fc2d7fff640 1 -- 172.21.15.5:0/358513566 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2f00af8b0 con 0x7fc2f015aaa0 2024-09-13T17:13:54.436 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 msgr2=0x7fc2dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 0x7fc2dc06d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f60 tx=0x7fc2e0009040 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 msgr2=0x7fc2f01f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800efc0 tx=0x7fc2e800c490 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 shutdown_connections 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2dc06ac00 0x7fc2dc06d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f015aaa0 0x7fc2f01f15c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f0143740 0x7fc2f00b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 --2- 172.21.15.5:0/358513566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f006a5a0 0x7fc2f00b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 >> 172.21.15.5:0/358513566 conn(0x7fc2f00b4650 msgr2=0x7fc2f01427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 shutdown_connections 2024-09-13T17:13:54.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.437+0000 7fc2f5a80640 1 -- 172.21.15.5:0/358513566 wait complete. 2024-09-13T17:13:54.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.552+0000 7fd68ef5a640 1 Processor -- start 2024-09-13T17:13:54.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.552+0000 7fd68ef5a640 1 -- start start 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68ef5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd688069e90 0x7fd6880b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68ef5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd68815d850 0x7fd6880ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68ef5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880b27f0 con 0x7fd6880ae7b0 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68ef5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68806ed60 con 0x7fd68815d850 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68ef5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880b40d0 con 0x7fd688069e90 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68d4f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd68815d850 0x7fd6880ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68d4f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd68815d850 0x7fd6880ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46732/0 (socket says 172.21.15.5:46732) 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.553+0000 7fd68d4f7640 1 -- 172.21.15.5:0/2934178904 learned_addr learned my addr 172.21.15.5:0/2934178904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68ccf6640 1 --2- 172.21.15.5:0/2934178904 >> v2:172.21.15.179:3300/0 conn(0x7fd688069e90 0x7fd6880b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68d4f7640 1 -- 172.21.15.5:0/2934178904 >> v2:172.21.15.179:3300/0 conn(0x7fd688069e90 msgr2=0x7fd6880b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:54.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68d4f7640 1 --2- 172.21.15.5:0/2934178904 >> v2:172.21.15.179:3300/0 conn(0x7fd688069e90 0x7fd6880b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68d4f7640 1 -- 172.21.15.5:0/2934178904 >> v1:172.21.15.179:6789/0 conn(0x7fd6880ae7b0 legacy=0x7fd68806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:54.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68d4f7640 1 -- 172.21.15.5:0/2934178904 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880ae390 con 0x7fd68815d850 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.554+0000 7fd68d4f7640 1 --2- 172.21.15.5:0/2934178904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68815d850 0x7fd6880ac110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd688070ee0 tx=0x7fd68002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946360ff3f5f2c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd6877fe640 1 -- 172.21.15.5:0/2934178904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680031600 con 0x7fd68815d850 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd6877fe640 1 -- 172.21.15.5:0/2934178904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68002d050 con 0x7fd68815d850 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd6877fe640 1 -- 172.21.15.5:0/2934178904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680031980 con 0x7fd68815d850 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 -- 172.21.15.5:0/2934178904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68815d850 msgr2=0x7fd6880ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/2934178904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68815d850 0x7fd6880ac110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd688070ee0 tx=0x7fd68002a6f0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 -- 172.21.15.5:0/2934178904 shutdown_connections 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/2934178904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68815d850 0x7fd6880ac110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/2934178904 >> v2:172.21.15.179:3300/0 conn(0x7fd688069e90 0x7fd6880b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 -- 172.21.15.5:0/2934178904 >> 172.21.15.5:0/2934178904 conn(0x7fd6880b4650 msgr2=0x7fd6880b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 -- 172.21.15.5:0/2934178904 shutdown_connections 2024-09-13T17:13:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.555+0000 7fd68ef5a640 1 -- 172.21.15.5:0/2934178904 wait complete. 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.556+0000 7fd68ef5a640 1 Processor -- start 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.556+0000 7fd68ef5a640 1 -- start start 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6880ae7b0 0x7fd6881543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68815d850 0x7fd688145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881467b0 con 0x7fd688069e90 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688146a90 con 0x7fd6880ae7b0 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ef5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd688153ba0 con 0x7fd68815d850 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ccf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ccf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46734/0 (socket says 172.21.15.5:46734) 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.557+0000 7fd68ccf6640 1 -- 172.21.15.5:0/3486608979 learned_addr learned my addr 172.21.15.5:0/3486608979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd687fff640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6880ae7b0 0x7fd6881543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68d4f7640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68815d850 0x7fd688145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 -- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68815d850 msgr2=0x7fd688145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68815d850 0x7fd688145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 -- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6880ae7b0 msgr2=0x7fd6881543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6880ae7b0 0x7fd6881543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 -- 172.21.15.5:0/3486608979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680009b30 con 0x7fd688069e90 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ccf6640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7f0 tx=0x7fd67800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004220 con 0x7fd688069e90 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6780043a0 con 0x7fd688069e90 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678007860 con 0x7fd688069e90 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688153e80 con 0x7fd688069e90 2024-09-13T17:13:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.558+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd688151480 con 0x7fd688069e90 2024-09-13T17:13:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.559+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880672a0 con 0x7fd688069e90 2024-09-13T17:13:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.560+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd678007bd0 con 0x7fd688069e90 2024-09-13T17:13:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.560+0000 7fd6857fa640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 0x7fd67406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.560+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd678089590 con 0x7fd688069e90 2024-09-13T17:13:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.560+0000 7fd687fff640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 0x7fd67406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.561+0000 7fd687fff640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 0x7fd67406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c88e0 tx=0x7fd67c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.564+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd678054520 con 0x7fd688069e90 2024-09-13T17:13:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.733+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6880ac110 con 0x7fd688069e90 2024-09-13T17:13:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.733+0000 7fd6857fa640 1 -- 172.21.15.5:0/3486608979 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd678057b40 con 0x7fd688069e90 2024-09-13T17:13:54.734 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 msgr2=0x7fd67406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 0x7fd67406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c88e0 tx=0x7fd67c009040 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 msgr2=0x7fd688143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7f0 tx=0x7fd67800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 shutdown_connections 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd68815d850 0x7fd688145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6880ae7b0 0x7fd6881543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd67406ac00 0x7fd67406d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 --2- 172.21.15.5:0/3486608979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd688069e90 0x7fd688143560 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 >> 172.21.15.5:0/3486608979 conn(0x7fd6880b4650 msgr2=0x7fd68806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 shutdown_connections 2024-09-13T17:13:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.735+0000 7fd68ef5a640 1 -- 172.21.15.5:0/3486608979 wait complete. 2024-09-13T17:13:54.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.850+0000 7f141085a640 1 Processor -- start 2024-09-13T17:13:54.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.850+0000 7f141085a640 1 -- start start 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f141085a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f140c0adf40 0x7f140c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f141085a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 0x7f140c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f141085a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0b1ac0 con 0x7f140c0b2230 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f141085a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c15cf70 con 0x7f140c0adf40 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f141085a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c15d210 con 0x7f140c0ae320 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f140c0adf40 0x7f140c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f140c0b2230 0x7f140c06df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43306/0 (socket says 172.21.15.5:43306) 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140ad9d640 1 -- 172.21.15.5:0/2672912815 learned_addr learned my addr 172.21.15.5:0/2672912815 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f1409d9b640 1 --2- 172.21.15.5:0/2672912815 >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 0x7f140c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140a59c640 1 -- 172.21.15.5:0/2672912815 >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 msgr2=0x7f140c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140a59c640 1 --2- 172.21.15.5:0/2672912815 >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 0x7f140c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140a59c640 1 -- 172.21.15.5:0/2672912815 >> v1:172.21.15.5:6789/0 conn(0x7f140c0b2230 legacy=0x7f140c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.851+0000 7f140a59c640 1 -- 172.21.15.5:0/2672912815 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c15d4f0 con 0x7f140c0adf40 2024-09-13T17:13:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.852+0000 7f1409d9b640 1 --2- 172.21.15.5:0/2672912815 >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 0x7f140c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.852+0000 7f140a59c640 1 --2- 172.21.15.5:0/2672912815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0adf40 0x7f140c160a50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f140c066400 tx=0x7f140402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6053fdfed3a02e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.852+0000 7f140959a640 1 -- 172.21.15.5:0/2672912815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404032440 con 0x7f140c0adf40 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.852+0000 7f140959a640 1 -- 172.21.15.5:0/2672912815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040325a0 con 0x7f140c0adf40 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.852+0000 7f140959a640 1 -- 172.21.15.5:0/2672912815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404032930 con 0x7f140c0adf40 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 -- 172.21.15.5:0/2672912815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0adf40 msgr2=0x7f140c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 --2- 172.21.15.5:0/2672912815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0adf40 0x7f140c160a50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f140c066400 tx=0x7f140402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 -- 172.21.15.5:0/2672912815 shutdown_connections 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 --2- 172.21.15.5:0/2672912815 >> v2:172.21.15.179:3300/0 conn(0x7f140c0ae320 0x7f140c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 --2- 172.21.15.5:0/2672912815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0adf40 0x7f140c160a50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 -- 172.21.15.5:0/2672912815 >> 172.21.15.5:0/2672912815 conn(0x7f140c070af0 msgr2=0x7f140c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 -- 172.21.15.5:0/2672912815 shutdown_connections 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.853+0000 7f141085a640 1 -- 172.21.15.5:0/2672912815 wait complete. 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.854+0000 7f141085a640 1 Processor -- start 2024-09-13T17:13:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.854+0000 7f141085a640 1 -- start start 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 0x7f140c142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ae320 0x7f140c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c144550 con 0x7f140c0b2230 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1438d0 con 0x7f140c0ae320 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f141085a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c143bb0 con 0x7f140c0adf40 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f140ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f140ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46758/0 (socket says 172.21.15.5:46758) 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f140ad9d640 1 -- 172.21.15.5:0/484472474 learned_addr learned my addr 172.21.15.5:0/484472474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f1409d9b640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ae320 0x7f140c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f140ad9d640 1 -- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 msgr2=0x7f140c142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.855+0000 7f140a59c640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 0x7f140c142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140ad9d640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 0x7f140c142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140ad9d640 1 -- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ae320 msgr2=0x7f140c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140ad9d640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ae320 0x7f140c142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140ad9d640 1 -- 172.21.15.5:0/484472474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009400 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140a59c640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 0x7f140c142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f140ad9d640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00ca80 tx=0x7f13fc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00ac30 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00ad90 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c143e90 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012600 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.856+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c142a70 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.857+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0672e0 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.857+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13fc007070 con 0x7f140c0b2230 2024-09-13T17:13:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.858+0000 7f1402ffd640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 0x7f13ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.858+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13fc089460 con 0x7f140c0b2230 2024-09-13T17:13:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.858+0000 7f140a59c640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 0x7f13ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.859+0000 7f140a59c640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 0x7f13ec06d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1404034000 tx=0x7f140402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:54.862+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13fc054380 con 0x7f140c0b2230 2024-09-13T17:13:55.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.031+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f140c144690 con 0x7f140c0b2230 2024-09-13T17:13:55.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.031+0000 7f1402ffd640 1 -- 172.21.15.5:0/484472474 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f140c144690 con 0x7f140c0b2230 2024-09-13T17:13:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:55.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 msgr2=0x7f13ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 0x7f13ec06d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1404034000 tx=0x7f140402e000 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 msgr2=0x7f140c15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00ca80 tx=0x7f13fc00cf40 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 shutdown_connections 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13ec06ac00 0x7f13ec06d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b2230 0x7f140c15eb90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f140c0ae320 0x7f140c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 --2- 172.21.15.5:0/484472474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f140c0adf40 0x7f140c142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 >> 172.21.15.5:0/484472474 conn(0x7f140c070af0 msgr2=0x7f140c0ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 shutdown_connections 2024-09-13T17:13:55.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.033+0000 7f141085a640 1 -- 172.21.15.5:0/484472474 wait complete. 2024-09-13T17:13:55.067 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-09-13T17:13:55.067 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:13:55.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:55.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.168+0000 7fb6a4f45640 1 Processor -- start 2024-09-13T17:13:55.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.168+0000 7fb6a4f45640 1 -- start start 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb6a4f45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 0x7fb6a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb6a4f45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6a006c320 0x7fb6a00ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb6a4f45640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a006d410 con 0x7fb6a00ab5a0 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb6a4f45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a00aba50 con 0x7fb6a006c320 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb6a4f45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a006cb70 con 0x7fb6a015a3e0 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6a00ab5a0 0x7fb6a015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43310/0 (socket says 172.21.15.5:43310) 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69ed9d640 1 -- 172.21.15.5:0/2150997437 learned_addr learned my addr 172.21.15.5:0/2150997437 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69e59c640 1 --2- 172.21.15.5:0/2150997437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 0x7fb6a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb697fff640 1 --2- 172.21.15.5:0/2150997437 >> v2:172.21.15.179:3300/0 conn(0x7fb6a006c320 0x7fb6a00ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051151617 0 0) 0x7fb6a006d410 con 0x7fb6a00ab5a0 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb68c003520 con 0x7fb6a00ab5a0 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69e59c640 1 -- 172.21.15.5:0/2150997437 >> v2:172.21.15.179:3300/0 conn(0x7fb6a006c320 msgr2=0x7fb6a00ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69e59c640 1 --2- 172.21.15.5:0/2150997437 >> v2:172.21.15.179:3300/0 conn(0x7fb6a006c320 0x7fb6a00ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69e59c640 1 -- 172.21.15.5:0/2150997437 >> v1:172.21.15.5:6789/0 conn(0x7fb6a00ab5a0 legacy=0x7fb6a015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.169+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360875812 0 0) 0x7fb68c003520 con 0x7fb6a00ab5a0 2024-09-13T17:13:55.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.170+0000 7fb69e59c640 1 -- 172.21.15.5:0/2150997437 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a006ce50 con 0x7fb6a015a3e0 2024-09-13T17:13:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.170+0000 7fb69e59c640 1 --2- 172.21.15.5:0/2150997437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 0x7fb6a006e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6900097a0 tx=0x7fb69002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fcea5105037949 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.170+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980019f0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69002aba0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb69dd9b640 1 -- 172.21.15.5:0/2150997437 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690032440 con 0x7fb6a015a3e0 2024-09-13T17:13:55.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 -- 172.21.15.5:0/2150997437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 msgr2=0x7fb6a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/2150997437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 0x7fb6a006e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6900097a0 tx=0x7fb69002a110 comp rx=0 tx=0).stop 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 -- 172.21.15.5:0/2150997437 shutdown_connections 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/2150997437 >> v2:172.21.15.179:3300/0 conn(0x7fb6a006c320 0x7fb6a00ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/2150997437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a015a3e0 0x7fb6a006e090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 -- 172.21.15.5:0/2150997437 >> 172.21.15.5:0/2150997437 conn(0x7fb6a00ce0d0 msgr2=0x7fb6a00ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 -- 172.21.15.5:0/2150997437 shutdown_connections 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.171+0000 7fb6a4f45640 1 -- 172.21.15.5:0/2150997437 wait complete. 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.172+0000 7fb6a4f45640 1 Processor -- start 2024-09-13T17:13:55.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.172+0000 7fb6a4f45640 1 -- start start 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a006c320 0x7fb6a0159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 0x7fb6a014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a01f4390 con 0x7fb6a015a3e0 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a01f0e30 con 0x7fb6a00ab5a0 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb6a4f45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a01f35d0 con 0x7fb6a006c320 2024-09-13T17:13:55.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb69ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb69ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46766/0 (socket says 172.21.15.5:46766) 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb69ed9d640 1 -- 172.21.15.5:0/4061844544 learned_addr learned my addr 172.21.15.5:0/4061844544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb69e59c640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a006c320 0x7fb6a0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.173+0000 7fb697fff640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 0x7fb6a014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 -- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a006c320 msgr2=0x7fb6a0159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a006c320 0x7fb6a0159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 -- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 msgr2=0x7fb6a014d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 0x7fb6a014d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 -- 172.21.15.5:0/4061844544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009400 con 0x7fb6a015a3e0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb697fff640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 0x7fb6a014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb69ed9d640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb69800cc70 tx=0x7fb69800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800ce80 con 0x7fb6a015a3e0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698012400 con 0x7fb6a015a3e0 2024-09-13T17:13:55.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a01f38b0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980127b0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.174+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a01f3e70 con 0x7fb6a015a3e0 2024-09-13T17:13:55.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.175+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a01f4090 con 0x7fb6a015a3e0 2024-09-13T17:13:55.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.176+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb698007070 con 0x7fb6a015a3e0 2024-09-13T17:13:55.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.176+0000 7fb696ffd640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 0x7fb68006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.176+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6980896d0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.176+0000 7fb69e59c640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 0x7fb68006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.177+0000 7fb69e59c640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 0x7fb68006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb690034000 tx=0x7fb69002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.180+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb698054700 con 0x7fb6a015a3e0 2024-09-13T17:13:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.352+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6a00672a0 con 0x7fb6a015a3e0 2024-09-13T17:13:55.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.354+0000 7fb696ffd640 1 -- 172.21.15.5:0/4061844544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fb698057d20 con 0x7fb6a015a3e0 2024-09-13T17:13:55.355 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:55.355 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:12.548476+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:55.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.355+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 msgr2=0x7fb68006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.355+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 0x7fb68006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb690034000 tx=0x7fb69002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:55.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.355+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 msgr2=0x7fb6a014ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.355+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb69800cc70 tx=0x7fb69800a430 comp rx=0 tx=0).stop 2024-09-13T17:13:55.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 shutdown_connections 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb68006ac00 0x7fb68006d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a015a3e0 0x7fb6a014ddf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6a00ab5a0 0x7fb6a014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 --2- 172.21.15.5:0/4061844544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a006c320 0x7fb6a0159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 >> 172.21.15.5:0/4061844544 conn(0x7fb6a00ce0d0 msgr2=0x7fb6a0154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 shutdown_connections 2024-09-13T17:13:55.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.356+0000 7fb6a4f45640 1 -- 172.21.15.5:0/4061844544 wait complete. 2024-09-13T17:13:55.367 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:55.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.476+0000 7f2583de2640 1 Processor -- start 2024-09-13T17:13:55.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.476+0000 7f2583de2640 1 -- start start 2024-09-13T17:13:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f2583de2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c0b1ac0 0x7f257c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f2583de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f2583de2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0b35f0 con 0x7f257c06eb80 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f2583de2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c160020 con 0x7f257c0b1ac0 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f2583de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c156f50 con 0x7f257c06ef60 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f258137d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c0b1ac0 0x7f257c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f258137d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257c0b1ac0 0x7f257c15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46772/0 (socket says 172.21.15.5:46772) 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.477+0000 7f258137d640 1 -- 172.21.15.5:0/1836387083 learned_addr learned my addr 172.21.15.5:0/1836387083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258137d640 1 -- 172.21.15.5:0/1836387083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 msgr2=0x7f257c06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258237f640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258137d640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258137d640 1 -- 172.21.15.5:0/1836387083 >> v1:172.21.15.179:6789/0 conn(0x7f257c06eb80 legacy=0x7f257c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258137d640 1 -- 172.21.15.5:0/1836387083 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0b1fa0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f258137d640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c15ca30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2570009870 tx=0x7f257002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccf94746cfbe9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f2580b7c640 1 -- 172.21.15.5:0/1836387083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570032440 con 0x7f257c0b1ac0 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f2580b7c640 1 -- 172.21.15.5:0/1836387083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700325a0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.478+0000 7f2580b7c640 1 -- 172.21.15.5:0/1836387083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570032930 con 0x7f257c0b1ac0 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 -- 172.21.15.5:0/1836387083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 msgr2=0x7f257c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c15ca30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2570009870 tx=0x7f257002a210 comp rx=0 tx=0).stop 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 -- 172.21.15.5:0/1836387083 shutdown_connections 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c06aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 --2- 172.21.15.5:0/1836387083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c15ca30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 -- 172.21.15.5:0/1836387083 >> 172.21.15.5:0/1836387083 conn(0x7f257c070af0 msgr2=0x7f257c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 -- 172.21.15.5:0/1836387083 shutdown_connections 2024-09-13T17:13:55.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.479+0000 7f2583de2640 1 -- 172.21.15.5:0/1836387083 wait complete. 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.480+0000 7f2583de2640 1 Processor -- start 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.480+0000 7f2583de2640 1 -- start start 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f257c06eb80 0x7f257c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0cdcd0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c149f30 con 0x7f257c06eb80 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2583de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0cc6f0 con 0x7f257c06ef60 2024-09-13T17:13:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46776/0 (socket says 172.21.15.5:46776) 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 -- 172.21.15.5:0/2177122322 learned_addr learned my addr 172.21.15.5:0/2177122322 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258137d640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f2581b7e640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f257c06eb80 0x7f257c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 -- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 msgr2=0x7f257c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 -- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f257c06eb80 msgr2=0x7f257c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f257c06eb80 0x7f257c15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.481+0000 7f258237f640 1 -- 172.21.15.5:0/2177122322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700094d0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f258237f640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f257400cd40 tx=0x7f257400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574003b90 con 0x7f257c0b1ac0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574003cf0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0cc9d0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574004240 con 0x7f257c0b1ac0 2024-09-13T17:13:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.482+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0ccf90 con 0x7f257c0b1ac0 2024-09-13T17:13:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.483+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c0672e0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.483+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25740043a0 con 0x7f257c0b1ac0 2024-09-13T17:13:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.484+0000 7f257a7fc640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 0x7f256806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.484+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2574012070 con 0x7f257c0b1ac0 2024-09-13T17:13:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.484+0000 7f2581b7e640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 0x7f256806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.484+0000 7f2581b7e640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 0x7f256806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f256c004ea0 tx=0x7f256c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.488+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2574054f30 con 0x7f257c0b1ac0 2024-09-13T17:13:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.657+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f257c15ca30 con 0x7f257c0b1ac0 2024-09-13T17:13:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.657+0000 7f257a7fc640 1 -- 172.21.15.5:0/2177122322 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2574058550 con 0x7f257c0b1ac0 2024-09-13T17:13:55.659 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:55.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 msgr2=0x7f256806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 0x7f256806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f256c004ea0 tx=0x7f256c009040 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 msgr2=0x7f257c0cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f257400cd40 tx=0x7f257400a660 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 shutdown_connections 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f256806ac00 0x7f256806d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257c0b1ac0 0x7f257c0cd790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f257c06ef60 0x7f257c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 --2- 172.21.15.5:0/2177122322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f257c06eb80 0x7f257c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 >> 172.21.15.5:0/2177122322 conn(0x7f257c070af0 msgr2=0x7f257c15eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 shutdown_connections 2024-09-13T17:13:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.659+0000 7f2583de2640 1 -- 172.21.15.5:0/2177122322 wait complete. 2024-09-13T17:13:55.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:55.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.774+0000 7f8874983640 1 Processor -- start 2024-09-13T17:13:55.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.774+0000 7f8874983640 1 -- start start 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.775+0000 7f8874983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88700b1ac0 0x7f887015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.775+0000 7f8874983640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f887006ef60 0x7f887006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.775+0000 7f8874983640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700b35f0 con 0x7f887006eb80 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.775+0000 7f8874983640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870160020 con 0x7f887006ef60 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.775+0000 7f8874983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870156f50 con 0x7f88700b1ac0 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f887006ef60 0x7f887006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f887006eb80 0x7f88700b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43312/0 (socket says 172.21.15.5:43312) 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886e59c640 1 -- 172.21.15.5:0/2158914615 learned_addr learned my addr 172.21.15.5:0/2158914615 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886dd9b640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88700b1ac0 0x7f887015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886ed9d640 1 -- 172.21.15.5:0/2158914615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88700b1ac0 msgr2=0x7f887015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886ed9d640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88700b1ac0 0x7f887015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886ed9d640 1 -- 172.21.15.5:0/2158914615 >> v1:172.21.15.5:6789/0 conn(0x7f887006eb80 legacy=0x7f88700b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886ed9d640 1 -- 172.21.15.5:0/2158914615 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700b1fa0 con 0x7f887006ef60 2024-09-13T17:13:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.776+0000 7f886d59a640 1 -- 172.21.15.5:0/2158914615 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791266596 0 0) 0x7f88700b35f0 con 0x7f887006eb80 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f886ed9d640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006ef60 0x7f887006aea0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8868009d90 tx=0x7f886802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19f7c8b74d82636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f886d59a640 1 -- 172.21.15.5:0/2158914615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868007740 con 0x7f887006ef60 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f886d59a640 1 -- 172.21.15.5:0/2158914615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886802d050 con 0x7f887006ef60 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f886d59a640 1 -- 172.21.15.5:0/2158914615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868007ac0 con 0x7f887006ef60 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 -- 172.21.15.5:0/2158914615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006ef60 msgr2=0x7f887006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006ef60 0x7f887006aea0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8868009d90 tx=0x7f886802a660 comp rx=0 tx=0).stop 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 -- 172.21.15.5:0/2158914615 shutdown_connections 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006ef60 0x7f887006aea0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 --2- 172.21.15.5:0/2158914615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88700b1ac0 0x7f887015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 -- 172.21.15.5:0/2158914615 >> 172.21.15.5:0/2158914615 conn(0x7f8870070af0 msgr2=0x7f8870070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 -- 172.21.15.5:0/2158914615 shutdown_connections 2024-09-13T17:13:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.777+0000 7f8874983640 1 -- 172.21.15.5:0/2158914615 wait complete. 2024-09-13T17:13:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.779+0000 7f8874983640 1 Processor -- start 2024-09-13T17:13:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.779+0000 7f8874983640 1 -- start start 2024-09-13T17:13:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.779+0000 7f8874983640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.779+0000 7f8874983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887006ef60 0x7f88700cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.779+0000 7f8874983640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 0x7f8870158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f8874983640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870158500 con 0x7f887006eb80 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f8874983640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870158070 con 0x7f88700b1ac0 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f8874983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870157460 con 0x7f887006ef60 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46802/0 (socket says 172.21.15.5:46802) 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 -- 172.21.15.5:0/3752578361 learned_addr learned my addr 172.21.15.5:0/3752578361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886dd9b640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887006ef60 0x7f88700cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886ed9d640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 0x7f8870158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 -- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887006ef60 msgr2=0x7f88700cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887006ef60 0x7f88700cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 -- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 msgr2=0x7f8870158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 0x7f8870158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 -- 172.21.15.5:0/3752578361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009a70 con 0x7f887006eb80 2024-09-13T17:13:55.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886ed9d640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 0x7f8870158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f886e59c640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f886000c430 tx=0x7f886000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600074e0 con 0x7f887006eb80 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860007660 con 0x7f887006eb80 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870157740 con 0x7f887006eb80 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860004a20 con 0x7f887006eb80 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.780+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870157d00 con 0x7f887006eb80 2024-09-13T17:13:55.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.781+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88700672e0 con 0x7f887006eb80 2024-09-13T17:13:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.782+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8860004b80 con 0x7f887006eb80 2024-09-13T17:13:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.782+0000 7f885effd640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 0x7f885006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.782+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8860089570 con 0x7f887006eb80 2024-09-13T17:13:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.783+0000 7f886dd9b640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 0x7f885006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.783+0000 7f886dd9b640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 0x7f885006d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88700cd360 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.786+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f88600542f0 con 0x7f887006eb80 2024-09-13T17:13:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.958+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f887006e780 con 0x7f887006eb80 2024-09-13T17:13:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.958+0000 7f885effd640 1 -- 172.21.15.5:0/3752578361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8860057910 con 0x7f887006eb80 2024-09-13T17:13:55.959 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 msgr2=0x7f885006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 0x7f885006d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88700cd360 tx=0x7f8864008040 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 msgr2=0x7f88701494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f886000c430 tx=0x7f886000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 shutdown_connections 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88700b1ac0 0x7f8870158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f887006ef60 0x7f88700cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f885006ac00 0x7f885006d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 --2- 172.21.15.5:0/3752578361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887006eb80 0x7f88701494a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 >> 172.21.15.5:0/3752578361 conn(0x7f8870070af0 msgr2=0x7f887015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 shutdown_connections 2024-09-13T17:13:55.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:55.960+0000 7f8874983640 1 -- 172.21.15.5:0/3752578361 wait complete. 2024-09-13T17:13:55.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.075+0000 7fdc6fb9c640 1 Processor -- start 2024-09-13T17:13:56.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.075+0000 7fdc6fb9c640 1 -- start start 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6fb9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc6815a060 0x7fdc6815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6fb9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc6806aea0 0x7fdc6806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6fb9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6806b830 con 0x7fdc680cc730 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6fb9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680b1ff0 con 0x7fdc6806aea0 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6fb9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680cd470 con 0x7fdc6815a060 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6e139640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc6806aea0 0x7fdc6806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6e139640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc6806aea0 0x7fdc6806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46810/0 (socket says 172.21.15.5:46810) 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6e139640 1 -- 172.21.15.5:0/2638856555 learned_addr learned my addr 172.21.15.5:0/2638856555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.076+0000 7fdc6d137640 1 --1- 172.21.15.5:0/2638856555 >> v1:172.21.15.5:6789/0 conn(0x7fdc680cc730 0x7fdc680b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43314/0 (socket says 172.21.15.5:43314) 2024-09-13T17:13:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.077+0000 7fdc6d938640 1 --2- 172.21.15.5:0/2638856555 >> v2:172.21.15.179:3300/0 conn(0x7fdc6815a060 0x7fdc6815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.077+0000 7fdc6e139640 1 -- 172.21.15.5:0/2638856555 >> v2:172.21.15.179:3300/0 conn(0x7fdc6815a060 msgr2=0x7fdc6815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.077+0000 7fdc6e139640 1 --2- 172.21.15.5:0/2638856555 >> v2:172.21.15.179:3300/0 conn(0x7fdc6815a060 0x7fdc6815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.077+0000 7fdc6e139640 1 -- 172.21.15.5:0/2638856555 >> v1:172.21.15.5:6789/0 conn(0x7fdc680cc730 legacy=0x7fdc680b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.077+0000 7fdc6e139640 1 -- 172.21.15.5:0/2638856555 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680cceb0 con 0x7fdc6806aea0 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6e139640 1 --2- 172.21.15.5:0/2638856555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6806aea0 0x7fdc6806b2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009e50 tx=0x7fdc6002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0110166f8a75eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6c936640 1 -- 172.21.15.5:0/2638856555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60031600 con 0x7fdc6806aea0 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6c936640 1 -- 172.21.15.5:0/2638856555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6002d050 con 0x7fdc6806aea0 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6c936640 1 -- 172.21.15.5:0/2638856555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60031980 con 0x7fdc6806aea0 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2638856555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6806aea0 msgr2=0x7fdc6806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2638856555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6806aea0 0x7fdc6806b2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009e50 tx=0x7fdc6002a6d0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2638856555 shutdown_connections 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2638856555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6806aea0 0x7fdc6806b2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2638856555 >> v2:172.21.15.179:3300/0 conn(0x7fdc6815a060 0x7fdc6815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2638856555 >> 172.21.15.5:0/2638856555 conn(0x7fdc68070af0 msgr2=0x7fdc68070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2638856555 shutdown_connections 2024-09-13T17:13:56.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.078+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2638856555 wait complete. 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 Processor -- start 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 -- start start 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6806aea0 0x7fdc68151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 0x7fdc6806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6806d370 con 0x7fdc6815a060 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6806d650 con 0x7fdc680cc730 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6fb9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6806d930 con 0x7fdc6806aea0 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.080+0000 7fdc6e139640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46826/0 (socket says 172.21.15.5:46826) 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 -- 172.21.15.5:0/2004930434 learned_addr learned my addr 172.21.15.5:0/2004930434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6d137640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 0x7fdc6806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6d938640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6806aea0 0x7fdc68151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 -- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6806aea0 msgr2=0x7fdc68151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6806aea0 0x7fdc68151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 -- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 msgr2=0x7fdc6806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 0x7fdc6806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 -- 172.21.15.5:0/2004930434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60009b30 con 0x7fdc6815a060 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6d137640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 0x7fdc6806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6e139640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc60034040 tx=0x7fdc60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6003d860 con 0x7fdc6815a060 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6003d9c0 con 0x7fdc6815a060 2024-09-13T17:13:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6003dd70 con 0x7fdc6815a060 2024-09-13T17:13:56.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6806dc10 con 0x7fdc6815a060 2024-09-13T17:13:56.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.081+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6806e410 con 0x7fdc6815a060 2024-09-13T17:13:56.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.082+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6806e5a0 con 0x7fdc6815a060 2024-09-13T17:13:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.083+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc6003b400 con 0x7fdc6815a060 2024-09-13T17:13:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.083+0000 7fdc5e7fc640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 0x7fdc4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.084+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc600aa5e0 con 0x7fdc6815a060 2024-09-13T17:13:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.084+0000 7fdc6d938640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 0x7fdc4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.084+0000 7fdc6d938640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 0x7fdc4c06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009ad0 tx=0x7fdc64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.088+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc60075400 con 0x7fdc6815a060 2024-09-13T17:13:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.264+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc680672e0 con 0x7fdc6815a060 2024-09-13T17:13:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.264+0000 7fdc5e7fc640 1 -- 172.21.15.5:0/2004930434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc60009510 con 0x7fdc6815a060 2024-09-13T17:13:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 msgr2=0x7fdc4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 0x7fdc4c06d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009ad0 tx=0x7fdc64008040 comp rx=0 tx=0).stop 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 msgr2=0x7fdc68158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc60034040 tx=0x7fdc60004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 shutdown_connections 2024-09-13T17:13:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4c06ac00 0x7fdc4c06d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc6815a060 0x7fdc68158130 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc680cc730 0x7fdc6806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 --2- 172.21.15.5:0/2004930434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6806aea0 0x7fdc68151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 >> 172.21.15.5:0/2004930434 conn(0x7fdc68070af0 msgr2=0x7fdc6815d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 shutdown_connections 2024-09-13T17:13:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.266+0000 7fdc6fb9c640 1 -- 172.21.15.5:0/2004930434 wait complete. 2024-09-13T17:13:56.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.381+0000 7f3af6a53640 1 Processor -- start 2024-09-13T17:13:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.381+0000 7f3af6a53640 1 -- start start 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3af6a53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3af00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3af6a53640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3af015aaa0 0x7f3af00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3af6a53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af00ac650 con 0x7f3af0143740 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3af6a53640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af0144100 con 0x7f3af015aaa0 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3af6a53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0143b20 con 0x7f3af006a5a0 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3aeffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3af0143740 0x7f3af0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43326/0 (socket says 172.21.15.5:43326) 2024-09-13T17:13:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3aeffff640 1 -- 172.21.15.5:0/2345441274 learned_addr learned my addr 172.21.15.5:0/2345441274 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.382+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214877612 0 0) 0x7f3ae0001110 con 0x7f3af0143740 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3af4ff0640 1 --2- 172.21.15.5:0/2345441274 >> v2:172.21.15.179:3300/0 conn(0x7f3af015aaa0 0x7f3af00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad8003520 con 0x7f3af0143740 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3af00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2649423509 0 0) 0x7f3ad8003520 con 0x7f3af0143740 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 msgr2=0x7f3af00ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3af00ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 >> v2:172.21.15.179:3300/0 conn(0x7f3af015aaa0 msgr2=0x7f3af00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 --2- 172.21.15.5:0/2345441274 >> v2:172.21.15.179:3300/0 conn(0x7f3af015aaa0 0x7f3af00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00b2130 con 0x7f3af0143740 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3ae0001800 con 0x7f3af0143740 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3af00ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 >> v1:172.21.15.5:6789/0 conn(0x7f3af0143740 legacy=0x7f3af0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ad8003970 0x7f3ad8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad80047c0 0x7f3ad8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3ad8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0144100 con 0x7f3ad8003970 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0143b20 con 0x7f3ad80047c0 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad800ba00 con 0x7f3af006a5a0 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ad8003970 0x7f3ad8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad80047c0 0x7f3ad8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3af4ff0640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3ad8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 -- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 msgr2=0x7f3ad8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3af006a5a0 0x7f3ad8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 -- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad80047c0 msgr2=0x7f3ad8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad80047c0 0x7f3ad8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aeffff640 1 -- 172.21.15.5:0/2345441274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8003520 con 0x7f3ad8003970 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.383+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ad80047c0 0x7f3ad8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.384+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ad8003970 0x7f3ad8003d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000c210 tx=0x7f3ad80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f1588cb016e5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.384+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0005ad0 con 0x7f3ad8003970 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.384+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0005c30 con 0x7f3ad8003970 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.384+0000 7f3aeeffd640 1 -- 172.21.15.5:0/2345441274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0007070 con 0x7f3ad8003970 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 -- 172.21.15.5:0/2345441274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ad8003970 msgr2=0x7f3ad8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2345441274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ad8003970 0x7f3ad8003d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000c210 tx=0x7f3ad80057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af4ff0640 1 -- 172.21.15.5:0/2345441274 reap_dead start 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 -- 172.21.15.5:0/2345441274 shutdown_connections 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 -- 172.21.15.5:0/2345441274 >> 172.21.15.5:0/2345441274 conn(0x7f3af00b4650 msgr2=0x7f3af00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 -- 172.21.15.5:0/2345441274 shutdown_connections 2024-09-13T17:13:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.385+0000 7f3af6a53640 1 -- 172.21.15.5:0/2345441274 wait complete. 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.386+0000 7f3af6a53640 1 Processor -- start 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.386+0000 7f3af6a53640 1 -- start start 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 0x7f3af00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0141a30 0x7f3af013d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af013c680 con 0x7f3af0152260 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0141e90 con 0x7f3af0141a30 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af6a53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af01f2b70 con 0x7f3ad8003970 2024-09-13T17:13:56.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46844/0 (socket says 172.21.15.5:46844) 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 -- 172.21.15.5:0/2092177327 learned_addr learned my addr 172.21.15.5:0/2092177327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 0x7f3af00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3af4ff0640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0141a30 0x7f3af013d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 -- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 msgr2=0x7f3af00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 0x7f3af00ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 -- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0141a30 msgr2=0x7f3af013d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0141a30 0x7f3af013d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aef7fe640 1 -- 172.21.15.5:0/2092177327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af01f1f60 con 0x7f3af0152260 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.387+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 0x7f3af00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3aef7fe640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4010860 tx=0x7f3ae4010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400cb40 con 0x7f3af0152260 2024-09-13T17:13:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400cca0 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af01f2240 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4015670 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.388+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af01f2800 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.389+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af00672a0 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.389+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ae40157d0 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.390+0000 7f3aecff9640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 0x7f3adc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.390+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3ae4089c60 con 0x7f3af0152260 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.390+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 0x7f3adc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.391+0000 7f3aeffff640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 0x7f3adc06d0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0033000 tx=0x7f3ae0009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.394+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ae4054bc0 con 0x7f3af0152260 2024-09-13T17:13:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.569+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3af00ac110 con 0x7f3af0152260 2024-09-13T17:13:56.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.569+0000 7f3aecff9640 1 -- 172.21.15.5:0/2092177327 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ae40581e0 con 0x7f3af0152260 2024-09-13T17:13:56.570 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:56.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 msgr2=0x7f3adc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 0x7f3adc06d0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0033000 tx=0x7f3ae0009030 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 msgr2=0x7f3af01414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4010860 tx=0x7f3ae4010d20 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 shutdown_connections 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3af0141a30 0x7f3af013d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3adc06ac30 0x7f3adc06d0f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af0152260 0x7f3af01414f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 --2- 172.21.15.5:0/2092177327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ad8003970 0x7f3af00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 >> 172.21.15.5:0/2092177327 conn(0x7f3af00b4650 msgr2=0x7f3af00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 shutdown_connections 2024-09-13T17:13:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.571+0000 7f3af6a53640 1 -- 172.21.15.5:0/2092177327 wait complete. 2024-09-13T17:13:56.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-13T17:13:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.683+0000 7f5f12fd5640 1 Processor -- start 2024-09-13T17:13:56.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.683+0000 7f5f12fd5640 1 -- start start 2024-09-13T17:13:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f12fd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f0c15c810 0x7f5f0c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f12fd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c0d06d0 0x7f5f0c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f12fd5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0d1e80 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f12fd5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b4fb0 con 0x7f5f0c15c810 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f12fd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0d1750 con 0x7f5f0c0d06d0 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f10d71640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f0c15c810 0x7f5f0c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f10d71640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f0c15c810 0x7f5f0c0cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46856/0 (socket says 172.21.15.5:46856) 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.684+0000 7f5f10d71640 1 -- 172.21.15.5:0/1397942709 learned_addr learned my addr 172.21.15.5:0/1397942709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.685+0000 7f5f0bfff640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c0d06d0 0x7f5f0c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.685+0000 7f5f10d71640 1 -- 172.21.15.5:0/1397942709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c0d06d0 msgr2=0x7f5f0c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.685+0000 7f5f10d71640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c0d06d0 0x7f5f0c0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.685+0000 7f5f10d71640 1 -- 172.21.15.5:0/1397942709 >> v1:172.21.15.179:6789/0 conn(0x7f5f0c0b4b20 legacy=0x7f5f0c0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.685+0000 7f5f10d71640 1 -- 172.21.15.5:0/1397942709 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0d0bd0 con 0x7f5f0c15c810 2024-09-13T17:13:56.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f10d71640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c15c810 0x7f5f0c0cd780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c47816343e1afec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f0b7fe640 1 -- 172.21.15.5:0/1397942709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04032440 con 0x7f5f0c15c810 2024-09-13T17:13:56.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f0b7fe640 1 -- 172.21.15.5:0/1397942709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040325a0 con 0x7f5f0c15c810 2024-09-13T17:13:56.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f0b7fe640 1 -- 172.21.15.5:0/1397942709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04032930 con 0x7f5f0c15c810 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1397942709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c15c810 msgr2=0x7f5f0c0cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c15c810 0x7f5f0c0cd780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402a250 comp rx=0 tx=0).stop 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1397942709 shutdown_connections 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c0d06d0 0x7f5f0c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1397942709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c15c810 0x7f5f0c0cd780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1397942709 >> 172.21.15.5:0/1397942709 conn(0x7f5f0c0717a0 msgr2=0x7f5f0c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1397942709 shutdown_connections 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.686+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1397942709 wait complete. 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.687+0000 7f5f12fd5640 1 Processor -- start 2024-09-13T17:13:56.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 -- start start 2024-09-13T17:13:56.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 0x7f5f0c1f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c15c810 0x7f5f0c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c1f1d70 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c6540 con 0x7f5f0c0d06d0 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f12fd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c6820 con 0x7f5f0c15c810 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f10d71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.688+0000 7f5f10d71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46862/0 (socket says 172.21.15.5:46862) 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 -- 172.21.15.5:0/1572997482 learned_addr learned my addr 172.21.15.5:0/1572997482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f0bfff640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 0x7f5f0c1f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f11572640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c15c810 0x7f5f0c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 -- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c15c810 msgr2=0x7f5f0c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c15c810 0x7f5f0c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 -- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 msgr2=0x7f5f0c1f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 0x7f5f0c1f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 -- 172.21.15.5:0/1572997482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040094d0 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f0bfff640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 0x7f5f0c1f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f10d71640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000c00 tx=0x7f5f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04032440 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04030b80 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c0c6b00 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0403d440 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.689+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c0c70c0 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.690+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c0672a0 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.691+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f04039040 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.691+0000 7f5f097fa640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 0x7f5eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.691+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f040aa2f0 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.691+0000 7f5f0bfff640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 0x7f5eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.692+0000 7f5f0bfff640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 0x7f5eec06d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c159960 tx=0x7f5efc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.696+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f04075070 con 0x7f5f0c0b4b20 2024-09-13T17:13:56.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:56.931+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f5f0c0b45e0 con 0x7f5f0c0b4b20 2024-09-13T17:13:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.439+0000 7f5f097fa640 1 -- 172.21.15.5:0/1572997482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v64) v1 ==== 147+0+0 (secure 0 0 0) 0x7f5f04078690 con 0x7f5f0c0b4b20 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 msgr2=0x7f5eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 0x7f5eec06d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c159960 tx=0x7f5efc00b040 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 msgr2=0x7f5f0c0c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000c00 tx=0x7f5f040046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 shutdown_connections 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f0c15c810 0x7f5f0c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f0c0d06d0 0x7f5f0c1f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eec06ac00 0x7f5eec06d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 --2- 172.21.15.5:0/1572997482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0c0b4b20 0x7f5f0c0c8a50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 >> 172.21.15.5:0/1572997482 conn(0x7f5f0c0717a0 msgr2=0x7f5f0c0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.441+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 shutdown_connections 2024-09-13T17:13:57.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.442+0000 7f5f12fd5640 1 -- 172.21.15.5:0/1572997482 wait complete. 2024-09-13T17:13:57.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:13:57.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.563+0000 7f1984b45640 1 Processor -- start 2024-09-13T17:13:57.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.563+0000 7f1984b45640 1 -- start start 2024-09-13T17:13:57.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1984b45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19801591e0 0x7f19800abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1984b45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f198006da30 0x7f198006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1984b45640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19800ad050 con 0x7f19800ad4e0 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1984b45640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198006e400 con 0x7f198006da30 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1984b45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800ac440 con 0x7f19801591e0 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f198006da30 0x7f198006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1977fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f19800ad4e0 0x7f19800b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43328/0 (socket says 172.21.15.5:43328) 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f198006da30 0x7f198006dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46874/0 (socket says 172.21.15.5:46874) 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f1977fff640 1 -- 172.21.15.5:0/155122635 learned_addr learned my addr 172.21.15.5:0/155122635 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197e59c640 1 --2- 172.21.15.5:0/155122635 >> v2:172.21.15.179:3300/0 conn(0x7f19801591e0 0x7f19800abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 -- 172.21.15.5:0/155122635 >> v2:172.21.15.179:3300/0 conn(0x7f19801591e0 msgr2=0x7f19800abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 --2- 172.21.15.5:0/155122635 >> v2:172.21.15.179:3300/0 conn(0x7f19801591e0 0x7f19800abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 -- 172.21.15.5:0/155122635 >> v1:172.21.15.5:6789/0 conn(0x7f19800ad4e0 legacy=0x7f19800b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197ed9d640 1 -- 172.21.15.5:0/155122635 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800ac720 con 0x7f198006da30 2024-09-13T17:13:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.564+0000 7f197dd9b640 1 -- 172.21.15.5:0/155122635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839202923 0 0) 0x7f19800ad050 con 0x7f19800ad4e0 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.565+0000 7f197ed9d640 1 --2- 172.21.15.5:0/155122635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f198006dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f198006afb0 tx=0x7f197802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c5b1345cd4dbd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.565+0000 7f197dd9b640 1 -- 172.21.15.5:0/155122635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197802aea0 con 0x7f198006da30 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.565+0000 7f197dd9b640 1 -- 172.21.15.5:0/155122635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197802d050 con 0x7f198006da30 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.565+0000 7f197dd9b640 1 -- 172.21.15.5:0/155122635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007960 con 0x7f198006da30 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 -- 172.21.15.5:0/155122635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 msgr2=0x7f198006dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 --2- 172.21.15.5:0/155122635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f198006dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f198006afb0 tx=0x7f197802a680 comp rx=0 tx=0).stop 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 -- 172.21.15.5:0/155122635 shutdown_connections 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 --2- 172.21.15.5:0/155122635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f198006dec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 --2- 172.21.15.5:0/155122635 >> v2:172.21.15.179:3300/0 conn(0x7f19801591e0 0x7f19800abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 -- 172.21.15.5:0/155122635 >> 172.21.15.5:0/155122635 conn(0x7f19800ce130 msgr2=0x7f19800ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 -- 172.21.15.5:0/155122635 shutdown_connections 2024-09-13T17:13:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.566+0000 7f1984b45640 1 -- 172.21.15.5:0/155122635 wait complete. 2024-09-13T17:13:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.567+0000 7f1984b45640 1 Processor -- start 2024-09-13T17:13:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.567+0000 7f1984b45640 1 -- start start 2024-09-13T17:13:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19800ad4e0 0x7f19800982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 0x7f19800ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1980151480 con 0x7f198006da30 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801527c0 con 0x7f19801591e0 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1984b45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980151bb0 con 0x7f19800ad4e0 2024-09-13T17:13:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46878/0 (socket says 172.21.15.5:46878) 2024-09-13T17:13:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 -- 172.21.15.5:0/3958482851 learned_addr learned my addr 172.21.15.5:0/3958482851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197ed9d640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 0x7f19800ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f1977fff640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19800ad4e0 0x7f19800982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 -- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19800ad4e0 msgr2=0x7f19800982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19800ad4e0 0x7f19800982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 -- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 msgr2=0x7f19800ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 0x7f19800ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 -- 172.21.15.5:0/3958482851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009a70 con 0x7f198006da30 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197ed9d640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 0x7f19800ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.568+0000 7f197e59c640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f197000d5f0 tx=0x7f197000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.569+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700125f0 con 0x7f198006da30 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.569+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970012750 con 0x7f198006da30 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.569+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1980151e90 con 0x7f198006da30 2024-09-13T17:13:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.569+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970012b00 con 0x7f198006da30 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.569+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1980152450 con 0x7f198006da30 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.570+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19800672a0 con 0x7f198006da30 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.570+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1970012c60 con 0x7f198006da30 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.570+0000 7f1976ffd640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 0x7f196006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.571+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1970089cb0 con 0x7f198006da30 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.571+0000 7f1977fff640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 0x7f196006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.571+0000 7f1977fff640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 0x7f196006d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1980157810 tx=0x7f1968007b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.575+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1970054a50 con 0x7f198006da30 2024-09-13T17:13:57.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.744+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f19801595c0 con 0x7f198006da30 2024-09-13T17:13:57.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.747+0000 7f1976ffd640 1 -- 172.21.15.5:0/3958482851 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1970058070 con 0x7f198006da30 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 msgr2=0x7f196006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 0x7f196006d0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1980157810 tx=0x7f1968007b50 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 msgr2=0x7f1980150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f197000d5f0 tx=0x7f197000dab0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 shutdown_connections 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19801591e0 0x7f19800ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19800ad4e0 0x7f19800982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f196006ac30 0x7f196006d0f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 --2- 172.21.15.5:0/3958482851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f198006da30 0x7f1980150f40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.749+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 >> 172.21.15.5:0/3958482851 conn(0x7f19800ce130 msgr2=0x7f198015d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.750+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 shutdown_connections 2024-09-13T17:13:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:57.750+0000 7f1984b45640 1 -- 172.21.15.5:0/3958482851 wait complete. 2024-09-13T17:13:57.761 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:13:57.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:13:57.796 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:13:57.839 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:13:57.839 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:13:57.839 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:13:57.856 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:13:57.856 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:13:57.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.053+0000 7f3388b3e640 1 Processor -- start 2024-09-13T17:13:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.053+0000 7f3388b3e640 1 -- start start 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3388b3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338415c810 0x7f33840cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3388b3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33840b4cf0 0x7f33840b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3388b3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840d1e80 con 0x7f33840d06d0 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3388b3e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840d1750 con 0x7f33840b4cf0 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3388b3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33840d0bd0 con 0x7f338415c810 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3382d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33840b4cf0 0x7f33840b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3382d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33840b4cf0 0x7f33840b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46886/0 (socket says 172.21.15.5:46886) 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.054+0000 7f3382d9d640 1 -- 172.21.15.5:0/556966852 learned_addr learned my addr 172.21.15.5:0/556966852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f338259c640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338415c810 0x7f33840cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f3382d9d640 1 -- 172.21.15.5:0/556966852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338415c810 msgr2=0x7f33840cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f3382d9d640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338415c810 0x7f33840cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f3382d9d640 1 -- 172.21.15.5:0/556966852 >> v1:172.21.15.179:6789/0 conn(0x7f33840d06d0 legacy=0x7f33840b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f3382d9d640 1 -- 172.21.15.5:0/556966852 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840d0eb0 con 0x7f33840b4cf0 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.055+0000 7f3382d9d640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33840b4cf0 0x7f33840b5a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f337c009870 tx=0x7f337c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fd7a4928da7145 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f338159a640 1 -- 172.21.15.5:0/556966852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c032440 con 0x7f33840b4cf0 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f338159a640 1 -- 172.21.15.5:0/556966852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c0325a0 con 0x7f33840b4cf0 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f338159a640 1 -- 172.21.15.5:0/556966852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c032930 con 0x7f33840b4cf0 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 -- 172.21.15.5:0/556966852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33840b4cf0 msgr2=0x7f33840b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33840b4cf0 0x7f33840b5a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f337c009870 tx=0x7f337c02a210 comp rx=0 tx=0).stop 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 -- 172.21.15.5:0/556966852 shutdown_connections 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33840b4cf0 0x7f33840b5a90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 --2- 172.21.15.5:0/556966852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338415c810 0x7f33840cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 -- 172.21.15.5:0/556966852 >> 172.21.15.5:0/556966852 conn(0x7f33840717a0 msgr2=0x7f3384071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 -- 172.21.15.5:0/556966852 shutdown_connections 2024-09-13T17:13:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.056+0000 7f3388b3e640 1 -- 172.21.15.5:0/556966852 wait complete. 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 Processor -- start 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 -- start start 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4cf0 0x7f33841f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840d06d0 0x7f338415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841587c0 con 0x7f338415c810 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841f5240 con 0x7f33840b4cf0 2024-09-13T17:13:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.058+0000 7f3388b3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33841f2200 con 0x7f33840d06d0 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46900/0 (socket says 172.21.15.5:46900) 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 -- 172.21.15.5:0/2317003594 learned_addr learned my addr 172.21.15.5:0/2317003594 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f338259c640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4cf0 0x7f33841f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3381d9b640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840d06d0 0x7f338415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 -- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840d06d0 msgr2=0x7f338415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840d06d0 0x7f338415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 -- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4cf0 msgr2=0x7f33841f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4cf0 0x7f33841f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 -- 172.21.15.5:0/2317003594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0094d0 con 0x7f338415c810 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3382d9d640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f337c02a250 tx=0x7f337c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c030b80 con 0x7f338415c810 2024-09-13T17:13:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c030d00 con 0x7f338415c810 2024-09-13T17:13:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33841f24e0 con 0x7f338415c810 2024-09-13T17:13:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c03d680 con 0x7f338415c810 2024-09-13T17:13:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.059+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33841f2870 con 0x7f338415c810 2024-09-13T17:13:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.060+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33841f2670 con 0x7f338415c810 2024-09-13T17:13:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.061+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f337c039040 con 0x7f338415c810 2024-09-13T17:13:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.061+0000 7f3372ffd640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 0x7f336406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.061+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f337c0aa400 con 0x7f338415c810 2024-09-13T17:13:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.062+0000 7f338259c640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 0x7f336406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.062+0000 7f338259c640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 0x7f336406d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33740070b0 tx=0x7f3374007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.066+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f337c075360 con 0x7f338415c810 2024-09-13T17:13:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.237+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3384158910 con 0x7f338415c810 2024-09-13T17:13:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.238+0000 7f3372ffd640 1 -- 172.21.15.5:0/2317003594 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f337c078980 con 0x7f338415c810 2024-09-13T17:13:58.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:13:58.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 msgr2=0x7f336406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 0x7f336406d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33740070b0 tx=0x7f3374007040 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 msgr2=0x7f33840cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f337c02a250 tx=0x7f337c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 shutdown_connections 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f336406ac00 0x7f336406d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f338415c810 0x7f33840cc270 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33840d06d0 0x7f338415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 --2- 172.21.15.5:0/2317003594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33840b4cf0 0x7f33841f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 >> 172.21.15.5:0/2317003594 conn(0x7f33840717a0 msgr2=0x7f3384071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 shutdown_connections 2024-09-13T17:13:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.240+0000 7f3388b3e640 1 -- 172.21.15.5:0/2317003594 wait complete. 2024-09-13T17:13:58.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:58.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:58.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.356+0000 7f2ab3ab1640 1 Processor -- start 2024-09-13T17:13:58.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 -- start start 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2aac15a180 0x7f2aac0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2aac15d960 0x7f2aac070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0ad1d0 con 0x7f2aac06ec60 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac15cbc0 con 0x7f2aac15a180 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.357+0000 7f2ab3ab1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0b2020 con 0x7f2aac15d960 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2aac15a180 0x7f2aac0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2aac15a180 0x7f2aac0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46904/0 (socket says 172.21.15.5:46904) 2024-09-13T17:13:58.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 -- 172.21.15.5:0/2913660626 learned_addr learned my addr 172.21.15.5:0/2913660626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab104c640 1 --2- 172.21.15.5:0/2913660626 >> v2:172.21.15.179:3300/0 conn(0x7f2aac15d960 0x7f2aac070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 -- 172.21.15.5:0/2913660626 >> v2:172.21.15.179:3300/0 conn(0x7f2aac15d960 msgr2=0x7f2aac070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 --2- 172.21.15.5:0/2913660626 >> v2:172.21.15.179:3300/0 conn(0x7f2aac15d960 0x7f2aac070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 -- 172.21.15.5:0/2913660626 >> v1:172.21.15.179:6789/0 conn(0x7f2aac06ec60 legacy=0x7f2aac1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.358+0000 7f2ab184d640 1 -- 172.21.15.5:0/2913660626 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac15ce80 con 0x7f2aac15a180 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab184d640 1 --2- 172.21.15.5:0/2913660626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac15a180 0x7f2aac0b1720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2aac071710 tx=0x7f2a9c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b47a12a8a2db36b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab084b640 1 -- 172.21.15.5:0/2913660626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c031600 con 0x7f2aac15a180 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab084b640 1 -- 172.21.15.5:0/2913660626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c02d050 con 0x7f2aac15a180 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab084b640 1 -- 172.21.15.5:0/2913660626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c031980 con 0x7f2aac15a180 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/2913660626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac15a180 msgr2=0x7f2aac0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/2913660626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac15a180 0x7f2aac0b1720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2aac071710 tx=0x7f2a9c02a6a0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/2913660626 shutdown_connections 2024-09-13T17:13:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/2913660626 >> v2:172.21.15.179:3300/0 conn(0x7f2aac15d960 0x7f2aac070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/2913660626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac15a180 0x7f2aac0b1720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.359+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/2913660626 >> 172.21.15.5:0/2913660626 conn(0x7f2aac0b0420 msgr2=0x7f2aac0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.360+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/2913660626 shutdown_connections 2024-09-13T17:13:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.360+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/2913660626 wait complete. 2024-09-13T17:13:58.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 Processor -- start 2024-09-13T17:13:58.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 -- start start 2024-09-13T17:13:58.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 0x7f2aac06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 0x7f2aac06da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1e7480 con 0x7f2aac06ec60 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15c440 con 0x7f2aac15a180 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.361+0000 7f2ab3ab1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1e63e0 con 0x7f2aac15d960 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46916/0 (socket says 172.21.15.5:46916) 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 -- 172.21.15.5:0/3740127045 learned_addr learned my addr 172.21.15.5:0/3740127045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab104c640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 0x7f2aac06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab204e640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 0x7f2aac06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 -- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 msgr2=0x7f2aac06da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 0x7f2aac06da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 -- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 msgr2=0x7f2aac06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 0x7f2aac06cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 -- 172.21.15.5:0/3740127045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c009b30 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab104c640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 0x7f2aac06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab204e640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 0x7f2aac06da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab184d640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c034040 tx=0x7f2a9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c03b810 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c03b970 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c03bd20 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac1e66c0 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.362+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac1e6c80 con 0x7f2aac06ec60 2024-09-13T17:13:58.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.363+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac0b1720 con 0x7f2aac06ec60 2024-09-13T17:13:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.364+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a9c03a3a0 con 0x7f2aac06ec60 2024-09-13T17:13:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.364+0000 7f2aaa7fc640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 0x7f2a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.365+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a9c0aa430 con 0x7f2aac06ec60 2024-09-13T17:13:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.365+0000 7f2ab104c640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 0x7f2a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.365+0000 7f2ab104c640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 0x7f2a9806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006fd0 tx=0x7f2aa0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.369+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a9c075250 con 0x7f2aac06ec60 2024-09-13T17:13:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.540+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2aac0caec0 con 0x7f2aac06ec60 2024-09-13T17:13:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.540+0000 7f2aaa7fc640 1 -- 172.21.15.5:0/3740127045 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a9c009510 con 0x7f2aac06ec60 2024-09-13T17:13:58.542 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:13:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 msgr2=0x7f2a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 0x7f2a9806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006fd0 tx=0x7f2aa0008040 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 msgr2=0x7f2aac15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c034040 tx=0x7f2a9c004a40 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 shutdown_connections 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2aac15d960 0x7f2aac06da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2aac15a180 0x7f2aac06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a9806ac00 0x7f2a9806d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 --2- 172.21.15.5:0/3740127045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2aac06ec60 0x7f2aac15bf00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 >> 172.21.15.5:0/3740127045 conn(0x7f2aac0b0420 msgr2=0x7f2aac0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 shutdown_connections 2024-09-13T17:13:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.542+0000 7f2ab3ab1640 1 -- 172.21.15.5:0/3740127045 wait complete. 2024-09-13T17:13:58.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.657+0000 7f187c553640 1 Processor -- start 2024-09-13T17:13:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.657+0000 7f187c553640 1 -- start start 2024-09-13T17:13:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187c553640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18741591e0 0x7f18740abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187c553640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18740ad4e0 0x7f18740b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187c553640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740ad050 con 0x7f187406da30 2024-09-13T17:13:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187c553640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740ac440 con 0x7f18741591e0 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187c553640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740ac720 con 0x7f18740ad4e0 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18741591e0 0x7f18740abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18741591e0 0x7f18740abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46932/0 (socket says 172.21.15.5:46932) 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 -- 172.21.15.5:0/4135916893 learned_addr learned my addr 172.21.15.5:0/4135916893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f1879aee640 1 --2- 172.21.15.5:0/4135916893 >> v2:172.21.15.179:3300/0 conn(0x7f18740ad4e0 0x7f18740b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 -- 172.21.15.5:0/4135916893 >> v2:172.21.15.179:3300/0 conn(0x7f18740ad4e0 msgr2=0x7f18740b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 --2- 172.21.15.5:0/4135916893 >> v2:172.21.15.179:3300/0 conn(0x7f18740ad4e0 0x7f18740b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 -- 172.21.15.5:0/4135916893 >> v1:172.21.15.5:6789/0 conn(0x7f187406da30 legacy=0x7f18740700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.658+0000 7f187a2ef640 1 -- 172.21.15.5:0/4135916893 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740aca00 con 0x7f18741591e0 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f187a2ef640 1 --2- 172.21.15.5:0/4135916893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18740abe60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18740ce100 tx=0x7f187002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b204618bb7230 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f18792ed640 1 -- 172.21.15.5:0/4135916893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870032440 con 0x7f18741591e0 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f18792ed640 1 -- 172.21.15.5:0/4135916893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700325a0 con 0x7f18741591e0 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f18792ed640 1 -- 172.21.15.5:0/4135916893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870032930 con 0x7f18741591e0 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f187c553640 1 -- 172.21.15.5:0/4135916893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 msgr2=0x7f18740abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.659+0000 7f187c553640 1 --2- 172.21.15.5:0/4135916893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18740abe60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18740ce100 tx=0x7f187002a270 comp rx=0 tx=0).stop 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 -- 172.21.15.5:0/4135916893 shutdown_connections 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 --2- 172.21.15.5:0/4135916893 >> v2:172.21.15.179:3300/0 conn(0x7f18740ad4e0 0x7f18740b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 --2- 172.21.15.5:0/4135916893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18740abe60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 -- 172.21.15.5:0/4135916893 >> 172.21.15.5:0/4135916893 conn(0x7f18740ce130 msgr2=0x7f18740ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 -- 172.21.15.5:0/4135916893 shutdown_connections 2024-09-13T17:13:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.660+0000 7f187c553640 1 -- 172.21.15.5:0/4135916893 wait complete. 2024-09-13T17:13:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 Processor -- start 2024-09-13T17:13:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 -- start start 2024-09-13T17:13:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 0x7f187414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 0x7f18741efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187414ed50 con 0x7f18741591e0 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187414c900 con 0x7f187406da30 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.661+0000 7f187c553640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187414cbe0 con 0x7f18740ad4e0 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46942/0 (socket says 172.21.15.5:46942) 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 -- 172.21.15.5:0/992788541 learned_addr learned my addr 172.21.15.5:0/992788541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187a2ef640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 0x7f187414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f1879aee640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 0x7f18741efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 -- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 msgr2=0x7f18741efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 0x7f18741efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 -- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 msgr2=0x7f187414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 0x7f187414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 -- 172.21.15.5:0/992788541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700094d0 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187a2ef640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 0x7f187414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f1879aee640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 0x7f18741efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187aaf0640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c7a0 tx=0x7f186c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c003b70 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c003cf0 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187414cec0 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c003ea0 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.662+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187414c340 con 0x7f18741591e0 2024-09-13T17:13:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.663+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18741558c0 con 0x7f18741591e0 2024-09-13T17:13:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.664+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f186c00aa90 con 0x7f18741591e0 2024-09-13T17:13:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.664+0000 7f186affd640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 0x7f185806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.664+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f186c0894f0 con 0x7f18741591e0 2024-09-13T17:13:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.664+0000 7f187a2ef640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 0x7f185806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.665+0000 7f187a2ef640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 0x7f185806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1870034000 tx=0x7f187002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.668+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f186c0543a0 con 0x7f18741591e0 2024-09-13T17:13:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.840+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18740672a0 con 0x7f18741591e0 2024-09-13T17:13:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.840+0000 7f186affd640 1 -- 172.21.15.5:0/992788541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f186c0579c0 con 0x7f18741591e0 2024-09-13T17:13:58.842 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 msgr2=0x7f185806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 0x7f185806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1870034000 tx=0x7f187002e000 comp rx=0 tx=0).stop 2024-09-13T17:13:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 msgr2=0x7f18741f0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c7a0 tx=0x7f186c00cc60 comp rx=0 tx=0).stop 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 shutdown_connections 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f185806ac00 0x7f185806d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18741591e0 0x7f18741f0170 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18740ad4e0 0x7f18741efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 --2- 172.21.15.5:0/992788541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f187406da30 0x7f187414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 >> 172.21.15.5:0/992788541 conn(0x7f18740ce130 msgr2=0x7f187406a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 shutdown_connections 2024-09-13T17:13:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.842+0000 7f187c553640 1 -- 172.21.15.5:0/992788541 wait complete. 2024-09-13T17:13:58.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.957+0000 7f027ae20640 1 Processor -- start 2024-09-13T17:13:58.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.957+0000 7f027ae20640 1 -- start start 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f027ae20640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02740ae320 0x7f0274160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f027ae20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f02740b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f027ae20640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740b1ac0 con 0x7f02740adf40 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f027ae20640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027415d210 con 0x7f02740ae320 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f027ae20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027415d4f0 con 0x7f02740b2230 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f0278bbc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02740adf40 0x7f027415ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43352/0 (socket says 172.21.15.5:43352) 2024-09-13T17:13:58.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f0278bbc640 1 -- 172.21.15.5:0/2752354121 learned_addr learned my addr 172.21.15.5:0/2752354121 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f0273fff640 1 --2- 172.21.15.5:0/2752354121 >> v2:172.21.15.179:3300/0 conn(0x7f02740ae320 0x7f0274160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02793bd640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f02740b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047212803 0 0) 0x7f02740b1ac0 con 0x7f02740adf40 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003520 con 0x7f02740adf40 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1552029271 0 0) 0x7f0264003520 con 0x7f02740adf40 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 msgr2=0x7f02740b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f02740b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 >> v2:172.21.15.179:3300/0 conn(0x7f02740ae320 msgr2=0x7f0274160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 --2- 172.21.15.5:0/2752354121 >> v2:172.21.15.179:3300/0 conn(0x7f02740ae320 0x7f0274160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027415d7d0 con 0x7f02740adf40 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.958+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0268001670 con 0x7f02740adf40 2024-09-13T17:13:58.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 >> v1:172.21.15.5:6789/0 conn(0x7f02740adf40 legacy=0x7f027415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f0264003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264003ef0 0x7f02640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0264004d00 0x7f0264005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027415d210 con 0x7f0264004d00 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027415d4f0 con 0x7f0264003ef0 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026400b980 con 0x7f02740b2230 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0264004d00 0x7f0264005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f0273fff640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264003ef0 0x7f02640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f0278bbc640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f0264003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 -- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 msgr2=0x7f0264003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f0264003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 -- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264003ef0 msgr2=0x7f02640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264003ef0 0x7f02640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f02793bd640 1 -- 172.21.15.5:0/2752354121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264003520 con 0x7f0264004d00 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.959+0000 7f0278bbc640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02740b2230 0x7f0264003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f02793bd640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0264004d00 0x7f0264005180 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f026c009fc0 tx=0x7f02640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7e8cf914bb8c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c02d070 con 0x7f0264004d00 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00f040 con 0x7f0264004d00 2024-09-13T17:13:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f02737fe640 1 -- 172.21.15.5:0/2752354121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c031670 con 0x7f0264004d00 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 -- 172.21.15.5:0/2752354121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0264004d00 msgr2=0x7f0264005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 --2- 172.21.15.5:0/2752354121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0264004d00 0x7f0264005180 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f026c009fc0 tx=0x7f02640057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f02793bd640 1 -- 172.21.15.5:0/2752354121 reap_dead start 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 -- 172.21.15.5:0/2752354121 shutdown_connections 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 -- 172.21.15.5:0/2752354121 >> 172.21.15.5:0/2752354121 conn(0x7f0274070af0 msgr2=0x7f0274070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 -- 172.21.15.5:0/2752354121 shutdown_connections 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.960+0000 7f027ae20640 1 -- 172.21.15.5:0/2752354121 wait complete. 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.962+0000 7f027ae20640 1 Processor -- start 2024-09-13T17:13:58.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.962+0000 7f027ae20640 1 -- start start 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.962+0000 7f027ae20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264004d00 0x7f0274144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 0x7f0274147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02741f1780 con 0x7f0274156cb0 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02741457f0 con 0x7f0264004d00 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274158d80 con 0x7f0274147880 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46966/0 (socket says 172.21.15.5:46966) 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 -- 172.21.15.5:0/3896733552 learned_addr learned my addr 172.21.15.5:0/3896733552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0278bbc640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264004d00 0x7f0274144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f02793bd640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 0x7f0274147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 -- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 msgr2=0x7f0274147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 0x7f0274147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 -- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264004d00 msgr2=0x7f0274144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264004d00 0x7f0274144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 -- 172.21.15.5:0/3896733552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02741584b0 con 0x7f0274156cb0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f02793bd640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 0x7f0274147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f0273fff640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0260011960 tx=0x7f0260011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260004240 con 0x7f0274156cb0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02600043a0 con 0x7f0274156cb0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274145a00 con 0x7f0274156cb0 2024-09-13T17:13:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000fa20 con 0x7f0274156cb0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.963+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0274145fc0 con 0x7f0274156cb0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.964+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02740672e0 con 0x7f0274156cb0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.965+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f026000fb80 con 0x7f0274156cb0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.965+0000 7f02717fa640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 0x7f025806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.965+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0260089c90 con 0x7f0274156cb0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.966+0000 7f0278bbc640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 0x7f025806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.966+0000 7f0278bbc640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 0x7f025806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0268005c90 tx=0x7f0268007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:58.969+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0260054b60 con 0x7f0274156cb0 2024-09-13T17:13:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.140+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0274160a50 con 0x7f0274156cb0 2024-09-13T17:13:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.140+0000 7f02717fa640 1 -- 172.21.15.5:0/3896733552 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02600230a0 con 0x7f0274156cb0 2024-09-13T17:13:59.141 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:13:59.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 msgr2=0x7f025806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 0x7f025806d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0268005c90 tx=0x7f0268007040 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 msgr2=0x7f0274157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0260011960 tx=0x7f0260011e20 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 shutdown_connections 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0274147880 0x7f0274147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f025806ac00 0x7f025806d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0274156cb0 0x7f0274157b40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 --2- 172.21.15.5:0/3896733552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0264004d00 0x7f0274144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 >> 172.21.15.5:0/3896733552 conn(0x7f0274070af0 msgr2=0x7f027415db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 shutdown_connections 2024-09-13T17:13:59.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.142+0000 7f027ae20640 1 -- 172.21.15.5:0/3896733552 wait complete. 2024-09-13T17:13:59.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.258+0000 7f57fb2f0640 1 Processor -- start 2024-09-13T17:13:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.258+0000 7f57fb2f0640 1 -- start start 2024-09-13T17:13:59.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f57f415dc30 0x7f57f40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57f406e5c0 0x7f57f406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406ef90 0x7f57f40ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40d0110 con 0x7f57f406e5c0 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f406f420 con 0x7f57f415dc30 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57fb2f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4099540 con 0x7f57f406ef90 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57f406e5c0 0x7f57f406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57f406e5c0 0x7f57f406ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46972/0 (socket says 172.21.15.5:46972) 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 -- 172.21.15.5:0/888520256 learned_addr learned my addr 172.21.15.5:0/888520256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f988d640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406ef90 0x7f57f40ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f908c640 1 --2- 172.21.15.5:0/888520256 >> v2:172.21.15.179:3300/0 conn(0x7f57f415dc30 0x7f57f40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 -- 172.21.15.5:0/888520256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406ef90 msgr2=0x7f57f40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406ef90 0x7f57f40ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 -- 172.21.15.5:0/888520256 >> v2:172.21.15.179:3300/0 conn(0x7f57f415dc30 msgr2=0x7f57f40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 --2- 172.21.15.5:0/888520256 >> v2:172.21.15.179:3300/0 conn(0x7f57f415dc30 0x7f57f40cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.259+0000 7f57f888b640 1 -- 172.21.15.5:0/888520256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4099820 con 0x7f57f406e5c0 2024-09-13T17:13:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.260+0000 7f57f888b640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f406e5c0 0x7f57f406ea50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57f406dc10 tx=0x7f57e402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcabd288b66a6972 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.260+0000 7f57ebfff640 1 -- 172.21.15.5:0/888520256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e402ae00 con 0x7f57f406e5c0 2024-09-13T17:13:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.260+0000 7f57ebfff640 1 -- 172.21.15.5:0/888520256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e4032440 con 0x7f57f406e5c0 2024-09-13T17:13:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.260+0000 7f57ebfff640 1 -- 172.21.15.5:0/888520256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e40327d0 con 0x7f57f406e5c0 2024-09-13T17:13:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 -- 172.21.15.5:0/888520256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f406e5c0 msgr2=0x7f57f406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f406e5c0 0x7f57f406ea50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57f406dc10 tx=0x7f57e402a0b0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 -- 172.21.15.5:0/888520256 shutdown_connections 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406ef90 0x7f57f40ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/888520256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f406e5c0 0x7f57f406ea50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/888520256 >> v2:172.21.15.179:3300/0 conn(0x7f57f415dc30 0x7f57f40cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 -- 172.21.15.5:0/888520256 >> 172.21.15.5:0/888520256 conn(0x7f57f40d0310 msgr2=0x7f57f40d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 -- 172.21.15.5:0/888520256 shutdown_connections 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.261+0000 7f57fb2f0640 1 -- 172.21.15.5:0/888520256 wait complete. 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.262+0000 7f57fb2f0640 1 Processor -- start 2024-09-13T17:13:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.262+0000 7f57fb2f0640 1 -- start start 2024-09-13T17:13:59.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406e5c0 0x7f57f40c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 0x7f57f406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40c85d0 con 0x7f57f415dc30 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f406bef0 con 0x7f57f406ef90 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40c79c0 con 0x7f57f406e5c0 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46974/0 (socket says 172.21.15.5:46974) 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 -- 172.21.15.5:0/3818357945 learned_addr learned my addr 172.21.15.5:0/3818357945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f908c640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406e5c0 0x7f57f40c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f888b640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 0x7f57f406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 -- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406e5c0 msgr2=0x7f57f40c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406e5c0 0x7f57f40c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 -- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 msgr2=0x7f57f406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 0x7f57f406b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 -- 172.21.15.5:0/3818357945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40094d0 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f888b640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 0x7f57f406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57f988d640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007d20 tx=0x7f57ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec014420 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec0145a0 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f40c7ca0 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.263+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec014950 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.264+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40c8260 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.265+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f4066830 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.265+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57ec014ab0 con 0x7f57f415dc30 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.266+0000 7f57e9ffb640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 0x7f57d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.266+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57ec089ff0 con 0x7f57f415dc30 2024-09-13T17:13:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.266+0000 7f57f908c640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 0x7f57d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.267+0000 7f57f908c640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 0x7f57d806d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f57f0006fd0 tx=0x7f57f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.270+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f57ec054e10 con 0x7f57f415dc30 2024-09-13T17:13:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.443+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57f406ea50 con 0x7f57f415dc30 2024-09-13T17:13:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.443+0000 7f57e9ffb640 1 -- 172.21.15.5:0/3818357945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57ec058430 con 0x7f57f415dc30 2024-09-13T17:13:59.445 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:13:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 msgr2=0x7f57d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 0x7f57d806d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f57f0006fd0 tx=0x7f57f0008040 comp rx=0 tx=0).stop 2024-09-13T17:13:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 msgr2=0x7f57f415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007d20 tx=0x7f57ec00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 shutdown_connections 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f57d806ac00 0x7f57d806d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f415dc30 0x7f57f415a7a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57f406ef90 0x7f57f406b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 --2- 172.21.15.5:0/3818357945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57f406e5c0 0x7f57f40c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 >> 172.21.15.5:0/3818357945 conn(0x7f57f40d0310 msgr2=0x7f57f40afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 shutdown_connections 2024-09-13T17:13:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.446+0000 7f57fb2f0640 1 -- 172.21.15.5:0/3818357945 wait complete. 2024-09-13T17:13:59.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:13:59.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.559+0000 7f4155591640 1 Processor -- start 2024-09-13T17:13:59.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.559+0000 7f4155591640 1 -- start start 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f4155591640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4150099110 0x7f41500cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f4155591640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41500d0e30 0x7f415006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f4155591640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500704a0 con 0x7f415015fd80 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f4155591640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415006cc10 con 0x7f4150099110 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f4155591640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500d12e0 con 0x7f41500d0e30 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4150099110 0x7f41500cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4150099110 0x7f41500cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46980/0 (socket says 172.21.15.5:46980) 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 -- 172.21.15.5:0/2357912833 learned_addr learned my addr 172.21.15.5:0/2357912833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414f7fe640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41500d0e30 0x7f415006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 -- 172.21.15.5:0/2357912833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41500d0e30 msgr2=0x7f415006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41500d0e30 0x7f415006e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 -- 172.21.15.5:0/2357912833 >> v1:172.21.15.179:6789/0 conn(0x7f415015fd80 legacy=0x7f4150098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.560+0000 7f414e7fc640 1 -- 172.21.15.5:0/2357912833 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415006bd80 con 0x7f4150099110 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.561+0000 7f414e7fc640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4150099110 0x7f41500cfd30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5348df825d9a856 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.561+0000 7f414dffb640 1 -- 172.21.15.5:0/2357912833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144032440 con 0x7f4150099110 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.561+0000 7f414dffb640 1 -- 172.21.15.5:0/2357912833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440325a0 con 0x7f4150099110 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.561+0000 7f414dffb640 1 -- 172.21.15.5:0/2357912833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144032930 con 0x7f4150099110 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 -- 172.21.15.5:0/2357912833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4150099110 msgr2=0x7f41500cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4150099110 0x7f41500cfd30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 -- 172.21.15.5:0/2357912833 shutdown_connections 2024-09-13T17:13:59.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41500d0e30 0x7f415006e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 --2- 172.21.15.5:0/2357912833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4150099110 0x7f41500cfd30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 -- 172.21.15.5:0/2357912833 >> 172.21.15.5:0/2357912833 conn(0x7f41500d0310 msgr2=0x7f41500d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 -- 172.21.15.5:0/2357912833 shutdown_connections 2024-09-13T17:13:59.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.562+0000 7f4155591640 1 -- 172.21.15.5:0/2357912833 wait complete. 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.563+0000 7f4155591640 1 Processor -- start 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.563+0000 7f4155591640 1 -- start start 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150099110 0x7f41500af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 0x7f41500b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500af6d0 con 0x7f415015fd80 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41501f2e60 con 0x7f41500d0e30 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f4155591640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41501f25c0 con 0x7f4150099110 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46994/0 (socket says 172.21.15.5:46994) 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 -- 172.21.15.5:0/2857689468 learned_addr learned my addr 172.21.15.5:0/2857689468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414effd640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150099110 0x7f41500af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414e7fc640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 0x7f41500b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 -- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150099110 msgr2=0x7f41500af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150099110 0x7f41500af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.564+0000 7f414f7fe640 1 -- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 msgr2=0x7f41500b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f414f7fe640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 0x7f41500b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f414f7fe640 1 -- 172.21.15.5:0/2857689468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f415015fd80 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f414e7fc640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 0x7f41500b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f414f7fe640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4148007e40 tx=0x7f414800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148014620 con 0x7f415015fd80 2024-09-13T17:13:59.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800ee90 con 0x7f415015fd80 2024-09-13T17:13:59.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41501f28a0 con 0x7f415015fd80 2024-09-13T17:13:59.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480149e0 con 0x7f415015fd80 2024-09-13T17:13:59.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.565+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41500ad280 con 0x7f415015fd80 2024-09-13T17:13:59.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.566+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500cfa60 con 0x7f415015fd80 2024-09-13T17:13:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.566+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4148014b40 con 0x7f415015fd80 2024-09-13T17:13:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.567+0000 7f41377fe640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 0x7f413c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.567+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f414808a030 con 0x7f415015fd80 2024-09-13T17:13:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.567+0000 7f414effd640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 0x7f413c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.568+0000 7f414effd640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 0x7f413c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4140000f60 tx=0x7f4140009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.571+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4148054e50 con 0x7f415015fd80 2024-09-13T17:13:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.752+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f415006cf90 con 0x7f415015fd80 2024-09-13T17:13:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.753+0000 7f41377fe640 1 -- 172.21.15.5:0/2857689468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4148058470 con 0x7f415015fd80 2024-09-13T17:13:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:13:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 msgr2=0x7f413c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 0x7f413c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4140000f60 tx=0x7f4140009040 comp rx=0 tx=0).stop 2024-09-13T17:13:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 msgr2=0x7f415015b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4148007e40 tx=0x7f414800e4b0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 shutdown_connections 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f413c06ac00 0x7f413c06d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415015fd80 0x7f415015b540 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41500d0e30 0x7f41500b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 --2- 172.21.15.5:0/2857689468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4150099110 0x7f41500af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 >> 172.21.15.5:0/2857689468 conn(0x7f41500d0310 msgr2=0x7f415015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 shutdown_connections 2024-09-13T17:13:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.755+0000 7f4155591640 1 -- 172.21.15.5:0/2857689468 wait complete. 2024-09-13T17:13:59.767 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:13:59.767 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:13:59.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.925+0000 7f9eb1b65640 1 Processor -- start 2024-09-13T17:13:59.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.925+0000 7f9eb1b65640 1 -- start start 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eb1b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9eac0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eb1b65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9eac0ae7b0 0x7f9eac06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eb1b65640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0b27f0 con 0x7f9eac0ac110 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eb1b65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac06ed60 con 0x7f9eac0ae7b0 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eb1b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0b40d0 con 0x7f9eac069e90 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eabfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9eac0ac110 0x7f9eac06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43354/0 (socket says 172.21.15.5:43354) 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eabfff640 1 -- 172.21.15.5:0/75985126 learned_addr learned my addr 172.21.15.5:0/75985126 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:13:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/75985126 >> v2:172.21.15.179:3300/0 conn(0x7f9eac0ae7b0 0x7f9eac06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9eac0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917330834 0 0) 0x7f9eac0b27f0 con 0x7f9eac0ac110 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e94003520 con 0x7f9eac0ac110 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645487310 0 0) 0x7f9e94003520 con 0x7f9eac0ac110 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 msgr2=0x7f9eac0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9eac0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 >> v2:172.21.15.179:3300/0 conn(0x7f9eac0ae7b0 msgr2=0x7f9eac06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 --2- 172.21.15.5:0/75985126 >> v2:172.21.15.179:3300/0 conn(0x7f9eac0ae7b0 0x7f9eac06a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0ae390 con 0x7f9eac0ac110 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f9ea40019f0 con 0x7f9eac0ac110 2024-09-13T17:13:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/75985126 >> v2:172.21.15.179:3300/0 conn(0x7f9eac0ae7b0 0x7f9eac06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.926+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9eac0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 >> v1:172.21.15.5:6789/0 conn(0x7f9eac0ac110 legacy=0x7f9eac06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9e94003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e94003eb0 0x7f9e940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94004d00 0x7f9e94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac06ed60 con 0x7f9e94004d00 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0b40d0 con 0x7f9e94003eb0 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400b980 con 0x7f9eac069e90 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94004d00 0x7f9e94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9e94003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e94003eb0 0x7f9e940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 -- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 msgr2=0x7f9e94003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac069e90 0x7f9e94003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 -- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e94003eb0 msgr2=0x7f9e940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e94003eb0 0x7f9e940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.927+0000 7f9eabfff640 1 -- 172.21.15.5:0/75985126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c009400 con 0x7f9e94004d00 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eabfff640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94004d00 0x7f9e94005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400a860 tx=0x7f9e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cf5f2f03a84d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea402ba80 con 0x7f9e94004d00 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea402bbe0 con 0x7f9e94004d00 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eaa7fc640 1 -- 172.21.15.5:0/75985126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4034470 con 0x7f9e94004d00 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eb1b65640 1 -- 172.21.15.5:0/75985126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94004d00 msgr2=0x7f9e94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/75985126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94004d00 0x7f9e94005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400a860 tx=0x7f9e940057f0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eabfff640 1 -- 172.21.15.5:0/75985126 reap_dead start 2024-09-13T17:13:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eb1b65640 1 -- 172.21.15.5:0/75985126 shutdown_connections 2024-09-13T17:13:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.928+0000 7f9eb1b65640 1 -- 172.21.15.5:0/75985126 >> 172.21.15.5:0/75985126 conn(0x7f9eac0b4650 msgr2=0x7f9eac0b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.929+0000 7f9eb1b65640 1 -- 172.21.15.5:0/75985126 shutdown_connections 2024-09-13T17:13:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.929+0000 7f9eb1b65640 1 -- 172.21.15.5:0/75985126 wait complete. 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.930+0000 7f9eb1b65640 1 Processor -- start 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.930+0000 7f9eb1b65640 1 -- start start 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac0ca000 0x7f9eac1e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac15a2d0 0x7f9eac15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15ac90 con 0x7f9eac157ef0 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0ca480 con 0x7f9eac15a2d0 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c8f60 con 0x7f9eac0ca000 2024-09-13T17:13:59.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47014/0 (socket says 172.21.15.5:47014) 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 -- 172.21.15.5:0/1002514456 learned_addr learned my addr 172.21.15.5:0/1002514456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac0ca000 0x7f9eac1e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eabfff640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac15a2d0 0x7f9eac15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 -- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac0ca000 msgr2=0x7f9eac1e6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac0ca000 0x7f9eac1e6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 -- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac15a2d0 msgr2=0x7f9eac15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac15a2d0 0x7f9eac15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 -- 172.21.15.5:0/1002514456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0c9240 con 0x7f9eac157ef0 2024-09-13T17:13:59.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eab7fe640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c011cd0 tx=0x7f9e9c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00fd20 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c00fe80 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.931+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0c9520 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.932+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004240 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.932+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac0c9ae0 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.932+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac06a270 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.933+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e9c0043a0 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.933+0000 7f9e93fff640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 0x7f9e9806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.933+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e9c089db0 con 0x7f9eac157ef0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.934+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 0x7f9e9806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.934+0000 7f9eaaffd640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 0x7f9e9806d0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0cf9c0 tx=0x7f9ea0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:13:59.938+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e9c054c80 con 0x7f9eac157ef0 2024-09-13T17:14:00.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.108+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9eac0ad6a0 con 0x7f9eac157ef0 2024-09-13T17:14:00.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.109+0000 7f9e93fff640 1 -- 172.21.15.5:0/1002514456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f9e9c022070 con 0x7f9eac157ef0 2024-09-13T17:14:00.111 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:00.111 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:00.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 msgr2=0x7f9e9806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 0x7f9e9806d0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0cf9c0 tx=0x7f9ea0009190 comp rx=0 tx=0).stop 2024-09-13T17:14:00.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 msgr2=0x7f9eac1e70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c011cd0 tx=0x7f9e9c00f610 comp rx=0 tx=0).stop 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 shutdown_connections 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eac15a2d0 0x7f9eac15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eac0ca000 0x7f9eac1e6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9e9806ac30 0x7f9e9806d0f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 --2- 172.21.15.5:0/1002514456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9eac157ef0 0x7f9eac1e70e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 >> 172.21.15.5:0/1002514456 conn(0x7f9eac0b4650 msgr2=0x7f9eac0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 shutdown_connections 2024-09-13T17:14:00.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.111+0000 7f9eb1b65640 1 -- 172.21.15.5:0/1002514456 wait complete. 2024-09-13T17:14:00.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:00.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.230+0000 7f0d7642b640 1 Processor -- start 2024-09-13T17:14:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.230+0000 7f0d7642b640 1 -- start start 2024-09-13T17:14:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d7642b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 0x7f0d700cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d7642b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d700cf000 0x7f0d700cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d7642b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d700cf980 con 0x7f0d701602c0 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d7642b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700d0630 con 0x7f0d700cf000 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d7642b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700d0910 con 0x7f0d7015c6e0 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d700cf000 0x7f0d700cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d700cf000 0x7f0d700cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47020/0 (socket says 172.21.15.5:47020) 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 -- 172.21.15.5:0/2214885501 learned_addr learned my addr 172.21.15.5:0/2214885501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6ffff640 1 --2- 172.21.15.5:0/2214885501 >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 0x7f0d700cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 -- 172.21.15.5:0/2214885501 >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 msgr2=0x7f0d700cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 --2- 172.21.15.5:0/2214885501 >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 0x7f0d700cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 -- 172.21.15.5:0/2214885501 >> v1:172.21.15.179:6789/0 conn(0x7f0d701602c0 legacy=0x7f0d70160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6f7fe640 1 -- 172.21.15.5:0/2214885501 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700d0bf0 con 0x7f0d700cf000 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.231+0000 7f0d6ffff640 1 --2- 172.21.15.5:0/2214885501 >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 0x7f0d700cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:00.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.232+0000 7f0d6f7fe640 1 --2- 172.21.15.5:0/2214885501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d700cf000 0x7f0d700cf440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b51b0 tx=0x7f0d6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b21e5435036174 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.232+0000 7f0d6effd640 1 -- 172.21.15.5:0/2214885501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64032440 con 0x7f0d700cf000 2024-09-13T17:14:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.232+0000 7f0d6effd640 1 -- 172.21.15.5:0/2214885501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d640325a0 con 0x7f0d700cf000 2024-09-13T17:14:00.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.232+0000 7f0d6effd640 1 -- 172.21.15.5:0/2214885501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64032930 con 0x7f0d700cf000 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 -- 172.21.15.5:0/2214885501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d700cf000 msgr2=0x7f0d700cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 --2- 172.21.15.5:0/2214885501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d700cf000 0x7f0d700cf440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b51b0 tx=0x7f0d6402a270 comp rx=0 tx=0).stop 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 -- 172.21.15.5:0/2214885501 shutdown_connections 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 --2- 172.21.15.5:0/2214885501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d700cf000 0x7f0d700cf440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 --2- 172.21.15.5:0/2214885501 >> v2:172.21.15.179:3300/0 conn(0x7f0d7015c6e0 0x7f0d700cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 -- 172.21.15.5:0/2214885501 >> 172.21.15.5:0/2214885501 conn(0x7f0d70089f90 msgr2=0x7f0d700d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 -- 172.21.15.5:0/2214885501 shutdown_connections 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.233+0000 7f0d7642b640 1 -- 172.21.15.5:0/2214885501 wait complete. 2024-09-13T17:14:00.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.234+0000 7f0d7642b640 1 Processor -- start 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.234+0000 7f0d7642b640 1 -- start start 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d700cf000 0x7f0d7015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d7015c6e0 0x7f0d7015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7015e7a0 con 0x7f0d701602c0 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7015e250 con 0x7f0d700cf000 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d7642b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700ca9e0 con 0x7f0d7015c6e0 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47036/0 (socket says 172.21.15.5:47036) 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 -- 172.21.15.5:0/160160745 learned_addr learned my addr 172.21.15.5:0/160160745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d6f7fe640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d7015c6e0 0x7f0d7015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d6ffff640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d700cf000 0x7f0d7015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 -- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d7015c6e0 msgr2=0x7f0d7015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d7015c6e0 0x7f0d7015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.235+0000 7f0d749c8640 1 -- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d700cf000 msgr2=0x7f0d7015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d749c8640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d700cf000 0x7f0d7015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d749c8640 1 -- 172.21.15.5:0/160160745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094d0 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d749c8640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c6e0 tx=0x7f0d6800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68003b70 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68003cf0 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7015e4c0 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68005310 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.236+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d700caf40 con 0x7f0d701602c0 2024-09-13T17:14:00.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.237+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d700672e0 con 0x7f0d701602c0 2024-09-13T17:14:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.237+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d68005470 con 0x7f0d701602c0 2024-09-13T17:14:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.238+0000 7f0d6cff9640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.238+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d68089320 con 0x7f0d701602c0 2024-09-13T17:14:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.238+0000 7f0d6ffff640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.239+0000 7f0d6ffff640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d60006e80 tx=0x7f0d60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.242+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0d680541f0 con 0x7f0d701602c0 2024-09-13T17:14:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.413+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d700d01c0 con 0x7f0d701602c0 2024-09-13T17:14:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.414+0000 7f0d6cff9640 1 -- 172.21.15.5:0/160160745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d68003e60 con 0x7f0d701602c0 2024-09-13T17:14:00.415 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 msgr2=0x7f0d5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d60006e80 tx=0x7f0d60008040 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 msgr2=0x7f0d701f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c6e0 tx=0x7f0d6800cba0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 shutdown_connections 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d701602c0 0x7f0d701f5ae0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d7015c6e0 0x7f0d7015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 --2- 172.21.15.5:0/160160745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d700cf000 0x7f0d7015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 >> 172.21.15.5:0/160160745 conn(0x7f0d70089f90 msgr2=0x7f0d700cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 shutdown_connections 2024-09-13T17:14:00.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.416+0000 7f0d7642b640 1 -- 172.21.15.5:0/160160745 wait complete. 2024-09-13T17:14:00.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.532+0000 7fe075308640 1 Processor -- start 2024-09-13T17:14:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.532+0000 7fe075308640 1 -- start start 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe075308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe07006c090 0x7fe07015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe075308640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07006c520 con 0x7fe070157e20 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe075308640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07006c800 con 0x7fe0700ad720 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe075308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07015b900 con 0x7fe07006c090 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe070157e20 0x7fe0700ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43358/0 (socket says 172.21.15.5:43358) 2024-09-13T17:14:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06effd640 1 -- 172.21.15.5:0/3784907969 learned_addr learned my addr 172.21.15.5:0/3784907969 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe07006c090 0x7fe07015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809165498 0 0) 0x7fe07006c520 con 0x7fe070157e20 2024-09-13T17:14:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe058003520 con 0x7fe070157e20 2024-09-13T17:14:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.533+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406506075 0 0) 0x7fe058003520 con 0x7fe070157e20 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe07006c090 msgr2=0x7fe07015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe07006c090 0x7fe07015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 >> v1:172.21.15.179:6789/0 conn(0x7fe0700ad720 legacy=0x7fe0700b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07006cae0 con 0x7fe070157e20 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe060001670 con 0x7fe070157e20 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 >> v1:172.21.15.5:6789/0 conn(0x7fe070157e20 legacy=0x7fe0700ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580039a0 0x7fe058003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0580047c0 0x7fe058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe058005180 0x7fe05800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07015b900 con 0x7fe0580047c0 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05800bec0 con 0x7fe0580039a0 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05800c000 con 0x7fe058005180 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0580047c0 0x7fe058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06effd640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580039a0 0x7fe058003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06f7fe640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe058005180 0x7fe05800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 -- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe058005180 msgr2=0x7fe05800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe058005180 0x7fe05800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 -- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580039a0 msgr2=0x7fe058003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580039a0 0x7fe058003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.534+0000 7fe06e7fc640 1 -- 172.21.15.5:0/3784907969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058003520 con 0x7fe0580047c0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.535+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0580047c0 0x7fe058004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe064009ac0 tx=0x7fe0580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a751b0672ae6fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.535+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064031400 con 0x7fe0580047c0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.535+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06402d050 con 0x7fe0580047c0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.535+0000 7fe06dffb640 1 -- 172.21.15.5:0/3784907969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064031780 con 0x7fe0580047c0 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.535+0000 7fe075308640 1 -- 172.21.15.5:0/3784907969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0580047c0 msgr2=0x7fe058004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe075308640 1 --2- 172.21.15.5:0/3784907969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0580047c0 0x7fe058004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe064009ac0 tx=0x7fe0580057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe06f7fe640 1 -- 172.21.15.5:0/3784907969 reap_dead start 2024-09-13T17:14:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe075308640 1 -- 172.21.15.5:0/3784907969 shutdown_connections 2024-09-13T17:14:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe075308640 1 -- 172.21.15.5:0/3784907969 >> 172.21.15.5:0/3784907969 conn(0x7fe0700ce130 msgr2=0x7fe0700ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe075308640 1 -- 172.21.15.5:0/3784907969 shutdown_connections 2024-09-13T17:14:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.536+0000 7fe075308640 1 -- 172.21.15.5:0/3784907969 wait complete. 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.537+0000 7fe075308640 1 Processor -- start 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.537+0000 7fe075308640 1 -- start start 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 0x7fe0701f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 0x7fe070153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0701f6040 con 0x7fe07015ce60 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0701539a0 con 0x7fe0580047c0 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe075308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0701528a0 con 0x7fe070152fe0 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47056/0 (socket says 172.21.15.5:47056) 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 -- 172.21.15.5:0/658914132 learned_addr learned my addr 172.21.15.5:0/658914132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06f7fe640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 0x7fe070153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06effd640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 0x7fe0701f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 -- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 msgr2=0x7fe070153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 0x7fe070153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 -- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 msgr2=0x7fe0701f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 0x7fe0701f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 -- 172.21.15.5:0/658914132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070151ed0 con 0x7fe07015ce60 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06f7fe640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 0x7fe070153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06effd640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 0x7fe0701f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.538+0000 7fe06e7fc640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe064009be0 tx=0x7fe064004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.539+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640044c0 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.539+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe064003da0 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.539+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe070151220 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.539+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064044630 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.539+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe070151b60 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.540+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe070152060 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.540+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe06403b410 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.541+0000 7fe0577fe640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.541+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe0640a9a50 con 0x7fe07015ce60 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.541+0000 7fe06effd640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.541+0000 7fe06effd640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 0x7fe05c06d0f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe060000fb0 tx=0x7fe060009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.545+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe0640749b0 con 0x7fe07015ce60 2024-09-13T17:14:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.715+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0700672a0 con 0x7fe07015ce60 2024-09-13T17:14:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.715+0000 7fe0577fe640 1 -- 172.21.15.5:0/658914132 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe064077fd0 con 0x7fe07015ce60 2024-09-13T17:14:00.716 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 msgr2=0x7fe05c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 0x7fe05c06d0f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe060000fb0 tx=0x7fe060009040 comp rx=0 tx=0).stop 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 msgr2=0x7fe070152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe064009be0 tx=0x7fe064004730 comp rx=0 tx=0).stop 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 shutdown_connections 2024-09-13T17:14:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe070152fe0 0x7fe070153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe07015ce60 0x7fe070152360 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 --2- 172.21.15.5:0/658914132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0580047c0 0x7fe0701f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 >> 172.21.15.5:0/658914132 conn(0x7fe0700ce130 msgr2=0x7fe070158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 shutdown_connections 2024-09-13T17:14:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.717+0000 7fe075308640 1 -- 172.21.15.5:0/658914132 wait complete. 2024-09-13T17:14:00.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.831+0000 7ff4a3f45640 1 Processor -- start 2024-09-13T17:14:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.832+0000 7ff4a3f45640 1 -- start start 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.832+0000 7ff4a3f45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff49c0cf000 0x7ff49c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.832+0000 7ff4a3f45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff49c1645e0 0x7ff49c1669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a3f45640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0cf980 con 0x7ff49c15c6e0 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a3f45640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0ce570 con 0x7ff49c1645e0 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a3f45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0d0630 con 0x7ff49c0cf000 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a1ce1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff49c15c6e0 0x7ff49c0cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43374/0 (socket says 172.21.15.5:43374) 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a1ce1640 1 -- 172.21.15.5:0/1530652520 learned_addr learned my addr 172.21.15.5:0/1530652520 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a24e2640 1 --2- 172.21.15.5:0/1530652520 >> v2:172.21.15.5:3300/0 conn(0x7ff49c1645e0 0x7ff49c1669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a14e0640 1 --2- 172.21.15.5:0/1530652520 >> v2:172.21.15.179:3300/0 conn(0x7ff49c0cf000 0x7ff49c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a24e2640 1 -- 172.21.15.5:0/1530652520 >> v2:172.21.15.179:3300/0 conn(0x7ff49c0cf000 msgr2=0x7ff49c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a24e2640 1 --2- 172.21.15.5:0/1530652520 >> v2:172.21.15.179:3300/0 conn(0x7ff49c0cf000 0x7ff49c0cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a24e2640 1 -- 172.21.15.5:0/1530652520 >> v1:172.21.15.5:6789/0 conn(0x7ff49c15c6e0 legacy=0x7ff49c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.833+0000 7ff4a24e2640 1 -- 172.21.15.5:0/1530652520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0d0910 con 0x7ff49c1645e0 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a24e2640 1 --2- 172.21.15.5:0/1530652520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c1645e0 0x7ff49c1669d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff49c08bf40 tx=0x7ff49402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef0687496f59667 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a0cdf640 1 -- 172.21.15.5:0/1530652520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49402aea0 con 0x7ff49c1645e0 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a0cdf640 1 -- 172.21.15.5:0/1530652520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49402d050 con 0x7ff49c1645e0 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a0cdf640 1 -- 172.21.15.5:0/1530652520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494007960 con 0x7ff49c1645e0 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 -- 172.21.15.5:0/1530652520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c1645e0 msgr2=0x7ff49c1669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/1530652520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c1645e0 0x7ff49c1669d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff49c08bf40 tx=0x7ff49402a680 comp rx=0 tx=0).stop 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 -- 172.21.15.5:0/1530652520 shutdown_connections 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/1530652520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c1645e0 0x7ff49c1669d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/1530652520 >> v2:172.21.15.179:3300/0 conn(0x7ff49c0cf000 0x7ff49c0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.834+0000 7ff4a3f45640 1 -- 172.21.15.5:0/1530652520 >> 172.21.15.5:0/1530652520 conn(0x7ff49c089f90 msgr2=0x7ff49c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:00.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.835+0000 7ff4a3f45640 1 -- 172.21.15.5:0/1530652520 shutdown_connections 2024-09-13T17:14:00.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.835+0000 7ff4a3f45640 1 -- 172.21.15.5:0/1530652520 wait complete. 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.836+0000 7ff4a3f45640 1 Processor -- start 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.836+0000 7ff4a3f45640 1 -- start start 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.836+0000 7ff4a3f45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49c0cf000 0x7ff49c157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.836+0000 7ff4a3f45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.836+0000 7ff4a3f45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 0x7ff49c0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a3f45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b5440 con 0x7ff49c15c6e0 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a3f45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15ece0 con 0x7ff49c0cf000 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a3f45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15efc0 con 0x7ff49c1645e0 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47076/0 (socket says 172.21.15.5:47076) 2024-09-13T17:14:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 -- 172.21.15.5:0/3694467206 learned_addr learned my addr 172.21.15.5:0/3694467206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a1ce1640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49c0cf000 0x7ff49c157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a24e2640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 0x7ff49c0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 -- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 msgr2=0x7ff49c0b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 0x7ff49c0b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 -- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49c0cf000 msgr2=0x7ff49c157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49c0cf000 0x7ff49c157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 -- 172.21.15.5:0/3694467206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494009a70 con 0x7ff49c15c6e0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a24e2640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 0x7ff49c0b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a14e0640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c7f0 tx=0x7ff48c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c004220 con 0x7ff49c15c6e0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c0043a0 con 0x7ff49c15c6e0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0b5690 con 0x7ff49c15c6e0 2024-09-13T17:14:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007860 con 0x7ff49c15c6e0 2024-09-13T17:14:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.837+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c1575d0 con 0x7ff49c15c6e0 2024-09-13T17:14:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.838+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c0672e0 con 0x7ff49c15c6e0 2024-09-13T17:14:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.839+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff48c007bd0 con 0x7ff49c15c6e0 2024-09-13T17:14:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.839+0000 7ff4927fc640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 0x7ff48006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.839+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff48c0895c0 con 0x7ff49c15c6e0 2024-09-13T17:14:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.840+0000 7ff4a1ce1640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 0x7ff48006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.840+0000 7ff4a1ce1640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 0x7ff48006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff498005880 tx=0x7ff498009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:00.844+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff48c054520 con 0x7ff49c15c6e0 2024-09-13T17:14:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.016+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff49c0b5bb0 con 0x7ff49c15c6e0 2024-09-13T17:14:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.017+0000 7ff4927fc640 1 -- 172.21.15.5:0/3694467206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff49c0b5bb0 con 0x7ff49c15c6e0 2024-09-13T17:14:01.018 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 msgr2=0x7ff48006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 0x7ff48006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff498005880 tx=0x7ff498009040 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 msgr2=0x7ff49c0b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c7f0 tx=0x7ff48c00ccb0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 shutdown_connections 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff49c1645e0 0x7ff49c0b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff48006ac00 0x7ff48006d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff49c15c6e0 0x7ff49c0b74e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 --2- 172.21.15.5:0/3694467206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49c0cf000 0x7ff49c157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 >> 172.21.15.5:0/3694467206 conn(0x7ff49c089f90 msgr2=0x7ff49c0b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 shutdown_connections 2024-09-13T17:14:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.019+0000 7ff4a3f45640 1 -- 172.21.15.5:0/3694467206 wait complete. 2024-09-13T17:14:01.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:01.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.134+0000 7f0ee7b65640 1 Processor -- start 2024-09-13T17:14:01.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.134+0000 7f0ee7b65640 1 -- start start 2024-09-13T17:14:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee7b65640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ee01591e0 0x7f0ee00abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee7b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee00ad4e0 0x7f0ee00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee7b65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee00ad050 con 0x7f0ee006da30 2024-09-13T17:14:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee7b65640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee00ac440 con 0x7f0ee01591e0 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee7b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00ac720 con 0x7f0ee00ad4e0 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ee01591e0 0x7f0ee00abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ee01591e0 0x7f0ee00abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47088/0 (socket says 172.21.15.5:47088) 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 -- 172.21.15.5:0/1231340036 learned_addr learned my addr 172.21.15.5:0/1231340036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5100640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee00ad4e0 0x7f0ee00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 -- 172.21.15.5:0/1231340036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee00ad4e0 msgr2=0x7f0ee00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee00ad4e0 0x7f0ee00b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 -- 172.21.15.5:0/1231340036 >> v1:172.21.15.179:6789/0 conn(0x7f0ee006da30 legacy=0x7f0ee00700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.135+0000 7f0ee5901640 1 -- 172.21.15.5:0/1231340036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00aca00 con 0x7f0ee01591e0 2024-09-13T17:14:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee5901640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee01591e0 0x7f0ee00abe60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0896ccb5a9ef6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee48ff640 1 -- 172.21.15.5:0/1231340036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc032440 con 0x7f0ee01591e0 2024-09-13T17:14:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee48ff640 1 -- 172.21.15.5:0/1231340036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0325a0 con 0x7f0ee01591e0 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee48ff640 1 -- 172.21.15.5:0/1231340036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc032930 con 0x7f0ee01591e0 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee7b65640 1 -- 172.21.15.5:0/1231340036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee01591e0 msgr2=0x7f0ee00abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.136+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee01591e0 0x7f0ee00abe60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc02a270 comp rx=0 tx=0).stop 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 -- 172.21.15.5:0/1231340036 shutdown_connections 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee00ad4e0 0x7f0ee00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/1231340036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee01591e0 0x7f0ee00abe60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 -- 172.21.15.5:0/1231340036 >> 172.21.15.5:0/1231340036 conn(0x7f0ee00ce130 msgr2=0x7f0ee00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 -- 172.21.15.5:0/1231340036 shutdown_connections 2024-09-13T17:14:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.137+0000 7f0ee7b65640 1 -- 172.21.15.5:0/1231340036 wait complete. 2024-09-13T17:14:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.138+0000 7f0ee7b65640 1 Processor -- start 2024-09-13T17:14:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.138+0000 7f0ee7b65640 1 -- start start 2024-09-13T17:14:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee00ad4e0 0x7f0ee0150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee01591e0 0x7f0ee0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0150a60 con 0x7f0ee006da30 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01532d0 con 0x7f0ee00ad4e0 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01526c0 con 0x7f0ee01591e0 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47100/0 (socket says 172.21.15.5:47100) 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 -- 172.21.15.5:0/791877962 learned_addr learned my addr 172.21.15.5:0/791877962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5100640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee00ad4e0 0x7f0ee0150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee6102640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee01591e0 0x7f0ee0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 -- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee01591e0 msgr2=0x7f0ee0158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee01591e0 0x7f0ee0158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 -- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee00ad4e0 msgr2=0x7f0ee0150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee00ad4e0 0x7f0ee0150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 -- 172.21.15.5:0/791877962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0094d0 con 0x7f0ee006da30 2024-09-13T17:14:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee5901640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc032440 con 0x7f0ee006da30 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc030980 con 0x7f0ee006da30 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee01529a0 con 0x7f0ee006da30 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.139+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc030d30 con 0x7f0ee006da30 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.140+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee0152f60 con 0x7f0ee006da30 2024-09-13T17:14:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.140+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee00672a0 con 0x7f0ee006da30 2024-09-13T17:14:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.141+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0edc039040 con 0x7f0ee006da30 2024-09-13T17:14:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.141+0000 7f0ed67fc640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 0x7f0ec406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.141+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0edc0a9e10 con 0x7f0ee006da30 2024-09-13T17:14:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.142+0000 7f0ee5100640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 0x7f0ec406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.142+0000 7f0ee5100640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 0x7f0ec406d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ee01f5950 tx=0x7f0ed0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.146+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0edc074c50 con 0x7f0ee006da30 2024-09-13T17:14:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.316+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0ee00ced60 con 0x7f0ee006da30 2024-09-13T17:14:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.316+0000 7f0ed67fc640 1 -- 172.21.15.5:0/791877962 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0edc04c020 con 0x7f0ee006da30 2024-09-13T17:14:01.317 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 msgr2=0x7f0ec406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 0x7f0ec406d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0ee01f5950 tx=0x7f0ed0009190 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 msgr2=0x7f0ee0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 shutdown_connections 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ee01591e0 0x7f0ee0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ee00ad4e0 0x7f0ee0150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ec406ac00 0x7f0ec406d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 --2- 172.21.15.5:0/791877962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee006da30 0x7f0ee0152030 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 >> 172.21.15.5:0/791877962 conn(0x7f0ee00ce130 msgr2=0x7f0ee00af130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 shutdown_connections 2024-09-13T17:14:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.318+0000 7f0ee7b65640 1 -- 172.21.15.5:0/791877962 wait complete. 2024-09-13T17:14:01.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.431+0000 7fbb4c77d640 1 Processor -- start 2024-09-13T17:14:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.431+0000 7fbb4c77d640 1 -- start start 2024-09-13T17:14:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4c77d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb4415a3e0 0x7fbb4406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4c77d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb440ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4c77d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4406d410 con 0x7fbb440ab5a0 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4c77d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440aba50 con 0x7fbb4415a3e0 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4c77d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4406cb70 con 0x7fbb4406c320 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb4415a3e0 0x7fbb4406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb4415a3e0 0x7fbb4406e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47106/0 (socket says 172.21.15.5:47106) 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 -- 172.21.15.5:0/3962235448 learned_addr learned my addr 172.21.15.5:0/3962235448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb49d18640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb440ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 -- 172.21.15.5:0/3962235448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 msgr2=0x7fbb440ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb440ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 -- 172.21.15.5:0/3962235448 >> v1:172.21.15.179:6789/0 conn(0x7fbb440ab5a0 legacy=0x7fbb4415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.432+0000 7fbb4a519640 1 -- 172.21.15.5:0/3962235448 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4406ce50 con 0x7fbb4415a3e0 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.433+0000 7fbb4a519640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4415a3e0 0x7fbb4406e090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f4cce9559fc09a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.433+0000 7fbb49517640 1 -- 172.21.15.5:0/3962235448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032440 con 0x7fbb4415a3e0 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.433+0000 7fbb49517640 1 -- 172.21.15.5:0/3962235448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb400325a0 con 0x7fbb4415a3e0 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.433+0000 7fbb49517640 1 -- 172.21.15.5:0/3962235448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032930 con 0x7fbb4415a3e0 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3962235448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4415a3e0 msgr2=0x7fbb4406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4415a3e0 0x7fbb4406e090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).stop 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3962235448 shutdown_connections 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb440ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3962235448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4415a3e0 0x7fbb4406e090 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3962235448 >> 172.21.15.5:0/3962235448 conn(0x7fbb440ce0d0 msgr2=0x7fbb440ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3962235448 shutdown_connections 2024-09-13T17:14:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.434+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3962235448 wait complete. 2024-09-13T17:14:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.435+0000 7fbb4c77d640 1 Processor -- start 2024-09-13T17:14:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.435+0000 7fbb4c77d640 1 -- start start 2024-09-13T17:14:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb4413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 0x7fbb44156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4414db60 con 0x7fbb440ab5a0 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4414c640 con 0x7fbb4415a3e0 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4c77d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441f2100 con 0x7fbb4406c320 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47108/0 (socket says 172.21.15.5:47108) 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 -- 172.21.15.5:0/3838436289 learned_addr learned my addr 172.21.15.5:0/3838436289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4a519640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb4413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4ad1a640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 0x7fbb44156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 -- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 msgr2=0x7fbb4413d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb4413d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 -- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 msgr2=0x7fbb44156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 0x7fbb44156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 -- 172.21.15.5:0/3838436289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400094d0 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb4ad1a640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 0x7fbb44156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb49d18640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800d800 tx=0x7fbb3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.436+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38018070 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.437+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38004020 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.437+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380041b0 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.437+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4414c360 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.437+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4414e070 con 0x7fbb440ab5a0 2024-09-13T17:14:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.437+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb440672a0 con 0x7fbb440ab5a0 2024-09-13T17:14:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.438+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb38004310 con 0x7fbb440ab5a0 2024-09-13T17:14:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.438+0000 7fbb36ffd640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 0x7fbb2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.439+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbb38089520 con 0x7fbb440ab5a0 2024-09-13T17:14:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.439+0000 7fbb4a519640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 0x7fbb2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.439+0000 7fbb4a519640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 0x7fbb2806d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.443+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb38054340 con 0x7fbb440ab5a0 2024-09-13T17:14:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.624+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb440ab060 con 0x7fbb440ab5a0 2024-09-13T17:14:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.624+0000 7fbb36ffd640 1 -- 172.21.15.5:0/3838436289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb38057960 con 0x7fbb440ab5a0 2024-09-13T17:14:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 msgr2=0x7fbb2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 0x7fbb2806d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).stop 2024-09-13T17:14:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 msgr2=0x7fbb44155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800d800 tx=0x7fbb3800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 shutdown_connections 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb4415a3e0 0x7fbb44156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb2806ac00 0x7fbb2806d0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb440ab5a0 0x7fbb44155ae0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 --2- 172.21.15.5:0/3838436289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb4406c320 0x7fbb4413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 >> 172.21.15.5:0/3838436289 conn(0x7fbb440ce0d0 msgr2=0x7fbb440732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 shutdown_connections 2024-09-13T17:14:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.626+0000 7fbb4c77d640 1 -- 172.21.15.5:0/3838436289 wait complete. 2024-09-13T17:14:01.638 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:14:01.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:01.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:01.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:01.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:01.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:01.665 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:14:01.720 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:01.720 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:01.740 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:01.740 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:01.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.901+0000 7f387c63a640 1 Processor -- start 2024-09-13T17:14:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.901+0000 7f387c63a640 1 -- start start 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387c63a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f387415c810 0x7f38740cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387c63a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b4cf0 0x7f38740b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387c63a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740d1e80 con 0x7f38740d06d0 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387c63a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740d1750 con 0x7f387415c810 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387c63a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740d0bd0 con 0x7f38740b4cf0 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387a3d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f387415c810 0x7f38740cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.902+0000 7f387a3d6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f387415c810 0x7f38740cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47116/0 (socket says 172.21.15.5:47116) 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 -- 172.21.15.5:0/3212440002 learned_addr learned my addr 172.21.15.5:0/3212440002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387abd7640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b4cf0 0x7f38740b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 -- 172.21.15.5:0/3212440002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b4cf0 msgr2=0x7f38740b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b4cf0 0x7f38740b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 -- 172.21.15.5:0/3212440002 >> v1:172.21.15.179:6789/0 conn(0x7f38740d06d0 legacy=0x7f38740b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 -- 172.21.15.5:0/3212440002 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740d0eb0 con 0x7f387415c810 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.903+0000 7f387a3d6640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415c810 0x7f38740cd780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c369b5eb960c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f38793d4640 1 -- 172.21.15.5:0/3212440002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f387415c810 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f38793d4640 1 -- 172.21.15.5:0/3212440002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640325a0 con 0x7f387415c810 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f38793d4640 1 -- 172.21.15.5:0/3212440002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864032930 con 0x7f387415c810 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 -- 172.21.15.5:0/3212440002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415c810 msgr2=0x7f38740cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415c810 0x7f38740cd780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).stop 2024-09-13T17:14:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 -- 172.21.15.5:0/3212440002 shutdown_connections 2024-09-13T17:14:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b4cf0 0x7f38740b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 --2- 172.21.15.5:0/3212440002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415c810 0x7f38740cd780 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 -- 172.21.15.5:0/3212440002 >> 172.21.15.5:0/3212440002 conn(0x7f38740717a0 msgr2=0x7f3874071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 -- 172.21.15.5:0/3212440002 shutdown_connections 2024-09-13T17:14:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.904+0000 7f387c63a640 1 -- 172.21.15.5:0/3212440002 wait complete. 2024-09-13T17:14:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 Processor -- start 2024-09-13T17:14:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 -- start start 2024-09-13T17:14:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740d06d0 0x7f3874159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 0x7f3874159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741f63c0 con 0x7f38740b4cf0 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874159a90 con 0x7f38740d06d0 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387c63a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38741f5740 con 0x7f387415c810 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387a3d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387a3d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47126/0 (socket says 172.21.15.5:47126) 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.906+0000 7f387a3d6640 1 -- 172.21.15.5:0/1222528921 learned_addr learned my addr 172.21.15.5:0/1222528921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387abd7640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 0x7f3874159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f3879bd5640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740d06d0 0x7f3874159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 -- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 msgr2=0x7f3874159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 0x7f3874159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 -- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740d06d0 msgr2=0x7f3874159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740d06d0 0x7f3874159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 -- 172.21.15.5:0/1222528921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38640094d0 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387abd7640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 0x7f3874159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387a3d6640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f38640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864030b80 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38741f5a20 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386403d440 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.907+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38741f5fe0 con 0x7f38740b4cf0 2024-09-13T17:14:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.908+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38741f6170 con 0x7f38740b4cf0 2024-09-13T17:14:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.909+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3864039040 con 0x7f38740b4cf0 2024-09-13T17:14:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.909+0000 7f3872ffd640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 0x7f386006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.909+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38640aa250 con 0x7f38740b4cf0 2024-09-13T17:14:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.909+0000 7f3879bd5640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 0x7f386006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.910+0000 7f3879bd5640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 0x7f386006d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f387415f980 tx=0x7f3868009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:01.913+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3864075070 con 0x7f38740b4cf0 2024-09-13T17:14:02.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.085+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38740672a0 con 0x7f38740b4cf0 2024-09-13T17:14:02.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.086+0000 7f3872ffd640 1 -- 172.21.15.5:0/1222528921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f3864078690 con 0x7f38740b4cf0 2024-09-13T17:14:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:02.088 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 msgr2=0x7f386006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 0x7f386006d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f387415f980 tx=0x7f3868009040 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 msgr2=0x7f387414ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f38640046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 shutdown_connections 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f387415c810 0x7f3874159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740d06d0 0x7f3874159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac00 0x7f386006d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 --2- 172.21.15.5:0/1222528921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740b4cf0 0x7f387414ca30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.088+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 >> 172.21.15.5:0/1222528921 conn(0x7f38740717a0 msgr2=0x7f3874071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.089+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 shutdown_connections 2024-09-13T17:14:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.089+0000 7f387c63a640 1 -- 172.21.15.5:0/1222528921 wait complete. 2024-09-13T17:14:02.101 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:02.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.205+0000 7f0e3eb01640 1 Processor -- start 2024-09-13T17:14:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.205+0000 7f0e3eb01640 1 -- start start 2024-09-13T17:14:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3eb01640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e38152fa0 0x7f0e38071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3eb01640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e381598a0 0x7f0e380b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3eb01640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e38153380 con 0x7f0e380b20e0 2024-09-13T17:14:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3eb01640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380b24f0 con 0x7f0e381598a0 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3eb01640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e38070f10 con 0x7f0e38152fa0 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e381598a0 0x7f0e380b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e381598a0 0x7f0e380b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47128/0 (socket says 172.21.15.5:47128) 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 -- 172.21.15.5:0/2094390353 learned_addr learned my addr 172.21.15.5:0/2094390353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e3c89d640 1 --2- 172.21.15.5:0/2094390353 >> v2:172.21.15.179:3300/0 conn(0x7f0e38152fa0 0x7f0e38071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 -- 172.21.15.5:0/2094390353 >> v2:172.21.15.179:3300/0 conn(0x7f0e38152fa0 msgr2=0x7f0e38071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 --2- 172.21.15.5:0/2094390353 >> v2:172.21.15.179:3300/0 conn(0x7f0e38152fa0 0x7f0e38071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 -- 172.21.15.5:0/2094390353 >> v1:172.21.15.5:6789/0 conn(0x7f0e380b20e0 legacy=0x7f0e3806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.206+0000 7f0e37fff640 1 -- 172.21.15.5:0/2094390353 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380711f0 con 0x7f0e381598a0 2024-09-13T17:14:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.207+0000 7f0e37fff640 1 --2- 172.21.15.5:0/2094390353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e381598a0 0x7f0e380b1ba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0e3806e4c0 tx=0x7f0e2402c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b768659b70458d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.207+0000 7f0e377fe640 1 -- 172.21.15.5:0/2094390353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24032820 con 0x7f0e381598a0 2024-09-13T17:14:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.207+0000 7f0e377fe640 1 -- 172.21.15.5:0/2094390353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2402e040 con 0x7f0e381598a0 2024-09-13T17:14:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.207+0000 7f0e377fe640 1 -- 172.21.15.5:0/2094390353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24032ba0 con 0x7f0e381598a0 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2094390353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e381598a0 msgr2=0x7f0e380b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2094390353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e381598a0 0x7f0e380b1ba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0e3806e4c0 tx=0x7f0e2402c960 comp rx=0 tx=0).stop 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2094390353 shutdown_connections 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2094390353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e381598a0 0x7f0e380b1ba0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2094390353 >> v2:172.21.15.179:3300/0 conn(0x7f0e38152fa0 0x7f0e38071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2094390353 >> 172.21.15.5:0/2094390353 conn(0x7f0e380ce130 msgr2=0x7f0e380ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2094390353 shutdown_connections 2024-09-13T17:14:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.208+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2094390353 wait complete. 2024-09-13T17:14:02.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.209+0000 7f0e3eb01640 1 Processor -- start 2024-09-13T17:14:02.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.209+0000 7f0e3eb01640 1 -- start start 2024-09-13T17:14:02.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 0x7f0e38159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e381598a0 0x7f0e3814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3815b0d0 con 0x7f0e38152fa0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3814e030 con 0x7f0e381598a0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3eb01640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380aeea0 con 0x7f0e380b20e0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47144/0 (socket says 172.21.15.5:47144) 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 -- 172.21.15.5:0/2931258114 learned_addr learned my addr 172.21.15.5:0/2931258114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3c89d640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 0x7f0e38159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 -- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 msgr2=0x7f0e38159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3d09e640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e381598a0 0x7f0e3814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 0x7f0e38159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 -- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e381598a0 msgr2=0x7f0e3814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e381598a0 0x7f0e3814a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e37fff640 1 -- 172.21.15.5:0/2931258114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2400b770 con 0x7f0e38152fa0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.210+0000 7f0e3c89d640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 0x7f0e38159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e37fff640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0e2402c9a0 tx=0x7f0e24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031900 con 0x7f0e38152fa0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24031a60 con 0x7f0e38152fa0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3815adf0 con 0x7f0e38152fa0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031e10 con 0x7f0e38152fa0 2024-09-13T17:14:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.211+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e380af440 con 0x7f0e38152fa0 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.212+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380672a0 con 0x7f0e38152fa0 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.212+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e2403b420 con 0x7f0e38152fa0 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.213+0000 7f0e357fa640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 0x7f0e1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.213+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e240aa5b0 con 0x7f0e38152fa0 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.213+0000 7f0e3c89d640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 0x7f0e1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.214+0000 7f0e3c89d640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 0x7f0e1c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009ac0 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.217+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e240753f0 con 0x7f0e38152fa0 2024-09-13T17:14:02.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.386+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e380b12d0 con 0x7f0e38152fa0 2024-09-13T17:14:02.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.386+0000 7f0e357fa640 1 -- 172.21.15.5:0/2931258114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e24078a10 con 0x7f0e38152fa0 2024-09-13T17:14:02.388 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:02.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 msgr2=0x7f0e1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 0x7f0e1c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009ac0 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 msgr2=0x7f0e3806c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0e2402c9a0 tx=0x7f0e24004730 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 shutdown_connections 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e381598a0 0x7f0e3814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e1c06ac00 0x7f0e1c06d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e38152fa0 0x7f0e3806c6e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 --2- 172.21.15.5:0/2931258114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e380b20e0 0x7f0e38159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 >> 172.21.15.5:0/2931258114 conn(0x7f0e380ce130 msgr2=0x7f0e380b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 shutdown_connections 2024-09-13T17:14:02.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.388+0000 7f0e3eb01640 1 -- 172.21.15.5:0/2931258114 wait complete. 2024-09-13T17:14:02.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.504+0000 7f7e59b25640 1 Processor -- start 2024-09-13T17:14:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.504+0000 7f7e59b25640 1 -- start start 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e59b25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e5415fd80 0x7f7e540cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e59b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e59b25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540704a0 con 0x7f7e540d0e30 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e59b25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5406cc10 con 0x7f7e5415fd80 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e59b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5406bd80 con 0x7f7e54099110 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e537fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e5415fd80 0x7f7e540cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e52ffd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7e540d0e30 0x7f7e54098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:59008/0 (socket says 172.21.15.5:59008) 2024-09-13T17:14:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:47972/0 (socket says 172.21.15.5:47972) 2024-09-13T17:14:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e52ffd640 1 -- 172.21.15.5:0/3213195815 learned_addr learned my addr 172.21.15.5:0/3213195815 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 -- 172.21.15.5:0/3213195815 >> v2:172.21.15.179:3300/0 conn(0x7f7e5415fd80 msgr2=0x7f7e540cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e527fc640 1 -- 172.21.15.5:0/3213195815 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150000597 0 0) 0x7f7e540704a0 con 0x7f7e540d0e30 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 --2- 172.21.15.5:0/3213195815 >> v2:172.21.15.179:3300/0 conn(0x7f7e5415fd80 0x7f7e540cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 -- 172.21.15.5:0/3213195815 >> v1:172.21.15.179:6789/0 conn(0x7f7e540d0e30 legacy=0x7f7e54098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.505+0000 7f7e53fff640 1 -- 172.21.15.5:0/3213195815 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540d1270 con 0x7f7e54099110 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.506+0000 7f7e53fff640 1 --2- 172.21.15.5:0/3213195815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009d90 tx=0x7f7e4c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31fb4f9b0c620a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.506+0000 7f7e527fc640 1 -- 172.21.15.5:0/3213195815 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c031600 con 0x7f7e54099110 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.506+0000 7f7e527fc640 1 -- 172.21.15.5:0/3213195815 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c02d050 con 0x7f7e54099110 2024-09-13T17:14:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e527fc640 1 -- 172.21.15.5:0/3213195815 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c031980 con 0x7f7e54099110 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 -- 172.21.15.5:0/3213195815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 msgr2=0x7f7e5406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 --2- 172.21.15.5:0/3213195815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009d90 tx=0x7f7e4c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 -- 172.21.15.5:0/3213195815 shutdown_connections 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 --2- 172.21.15.5:0/3213195815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e5406e870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 --2- 172.21.15.5:0/3213195815 >> v2:172.21.15.179:3300/0 conn(0x7f7e5415fd80 0x7f7e540cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 -- 172.21.15.5:0/3213195815 >> 172.21.15.5:0/3213195815 conn(0x7f7e540d0310 msgr2=0x7f7e540d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 -- 172.21.15.5:0/3213195815 shutdown_connections 2024-09-13T17:14:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.507+0000 7f7e59b25640 1 -- 172.21.15.5:0/3213195815 wait complete. 2024-09-13T17:14:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.508+0000 7f7e59b25640 1 Processor -- start 2024-09-13T17:14:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.508+0000 7f7e59b25640 1 -- start start 2024-09-13T17:14:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e541518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e5415fd80 0x7f7e540ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540aea20 con 0x7f7e540d0e30 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54151de0 con 0x7f7e5415fd80 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e59b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540ade10 con 0x7f7e54099110 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47156/0 (socket says 172.21.15.5:47156) 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.509+0000 7f7e52ffd640 1 -- 172.21.15.5:0/1722263450 learned_addr learned my addr 172.21.15.5:0/1722263450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e53fff640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e5415fd80 0x7f7e540ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e537fe640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e541518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 -- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 msgr2=0x7f7e541518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e541518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 -- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e5415fd80 msgr2=0x7f7e540ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e5415fd80 0x7f7e540ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 -- 172.21.15.5:0/1722263450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c009a70 con 0x7f7e540d0e30 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e52ffd640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c500 tx=0x7f7e4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007560 con 0x7f7e540d0e30 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e480047e0 con 0x7f7e540d0e30 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540ae0f0 con 0x7f7e540d0e30 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48004b90 con 0x7f7e540d0e30 2024-09-13T17:14:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.510+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540ae6b0 con 0x7f7e540d0e30 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.511+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e540cfa60 con 0x7f7e540d0e30 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.512+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e48004cf0 con 0x7f7e540d0e30 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.512+0000 7f7e3bfff640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.512+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e48088b50 con 0x7f7e540d0e30 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.512+0000 7f7e537fe640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.513+0000 7f7e537fe640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 0x7f7e4006d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ad0 tx=0x7f7e44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.516+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e48053a00 con 0x7f7e540d0e30 2024-09-13T17:14:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.685+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e5406cf90 con 0x7f7e540d0e30 2024-09-13T17:14:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.686+0000 7f7e3bfff640 1 -- 172.21.15.5:0/1722263450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e480180a0 con 0x7f7e540d0e30 2024-09-13T17:14:02.687 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.687+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 msgr2=0x7f7e4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.687+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 0x7f7e4006d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ad0 tx=0x7f7e44008040 comp rx=0 tx=0).stop 2024-09-13T17:14:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.687+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 msgr2=0x7f7e540aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.687+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c500 tx=0x7f7e4800c9c0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 shutdown_connections 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e5415fd80 0x7f7e540ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7e4006ac00 0x7f7e4006d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e540d0e30 0x7f7e540aeeb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 --2- 172.21.15.5:0/1722263450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e54099110 0x7f7e541518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 >> 172.21.15.5:0/1722263450 conn(0x7f7e540d0310 msgr2=0x7f7e5415e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 shutdown_connections 2024-09-13T17:14:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.688+0000 7f7e59b25640 1 -- 172.21.15.5:0/1722263450 wait complete. 2024-09-13T17:14:02.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:02.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 Processor -- start 2024-09-13T17:14:02.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 -- start start 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f097815fce0 0x7f09780cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09780b1230 0x7f09780b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780ce590 con 0x7f09780b44a0 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780b4fc0 con 0x7f097815fce0 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.804+0000 7f097e67d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780ccd80 con 0x7f09780b1230 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f097815fce0 0x7f09780cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f097815fce0 0x7f09780cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47162/0 (socket says 172.21.15.5:47162) 2024-09-13T17:14:02.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 -- 172.21.15.5:0/2592220140 learned_addr learned my addr 172.21.15.5:0/2592220140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f096ffff640 1 --2- 172.21.15.5:0/2592220140 >> v2:172.21.15.179:3300/0 conn(0x7f09780b1230 0x7f09780b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 -- 172.21.15.5:0/2592220140 >> v2:172.21.15.179:3300/0 conn(0x7f09780b1230 msgr2=0x7f09780b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 --2- 172.21.15.5:0/2592220140 >> v2:172.21.15.179:3300/0 conn(0x7f09780b1230 0x7f09780b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 -- 172.21.15.5:0/2592220140 >> v1:172.21.15.5:6789/0 conn(0x7f09780b44a0 legacy=0x7f097806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.805+0000 7f0977fff640 1 -- 172.21.15.5:0/2592220140 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780d3340 con 0x7f097815fce0 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f0977fff640 1 --2- 172.21.15.5:0/2592220140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097815fce0 0x7f09780cea20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09780d20c0 tx=0x7f096802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d53213f040c3f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f09777fe640 1 -- 172.21.15.5:0/2592220140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968032440 con 0x7f097815fce0 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f09777fe640 1 -- 172.21.15.5:0/2592220140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09680325a0 con 0x7f097815fce0 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f09777fe640 1 -- 172.21.15.5:0/2592220140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968032930 con 0x7f097815fce0 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 -- 172.21.15.5:0/2592220140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097815fce0 msgr2=0x7f09780cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 --2- 172.21.15.5:0/2592220140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097815fce0 0x7f09780cea20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09780d20c0 tx=0x7f096802a270 comp rx=0 tx=0).stop 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 -- 172.21.15.5:0/2592220140 shutdown_connections 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 --2- 172.21.15.5:0/2592220140 >> v2:172.21.15.179:3300/0 conn(0x7f09780b1230 0x7f09780b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 --2- 172.21.15.5:0/2592220140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f097815fce0 0x7f09780cea20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 -- 172.21.15.5:0/2592220140 >> 172.21.15.5:0/2592220140 conn(0x7f0978089f90 msgr2=0x7f09780d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 -- 172.21.15.5:0/2592220140 shutdown_connections 2024-09-13T17:14:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.806+0000 7f097e67d640 1 -- 172.21.15.5:0/2592220140 wait complete. 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 Processor -- start 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 -- start start 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09780b44a0 0x7f09781f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 0x7f09780cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781f3070 con 0x7f09780b1230 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09780cc090 con 0x7f097815fce0 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f097e67d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09780ca560 con 0x7f09780b44a0 2024-09-13T17:14:02.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f0977fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f0977fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47164/0 (socket says 172.21.15.5:47164) 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.808+0000 7f0977fff640 1 -- 172.21.15.5:0/1184384933 learned_addr learned my addr 172.21.15.5:0/1184384933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f096ffff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09780b44a0 0x7f09781f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f097cc1a640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 0x7f09780cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 -- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09780b44a0 msgr2=0x7f09781f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09780b44a0 0x7f09781f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 -- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 msgr2=0x7f09780cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 0x7f09780cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 -- 172.21.15.5:0/1184384933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09680094d0 con 0x7f09780b1230 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f097cc1a640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 0x7f09780cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f0977fff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f096802a2b0 tx=0x7f09680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968032440 con 0x7f09780b1230 2024-09-13T17:14:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968030ba0 con 0x7f09780b1230 2024-09-13T17:14:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096803d440 con 0x7f09780b1230 2024-09-13T17:14:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09780c9cc0 con 0x7f09780b1230 2024-09-13T17:14:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.809+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09780ca280 con 0x7f09780b1230 2024-09-13T17:14:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.810+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09780b4910 con 0x7f09780b1230 2024-09-13T17:14:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.811+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0968039040 con 0x7f09780b1230 2024-09-13T17:14:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.811+0000 7f09757fa640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 0x7f095806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.811+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09680aa280 con 0x7f09780b1230 2024-09-13T17:14:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.811+0000 7f096ffff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 0x7f095806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.812+0000 7f096ffff640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 0x7f095806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f09780a0630 tx=0x7f0960008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.815+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f09680750b0 con 0x7f09780b1230 2024-09-13T17:14:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.986+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09780d2cf0 con 0x7f09780b1230 2024-09-13T17:14:02.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.987+0000 7f09757fa640 1 -- 172.21.15.5:0/1184384933 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09680786d0 con 0x7f09780b1230 2024-09-13T17:14:02.988 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 msgr2=0x7f095806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 0x7f095806d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f09780a0630 tx=0x7f0960008040 comp rx=0 tx=0).stop 2024-09-13T17:14:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 msgr2=0x7f09780c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f096802a2b0 tx=0x7f09680046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 shutdown_connections 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f097815fce0 0x7f09780cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09780b44a0 0x7f09781f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f095806ac00 0x7f095806d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 --2- 172.21.15.5:0/1184384933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780b1230 0x7f09780c95b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 >> 172.21.15.5:0/1184384933 conn(0x7f0978089f90 msgr2=0x7f097815cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 shutdown_connections 2024-09-13T17:14:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:02.989+0000 7f097e67d640 1 -- 172.21.15.5:0/1184384933 wait complete. 2024-09-13T17:14:03.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.104+0000 7f622f376640 1 Processor -- start 2024-09-13T17:14:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.104+0000 7f622f376640 1 -- start start 2024-09-13T17:14:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622f376640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f622806eb80 0x7f62280b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622f376640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f622806ef60 0x7f622806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622f376640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280b35f0 con 0x7f62280b1ac0 2024-09-13T17:14:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622f376640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622815d140 con 0x7f622806ef60 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622f376640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6228160020 con 0x7f622806eb80 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f622806ef60 0x7f622806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f622806ef60 0x7f622806aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47176/0 (socket says 172.21.15.5:47176) 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 -- 172.21.15.5:0/681830886 learned_addr learned my addr 172.21.15.5:0/681830886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d112640 1 --2- 172.21.15.5:0/681830886 >> v2:172.21.15.179:3300/0 conn(0x7f622806eb80 0x7f62280b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 -- 172.21.15.5:0/681830886 >> v2:172.21.15.179:3300/0 conn(0x7f622806eb80 msgr2=0x7f62280b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 --2- 172.21.15.5:0/681830886 >> v2:172.21.15.179:3300/0 conn(0x7f622806eb80 0x7f62280b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 -- 172.21.15.5:0/681830886 >> v1:172.21.15.179:6789/0 conn(0x7f62280b1ac0 legacy=0x7f622815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.105+0000 7f622d913640 1 -- 172.21.15.5:0/681830886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228156f50 con 0x7f622806ef60 2024-09-13T17:14:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.106+0000 7f622d913640 1 --2- 172.21.15.5:0/681830886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806ef60 0x7f622806aea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6228071c60 tx=0x7f622002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8b9eadfe903b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.106+0000 7f621ffff640 1 -- 172.21.15.5:0/681830886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220031600 con 0x7f622806ef60 2024-09-13T17:14:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.106+0000 7f621ffff640 1 -- 172.21.15.5:0/681830886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622002d050 con 0x7f622806ef60 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.106+0000 7f621ffff640 1 -- 172.21.15.5:0/681830886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220031980 con 0x7f622806ef60 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 -- 172.21.15.5:0/681830886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806ef60 msgr2=0x7f622806aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 --2- 172.21.15.5:0/681830886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806ef60 0x7f622806aea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6228071c60 tx=0x7f622002a730 comp rx=0 tx=0).stop 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 -- 172.21.15.5:0/681830886 shutdown_connections 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 --2- 172.21.15.5:0/681830886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806ef60 0x7f622806aea0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 --2- 172.21.15.5:0/681830886 >> v2:172.21.15.179:3300/0 conn(0x7f622806eb80 0x7f62280b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 -- 172.21.15.5:0/681830886 >> 172.21.15.5:0/681830886 conn(0x7f6228070af0 msgr2=0x7f6228070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 -- 172.21.15.5:0/681830886 shutdown_connections 2024-09-13T17:14:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.107+0000 7f622f376640 1 -- 172.21.15.5:0/681830886 wait complete. 2024-09-13T17:14:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.108+0000 7f622f376640 1 Processor -- start 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.108+0000 7f622f376640 1 -- start start 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622806ef60 0x7f622814a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62280b1ac0 0x7f62280c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622814a8f0 con 0x7f622806eb80 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622815b750 con 0x7f62280b1ac0 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622f376640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622815ba30 con 0x7f622806ef60 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47180/0 (socket says 172.21.15.5:47180) 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 -- 172.21.15.5:0/1549638272 learned_addr learned my addr 172.21.15.5:0/1549638272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622c911640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622806ef60 0x7f622814a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d913640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62280b1ac0 0x7f62280c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 -- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622806ef60 msgr2=0x7f622814a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622806ef60 0x7f622814a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 -- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62280b1ac0 msgr2=0x7f62280c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62280b1ac0 0x7f62280c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 -- 172.21.15.5:0/1549638272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6220009b30 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.109+0000 7f622d112640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f622400d800 tx=0x7f622400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.110+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400b6c0 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.110+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400b820 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.110+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622815bd10 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.110+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400bbb0 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.110+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622815c2d0 con 0x7f622806eb80 2024-09-13T17:14:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.111+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62280672e0 con 0x7f622806eb80 2024-09-13T17:14:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.111+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f622400bd10 con 0x7f622806eb80 2024-09-13T17:14:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.111+0000 7f621dffb640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.112+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6224089ac0 con 0x7f622806eb80 2024-09-13T17:14:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.112+0000 7f622c911640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.112+0000 7f622c911640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6218000f60 tx=0x7f6218009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.116+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6224054a20 con 0x7f622806eb80 2024-09-13T17:14:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.286+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62280b3a20 con 0x7f622806eb80 2024-09-13T17:14:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.287+0000 7f621dffb640 1 -- 172.21.15.5:0/1549638272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6224089e60 con 0x7f622806eb80 2024-09-13T17:14:03.288 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 msgr2=0x7f620c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6218000f60 tx=0x7f6218009040 comp rx=0 tx=0).stop 2024-09-13T17:14:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 msgr2=0x7f622815b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f622400d800 tx=0x7f622400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 shutdown_connections 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62280b1ac0 0x7f62280c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622806ef60 0x7f622814a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 --2- 172.21.15.5:0/1549638272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622806eb80 0x7f622815b0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 >> 172.21.15.5:0/1549638272 conn(0x7f6228070af0 msgr2=0x7f622815dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 shutdown_connections 2024-09-13T17:14:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.289+0000 7f622f376640 1 -- 172.21.15.5:0/1549638272 wait complete. 2024-09-13T17:14:03.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.403+0000 7ff2eff18640 1 Processor -- start 2024-09-13T17:14:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.403+0000 7ff2eff18640 1 -- start start 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eff18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2e8159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eff18640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff2e8071190 0x7ff2e806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eff18640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e80b1580 con 0x7ff2e8159bb0 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eff18640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80b2ad0 con 0x7ff2e8071190 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eff18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80b1ec0 con 0x7ff2e8159290 2024-09-13T17:14:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2ed4b3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2e8159bb0 0x7ff2e8070a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53336/0 (socket says 172.21.15.5:53336) 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2ed4b3640 1 -- 172.21.15.5:0/435349724 learned_addr learned my addr 172.21.15.5:0/435349724 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2e8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2ee4b5640 1 --2- 172.21.15.5:0/435349724 >> v2:172.21.15.179:3300/0 conn(0x7ff2e8071190 0x7ff2e806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532973192 0 0) 0x7ff2e80b1580 con 0x7ff2e8159bb0 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.404+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d4003520 con 0x7ff2e8159bb0 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279747534 0 0) 0x7ff2d4003520 con 0x7ff2e8159bb0 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 msgr2=0x7ff2e8159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2e8159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 >> v2:172.21.15.179:3300/0 conn(0x7ff2e8071190 msgr2=0x7ff2e806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 --2- 172.21.15.5:0/435349724 >> v2:172.21.15.179:3300/0 conn(0x7ff2e8071190 0x7ff2e806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80b21a0 con 0x7ff2e8159bb0 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff2e4001670 con 0x7ff2e8159bb0 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 >> v1:172.21.15.5:6789/0 conn(0x7ff2e8159bb0 legacy=0x7ff2e8070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d4003970 0x7ff2d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d4004d00 0x7ff2d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80b2ad0 con 0x7ff2d4003970 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80b1ec0 con 0x7ff2d4004d00 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d400b980 con 0x7ff2e8159290 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d4003970 0x7ff2d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2ee4b5640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d4004d00 0x7ff2d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2ed4b3640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 -- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 msgr2=0x7ff2d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2e8159290 0x7ff2d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 -- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d4004d00 msgr2=0x7ff2d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d4004d00 0x7ff2d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.405+0000 7ff2edcb4640 1 -- 172.21.15.5:0/435349724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4003520 con 0x7ff2d4003970 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.406+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d4003970 0x7ff2d4003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009ac0 tx=0x7ff2d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c53691e1f03b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.406+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031400 con 0x7ff2d4003970 2024-09-13T17:14:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.406+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc02d050 con 0x7ff2d4003970 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.406+0000 7ff2eccb2640 1 -- 172.21.15.5:0/435349724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031780 con 0x7ff2d4003970 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 -- 172.21.15.5:0/435349724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d4003970 msgr2=0x7ff2d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 --2- 172.21.15.5:0/435349724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d4003970 0x7ff2d4003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009ac0 tx=0x7ff2d40057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2ee4b5640 1 -- 172.21.15.5:0/435349724 reap_dead start 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 -- 172.21.15.5:0/435349724 shutdown_connections 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 -- 172.21.15.5:0/435349724 >> 172.21.15.5:0/435349724 conn(0x7ff2e80ce0d0 msgr2=0x7ff2e80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 -- 172.21.15.5:0/435349724 shutdown_connections 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.407+0000 7ff2eff18640 1 -- 172.21.15.5:0/435349724 wait complete. 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.408+0000 7ff2eff18640 1 Processor -- start 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.408+0000 7ff2eff18640 1 -- start start 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d4003970 0x7ff2e80978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2e80cd960 0x7ff2e8148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8152d00 con 0x7ff2e8149840 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80cddf0 con 0x7ff2e80cd960 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e81523d0 con 0x7ff2d4003970 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50892/0 (socket says 172.21.15.5:50892) 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 -- 172.21.15.5:0/3634642241 learned_addr learned my addr 172.21.15.5:0/3634642241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2edcb4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d4003970 0x7ff2e80978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ed4b3640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2e80cd960 0x7ff2e8148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 -- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d4003970 msgr2=0x7ff2e80978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d4003970 0x7ff2e80978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 -- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2e80cd960 msgr2=0x7ff2e8148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2e80cd960 0x7ff2e8148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 -- 172.21.15.5:0/3634642241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80b30e0 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2ee4b5640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80adcc0 tx=0x7ff2e000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000e040 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000f040 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e81526b0 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.409+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0015430 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.410+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8097e20 con 0x7ff2e8149840 2024-09-13T17:14:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.410+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e809c460 con 0x7ff2e8149840 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.411+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2e0015590 con 0x7ff2e8149840 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.411+0000 7ff2da7fc640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 0x7ff2cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.411+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff2e0089fc0 con 0x7ff2e8149840 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.412+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 0x7ff2cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.412+0000 7ff2edcb4640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 0x7ff2cc06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc033000 tx=0x7ff2dc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.416+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2e0054dd0 con 0x7ff2e8149840 2024-09-13T17:14:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.600+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2e80672a0 con 0x7ff2e8149840 2024-09-13T17:14:03.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.601+0000 7ff2da7fc640 1 -- 172.21.15.5:0/3634642241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff2e00583f0 con 0x7ff2e8149840 2024-09-13T17:14:03.602 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 msgr2=0x7ff2cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 0x7ff2cc06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc033000 tx=0x7ff2dc008030 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 msgr2=0x7ff2e8149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80adcc0 tx=0x7ff2e000f1b0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 shutdown_connections 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff2cc06ac00 0x7ff2cc06d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2e8149840 0x7ff2e8149170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2e80cd960 0x7ff2e8148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 --2- 172.21.15.5:0/3634642241 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d4003970 0x7ff2e80978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 >> 172.21.15.5:0/3634642241 conn(0x7ff2e80ce0d0 msgr2=0x7ff2e806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 shutdown_connections 2024-09-13T17:14:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.602+0000 7ff2eff18640 1 -- 172.21.15.5:0/3634642241 wait complete. 2024-09-13T17:14:03.616 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:03.617 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:03.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.737+0000 7f35aeb0f640 1 Processor -- start 2024-09-13T17:14:03.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.737+0000 7f35aeb0f640 1 -- start start 2024-09-13T17:14:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35aeb0f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a806e090 0x7f35a80ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35aeb0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 0x7f35a80b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35aeb0f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a806d410 con 0x7f35a815a3e0 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35aeb0f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a806e4d0 con 0x7f35a806e090 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35aeb0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80aba30 con 0x7f35a80ab5a0 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a806e090 0x7f35a80ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a806e090 0x7f35a80ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50894/0 (socket says 172.21.15.5:50894) 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 -- 172.21.15.5:0/1886992242 learned_addr learned my addr 172.21.15.5:0/1886992242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35ad0ac640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 0x7f35a80b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 -- 172.21.15.5:0/1886992242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 msgr2=0x7f35a80b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 0x7f35a80b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 -- 172.21.15.5:0/1886992242 >> v1:172.21.15.5:6789/0 conn(0x7f35a815a3e0 legacy=0x7f35a806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f359ffff640 1 -- 172.21.15.5:0/1886992242 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a806cb70 con 0x7f35a806e090 2024-09-13T17:14:03.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.738+0000 7f35ad0ac640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 0x7f35a80b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.739+0000 7f359ffff640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a806e090 0x7f35a80ab060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3598009870 tx=0x7f359802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55c8b864829f632 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.739+0000 7f359f7fe640 1 -- 172.21.15.5:0/1886992242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598032440 con 0x7f35a806e090 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.739+0000 7f359f7fe640 1 -- 172.21.15.5:0/1886992242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980325a0 con 0x7f35a806e090 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.739+0000 7f359f7fe640 1 -- 172.21.15.5:0/1886992242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598032930 con 0x7f35a806e090 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 -- 172.21.15.5:0/1886992242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a806e090 msgr2=0x7f35a80ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a806e090 0x7f35a80ab060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3598009870 tx=0x7f359802a270 comp rx=0 tx=0).stop 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 -- 172.21.15.5:0/1886992242 shutdown_connections 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a80ab5a0 0x7f35a80b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/1886992242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a806e090 0x7f35a80ab060 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 -- 172.21.15.5:0/1886992242 >> 172.21.15.5:0/1886992242 conn(0x7f35a80ce0d0 msgr2=0x7f35a80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 -- 172.21.15.5:0/1886992242 shutdown_connections 2024-09-13T17:14:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.740+0000 7f35aeb0f640 1 -- 172.21.15.5:0/1886992242 wait complete. 2024-09-13T17:14:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.741+0000 7f35aeb0f640 1 Processor -- start 2024-09-13T17:14:03.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.741+0000 7f35aeb0f640 1 -- start start 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a806e090 0x7f35a81533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a815a3e0 0x7f35a814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81e4a00 con 0x7f35a80ab5a0 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8152050 con 0x7f35a815a3e0 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35aeb0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8152330 con 0x7f35a806e090 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50910/0 (socket says 172.21.15.5:50910) 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 -- 172.21.15.5:0/992794970 learned_addr learned my addr 172.21.15.5:0/992794970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35ac8ab640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a806e090 0x7f35a81533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f35ad0ac640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a815a3e0 0x7f35a814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 -- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a806e090 msgr2=0x7f35a81533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a806e090 0x7f35a81533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 -- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a815a3e0 msgr2=0x7f35a814a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a815a3e0 0x7f35a814a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.742+0000 7f359ffff640 1 -- 172.21.15.5:0/992794970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980094d0 con 0x7f35a80ab5a0 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f359ffff640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3598000c00 tx=0x7f35980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598030b80 con 0x7f35a80ab5a0 2024-09-13T17:14:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598030d00 con 0x7f35a80ab5a0 2024-09-13T17:14:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a8152610 con 0x7f35a80ab5a0 2024-09-13T17:14:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359803d680 con 0x7f35a80ab5a0 2024-09-13T17:14:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.743+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8152bd0 con 0x7f35a80ab5a0 2024-09-13T17:14:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.744+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80672a0 con 0x7f35a80ab5a0 2024-09-13T17:14:03.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.744+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3598039040 con 0x7f35a80ab5a0 2024-09-13T17:14:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.745+0000 7f359d7fa640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 0x7f359406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.745+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35980aa390 con 0x7f35a80ab5a0 2024-09-13T17:14:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.745+0000 7f35ac8ab640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 0x7f359406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.745+0000 7f35ac8ab640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 0x7f359406d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f35a81f3440 tx=0x7f35a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.749+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f35980752f0 con 0x7f35a80ab5a0 2024-09-13T17:14:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.922+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35a8154d80 con 0x7f35a80ab5a0 2024-09-13T17:14:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.923+0000 7f359d7fa640 1 -- 172.21.15.5:0/992794970 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f3598078910 con 0x7f35a80ab5a0 2024-09-13T17:14:03.925 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 msgr2=0x7f359406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 0x7f359406d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f35a81f3440 tx=0x7f35a4009040 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 msgr2=0x7f35a814a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3598000c00 tx=0x7f35980046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 shutdown_connections 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35a815a3e0 0x7f35a814a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f359406ac00 0x7f359406d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80ab5a0 0x7f35a814a340 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.925+0000 7f35aeb0f640 1 --2- 172.21.15.5:0/992794970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35a806e090 0x7f35a81533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.926+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 >> 172.21.15.5:0/992794970 conn(0x7f35a80ce0d0 msgr2=0x7f35a8154670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.926+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 shutdown_connections 2024-09-13T17:14:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:03.926+0000 7f35aeb0f640 1 -- 172.21.15.5:0/992794970 wait complete. 2024-09-13T17:14:03.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:03.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:04.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.040+0000 7f83a8108640 1 Processor -- start 2024-09-13T17:14:04.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 -- start start 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83a0152fa0 0x7f83a0071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a0153380 con 0x7f83a01598a0 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a0070f10 con 0x7f83a0152fa0 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.041+0000 7f83a8108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00711f0 con 0x7f83a00b22b0 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a66a5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a56a3640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f83a01598a0 0x7f83a00b1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:43486/0 (socket says 172.21.15.5:43486) 2024-09-13T17:14:04.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a56a3640 1 -- 172.21.15.5:0/2026017977 learned_addr learned my addr 172.21.15.5:0/2026017977 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a5ea4640 1 --2- 172.21.15.5:0/2026017977 >> v2:172.21.15.179:3300/0 conn(0x7f83a0152fa0 0x7f83a0071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a66a5640 1 -- 172.21.15.5:0/2026017977 >> v2:172.21.15.179:3300/0 conn(0x7f83a0152fa0 msgr2=0x7f83a0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a66a5640 1 --2- 172.21.15.5:0/2026017977 >> v2:172.21.15.179:3300/0 conn(0x7f83a0152fa0 0x7f83a0071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a4ea2640 1 -- 172.21.15.5:0/2026017977 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253200971 0 0) 0x7f83a0153380 con 0x7f83a01598a0 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a66a5640 1 -- 172.21.15.5:0/2026017977 >> v1:172.21.15.179:6789/0 conn(0x7f83a01598a0 legacy=0x7f83a00b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.042+0000 7f83a66a5640 1 -- 172.21.15.5:0/2026017977 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00714d0 con 0x7f83a00b22b0 2024-09-13T17:14:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.043+0000 7f83a66a5640 1 --2- 172.21.15.5:0/2026017977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a006c920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8398009d90 tx=0x7f839802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37882478b830473 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.043+0000 7f83a4ea2640 1 -- 172.21.15.5:0/2026017977 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398007740 con 0x7f83a00b22b0 2024-09-13T17:14:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.043+0000 7f83a4ea2640 1 -- 172.21.15.5:0/2026017977 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839802d050 con 0x7f83a00b22b0 2024-09-13T17:14:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.043+0000 7f83a4ea2640 1 -- 172.21.15.5:0/2026017977 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398007ac0 con 0x7f83a00b22b0 2024-09-13T17:14:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 -- 172.21.15.5:0/2026017977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 msgr2=0x7f83a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 --2- 172.21.15.5:0/2026017977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a006c920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8398009d90 tx=0x7f839802a660 comp rx=0 tx=0).stop 2024-09-13T17:14:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 -- 172.21.15.5:0/2026017977 shutdown_connections 2024-09-13T17:14:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 --2- 172.21.15.5:0/2026017977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a006c920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 --2- 172.21.15.5:0/2026017977 >> v2:172.21.15.179:3300/0 conn(0x7f83a0152fa0 0x7f83a0071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 -- 172.21.15.5:0/2026017977 >> 172.21.15.5:0/2026017977 conn(0x7f83a00ce130 msgr2=0x7f83a00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 -- 172.21.15.5:0/2026017977 shutdown_connections 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.044+0000 7f83a8108640 1 -- 172.21.15.5:0/2026017977 wait complete. 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.045+0000 7f83a8108640 1 Processor -- start 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.045+0000 7f83a8108640 1 -- start start 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a01f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a0152fa0 0x7f83a014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a014df50 con 0x7f83a01598a0 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a014cbd0 con 0x7f83a0152fa0 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a8108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a014ceb0 con 0x7f83a00b22b0 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a66a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a66a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50924/0 (socket says 172.21.15.5:50924) 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a66a5640 1 -- 172.21.15.5:0/4235602001 learned_addr learned my addr 172.21.15.5:0/4235602001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a5ea4640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a01f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.046+0000 7f83a56a3640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a0152fa0 0x7f83a014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 -- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 msgr2=0x7f83a01f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a01f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 -- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a0152fa0 msgr2=0x7f83a014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a0152fa0 0x7f83a014ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 -- 172.21.15.5:0/4235602001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009a70 con 0x7f83a01598a0 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a66a5640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8398009eb0 tx=0x7f8398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839803b820 con 0x7f83a01598a0 2024-09-13T17:14:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a014d190 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839803b980 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839803bcf0 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.047+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a014d750 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.048+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a00672a0 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.048+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8398031400 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.049+0000 7f83967fc640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 0x7f838406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.049+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83980ab030 con 0x7f83a01598a0 2024-09-13T17:14:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.049+0000 7f83a5ea4640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 0x7f838406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.050+0000 7f83a5ea4640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 0x7f838406d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f839c009ad0 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.053+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8398075e60 con 0x7f83a01598a0 2024-09-13T17:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.225+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83a0070b70 con 0x7f83a01598a0 2024-09-13T17:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.225+0000 7f83967fc640 1 -- 172.21.15.5:0/4235602001 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8398098070 con 0x7f83a01598a0 2024-09-13T17:14:04.226 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 msgr2=0x7f838406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 0x7f838406d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f839c009ad0 tx=0x7f839c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 msgr2=0x7f83a014f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8398009eb0 tx=0x7f8398004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 shutdown_connections 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838406ac00 0x7f838406d0c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a01598a0 0x7f83a014f0f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a0152fa0 0x7f83a014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 --2- 172.21.15.5:0/4235602001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a00b22b0 0x7f83a01f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 >> 172.21.15.5:0/4235602001 conn(0x7f83a00ce130 msgr2=0x7f83a00983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 shutdown_connections 2024-09-13T17:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.227+0000 7f83a8108640 1 -- 172.21.15.5:0/4235602001 wait complete. 2024-09-13T17:14:04.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.342+0000 7feca69f4640 1 Processor -- start 2024-09-13T17:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.342+0000 7feca69f4640 1 -- start start 2024-09-13T17:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7feca69f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feca006eaf0 0x7feca00b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7feca69f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00b35f0 con 0x7feca006eed0 2024-09-13T17:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7feca69f4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca0156f50 con 0x7feca00b1ac0 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7feca69f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca015d140 con 0x7feca006eaf0 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feca006eaf0 0x7feca00b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feca006eaf0 0x7feca00b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50934/0 (socket says 172.21.15.5:50934) 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 -- 172.21.15.5:0/3586480472 learned_addr learned my addr 172.21.15.5:0/3586480472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 -- 172.21.15.5:0/3586480472 >> v1:172.21.15.179:6789/0 conn(0x7feca00b1ac0 legacy=0x7feca015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 -- 172.21.15.5:0/3586480472 >> v1:172.21.15.5:6789/0 conn(0x7feca006eed0 legacy=0x7feca006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.343+0000 7fec9ffff640 1 -- 172.21.15.5:0/3586480472 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00b3f60 con 0x7feca006eaf0 2024-09-13T17:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.344+0000 7fec9ffff640 1 --2- 172.21.15.5:0/3586480472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca00b3a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec9002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05ed22620f586cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.344+0000 7fec9effd640 1 -- 172.21.15.5:0/3586480472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90032440 con 0x7feca006eaf0 2024-09-13T17:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.344+0000 7fec9effd640 1 -- 172.21.15.5:0/3586480472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900325a0 con 0x7feca006eaf0 2024-09-13T17:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.344+0000 7fec9effd640 1 -- 172.21.15.5:0/3586480472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90032930 con 0x7feca006eaf0 2024-09-13T17:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 -- 172.21.15.5:0/3586480472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 msgr2=0x7feca00b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 --2- 172.21.15.5:0/3586480472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca00b3a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec9002a2a0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 -- 172.21.15.5:0/3586480472 shutdown_connections 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 --2- 172.21.15.5:0/3586480472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca00b3a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 -- 172.21.15.5:0/3586480472 >> 172.21.15.5:0/3586480472 conn(0x7feca0070af0 msgr2=0x7feca0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 -- 172.21.15.5:0/3586480472 shutdown_connections 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.345+0000 7feca69f4640 1 -- 172.21.15.5:0/3586480472 wait complete. 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.346+0000 7feca69f4640 1 Processor -- start 2024-09-13T17:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.346+0000 7feca69f4640 1 -- start start 2024-09-13T17:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca006eed0 0x7feca00af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 0x7feca00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01585a0 con 0x7feca006eaf0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00cc500 con 0x7feca00b1ac0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca69f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00cc7e0 con 0x7feca006eed0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50942/0 (socket says 172.21.15.5:50942) 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7fec9ffff640 1 -- 172.21.15.5:0/1174485160 learned_addr learned my addr 172.21.15.5:0/1174485160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7fec9f7fe640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca006eed0 0x7feca00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.347+0000 7feca4f91640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 0x7feca00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 -- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca006eed0 msgr2=0x7feca00af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca006eed0 0x7feca00af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 -- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 msgr2=0x7feca00afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 0x7feca00afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 -- 172.21.15.5:0/1174485160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900094d0 con 0x7feca006eaf0 2024-09-13T17:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7feca4f91640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 0x7feca00afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9ffff640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90030b00 con 0x7feca006eaf0 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90030c60 con 0x7feca006eaf0 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca00ccac0 con 0x7feca006eaf0 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9003b400 con 0x7feca006eaf0 2024-09-13T17:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.348+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca0148780 con 0x7feca006eaf0 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.349+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca00672e0 con 0x7feca006eaf0 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.349+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec90039040 con 0x7feca006eaf0 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.350+0000 7fec9cff9640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 0x7fec8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.350+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec900a9e90 con 0x7feca006eaf0 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.350+0000 7fec9f7fe640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 0x7fec8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.351+0000 7fec9f7fe640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 0x7fec8c06d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feca015e850 tx=0x7fec94009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.354+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec90074d60 con 0x7feca006eaf0 2024-09-13T17:14:04.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.527+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feca0148910 con 0x7feca006eaf0 2024-09-13T17:14:04.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.527+0000 7fec9cff9640 1 -- 172.21.15.5:0/1174485160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca0148910 con 0x7feca006eaf0 2024-09-13T17:14:04.529 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 msgr2=0x7fec8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 0x7fec8c06d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feca015e850 tx=0x7fec94009060 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 msgr2=0x7feca0148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec900046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 shutdown_connections 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca00b1ac0 0x7feca00afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca006eed0 0x7feca00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec8c06ac00 0x7fec8c06d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 --2- 172.21.15.5:0/1174485160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feca006eaf0 0x7feca0148240 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 >> 172.21.15.5:0/1174485160 conn(0x7feca0070af0 msgr2=0x7feca015dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 shutdown_connections 2024-09-13T17:14:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.529+0000 7feca69f4640 1 -- 172.21.15.5:0/1174485160 wait complete. 2024-09-13T17:14:04.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.645+0000 7fcaf2584640 1 Processor -- start 2024-09-13T17:14:04.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.645+0000 7fcaf2584640 1 -- start start 2024-09-13T17:14:04.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaf2584640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaec15fd80 0x7fcaec0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaf2584640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaf2584640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec0704a0 con 0x7fcaec098f40 2024-09-13T17:14:04.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaf2584640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0993f0 con 0x7fcaec15fd80 2024-09-13T17:14:04.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaf2584640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec06cc10 con 0x7fcaec0d0e30 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaec15fd80 0x7fcaec0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcaec15fd80 0x7fcaec0cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50944/0 (socket says 172.21.15.5:50944) 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 -- 172.21.15.5:0/1383108107 learned_addr learned my addr 172.21.15.5:0/1383108107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaeb7fe640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 -- 172.21.15.5:0/1383108107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 msgr2=0x7fcaec098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 -- 172.21.15.5:0/1383108107 >> v1:172.21.15.179:6789/0 conn(0x7fcaec098f40 legacy=0x7fcaec0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.646+0000 7fcaebfff640 1 -- 172.21.15.5:0/1383108107 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec06bd80 con 0x7fcaec15fd80 2024-09-13T17:14:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.647+0000 7fcaebfff640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0cfd30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009870 tx=0x7fcadc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8b203f7bb999e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.647+0000 7fcaeaffd640 1 -- 172.21.15.5:0/1383108107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc032440 con 0x7fcaec15fd80 2024-09-13T17:14:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.647+0000 7fcaeaffd640 1 -- 172.21.15.5:0/1383108107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc0325a0 con 0x7fcaec15fd80 2024-09-13T17:14:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.647+0000 7fcaeaffd640 1 -- 172.21.15.5:0/1383108107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc032930 con 0x7fcaec15fd80 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 -- 172.21.15.5:0/1383108107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 msgr2=0x7fcaec0cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0cfd30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009870 tx=0x7fcadc02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 -- 172.21.15.5:0/1383108107 shutdown_connections 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 --2- 172.21.15.5:0/1383108107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0cfd30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 -- 172.21.15.5:0/1383108107 >> 172.21.15.5:0/1383108107 conn(0x7fcaec0d0310 msgr2=0x7fcaec0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 -- 172.21.15.5:0/1383108107 shutdown_connections 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.648+0000 7fcaf2584640 1 -- 172.21.15.5:0/1383108107 wait complete. 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.649+0000 7fcaf2584640 1 Processor -- start 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.649+0000 7fcaf2584640 1 -- start start 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 0x7fcaec0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec155e00 con 0x7fcaec15fd80 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0b6120 con 0x7fcaec098f40 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf2584640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec158df0 con 0x7fcaec0d0e30 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50954/0 (socket says 172.21.15.5:50954) 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 -- 172.21.15.5:0/2666794555 learned_addr learned my addr 172.21.15.5:0/2666794555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaeb7fe640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaebfff640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 0x7fcaec0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 -- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 msgr2=0x7fcaec1f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec1f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 -- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 msgr2=0x7fcaec0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 0x7fcaec0b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaf0b21640 1 -- 172.21.15.5:0/2666794555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0094d0 con 0x7fcaec15fd80 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.650+0000 7fcaebfff640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 0x7fcaec0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcaf0b21640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c6b0 tx=0x7fcae400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4003b70 con 0x7fcaec15fd80 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4003cf0 con 0x7fcaec15fd80 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec158550 con 0x7fcaec15fd80 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4003ea0 con 0x7fcaec15fd80 2024-09-13T17:14:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.651+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec158b10 con 0x7fcaec15fd80 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.652+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec06c1f0 con 0x7fcaec15fd80 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.652+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcae4005310 con 0x7fcaec15fd80 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.653+0000 7fcae8ff9640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 0x7fcad806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.653+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcae4089360 con 0x7fcaec15fd80 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.653+0000 7fcaebfff640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 0x7fcad806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.654+0000 7fcaebfff640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 0x7fcad806d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcadc034000 tx=0x7fcadc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.657+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcaec06c1f0 con 0x7fcaec15fd80 2024-09-13T17:14:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.828+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcaec06c1f0 con 0x7fcaec15fd80 2024-09-13T17:14:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.828+0000 7fcae8ff9640 1 -- 172.21.15.5:0/2666794555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcaec06c1f0 con 0x7fcaec15fd80 2024-09-13T17:14:04.829 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 msgr2=0x7fcad806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 0x7fcad806d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcadc034000 tx=0x7fcadc02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 msgr2=0x7fcaec0c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c6b0 tx=0x7fcae400cb70 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 shutdown_connections 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcad806ac00 0x7fcad806d0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcaec15fd80 0x7fcaec0c6010 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcaec0d0e30 0x7fcaec1f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 --2- 172.21.15.5:0/2666794555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaec098f40 0x7fcaec0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 >> 172.21.15.5:0/2666794555 conn(0x7fcaec0d0310 msgr2=0x7fcaec0b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 shutdown_connections 2024-09-13T17:14:04.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.830+0000 7fcaf2584640 1 -- 172.21.15.5:0/2666794555 wait complete. 2024-09-13T17:14:04.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.946+0000 7f3f145e2640 1 Processor -- start 2024-09-13T17:14:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.946+0000 7f3f145e2640 1 -- start start 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f145e2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f0c157e20 0x7f3f0c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f145e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c06c520 con 0x7f3f0c0ad720 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f145e2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c06c800 con 0x7f3f0c06c090 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f145e2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c15b900 con 0x7f3f0c157e20 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f12b7f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f0c0ad720 0x7f3f0c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53364/0 (socket says 172.21.15.5:53364) 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f12b7f640 1 -- 172.21.15.5:0/847897827 learned_addr learned my addr 172.21.15.5:0/847897827 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f1237e640 1 --2- 172.21.15.5:0/847897827 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c157e20 0x7f3f0c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585299292 0 0) 0x7f3f0c06c520 con 0x7f3f0c0ad720 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.947+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef8003520 con 0x7f3f0c0ad720 2024-09-13T17:14:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736308961 0 0) 0x7f3ef8003520 con 0x7f3f0c0ad720 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c157e20 msgr2=0x7f3f0c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 --2- 172.21.15.5:0/847897827 >> v2:172.21.15.179:3300/0 conn(0x7f3f0c157e20 0x7f3f0c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 >> v1:172.21.15.179:6789/0 conn(0x7f3f0c06c090 legacy=0x7f3f0c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c06cae0 con 0x7f3f0c0ad720 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3f040019f0 con 0x7f3f0c0ad720 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 >> v1:172.21.15.5:6789/0 conn(0x7f3f0c0ad720 legacy=0x7f3f0c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef8003970 0x7f3ef8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef8004370 0x7f3ef8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3ef800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c15b900 con 0x7f3ef8005040 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef800bfa0 con 0x7f3ef8004370 2024-09-13T17:14:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef800c160 con 0x7f3ef8003970 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3ef800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f1237e640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef8003970 0x7f3ef8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f11b7d640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef8004370 0x7f3ef8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 -- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef8003970 msgr2=0x7f3ef8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef8003970 0x7f3ef8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 -- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef8004370 msgr2=0x7f3ef8004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef8004370 0x7f3ef8004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.948+0000 7f3f12b7f640 1 -- 172.21.15.5:0/847897827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8003520 con 0x7f3ef8005040 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.949+0000 7f3f12b7f640 1 -- 172.21.15.5:0/847897827 reap_dead start 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.949+0000 7f3f12b7f640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3ef800b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400a7a0 tx=0x7f3ef80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c93e025ae78e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.949+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0402b9a0 con 0x7f3ef8005040 2024-09-13T17:14:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.949+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0402bb20 con 0x7f3ef8005040 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.949+0000 7f3f1137c640 1 -- 172.21.15.5:0/847897827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04034470 con 0x7f3ef8005040 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 -- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 msgr2=0x7f3ef800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3ef800b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400a7a0 tx=0x7f3ef80057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 -- 172.21.15.5:0/847897827 shutdown_connections 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 --2- 172.21.15.5:0/847897827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3ef800b980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 -- 172.21.15.5:0/847897827 >> 172.21.15.5:0/847897827 conn(0x7f3f0c0ce130 msgr2=0x7f3f0c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 -- 172.21.15.5:0/847897827 shutdown_connections 2024-09-13T17:14:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.950+0000 7f3f145e2640 1 -- 172.21.15.5:0/847897827 wait complete. 2024-09-13T17:14:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.951+0000 7f3f145e2640 1 Processor -- start 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.951+0000 7f3f145e2640 1 -- start start 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0af430 0x7f3f0c150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c1555b0 0x7f3f0c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1f2b70 con 0x7f3ef8005040 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1f2230 con 0x7f3f0c0af430 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c1efbc0 con 0x7f3f0c1555b0 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50964/0 (socket says 172.21.15.5:50964) 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 -- 172.21.15.5:0/2679185365 learned_addr learned my addr 172.21.15.5:0/2679185365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f12b7f640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c1555b0 0x7f3f0c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f11b7d640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0af430 0x7f3f0c150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 -- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c1555b0 msgr2=0x7f3f0c150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c1555b0 0x7f3f0c150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 -- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0af430 msgr2=0x7f3f0c150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0af430 0x7f3f0c150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 -- 172.21.15.5:0/2679185365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c155b20 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f1237e640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f080118e0 tx=0x7f3f08011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800faf0 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0800fc50 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c1f24b0 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08014440 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.952+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c0b32f0 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.953+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0cd0a0 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.954+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f0801d400 con 0x7f3ef8005040 2024-09-13T17:14:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.954+0000 7f3efeffd640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 0x7f3ef006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.955+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f08089f40 con 0x7f3ef8005040 2024-09-13T17:14:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.955+0000 7f3f11b7d640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 0x7f3ef006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.955+0000 7f3f11b7d640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 0x7f3ef006d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0aecb0 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:04.959+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f08054df0 con 0x7f3ef8005040 2024-09-13T17:14:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.130+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f0c0672a0 con 0x7f3ef8005040 2024-09-13T17:14:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.130+0000 7f3efeffd640 1 -- 172.21.15.5:0/2679185365 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f08058410 con 0x7f3ef8005040 2024-09-13T17:14:05.132 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 msgr2=0x7f3ef006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 0x7f3ef006d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0aecb0 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2024-09-13T17:14:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 msgr2=0x7f3f0c1ef680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f080118e0 tx=0x7f3f08011da0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 shutdown_connections 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0c1555b0 0x7f3f0c150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f0c0af430 0x7f3f0c150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ef006ac30 0x7f3ef006d0f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 --2- 172.21.15.5:0/2679185365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef8005040 0x7f3f0c1ef680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 >> 172.21.15.5:0/2679185365 conn(0x7f3f0c0ce130 msgr2=0x7f3f0c06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 shutdown_connections 2024-09-13T17:14:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.133+0000 7f3f145e2640 1 -- 172.21.15.5:0/2679185365 wait complete. 2024-09-13T17:14:05.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.246+0000 7f95a3696640 1 Processor -- start 2024-09-13T17:14:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.246+0000 7f95a3696640 1 -- start start 2024-09-13T17:14:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a3696640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f959c0b4cf0 0x7f959c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a3696640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f959c0d06d0 0x7f959c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a3696640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0d1e80 con 0x7f959c15c810 2024-09-13T17:14:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a3696640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0d1750 con 0x7f959c0d06d0 2024-09-13T17:14:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a3696640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0d0bd0 con 0x7f959c0b4cf0 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f959c0d06d0 0x7f959c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f959c0d06d0 0x7f959c0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50974/0 (socket says 172.21.15.5:50974) 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 -- 172.21.15.5:0/3462304571 learned_addr learned my addr 172.21.15.5:0/3462304571 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a0c31640 1 --2- 172.21.15.5:0/3462304571 >> v2:172.21.15.179:3300/0 conn(0x7f959c0b4cf0 0x7f959c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 -- 172.21.15.5:0/3462304571 >> v2:172.21.15.179:3300/0 conn(0x7f959c0b4cf0 msgr2=0x7f959c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 --2- 172.21.15.5:0/3462304571 >> v2:172.21.15.179:3300/0 conn(0x7f959c0b4cf0 0x7f959c0cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 -- 172.21.15.5:0/3462304571 >> v1:172.21.15.5:6789/0 conn(0x7f959c15c810 legacy=0x7f959c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.247+0000 7f95a1c33640 1 -- 172.21.15.5:0/3462304571 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0d0eb0 con 0x7f959c0d06d0 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a1c33640 1 --2- 172.21.15.5:0/3462304571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c0d06d0 0x7f959c0b5a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f959c0cf4f0 tx=0x7f959402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43de2e37cfe10ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f9593fff640 1 -- 172.21.15.5:0/3462304571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594031600 con 0x7f959c0d06d0 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f9593fff640 1 -- 172.21.15.5:0/3462304571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959402d050 con 0x7f959c0d06d0 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f9593fff640 1 -- 172.21.15.5:0/3462304571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594031980 con 0x7f959c0d06d0 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 -- 172.21.15.5:0/3462304571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c0d06d0 msgr2=0x7f959c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 --2- 172.21.15.5:0/3462304571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c0d06d0 0x7f959c0b5a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f959c0cf4f0 tx=0x7f959402a730 comp rx=0 tx=0).stop 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 -- 172.21.15.5:0/3462304571 shutdown_connections 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 --2- 172.21.15.5:0/3462304571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c0d06d0 0x7f959c0b5a90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 --2- 172.21.15.5:0/3462304571 >> v2:172.21.15.179:3300/0 conn(0x7f959c0b4cf0 0x7f959c0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.248+0000 7f95a3696640 1 -- 172.21.15.5:0/3462304571 >> 172.21.15.5:0/3462304571 conn(0x7f959c0717a0 msgr2=0x7f959c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.249+0000 7f95a3696640 1 -- 172.21.15.5:0/3462304571 shutdown_connections 2024-09-13T17:14:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.249+0000 7f95a3696640 1 -- 172.21.15.5:0/3462304571 wait complete. 2024-09-13T17:14:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 Processor -- start 2024-09-13T17:14:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 -- start start 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f959c0b4cf0 0x7f959c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 0x7f959c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c1f34c0 con 0x7f959c15c810 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0ca250 con 0x7f959c0d06d0 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.250+0000 7f95a3696640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0c9920 con 0x7f959c0b4cf0 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50982/0 (socket says 172.21.15.5:50982) 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 -- 172.21.15.5:0/1376484052 learned_addr learned my addr 172.21.15.5:0/1376484052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1432640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f959c0b4cf0 0x7f959c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a0c31640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 0x7f959c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 -- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f959c0b4cf0 msgr2=0x7f959c158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f959c0b4cf0 0x7f959c158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 -- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 msgr2=0x7f959c1591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 0x7f959c1591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 -- 172.21.15.5:0/1376484052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594009b30 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a0c31640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 0x7f959c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a1c33640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9594034040 tx=0x7f9594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959403d860 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959403d9c0 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c0c9c00 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959403dd70 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.251+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1f36e0 con 0x7f959c15c810 2024-09-13T17:14:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.253+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c0672a0 con 0x7f959c15c810 2024-09-13T17:14:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.253+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f959403b400 con 0x7f959c15c810 2024-09-13T17:14:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.253+0000 7f9591ffb640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 0x7f958006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.253+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95940aa5a0 con 0x7f959c15c810 2024-09-13T17:14:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.254+0000 7f95a1432640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 0x7f958006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.254+0000 7f95a1432640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 0x7f958006d0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f959c1f3690 tx=0x7f9598009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.258+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9594075450 con 0x7f959c15c810 2024-09-13T17:14:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.440+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f959c0b5a90 con 0x7f959c15c810 2024-09-13T17:14:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.440+0000 7f9591ffb640 1 -- 172.21.15.5:0/1376484052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f959407de60 con 0x7f959c15c810 2024-09-13T17:14:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 msgr2=0x7f958006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 0x7f958006d0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f959c1f3690 tx=0x7f9598009040 comp rx=0 tx=0).stop 2024-09-13T17:14:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 msgr2=0x7f959c1f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9594034040 tx=0x7f9594004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 shutdown_connections 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f958006ac30 0x7f958006d0f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f959c15c810 0x7f959c1f2750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f959c0d06d0 0x7f959c1591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 --2- 172.21.15.5:0/1376484052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f959c0b4cf0 0x7f959c158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 >> 172.21.15.5:0/1376484052 conn(0x7f959c0717a0 msgr2=0x7f959c0c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 shutdown_connections 2024-09-13T17:14:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.442+0000 7f95a3696640 1 -- 172.21.15.5:0/1376484052 wait complete. 2024-09-13T17:14:05.454 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:14:05.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:05.455 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:05.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:05.486 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:14:05.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:05.486 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:14:05.553 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:05.553 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:05.570 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:05.570 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:05.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:05.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.767+0000 7f5f54f01640 1 Processor -- start 2024-09-13T17:14:05.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.767+0000 7f5f54f01640 1 -- start start 2024-09-13T17:14:05.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f5006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f5015d4a0 0x7f5f5006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5f50071ea0 0x7f5f50152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5015d9a0 con 0x7f5f5015d4a0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500710c0 con 0x7f5f50071ea0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f54f01640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50071550 con 0x7f5f500b27c0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f5015d4a0 0x7f5f5006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f5015d4a0 0x7f5f5006c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50998/0 (socket says 172.21.15.5:50998) 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 -- 172.21.15.5:0/298695813 learned_addr learned my addr 172.21.15.5:0/298695813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f4e59c640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f5006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 -- 172.21.15.5:0/298695813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 msgr2=0x7f5f5006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f5006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 -- 172.21.15.5:0/298695813 >> v2:172.21.15.179:3300/0 conn(0x7f5f50071ea0 msgr2=0x7f5f50152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f4ed9d640 1 --2- 172.21.15.5:0/298695813 >> v2:172.21.15.179:3300/0 conn(0x7f5f50071ea0 0x7f5f50152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 --2- 172.21.15.5:0/298695813 >> v2:172.21.15.179:3300/0 conn(0x7f5f50071ea0 0x7f5f50152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.768+0000 7f5f47fff640 1 -- 172.21.15.5:0/298695813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500b2ba0 con 0x7f5f5015d4a0 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.769+0000 7f5f47fff640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5015d4a0 0x7f5f5006c650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5f5006afc0 tx=0x7f5f3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caaa6d0fcb3873f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.769+0000 7f5f4dd9b640 1 -- 172.21.15.5:0/298695813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38032440 con 0x7f5f5015d4a0 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.769+0000 7f5f4dd9b640 1 -- 172.21.15.5:0/298695813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380325a0 con 0x7f5f5015d4a0 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.769+0000 7f5f4dd9b640 1 -- 172.21.15.5:0/298695813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38032930 con 0x7f5f5015d4a0 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 -- 172.21.15.5:0/298695813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5015d4a0 msgr2=0x7f5f5006c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5015d4a0 0x7f5f5006c650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5f5006afc0 tx=0x7f5f3802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 -- 172.21.15.5:0/298695813 shutdown_connections 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 --2- 172.21.15.5:0/298695813 >> v2:172.21.15.179:3300/0 conn(0x7f5f50071ea0 0x7f5f50152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5015d4a0 0x7f5f5006c650 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 --2- 172.21.15.5:0/298695813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f5006c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 -- 172.21.15.5:0/298695813 >> 172.21.15.5:0/298695813 conn(0x7f5f500ce0d0 msgr2=0x7f5f500ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 -- 172.21.15.5:0/298695813 shutdown_connections 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.770+0000 7f5f54f01640 1 -- 172.21.15.5:0/298695813 wait complete. 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.771+0000 7f5f54f01640 1 Processor -- start 2024-09-13T17:14:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.771+0000 7f5f54f01640 1 -- start start 2024-09-13T17:14:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f501f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f5015d4a0 0x7f5f501f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50152730 con 0x7f5f50071ea0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501596c0 con 0x7f5f5015d4a0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f54f01640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50158ab0 con 0x7f5f500b27c0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51008/0 (socket says 172.21.15.5:51008) 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 -- 172.21.15.5:0/1092987042 learned_addr learned my addr 172.21.15.5:0/1092987042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4ed9d640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f5015d4a0 0x7f5f501f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f47fff640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f501f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 -- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 msgr2=0x7f5f501f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f501f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 -- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f5015d4a0 msgr2=0x7f5f501f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f5015d4a0 0x7f5f501f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 -- 172.21.15.5:0/1092987042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380094d0 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.772+0000 7f5f4e59c640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c7f0 tx=0x7f5f4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.773+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f40004220 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.773+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40004380 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.773+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f40007840 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.773+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f50158d90 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.773+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50159350 con 0x7f5f50071ea0 2024-09-13T17:14:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.774+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f500672a0 con 0x7f5f50071ea0 2024-09-13T17:14:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.774+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f40007bb0 con 0x7f5f50071ea0 2024-09-13T17:14:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.775+0000 7f5f46ffd640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 0x7f5f3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.775+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f400894b0 con 0x7f5f50071ea0 2024-09-13T17:14:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.775+0000 7f5f47fff640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 0x7f5f3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.775+0000 7f5f47fff640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 0x7f5f3006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f38034000 tx=0x7f5f3802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.779+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f40054410 con 0x7f5f50071ea0 2024-09-13T17:14:05.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.951+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f5006c110 con 0x7f5f50071ea0 2024-09-13T17:14:05.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.952+0000 7f5f46ffd640 1 -- 172.21.15.5:0/1092987042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f5f40007e60 con 0x7f5f50071ea0 2024-09-13T17:14:05.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:05.953 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 msgr2=0x7f5f3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 0x7f5f3006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5f38034000 tx=0x7f5f3802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 msgr2=0x7f5f501521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c7f0 tx=0x7f5f4000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 shutdown_connections 2024-09-13T17:14:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f5015d4a0 0x7f5f501f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f500b27c0 0x7f5f501f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f3006ac00 0x7f5f3006d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 --2- 172.21.15.5:0/1092987042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f50071ea0 0x7f5f501521f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 >> 172.21.15.5:0/1092987042 conn(0x7f5f500ce0d0 msgr2=0x7f5f500730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 shutdown_connections 2024-09-13T17:14:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:05.954+0000 7f5f54f01640 1 -- 172.21.15.5:0/1092987042 wait complete. 2024-09-13T17:14:05.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:05.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.070+0000 7f67633c7640 1 Processor -- start 2024-09-13T17:14:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.070+0000 7f67633c7640 1 -- start start 2024-09-13T17:14:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f675c157e20 0x7f675c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c06c090 0x7f675c06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f675c0ad010 0x7f675c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c15b900 con 0x7f675c157e20 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c06db00 con 0x7f675c0ad010 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f67633c7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c06c520 con 0x7f675c06c090 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f675c157e20 0x7f675c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f675c157e20 0x7f675c15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51014/0 (socket says 172.21.15.5:51014) 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 -- 172.21.15.5:0/2749616607 learned_addr learned my addr 172.21.15.5:0/2749616607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6760962640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c06c090 0x7f675c06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 -- 172.21.15.5:0/2749616607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c06c090 msgr2=0x7f675c06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c06c090 0x7f675c06d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 -- 172.21.15.5:0/2749616607 >> v2:172.21.15.179:3300/0 conn(0x7f675c0ad010 msgr2=0x7f675c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 --2- 172.21.15.5:0/2749616607 >> v2:172.21.15.179:3300/0 conn(0x7f675c0ad010 0x7f675c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.071+0000 7f6761163640 1 -- 172.21.15.5:0/2749616607 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c06c800 con 0x7f675c157e20 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.072+0000 7f6761163640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c15b3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ce0e0 tx=0x7f675802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfde18dabd0f791 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.072+0000 7f6753fff640 1 -- 172.21.15.5:0/2749616607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758032440 con 0x7f675c157e20 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.072+0000 7f6753fff640 1 -- 172.21.15.5:0/2749616607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580325a0 con 0x7f675c157e20 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.072+0000 7f6753fff640 1 -- 172.21.15.5:0/2749616607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758032930 con 0x7f675c157e20 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 -- 172.21.15.5:0/2749616607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 msgr2=0x7f675c15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c15b3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ce0e0 tx=0x7f675802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 -- 172.21.15.5:0/2749616607 shutdown_connections 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 --2- 172.21.15.5:0/2749616607 >> v2:172.21.15.179:3300/0 conn(0x7f675c0ad010 0x7f675c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c06c090 0x7f675c06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 --2- 172.21.15.5:0/2749616607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c15b3c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 -- 172.21.15.5:0/2749616607 >> 172.21.15.5:0/2749616607 conn(0x7f675c0ce130 msgr2=0x7f675c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 -- 172.21.15.5:0/2749616607 shutdown_connections 2024-09-13T17:14:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.073+0000 7f67633c7640 1 -- 172.21.15.5:0/2749616607 wait complete. 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.074+0000 7f67633c7640 1 Processor -- start 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.074+0000 7f67633c7640 1 -- start start 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c0ad010 0x7f675c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 0x7f675c097520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c14dc90 con 0x7f675c157e20 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c14df70 con 0x7f675c0ae720 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f67633c7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c14e250 con 0x7f675c0ad010 2024-09-13T17:14:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51020/0 (socket says 172.21.15.5:51020) 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 -- 172.21.15.5:0/4248223217 learned_addr learned my addr 172.21.15.5:0/4248223217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6761163640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c0ad010 0x7f675c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6761964640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 0x7f675c097520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 -- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c0ad010 msgr2=0x7f675c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c0ad010 0x7f675c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 -- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 msgr2=0x7f675c097520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 0x7f675c097520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6760962640 1 -- 172.21.15.5:0/4248223217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580094d0 con 0x7f675c157e20 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.075+0000 7f6761964640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 0x7f675c097520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f6760962640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c7f0 tx=0x7f674c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c004220 con 0x7f675c157e20 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c0043a0 con 0x7f675c157e20 2024-09-13T17:14:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c14e530 con 0x7f675c157e20 2024-09-13T17:14:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c007860 con 0x7f675c157e20 2024-09-13T17:14:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.076+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c14d980 con 0x7f675c157e20 2024-09-13T17:14:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.077+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c0672a0 con 0x7f675c157e20 2024-09-13T17:14:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.077+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f674c007bd0 con 0x7f675c157e20 2024-09-13T17:14:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.078+0000 7f6751ffb640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 0x7f674006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.078+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f674c0895d0 con 0x7f675c157e20 2024-09-13T17:14:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.078+0000 7f6761163640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 0x7f674006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.079+0000 7f6761163640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 0x7f674006d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6758034000 tx=0x7f675802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.082+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f674c0544a0 con 0x7f675c157e20 2024-09-13T17:14:06.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.253+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f675c158200 con 0x7f675c157e20 2024-09-13T17:14:06.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.253+0000 7f6751ffb640 1 -- 172.21.15.5:0/4248223217 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f674c057ac0 con 0x7f675c157e20 2024-09-13T17:14:06.254 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 msgr2=0x7f674006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 0x7f674006d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6758034000 tx=0x7f675802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 msgr2=0x7f675c14d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c7f0 tx=0x7f674c00ccb0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 shutdown_connections 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f675c0ae720 0x7f675c097520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f674006ac00 0x7f674006d0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f675c157e20 0x7f675c14d440 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 --2- 172.21.15.5:0/4248223217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f675c0ad010 0x7f675c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 >> 172.21.15.5:0/4248223217 conn(0x7f675c0ce130 msgr2=0x7f675c156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 shutdown_connections 2024-09-13T17:14:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.255+0000 7f67633c7640 1 -- 172.21.15.5:0/4248223217 wait complete. 2024-09-13T17:14:06.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.371+0000 7f0afb39d640 1 Processor -- start 2024-09-13T17:14:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.371+0000 7f0afb39d640 1 -- start start 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afb39d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af415faf0 0x7f0af40ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afb39d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 0x7f0af40d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afb39d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af40cd7d0 con 0x7f0af40d0d70 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afb39d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40cdab0 con 0x7f0af415faf0 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afb39d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40cdd90 con 0x7f0af40d03f0 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9b9a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 0x7f0af40d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afa39b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af415faf0 0x7f0af40ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afab9c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0af40d0d70 0x7f0af40ceaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:43522/0 (socket says 172.21.15.5:43522) 2024-09-13T17:14:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0afab9c640 1 -- 172.21.15.5:0/3609223323 learned_addr learned my addr 172.21.15.5:0/3609223323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9399640 1 -- 172.21.15.5:0/3609223323 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773750561 0 0) 0x7f0af40cd7d0 con 0x7f0af40d0d70 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9b9a640 1 -- 172.21.15.5:0/3609223323 >> v2:172.21.15.179:3300/0 conn(0x7f0af415faf0 msgr2=0x7f0af40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/3609223323 >> v2:172.21.15.179:3300/0 conn(0x7f0af415faf0 0x7f0af40ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9b9a640 1 -- 172.21.15.5:0/3609223323 >> v1:172.21.15.179:6789/0 conn(0x7f0af40d0d70 legacy=0x7f0af40ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.372+0000 7f0af9b9a640 1 -- 172.21.15.5:0/3609223323 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40ce070 con 0x7f0af40d03f0 2024-09-13T17:14:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.373+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/3609223323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 0x7f0af40d0830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097a0 tx=0x7f0ae402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4730180432edde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.373+0000 7f0af9399640 1 -- 172.21.15.5:0/3609223323 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae402ae50 con 0x7f0af40d03f0 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.373+0000 7f0af9399640 1 -- 172.21.15.5:0/3609223323 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4032440 con 0x7f0af40d03f0 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.373+0000 7f0af9399640 1 -- 172.21.15.5:0/3609223323 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40327d0 con 0x7f0af40d03f0 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 -- 172.21.15.5:0/3609223323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 msgr2=0x7f0af40d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 --2- 172.21.15.5:0/3609223323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 0x7f0af40d0830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40097a0 tx=0x7f0ae402a100 comp rx=0 tx=0).stop 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 -- 172.21.15.5:0/3609223323 shutdown_connections 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 --2- 172.21.15.5:0/3609223323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af40d03f0 0x7f0af40d0830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 --2- 172.21.15.5:0/3609223323 >> v2:172.21.15.179:3300/0 conn(0x7f0af415faf0 0x7f0af40ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 -- 172.21.15.5:0/3609223323 >> 172.21.15.5:0/3609223323 conn(0x7f0af4089f90 msgr2=0x7f0af40d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 -- 172.21.15.5:0/3609223323 shutdown_connections 2024-09-13T17:14:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.374+0000 7f0afb39d640 1 -- 172.21.15.5:0/3609223323 wait complete. 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.375+0000 7f0afb39d640 1 Processor -- start 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.375+0000 7f0afb39d640 1 -- start start 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 0x7f0af40c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415faf0 0x7f0af40c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af4154dc0 con 0x7f0af40d03f0 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40c6b20 con 0x7f0af40d0d70 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afb39d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40b51d0 con 0x7f0af415faf0 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51022/0 (socket says 172.21.15.5:51022) 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 -- 172.21.15.5:0/581471939 learned_addr learned my addr 172.21.15.5:0/581471939 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afab9c640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415faf0 0x7f0af40c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 0x7f0af40c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 -- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415faf0 msgr2=0x7f0af40c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415faf0 0x7f0af40c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 -- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 msgr2=0x7f0af40c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 0x7f0af40c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0afa39b640 1 -- 172.21.15.5:0/581471939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4009400 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.376+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 0x7f0af40c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0afa39b640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e9b0 tx=0x7f0af000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0009670 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000c9a0 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000cd50 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af40b54b0 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.377+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af40c6e00 con 0x7f0af40d03f0 2024-09-13T17:14:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.378+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af415f300 con 0x7f0af40d03f0 2024-09-13T17:14:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.378+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0af0013470 con 0x7f0af40d03f0 2024-09-13T17:14:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.379+0000 7f0aeaffd640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 0x7f0ad806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.379+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0af0089900 con 0x7f0af40d03f0 2024-09-13T17:14:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.379+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 0x7f0ad806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.379+0000 7f0af9b9a640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 0x7f0ad806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4034000 tx=0x7f0ae402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.383+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0af00547d0 con 0x7f0af40d03f0 2024-09-13T17:14:06.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.554+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0af40d0830 con 0x7f0af40d03f0 2024-09-13T17:14:06.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.555+0000 7f0aeaffd640 1 -- 172.21.15.5:0/581471939 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0af0057df0 con 0x7f0af40d03f0 2024-09-13T17:14:06.556 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 msgr2=0x7f0ad806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 0x7f0ad806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4034000 tx=0x7f0ae402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 msgr2=0x7f0af4154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e9b0 tx=0x7f0af000ee70 comp rx=0 tx=0).stop 2024-09-13T17:14:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 shutdown_connections 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af415faf0 0x7f0af40c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af40d0d70 0x7f0af40c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad806ac00 0x7f0ad806d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 --2- 172.21.15.5:0/581471939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af40d03f0 0x7f0af4154880 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 >> 172.21.15.5:0/581471939 conn(0x7f0af4089f90 msgr2=0x7f0af406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 shutdown_connections 2024-09-13T17:14:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.557+0000 7f0afb39d640 1 -- 172.21.15.5:0/581471939 wait complete. 2024-09-13T17:14:06.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.672+0000 7f74e6f45640 1 Processor -- start 2024-09-13T17:14:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.672+0000 7f74e6f45640 1 -- start start 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74e01591e0 0x7f74e00abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f74e006da30 0x7f74e006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e006e420 con 0x7f74e01591e0 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e00ad050 con 0x7f74e006da30 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e6f45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00ac440 con 0x7f74e00ad4e0 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74e01591e0 0x7f74e00abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74e01591e0 0x7f74e00abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51032/0 (socket says 172.21.15.5:51032) 2024-09-13T17:14:06.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2666977808 learned_addr learned my addr 172.21.15.5:0/2666977808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74dffff640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2666977808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 msgr2=0x7f74e00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e54e2640 1 --2- 172.21.15.5:0/2666977808 >> v2:172.21.15.179:3300/0 conn(0x7f74e006da30 0x7f74e006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e00b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2666977808 >> v2:172.21.15.179:3300/0 conn(0x7f74e006da30 msgr2=0x7f74e006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2666977808 >> v2:172.21.15.179:3300/0 conn(0x7f74e006da30 0x7f74e006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.673+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2666977808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00ac720 con 0x7f74e01591e0 2024-09-13T17:14:06.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.674+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e01591e0 0x7f74e00abe60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f74e009c400 tx=0x7f74d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98daaf6296f8824e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.674+0000 7f74df7fe640 1 -- 172.21.15.5:0/2666977808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4032440 con 0x7f74e01591e0 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.674+0000 7f74df7fe640 1 -- 172.21.15.5:0/2666977808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d40325a0 con 0x7f74e01591e0 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.674+0000 7f74df7fe640 1 -- 172.21.15.5:0/2666977808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4032930 con 0x7f74e01591e0 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 -- 172.21.15.5:0/2666977808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e01591e0 msgr2=0x7f74e00abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e01591e0 0x7f74e00abe60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f74e009c400 tx=0x7f74d402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 -- 172.21.15.5:0/2666977808 shutdown_connections 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2666977808 >> v2:172.21.15.179:3300/0 conn(0x7f74e006da30 0x7f74e006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2666977808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e01591e0 0x7f74e00abe60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 -- 172.21.15.5:0/2666977808 >> 172.21.15.5:0/2666977808 conn(0x7f74e00ce130 msgr2=0x7f74e00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 -- 172.21.15.5:0/2666977808 shutdown_connections 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.675+0000 7f74e6f45640 1 -- 172.21.15.5:0/2666977808 wait complete. 2024-09-13T17:14:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.676+0000 7f74e6f45640 1 Processor -- start 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.676+0000 7f74e6f45640 1 -- start start 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e0098fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 0x7f74e015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e014ec10 con 0x7f74e006da30 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0156920 con 0x7f74e01591e0 2024-09-13T17:14:06.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e6f45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01582e0 con 0x7f74e00ad4e0 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51048/0 (socket says 172.21.15.5:51048) 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2839765716 learned_addr learned my addr 172.21.15.5:0/2839765716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e54e2640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 0x7f74e015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74dffff640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e0098fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 msgr2=0x7f74e0098fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e0098fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 msgr2=0x7f74e015b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 0x7f74e015b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 -- 172.21.15.5:0/2839765716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d40094d0 con 0x7f74e006da30 2024-09-13T17:14:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e54e2640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 0x7f74e015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74dffff640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e0098fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.677+0000 7f74e4ce1640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.678+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4032440 con 0x7f74e006da30 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.678+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d4030b80 con 0x7f74e006da30 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.678+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d403b400 con 0x7f74e006da30 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.678+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e01562d0 con 0x7f74e006da30 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.678+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e0155fc0 con 0x7f74e006da30 2024-09-13T17:14:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.679+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e00672a0 con 0x7f74e006da30 2024-09-13T17:14:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.679+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74d4039040 con 0x7f74e006da30 2024-09-13T17:14:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.679+0000 7f74dd7fa640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 0x7f74c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.680+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74d40aa0f0 con 0x7f74e006da30 2024-09-13T17:14:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.680+0000 7f74dffff640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 0x7f74c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.680+0000 7f74dffff640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 0x7f74c406d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.684+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f74d4074f10 con 0x7f74e006da30 2024-09-13T17:14:06.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.852+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74e01595c0 con 0x7f74e006da30 2024-09-13T17:14:06.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.852+0000 7f74dd7fa640 1 -- 172.21.15.5:0/2839765716 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74d4078530 con 0x7f74e006da30 2024-09-13T17:14:06.854 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 msgr2=0x7f74c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 0x7f74c406d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc008040 comp rx=0 tx=0).stop 2024-09-13T17:14:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 msgr2=0x7f74e014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d40046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 shutdown_connections 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74e01591e0 0x7f74e015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74e00ad4e0 0x7f74e0098fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f74c406ac00 0x7f74c406d0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 --2- 172.21.15.5:0/2839765716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74e006da30 0x7f74e014e6d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 >> 172.21.15.5:0/2839765716 conn(0x7f74e00ce130 msgr2=0x7f74e00ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 shutdown_connections 2024-09-13T17:14:06.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.855+0000 7f74e6f45640 1 -- 172.21.15.5:0/2839765716 wait complete. 2024-09-13T17:14:06.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:06.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.969+0000 7fb0932e9640 1 Processor -- start 2024-09-13T17:14:06.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 -- start start 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb08c1591e0 0x7fb08c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0ad050 con 0x7fb08c06da30 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0ac440 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.970+0000 7fb0932e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0ac720 con 0x7fb08c1591e0 2024-09-13T17:14:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51064/0 (socket says 172.21.15.5:51064) 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 -- 172.21.15.5:0/1332343369 learned_addr learned my addr 172.21.15.5:0/1332343369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb091085640 1 --2- 172.21.15.5:0/1332343369 >> v2:172.21.15.179:3300/0 conn(0x7fb08c1591e0 0x7fb08c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 -- 172.21.15.5:0/1332343369 >> v2:172.21.15.179:3300/0 conn(0x7fb08c1591e0 msgr2=0x7fb08c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 --2- 172.21.15.5:0/1332343369 >> v2:172.21.15.179:3300/0 conn(0x7fb08c1591e0 0x7fb08c0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 -- 172.21.15.5:0/1332343369 >> v1:172.21.15.179:6789/0 conn(0x7fb08c06da30 legacy=0x7fb08c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.971+0000 7fb090884640 1 -- 172.21.15.5:0/1332343369 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0aca00 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb090884640 1 --2- 172.21.15.5:0/1332343369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb08c06afb0 tx=0x7fb07c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97812280dffe633d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb083fff640 1 -- 172.21.15.5:0/1332343369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c032440 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb083fff640 1 -- 172.21.15.5:0/1332343369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0325a0 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb083fff640 1 -- 172.21.15.5:0/1332343369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c032930 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 -- 172.21.15.5:0/1332343369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c0ad4e0 msgr2=0x7fb08c0b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 --2- 172.21.15.5:0/1332343369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb08c06afb0 tx=0x7fb07c02a270 comp rx=0 tx=0).stop 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 -- 172.21.15.5:0/1332343369 shutdown_connections 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 --2- 172.21.15.5:0/1332343369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c0b1b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 --2- 172.21.15.5:0/1332343369 >> v2:172.21.15.179:3300/0 conn(0x7fb08c1591e0 0x7fb08c0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.972+0000 7fb0932e9640 1 -- 172.21.15.5:0/1332343369 >> 172.21.15.5:0/1332343369 conn(0x7fb08c0ce130 msgr2=0x7fb08c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.973+0000 7fb0932e9640 1 -- 172.21.15.5:0/1332343369 shutdown_connections 2024-09-13T17:14:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.973+0000 7fb0932e9640 1 -- 172.21.15.5:0/1332343369 wait complete. 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 Processor -- start 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 -- start start 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c1f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1591e0 0x7fb08c1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c157340 con 0x7fb08c06da30 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0cdf50 con 0x7fb08c0ad4e0 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb0932e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c152020 con 0x7fb08c1591e0 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.974+0000 7fb091085640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51066/0 (socket says 172.21.15.5:51066) 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 -- 172.21.15.5:0/635660536 learned_addr learned my addr 172.21.15.5:0/635660536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb090884640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c1f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091886640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1591e0 0x7fb08c1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 -- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1591e0 msgr2=0x7fb08c1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1591e0 0x7fb08c1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 -- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c0ad4e0 msgr2=0x7fb08c1f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c1f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 -- 172.21.15.5:0/635660536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0094d0 con 0x7fb08c06da30 2024-09-13T17:14:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb091085640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e8a0 tx=0x7fb08800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880094f0 con 0x7fb08c06da30 2024-09-13T17:14:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08800c940 con 0x7fb08c06da30 2024-09-13T17:14:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c14fd10 con 0x7fb08c06da30 2024-09-13T17:14:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08800ccf0 con 0x7fb08c06da30 2024-09-13T17:14:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.975+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c152580 con 0x7fb08c06da30 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.977+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c1575b0 con 0x7fb08c06da30 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.977+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb088013470 con 0x7fb08c06da30 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.977+0000 7fb081ffb640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 0x7fb07006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.978+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0880896f0 con 0x7fb08c06da30 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.978+0000 7fb090884640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 0x7fb07006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.978+0000 7fb090884640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 0x7fb07006d0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb07c034000 tx=0x7fb07c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:06.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:06.982+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0880545b0 con 0x7fb08c06da30 2024-09-13T17:14:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.151+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb08c0672a0 con 0x7fb08c06da30 2024-09-13T17:14:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.151+0000 7fb081ffb640 1 -- 172.21.15.5:0/635660536 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb088057bd0 con 0x7fb08c06da30 2024-09-13T17:14:07.153 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 msgr2=0x7fb07006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 0x7fb07006d0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb07c034000 tx=0x7fb07c02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 msgr2=0x7fb08c1553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e8a0 tx=0x7fb08800ed60 comp rx=0 tx=0).stop 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 shutdown_connections 2024-09-13T17:14:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb08c1591e0 0x7fb08c1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb08c0ad4e0 0x7fb08c1f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb07006ac30 0x7fb07006d0f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 --2- 172.21.15.5:0/635660536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb08c06da30 0x7fb08c1553a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 >> 172.21.15.5:0/635660536 conn(0x7fb08c0ce130 msgr2=0x7fb08c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 shutdown_connections 2024-09-13T17:14:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.153+0000 7fb0932e9640 1 -- 172.21.15.5:0/635660536 wait complete. 2024-09-13T17:14:07.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.266+0000 7f09e47ae640 1 Processor -- start 2024-09-13T17:14:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.266+0000 7f09e47ae640 1 -- start start 2024-09-13T17:14:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e47ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 0x7f09dc0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e47ae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09dc0ab5a0 0x7f09dc0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e47ae640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc06d410 con 0x7f09dc15a3e0 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e47ae640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0aba50 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e47ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc06e4d0 con 0x7f09dc06e090 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09dc0ab5a0 0x7f09dc0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09dc0ab5a0 0x7f09dc0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51082/0 (socket says 172.21.15.5:51082) 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 -- 172.21.15.5:0/604010534 learned_addr learned my addr 172.21.15.5:0/604010534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e1d49640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 0x7f09dc0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 -- 172.21.15.5:0/604010534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 msgr2=0x7f09dc0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 0x7f09dc0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 -- 172.21.15.5:0/604010534 >> v1:172.21.15.179:6789/0 conn(0x7f09dc15a3e0 legacy=0x7f09dc06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e2d4b640 1 -- 172.21.15.5:0/604010534 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc06cb70 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.267+0000 7f09e1d49640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 0x7f09dc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.268+0000 7f09e2d4b640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0b1640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a311bec1b7c0dce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.268+0000 7f09e1548640 1 -- 172.21.15.5:0/604010534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d402aea0 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.268+0000 7f09e1548640 1 -- 172.21.15.5:0/604010534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d402d050 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.268+0000 7f09e1548640 1 -- 172.21.15.5:0/604010534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4031820 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 -- 172.21.15.5:0/604010534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc0ab5a0 msgr2=0x7f09dc0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0b1640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009e50 tx=0x7f09d402a6c0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 -- 172.21.15.5:0/604010534 shutdown_connections 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0b1640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 --2- 172.21.15.5:0/604010534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc06e090 0x7f09dc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 -- 172.21.15.5:0/604010534 >> 172.21.15.5:0/604010534 conn(0x7f09dc0ce0d0 msgr2=0x7f09dc0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 -- 172.21.15.5:0/604010534 shutdown_connections 2024-09-13T17:14:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.269+0000 7f09e47ae640 1 -- 172.21.15.5:0/604010534 wait complete. 2024-09-13T17:14:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.270+0000 7f09e47ae640 1 Processor -- start 2024-09-13T17:14:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.270+0000 7f09e47ae640 1 -- start start 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc15a3e0 0x7f09dc149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1e63e0 con 0x7f09dc06e090 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1e66c0 con 0x7f09dc0ab5a0 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e47ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1e69a0 con 0x7f09dc15a3e0 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51098/0 (socket says 172.21.15.5:51098) 2024-09-13T17:14:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 -- 172.21.15.5:0/707370136 learned_addr learned my addr 172.21.15.5:0/707370136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e2d4b640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc15a3e0 0x7f09dc149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e1d49640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 -- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc15a3e0 msgr2=0x7f09dc149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc15a3e0 0x7f09dc149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 -- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 msgr2=0x7f09dc0ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 -- 172.21.15.5:0/707370136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009b30 con 0x7f09dc06e090 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e1d49640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09e254a640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b3f0 tx=0x7f09d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.271+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8011830 con 0x7f09dc06e090 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.272+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8011990 con 0x7f09dc06e090 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.272+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc15b310 con 0x7f09dc06e090 2024-09-13T17:14:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.272+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8011d40 con 0x7f09dc06e090 2024-09-13T17:14:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.272+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc1e6c80 con 0x7f09dc06e090 2024-09-13T17:14:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.273+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc0672a0 con 0x7f09dc06e090 2024-09-13T17:14:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.273+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09d801a400 con 0x7f09dc06e090 2024-09-13T17:14:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.274+0000 7f09d2ffd640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 0x7f09c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.274+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09d80897d0 con 0x7f09dc06e090 2024-09-13T17:14:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.274+0000 7f09e1d49640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 0x7f09c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.274+0000 7f09e1d49640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 0x7f09c006d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09dc1f3990 tx=0x7f09cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.278+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f09d80545f0 con 0x7f09dc06e090 2024-09-13T17:14:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.464+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09dc0ac4b0 con 0x7f09dc06e090 2024-09-13T17:14:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.465+0000 7f09d2ffd640 1 -- 172.21.15.5:0/707370136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f09d8057c10 con 0x7f09dc06e090 2024-09-13T17:14:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 msgr2=0x7f09c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 0x7f09c006d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f09dc1f3990 tx=0x7f09cc008040 comp rx=0 tx=0).stop 2024-09-13T17:14:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 msgr2=0x7f09dc1e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b3f0 tx=0x7f09d800b8b0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 shutdown_connections 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09dc15a3e0 0x7f09dc149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09dc0ab5a0 0x7f09dc0ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f09c006ac00 0x7f09c006d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 --2- 172.21.15.5:0/707370136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc06e090 0x7f09dc1e44c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 >> 172.21.15.5:0/707370136 conn(0x7f09dc0ce0d0 msgr2=0x7f09dc06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 shutdown_connections 2024-09-13T17:14:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.467+0000 7f09e47ae640 1 -- 172.21.15.5:0/707370136 wait complete. 2024-09-13T17:14:07.481 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:07.481 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:07.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.636+0000 7f0af488f640 1 Processor -- start 2024-09-13T17:14:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.636+0000 7f0af488f640 1 -- start start 2024-09-13T17:14:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0af488f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0af006e1c0 0x7f0af00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0af488f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 0x7f0af00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0af488f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b2390 con 0x7f0af0156f40 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0af488f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af015a700 con 0x7f0af006e1c0 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0af488f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00b1780 con 0x7f0af015a290 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0af006e1c0 0x7f0af00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0af006e1c0 0x7f0af00aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51110/0 (socket says 172.21.15.5:51110) 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 -- 172.21.15.5:0/2709673510 learned_addr learned my addr 172.21.15.5:0/2709673510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aeed9d640 1 --2- 172.21.15.5:0/2709673510 >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 0x7f0af00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 -- 172.21.15.5:0/2709673510 >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 msgr2=0x7f0af00b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 --2- 172.21.15.5:0/2709673510 >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 0x7f0af00b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 -- 172.21.15.5:0/2709673510 >> v1:172.21.15.179:6789/0 conn(0x7f0af0156f40 legacy=0x7f0af006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aedd9b640 1 -- 172.21.15.5:0/2709673510 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00b1a60 con 0x7f0af006e1c0 2024-09-13T17:14:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.637+0000 7f0aeed9d640 1 --2- 172.21.15.5:0/2709673510 >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 0x7f0af00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.638+0000 7f0aedd9b640 1 --2- 172.21.15.5:0/2709673510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af006e1c0 0x7f0af00aced0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0af006b8f0 tx=0x7f0ae402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6929ef06dba5f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.638+0000 7f0aed59a640 1 -- 172.21.15.5:0/2709673510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae402f070 con 0x7f0af006e1c0 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.638+0000 7f0aed59a640 1 -- 172.21.15.5:0/2709673510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40325a0 con 0x7f0af006e1c0 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.638+0000 7f0aed59a640 1 -- 172.21.15.5:0/2709673510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4032930 con 0x7f0af006e1c0 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 -- 172.21.15.5:0/2709673510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af006e1c0 msgr2=0x7f0af00aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 --2- 172.21.15.5:0/2709673510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af006e1c0 0x7f0af00aced0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0af006b8f0 tx=0x7f0ae402c8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 -- 172.21.15.5:0/2709673510 shutdown_connections 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 --2- 172.21.15.5:0/2709673510 >> v2:172.21.15.179:3300/0 conn(0x7f0af015a290 0x7f0af00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 --2- 172.21.15.5:0/2709673510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af006e1c0 0x7f0af00aced0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 -- 172.21.15.5:0/2709673510 >> 172.21.15.5:0/2709673510 conn(0x7f0af00ce0d0 msgr2=0x7f0af00ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 -- 172.21.15.5:0/2709673510 shutdown_connections 2024-09-13T17:14:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.639+0000 7f0af488f640 1 -- 172.21.15.5:0/2709673510 wait complete. 2024-09-13T17:14:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.640+0000 7f0af488f640 1 Processor -- start 2024-09-13T17:14:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.640+0000 7f0af488f640 1 -- start start 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af006e1c0 0x7f0af0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af015a290 0x7f0af0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0153d30 con 0x7f0af0156f40 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0153700 con 0x7f0af006e1c0 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0af488f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0154690 con 0x7f0af015a290 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51112/0 (socket says 172.21.15.5:51112) 2024-09-13T17:14:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 -- 172.21.15.5:0/596268885 learned_addr learned my addr 172.21.15.5:0/596268885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aee59c640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af006e1c0 0x7f0af0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aeed9d640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af015a290 0x7f0af0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 -- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af015a290 msgr2=0x7f0af0154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af015a290 0x7f0af0154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 -- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af006e1c0 msgr2=0x7f0af0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af006e1c0 0x7f0af0154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 -- 172.21.15.5:0/596268885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae400b770 con 0x7f0af0156f40 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.641+0000 7f0aedd9b640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.642+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4033d30 con 0x7f0af0156f40 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.642+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4033e90 con 0x7f0af0156f40 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.642+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af0155440 con 0x7f0af0156f40 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.642+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae403c660 con 0x7f0af0156f40 2024-09-13T17:14:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.642+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0153950 con 0x7f0af0156f40 2024-09-13T17:14:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.643+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af00672a0 con 0x7f0af0156f40 2024-09-13T17:14:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.643+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ae403c7c0 con 0x7f0af0156f40 2024-09-13T17:14:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.644+0000 7f0adeffd640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 0x7f0ad006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.644+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ae40aa540 con 0x7f0af0156f40 2024-09-13T17:14:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.644+0000 7f0aee59c640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 0x7f0ad006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.644+0000 7f0aee59c640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 0x7f0ad006d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004f60 tx=0x7f0ae0007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.648+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0ae40754a0 con 0x7f0af0156f40 2024-09-13T17:14:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.818+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af00b1080 con 0x7f0af0156f40 2024-09-13T17:14:07.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.819+0000 7f0adeffd640 1 -- 172.21.15.5:0/596268885 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f0ae4078ac0 con 0x7f0af0156f40 2024-09-13T17:14:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:07.822 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 msgr2=0x7f0ad006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 0x7f0ad006d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004f60 tx=0x7f0ae0007e30 comp rx=0 tx=0).stop 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 msgr2=0x7f0af014e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4004730 comp rx=0 tx=0).stop 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 shutdown_connections 2024-09-13T17:14:07.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0af015a290 0x7f0af0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ad006ac00 0x7f0ad006d0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af0156f40 0x7f0af014e4e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 --2- 172.21.15.5:0/596268885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0af006e1c0 0x7f0af0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 >> 172.21.15.5:0/596268885 conn(0x7f0af00ce0d0 msgr2=0x7f0af0155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 shutdown_connections 2024-09-13T17:14:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.822+0000 7f0af488f640 1 -- 172.21.15.5:0/596268885 wait complete. 2024-09-13T17:14:07.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:07.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.937+0000 7f311a345640 1 Processor -- start 2024-09-13T17:14:07.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.937+0000 7f311a345640 1 -- start start 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f311a345640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3114157e20 0x7f311415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f311a345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311406c090 0x7f311406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f311a345640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311406c520 con 0x7f31140ad010 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f311a345640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311415b900 con 0x7f311406c090 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f311a345640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311406db00 con 0x7f3114157e20 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f31137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311406c090 0x7f311406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f31137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f311406c090 0x7f311406d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51120/0 (socket says 172.21.15.5:51120) 2024-09-13T17:14:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f31137fe640 1 -- 172.21.15.5:0/4058359720 learned_addr learned my addr 172.21.15.5:0/4058359720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.938+0000 7f3113fff640 1 --2- 172.21.15.5:0/4058359720 >> v2:172.21.15.179:3300/0 conn(0x7f3114157e20 0x7f311415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f31137fe640 1 -- 172.21.15.5:0/4058359720 >> v2:172.21.15.179:3300/0 conn(0x7f3114157e20 msgr2=0x7f311415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f31137fe640 1 --2- 172.21.15.5:0/4058359720 >> v2:172.21.15.179:3300/0 conn(0x7f3114157e20 0x7f311415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f31137fe640 1 -- 172.21.15.5:0/4058359720 >> v1:172.21.15.179:6789/0 conn(0x7f31140ad010 legacy=0x7f31140ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f31137fe640 1 -- 172.21.15.5:0/4058359720 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311406c800 con 0x7f311406c090 2024-09-13T17:14:07.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f31137fe640 1 --2- 172.21.15.5:0/4058359720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311406c090 0x7f311406d5c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31140cee60 tx=0x7f310802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d53778f504fafc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.939+0000 7f3112ffd640 1 -- 172.21.15.5:0/4058359720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108032440 con 0x7f311406c090 2024-09-13T17:14:07.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f3112ffd640 1 -- 172.21.15.5:0/4058359720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080325a0 con 0x7f311406c090 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f3112ffd640 1 -- 172.21.15.5:0/4058359720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108032930 con 0x7f311406c090 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 -- 172.21.15.5:0/4058359720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311406c090 msgr2=0x7f311406d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 --2- 172.21.15.5:0/4058359720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311406c090 0x7f311406d5c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31140cee60 tx=0x7f310802a270 comp rx=0 tx=0).stop 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 -- 172.21.15.5:0/4058359720 shutdown_connections 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 --2- 172.21.15.5:0/4058359720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f311406c090 0x7f311406d5c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 --2- 172.21.15.5:0/4058359720 >> v2:172.21.15.179:3300/0 conn(0x7f3114157e20 0x7f311415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 -- 172.21.15.5:0/4058359720 >> 172.21.15.5:0/4058359720 conn(0x7f31140ce130 msgr2=0x7f31140ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 -- 172.21.15.5:0/4058359720 shutdown_connections 2024-09-13T17:14:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.940+0000 7f311a345640 1 -- 172.21.15.5:0/4058359720 wait complete. 2024-09-13T17:14:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.941+0000 7f311a345640 1 Processor -- start 2024-09-13T17:14:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 -- start start 2024-09-13T17:14:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 0x7f3114097060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3114140cf0 0x7f31140975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31141539e0 con 0x7f31140ad010 2024-09-13T17:14:07.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31141e5090 con 0x7f3114157e20 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f311a345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140afb40 con 0x7f3114140cf0 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f3113fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f3113fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51132/0 (socket says 172.21.15.5:51132) 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.942+0000 7f3113fff640 1 -- 172.21.15.5:0/3799118179 learned_addr learned my addr 172.21.15.5:0/3799118179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f31188e2640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3114140cf0 0x7f31140975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f31137fe640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 0x7f3114097060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 -- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3114140cf0 msgr2=0x7f31140975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3114140cf0 0x7f31140975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 -- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 msgr2=0x7f3114097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 0x7f3114097060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 -- 172.21.15.5:0/3799118179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080094d0 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f31137fe640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 0x7f3114097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3113fff640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f310400e870 tx=0x7f310400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040094f0 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400c8e0 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31141e4760 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400cc90 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.943+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31141e4d20 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.944+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31140672a0 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.945+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3104013470 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.945+0000 7f3110ff9640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 0x7f310006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.945+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3104089a40 con 0x7f31140ad010 2024-09-13T17:14:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.945+0000 7f31137fe640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 0x7f310006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.946+0000 7f31137fe640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 0x7f310006d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3108034000 tx=0x7f310802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:07.949+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f310408be60 con 0x7f31140ad010 2024-09-13T17:14:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.119+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3114158200 con 0x7f31140ad010 2024-09-13T17:14:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.120+0000 7f3110ff9640 1 -- 172.21.15.5:0/3799118179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3104054910 con 0x7f31140ad010 2024-09-13T17:14:08.122 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 msgr2=0x7f310006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 0x7f310006d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3108034000 tx=0x7f310802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 msgr2=0x7f31141534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f310400e870 tx=0x7f310400ed30 comp rx=0 tx=0).stop 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 shutdown_connections 2024-09-13T17:14:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3114140cf0 0x7f31140975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3114157e20 0x7f3114097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f310006ac30 0x7f310006d0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 --2- 172.21.15.5:0/3799118179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31140ad010 0x7f31141534a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 >> 172.21.15.5:0/3799118179 conn(0x7f31140ce130 msgr2=0x7f311415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 shutdown_connections 2024-09-13T17:14:08.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.122+0000 7f311a345640 1 -- 172.21.15.5:0/3799118179 wait complete. 2024-09-13T17:14:08.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.240+0000 7fd4a92e5640 1 Processor -- start 2024-09-13T17:14:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.240+0000 7fd4a92e5640 1 -- start start 2024-09-13T17:14:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.240+0000 7fd4a92e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4a4152fa0 0x7fd4a4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.240+0000 7fd4a92e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4a41598a0 0x7fd4a40b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a92e5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a4153380 con 0x7fd4a40b20e0 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a92e5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40b24f0 con 0x7fd4a41598a0 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a92e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a4070f10 con 0x7fd4a4152fa0 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4a41598a0 0x7fd4a40b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4a41598a0 0x7fd4a40b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51136/0 (socket says 172.21.15.5:51136) 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 -- 172.21.15.5:0/374822044 learned_addr learned my addr 172.21.15.5:0/374822044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a2ffd640 1 --2- 172.21.15.5:0/374822044 >> v2:172.21.15.179:3300/0 conn(0x7fd4a4152fa0 0x7fd4a4071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 -- 172.21.15.5:0/374822044 >> v2:172.21.15.179:3300/0 conn(0x7fd4a4152fa0 msgr2=0x7fd4a4071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 --2- 172.21.15.5:0/374822044 >> v2:172.21.15.179:3300/0 conn(0x7fd4a4152fa0 0x7fd4a4071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 -- 172.21.15.5:0/374822044 >> v1:172.21.15.179:6789/0 conn(0x7fd4a40b20e0 legacy=0x7fd4a406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.241+0000 7fd4a27fc640 1 -- 172.21.15.5:0/374822044 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40711f0 con 0x7fd4a41598a0 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a27fc640 1 --2- 172.21.15.5:0/374822044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a41598a0 0x7fd4a40b1ba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4a406e4c0 tx=0x7fd49802c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb224ec7a63deaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a1ffb640 1 -- 172.21.15.5:0/374822044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498032480 con 0x7fd4a41598a0 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a1ffb640 1 -- 172.21.15.5:0/374822044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49802f030 con 0x7fd4a41598a0 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a1ffb640 1 -- 172.21.15.5:0/374822044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498032800 con 0x7fd4a41598a0 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a92e5640 1 -- 172.21.15.5:0/374822044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a41598a0 msgr2=0x7fd4a40b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.242+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/374822044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a41598a0 0x7fd4a40b1ba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4a406e4c0 tx=0x7fd49802c720 comp rx=0 tx=0).stop 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 -- 172.21.15.5:0/374822044 shutdown_connections 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/374822044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a41598a0 0x7fd4a40b1ba0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/374822044 >> v2:172.21.15.179:3300/0 conn(0x7fd4a4152fa0 0x7fd4a4071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 -- 172.21.15.5:0/374822044 >> 172.21.15.5:0/374822044 conn(0x7fd4a40ce130 msgr2=0x7fd4a40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 -- 172.21.15.5:0/374822044 shutdown_connections 2024-09-13T17:14:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.243+0000 7fd4a92e5640 1 -- 172.21.15.5:0/374822044 wait complete. 2024-09-13T17:14:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.244+0000 7fd4a92e5640 1 Processor -- start 2024-09-13T17:14:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.244+0000 7fd4a92e5640 1 -- start start 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a4152fa0 0x7fd4a40b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a41598a0 0x7fd4a40b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415ce80 con 0x7fd4a40b20e0 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a413c7b0 con 0x7fd4a4152fa0 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a41edc60 con 0x7fd4a41598a0 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51138/0 (socket says 172.21.15.5:51138) 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 -- 172.21.15.5:0/1072779182 learned_addr learned my addr 172.21.15.5:0/1072779182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a27fc640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a4152fa0 0x7fd4a40b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a37fe640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a41598a0 0x7fd4a40b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 -- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a41598a0 msgr2=0x7fd4a40b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a41598a0 0x7fd4a40b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 -- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a4152fa0 msgr2=0x7fd4a40b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a4152fa0 0x7fd4a40b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 -- 172.21.15.5:0/1072779182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49800b760 con 0x7fd4a40b20e0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a2ffd640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd49400d830 tx=0x7fd49400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400b660 con 0x7fd4a40b20e0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400b7c0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400bb50 con 0x7fd4a40b20e0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.245+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a413ccb0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.246+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a415c8c0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.246+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a40672a0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.247+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd49401e460 con 0x7fd4a40b20e0 2024-09-13T17:14:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.247+0000 7fd48b7fe640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 0x7fd49006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.248+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd494089c40 con 0x7fd4a40b20e0 2024-09-13T17:14:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.248+0000 7fd4a27fc640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 0x7fd49006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.248+0000 7fd4a27fc640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 0x7fd49006d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd498037000 tx=0x7fd498030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.252+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd494054ba0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.425+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4a40b12d0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.425+0000 7fd48b7fe640 1 -- 172.21.15.5:0/1072779182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4940581c0 con 0x7fd4a40b20e0 2024-09-13T17:14:08.427 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 msgr2=0x7fd49006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 0x7fd49006d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd498037000 tx=0x7fd498030000 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 msgr2=0x7fd4a413c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd49400d830 tx=0x7fd49400dcf0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 shutdown_connections 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a41598a0 0x7fd4a40b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a4152fa0 0x7fd4a40b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd49006ac00 0x7fd49006d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 --2- 172.21.15.5:0/1072779182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a40b20e0 0x7fd4a413c270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 >> 172.21.15.5:0/1072779182 conn(0x7fd4a40ce130 msgr2=0x7fd4a40ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 shutdown_connections 2024-09-13T17:14:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.427+0000 7fd4a92e5640 1 -- 172.21.15.5:0/1072779182 wait complete. 2024-09-13T17:14:08.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:08.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.543+0000 7f018d983640 1 Processor -- start 2024-09-13T17:14:08.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.543+0000 7f018d983640 1 -- start start 2024-09-13T17:14:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f018d983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f018d983640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f018806da30 0x7f018806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f018d983640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880ad050 con 0x7f01881591e0 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f018d983640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018806e420 con 0x7f018806da30 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f018d983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880ac440 con 0x7f01880abe60 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f018806da30 0x7f018806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f018806da30 0x7f018806dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51144/0 (socket says 172.21.15.5:51144) 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 -- 172.21.15.5:0/1144783717 learned_addr learned my addr 172.21.15.5:0/1144783717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01867fc640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 -- 172.21.15.5:0/1144783717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 msgr2=0x7f01880b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 -- 172.21.15.5:0/1144783717 >> v1:172.21.15.179:6789/0 conn(0x7f01881591e0 legacy=0x7f01880ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.544+0000 7f01877fe640 1 -- 172.21.15.5:0/1144783717 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880ac720 con 0x7f018806da30 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.545+0000 7f01877fe640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f018806dee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0178009e50 tx=0x7f017802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca050e8efc05605 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.545+0000 7f0185ffb640 1 -- 172.21.15.5:0/1144783717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017802aea0 con 0x7f018806da30 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.545+0000 7f0185ffb640 1 -- 172.21.15.5:0/1144783717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017802d050 con 0x7f018806da30 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.545+0000 7f0185ffb640 1 -- 172.21.15.5:0/1144783717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178031820 con 0x7f018806da30 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 -- 172.21.15.5:0/1144783717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 msgr2=0x7f018806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f018806dee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0178009e50 tx=0x7f017802a6c0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 -- 172.21.15.5:0/1144783717 shutdown_connections 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f018806dee0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 --2- 172.21.15.5:0/1144783717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 -- 172.21.15.5:0/1144783717 >> 172.21.15.5:0/1144783717 conn(0x7f01880ce130 msgr2=0x7f01880ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 -- 172.21.15.5:0/1144783717 shutdown_connections 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.546+0000 7f018d983640 1 -- 172.21.15.5:0/1144783717 wait complete. 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.547+0000 7f018d983640 1 Processor -- start 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.547+0000 7f018d983640 1 -- start start 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01881591e0 0x7f01881f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01881f5560 con 0x7f018806da30 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01881f2aa0 con 0x7f01881591e0 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f018d983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01881f2d80 con 0x7f01880abe60 2024-09-13T17:14:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f0186ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f0186ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51156/0 (socket says 172.21.15.5:51156) 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f0186ffd640 1 -- 172.21.15.5:0/1704631310 learned_addr learned my addr 172.21.15.5:0/1704631310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f01877fe640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01881591e0 0x7f01881f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.548+0000 7f01867fc640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 -- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 msgr2=0x7f01880af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 -- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01881591e0 msgr2=0x7f01881f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01881591e0 0x7f01881f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 -- 172.21.15.5:0/1704631310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009b30 con 0x7f018806da30 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f0186ffd640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f018000b3f0 tx=0x7f018000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180011830 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180011990 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01881f5820 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180011d40 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.549+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01880991a0 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.550+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01881f5d40 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.550+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f018001a400 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.551+0000 7f017ffff640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 0x7f016806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.551+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0180089480 con 0x7f018806da30 2024-09-13T17:14:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.551+0000 7f01867fc640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 0x7f016806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.552+0000 7f01867fc640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 0x7f016806d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01880afc20 tx=0x7f0170008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.555+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01881f5d40 con 0x7f018806da30 2024-09-13T17:14:08.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.729+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01880672a0 con 0x7f018806da30 2024-09-13T17:14:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.730+0000 7f017ffff640 1 -- 172.21.15.5:0/1704631310 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0180054350 con 0x7f018806da30 2024-09-13T17:14:08.732 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 msgr2=0x7f016806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 0x7f016806d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01880afc20 tx=0x7f0170008040 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 msgr2=0x7f01881f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f018000b3f0 tx=0x7f018000b8b0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 shutdown_connections 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01881591e0 0x7f01881f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880abe60 0x7f01880af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f016806ac00 0x7f016806d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 --2- 172.21.15.5:0/1704631310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f018806da30 0x7f01881f6020 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.731+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 >> 172.21.15.5:0/1704631310 conn(0x7f01880ce130 msgr2=0x7f0188070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.732+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 shutdown_connections 2024-09-13T17:14:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.732+0000 7f018d983640 1 -- 172.21.15.5:0/1704631310 wait complete. 2024-09-13T17:14:08.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.847+0000 7f31a2a96640 1 Processor -- start 2024-09-13T17:14:08.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.847+0000 7f31a2a96640 1 -- start start 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a2a96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f319c0abe60 0x7f319c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a2a96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a2a96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0ad050 con 0x7f319c1591e0 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a2a96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c06e400 con 0x7f319c0abe60 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a2a96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0ac440 con 0x7f319c06da30 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f319bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f319c0abe60 0x7f319c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a1033640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a0832640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f319c1591e0 0x7f319c0ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:43596/0 (socket says 172.21.15.5:43596) 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a0832640 1 -- 172.21.15.5:0/4063329683 learned_addr learned my addr 172.21.15.5:0/4063329683 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a1033640 1 -- 172.21.15.5:0/4063329683 >> v2:172.21.15.179:3300/0 conn(0x7f319c0abe60 msgr2=0x7f319c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a1033640 1 --2- 172.21.15.5:0/4063329683 >> v2:172.21.15.179:3300/0 conn(0x7f319c0abe60 0x7f319c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a1033640 1 -- 172.21.15.5:0/4063329683 >> v1:172.21.15.179:6789/0 conn(0x7f319c1591e0 legacy=0x7f319c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.848+0000 7f31a1033640 1 -- 172.21.15.5:0/4063329683 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0ac720 con 0x7f319c06da30 2024-09-13T17:14:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.849+0000 7f31a1033640 1 --2- 172.21.15.5:0/4063329683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c06dec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbfaa209b76114f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.849+0000 7f319b7fe640 1 -- 172.21.15.5:0/4063329683 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194007740 con 0x7f319c06da30 2024-09-13T17:14:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.849+0000 7f319b7fe640 1 -- 172.21.15.5:0/4063329683 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319402d050 con 0x7f319c06da30 2024-09-13T17:14:08.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.849+0000 7f319b7fe640 1 -- 172.21.15.5:0/4063329683 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194007ac0 con 0x7f319c06da30 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 -- 172.21.15.5:0/4063329683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 msgr2=0x7f319c06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 --2- 172.21.15.5:0/4063329683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c06dec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402a660 comp rx=0 tx=0).stop 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 -- 172.21.15.5:0/4063329683 shutdown_connections 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 --2- 172.21.15.5:0/4063329683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c06dec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 --2- 172.21.15.5:0/4063329683 >> v2:172.21.15.179:3300/0 conn(0x7f319c0abe60 0x7f319c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 -- 172.21.15.5:0/4063329683 >> 172.21.15.5:0/4063329683 conn(0x7f319c0ce130 msgr2=0x7f319c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 -- 172.21.15.5:0/4063329683 shutdown_connections 2024-09-13T17:14:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.850+0000 7f31a2a96640 1 -- 172.21.15.5:0/4063329683 wait complete. 2024-09-13T17:14:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.851+0000 7f31a2a96640 1 Processor -- start 2024-09-13T17:14:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.851+0000 7f31a2a96640 1 -- start start 2024-09-13T17:14:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f319c0abe60 0x7f319c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c1581d0 con 0x7f319c1591e0 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c157ef0 con 0x7f319c0abe60 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a2a96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c151770 con 0x7f319c06da30 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51162/0 (socket says 172.21.15.5:51162) 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 -- 172.21.15.5:0/2139320384 learned_addr learned my addr 172.21.15.5:0/2139320384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a0832640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f319bfff640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f319c0abe60 0x7f319c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 -- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 msgr2=0x7f319c146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 -- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f319c0abe60 msgr2=0x7f319c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f319c0abe60 0x7f319c1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a1033640 1 -- 172.21.15.5:0/2139320384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009a70 con 0x7f319c1591e0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.852+0000 7f31a0832640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31a1033640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3194009eb0 tx=0x7f3194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319403b820 con 0x7f319c1591e0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319403b980 con 0x7f319c1591e0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c151a50 con 0x7f319c1591e0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319403bd10 con 0x7f319c1591e0 2024-09-13T17:14:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.853+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c157b00 con 0x7f319c1591e0 2024-09-13T17:14:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.854+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c151f70 con 0x7f319c1591e0 2024-09-13T17:14:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.854+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3194031400 con 0x7f319c1591e0 2024-09-13T17:14:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.855+0000 7f31997fa640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 0x7f318006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:08.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.855+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31940aaee0 con 0x7f319c1591e0 2024-09-13T17:14:08.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.855+0000 7f31a0832640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 0x7f318006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:08.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.856+0000 7f31a0832640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 0x7f318006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:08.859+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f319c151f70 con 0x7f319c1591e0 2024-09-13T17:14:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.030+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f319c151f70 con 0x7f319c1591e0 2024-09-13T17:14:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.030+0000 7f31997fa640 1 -- 172.21.15.5:0/2139320384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f319c151f70 con 0x7f319c1591e0 2024-09-13T17:14:09.032 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 msgr2=0x7f318006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 0x7f318006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190007e80 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 msgr2=0x7f319c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3194009eb0 tx=0x7f3194004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 shutdown_connections 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f318006ac00 0x7f318006d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f319c1591e0 0x7f319c152250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f319c0abe60 0x7f319c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 --2- 172.21.15.5:0/2139320384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f319c06da30 0x7f319c146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 >> 172.21.15.5:0/2139320384 conn(0x7f319c0ce130 msgr2=0x7f319c0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 shutdown_connections 2024-09-13T17:14:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.032+0000 7f31a2a96640 1 -- 172.21.15.5:0/2139320384 wait complete. 2024-09-13T17:14:09.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:09.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.145+0000 7feb5a4c5640 1 Processor -- start 2024-09-13T17:14:09.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.145+0000 7feb5a4c5640 1 -- start start 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb5a4c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb5415a3e0 0x7feb5406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb5a4c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb540ab770 0x7feb540b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb5a4c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5406d410 con 0x7feb5406c320 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb5a4c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5406cb70 con 0x7feb540ab770 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb5a4c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5406ce50 con 0x7feb5415a3e0 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb58a62640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb540ab770 0x7feb540b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb4bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb5406c320 0x7feb540ab060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53384/0 (socket says 172.21.15.5:53384) 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb4bfff640 1 -- 172.21.15.5:0/3452648276 learned_addr learned my addr 172.21.15.5:0/3452648276 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.146+0000 7feb53fff640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb5415a3e0 0x7feb5406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb537fe640 1 -- 172.21.15.5:0/3452648276 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263408239 0 0) 0x7feb5406d410 con 0x7feb5406c320 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb537fe640 1 -- 172.21.15.5:0/3452648276 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb40003520 con 0x7feb5406c320 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb58a62640 1 -- 172.21.15.5:0/3452648276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb5415a3e0 msgr2=0x7feb5406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb58a62640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb5415a3e0 0x7feb5406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb58a62640 1 -- 172.21.15.5:0/3452648276 >> v1:172.21.15.5:6789/0 conn(0x7feb5406c320 legacy=0x7feb540ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb58a62640 1 -- 172.21.15.5:0/3452648276 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5406d130 con 0x7feb540ab770 2024-09-13T17:14:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.147+0000 7feb58a62640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb540ab770 0x7feb540b1640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009d90 tx=0x7feb4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2966d9ef1940f9da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb537fe640 1 -- 172.21.15.5:0/3452648276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c007740 con 0x7feb540ab770 2024-09-13T17:14:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb537fe640 1 -- 172.21.15.5:0/3452648276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c02d050 con 0x7feb540ab770 2024-09-13T17:14:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb537fe640 1 -- 172.21.15.5:0/3452648276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c007ac0 con 0x7feb540ab770 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 -- 172.21.15.5:0/3452648276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb540ab770 msgr2=0x7feb540b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb540ab770 0x7feb540b1640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009d90 tx=0x7feb4c02a660 comp rx=0 tx=0).stop 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 -- 172.21.15.5:0/3452648276 shutdown_connections 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb540ab770 0x7feb540b1640 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/3452648276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb5415a3e0 0x7feb5406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 -- 172.21.15.5:0/3452648276 >> 172.21.15.5:0/3452648276 conn(0x7feb540ce0d0 msgr2=0x7feb540ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 -- 172.21.15.5:0/3452648276 shutdown_connections 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.148+0000 7feb5a4c5640 1 -- 172.21.15.5:0/3452648276 wait complete. 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.149+0000 7feb5a4c5640 1 Processor -- start 2024-09-13T17:14:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.149+0000 7feb5a4c5640 1 -- start start 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb540ab770 0x7feb5414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 0x7feb540716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541493c0 con 0x7feb5406c320 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb540ccab0 con 0x7feb5415a3e0 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb5a4c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb540cc810 con 0x7feb540ab770 2024-09-13T17:14:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51192/0 (socket says 172.21.15.5:51192) 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb53fff640 1 -- 172.21.15.5:0/4226813540 learned_addr learned my addr 172.21.15.5:0/4226813540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb4bfff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb540ab770 0x7feb5414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.150+0000 7feb58a62640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 0x7feb540716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 -- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb540ab770 msgr2=0x7feb5414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb540ab770 0x7feb5414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 -- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 msgr2=0x7feb540716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 0x7feb540716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 -- 172.21.15.5:0/4226813540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009a70 con 0x7feb5406c320 2024-09-13T17:14:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb58a62640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 0x7feb540716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb53fff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e870 tx=0x7feb4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb440094f0 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400c940 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb54070c20 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400ccf0 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.151+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb540711a0 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.152+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb540672a0 con 0x7feb5406c320 2024-09-13T17:14:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.152+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb44013470 con 0x7feb5406c320 2024-09-13T17:14:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.153+0000 7feb517fa640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 0x7feb3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.153+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb44089770 con 0x7feb5406c320 2024-09-13T17:14:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.153+0000 7feb4bfff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 0x7feb3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.153+0000 7feb4bfff640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 0x7feb3406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feb540ab4b0 tx=0x7feb3c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.157+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb44054620 con 0x7feb5406c320 2024-09-13T17:14:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.338+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feb540b1640 con 0x7feb5406c320 2024-09-13T17:14:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.339+0000 7feb517fa640 1 -- 172.21.15.5:0/4226813540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7feb44057c40 con 0x7feb5406c320 2024-09-13T17:14:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 msgr2=0x7feb3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 0x7feb3406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feb540ab4b0 tx=0x7feb3c009040 comp rx=0 tx=0).stop 2024-09-13T17:14:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 msgr2=0x7feb54148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e870 tx=0x7feb4400ed30 comp rx=0 tx=0).stop 2024-09-13T17:14:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 shutdown_connections 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb5415a3e0 0x7feb540716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb540ab770 0x7feb5414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feb3406ac00 0x7feb3406d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 --2- 172.21.15.5:0/4226813540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406c320 0x7feb54148e80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 >> 172.21.15.5:0/4226813540 conn(0x7feb540ce0d0 msgr2=0x7feb540adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 shutdown_connections 2024-09-13T17:14:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.341+0000 7feb5a4c5640 1 -- 172.21.15.5:0/4226813540 wait complete. 2024-09-13T17:14:09.353 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:14:09.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:09.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T17:14:09.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:09.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:09.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:09.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:14:09.436 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:09.436 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:09.455 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:09.455 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:09.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:09.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.614+0000 7f3b19508640 1 Processor -- start 2024-09-13T17:14:09.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.614+0000 7f3b19508640 1 -- start start 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.614+0000 7f3b19508640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3b1415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b19508640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140b2390 con 0x7f3b1406e1c0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b19508640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140b1780 con 0x7f3b14156f40 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b19508640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140b1a60 con 0x7f3b140aced0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b127fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b1406e1c0 0x7f3b14160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53396/0 (socket says 172.21.15.5:53396) 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b127fc640 1 -- 172.21.15.5:0/787199080 learned_addr learned my addr 172.21.15.5:0/787199080 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b137fe640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3b1415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646676000 0 0) 0x7f3b140b2390 con 0x7f3b1406e1c0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3afc003520 con 0x7f3b1406e1c0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292419911 0 0) 0x7f3afc003520 con 0x7f3b1406e1c0 2024-09-13T17:14:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 msgr2=0x7f3b1415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3b1415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 >> v1:172.21.15.179:6789/0 conn(0x7f3b14156f40 legacy=0x7f3b1406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140b1d40 con 0x7f3b1406e1c0 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3b08001670 con 0x7f3b1406e1c0 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 >> v1:172.21.15.5:6789/0 conn(0x7f3b1406e1c0 legacy=0x7f3b14160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3afc0039a0 0x7f3afc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3afc0047c0 0x7f3afc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3afc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140b1a60 con 0x7f3afc0047c0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc00ba60 con 0x7f3afc0039a0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc00de30 con 0x7f3b140aced0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.615+0000 7f3b127fc640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3afc0047c0 0x7f3afc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b12ffd640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3afc0039a0 0x7f3afc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b137fe640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3afc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 -- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 msgr2=0x7f3afc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b140aced0 0x7f3afc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 -- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3afc0039a0 msgr2=0x7f3afc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3afc0039a0 0x7f3afc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 -- 172.21.15.5:0/787199080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc003520 con 0x7f3afc0047c0 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.616+0000 7f3b127fc640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3afc0047c0 0x7f3afc004c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3b08001eb0 tx=0x7f3afc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e322acee681d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005ad0 con 0x7f3afc0047c0 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0802d070 con 0x7f3afc0047c0 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b11ffb640 1 -- 172.21.15.5:0/787199080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005e90 con 0x7f3afc0047c0 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 -- 172.21.15.5:0/787199080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3afc0047c0 msgr2=0x7f3afc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 --2- 172.21.15.5:0/787199080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3afc0047c0 0x7f3afc004c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3b08001eb0 tx=0x7f3afc0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b137fe640 1 -- 172.21.15.5:0/787199080 reap_dead start 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 -- 172.21.15.5:0/787199080 shutdown_connections 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 -- 172.21.15.5:0/787199080 >> 172.21.15.5:0/787199080 conn(0x7f3b140ce0d0 msgr2=0x7f3b140ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 -- 172.21.15.5:0/787199080 shutdown_connections 2024-09-13T17:14:09.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.617+0000 7f3b19508640 1 -- 172.21.15.5:0/787199080 wait complete. 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 Processor -- start 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 -- start start 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3afc0047c0 0x7f3b141f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b140aeed0 0x7f3b140c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141f26f0 con 0x7f3b141513a0 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140af350 con 0x7f3b140aeed0 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b19508640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141552e0 con 0x7f3afc0047c0 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51212/0 (socket says 172.21.15.5:51212) 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.619+0000 7f3b127fc640 1 -- 172.21.15.5:0/2069794336 learned_addr learned my addr 172.21.15.5:0/2069794336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b12ffd640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3afc0047c0 0x7f3b141f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b137fe640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b140aeed0 0x7f3b140c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 -- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3afc0047c0 msgr2=0x7f3b141f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3afc0047c0 0x7f3b141f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 -- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b140aeed0 msgr2=0x7f3b140c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b140aeed0 0x7f3b140c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 -- 172.21.15.5:0/2069794336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b141f31a0 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b127fc640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b08001eb0 tx=0x7f3b08001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005a80 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08005be0 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141f2900 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08007070 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.620+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b141f2ec0 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.621+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140672a0 con 0x7f3b141513a0 2024-09-13T17:14:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.622+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b0802f030 con 0x7f3b141513a0 2024-09-13T17:14:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.622+0000 7f3afb7fe640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 0x7f3b0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.622+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b080a9a40 con 0x7f3b141513a0 2024-09-13T17:14:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.622+0000 7f3b12ffd640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 0x7f3b0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.623+0000 7f3b12ffd640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 0x7f3b0006d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005590 tx=0x7f3b04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.626+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b080abe60 con 0x7f3b141513a0 2024-09-13T17:14:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.799+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b140b1080 con 0x7f3b141513a0 2024-09-13T17:14:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.800+0000 7f3afb7fe640 1 -- 172.21.15.5:0/2069794336 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f3b08074a10 con 0x7f3b141513a0 2024-09-13T17:14:09.802 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:09.802 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 msgr2=0x7f3b0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 0x7f3b0006d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005590 tx=0x7f3b04009040 comp rx=0 tx=0).stop 2024-09-13T17:14:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 msgr2=0x7f3b140ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b08001eb0 tx=0x7f3b08001930 comp rx=0 tx=0).stop 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 shutdown_connections 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b140aeed0 0x7f3b140c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b0006ac00 0x7f3b0006d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b141513a0 0x7f3b140ae990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 --2- 172.21.15.5:0/2069794336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3afc0047c0 0x7f3b141f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 >> 172.21.15.5:0/2069794336 conn(0x7f3b140ce0d0 msgr2=0x7f3b140700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 shutdown_connections 2024-09-13T17:14:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.802+0000 7f3b19508640 1 -- 172.21.15.5:0/2069794336 wait complete. 2024-09-13T17:14:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:09.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 Processor -- start 2024-09-13T17:14:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 -- start start 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 0x7f5edc15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc06c090 0x7f5edc06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5edc0ad010 0x7f5edc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc15b900 con 0x7f5edc0ad010 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc06db00 con 0x7f5edc157e20 2024-09-13T17:14:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.918+0000 7f5ee189c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc06c520 con 0x7f5edc06c090 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5edc0ad010 0x7f5edc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5edc0ad010 0x7f5edc0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51228/0 (socket says 172.21.15.5:51228) 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 -- 172.21.15.5:0/1851850497 learned_addr learned my addr 172.21.15.5:0/1851850497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edaffd640 1 --2- 172.21.15.5:0/1851850497 >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 0x7f5edc15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5eda7fc640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc06c090 0x7f5edc06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 -- 172.21.15.5:0/1851850497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc06c090 msgr2=0x7f5edc06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc06c090 0x7f5edc06d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 -- 172.21.15.5:0/1851850497 >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 msgr2=0x7f5edc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/1851850497 >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 0x7f5edc15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edb7fe640 1 -- 172.21.15.5:0/1851850497 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc06c800 con 0x7f5edc0ad010 2024-09-13T17:14:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.919+0000 7f5edaffd640 1 --2- 172.21.15.5:0/1851850497 >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 0x7f5edc15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0ad010 0x7f5edc0ad460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0cee60 tx=0x7f5ed402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b33d232c1a408d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5ed9ffb640 1 -- 172.21.15.5:0/1851850497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4031600 con 0x7f5edc0ad010 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5ed9ffb640 1 -- 172.21.15.5:0/1851850497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed402d050 con 0x7f5edc0ad010 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5ed9ffb640 1 -- 172.21.15.5:0/1851850497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4031980 con 0x7f5edc0ad010 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5ee189c640 1 -- 172.21.15.5:0/1851850497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0ad010 msgr2=0x7f5edc0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.920+0000 7f5ee189c640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0ad010 0x7f5edc0ad460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0cee60 tx=0x7f5ed402a6a0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 -- 172.21.15.5:0/1851850497 shutdown_connections 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc0ad010 0x7f5edc0ad460 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 --2- 172.21.15.5:0/1851850497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc06c090 0x7f5edc06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 --2- 172.21.15.5:0/1851850497 >> v2:172.21.15.179:3300/0 conn(0x7f5edc157e20 0x7f5edc15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 -- 172.21.15.5:0/1851850497 >> 172.21.15.5:0/1851850497 conn(0x7f5edc0ce130 msgr2=0x7f5edc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 -- 172.21.15.5:0/1851850497 shutdown_connections 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.921+0000 7f5ee189c640 1 -- 172.21.15.5:0/1851850497 wait complete. 2024-09-13T17:14:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.922+0000 7f5ee189c640 1 Processor -- start 2024-09-13T17:14:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.922+0000 7f5ee189c640 1 -- start start 2024-09-13T17:14:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5edc0ad010 0x7f5edc14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc157e20 0x7f5edc0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc14fc70 con 0x7f5edc14fe10 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc09ad00 con 0x7f5edc0ad010 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5ee189c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc09afe0 con 0x7f5edc157e20 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51240/0 (socket says 172.21.15.5:51240) 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 -- 172.21.15.5:0/4051580508 learned_addr learned my addr 172.21.15.5:0/4051580508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edaffd640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5edc0ad010 0x7f5edc14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5eda7fc640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc157e20 0x7f5edc0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 -- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc157e20 msgr2=0x7f5edc0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc157e20 0x7f5edc0ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 -- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5edc0ad010 msgr2=0x7f5edc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5edc0ad010 0x7f5edc14f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 -- 172.21.15.5:0/4051580508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009b30 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.923+0000 7f5edb7fe640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034040 tx=0x7f5ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.924+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403d860 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.924+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed403d9c0 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.924+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc09b2c0 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.924+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403dd70 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.924+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc09b880 con 0x7f5edc14fe10 2024-09-13T17:14:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.925+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc1f0740 con 0x7f5edc14fe10 2024-09-13T17:14:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.925+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ed4046400 con 0x7f5edc14fe10 2024-09-13T17:14:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.925+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 0x7f5ec806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.926+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ed40aa6f0 con 0x7f5edc14fe10 2024-09-13T17:14:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.926+0000 7f5edaffd640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 0x7f5ec806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.926+0000 7f5edaffd640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 0x7f5ec806d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:09.930+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5edc1f0740 con 0x7f5edc14fe10 2024-09-13T17:14:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.101+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5edc0ac1b0 con 0x7f5edc14fe10 2024-09-13T17:14:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.101+0000 7f5ec3fff640 1 -- 172.21.15.5:0/4051580508 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5edc0ac1b0 con 0x7f5edc14fe10 2024-09-13T17:14:10.104 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 msgr2=0x7f5ec806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 0x7f5ec806d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).stop 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 msgr2=0x7f5edc0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034040 tx=0x7f5ed4004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 shutdown_connections 2024-09-13T17:14:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5ec806ac30 0x7f5ec806d0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5edc14fe10 0x7f5edc0ae980 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5edc157e20 0x7f5edc0ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 --2- 172.21.15.5:0/4051580508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5edc0ad010 0x7f5edc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 >> 172.21.15.5:0/4051580508 conn(0x7f5edc0ce130 msgr2=0x7f5edc158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 shutdown_connections 2024-09-13T17:14:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.104+0000 7f5ee189c640 1 -- 172.21.15.5:0/4051580508 wait complete. 2024-09-13T17:14:10.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:10.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.219+0000 7f7aa5c20640 1 Processor -- start 2024-09-13T17:14:10.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.219+0000 7f7aa5c20640 1 -- start start 2024-09-13T17:14:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7aa5c20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa006a5a0 0x7f7aa00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7aa5c20640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa015aaa0 0x7f7aa00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7aa5c20640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa00ac650 con 0x7f7aa0143740 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7aa5c20640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa0144100 con 0x7f7aa015aaa0 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7aa5c20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0143b20 con 0x7f7aa006a5a0 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa015aaa0 0x7f7aa00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7aa0143740 0x7f7aa0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53410/0 (socket says 172.21.15.5:53410) 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9f7fe640 1 -- 172.21.15.5:0/3040557207 learned_addr learned my addr 172.21.15.5:0/3040557207 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9effd640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa006a5a0 0x7f7aa00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9ffff640 1 -- 172.21.15.5:0/3040557207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa006a5a0 msgr2=0x7f7aa00ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9ffff640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa006a5a0 0x7f7aa00ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9ffff640 1 -- 172.21.15.5:0/3040557207 >> v1:172.21.15.5:6789/0 conn(0x7f7aa0143740 legacy=0x7f7aa0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9ffff640 1 -- 172.21.15.5:0/3040557207 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00b2130 con 0x7f7aa015aaa0 2024-09-13T17:14:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.220+0000 7f7a9e7fc640 1 -- 172.21.15.5:0/3040557207 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621656127 0 0) 0x7f7a90001110 con 0x7f7aa0143740 2024-09-13T17:14:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.221+0000 7f7a9ffff640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015aaa0 0x7f7aa00ac110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009d90 tx=0x7f7a9802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78fa9fb738694dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.221+0000 7f7a9e7fc640 1 -- 172.21.15.5:0/3040557207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98007740 con 0x7f7aa015aaa0 2024-09-13T17:14:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.221+0000 7f7a9e7fc640 1 -- 172.21.15.5:0/3040557207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9802d050 con 0x7f7aa015aaa0 2024-09-13T17:14:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.221+0000 7f7a9e7fc640 1 -- 172.21.15.5:0/3040557207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98007ac0 con 0x7f7aa015aaa0 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 -- 172.21.15.5:0/3040557207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015aaa0 msgr2=0x7f7aa00ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015aaa0 0x7f7aa00ac110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009d90 tx=0x7f7a9802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 -- 172.21.15.5:0/3040557207 shutdown_connections 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015aaa0 0x7f7aa00ac110 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/3040557207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa006a5a0 0x7f7aa00ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 -- 172.21.15.5:0/3040557207 >> 172.21.15.5:0/3040557207 conn(0x7f7aa00b4650 msgr2=0x7f7aa00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 -- 172.21.15.5:0/3040557207 shutdown_connections 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.222+0000 7f7aa5c20640 1 -- 172.21.15.5:0/3040557207 wait complete. 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.223+0000 7f7aa5c20640 1 Processor -- start 2024-09-13T17:14:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.223+0000 7f7aa5c20640 1 -- start start 2024-09-13T17:14:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa0143740 0x7f7aa009c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 0x7f7aa01e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e2bb0 con 0x7f7aa006a5a0 2024-09-13T17:14:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e4ba0 con 0x7f7aa015aaa0 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7aa5c20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e1f30 con 0x7f7aa0143740 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51256/0 (socket says 172.21.15.5:51256) 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 -- 172.21.15.5:0/1676861267 learned_addr learned my addr 172.21.15.5:0/1676861267 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9ffff640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 0x7f7aa01e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9effd640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa0143740 0x7f7aa009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 -- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa0143740 msgr2=0x7f7aa009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa0143740 0x7f7aa009c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 -- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 msgr2=0x7f7aa01e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 0x7f7aa01e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 -- 172.21.15.5:0/1676861267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009a70 con 0x7f7aa006a5a0 2024-09-13T17:14:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9ffff640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 0x7f7aa01e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.224+0000 7f7a9f7fe640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c780 tx=0x7f7a9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.225+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900072d0 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.225+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90007450 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.225+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900047e0 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.225+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa01e2210 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.225+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa01e27d0 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.226+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa00672a0 con 0x7f7aa006a5a0 2024-09-13T17:14:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.226+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a90004960 con 0x7f7aa006a5a0 2024-09-13T17:14:10.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.227+0000 7f7a87fff640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 0x7f7a8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.227+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7a90088790 con 0x7f7aa006a5a0 2024-09-13T17:14:10.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.227+0000 7f7a9effd640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 0x7f7a8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.227+0000 7f7a9effd640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 0x7f7a8c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e3fb0 tx=0x7f7a94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.231+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7a90053640 con 0x7f7aa006a5a0 2024-09-13T17:14:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.400+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7aa00ac650 con 0x7f7aa006a5a0 2024-09-13T17:14:10.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.401+0000 7f7a87fff640 1 -- 172.21.15.5:0/1676861267 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a90018020 con 0x7f7aa006a5a0 2024-09-13T17:14:10.403 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 msgr2=0x7f7a8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 0x7f7a8c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7aa01e3fb0 tx=0x7f7a94008040 comp rx=0 tx=0).stop 2024-09-13T17:14:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 msgr2=0x7f7aa012f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c780 tx=0x7f7a9000cc40 comp rx=0 tx=0).stop 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 shutdown_connections 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7aa015aaa0 0x7f7aa01e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa0143740 0x7f7aa009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7a8c06ac00 0x7f7a8c06d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 --2- 172.21.15.5:0/1676861267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa006a5a0 0x7f7aa012f5b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.402+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 >> 172.21.15.5:0/1676861267 conn(0x7f7aa00b4650 msgr2=0x7f7aa0142950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.403+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 shutdown_connections 2024-09-13T17:14:10.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.403+0000 7f7aa5c20640 1 -- 172.21.15.5:0/1676861267 wait complete. 2024-09-13T17:14:10.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.518+0000 7fe60ce32640 1 Processor -- start 2024-09-13T17:14:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.518+0000 7fe60ce32640 1 -- start start 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60ce32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 0x7fe60815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60ce32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe60806aea0 0x7fe60806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60ce32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60806b830 con 0x7fe6080cc730 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60ce32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080b1ff0 con 0x7fe60806aea0 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60ce32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080cd470 con 0x7fe60815a060 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe606d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe60806aea0 0x7fe60806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe606d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe60806aea0 0x7fe60806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51260/0 (socket says 172.21.15.5:51260) 2024-09-13T17:14:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe606d9d640 1 -- 172.21.15.5:0/3898384445 learned_addr learned my addr 172.21.15.5:0/3898384445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.519+0000 7fe60659c640 1 --2- 172.21.15.5:0/3898384445 >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 0x7fe60815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe606d9d640 1 -- 172.21.15.5:0/3898384445 >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 msgr2=0x7fe60815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe606d9d640 1 --2- 172.21.15.5:0/3898384445 >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 0x7fe60815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe606d9d640 1 -- 172.21.15.5:0/3898384445 >> v1:172.21.15.179:6789/0 conn(0x7fe6080cc730 legacy=0x7fe6080b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe606d9d640 1 -- 172.21.15.5:0/3898384445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080cceb0 con 0x7fe60806aea0 2024-09-13T17:14:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe60659c640 1 --2- 172.21.15.5:0/3898384445 >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 0x7fe60815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.520+0000 7fe606d9d640 1 --2- 172.21.15.5:0/3898384445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe60806aea0 0x7fe60806b2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009870 tx=0x7fe5f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a2c69c44b08704 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60559a640 1 -- 172.21.15.5:0/3898384445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8032440 con 0x7fe60806aea0 2024-09-13T17:14:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60559a640 1 -- 172.21.15.5:0/3898384445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80325a0 con 0x7fe60806aea0 2024-09-13T17:14:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60559a640 1 -- 172.21.15.5:0/3898384445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8032930 con 0x7fe60806aea0 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 -- 172.21.15.5:0/3898384445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe60806aea0 msgr2=0x7fe60806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 --2- 172.21.15.5:0/3898384445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe60806aea0 0x7fe60806b2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009870 tx=0x7fe5f802a210 comp rx=0 tx=0).stop 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 -- 172.21.15.5:0/3898384445 shutdown_connections 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 --2- 172.21.15.5:0/3898384445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe60806aea0 0x7fe60806b2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 --2- 172.21.15.5:0/3898384445 >> v2:172.21.15.179:3300/0 conn(0x7fe60815a060 0x7fe60815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 -- 172.21.15.5:0/3898384445 >> 172.21.15.5:0/3898384445 conn(0x7fe608070af0 msgr2=0x7fe608070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 -- 172.21.15.5:0/3898384445 shutdown_connections 2024-09-13T17:14:10.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.521+0000 7fe60ce32640 1 -- 172.21.15.5:0/3898384445 wait complete. 2024-09-13T17:14:10.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 Processor -- start 2024-09-13T17:14:10.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 -- start start 2024-09-13T17:14:10.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60806aea0 0x7fe608140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60815a060 0x7fe6080cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608151c00 con 0x7fe6080cc730 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608141990 con 0x7fe60815a060 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.523+0000 7fe60ce32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080ac810 con 0x7fe60806aea0 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51268/0 (socket says 172.21.15.5:51268) 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 -- 172.21.15.5:0/676658226 learned_addr learned my addr 172.21.15.5:0/676658226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:10.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe60659c640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60806aea0 0x7fe608140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe606d9d640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60815a060 0x7fe6080cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 -- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60806aea0 msgr2=0x7fe608140ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60806aea0 0x7fe608140ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 -- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60815a060 msgr2=0x7fe6080cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60815a060 0x7fe6080cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 -- 172.21.15.5:0/676658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80094d0 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe605d9b640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c450 tx=0x7fe5f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00052d0 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0005430 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0012870 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6080ac250 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.524+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608141620 con 0x7fe6080cc730 2024-09-13T17:14:10.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.525+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6080672e0 con 0x7fe6080cc730 2024-09-13T17:14:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.526+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe5f00129d0 con 0x7fe6080cc730 2024-09-13T17:14:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.526+0000 7fe5feffd640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 0x7fe5e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.526+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe5f0088fb0 con 0x7fe6080cc730 2024-09-13T17:14:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.527+0000 7fe60659c640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 0x7fe5e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.527+0000 7fe60659c640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 0x7fe5e806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe600003b80 tx=0x7fe600009890 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.530+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe5f00bc9c0 con 0x7fe6080cc730 2024-09-13T17:14:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.700+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe608141b00 con 0x7fe6080cc730 2024-09-13T17:14:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.700+0000 7fe5feffd640 1 -- 172.21.15.5:0/676658226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5f0053df0 con 0x7fe6080cc730 2024-09-13T17:14:10.703 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 msgr2=0x7fe5e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 0x7fe5e806d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe600003b80 tx=0x7fe600009890 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 msgr2=0x7fe6080ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c450 tx=0x7fe5f000c910 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 shutdown_connections 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe60815a060 0x7fe6080cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5e806ac00 0x7fe5e806d0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6080cc730 0x7fe6080ab870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.702+0000 7fe60ce32640 1 --2- 172.21.15.5:0/676658226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe60806aea0 0x7fe608140ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.703+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 >> 172.21.15.5:0/676658226 conn(0x7fe608070af0 msgr2=0x7fe60815d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.703+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 shutdown_connections 2024-09-13T17:14:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.703+0000 7fe60ce32640 1 -- 172.21.15.5:0/676658226 wait complete. 2024-09-13T17:14:10.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:10.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.817+0000 7f8572dce640 1 Processor -- start 2024-09-13T17:14:10.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.817+0000 7f8572dce640 1 -- start start 2024-09-13T17:14:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f856c06eaf0 0x7f856c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f856c06eed0 0x7f856c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c160020 con 0x7f856c06eed0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0b35f0 con 0x7f856c06eaf0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8572dce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c156f50 con 0x7f856c0b1ac0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f856c06eed0 0x7f856c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f856c06eed0 0x7f856c06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51272/0 (socket says 172.21.15.5:51272) 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 -- 172.21.15.5:0/1153842338 learned_addr learned my addr 172.21.15.5:0/1153842338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f856bfff640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f8570b6a640 1 --2- 172.21.15.5:0/1153842338 >> v2:172.21.15.179:3300/0 conn(0x7f856c06eaf0 0x7f856c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 -- 172.21.15.5:0/1153842338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 msgr2=0x7f856c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 -- 172.21.15.5:0/1153842338 >> v2:172.21.15.179:3300/0 conn(0x7f856c06eaf0 msgr2=0x7f856c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 --2- 172.21.15.5:0/1153842338 >> v2:172.21.15.179:3300/0 conn(0x7f856c06eaf0 0x7f856c0b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.818+0000 7f857136b640 1 -- 172.21.15.5:0/1153842338 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0b3f60 con 0x7f856c06eed0 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.819+0000 7f857136b640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c06aea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f856c1570c0 tx=0x7f856402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c5c627bf958dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.819+0000 7f856b7fe640 1 -- 172.21.15.5:0/1153842338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856402aea0 con 0x7f856c06eed0 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.819+0000 7f856b7fe640 1 -- 172.21.15.5:0/1153842338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856402d050 con 0x7f856c06eed0 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.819+0000 7f856b7fe640 1 -- 172.21.15.5:0/1153842338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564031820 con 0x7f856c06eed0 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 -- 172.21.15.5:0/1153842338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 msgr2=0x7f856c06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c06aea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f856c1570c0 tx=0x7f856402a680 comp rx=0 tx=0).stop 2024-09-13T17:14:10.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 -- 172.21.15.5:0/1153842338 shutdown_connections 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c06aea0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 --2- 172.21.15.5:0/1153842338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 --2- 172.21.15.5:0/1153842338 >> v2:172.21.15.179:3300/0 conn(0x7f856c06eaf0 0x7f856c0b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 -- 172.21.15.5:0/1153842338 >> 172.21.15.5:0/1153842338 conn(0x7f856c070af0 msgr2=0x7f856c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 -- 172.21.15.5:0/1153842338 shutdown_connections 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.820+0000 7f8572dce640 1 -- 172.21.15.5:0/1153842338 wait complete. 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.821+0000 7f8572dce640 1 Processor -- start 2024-09-13T17:14:10.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.821+0000 7f8572dce640 1 -- start start 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f856c06eaf0 0x7f856c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c1478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15c0a0 con 0x7f856c06eed0 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15b420 con 0x7f856c06eaf0 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8572dce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15b700 con 0x7f856c0b1ac0 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f856bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f856bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51278/0 (socket says 172.21.15.5:51278) 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f856bfff640 1 -- 172.21.15.5:0/22993569 learned_addr learned my addr 172.21.15.5:0/22993569 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f8570b6a640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f856c06eaf0 0x7f856c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.822+0000 7f857136b640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c1478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 -- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 msgr2=0x7f856c1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c1478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 -- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f856c06eaf0 msgr2=0x7f856c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f856c06eaf0 0x7f856c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 -- 172.21.15.5:0/22993569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009b30 con 0x7f856c06eed0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f856bfff640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f856000d5c0 tx=0x7f856000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600125f0 con 0x7f856c06eed0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560012750 con 0x7f856c06eed0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c15b9e0 con 0x7f856c06eed0 2024-09-13T17:14:10.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560012b00 con 0x7f856c06eed0 2024-09-13T17:14:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.823+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c157d60 con 0x7f856c06eed0 2024-09-13T17:14:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.824+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c0672e0 con 0x7f856c06eed0 2024-09-13T17:14:10.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.825+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8560012c60 con 0x7f856c06eed0 2024-09-13T17:14:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.825+0000 7f85697fa640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 0x7f855806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.825+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8560089930 con 0x7f856c06eed0 2024-09-13T17:14:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.826+0000 7f8570b6a640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 0x7f855806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:10.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.826+0000 7f8570b6a640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 0x7f855806d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f855c006fd0 tx=0x7f855c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:10.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:10.829+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8560054890 con 0x7f856c06eed0 2024-09-13T17:14:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.002+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f856c0abfd0 con 0x7f856c06eed0 2024-09-13T17:14:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.002+0000 7f85697fa640 1 -- 172.21.15.5:0/22993569 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8560057eb0 con 0x7f856c06eed0 2024-09-13T17:14:11.005 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 msgr2=0x7f855806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 0x7f855806d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f855c006fd0 tx=0x7f855c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 msgr2=0x7f856c157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f856000d5c0 tx=0x7f856000da80 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 shutdown_connections 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f856c0b1ac0 0x7f856c1478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f855806ac30 0x7f855806d0f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f856c06eed0 0x7f856c157820 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 --2- 172.21.15.5:0/22993569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f856c06eaf0 0x7f856c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 >> 172.21.15.5:0/22993569 conn(0x7f856c070af0 msgr2=0x7f856c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 shutdown_connections 2024-09-13T17:14:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.004+0000 7f8572dce640 1 -- 172.21.15.5:0/22993569 wait complete. 2024-09-13T17:14:11.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:11.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.117+0000 7fbe72533640 1 Processor -- start 2024-09-13T17:14:11.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.117+0000 7fbe72533640 1 -- start start 2024-09-13T17:14:11.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe6c0adf40 0x7fbe6c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 0x7fbe6c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0b2230 0x7fbe6c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b1ac0 con 0x7fbe6c0adf40 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c15cf70 con 0x7fbe6c0ae320 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe72533640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15d210 con 0x7fbe6c0b2230 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe6c0adf40 0x7fbe6c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe6c0adf40 0x7fbe6c160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51282/0 (socket says 172.21.15.5:51282) 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 -- 172.21.15.5:0/898264304 learned_addr learned my addr 172.21.15.5:0/898264304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6b7fe640 1 --2- 172.21.15.5:0/898264304 >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 0x7fbe6c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe70ad0640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0b2230 0x7fbe6c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 -- 172.21.15.5:0/898264304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0b2230 msgr2=0x7fbe6c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0b2230 0x7fbe6c0b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 -- 172.21.15.5:0/898264304 >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 msgr2=0x7fbe6c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:11.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.118+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/898264304 >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 0x7fbe6c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6bfff640 1 -- 172.21.15.5:0/898264304 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c15d4f0 con 0x7fbe6c0adf40 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6b7fe640 1 --2- 172.21.15.5:0/898264304 >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 0x7fbe6c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0adf40 0x7fbe6c160a50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c066400 tx=0x7fbe5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937caef1ef92cac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6affd640 1 -- 172.21.15.5:0/898264304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c032440 con 0x7fbe6c0adf40 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6affd640 1 -- 172.21.15.5:0/898264304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0325a0 con 0x7fbe6c0adf40 2024-09-13T17:14:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.119+0000 7fbe6affd640 1 -- 172.21.15.5:0/898264304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c032930 con 0x7fbe6c0adf40 2024-09-13T17:14:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 -- 172.21.15.5:0/898264304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0adf40 msgr2=0x7fbe6c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0adf40 0x7fbe6c160a50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c066400 tx=0x7fbe5c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 -- 172.21.15.5:0/898264304 shutdown_connections 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0b2230 0x7fbe6c0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 --2- 172.21.15.5:0/898264304 >> v2:172.21.15.179:3300/0 conn(0x7fbe6c0ae320 0x7fbe6c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 --2- 172.21.15.5:0/898264304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0adf40 0x7fbe6c160a50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 -- 172.21.15.5:0/898264304 >> 172.21.15.5:0/898264304 conn(0x7fbe6c070af0 msgr2=0x7fbe6c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 -- 172.21.15.5:0/898264304 shutdown_connections 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.120+0000 7fbe72533640 1 -- 172.21.15.5:0/898264304 wait complete. 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.121+0000 7fbe72533640 1 Processor -- start 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.121+0000 7fbe72533640 1 -- start start 2024-09-13T17:14:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 0x7fbe6c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe6c0ae320 0x7fbe6c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c13ab80 con 0x7fbe6c0b2230 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c153f70 con 0x7fbe6c0ae320 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe72533640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1539b0 con 0x7fbe6c0adf40 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe70ad0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe70ad0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51294/0 (socket says 172.21.15.5:51294) 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe70ad0640 1 -- 172.21.15.5:0/133553445 learned_addr learned my addr 172.21.15.5:0/133553445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe6b7fe640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe6c0ae320 0x7fbe6c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.122+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 0x7fbe6c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 -- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 msgr2=0x7fbe6c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 0x7fbe6c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 -- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe6c0ae320 msgr2=0x7fbe6c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe6c0ae320 0x7fbe6c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 -- 172.21.15.5:0/133553445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0094d0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 0x7fbe6c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe70ad0640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007e60 tx=0x7fbe6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64014420 con 0x7fbe6c0b2230 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640145a0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c153c90 con 0x7fbe6c0b2230 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64014950 con 0x7fbe6c0b2230 2024-09-13T17:14:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.123+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1e5d40 con 0x7fbe6c0b2230 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.124+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0672e0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.124+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe64014ab0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.125+0000 7fbe68ff9640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.125+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe64089fa0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.125+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.126+0000 7fbe6bfff640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 0x7fbe5806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c034000 tx=0x7fbe5c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.129+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe640bd9c0 con 0x7fbe6c0b2230 2024-09-13T17:14:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.315+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe6c15ca30 con 0x7fbe6c0b2230 2024-09-13T17:14:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.315+0000 7fbe68ff9640 1 -- 172.21.15.5:0/133553445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe64058850 con 0x7fbe6c0b2230 2024-09-13T17:14:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 msgr2=0x7fbe5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 0x7fbe5806d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c034000 tx=0x7fbe5c02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 msgr2=0x7fbe6c150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007e60 tx=0x7fbe6400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 shutdown_connections 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe6c0b2230 0x7fbe6c150670 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe6c0ae320 0x7fbe6c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 --2- 172.21.15.5:0/133553445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe6c0adf40 0x7fbe6c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 >> 172.21.15.5:0/133553445 conn(0x7fbe6c070af0 msgr2=0x7fbe6c160020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 shutdown_connections 2024-09-13T17:14:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.317+0000 7fbe72533640 1 -- 172.21.15.5:0/133553445 wait complete. 2024-09-13T17:14:11.331 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:11.331 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:11.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.450+0000 7f5152f26640 1 Processor -- start 2024-09-13T17:14:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.450+0000 7f5152f26640 1 -- start start 2024-09-13T17:14:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f5152f26640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f514c15a3e0 0x7f514c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f5152f26640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06d410 con 0x7f514c06c320 2024-09-13T17:14:11.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f5152f26640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06cb70 con 0x7f514c0ab770 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f5152f26640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c06ce50 con 0x7f514c15a3e0 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f514bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f514c06c320 0x7f514c0ab060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53412/0 (socket says 172.21.15.5:53412) 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f514bfff640 1 -- 172.21.15.5:0/3578941237 learned_addr learned my addr 172.21.15.5:0/3578941237 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.451+0000 7f5150cc2640 1 --2- 172.21.15.5:0/3578941237 >> v2:172.21.15.179:3300/0 conn(0x7f514c15a3e0 0x7f514c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777937804 0 0) 0x7f514c06d410 con 0x7f514c06c320 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f513c003520 con 0x7f514c06c320 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681444773 0 0) 0x7f513c003520 con 0x7f514c06c320 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 >> v2:172.21.15.179:3300/0 conn(0x7f514c15a3e0 msgr2=0x7f514c06e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 --2- 172.21.15.5:0/3578941237 >> v2:172.21.15.179:3300/0 conn(0x7f514c15a3e0 0x7f514c06e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 >> v1:172.21.15.179:6789/0 conn(0x7f514c0ab770 legacy=0x7f514c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c06d130 con 0x7f514c06c320 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f5138001670 con 0x7f514c06c320 2024-09-13T17:14:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 >> v1:172.21.15.5:6789/0 conn(0x7f514c06c320 legacy=0x7f514c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 0x7f513c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f513c0047c0 0x7f513c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c005180 0x7f513c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c06ce50 con 0x7f513c003970 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c00c020 con 0x7f513c005180 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c00c1e0 con 0x7f513c0047c0 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 0x7f513c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f51514c3640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c005180 0x7f513c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514bfff640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f513c0047c0 0x7f513c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 -- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f513c0047c0 msgr2=0x7f513c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f513c0047c0 0x7f513c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 -- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c005180 msgr2=0x7f513c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c005180 0x7f513c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f5150cc2640 1 -- 172.21.15.5:0/3578941237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c003520 con 0x7f513c003970 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f514bfff640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f513c0047c0 0x7f513c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f51514c3640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c005180 0x7f513c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.452+0000 7f51514c3640 1 -- 172.21.15.5:0/3578941237 reap_dead start 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.453+0000 7f5150cc2640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 0x7f513c003d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5140009ac0 tx=0x7f513c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a721c7f9991b333f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.453+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140031400 con 0x7f513c003970 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.453+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514002d050 con 0x7f513c003970 2024-09-13T17:14:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.453+0000 7f514b7fe640 1 -- 172.21.15.5:0/3578941237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140031780 con 0x7f513c003970 2024-09-13T17:14:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 -- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 msgr2=0x7f513c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 0x7f513c003d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5140009ac0 tx=0x7f513c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 -- 172.21.15.5:0/3578941237 shutdown_connections 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 --2- 172.21.15.5:0/3578941237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513c003970 0x7f513c003d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 -- 172.21.15.5:0/3578941237 >> 172.21.15.5:0/3578941237 conn(0x7f514c0ce0d0 msgr2=0x7f514c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 -- 172.21.15.5:0/3578941237 shutdown_connections 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.454+0000 7f5152f26640 1 -- 172.21.15.5:0/3578941237 wait complete. 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.455+0000 7f5152f26640 1 Processor -- start 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.455+0000 7f5152f26640 1 -- start start 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c003970 0x7f514c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f514c1f27b0 0x7f514c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c15bb10 con 0x7f514c1f2330 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c15bdf0 con 0x7f513c003970 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5152f26640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c15c0d0 con 0x7f514c1f27b0 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f514bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f514bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51312/0 (socket says 172.21.15.5:51312) 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f514bfff640 1 -- 172.21.15.5:0/405481914 learned_addr learned my addr 172.21.15.5:0/405481914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.456+0000 7f5150cc2640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c003970 0x7f514c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f51514c3640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f514c1f27b0 0x7f514c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 -- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f514c1f27b0 msgr2=0x7f514c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f514c1f27b0 0x7f514c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 -- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c003970 msgr2=0x7f514c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c003970 0x7f514c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 -- 172.21.15.5:0/405481914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c15c3b0 con 0x7f514c1f2330 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f514bfff640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f513800d900 tx=0x7f513800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380074e0 con 0x7f514c1f2330 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138007640 con 0x7f514c1f2330 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c15c690 con 0x7f514c1f2330 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380049e0 con 0x7f514c1f2330 2024-09-13T17:14:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.457+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c1597f0 con 0x7f514c1f2330 2024-09-13T17:14:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.458+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0672a0 con 0x7f514c1f2330 2024-09-13T17:14:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.459+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5138004b40 con 0x7f514c1f2330 2024-09-13T17:14:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.460+0000 7f51497fa640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 0x7f513006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.460+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5138089470 con 0x7f514c1f2330 2024-09-13T17:14:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.460+0000 7f5150cc2640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 0x7f513006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.460+0000 7f5150cc2640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 0x7f513006d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5140033000 tx=0x7f5140008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.468+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51380543d0 con 0x7f514c1f2330 2024-09-13T17:14:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.641+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f514c0af8e0 con 0x7f514c1f2330 2024-09-13T17:14:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.643+0000 7f51497fa640 1 -- 172.21.15.5:0/405481914 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f51380579f0 con 0x7f514c1f2330 2024-09-13T17:14:11.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:11.646 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 msgr2=0x7f513006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 0x7f513006d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5140033000 tx=0x7f5140008030 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 msgr2=0x7f514c157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f513800d900 tx=0x7f513800ddc0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 shutdown_connections 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f514c1f27b0 0x7f514c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f513006ac00 0x7f513006d0c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514c1f2330 0x7f514c157220 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 --2- 172.21.15.5:0/405481914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f513c003970 0x7f514c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 >> 172.21.15.5:0/405481914 conn(0x7f514c0ce0d0 msgr2=0x7f514c0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 shutdown_connections 2024-09-13T17:14:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.645+0000 7f5152f26640 1 -- 172.21.15.5:0/405481914 wait complete. 2024-09-13T17:14:11.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:11.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.763+0000 7fe694526640 1 Processor -- start 2024-09-13T17:14:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.763+0000 7fe694526640 1 -- start start 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe694526640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 0x7fe68c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe694526640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0cf980 con 0x7fe68c15c6e0 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe694526640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0ce570 con 0x7fe68c1645e0 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe694526640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0d0630 con 0x7fe68c0cf000 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe6922c2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe68c15c6e0 0x7fe68c0cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53424/0 (socket says 172.21.15.5:53424) 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe6922c2640 1 -- 172.21.15.5:0/3948178282 learned_addr learned my addr 172.21.15.5:0/3948178282 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.764+0000 7fe691ac1640 1 --2- 172.21.15.5:0/3948178282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 0x7fe68c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122107815 0 0) 0x7fe68c0cf980 con 0x7fe68c15c6e0 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe678003520 con 0x7fe68c15c6e0 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770349948 0 0) 0x7fe68c0ce570 con 0x7fe68c1645e0 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe68c0cf980 con 0x7fe68c1645e0 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945491069 0 0) 0x7fe678003520 con 0x7fe68c15c6e0 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe691ac1640 1 -- 172.21.15.5:0/3948178282 >> v1:172.21.15.179:6789/0 conn(0x7fe68c1645e0 legacy=0x7fe68c1669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe691ac1640 1 -- 172.21.15.5:0/3948178282 >> v1:172.21.15.5:6789/0 conn(0x7fe68c15c6e0 legacy=0x7fe68c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.765+0000 7fe691ac1640 1 -- 172.21.15.5:0/3948178282 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0d0910 con 0x7fe68c0cf000 2024-09-13T17:14:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.766+0000 7fe691ac1640 1 --2- 172.21.15.5:0/3948178282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 0x7fe68c0cf440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe680009dc0 tx=0x7fe68002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2446177e5ca289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.766+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688001670 con 0x7fe68c0cf000 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.766+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68002d050 con 0x7fe68c0cf000 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.766+0000 7fe6912c0640 1 -- 172.21.15.5:0/3948178282 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680007760 con 0x7fe68c0cf000 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 -- 172.21.15.5:0/3948178282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 msgr2=0x7fe68c0cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 --2- 172.21.15.5:0/3948178282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 0x7fe68c0cf440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe680009dc0 tx=0x7fe68002a660 comp rx=0 tx=0).stop 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 -- 172.21.15.5:0/3948178282 shutdown_connections 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 --2- 172.21.15.5:0/3948178282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c0cf000 0x7fe68c0cf440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 -- 172.21.15.5:0/3948178282 >> 172.21.15.5:0/3948178282 conn(0x7fe68c089f90 msgr2=0x7fe68c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 -- 172.21.15.5:0/3948178282 shutdown_connections 2024-09-13T17:14:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.767+0000 7fe694526640 1 -- 172.21.15.5:0/3948178282 wait complete. 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.768+0000 7fe694526640 1 Processor -- start 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.768+0000 7fe694526640 1 -- start start 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c15c6e0 0x7fe68c0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68c1645e0 0x7fe68c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b68a0 con 0x7fe68c0cf000 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b5980 con 0x7fe68c1645e0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe694526640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b5c20 con 0x7fe68c15c6e0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51324/0 (socket says 172.21.15.5:51324) 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 -- 172.21.15.5:0/4253725844 learned_addr learned my addr 172.21.15.5:0/4253725844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe691ac1640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c15c6e0 0x7fe68c0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe692ac3640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68c1645e0 0x7fe68c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 -- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c15c6e0 msgr2=0x7fe68c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c15c6e0 0x7fe68c0b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 -- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68c1645e0 msgr2=0x7fe68c158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68c1645e0 0x7fe68c158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 -- 172.21.15.5:0/4253725844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680009a70 con 0x7fe68c0cf000 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.769+0000 7fe6922c2640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe6880010e0 tx=0x7fe68800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.770+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688005ad0 con 0x7fe68c0cf000 2024-09-13T17:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.770+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688005c30 con 0x7fe68c0cf000 2024-09-13T17:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.770+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c0b5f00 con 0x7fe68c0cf000 2024-09-13T17:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.770+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688007070 con 0x7fe68c0cf000 2024-09-13T17:14:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.770+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c0b64c0 con 0x7fe68c0cf000 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.771+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c0672e0 con 0x7fe68c0cf000 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.771+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6880071d0 con 0x7fe68c0cf000 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.772+0000 7fe67effd640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 0x7fe67006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.772+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe688088d90 con 0x7fe68c0cf000 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.772+0000 7fe691ac1640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 0x7fe67006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.773+0000 7fe691ac1640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 0x7fe67006d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe680034000 tx=0x7fe68002f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.776+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe688053c60 con 0x7fe68c0cf000 2024-09-13T17:14:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.948+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe68c15cac0 con 0x7fe68c0cf000 2024-09-13T17:14:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.949+0000 7fe67effd640 1 -- 172.21.15.5:0/4253725844 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe688017070 con 0x7fe68c0cf000 2024-09-13T17:14:11.951 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 msgr2=0x7fe67006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 0x7fe67006d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe680034000 tx=0x7fe68002f000 comp rx=0 tx=0).stop 2024-09-13T17:14:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 msgr2=0x7fe68c15dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe6880010e0 tx=0x7fe68800cb70 comp rx=0 tx=0).stop 2024-09-13T17:14:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 shutdown_connections 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68c1645e0 0x7fe68c158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68c15c6e0 0x7fe68c0b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe67006ac30 0x7fe67006d0f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 --2- 172.21.15.5:0/4253725844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68c0cf000 0x7fe68c15dbf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 >> 172.21.15.5:0/4253725844 conn(0x7fe68c089f90 msgr2=0x7fe68c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 shutdown_connections 2024-09-13T17:14:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:11.951+0000 7fe694526640 1 -- 172.21.15.5:0/4253725844 wait complete. 2024-09-13T17:14:11.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.067+0000 7fb9fd041640 1 Processor -- start 2024-09-13T17:14:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.067+0000 7fb9fd041640 1 -- start start 2024-09-13T17:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9fd041640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9fd041640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 0x7fb9f80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9fd041640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f80ad050 con 0x7fb9f806da30 2024-09-13T17:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9fd041640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80ac440 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9fd041640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ac720 con 0x7fb9f81591e0 2024-09-13T17:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9f6d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9f6d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:57416/0 (socket says 172.21.15.5:57416) 2024-09-13T17:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.068+0000 7fb9f6d9d640 1 -- 172.21.15.5:0/1213880276 learned_addr learned my addr 172.21.15.5:0/1213880276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f659c640 1 --2- 172.21.15.5:0/1213880276 >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 0x7fb9f80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f6d9d640 1 -- 172.21.15.5:0/1213880276 >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 msgr2=0x7fb9f80b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/1213880276 >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 0x7fb9f80b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f6d9d640 1 -- 172.21.15.5:0/1213880276 >> v1:172.21.15.179:6789/0 conn(0x7fb9f806da30 legacy=0x7fb9f80700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f6d9d640 1 -- 172.21.15.5:0/1213880276 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80aca00 con 0x7fb9f81591e0 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.069+0000 7fb9f659c640 1 --2- 172.21.15.5:0/1213880276 >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 0x7fb9f80b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/1213880276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009870 tx=0x7fb9e802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a23663abb8bc45a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9f5d9b640 1 -- 172.21.15.5:0/1213880276 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8032440 con 0x7fb9f81591e0 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9f5d9b640 1 -- 172.21.15.5:0/1213880276 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e80325a0 con 0x7fb9f81591e0 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9f5d9b640 1 -- 172.21.15.5:0/1213880276 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8032930 con 0x7fb9f81591e0 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 -- 172.21.15.5:0/1213880276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 msgr2=0x7fb9f80abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 --2- 172.21.15.5:0/1213880276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009870 tx=0x7fb9e802a270 comp rx=0 tx=0).stop 2024-09-13T17:14:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 -- 172.21.15.5:0/1213880276 shutdown_connections 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 --2- 172.21.15.5:0/1213880276 >> v2:172.21.15.179:3300/0 conn(0x7fb9f80ad4e0 0x7fb9f80b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 --2- 172.21.15.5:0/1213880276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f80abe60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.070+0000 7fb9fd041640 1 -- 172.21.15.5:0/1213880276 >> 172.21.15.5:0/1213880276 conn(0x7fb9f80ce130 msgr2=0x7fb9f80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.071+0000 7fb9fd041640 1 -- 172.21.15.5:0/1213880276 shutdown_connections 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.071+0000 7fb9fd041640 1 -- 172.21.15.5:0/1213880276 wait complete. 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.072+0000 7fb9fd041640 1 Processor -- start 2024-09-13T17:14:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.072+0000 7fb9fd041640 1 -- start start 2024-09-13T17:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 0x7fb9f81f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f809a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81f0ed0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80988f0 con 0x7fb9f806da30 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9fd041640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8098bd0 con 0x7fb9f81591e0 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51330/0 (socket says 172.21.15.5:51330) 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 -- 172.21.15.5:0/3263195748 learned_addr learned my addr 172.21.15.5:0/3263195748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 0x7fb9f81f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f759e640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f809a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 -- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 msgr2=0x7fb9f809a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f809a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 -- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 msgr2=0x7fb9f81f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 0x7fb9f81f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f659c640 1 -- 172.21.15.5:0/3263195748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80094d0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.073+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 0x7fb9f81f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9f659c640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e7e0 tx=0x7fb9ec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00c8d0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00ee90 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f8098eb0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00cc70 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.074+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f8099470 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.075+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f80672a0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.075+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9ec013410 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.076+0000 7fb9df7fe640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 0x7fb9e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.076+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb9ec089470 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.076+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 0x7fb9e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.077+0000 7fb9f6d9d640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 0x7fb9e406d0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8034000 tx=0x7fb9e802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.080+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb9ec054290 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:14:12.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:14:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.273+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9f8098640 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.273+0000 7fb9df7fe640 1 -- 172.21.15.5:0/3263195748 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9ec0578b0 con 0x7fb9f80ad4e0 2024-09-13T17:14:12.275 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 msgr2=0x7fb9e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 0x7fb9e406d0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8034000 tx=0x7fb9e802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 msgr2=0x7fb9f80cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e7e0 tx=0x7fb9ec00eca0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 shutdown_connections 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9f81591e0 0x7fb9f809a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9e406ac30 0x7fb9e406d0f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f80ad4e0 0x7fb9f80cd780 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 --2- 172.21.15.5:0/3263195748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9f806da30 0x7fb9f81f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 >> 172.21.15.5:0/3263195748 conn(0x7fb9f80ce130 msgr2=0x7fb9f80ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 shutdown_connections 2024-09-13T17:14:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.275+0000 7fb9fd041640 1 -- 172.21.15.5:0/3263195748 wait complete. 2024-09-13T17:14:12.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.391+0000 7f64af5b5640 1 Processor -- start 2024-09-13T17:14:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.391+0000 7f64af5b5640 1 -- start start 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64af5b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64a815c6e0 0x7f64a80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64af5b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 0x7f64a81609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64af5b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a80d0630 con 0x7f64a80cf000 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64af5b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a80d0910 con 0x7f64a815c6e0 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64af5b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80d0bf0 con 0x7f64a80cf440 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64ad351640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64a815c6e0 0x7f64a80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64ad351640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64a815c6e0 0x7f64a80cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:36262/0 (socket says 172.21.15.5:36262) 2024-09-13T17:14:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64acb50640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f64a80cf000 0x7f64a81602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:43658/0 (socket says 172.21.15.5:43658) 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64ad351640 1 -- 172.21.15.5:0/1093361690 learned_addr learned my addr 172.21.15.5:0/1093361690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.392+0000 7f64adb52640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 0x7f64a81609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64ad351640 1 -- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 msgr2=0x7f64a81609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64ad351640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 0x7f64a81609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64ad351640 1 -- 172.21.15.5:0/1093361690 >> v1:172.21.15.179:6789/0 conn(0x7f64a80cf000 legacy=0x7f64a81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64ad351640 1 -- 172.21.15.5:0/1093361690 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80d0ed0 con 0x7f64a815c6e0 2024-09-13T17:14:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64adb52640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 0x7f64a81609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.393+0000 7f64ad351640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a815c6e0 0x7f64a80cde60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009870 tx=0x7f64a402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3834f081d660c888 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f649bfff640 1 -- 172.21.15.5:0/1093361690 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4032440 con 0x7f64a815c6e0 2024-09-13T17:14:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f649bfff640 1 -- 172.21.15.5:0/1093361690 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a40325a0 con 0x7f64a815c6e0 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f649bfff640 1 -- 172.21.15.5:0/1093361690 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4032930 con 0x7f64a815c6e0 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 -- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a815c6e0 msgr2=0x7f64a80cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a815c6e0 0x7f64a80cde60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009870 tx=0x7f64a402a250 comp rx=0 tx=0).stop 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 -- 172.21.15.5:0/1093361690 shutdown_connections 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a80cf440 0x7f64a81609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 --2- 172.21.15.5:0/1093361690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a815c6e0 0x7f64a80cde60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 -- 172.21.15.5:0/1093361690 >> 172.21.15.5:0/1093361690 conn(0x7f64a8089f90 msgr2=0x7f64a80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 -- 172.21.15.5:0/1093361690 shutdown_connections 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.394+0000 7f64af5b5640 1 -- 172.21.15.5:0/1093361690 wait complete. 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 Processor -- start 2024-09-13T17:14:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 -- start start 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a80cf000 0x7f64a815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a815c6e0 0x7f64a815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80b7670 con 0x7f64a80cf440 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a815f710 con 0x7f64a80cf000 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64af5b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80c9d10 con 0x7f64a815c6e0 2024-09-13T17:14:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64acb50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64acb50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51342/0 (socket says 172.21.15.5:51342) 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.396+0000 7f64acb50640 1 -- 172.21.15.5:0/3300565116 learned_addr learned my addr 172.21.15.5:0/3300565116 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64adb52640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a815c6e0 0x7f64a815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64ad351640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a80cf000 0x7f64a815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 -- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a815c6e0 msgr2=0x7f64a815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a815c6e0 0x7f64a815cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 -- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a80cf000 msgr2=0x7f64a815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a80cf000 0x7f64a815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 -- 172.21.15.5:0/3300565116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a0009a70 con 0x7f64a80cf440 2024-09-13T17:14:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64acb50640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c480 tx=0x7f649c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c0074e0 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c007660 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a40094d0 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c004a20 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.397+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a815fc20 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.398+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a815fdb0 con 0x7f64a80cf440 2024-09-13T17:14:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.399+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f649c004b80 con 0x7f64a80cf440 2024-09-13T17:14:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.399+0000 7f6499ffb640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 0x7f648c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.399+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f649c089000 con 0x7f64a80cf440 2024-09-13T17:14:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.400+0000 7f64ad351640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 0x7f648c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.400+0000 7f64ad351640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 0x7f648c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64a4034000 tx=0x7f64a402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.404+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f649c053e20 con 0x7f64a80cf440 2024-09-13T17:14:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.578+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64a80672e0 con 0x7f64a80cf440 2024-09-13T17:14:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.578+0000 7f6499ffb640 1 -- 172.21.15.5:0/3300565116 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f649c057440 con 0x7f64a80cf440 2024-09-13T17:14:12.581 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 msgr2=0x7f648c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 0x7f648c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64a4034000 tx=0x7f64a402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 msgr2=0x7f64a815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c480 tx=0x7f649c00c880 comp rx=0 tx=0).stop 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 shutdown_connections 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64a815c6e0 0x7f64a815cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648c06ac00 0x7f648c06d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a80cf440 0x7f64a815f1d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 --2- 172.21.15.5:0/3300565116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64a80cf000 0x7f64a815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 >> 172.21.15.5:0/3300565116 conn(0x7f64a8089f90 msgr2=0x7f64a81e6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 shutdown_connections 2024-09-13T17:14:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.581+0000 7f64af5b5640 1 -- 172.21.15.5:0/3300565116 wait complete. 2024-09-13T17:14:12.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.697+0000 7f5921318640 1 Processor -- start 2024-09-13T17:14:12.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 -- start start 2024-09-13T17:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 0x7f591c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f591c06da30 0x7f591c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c0ad050 con 0x7f591c1591e0 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c06e420 con 0x7f591c06da30 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.698+0000 7f5921318640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0ac440 con 0x7f591c0abe60 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f591c06da30 0x7f591c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f591c06da30 0x7f591c06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51344/0 (socket says 172.21.15.5:51344) 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 -- 172.21.15.5:0/1817742639 learned_addr learned my addr 172.21.15.5:0/1817742639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591a7fc640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 0x7f591c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 -- 172.21.15.5:0/1817742639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 msgr2=0x7f591c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 0x7f591c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 -- 172.21.15.5:0/1817742639 >> v1:172.21.15.179:6789/0 conn(0x7f591c1591e0 legacy=0x7f591c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591b7fe640 1 -- 172.21.15.5:0/1817742639 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0ac720 con 0x7f591c06da30 2024-09-13T17:14:12.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.699+0000 7f591a7fc640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 0x7f591c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f591b7fe640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c06dee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5914009e50 tx=0x7f591402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1f451aed692407 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f5919ffb640 1 -- 172.21.15.5:0/1817742639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914031600 con 0x7f591c06da30 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f5919ffb640 1 -- 172.21.15.5:0/1817742639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591402d050 con 0x7f591c06da30 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f5919ffb640 1 -- 172.21.15.5:0/1817742639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914031980 con 0x7f591c06da30 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f5921318640 1 -- 172.21.15.5:0/1817742639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 msgr2=0x7f591c06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.700+0000 7f5921318640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c06dee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5914009e50 tx=0x7f591402a710 comp rx=0 tx=0).stop 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 -- 172.21.15.5:0/1817742639 shutdown_connections 2024-09-13T17:14:12.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c06dee0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 --2- 172.21.15.5:0/1817742639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c0abe60 0x7f591c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 -- 172.21.15.5:0/1817742639 >> 172.21.15.5:0/1817742639 conn(0x7f591c0ce130 msgr2=0x7f591c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 -- 172.21.15.5:0/1817742639 shutdown_connections 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.701+0000 7f5921318640 1 -- 172.21.15.5:0/1817742639 wait complete. 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.702+0000 7f5921318640 1 Processor -- start 2024-09-13T17:14:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.702+0000 7f5921318640 1 -- start start 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f591c0abe60 0x7f591c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c1591e0 0x7f591c071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c14cda0 con 0x7f591c06da30 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c14bb50 con 0x7f591c0abe60 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f5921318640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c156a20 con 0x7f591c1591e0 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51352/0 (socket says 172.21.15.5:51352) 2024-09-13T17:14:12.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 -- 172.21.15.5:0/1403680459 learned_addr learned my addr 172.21.15.5:0/1403680459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591a7fc640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f591c0abe60 0x7f591c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591b7fe640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c1591e0 0x7f591c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 -- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c1591e0 msgr2=0x7f591c071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c1591e0 0x7f591c071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 -- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f591c0abe60 msgr2=0x7f591c14b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f591c0abe60 0x7f591c14b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 -- 172.21.15.5:0/1403680459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914009b30 con 0x7f591c06da30 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f591affd640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c400 tx=0x7f590c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.703+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0052d0 con 0x7f591c06da30 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.704+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c005430 con 0x7f591c06da30 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.704+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c156d00 con 0x7f591c06da30 2024-09-13T17:14:12.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.704+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c003830 con 0x7f591c06da30 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.704+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c1572c0 con 0x7f591c06da30 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.705+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c0672a0 con 0x7f591c06da30 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.705+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f590c003990 con 0x7f591c06da30 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.706+0000 7f59037fe640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 0x7f590806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.706+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f590c088be0 con 0x7f591c06da30 2024-09-13T17:14:12.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.706+0000 7f591a7fc640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 0x7f590806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.706+0000 7f591a7fc640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 0x7f590806d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f591c1f3560 tx=0x7f5910008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.710+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f590c053ab0 con 0x7f591c06da30 2024-09-13T17:14:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.880+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f591c06dee0 con 0x7f591c06da30 2024-09-13T17:14:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.880+0000 7f59037fe640 1 -- 172.21.15.5:0/1403680459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f590c0170a0 con 0x7f591c06da30 2024-09-13T17:14:12.883 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 msgr2=0x7f590806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 0x7f590806d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f591c1f3560 tx=0x7f5910008040 comp rx=0 tx=0).stop 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 msgr2=0x7f591c14c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c400 tx=0x7f590c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 shutdown_connections 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f591c1591e0 0x7f591c071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f591c0abe60 0x7f591c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f590806ac00 0x7f590806d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 --2- 172.21.15.5:0/1403680459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f591c06da30 0x7f591c14c860 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 >> 172.21.15.5:0/1403680459 conn(0x7f591c0ce130 msgr2=0x7f591c0aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 shutdown_connections 2024-09-13T17:14:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.883+0000 7f5921318640 1 -- 172.21.15.5:0/1403680459 wait complete. 2024-09-13T17:14:12.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.996+0000 7f76a343a640 1 Processor -- start 2024-09-13T17:14:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.997+0000 7f76a343a640 1 -- start start 2024-09-13T17:14:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.997+0000 7f76a343a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f769c06e1c0 0x7f769c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a343a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0b2390 con 0x7f769c156f40 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a343a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c15a700 con 0x7f769c15a290 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a343a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0b1780 con 0x7f769c06e1c0 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a11d6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f769c156f40 0x7f769c06dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53426/0 (socket says 172.21.15.5:53426) 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a11d6640 1 -- 172.21.15.5:0/1595090258 learned_addr learned my addr 172.21.15.5:0/1595090258 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a09d5640 1 --2- 172.21.15.5:0/1595090258 >> v2:172.21.15.179:3300/0 conn(0x7f769c06e1c0 0x7f769c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427457795 0 0) 0x7f769c0b2390 con 0x7f769c156f40 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7688005730 con 0x7f769c156f40 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273126622 0 0) 0x7f7694001490 con 0x7f769c15a290 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c0b2390 con 0x7f769c15a290 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a09d5640 1 -- 172.21.15.5:0/1595090258 >> v1:172.21.15.179:6789/0 conn(0x7f769c15a290 legacy=0x7f769c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a09d5640 1 -- 172.21.15.5:0/1595090258 >> v1:172.21.15.5:6789/0 conn(0x7f769c156f40 legacy=0x7f769c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954085828 0 0) 0x7f7688005730 con 0x7f769c156f40 2024-09-13T17:14:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.998+0000 7f76a09d5640 1 -- 172.21.15.5:0/1595090258 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0b1a60 con 0x7f769c06e1c0 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.999+0000 7f76a09d5640 1 --2- 172.21.15.5:0/1595090258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c06e1c0 0x7f769c0aced0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18f16026ba2157c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.999+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698001670 con 0x7f769c06e1c0 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.999+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c02ac50 con 0x7f769c06e1c0 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:12.999+0000 7f7693fff640 1 -- 172.21.15.5:0/1595090258 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c032440 con 0x7f769c06e1c0 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 -- 172.21.15.5:0/1595090258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c06e1c0 msgr2=0x7f769c0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 --2- 172.21.15.5:0/1595090258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c06e1c0 0x7f769c0aced0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 -- 172.21.15.5:0/1595090258 shutdown_connections 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 --2- 172.21.15.5:0/1595090258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c06e1c0 0x7f769c0aced0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 -- 172.21.15.5:0/1595090258 >> 172.21.15.5:0/1595090258 conn(0x7f769c0ce0d0 msgr2=0x7f769c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 -- 172.21.15.5:0/1595090258 shutdown_connections 2024-09-13T17:14:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.000+0000 7f76a343a640 1 -- 172.21.15.5:0/1595090258 wait complete. 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.001+0000 7f76a343a640 1 Processor -- start 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.001+0000 7f76a343a640 1 -- start start 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c156f40 0x7f769c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c15a290 0x7f769c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c14e1e0 con 0x7f769c06e1c0 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0add20 con 0x7f769c15a290 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a343a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0ae000 con 0x7f769c156f40 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51362/0 (socket says 172.21.15.5:51362) 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 -- 172.21.15.5:0/1750280848 learned_addr learned my addr 172.21.15.5:0/1750280848 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a09d5640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c156f40 0x7f769c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a19d7640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c15a290 0x7f769c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 -- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c156f40 msgr2=0x7f769c14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c156f40 0x7f769c14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 -- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c15a290 msgr2=0x7f769c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c15a290 0x7f769c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.002+0000 7f76a11d6640 1 -- 172.21.15.5:0/1750280848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c009400 con 0x7f769c06e1c0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f76a11d6640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f76980010e0 tx=0x7f769800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698005ad0 con 0x7f769c06e1c0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698005c30 con 0x7f769c06e1c0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c0ae2e0 con 0x7f769c06e1c0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698007070 con 0x7f769c06e1c0 2024-09-13T17:14:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.003+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c14dd60 con 0x7f769c06e1c0 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.004+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c14dfb0 con 0x7f769c06e1c0 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.004+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f76980071d0 con 0x7f769c06e1c0 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.005+0000 7f7691ffb640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 0x7f768006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.005+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7698088d30 con 0x7f769c06e1c0 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.005+0000 7f76a09d5640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 0x7f768006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.006+0000 7f76a09d5640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 0x7f768006d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.009+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7698053c90 con 0x7f769c06e1c0 2024-09-13T17:14:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.190+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f769c0672a0 con 0x7f769c06e1c0 2024-09-13T17:14:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.190+0000 7f7691ffb640 1 -- 172.21.15.5:0/1750280848 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7698017070 con 0x7f769c06e1c0 2024-09-13T17:14:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 msgr2=0x7f768006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 0x7f768006d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 msgr2=0x7f769c1f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f76980010e0 tx=0x7f769800cb70 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 shutdown_connections 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f769c15a290 0x7f769c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f769c156f40 0x7f769c14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f768006ac00 0x7f768006d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 --2- 172.21.15.5:0/1750280848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769c06e1c0 0x7f769c1f55f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 >> 172.21.15.5:0/1750280848 conn(0x7f769c0ce0d0 msgr2=0x7f769c06d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 shutdown_connections 2024-09-13T17:14:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.192+0000 7f76a343a640 1 -- 172.21.15.5:0/1750280848 wait complete. 2024-09-13T17:14:13.205 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:14:13.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:13.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-13T17:14:13.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:13.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:14:13.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:13.233 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:14:13.288 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:14:13.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.388+0000 7f95b90b1640 1 Processor -- start 2024-09-13T17:14:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.388+0000 7f95b90b1640 1 -- start start 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b90b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95b415c810 0x7f95b40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b90b1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 0x7f95b40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b90b1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40d1e80 con 0x7f95b40d06d0 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b90b1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40d1750 con 0x7f95b415c810 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b90b1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40d0bd0 con 0x7f95b40b4cf0 2024-09-13T17:14:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95b415c810 0x7f95b40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95b415c810 0x7f95b40cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33256/0 (socket says 172.21.15.5:33256) 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b2d9d640 1 -- 172.21.15.5:0/3955800929 learned_addr learned my addr 172.21.15.5:0/3955800929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.389+0000 7f95b359e640 1 --2- 172.21.15.5:0/3955800929 >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 0x7f95b40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b2d9d640 1 -- 172.21.15.5:0/3955800929 >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 msgr2=0x7f95b40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b2d9d640 1 --2- 172.21.15.5:0/3955800929 >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 0x7f95b40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b2d9d640 1 -- 172.21.15.5:0/3955800929 >> v1:172.21.15.179:6789/0 conn(0x7f95b40d06d0 legacy=0x7f95b40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b2d9d640 1 -- 172.21.15.5:0/3955800929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40d0eb0 con 0x7f95b415c810 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b359e640 1 --2- 172.21.15.5:0/3955800929 >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 0x7f95b40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b2d9d640 1 --2- 172.21.15.5:0/3955800929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b415c810 0x7f95b40cd780 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f95b40b5600 tx=0x7f95a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40680765d9dc5c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.390+0000 7f95b1d9b640 1 -- 172.21.15.5:0/3955800929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032440 con 0x7f95b415c810 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b1d9b640 1 -- 172.21.15.5:0/3955800929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a40325a0 con 0x7f95b415c810 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b1d9b640 1 -- 172.21.15.5:0/3955800929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032930 con 0x7f95b415c810 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 -- 172.21.15.5:0/3955800929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b415c810 msgr2=0x7f95b40cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 --2- 172.21.15.5:0/3955800929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b415c810 0x7f95b40cd780 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f95b40b5600 tx=0x7f95a402a270 comp rx=0 tx=0).stop 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 -- 172.21.15.5:0/3955800929 shutdown_connections 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 --2- 172.21.15.5:0/3955800929 >> v2:172.21.15.179:3300/0 conn(0x7f95b40b4cf0 0x7f95b40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 --2- 172.21.15.5:0/3955800929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b415c810 0x7f95b40cd780 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 -- 172.21.15.5:0/3955800929 >> 172.21.15.5:0/3955800929 conn(0x7f95b40717a0 msgr2=0x7f95b4071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 -- 172.21.15.5:0/3955800929 shutdown_connections 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.391+0000 7f95b90b1640 1 -- 172.21.15.5:0/3955800929 wait complete. 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 Processor -- start 2024-09-13T17:14:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 -- start start 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b40d06d0 0x7f95b40c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b415c810 0x7f95b40c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c73b0 con 0x7f95b40b4cf0 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41567b0 con 0x7f95b40d06d0 2024-09-13T17:14:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b90b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41f1ba0 con 0x7f95b415c810 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33272/0 (socket says 172.21.15.5:33272) 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.393+0000 7f95b2d9d640 1 -- 172.21.15.5:0/2797345950 learned_addr learned my addr 172.21.15.5:0/2797345950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b259c640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b40d06d0 0x7f95b40c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b359e640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b415c810 0x7f95b40c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 -- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b415c810 msgr2=0x7f95b40c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b415c810 0x7f95b40c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 -- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b40d06d0 msgr2=0x7f95b40c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b40d06d0 0x7f95b40c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 -- 172.21.15.5:0/2797345950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094d0 con 0x7f95b40b4cf0 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b2d9d640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95a402a2b0 tx=0x7f95a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032440 con 0x7f95b40b4cf0 2024-09-13T17:14:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4030ba0 con 0x7f95b40b4cf0 2024-09-13T17:14:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40c7650 con 0x7f95b40b4cf0 2024-09-13T17:14:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a403d440 con 0x7f95b40b4cf0 2024-09-13T17:14:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.394+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b40c7c10 con 0x7f95b40b4cf0 2024-09-13T17:14:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.395+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40672a0 con 0x7f95b40b4cf0 2024-09-13T17:14:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.396+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95a4039040 con 0x7f95b40b4cf0 2024-09-13T17:14:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.396+0000 7f959b7fe640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 0x7f95a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.396+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95a40aa110 con 0x7f95b40b4cf0 2024-09-13T17:14:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.396+0000 7f95b259c640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 0x7f95a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.397+0000 7f95b259c640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 0x7f95a006d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95b415e840 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.400+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f95a4075070 con 0x7f95b40b4cf0 2024-09-13T17:14:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.607+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b40b5a90 con 0x7f95b40b4cf0 2024-09-13T17:14:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.608+0000 7f959b7fe640 1 -- 172.21.15.5:0/2797345950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7f95a4078690 con 0x7f95b40b4cf0 2024-09-13T17:14:13.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:13.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:14:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:14:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 msgr2=0x7f95a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 0x7f95a006d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95b415e840 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2024-09-13T17:14:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 msgr2=0x7f95b40c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95a402a2b0 tx=0x7f95a40046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 shutdown_connections 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95b415c810 0x7f95b40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b40d06d0 0x7f95b40c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f95a006ac00 0x7f95a006d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 --2- 172.21.15.5:0/2797345950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b40b4cf0 0x7f95b40c9b80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 >> 172.21.15.5:0/2797345950 conn(0x7f95b40717a0 msgr2=0x7f95b40d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 shutdown_connections 2024-09-13T17:14:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.610+0000 7f95b90b1640 1 -- 172.21.15.5:0/2797345950 wait complete. 2024-09-13T17:14:13.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.723+0000 7f387a51f640 1 Processor -- start 2024-09-13T17:14:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.723+0000 7f387a51f640 1 -- start start 2024-09-13T17:14:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f387a51f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f387415fd80 0x7f38740cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f387a51f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 0x7f387406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f387a51f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740704a0 con 0x7f38740d0e30 2024-09-13T17:14:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f387a51f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387406cc10 con 0x7f387415fd80 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f387a51f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387406bd80 con 0x7f3874099110 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3873fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f387415fd80 0x7f38740cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f38737fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38740d0e30 0x7f3874098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45832/0 (socket says 172.21.15.5:45832) 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f38737fe640 1 -- 172.21.15.5:0/630748111 learned_addr learned my addr 172.21.15.5:0/630748111 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3878abc640 1 --2- 172.21.15.5:0/630748111 >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 0x7f387406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3873fff640 1 -- 172.21.15.5:0/630748111 >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 msgr2=0x7f387406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3873fff640 1 --2- 172.21.15.5:0/630748111 >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 0x7f387406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3873fff640 1 -- 172.21.15.5:0/630748111 >> v1:172.21.15.5:6789/0 conn(0x7f38740d0e30 legacy=0x7f3874098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3873fff640 1 -- 172.21.15.5:0/630748111 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740d1270 con 0x7f387415fd80 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3872ffd640 1 -- 172.21.15.5:0/630748111 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219910854 0 0) 0x7f38740704a0 con 0x7f38740d0e30 2024-09-13T17:14:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.724+0000 7f3878abc640 1 --2- 172.21.15.5:0/630748111 >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 0x7f387406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f3873fff640 1 --2- 172.21.15.5:0/630748111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415fd80 0x7f38740cfd30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3874071b10 tx=0x7f386402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc1ce6146a1ecdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f3872ffd640 1 -- 172.21.15.5:0/630748111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386402ae60 con 0x7f387415fd80 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f3872ffd640 1 -- 172.21.15.5:0/630748111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f387415fd80 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f3872ffd640 1 -- 172.21.15.5:0/630748111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640327d0 con 0x7f387415fd80 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f387a51f640 1 -- 172.21.15.5:0/630748111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415fd80 msgr2=0x7f38740cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.725+0000 7f387a51f640 1 --2- 172.21.15.5:0/630748111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415fd80 0x7f38740cfd30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3874071b10 tx=0x7f386402a110 comp rx=0 tx=0).stop 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 -- 172.21.15.5:0/630748111 shutdown_connections 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 --2- 172.21.15.5:0/630748111 >> v2:172.21.15.179:3300/0 conn(0x7f3874099110 0x7f387406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 --2- 172.21.15.5:0/630748111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387415fd80 0x7f38740cfd30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 -- 172.21.15.5:0/630748111 >> 172.21.15.5:0/630748111 conn(0x7f38740d0310 msgr2=0x7f38740d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 -- 172.21.15.5:0/630748111 shutdown_connections 2024-09-13T17:14:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.726+0000 7f387a51f640 1 -- 172.21.15.5:0/630748111 wait complete. 2024-09-13T17:14:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.727+0000 7f387a51f640 1 Processor -- start 2024-09-13T17:14:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.727+0000 7f387a51f640 1 -- start start 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740d0e30 0x7f387409cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f387415fd80 0x7f387409d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740ae310 con 0x7f3874099110 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387409c230 con 0x7f387415fd80 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387415be30 con 0x7f38740d0e30 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33288/0 (socket says 172.21.15.5:33288) 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 -- 172.21.15.5:0/2451723972 learned_addr learned my addr 172.21.15.5:0/2451723972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3878abc640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f387415fd80 0x7f387409d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f38737fe640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740d0e30 0x7f387409cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 -- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740d0e30 msgr2=0x7f387409cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740d0e30 0x7f387409cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 -- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f387415fd80 msgr2=0x7f387409d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f387415fd80 0x7f387409d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 -- 172.21.15.5:0/2451723972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864009400 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3873fff640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f38640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640308d0 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864030a50 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387409c7b0 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.728+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864030e00 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.729+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38740ae030 con 0x7f3874099110 2024-09-13T17:14:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.730+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38740cfa60 con 0x7f3874099110 2024-09-13T17:14:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.730+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3864039040 con 0x7f3874099110 2024-09-13T17:14:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.730+0000 7f3870ff9640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 0x7f386006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.730+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38640aa1e0 con 0x7f3874099110 2024-09-13T17:14:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.731+0000 7f38737fe640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 0x7f386006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.731+0000 7f38737fe640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 0x7f386006d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38740c6f10 tx=0x7f3868007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.734+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3864075140 con 0x7f3874099110 2024-09-13T17:14:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.907+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f387406cf90 con 0x7f3874099110 2024-09-13T17:14:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.909+0000 7f3870ff9640 1 -- 172.21.15.5:0/2451723972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f3864078760 con 0x7f3874099110 2024-09-13T17:14:13.911 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:13.911 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 msgr2=0x7f386006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 0x7f386006d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38740c6f10 tx=0x7f3868007d50 comp rx=0 tx=0).stop 2024-09-13T17:14:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 msgr2=0x7f387415b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f38640046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 shutdown_connections 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f387415fd80 0x7f387409d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740d0e30 0x7f387409cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f386006ac30 0x7f386006d0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 --2- 172.21.15.5:0/2451723972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3874099110 0x7f387415b8f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 >> 172.21.15.5:0/2451723972 conn(0x7f38740d0310 msgr2=0x7f38740b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 shutdown_connections 2024-09-13T17:14:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:13.911+0000 7f387a51f640 1 -- 172.21.15.5:0/2451723972 wait complete. 2024-09-13T17:14:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:13:06.616552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:13:07.133056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:13:10.212716+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:14:13.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.026+0000 7f38798f7640 1 Processor -- start 2024-09-13T17:14:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.027+0000 7f38798f7640 1 -- start start 2024-09-13T17:14:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.027+0000 7f38798f7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38740adf40 0x7f3874160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38798f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 0x7f387415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38798f7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740b1ac0 con 0x7f38740b2230 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38798f7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387415cf70 con 0x7f38740adf40 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38798f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387415d210 con 0x7f38740ae320 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38727fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 0x7f387415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3872ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38740adf40 0x7f3874160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38737fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f38740b2230 0x7f387406df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:43230/0 (socket says 172.21.15.5:43230) 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38737fe640 1 -- 172.21.15.5:0/3150912356 learned_addr learned my addr 172.21.15.5:0/3150912356 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3871ffb640 1 -- 172.21.15.5:0/3150912356 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674215883 0 0) 0x7f38740b1ac0 con 0x7f38740b2230 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3871ffb640 1 -- 172.21.15.5:0/3150912356 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3860003520 con 0x7f38740b2230 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3872ffd640 1 -- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 msgr2=0x7f387415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3872ffd640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 0x7f387415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3872ffd640 1 -- 172.21.15.5:0/3150912356 >> v1:172.21.15.179:6789/0 conn(0x7f38740b2230 legacy=0x7f387406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f3872ffd640 1 -- 172.21.15.5:0/3150912356 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387415d4f0 con 0x7f38740adf40 2024-09-13T17:14:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.028+0000 7f38727fc640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 0x7f387415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.029+0000 7f3872ffd640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740adf40 0x7f3874160a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f386402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47da553c7ebbe94a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.029+0000 7f3871ffb640 1 -- 172.21.15.5:0/3150912356 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864007740 con 0x7f38740adf40 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.029+0000 7f3871ffb640 1 -- 172.21.15.5:0/3150912356 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386402d050 con 0x7f38740adf40 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.029+0000 7f3871ffb640 1 -- 172.21.15.5:0/3150912356 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864007ac0 con 0x7f38740adf40 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 -- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740adf40 msgr2=0x7f3874160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740adf40 0x7f3874160a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f386402a660 comp rx=0 tx=0).stop 2024-09-13T17:14:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 -- 172.21.15.5:0/3150912356 shutdown_connections 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740ae320 0x7f387415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 --2- 172.21.15.5:0/3150912356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740adf40 0x7f3874160a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 -- 172.21.15.5:0/3150912356 >> 172.21.15.5:0/3150912356 conn(0x7f3874070af0 msgr2=0x7f3874070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 -- 172.21.15.5:0/3150912356 shutdown_connections 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.030+0000 7f38798f7640 1 -- 172.21.15.5:0/3150912356 wait complete. 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.031+0000 7f38798f7640 1 Processor -- start 2024-09-13T17:14:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.031+0000 7f38798f7640 1 -- start start 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 0x7f387415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b2230 0x7f387406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874145d50 con 0x7f38740adf40 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874147c20 con 0x7f38740ae320 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38798f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3874147010 con 0x7f38740b2230 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33302/0 (socket says 172.21.15.5:33302) 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 -- 172.21.15.5:0/1365129052 learned_addr learned my addr 172.21.15.5:0/1365129052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38737fe640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b2230 0x7f387406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 -- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b2230 msgr2=0x7f387406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b2230 0x7f387406a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38727fc640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 0x7f387415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 -- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 msgr2=0x7f387415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 0x7f387415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f3872ffd640 1 -- 172.21.15.5:0/1365129052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009400 con 0x7f38740adf40 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.032+0000 7f38727fc640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 0x7f387415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f3872ffd640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f3864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386403c830 con 0x7f38740adf40 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386403c990 con 0x7f38740adf40 2024-09-13T17:14:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3864009a70 con 0x7f38740adf40 2024-09-13T17:14:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386403cd40 con 0x7f38740adf40 2024-09-13T17:14:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.033+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38741475d0 con 0x7f38740adf40 2024-09-13T17:14:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.034+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38740672e0 con 0x7f38740adf40 2024-09-13T17:14:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.034+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3864045460 con 0x7f38740adf40 2024-09-13T17:14:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.035+0000 7f386bfff640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 0x7f385406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.035+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38640ab2d0 con 0x7f38740adf40 2024-09-13T17:14:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.035+0000 7f38727fc640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 0x7f385406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.035+0000 7f38727fc640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 0x7f385406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f387415b750 tx=0x7f385c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.039+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3864076210 con 0x7f38740adf40 2024-09-13T17:14:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.212+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3874160a30 con 0x7f38740adf40 2024-09-13T17:14:14.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.212+0000 7f386bfff640 1 -- 172.21.15.5:0/1365129052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3864079830 con 0x7f38740adf40 2024-09-13T17:14:14.214 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 msgr2=0x7f385406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 0x7f385406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f387415b750 tx=0x7f385c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 msgr2=0x7f3874145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f3864004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 shutdown_connections 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38740b2230 0x7f387406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38740ae320 0x7f387415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f385406ac00 0x7f385406d0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 --2- 172.21.15.5:0/1365129052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38740adf40 0x7f3874145810 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 >> 172.21.15.5:0/1365129052 conn(0x7f3874070af0 msgr2=0x7f38740afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 shutdown_connections 2024-09-13T17:14:14.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.214+0000 7f38798f7640 1 -- 172.21.15.5:0/1365129052 wait complete. 2024-09-13T17:14:14.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.330+0000 7f9985b25640 1 Processor -- start 2024-09-13T17:14:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.330+0000 7f9985b25640 1 -- start start 2024-09-13T17:14:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f9985b25640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99800b3b00 0x7f998006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f9985b25640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9980160510 con 0x7f9980160000 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f9985b25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99801607f0 con 0x7f998015cfa0 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f9985b25640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998006e7b0 con 0x7f99800b3b00 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f997f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99800b3b00 0x7f998006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f997effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9980160000 0x7f99800b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45844/0 (socket says 172.21.15.5:45844) 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f997effd640 1 -- 172.21.15.5:0/453011588 learned_addr learned my addr 172.21.15.5:0/453011588 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f997f7fe640 1 -- 172.21.15.5:0/453011588 >> v1:172.21.15.179:6789/0 conn(0x7f998015cfa0 legacy=0x7f998006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.331+0000 7f997f7fe640 1 -- 172.21.15.5:0/453011588 >> v1:172.21.15.5:6789/0 conn(0x7f9980160000 legacy=0x7f99800b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997f7fe640 1 -- 172.21.15.5:0/453011588 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980160ad0 con 0x7f99800b3b00 2024-09-13T17:14:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997e7fc640 1 -- 172.21.15.5:0/453011588 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339541105 0 0) 0x7f9980160510 con 0x7f9980160000 2024-09-13T17:14:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997f7fe640 1 --2- 172.21.15.5:0/453011588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99800b3b00 0x7f998006eb30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f99700097a0 tx=0x7f997002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15520c13260ed77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997e7fc640 1 -- 172.21.15.5:0/453011588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970032440 con 0x7f99800b3b00 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997e7fc640 1 -- 172.21.15.5:0/453011588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99700325a0 con 0x7f99800b3b00 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.332+0000 7f997e7fc640 1 -- 172.21.15.5:0/453011588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970032930 con 0x7f99800b3b00 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 -- 172.21.15.5:0/453011588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99800b3b00 msgr2=0x7f998006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 --2- 172.21.15.5:0/453011588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99800b3b00 0x7f998006eb30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f99700097a0 tx=0x7f997002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 -- 172.21.15.5:0/453011588 shutdown_connections 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 --2- 172.21.15.5:0/453011588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99800b3b00 0x7f998006eb30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 -- 172.21.15.5:0/453011588 >> 172.21.15.5:0/453011588 conn(0x7f9980070af0 msgr2=0x7f9980070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 -- 172.21.15.5:0/453011588 shutdown_connections 2024-09-13T17:14:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.333+0000 7f9985b25640 1 -- 172.21.15.5:0/453011588 wait complete. 2024-09-13T17:14:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.334+0000 7f9985b25640 1 Processor -- start 2024-09-13T17:14:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.334+0000 7f9985b25640 1 -- start start 2024-09-13T17:14:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 0x7f998014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f998015cfa0 0x7f998006a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801f1970 con 0x7f9980160000 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980158290 con 0x7f99800b3b00 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f9985b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998006b300 con 0x7f998015cfa0 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f997ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f997f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 0x7f998014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f997ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33326/0 (socket says 172.21.15.5:33326) 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f997ffff640 1 -- 172.21.15.5:0/3001351072 learned_addr learned my addr 172.21.15.5:0/3001351072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.335+0000 7f997effd640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f998015cfa0 0x7f998006a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 -- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f998015cfa0 msgr2=0x7f998006a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f998015cfa0 0x7f998006a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 -- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 msgr2=0x7f998014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 0x7f998014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 -- 172.21.15.5:0/3001351072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009400 con 0x7f9980160000 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997f7fe640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 0x7f998014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f997ffff640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f997800c780 tx=0x7f997800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978004b60 con 0x7f9980160000 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800ce90 con 0x7f9980160000 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800a7f0 con 0x7f9980160000 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998006b5e0 con 0x7f9980160000 2024-09-13T17:14:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.336+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998014b760 con 0x7f9980160000 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.337+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99800672e0 con 0x7f9980160000 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.338+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f997800a950 con 0x7f9980160000 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.338+0000 7f9967fff640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 0x7f996c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.338+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9978089780 con 0x7f9980160000 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.338+0000 7f997f7fe640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 0x7f996c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.339+0000 7f997f7fe640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 0x7f996c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9970034000 tx=0x7f997002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.342+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9978054650 con 0x7f9980160000 2024-09-13T17:14:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.514+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f998015d3e0 con 0x7f9980160000 2024-09-13T17:14:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.514+0000 7f9967fff640 1 -- 172.21.15.5:0/3001351072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9978057c70 con 0x7f9980160000 2024-09-13T17:14:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 msgr2=0x7f996c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 0x7f996c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9970034000 tx=0x7f997002e000 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 msgr2=0x7f998015a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f997800c780 tx=0x7f997800cc40 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 shutdown_connections 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f996c06ac00 0x7f996c06d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9980160000 0x7f998015a550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f998015cfa0 0x7f998006a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 --2- 172.21.15.5:0/3001351072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99800b3b00 0x7f998014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 >> 172.21.15.5:0/3001351072 conn(0x7f9980070af0 msgr2=0x7f99800b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 shutdown_connections 2024-09-13T17:14:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.516+0000 7f9985b25640 1 -- 172.21.15.5:0/3001351072 wait complete. 2024-09-13T17:14:14.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 Processor -- start 2024-09-13T17:14:14.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 -- start start 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea9c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0ad050 con 0x7fea9c06da30 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0ac440 con 0x7fea9c1591e0 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.632+0000 7feaa2576640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ac720 con 0x7fea9c0abe60 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7feaa0b13640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea9c06da30 0x7fea9c0700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45850/0 (socket says 172.21.15.5:45850) 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7feaa0b13640 1 -- 172.21.15.5:0/765772079 learned_addr learned my addr 172.21.15.5:0/765772079 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea93fff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea9c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800766610 0 0) 0x7fea9c0ad050 con 0x7fea9c06da30 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea88003520 con 0x7fea9c06da30 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709116099 0 0) 0x7fea88003520 con 0x7fea9c06da30 2024-09-13T17:14:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 msgr2=0x7fea9c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea9c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 >> v1:172.21.15.179:6789/0 conn(0x7fea9c1591e0 legacy=0x7fea9c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0aca00 con 0x7fea9c06da30 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fea940019f0 con 0x7fea9c06da30 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 >> v1:172.21.15.5:6789/0 conn(0x7fea9c06da30 legacy=0x7fea9c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88003fd0 0x7fea880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea88004d00 0x7fea88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ac720 con 0x7fea88003fd0 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800bb40 con 0x7fea88004d00 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800bd00 con 0x7fea9c0abe60 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.633+0000 7fea93fff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88003fd0 0x7fea880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea9bfff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7feaa0b13640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea88004d00 0x7fea88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea93fff640 1 -- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 msgr2=0x7fea880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea93fff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0abe60 0x7fea880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea93fff640 1 -- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea88004d00 msgr2=0x7fea88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea93fff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea88004d00 0x7fea88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.634+0000 7fea93fff640 1 -- 172.21.15.5:0/765772079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88003520 con 0x7fea88003fd0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7fea93fff640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88003fd0 0x7fea880047c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba10 tx=0x7fea880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dadd721c9870c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8402adb0 con 0x7fea88003fd0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8402e070 con 0x7fea88003fd0 2024-09-13T17:14:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7fea9b7fe640 1 -- 172.21.15.5:0/765772079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84034620 con 0x7fea88003fd0 2024-09-13T17:14:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 -- 172.21.15.5:0/765772079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88003fd0 msgr2=0x7fea880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 --2- 172.21.15.5:0/765772079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88003fd0 0x7fea880047c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba10 tx=0x7fea880057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa0b13640 1 -- 172.21.15.5:0/765772079 reap_dead start 2024-09-13T17:14:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 -- 172.21.15.5:0/765772079 shutdown_connections 2024-09-13T17:14:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 -- 172.21.15.5:0/765772079 >> 172.21.15.5:0/765772079 conn(0x7fea9c0ce130 msgr2=0x7fea9c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 -- 172.21.15.5:0/765772079 shutdown_connections 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.635+0000 7feaa2576640 1 -- 172.21.15.5:0/765772079 wait complete. 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 Processor -- start 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 -- start start 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea88003fd0 0x7fea9c1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 0x7fea9c15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c14e150 con 0x7fea9c14d3b0 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c15b2d0 con 0x7fea9c15a910 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7feaa2576640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1561b0 con 0x7fea88003fd0 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7fea93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7fea93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33358/0 (socket says 172.21.15.5:33358) 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.637+0000 7fea93fff640 1 -- 172.21.15.5:0/3157305451 learned_addr learned my addr 172.21.15.5:0/3157305451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea9bfff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea88003fd0 0x7fea9c1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7feaa0b13640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 0x7fea9c15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 -- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea88003fd0 msgr2=0x7fea9c1f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea88003fd0 0x7fea9c1f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 -- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 msgr2=0x7fea9c15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 0x7fea9c15ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 -- 172.21.15.5:0/3157305451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c14de70 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7feaa0b13640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 0x7fea9c15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea93fff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba10 tx=0x7fea84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8403f470 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8403f5d0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8403f980 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c155b60 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.638+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c14afd0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.639+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c1559c0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.640+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea8403fae0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.640+0000 7fea997fa640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 0x7fea7c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.640+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea840aa460 con 0x7fea9c14d3b0 2024-09-13T17:14:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.640+0000 7fea9bfff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 0x7fea7c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.641+0000 7fea9bfff640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 0x7fea7c06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017e0 tx=0x7fea8c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.644+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fea9c1559c0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.812+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea9c1559c0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.813+0000 7fea997fa640 1 -- 172.21.15.5:0/3157305451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea9c1559c0 con 0x7fea9c14d3b0 2024-09-13T17:14:14.815 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 msgr2=0x7fea7c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 0x7fea7c06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017e0 tx=0x7fea8c009040 comp rx=0 tx=0).stop 2024-09-13T17:14:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 msgr2=0x7fea9c14d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba10 tx=0x7fea84004730 comp rx=0 tx=0).stop 2024-09-13T17:14:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 shutdown_connections 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c15a910 0x7fea9c15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea7c06ac30 0x7fea7c06d0f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c14d3b0 0x7fea9c14d830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 --2- 172.21.15.5:0/3157305451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea88003fd0 0x7fea9c1f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 >> 172.21.15.5:0/3157305451 conn(0x7fea9c0ce130 msgr2=0x7fea9c070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 shutdown_connections 2024-09-13T17:14:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.815+0000 7feaa2576640 1 -- 172.21.15.5:0/3157305451 wait complete. 2024-09-13T17:14:14.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:14:14.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.930+0000 7f847565a640 1 Processor -- start 2024-09-13T17:14:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.930+0000 7f847565a640 1 -- start start 2024-09-13T17:14:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f847565a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84700cea20 0x7f84700d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f847565a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700ce590 con 0x7f847015fce0 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f847565a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700d3340 con 0x7f84700b1230 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f847565a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700b4fc0 con 0x7f84700cea20 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f846f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84700cea20 0x7f84700d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f846effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f847015fce0 0x7f84700b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45860/0 (socket says 172.21.15.5:45860) 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.931+0000 7f846effd640 1 -- 172.21.15.5:0/4116607117 learned_addr learned my addr 172.21.15.5:0/4116607117 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.932+0000 7f846f7fe640 1 -- 172.21.15.5:0/4116607117 >> v1:172.21.15.179:6789/0 conn(0x7f84700b1230 legacy=0x7f847006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.932+0000 7f846f7fe640 1 -- 172.21.15.5:0/4116607117 >> v1:172.21.15.5:6789/0 conn(0x7f847015fce0 legacy=0x7f84700b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.932+0000 7f846f7fe640 1 -- 172.21.15.5:0/4116607117 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700b4ce0 con 0x7f84700cea20 2024-09-13T17:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.932+0000 7f846dffb640 1 -- 172.21.15.5:0/4116607117 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879743452 0 0) 0x7f84700ce590 con 0x7f847015fce0 2024-09-13T17:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.932+0000 7f846f7fe640 1 --2- 172.21.15.5:0/4116607117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700cea20 0x7f84700d13f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f84680097a0 tx=0x7f846802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc9e5a46ce1fc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f846dffb640 1 -- 172.21.15.5:0/4116607117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468032440 con 0x7f84700cea20 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f846dffb640 1 -- 172.21.15.5:0/4116607117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84680325a0 con 0x7f84700cea20 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f846dffb640 1 -- 172.21.15.5:0/4116607117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468032930 con 0x7f84700cea20 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 -- 172.21.15.5:0/4116607117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700cea20 msgr2=0x7f84700d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 --2- 172.21.15.5:0/4116607117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700cea20 0x7f84700d13f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f84680097a0 tx=0x7f846802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 -- 172.21.15.5:0/4116607117 shutdown_connections 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 --2- 172.21.15.5:0/4116607117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700cea20 0x7f84700d13f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 -- 172.21.15.5:0/4116607117 >> 172.21.15.5:0/4116607117 conn(0x7f8470089f90 msgr2=0x7f84700d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 -- 172.21.15.5:0/4116607117 shutdown_connections 2024-09-13T17:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.933+0000 7f847565a640 1 -- 172.21.15.5:0/4116607117 wait complete. 2024-09-13T17:14:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.934+0000 7f847565a640 1 Processor -- start 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 -- start start 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 0x7f84701f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847015fce0 0x7f847015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701f6720 con 0x7f84700b1230 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701582a0 con 0x7f84700cea20 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f847565a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8470158580 con 0x7f847015fce0 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33380/0 (socket says 172.21.15.5:33380) 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.935+0000 7f846effd640 1 -- 172.21.15.5:0/3033701476 learned_addr learned my addr 172.21.15.5:0/3033701476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 -- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847015fce0 msgr2=0x7f847015b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847015fce0 0x7f847015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 -- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 msgr2=0x7f84701f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846e7fc640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 0x7f84701f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 0x7f84701f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 -- 172.21.15.5:0/3033701476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009400 con 0x7f84700b1230 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846e7fc640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 0x7f84701f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f846effd640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f846000c7c0 tx=0x7f846000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000a640 con 0x7f84700b1230 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000a7c0 con 0x7f84700b1230 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000ab70 con 0x7f84700b1230 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470158860 con 0x7f84700b1230 2024-09-13T17:14:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.936+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470158e20 con 0x7f84700b1230 2024-09-13T17:14:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.937+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8470159040 con 0x7f84700b1230 2024-09-13T17:14:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.938+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f846000acd0 con 0x7f84700b1230 2024-09-13T17:14:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.938+0000 7f84577fe640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 0x7f845c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.938+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8460088ce0 con 0x7f84700b1230 2024-09-13T17:14:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.938+0000 7f846e7fc640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 0x7f845c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.939+0000 7f846e7fc640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 0x7f845c06d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8464007fd0 tx=0x7f8464009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:14.942+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8460053b00 con 0x7f84700b1230 2024-09-13T17:14:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.111+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84700b3f60 con 0x7f84700b1230 2024-09-13T17:14:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.111+0000 7f84577fe640 1 -- 172.21.15.5:0/3033701476 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8460018070 con 0x7f84700b1230 2024-09-13T17:14:15.114 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 msgr2=0x7f845c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 0x7f845c06d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8464007fd0 tx=0x7f8464009040 comp rx=0 tx=0).stop 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 msgr2=0x7f84700c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f846000c7c0 tx=0x7f846000cc80 comp rx=0 tx=0).stop 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 shutdown_connections 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847015fce0 0x7f847015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84700cea20 0x7f84701f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f845c06ac00 0x7f845c06d0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 --2- 172.21.15.5:0/3033701476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84700b1230 0x7f84700c95b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 >> 172.21.15.5:0/3033701476 conn(0x7f8470089f90 msgr2=0x7f84700b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.113+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 shutdown_connections 2024-09-13T17:14:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.114+0000 7f847565a640 1 -- 172.21.15.5:0/3033701476 wait complete. 2024-09-13T17:14:15.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.226+0000 7fe17efe9640 1 Processor -- start 2024-09-13T17:14:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.226+0000 7fe17efe9640 1 -- start start 2024-09-13T17:14:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17efe9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17815a3e0 0x7fe17806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17efe9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe17806c320 0x7fe1780ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17efe9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780ab9f0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17efe9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17806d410 con 0x7fe17815a3e0 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17efe9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17806cb70 con 0x7fe17806c320 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17815a3e0 0x7fe17806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17815a3e0 0x7fe17806e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33384/0 (socket says 172.21.15.5:33384) 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 -- 172.21.15.5:0/504372114 learned_addr learned my addr 172.21.15.5:0/504372114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe177fff640 1 --2- 172.21.15.5:0/504372114 >> v2:172.21.15.179:3300/0 conn(0x7fe17806c320 0x7fe1780ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 -- 172.21.15.5:0/504372114 >> v2:172.21.15.179:3300/0 conn(0x7fe17806c320 msgr2=0x7fe1780ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 --2- 172.21.15.5:0/504372114 >> v2:172.21.15.179:3300/0 conn(0x7fe17806c320 0x7fe1780ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 -- 172.21.15.5:0/504372114 >> v1:172.21.15.179:6789/0 conn(0x7fe1780ab5a0 legacy=0x7fe17815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.227+0000 7fe17cd85640 1 -- 172.21.15.5:0/504372114 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17806ce50 con 0x7fe17815a3e0 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.228+0000 7fe17cd85640 1 --2- 172.21.15.5:0/504372114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17815a3e0 0x7fe17806e090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe1780b3190 tx=0x7fe16c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7363487828ca194a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.228+0000 7fe1777fe640 1 -- 172.21.15.5:0/504372114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c032440 con 0x7fe17815a3e0 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.228+0000 7fe1777fe640 1 -- 172.21.15.5:0/504372114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0325a0 con 0x7fe17815a3e0 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.228+0000 7fe1777fe640 1 -- 172.21.15.5:0/504372114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c032930 con 0x7fe17815a3e0 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 -- 172.21.15.5:0/504372114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17815a3e0 msgr2=0x7fe17806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 --2- 172.21.15.5:0/504372114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17815a3e0 0x7fe17806e090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe1780b3190 tx=0x7fe16c02a230 comp rx=0 tx=0).stop 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 -- 172.21.15.5:0/504372114 shutdown_connections 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 --2- 172.21.15.5:0/504372114 >> v2:172.21.15.179:3300/0 conn(0x7fe17806c320 0x7fe1780ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 --2- 172.21.15.5:0/504372114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17815a3e0 0x7fe17806e090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 -- 172.21.15.5:0/504372114 >> 172.21.15.5:0/504372114 conn(0x7fe1780ce0d0 msgr2=0x7fe1780ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 -- 172.21.15.5:0/504372114 shutdown_connections 2024-09-13T17:14:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.229+0000 7fe17efe9640 1 -- 172.21.15.5:0/504372114 wait complete. 2024-09-13T17:14:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.230+0000 7fe17efe9640 1 Processor -- start 2024-09-13T17:14:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.230+0000 7fe17efe9640 1 -- start start 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17806c320 0x7fe178149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17815a3e0 0x7fe1781f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17814a210 con 0x7fe1780ab5a0 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17814a440 con 0x7fe17815a3e0 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17efe9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17814a720 con 0x7fe17806c320 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33388/0 (socket says 172.21.15.5:33388) 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 -- 172.21.15.5:0/416503138 learned_addr learned my addr 172.21.15.5:0/416503138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17cd85640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17806c320 0x7fe178149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe17d586640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17815a3e0 0x7fe1781f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 -- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17806c320 msgr2=0x7fe178149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17806c320 0x7fe178149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 -- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17815a3e0 msgr2=0x7fe1781f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17815a3e0 0x7fe1781f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 -- 172.21.15.5:0/416503138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0094d0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.231+0000 7fe177fff640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe16400c7f0 tx=0x7fe16400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.232+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164004220 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.232+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1640043a0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.232+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17814aa00 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.232+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164007860 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.232+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17814afc0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.233+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780672a0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.233+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe1640079c0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.234+0000 7fe1757fa640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 0x7fe15c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.234+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1640893d0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.234+0000 7fe17cd85640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 0x7fe15c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.234+0000 7fe17cd85640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 0x7fe15c06d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe16c034000 tx=0x7fe16c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.238+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe164054330 con 0x7fe1780ab5a0 2024-09-13T17:14:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.446+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe17814b1b0 con 0x7fe1780ab5a0 2024-09-13T17:14:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.447+0000 7fe1757fa640 1 -- 172.21.15.5:0/416503138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7fe164057950 con 0x7fe1780ab5a0 2024-09-13T17:14:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:15.449 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:14:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.448+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 msgr2=0x7fe15c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.448+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 0x7fe15c06d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe16c034000 tx=0x7fe16c02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.448+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 msgr2=0x7fe1781f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.448+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe16400c7f0 tx=0x7fe16400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 shutdown_connections 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe17815a3e0 0x7fe1781f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe15c06ac00 0x7fe15c06d0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1780ab5a0 0x7fe1781f2d30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 --2- 172.21.15.5:0/416503138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe17806c320 0x7fe178149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 >> 172.21.15.5:0/416503138 conn(0x7fe1780ce0d0 msgr2=0x7fe1780af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 shutdown_connections 2024-09-13T17:14:15.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.449+0000 7fe17efe9640 1 -- 172.21.15.5:0/416503138 wait complete. 2024-09-13T17:14:15.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.563+0000 7f5cf88f0640 1 Processor -- start 2024-09-13T17:14:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.563+0000 7f5cf88f0640 1 -- start start 2024-09-13T17:14:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf88f0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cf415a3e0 0x7f5cf406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf88f0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf406d410 con 0x7f5cf406c320 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf88f0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf406cb70 con 0x7f5cf40ab770 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf88f0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf406ce50 con 0x7f5cf415a3e0 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cf415a3e0 0x7f5cf406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cebfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5cf406c320 0x7f5cf40ab060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45874/0 (socket says 172.21.15.5:45874) 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cf415a3e0 0x7f5cf406e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33392/0 (socket says 172.21.15.5:33392) 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cebfff640 1 -- 172.21.15.5:0/1540047478 learned_addr learned my addr 172.21.15.5:0/1540047478 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf259c640 1 -- 172.21.15.5:0/1540047478 >> v1:172.21.15.179:6789/0 conn(0x7f5cf40ab770 legacy=0x7f5cf40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf259c640 1 -- 172.21.15.5:0/1540047478 >> v1:172.21.15.5:6789/0 conn(0x7f5cf406c320 legacy=0x7f5cf40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf259c640 1 -- 172.21.15.5:0/1540047478 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf406d130 con 0x7f5cf415a3e0 2024-09-13T17:14:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.564+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/1540047478 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73404996 0 0) 0x7f5cf406d410 con 0x7f5cf406c320 2024-09-13T17:14:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf259c640 1 --2- 172.21.15.5:0/1540047478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf406e090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40097a0 tx=0x7f5ce402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ec15bd835fa316 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/1540047478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4032440 con 0x7f5cf415a3e0 2024-09-13T17:14:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/1540047478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40325a0 con 0x7f5cf415a3e0 2024-09-13T17:14:15.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf1d9b640 1 -- 172.21.15.5:0/1540047478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4032930 con 0x7f5cf415a3e0 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf88f0640 1 -- 172.21.15.5:0/1540047478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 msgr2=0x7f5cf406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.565+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/1540047478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf406e090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40097a0 tx=0x7f5ce402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.566+0000 7f5cf88f0640 1 -- 172.21.15.5:0/1540047478 shutdown_connections 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.566+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/1540047478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf406e090 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.566+0000 7f5cf88f0640 1 -- 172.21.15.5:0/1540047478 >> 172.21.15.5:0/1540047478 conn(0x7f5cf40ce0d0 msgr2=0x7f5cf40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.566+0000 7f5cf88f0640 1 -- 172.21.15.5:0/1540047478 shutdown_connections 2024-09-13T17:14:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.566+0000 7f5cf88f0640 1 -- 172.21.15.5:0/1540047478 wait complete. 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.567+0000 7f5cf88f0640 1 Processor -- start 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.567+0000 7f5cf88f0640 1 -- start start 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf406c320 0x7f5cf4144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf40ab770 0x7f5cf409b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4144f60 con 0x7f5cf415a3e0 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40996d0 con 0x7f5cf40ab770 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf88f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40999b0 con 0x7f5cf406c320 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33394/0 (socket says 172.21.15.5:33394) 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/2788781759 learned_addr learned my addr 172.21.15.5:0/2788781759 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cebfff640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf40ab770 0x7f5cf409b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf259c640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf406c320 0x7f5cf4144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf406c320 msgr2=0x7f5cf4144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf406c320 0x7f5cf4144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf40ab770 msgr2=0x7f5cf409b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf40ab770 0x7f5cf409b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 -- 172.21.15.5:0/2788781759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009400 con 0x7f5cf415a3e0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.568+0000 7f5cf2d9d640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c700 tx=0x7f5cec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.569+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00aa50 con 0x7f5cf415a3e0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.569+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00abb0 con 0x7f5cf415a3e0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.569+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf4099c90 con 0x7f5cf415a3e0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.569+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00ce10 con 0x7f5cf415a3e0 2024-09-13T17:14:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.569+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf409a250 con 0x7f5cf415a3e0 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.570+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf40672a0 con 0x7f5cf415a3e0 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.570+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5cec012420 con 0x7f5cf415a3e0 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.571+0000 7f5ceaffd640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 0x7f5cd406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.571+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5cec0899c0 con 0x7f5cf415a3e0 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.571+0000 7f5cf259c640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 0x7f5cd406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.572+0000 7f5cf259c640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 0x7f5cd406d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4034000 tx=0x7f5ce402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.575+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5cec054890 con 0x7f5cf415a3e0 2024-09-13T17:14:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.745+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf406e090 con 0x7f5cf415a3e0 2024-09-13T17:14:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.746+0000 7f5ceaffd640 1 -- 172.21.15.5:0/2788781759 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f5cec016090 con 0x7f5cf415a3e0 2024-09-13T17:14:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:15.748 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 msgr2=0x7f5cd406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 0x7f5cd406d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4034000 tx=0x7f5ce402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 msgr2=0x7f5cf409a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c700 tx=0x7f5cec00cbc0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 shutdown_connections 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5cd406ac30 0x7f5cd406d0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cf415a3e0 0x7f5cf409a770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cf40ab770 0x7f5cf409b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 --2- 172.21.15.5:0/2788781759 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cf406c320 0x7f5cf4144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 >> 172.21.15.5:0/2788781759 conn(0x7f5cf40ce0d0 msgr2=0x7f5cf40aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 shutdown_connections 2024-09-13T17:14:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.748+0000 7f5cf88f0640 1 -- 172.21.15.5:0/2788781759 wait complete. 2024-09-13T17:14:15.761 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:14:15.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 Processor -- start 2024-09-13T17:14:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 -- start start 2024-09-13T17:14:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 0x7f0e880cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e880d06d0 0x7f0e880b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880b4f30 con 0x7f0e880b4b20 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880d1e80 con 0x7f0e880d06d0 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.861+0000 7f0e8f0c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880d1750 con 0x7f0e8815c810 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e880d06d0 0x7f0e880b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0e880d06d0 0x7f0e880b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33396/0 (socket says 172.21.15.5:33396) 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 -- 172.21.15.5:0/808690823 learned_addr learned my addr 172.21.15.5:0/808690823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e8ce65640 1 --2- 172.21.15.5:0/808690823 >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 0x7f0e880cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 -- 172.21.15.5:0/808690823 >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 msgr2=0x7f0e880cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 --2- 172.21.15.5:0/808690823 >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 0x7f0e880cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 -- 172.21.15.5:0/808690823 >> v1:172.21.15.179:6789/0 conn(0x7f0e880b4b20 legacy=0x7f0e880d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e87fff640 1 -- 172.21.15.5:0/808690823 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880d0bd0 con 0x7f0e880d06d0 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.862+0000 7f0e8ce65640 1 --2- 172.21.15.5:0/808690823 >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 0x7f0e880cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e87fff640 1 --2- 172.21.15.5:0/808690823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e880b45e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0e88072540 tx=0x7f0e7002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa64cf43f74c4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e877fe640 1 -- 172.21.15.5:0/808690823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70031600 con 0x7f0e880d06d0 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e877fe640 1 -- 172.21.15.5:0/808690823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7002d050 con 0x7f0e880d06d0 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e877fe640 1 -- 172.21.15.5:0/808690823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70031980 con 0x7f0e880d06d0 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/808690823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 msgr2=0x7f0e880b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/808690823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e880b45e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0e88072540 tx=0x7f0e7002a6f0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/808690823 shutdown_connections 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/808690823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e880b45e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/808690823 >> v2:172.21.15.179:3300/0 conn(0x7f0e8815c810 0x7f0e880cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/808690823 >> 172.21.15.5:0/808690823 conn(0x7f0e880717a0 msgr2=0x7f0e88071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/808690823 shutdown_connections 2024-09-13T17:14:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.863+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/808690823 wait complete. 2024-09-13T17:14:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 Processor -- start 2024-09-13T17:14:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 -- start start 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e880b4b20 0x7f0e88155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 0x7f0e880cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88155ac0 con 0x7f0e880d06d0 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881f3d50 con 0x7f0e8815c810 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.865+0000 7f0e8f0c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881f4030 con 0x7f0e880b4b20 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33398/0 (socket says 172.21.15.5:33398) 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 -- 172.21.15.5:0/3489122011 learned_addr learned my addr 172.21.15.5:0/3489122011 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e8ce65640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e880b4b20 0x7f0e88155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e8d666640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 0x7f0e880cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 -- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e880b4b20 msgr2=0x7f0e88155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e880b4b20 0x7f0e88155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 -- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 msgr2=0x7f0e880cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 0x7f0e880cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 -- 172.21.15.5:0/3489122011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009b30 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e8d666640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 0x7f0e880cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e87fff640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e70000f80 tx=0x7f0e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7003d860 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7003d9c0 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7003dd70 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e881f4310 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.866+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e881f48d0 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.867+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e880672a0 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.868+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e7003b400 con 0x7f0e880d06d0 2024-09-13T17:14:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.868+0000 7f0e857fa640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 0x7f0e6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.868+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e700aa810 con 0x7f0e880d06d0 2024-09-13T17:14:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.869+0000 7f0e8ce65640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 0x7f0e6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.869+0000 7f0e8ce65640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 0x7f0e6806d0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0e880b57d0 tx=0x7f0e78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:15.873+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e70075590 con 0x7f0e880d06d0 2024-09-13T17:14:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.078+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e880b45e0 con 0x7f0e880d06d0 2024-09-13T17:14:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.078+0000 7f0e857fa640 1 -- 172.21.15.5:0/3489122011 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7f0e70009510 con 0x7f0e880d06d0 2024-09-13T17:14:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:16.081 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:14:16.081 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.080+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 msgr2=0x7f0e6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.080+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 0x7f0e6806d0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0e880b57d0 tx=0x7f0e78008040 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.080+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 msgr2=0x7f0e881f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.080+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e70000f80 tx=0x7f0e70004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.080+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 shutdown_connections 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e8815c810 0x7f0e880cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0e6806ac00 0x7f0e6806d0c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e880d06d0 0x7f0e881f4df0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 --2- 172.21.15.5:0/3489122011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e880b4b20 0x7f0e88155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 >> 172.21.15.5:0/3489122011 conn(0x7f0e880717a0 msgr2=0x7f0e880730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 shutdown_connections 2024-09-13T17:14:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.081+0000 7f0e8f0c9640 1 -- 172.21.15.5:0/3489122011 wait complete. 2024-09-13T17:14:16.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.193+0000 7fb3f72e9640 1 Processor -- start 2024-09-13T17:14:16.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.193+0000 7fb3f72e9640 1 -- start start 2024-09-13T17:14:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f72e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb3f015d960 0x7fb3f0070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f72e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f015cbc0 con 0x7fb3f006ec60 2024-09-13T17:14:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f72e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00b2020 con 0x7fb3f015a180 2024-09-13T17:14:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f72e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f00b1e30 con 0x7fb3f015d960 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f5886640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3f006ec60 0x7fb3f00ac1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45876/0 (socket says 172.21.15.5:45876) 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.194+0000 7fb3f5886640 1 -- 172.21.15.5:0/1505944994 learned_addr learned my addr 172.21.15.5:0/1505944994 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783497101 0 0) 0x7fb3f015cbc0 con 0x7fb3f006ec60 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d8003520 con 0x7fb3f006ec60 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f4884640 1 --2- 172.21.15.5:0/1505944994 >> v2:172.21.15.179:3300/0 conn(0x7fb3f015d960 0x7fb3f0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 370266064 0 0) 0x7fb3d8003520 con 0x7fb3f006ec60 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 >> v2:172.21.15.179:3300/0 conn(0x7fb3f015d960 msgr2=0x7fb3f0070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 --2- 172.21.15.5:0/1505944994 >> v2:172.21.15.179:3300/0 conn(0x7fb3f015d960 0x7fb3f0070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 >> v1:172.21.15.179:6789/0 conn(0x7fb3f015a180 legacy=0x7fb3f00b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f015ce80 con 0x7fb3f006ec60 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb3e8001670 con 0x7fb3f006ec60 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 >> v1:172.21.15.5:6789/0 conn(0x7fb3f006ec60 legacy=0x7fb3f00ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 0x7fb3d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d80047c0 0x7fb3d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d8005180 0x7fb3d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d800c0f0 con 0x7fb3d8003970 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d800c260 con 0x7fb3d8005180 2024-09-13T17:14:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d800c420 con 0x7fb3d80047c0 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 0x7fb3d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5886640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d8005180 0x7fb3d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f4884640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d80047c0 0x7fb3d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 -- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d80047c0 msgr2=0x7fb3d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d80047c0 0x7fb3d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 -- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d8005180 msgr2=0x7fb3d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3d8005180 0x7fb3d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5085640 1 -- 172.21.15.5:0/1505944994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8003520 con 0x7fb3d8003970 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f5886640 1 -- 172.21.15.5:0/1505944994 reap_dead start 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.195+0000 7fb3f4884640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d80047c0 0x7fb3d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.196+0000 7fb3f5085640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 0x7fb3d8003d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0001e50 tx=0x7fb3d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88de706863d44fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.196+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e002ae40 con 0x7fb3d8003970 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.196+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0003970 con 0x7fb3d8003970 2024-09-13T17:14:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.196+0000 7fb3effff640 1 -- 172.21.15.5:0/1505944994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003d20 con 0x7fb3d8003970 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 -- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 msgr2=0x7fb3d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 0x7fb3d8003d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0001e50 tx=0x7fb3d80057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 -- 172.21.15.5:0/1505944994 shutdown_connections 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/1505944994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d8003970 0x7fb3d8003d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 -- 172.21.15.5:0/1505944994 >> 172.21.15.5:0/1505944994 conn(0x7fb3f00b0420 msgr2=0x7fb3f00b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 -- 172.21.15.5:0/1505944994 shutdown_connections 2024-09-13T17:14:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.197+0000 7fb3f72e9640 1 -- 172.21.15.5:0/1505944994 wait complete. 2024-09-13T17:14:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.198+0000 7fb3f72e9640 1 Processor -- start 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.198+0000 7fb3f72e9640 1 -- start start 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d8003970 0x7fb3f0144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f015ea70 0x7fb3f015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f015f430 con 0x7fb3f006e0b0 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006eaa0 con 0x7fb3f015ea70 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f72e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006c710 con 0x7fb3d8003970 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f5886640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f5886640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33418/0 (socket says 172.21.15.5:33418) 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f5886640 1 -- 172.21.15.5:0/2383986292 learned_addr learned my addr 172.21.15.5:0/2383986292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f5085640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d8003970 0x7fb3f0144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.199+0000 7fb3f4884640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f015ea70 0x7fb3f015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 -- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d8003970 msgr2=0x7fb3f0144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d8003970 0x7fb3f0144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 -- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f015ea70 msgr2=0x7fb3f015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f015ea70 0x7fb3f015eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 -- 172.21.15.5:0/2383986292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f006c9f0 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f5886640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00ae2e0 tx=0x7fb3e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800f620 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800f780 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800fb30 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f006ccd0 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.200+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f006d290 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.201+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f006c470 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.202+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3e800fc90 con 0x7fb3f006e0b0 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.202+0000 7fb3edffb640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 0x7fb3dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.202+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb3e80894c0 con 0x7fb3f006e0b0 2024-09-13T17:14:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.203+0000 7fb3f5085640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 0x7fb3dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.203+0000 7fb3f5085640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 0x7fb3dc06d0f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0032000 tx=0x7fb3e002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.207+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb3e8054390 con 0x7fb3f006e0b0 2024-09-13T17:14:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.419+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3f00b1ab0 con 0x7fb3f006e0b0 2024-09-13T17:14:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.419+0000 7fb3edffb640 1 -- 172.21.15.5:0/2383986292 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4721 (secure 0 0 0) 0x7fb3e80579b0 con 0x7fb3f006e0b0 2024-09-13T17:14:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:16.422 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3863504335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3863504335},{"type":"v1","addr":"172.21.15.179:6837","nonce":3863504335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3050729618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3050729618},{"type":"v1","addr":"172.21.15.5:6833","nonce":3050729618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/819615368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":819615368},{"type":"v1","addr":"172.21.15.5:6835","nonce":819615368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:13:08.163883+0000","modified":"2024-09-13T17:13:29.339757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/90966651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":90966651},{"type":"v1","addr":"172.21.15.179:6836","nonce":90966651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:14:16.422 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 msgr2=0x7fb3dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 0x7fb3dc06d0f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0032000 tx=0x7fb3e002e000 comp rx=0 tx=0).stop 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 msgr2=0x7fb3f006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00ae2e0 tx=0x7fb3e8007430 comp rx=0 tx=0).stop 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 shutdown_connections 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb3dc06ac30 0x7fb3dc06d0f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3f006e0b0 0x7fb3f006e560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3f015ea70 0x7fb3f015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 --2- 172.21.15.5:0/2383986292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3d8003970 0x7fb3f0144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 >> 172.21.15.5:0/2383986292 conn(0x7fb3f00b0420 msgr2=0x7fb3f015ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 shutdown_connections 2024-09-13T17:14:16.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.422+0000 7fb3f72e9640 1 -- 172.21.15.5:0/2383986292 wait complete. 2024-09-13T17:14:16.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.534+0000 7f100f8c5640 1 Processor -- start 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.534+0000 7f100f8c5640 1 -- start start 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100f8c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f100815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100f8c5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f100806ef60 0x7f100806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100f8c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080b35f0 con 0x7f100806eb80 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100f8c5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1008160020 con 0x7f100806ef60 2024-09-13T17:14:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100f8c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1008156f50 con 0x7f10080b1ac0 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100d661640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f100806eb80 0x7f10080b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45884/0 (socket says 172.21.15.5:45884) 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100d661640 1 -- 172.21.15.5:0/901271075 learned_addr learned my addr 172.21.15.5:0/901271075 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100de62640 1 --2- 172.21.15.5:0/901271075 >> v2:172.21.15.179:3300/0 conn(0x7f100806ef60 0x7f100806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f100ce60640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f100815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605115663 0 0) 0x7f10080b35f0 con 0x7f100806eb80 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff4003520 con 0x7f100806eb80 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 850531134 0 0) 0x7f0ff4003520 con 0x7f100806eb80 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 msgr2=0x7f100815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f100815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 >> v2:172.21.15.179:3300/0 conn(0x7f100806ef60 msgr2=0x7f100806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 --2- 172.21.15.5:0/901271075 >> v2:172.21.15.179:3300/0 conn(0x7f100806ef60 0x7f100806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.535+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080b1fa0 con 0x7f100806eb80 2024-09-13T17:14:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f1004001670 con 0x7f100806eb80 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 >> v1:172.21.15.5:6789/0 conn(0x7f100806eb80 legacy=0x7f10080b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f0ff4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ff4003ef0 0x7f0ff40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ff4004d00 0x7f0ff4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008160020 con 0x7f0ff4004d00 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008156f50 con 0x7f0ff4003ef0 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff400b980 con 0x7f10080b1ac0 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ff4004d00 0x7f0ff4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100d661640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f0ff4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100ce60640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ff4003ef0 0x7f0ff40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 -- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 msgr2=0x7f0ff4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f0ff4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 -- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ff4003ef0 msgr2=0x7f0ff40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ff4003ef0 0x7f0ff40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100de62640 1 -- 172.21.15.5:0/901271075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4003520 con 0x7f0ff4004d00 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.536+0000 7f100d661640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10080b1ac0 0x7f0ff4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100de62640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ff4004d00 0x7f0ff4005180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1000009f90 tx=0x7f0ff40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8072fc87f87b358 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100002d070 con 0x7f0ff4004d00 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000f040 con 0x7f0ff4004d00 2024-09-13T17:14:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f0ffffff640 1 -- 172.21.15.5:0/901271075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000031670 con 0x7f0ff4004d00 2024-09-13T17:14:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100f8c5640 1 -- 172.21.15.5:0/901271075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ff4004d00 msgr2=0x7f0ff4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100f8c5640 1 --2- 172.21.15.5:0/901271075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ff4004d00 0x7f0ff4005180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1000009f90 tx=0x7f0ff40057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100de62640 1 -- 172.21.15.5:0/901271075 reap_dead start 2024-09-13T17:14:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100f8c5640 1 -- 172.21.15.5:0/901271075 shutdown_connections 2024-09-13T17:14:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.537+0000 7f100f8c5640 1 -- 172.21.15.5:0/901271075 >> 172.21.15.5:0/901271075 conn(0x7f1008070af0 msgr2=0x7f1008070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.538+0000 7f100f8c5640 1 -- 172.21.15.5:0/901271075 shutdown_connections 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.538+0000 7f100f8c5640 1 -- 172.21.15.5:0/901271075 wait complete. 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.539+0000 7f100f8c5640 1 Processor -- start 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.539+0000 7f100f8c5640 1 -- start start 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.539+0000 7f100f8c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ff4004d00 0x7f10080cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.539+0000 7f100f8c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f100814c2a0 0x7f100814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100f8c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100f8c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080ccc20 con 0x7f100814dfe0 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100f8c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cb640 con 0x7f100814c2a0 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100f8c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cb920 con 0x7f0ff4004d00 2024-09-13T17:14:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33440/0 (socket says 172.21.15.5:33440) 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 -- 172.21.15.5:0/927636584 learned_addr learned my addr 172.21.15.5:0/927636584 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100d661640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ff4004d00 0x7f10080cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100ce60640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f100814c2a0 0x7f100814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 -- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ff4004d00 msgr2=0x7f10080cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ff4004d00 0x7f10080cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 -- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f100814c2a0 msgr2=0x7f100814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f100814c2a0 0x7f100814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 -- 172.21.15.5:0/927636584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080cbc00 con 0x7f100814dfe0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100de62640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1000009f90 tx=0x7f1000009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000003990 con 0x7f100814dfe0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100003f070 con 0x7f100814dfe0 2024-09-13T17:14:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10080cbee0 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.540+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000003d10 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.541+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10080cb2a0 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.541+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10080672e0 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.542+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1000041030 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.542+0000 7f0ffdffb640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 0x7f0fec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.542+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f10000aa8d0 con 0x7f100814dfe0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.543+0000 7f100d661640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 0x7f0fec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.543+0000 7f100d661640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 0x7f0fec06d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1004001cf0 tx=0x7f1004001c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.547+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1000075650 con 0x7f100814dfe0 2024-09-13T17:14:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.717+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10080cc3a0 con 0x7f100814dfe0 2024-09-13T17:14:16.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.718+0000 7f0ffdffb640 1 -- 172.21.15.5:0/927636584 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18641 (secure 0 0 0) 0x7f1000078c70 con 0x7f100814dfe0 2024-09-13T17:14:16.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:16.721 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:13:56.423272+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:13:06.616552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:13:07.133056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:13:10.212716+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:16.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 msgr2=0x7f0fec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 0x7f0fec06d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1004001cf0 tx=0x7f1004001c60 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 msgr2=0x7f100814e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1000009f90 tx=0x7f1000009750 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 shutdown_connections 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fec06ac00 0x7f0fec06d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100814dfe0 0x7f100814e9d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f100814c2a0 0x7f100814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 --2- 172.21.15.5:0/927636584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ff4004d00 0x7f10080cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 >> 172.21.15.5:0/927636584 conn(0x7f1008070af0 msgr2=0x7f10080aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 shutdown_connections 2024-09-13T17:14:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.720+0000 7f100f8c5640 1 -- 172.21.15.5:0/927636584 wait complete. 2024-09-13T17:14:16.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:14:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 Processor -- start 2024-09-13T17:14:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 -- start start 2024-09-13T17:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8f40cf2c0 0x7fa8f40d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8f415ff50 0x7fa8f4160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40cfdb0 con 0x7fa8f415c470 2024-09-13T17:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40d31b0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.834+0000 7fa8f95a0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f41608a0 con 0x7fa8f415ff50 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8f40cf2c0 0x7fa8f40d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa8f415c470 0x7fa8f40b1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45894/0 (socket says 172.21.15.5:45894) 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8f3fff640 1 -- 172.21.15.5:0/855365593 learned_addr learned my addr 172.21.15.5:0/855365593 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8f8d9f640 1 --2- 172.21.15.5:0/855365593 >> v2:172.21.15.179:3300/0 conn(0x7fa8f415ff50 0x7fa8f4160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8ebfff640 1 -- 172.21.15.5:0/855365593 >> v2:172.21.15.179:3300/0 conn(0x7fa8f415ff50 msgr2=0x7fa8f4160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8ebfff640 1 --2- 172.21.15.5:0/855365593 >> v2:172.21.15.179:3300/0 conn(0x7fa8f415ff50 0x7fa8f4160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8ebfff640 1 -- 172.21.15.5:0/855365593 >> v1:172.21.15.5:6789/0 conn(0x7fa8f415c470 legacy=0x7fa8f40b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8ebfff640 1 -- 172.21.15.5:0/855365593 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f415c850 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.835+0000 7fa8f37fe640 1 -- 172.21.15.5:0/855365593 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455649718 0 0) 0x7fa8e4001110 con 0x7fa8f415c470 2024-09-13T17:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8ebfff640 1 --2- 172.21.15.5:0/855365593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40d2c70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40c9400 tx=0x7fa8dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ebe20156d82a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f37fe640 1 -- 172.21.15.5:0/855365593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc032440 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f37fe640 1 -- 172.21.15.5:0/855365593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc0325a0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f37fe640 1 -- 172.21.15.5:0/855365593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc032930 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 -- 172.21.15.5:0/855365593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 msgr2=0x7fa8f40d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/855365593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40d2c70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40c9400 tx=0x7fa8dc02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 -- 172.21.15.5:0/855365593 shutdown_connections 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/855365593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40d2c70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/855365593 >> v2:172.21.15.179:3300/0 conn(0x7fa8f415ff50 0x7fa8f4160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 -- 172.21.15.5:0/855365593 >> 172.21.15.5:0/855365593 conn(0x7fa8f4089f90 msgr2=0x7fa8f40d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 -- 172.21.15.5:0/855365593 shutdown_connections 2024-09-13T17:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.836+0000 7fa8f95a0640 1 -- 172.21.15.5:0/855365593 wait complete. 2024-09-13T17:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 Processor -- start 2024-09-13T17:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 -- start start 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f415c470 0x7fa8f41533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f415ff50 0x7fa8f415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40af460 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40af740 con 0x7fa8f415c470 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f95a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40afa20 con 0x7fa8f415ff50 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.838+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33446/0 (socket says 172.21.15.5:33446) 2024-09-13T17:14:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 -- 172.21.15.5:0/2109043733 learned_addr learned my addr 172.21.15.5:0/2109043733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8ebfff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f415c470 0x7fa8f41533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f8d9f640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f415ff50 0x7fa8f415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 -- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f415ff50 msgr2=0x7fa8f415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f415ff50 0x7fa8f415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 -- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f415c470 msgr2=0x7fa8f41533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f415c470 0x7fa8f41533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 -- 172.21.15.5:0/2109043733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc009400 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f3fff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c750 tx=0x7fa8e400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4005ab0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4005c10 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4007070 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40afd00 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.839+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40b05f0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.840+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4157ad0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.841+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8e40071d0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.841+0000 7fa8f17fa640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 0x7fa8d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.841+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8e4088ae0 con 0x7fa8f40cf2c0 2024-09-13T17:14:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.842+0000 7fa8ebfff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 0x7fa8d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.842+0000 7fa8ebfff640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 0x7fa8d406d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc034000 tx=0x7fa8dc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:16.846+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8f4157ad0 con 0x7fa8f40cf2c0 2024-09-13T17:14:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.057+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8f40cfdb0 con 0x7fa8f40cf2c0 2024-09-13T17:14:17.060 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:14:17.058+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:14:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.068+0000 7fa8f17fa640 1 -- 172.21.15.5:0/2109043733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa8f40cfdb0 con 0x7fa8f40cf2c0 2024-09-13T17:14:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:14:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 msgr2=0x7fa8d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 0x7fa8d406d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc034000 tx=0x7fa8dc02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 msgr2=0x7fa8f40b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c750 tx=0x7fa8e400cc10 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 shutdown_connections 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f415ff50 0x7fa8f415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f415c470 0x7fa8f41533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8d406ac00 0x7fa8d406d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 --2- 172.21.15.5:0/2109043733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f40cf2c0 0x7fa8f40b00b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 >> 172.21.15.5:0/2109043733 conn(0x7fa8f4089f90 msgr2=0x7fa8f406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 shutdown_connections 2024-09-13T17:14:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.070+0000 7fa8f95a0640 1 -- 172.21.15.5:0/2109043733 wait complete. 2024-09-13T17:14:17.074 INFO:tasks.ceph.mds.b.smithi179.stderr: -4282> 2024-09-13T17:13:09.395+0000 7f474e9a9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:14:17.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:14:17.106 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:14:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.185+0000 7f1b4048e640 1 Processor -- start 2024-09-13T17:14:17.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.185+0000 7f1b4048e640 1 -- start start 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b4048e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 0x7f1b380b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b4048e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b3806ef60 0x7f1b3806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b4048e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380b35f0 con 0x7f1b380b1ac0 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b4048e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3815d140 con 0x7f1b3806ef60 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b4048e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b38160020 con 0x7f1b3806eb80 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3ea2b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b3806ef60 0x7f1b3806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3da29640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b380b1ac0 0x7f1b3815ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45908/0 (socket says 172.21.15.5:45908) 2024-09-13T17:14:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3da29640 1 -- 172.21.15.5:0/447990806 learned_addr learned my addr 172.21.15.5:0/447990806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3e22a640 1 --2- 172.21.15.5:0/447990806 >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 0x7f1b380b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3d228640 1 -- 172.21.15.5:0/447990806 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213104330 0 0) 0x7f1b380b35f0 con 0x7f1b380b1ac0 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3d228640 1 -- 172.21.15.5:0/447990806 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003520 con 0x7f1b380b1ac0 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/447990806 >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 msgr2=0x7f1b380b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3ea2b640 1 --2- 172.21.15.5:0/447990806 >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 0x7f1b380b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/447990806 >> v1:172.21.15.5:6789/0 conn(0x7f1b380b1ac0 legacy=0x7f1b3815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/447990806 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38156f50 con 0x7f1b3806ef60 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.186+0000 7f1b3e22a640 1 --2- 172.21.15.5:0/447990806 >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 0x7f1b380b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:17.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.187+0000 7f1b3ea2b640 1 --2- 172.21.15.5:0/447990806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b3806ef60 0x7f1b3806aea0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b38071c60 tx=0x7f1b3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5892074454218a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.187+0000 7f1b3d228640 1 -- 172.21.15.5:0/447990806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30032440 con 0x7f1b3806ef60 2024-09-13T17:14:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.187+0000 7f1b3d228640 1 -- 172.21.15.5:0/447990806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b300325a0 con 0x7f1b3806ef60 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.187+0000 7f1b3d228640 1 -- 172.21.15.5:0/447990806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30032930 con 0x7f1b3806ef60 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 -- 172.21.15.5:0/447990806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b3806ef60 msgr2=0x7f1b3806aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 --2- 172.21.15.5:0/447990806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b3806ef60 0x7f1b3806aea0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b38071c60 tx=0x7f1b3002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 -- 172.21.15.5:0/447990806 shutdown_connections 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 --2- 172.21.15.5:0/447990806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b3806ef60 0x7f1b3806aea0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 --2- 172.21.15.5:0/447990806 >> v2:172.21.15.179:3300/0 conn(0x7f1b3806eb80 0x7f1b380b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 -- 172.21.15.5:0/447990806 >> 172.21.15.5:0/447990806 conn(0x7f1b38070af0 msgr2=0x7f1b38070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 -- 172.21.15.5:0/447990806 shutdown_connections 2024-09-13T17:14:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.188+0000 7f1b4048e640 1 -- 172.21.15.5:0/447990806 wait complete. 2024-09-13T17:14:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.190+0000 7f1b4048e640 1 Processor -- start 2024-09-13T17:14:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.190+0000 7f1b4048e640 1 -- start start 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3806eb80 0x7f1b380a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b3806ef60 0x7f1b3814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3814e9b0 con 0x7f1b380b1ac0 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380a8470 con 0x7f1b3806eb80 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b4048e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38157190 con 0x7f1b3806ef60 2024-09-13T17:14:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b3ea2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b3ea2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33458/0 (socket says 172.21.15.5:33458) 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.191+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/1138200724 learned_addr learned my addr 172.21.15.5:0/1138200724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3e22a640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3806eb80 0x7f1b380a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3da29640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b3806ef60 0x7f1b3814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b3806ef60 msgr2=0x7f1b3814e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b3806ef60 0x7f1b3814e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3806eb80 msgr2=0x7f1b380a7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3806eb80 0x7f1b380a7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 -- 172.21.15.5:0/1138200724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009400 con 0x7f1b380b1ac0 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b3ea2b640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b30035040 tx=0x7f1b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30030a80 con 0x7f1b380b1ac0 2024-09-13T17:14:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30032e90 con 0x7f1b380b1ac0 2024-09-13T17:14:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b38157470 con 0x7f1b380b1ac0 2024-09-13T17:14:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30030e40 con 0x7f1b380b1ac0 2024-09-13T17:14:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.192+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3814be10 con 0x7f1b380b1ac0 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.193+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b380672e0 con 0x7f1b380b1ac0 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.194+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b30039040 con 0x7f1b380b1ac0 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.194+0000 7f1b2effd640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 0x7f1b1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.194+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1b300a9e40 con 0x7f1b380b1ac0 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.194+0000 7f1b3e22a640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 0x7f1b1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.195+0000 7f1b3e22a640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 0x7f1b1c06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1b34003b80 tx=0x7f1b34009910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.199+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b30074d50 con 0x7f1b380b1ac0 2024-09-13T17:14:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:17.404+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b380b3a20 con 0x7f1b380b1ac0 2024-09-13T17:14:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.075+0000 7f1b2effd640 1 -- 172.21.15.5:0/1138200724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b30006e10 con 0x7f1b380b1ac0 2024-09-13T17:14:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 msgr2=0x7f1b1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 0x7f1b1c06d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1b34003b80 tx=0x7f1b34009910 comp rx=0 tx=0).stop 2024-09-13T17:14:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 msgr2=0x7f1b3806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b30035040 tx=0x7f1b300046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 shutdown_connections 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b1c06ac00 0x7f1b1c06d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b380b1ac0 0x7f1b3806a520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b3806ef60 0x7f1b3814e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 --2- 172.21.15.5:0/1138200724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3806eb80 0x7f1b380a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 >> 172.21.15.5:0/1138200724 conn(0x7f1b38070af0 msgr2=0x7f1b3815eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 shutdown_connections 2024-09-13T17:14:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.078+0000 7f1b4048e640 1 -- 172.21.15.5:0/1138200724 wait complete. 2024-09-13T17:14:18.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:14:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.204+0000 7f67ec6f0640 1 Processor -- start 2024-09-13T17:14:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.204+0000 7f67ec6f0640 1 -- start start 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ec6f0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e40ab900 0x7f67e40afc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ec6f0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67e406d700 0x7f67e4166130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ec6f0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40b0780 con 0x7f67e40b0190 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ec6f0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40b0a60 con 0x7f67e40ab900 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ec6f0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40b0d40 con 0x7f67e406d700 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ea48c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e40ab900 0x7f67e40afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ea48c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e40ab900 0x7f67e40afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33462/0 (socket says 172.21.15.5:33462) 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67ea48c640 1 -- 172.21.15.5:0/1783358358 learned_addr learned my addr 172.21.15.5:0/1783358358 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67e9c8b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67e40b0190 0x7f67e40abce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45918/0 (socket says 172.21.15.5:45918) 2024-09-13T17:14:18.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.205+0000 7f67eac8d640 1 --2- 172.21.15.5:0/1783358358 >> v2:172.21.15.179:3300/0 conn(0x7f67e406d700 0x7f67e4166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:18.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67ea48c640 1 -- 172.21.15.5:0/1783358358 >> v2:172.21.15.179:3300/0 conn(0x7f67e406d700 msgr2=0x7f67e4166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:18.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67ea48c640 1 --2- 172.21.15.5:0/1783358358 >> v2:172.21.15.179:3300/0 conn(0x7f67e406d700 0x7f67e4166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67ea48c640 1 -- 172.21.15.5:0/1783358358 >> v1:172.21.15.5:6789/0 conn(0x7f67e40b0190 legacy=0x7f67e40abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67e948a640 1 -- 172.21.15.5:0/1783358358 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617948591 0 0) 0x7f67e40b0780 con 0x7f67e40b0190 2024-09-13T17:14:18.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67ea48c640 1 -- 172.21.15.5:0/1783358358 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40b1020 con 0x7f67e40ab900 2024-09-13T17:14:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67ea48c640 1 --2- 172.21.15.5:0/1783358358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40ab900 0x7f67e40afc50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f67e406dfb0 tx=0x7f67d402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7718885ffb1c846 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.206+0000 7f67e948a640 1 -- 172.21.15.5:0/1783358358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4031600 con 0x7f67e40ab900 2024-09-13T17:14:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67e948a640 1 -- 172.21.15.5:0/1783358358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d402d050 con 0x7f67e40ab900 2024-09-13T17:14:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67e948a640 1 -- 172.21.15.5:0/1783358358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4031980 con 0x7f67e40ab900 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 -- 172.21.15.5:0/1783358358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40ab900 msgr2=0x7f67e40afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/1783358358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40ab900 0x7f67e40afc50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f67e406dfb0 tx=0x7f67d402a730 comp rx=0 tx=0).stop 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 -- 172.21.15.5:0/1783358358 shutdown_connections 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/1783358358 >> v2:172.21.15.179:3300/0 conn(0x7f67e406d700 0x7f67e4166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/1783358358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40ab900 0x7f67e40afc50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 -- 172.21.15.5:0/1783358358 >> 172.21.15.5:0/1783358358 conn(0x7f67e4065ff0 msgr2=0x7f67e4069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 -- 172.21.15.5:0/1783358358 shutdown_connections 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.207+0000 7f67ec6f0640 1 -- 172.21.15.5:0/1783358358 wait complete. 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.208+0000 7f67ec6f0640 1 Processor -- start 2024-09-13T17:14:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.208+0000 7f67ec6f0640 1 -- start start 2024-09-13T17:14:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e40ab900 0x7f67e415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e40b0190 0x7f67e415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4147570 con 0x7f67e406d700 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4152ad0 con 0x7f67e40b0190 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ec6f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4152db0 con 0x7f67e40ab900 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ea48c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ea48c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33470/0 (socket says 172.21.15.5:33470) 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.209+0000 7f67ea48c640 1 -- 172.21.15.5:0/278619246 learned_addr learned my addr 172.21.15.5:0/278619246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 -- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e40ab900 msgr2=0x7f67e415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e40ab900 0x7f67e415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67eac8d640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e40b0190 0x7f67e415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 -- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e40b0190 msgr2=0x7f67e415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e40b0190 0x7f67e415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 -- 172.21.15.5:0/278619246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009b30 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ea48c640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f67d4034040 tx=0x7f67d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d403d860 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d403d9e0 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e4153090 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d403dd90 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.210+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e4153650 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.211+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e4066fe0 con 0x7f67e406d700 2024-09-13T17:14:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.212+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f67d403b400 con 0x7f67e406d700 2024-09-13T17:14:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.212+0000 7f67e2ffd640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 0x7f67d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.212+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f67d40aa580 con 0x7f67e406d700 2024-09-13T17:14:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.212+0000 7f67e9c8b640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 0x7f67d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.213+0000 7f67e9c8b640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 0x7f67d006d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67d8007fd0 tx=0x7f67d8007960 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.216+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f67d40753e0 con 0x7f67e406d700 2024-09-13T17:14:18.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:18.385+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67e40afc50 con 0x7f67e406d700 2024-09-13T17:14:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.078+0000 7f67e2ffd640 1 -- 172.21.15.5:0/278619246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f67d4009510 con 0x7f67e406d700 2024-09-13T17:14:19.081 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 msgr2=0x7f67d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 0x7f67d006d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67d8007fd0 tx=0x7f67d8007960 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 msgr2=0x7f67e4147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f67d4034040 tx=0x7f67d4004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 shutdown_connections 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e40b0190 0x7f67e415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e40ab900 0x7f67e415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67d006ac00 0x7f67d006d0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 --2- 172.21.15.5:0/278619246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e406d700 0x7f67e4147030 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.081+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 >> 172.21.15.5:0/278619246 conn(0x7f67e4065ff0 msgr2=0x7f67e415ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.082+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 shutdown_connections 2024-09-13T17:14:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.082+0000 7f67ec6f0640 1 -- 172.21.15.5:0/278619246 wait complete. 2024-09-13T17:14:19.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:14:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.208+0000 7f922e108640 1 Processor -- start 2024-09-13T17:14:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.208+0000 7f922e108640 1 -- start start 2024-09-13T17:14:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f922e108640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92280b43f0 0x7f92280b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f922e108640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9228160080 0x7f92281604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f922e108640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92281609e0 con 0x7f92280ae3a0 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f922e108640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280b3fd0 con 0x7f9228160080 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f922e108640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280b30d0 con 0x7f92280b43f0 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f92277fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92280ae3a0 0x7f922815dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45920/0 (socket says 172.21.15.5:45920) 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f92277fe640 1 -- 172.21.15.5:0/3117372233 learned_addr learned my addr 172.21.15.5:0/3117372233 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9227fff640 1 --2- 172.21.15.5:0/3117372233 >> v2:172.21.15.5:3300/0 conn(0x7f9228160080 0x7f92281604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9226ffd640 1 --2- 172.21.15.5:0/3117372233 >> v2:172.21.15.179:3300/0 conn(0x7f92280b43f0 0x7f92280b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9227fff640 1 -- 172.21.15.5:0/3117372233 >> v2:172.21.15.179:3300/0 conn(0x7f92280b43f0 msgr2=0x7f92280b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9227fff640 1 --2- 172.21.15.5:0/3117372233 >> v2:172.21.15.179:3300/0 conn(0x7f92280b43f0 0x7f92280b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9227fff640 1 -- 172.21.15.5:0/3117372233 >> v1:172.21.15.5:6789/0 conn(0x7f92280ae3a0 legacy=0x7f922815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.209+0000 7f9227fff640 1 -- 172.21.15.5:0/3117372233 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280b3350 con 0x7f9228160080 2024-09-13T17:14:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.210+0000 7f9227fff640 1 --2- 172.21.15.5:0/3117372233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92281604a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9228161160 tx=0x7f922002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debd6388ccb15591 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.210+0000 7f92267fc640 1 -- 172.21.15.5:0/3117372233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220007740 con 0x7f9228160080 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.210+0000 7f92267fc640 1 -- 172.21.15.5:0/3117372233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922002d050 con 0x7f9228160080 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.210+0000 7f92267fc640 1 -- 172.21.15.5:0/3117372233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220007ac0 con 0x7f9228160080 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 -- 172.21.15.5:0/3117372233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 msgr2=0x7f92281604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 --2- 172.21.15.5:0/3117372233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92281604a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9228161160 tx=0x7f922002a5f0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 -- 172.21.15.5:0/3117372233 shutdown_connections 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 --2- 172.21.15.5:0/3117372233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92281604a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 --2- 172.21.15.5:0/3117372233 >> v2:172.21.15.179:3300/0 conn(0x7f92280b43f0 0x7f92280b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 -- 172.21.15.5:0/3117372233 >> 172.21.15.5:0/3117372233 conn(0x7f9228071850 msgr2=0x7f9228069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 -- 172.21.15.5:0/3117372233 shutdown_connections 2024-09-13T17:14:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.211+0000 7f922e108640 1 -- 172.21.15.5:0/3117372233 wait complete. 2024-09-13T17:14:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.212+0000 7f922e108640 1 Processor -- start 2024-09-13T17:14:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.212+0000 7f922e108640 1 -- start start 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92280ae3a0 0x7f92281394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92280b43f0 0x7f92281406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92281417e0 con 0x7f9228160080 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228153d30 con 0x7f92280ae3a0 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f922e108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92281399f0 con 0x7f92280b43f0 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f9227fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f9227fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33488/0 (socket says 172.21.15.5:33488) 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f9227fff640 1 -- 172.21.15.5:0/2638351036 learned_addr learned my addr 172.21.15.5:0/2638351036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f92277fe640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92280ae3a0 0x7f92281394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.213+0000 7f9226ffd640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92280b43f0 0x7f92281406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 -- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92280b43f0 msgr2=0x7f92281406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92280b43f0 0x7f92281406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 -- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92280ae3a0 msgr2=0x7f92281394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92280ae3a0 0x7f92281394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 -- 172.21.15.5:0/2638351036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009a70 con 0x7f9228160080 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f9227fff640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f922002abe0 tx=0x7f9220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220031910 con 0x7f9228160080 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220031a70 con 0x7f9228160080 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9228140f40 con 0x7f9228160080 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220031de0 con 0x7f9228160080 2024-09-13T17:14:19.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.214+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228141500 con 0x7f9228160080 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.215+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9228153ae0 con 0x7f9228160080 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.215+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f922003b410 con 0x7f9228160080 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.216+0000 7f920ffff640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 0x7f921406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.216+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f92200aae30 con 0x7f9228160080 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.216+0000 7f92277fe640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 0x7f921406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:19.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.217+0000 7f92277fe640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 0x7f921406d0f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9218005880 tx=0x7f9218009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:19.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.220+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9220075e60 con 0x7f9228160080 2024-09-13T17:14:19.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:19.398+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f92281604a0 con 0x7f9228160080 2024-09-13T17:14:20.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.081+0000 7f920ffff640 1 -- 172.21.15.5:0/2638351036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9220079480 con 0x7f9228160080 2024-09-13T17:14:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:14:20.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 msgr2=0x7f921406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 0x7f921406d0f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9218005880 tx=0x7f9218009040 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 msgr2=0x7f92280af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f922002abe0 tx=0x7f9220004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 shutdown_connections 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f921406ac30 0x7f921406d0f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9228160080 0x7f92280af610 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92280b43f0 0x7f92281406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 --2- 172.21.15.5:0/2638351036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92280ae3a0 0x7f92281394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.085+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 >> 172.21.15.5:0/2638351036 conn(0x7f9228071850 msgr2=0x7f922815e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.086+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 shutdown_connections 2024-09-13T17:14:20.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.086+0000 7f922e108640 1 -- 172.21.15.5:0/2638351036 wait complete. 2024-09-13T17:14:20.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.213+0000 7efccd2e9640 1 Processor -- start 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.213+0000 7efccd2e9640 1 -- start start 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efccd2e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 0x7efcc80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efccd2e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc80d3300 con 0x7efcc80cdbf0 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efccd2e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc80cd900 con 0x7efcc80b6e80 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efccd2e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80b5de0 con 0x7efcc80ccfe0 2024-09-13T17:14:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efcc67fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcc80cdbf0 0x7efcc80d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45922/0 (socket says 172.21.15.5:45922) 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.214+0000 7efcc67fc640 1 -- 172.21.15.5:0/4264010932 learned_addr learned my addr 172.21.15.5:0/4264010932 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc6ffd640 1 --2- 172.21.15.5:0/4264010932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 0x7efcc80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974301474 0 0) 0x7efcc80d3300 con 0x7efcc80cdbf0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb0003520 con 0x7efcc80cdbf0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54656995 0 0) 0x7efcc80cd900 con 0x7efcc80b6e80 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc80d3300 con 0x7efcc80b6e80 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc6ffd640 1 -- 172.21.15.5:0/4264010932 >> v1:172.21.15.179:6789/0 conn(0x7efcc80b6e80 legacy=0x7efcc80b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc6ffd640 1 -- 172.21.15.5:0/4264010932 >> v1:172.21.15.5:6789/0 conn(0x7efcc80cdbf0 legacy=0x7efcc80d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.215+0000 7efcc6ffd640 1 -- 172.21.15.5:0/4264010932 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc80b60c0 con 0x7efcc80ccfe0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.216+0000 7efcc6ffd640 1 --2- 172.21.15.5:0/4264010932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 0x7efcc80cd3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097d0 tx=0x7efcb802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2de9cd23e9c2314 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.216+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8032440 con 0x7efcc80ccfe0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.216+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb80325a0 con 0x7efcc80ccfe0 2024-09-13T17:14:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.216+0000 7efcc5ffb640 1 -- 172.21.15.5:0/4264010932 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8032910 con 0x7efcc80ccfe0 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 -- 172.21.15.5:0/4264010932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 msgr2=0x7efcc80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 --2- 172.21.15.5:0/4264010932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 0x7efcc80cd3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097d0 tx=0x7efcb802a210 comp rx=0 tx=0).stop 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 -- 172.21.15.5:0/4264010932 shutdown_connections 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 --2- 172.21.15.5:0/4264010932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80ccfe0 0x7efcc80cd3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 -- 172.21.15.5:0/4264010932 >> 172.21.15.5:0/4264010932 conn(0x7efcc8089f90 msgr2=0x7efcc80d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 -- 172.21.15.5:0/4264010932 shutdown_connections 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.217+0000 7efccd2e9640 1 -- 172.21.15.5:0/4264010932 wait complete. 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.218+0000 7efccd2e9640 1 Processor -- start 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.218+0000 7efccd2e9640 1 -- start start 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80b6e80 0x7efcc815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc80ccfe0 0x7efcc815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80c61b0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc815feb0 con 0x7efcc80ccfe0 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efccd2e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc814cdd0 con 0x7efcc80b6e80 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33494/0 (socket says 172.21.15.5:33494) 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80b6e80 0x7efcc815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 -- 172.21.15.5:0/2302448949 learned_addr learned my addr 172.21.15.5:0/2302448949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc67fc640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc80ccfe0 0x7efcc815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 -- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80b6e80 msgr2=0x7efcc815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80b6e80 0x7efcc815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 -- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc80ccfe0 msgr2=0x7efcc815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:20.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc80ccfe0 0x7efcc815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 -- 172.21.15.5:0/2302448949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8009400 con 0x7efcc80cdbf0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.219+0000 7efcc77fe640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c790 tx=0x7efcc000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000cea0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0003b70 con 0x7efcc80cdbf0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc815e390 con 0x7efcc80cdbf0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000a850 con 0x7efcc80cdbf0 2024-09-13T17:14:20.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc815e950 con 0x7efcc80cdbf0 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.220+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc806ced0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.221+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efcc000a9b0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.221+0000 7efcaf7fe640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 0x7efcb406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.222+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7efcc00890b0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.222+0000 7efcc6ffd640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 0x7efcb406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:20.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.222+0000 7efcc6ffd640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 0x7efcb406d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034000 tx=0x7efcb802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:20.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.226+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efcc00542f0 con 0x7efcc80cdbf0 2024-09-13T17:14:20.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:20.396+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcc80cd3c0 con 0x7efcc80cdbf0 2024-09-13T17:14:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.089+0000 7efcaf7fe640 1 -- 172.21.15.5:0/2302448949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7efcc0057910 con 0x7efcc80cdbf0 2024-09-13T17:14:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:14:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 msgr2=0x7efcb406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 0x7efcb406d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034000 tx=0x7efcb802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 msgr2=0x7efcc814c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c790 tx=0x7efcc000cc50 comp rx=0 tx=0).stop 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 shutdown_connections 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efcb406ac30 0x7efcb406d0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcc80cdbf0 0x7efcc814c890 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcc80ccfe0 0x7efcc815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 --2- 172.21.15.5:0/2302448949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcc80b6e80 0x7efcc815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.092+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 >> 172.21.15.5:0/2302448949 conn(0x7efcc8089f90 msgr2=0x7efcc806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.093+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 shutdown_connections 2024-09-13T17:14:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.093+0000 7efccd2e9640 1 -- 172.21.15.5:0/2302448949 wait complete. 2024-09-13T17:14:21.109 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:14:21.109 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:14:21.109 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:14:21.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:21.110 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:14:21.110 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:14:21.110 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:14:21.110 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:21.110 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:14:21.110 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:14:21.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:14:21.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:21.111 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:14:21.111 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:14:21.111 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:14:21.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:21.120 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:14:21.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:14:21.121 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:14:21.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:14:21.122 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:14:21.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:14:21.123 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:14:21.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:14:21.164 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:14:21.164 DEBUG:teuthology.parallel:result is None 2024-09-13T17:14:21.165 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:14:21.165 DEBUG:teuthology.parallel:result is None 2024-09-13T17:14:21.167 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:14:21.167 DEBUG:teuthology.parallel:result is None 2024-09-13T17:14:21.168 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:14:21.168 DEBUG:teuthology.parallel:result is None 2024-09-13T17:14:21.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:14:21.246 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:14:21.246 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:14:21.246 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:14:21.247 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:14:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.285+0000 7f83d531f640 1 Processor -- start 2024-09-13T17:14:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.285+0000 7f83d531f640 1 -- start start 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83d531f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83d00d06d0 0x7f83d00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83d531f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d00d1e80 con 0x7f83d015c810 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83d531f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d00d1750 con 0x7f83d00b4cf0 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83d531f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00d0bd0 con 0x7f83d00d06d0 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83cf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83d00d06d0 0x7f83d00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83ceffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83d015c810 0x7f83d00b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45952/0 (socket says 172.21.15.5:45952) 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.286+0000 7f83ceffd640 1 -- 172.21.15.5:0/464815176 learned_addr learned my addr 172.21.15.5:0/464815176 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.287+0000 7f83cf7fe640 1 -- 172.21.15.5:0/464815176 >> v1:172.21.15.179:6789/0 conn(0x7f83d00b4cf0 legacy=0x7f83d00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.287+0000 7f83cf7fe640 1 -- 172.21.15.5:0/464815176 >> v1:172.21.15.5:6789/0 conn(0x7f83d015c810 legacy=0x7f83d00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.287+0000 7f83cf7fe640 1 -- 172.21.15.5:0/464815176 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00d0eb0 con 0x7f83d00d06d0 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83cf7fe640 1 --2- 172.21.15.5:0/464815176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d00cd780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009d90 tx=0x7f83c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cef7f75eb749971 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83cdffb640 1 -- 172.21.15.5:0/464815176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8007740 con 0x7f83d00d06d0 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83cdffb640 1 -- 172.21.15.5:0/464815176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c802d050 con 0x7f83d00d06d0 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83cdffb640 1 -- 172.21.15.5:0/464815176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8007ac0 con 0x7f83d00d06d0 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83d531f640 1 -- 172.21.15.5:0/464815176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 msgr2=0x7f83d00cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83d531f640 1 --2- 172.21.15.5:0/464815176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d00cd780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009d90 tx=0x7f83c802a5f0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83d531f640 1 -- 172.21.15.5:0/464815176 shutdown_connections 2024-09-13T17:14:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83d531f640 1 --2- 172.21.15.5:0/464815176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d00cd780 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.288+0000 7f83d531f640 1 -- 172.21.15.5:0/464815176 >> 172.21.15.5:0/464815176 conn(0x7f83d00717a0 msgr2=0x7f83d0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.289+0000 7f83d531f640 1 -- 172.21.15.5:0/464815176 shutdown_connections 2024-09-13T17:14:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.289+0000 7f83d531f640 1 -- 172.21.15.5:0/464815176 wait complete. 2024-09-13T17:14:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.291+0000 7f83d531f640 1 Processor -- start 2024-09-13T17:14:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.291+0000 7f83d531f640 1 -- start start 2024-09-13T17:14:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83d531f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83d531f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83d531f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83d015c810 0x7f83d01592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83d531f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01562c0 con 0x7f83d00d06d0 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83ceffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83ceffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55212/0 (socket says 172.21.15.5:55212) 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.292+0000 7f83ceffd640 1 -- 172.21.15.5:0/3211348257 learned_addr learned my addr 172.21.15.5:0/3211348257 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01f5620 con 0x7f83d015c810 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01f25a0 con 0x7f83d00b4cf0 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83cf7fe640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83d015c810 0x7f83d01592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ce7fc640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ceffd640 1 -- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83d015c810 msgr2=0x7f83d01592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ceffd640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83d015c810 0x7f83d01592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ceffd640 1 -- 172.21.15.5:0/3211348257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 msgr2=0x7f83d0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ceffd640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d0155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.293+0000 7f83ceffd640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009a70 con 0x7f83d00b4cf0 2024-09-13T17:14:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83ceffd640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c5a0 tx=0x7f83c000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00074e0 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0007640 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0004a20 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d01f2880 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.294+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d01f2e40 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.295+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00672a0 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.295+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83c0004b80 con 0x7f83d00b4cf0 2024-09-13T17:14:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.296+0000 7f83c77fe640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.296+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f83c00882d0 con 0x7f83d00b4cf0 2024-09-13T17:14:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.296+0000 7f83ce7fc640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.297+0000 7f83ce7fc640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 0x7f83b006d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83d01f24d0 tx=0x7f83b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.301+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83c0053790 con 0x7f83d00b4cf0 2024-09-13T17:14:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:21.484+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f83d008a360 con 0x7f83d00b4cf0 2024-09-13T17:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.272+0000 7f83c77fe640 1 -- 172.21.15.5:0/3211348257 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f83c0056db0 con 0x7f83d00b4cf0 2024-09-13T17:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 msgr2=0x7f83b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 0x7f83b006d0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83d01f24d0 tx=0x7f83b8009040 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 msgr2=0x7f83d01f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83c000c5a0 tx=0x7f83c000ca60 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 shutdown_connections 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83d015c810 0x7f83d01592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83d00d06d0 0x7f83d0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 --2- 172.21.15.5:0/3211348257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83d00b4cf0 0x7f83d01f1f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 >> 172.21.15.5:0/3211348257 conn(0x7f83d00717a0 msgr2=0x7f83d00d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 shutdown_connections 2024-09-13T17:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.275+0000 7f83d531f640 1 -- 172.21.15.5:0/3211348257 wait complete. 2024-09-13T17:14:22.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.388+0000 7f83ab911640 1 Processor -- start 2024-09-13T17:14:22.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.388+0000 7f83ab911640 1 -- start start 2024-09-13T17:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83ab911640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83a40b1ac0 0x7f83a415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83ab911640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40b35f0 con 0x7f83a406eb80 2024-09-13T17:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83ab911640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a4156f50 con 0x7f83a406ef60 2024-09-13T17:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83ab911640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a4160020 con 0x7f83a40b1ac0 2024-09-13T17:14:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83a96ad640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83a406eb80 0x7f83a40b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45966/0 (socket says 172.21.15.5:45966) 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83a96ad640 1 -- 172.21.15.5:0/1470662139 learned_addr learned my addr 172.21.15.5:0/1470662139 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942838528 0 0) 0x7f83a40b35f0 con 0x7f83a406eb80 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c003520 con 0x7f83a406eb80 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.389+0000 7f83a8eac640 1 --2- 172.21.15.5:0/1470662139 >> v2:172.21.15.179:3300/0 conn(0x7f83a40b1ac0 0x7f83a415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811803917 0 0) 0x7f838c003520 con 0x7f83a406eb80 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 >> v2:172.21.15.179:3300/0 conn(0x7f83a40b1ac0 msgr2=0x7f83a415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 --2- 172.21.15.5:0/1470662139 >> v2:172.21.15.179:3300/0 conn(0x7f83a40b1ac0 0x7f83a415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 >> v1:172.21.15.179:6789/0 conn(0x7f83a406ef60 legacy=0x7f83a406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40b1fa0 con 0x7f83a406eb80 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f83940019f0 con 0x7f83a406eb80 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 >> v1:172.21.15.5:6789/0 conn(0x7f83a406eb80 legacy=0x7f83a40b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 0x7f838c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838c0047c0 0x7f838c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c005180 0x7f838c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4160020 con 0x7f838c005180 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c00c020 con 0x7f838c003970 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c00c1e0 con 0x7f838c0047c0 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 0x7f838c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a9eae640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c005180 0x7f838c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a8eac640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838c0047c0 0x7f838c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 -- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838c0047c0 msgr2=0x7f838c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838c0047c0 0x7f838c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 -- 172.21.15.5:0/1470662139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c005180 msgr2=0x7f838c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c005180 0x7f838c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a96ad640 1 -- 172.21.15.5:0/1470662139 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c003520 con 0x7f838c003970 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a9eae640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c005180 0x7f838c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.390+0000 7f83a9eae640 1 -- 172.21.15.5:0/1470662139 reap_dead start 2024-09-13T17:14:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.391+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 0x7f838c003d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f839400a830 tx=0x7f838c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ceeb4fbe39e9a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.391+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839402ba50 con 0x7f838c003970 2024-09-13T17:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.391+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839402bbb0 con 0x7f838c003970 2024-09-13T17:14:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.391+0000 7f83a3fff640 1 -- 172.21.15.5:0/1470662139 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394034470 con 0x7f838c003970 2024-09-13T17:14:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 -- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 msgr2=0x7f838c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 0x7f838c003d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f839400a830 tx=0x7f838c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 -- 172.21.15.5:0/1470662139 shutdown_connections 2024-09-13T17:14:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 --2- 172.21.15.5:0/1470662139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f838c003970 0x7f838c003d90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 -- 172.21.15.5:0/1470662139 >> 172.21.15.5:0/1470662139 conn(0x7f83a4070af0 msgr2=0x7f83a4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 -- 172.21.15.5:0/1470662139 shutdown_connections 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.392+0000 7f83ab911640 1 -- 172.21.15.5:0/1470662139 wait complete. 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.393+0000 7f83ab911640 1 Processor -- start 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.393+0000 7f83ab911640 1 -- start start 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a4144570 0x7f83a4144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a4145400 0x7f83a40ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41449f0 con 0x7f838c003970 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4145940 con 0x7f83a4145400 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83ab911640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4145c20 con 0x7f83a4144570 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33580/0 (socket says 172.21.15.5:33580) 2024-09-13T17:14:22.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 -- 172.21.15.5:0/1194564749 learned_addr learned my addr 172.21.15.5:0/1194564749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a8eac640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a4144570 0x7f83a4144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a9eae640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a4145400 0x7f83a40ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 -- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a4144570 msgr2=0x7f83a4144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a4144570 0x7f83a4144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 -- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a4145400 msgr2=0x7f83a40ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a4145400 0x7f83a40ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 -- 172.21.15.5:0/1194564749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4145f00 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.394+0000 7f83a96ad640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f839400a830 tx=0x7f8394001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.395+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839403b040 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.395+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394034470 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.395+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a41461e0 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.395+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394034820 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.395+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4147200 con 0x7f838c003970 2024-09-13T17:14:22.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.396+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40672e0 con 0x7f838c003970 2024-09-13T17:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.396+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8394031070 con 0x7f838c003970 2024-09-13T17:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.397+0000 7f83a1ffb640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 0x7f839006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.397+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f83940a9510 con 0x7f838c003970 2024-09-13T17:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.397+0000 7f83a8eac640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 0x7f839006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.398+0000 7f83a8eac640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 0x7f839006d0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83a415c3a0 tx=0x7f8398008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.401+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83940748f0 con 0x7f838c003970 2024-09-13T17:14:22.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.639+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83a40b3db0 con 0x7f838c003970 2024-09-13T17:14:22.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.640+0000 7f83a1ffb640 1 -- 172.21.15.5:0/1194564749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8394077f10 con 0x7f838c003970 2024-09-13T17:14:22.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:22.642 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:14:22.642 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:14:22.649 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.651 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.653 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:14:22.653 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:14:22.653 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:14:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:14:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:14:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:14:22.657 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:14:22.657 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:14:22.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:14:22.658 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRmZM9QBRAA176vw/6qA1pAqMxObUw0fg==", 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRmIuBQBRAAGJEEdcZCqxZGWFhljAVcBQ==", 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRm8edQBRAA0pS002FtsX0ts9qjg3I00g==", 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T17:14:22.662 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRmiu9QBRAAEkTyGWrS9LKmf7tpzsAayA==", 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRmLvdQBRAAmEWbu0TiJmXJtX6E55D51Q==", 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T17:14:22.663 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCTcuRmrwFRBRAAZyELILNOv86WD9v+gHeYPg==", 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:14:22.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:22.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:14:22.666 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:14:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 msgr2=0x7f839006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 0x7f839006d0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83a415c3a0 tx=0x7f8398008040 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 msgr2=0x7f83a41469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f839400a830 tx=0x7f8394001d80 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 shutdown_connections 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a4145400 0x7f83a40ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a4144570 0x7f83a4144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f839006ac30 0x7f839006d0f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 --2- 172.21.15.5:0/1194564749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f838c003970 0x7f83a41469e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 >> 172.21.15.5:0/1194564749 conn(0x7f83a4070af0 msgr2=0x7f83a415dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 shutdown_connections 2024-09-13T17:14:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.642+0000 7f83ab911640 1 -- 172.21.15.5:0/1194564749 wait complete. 2024-09-13T17:14:22.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T17:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.776+0000 7fc5b5365640 1 Processor -- start 2024-09-13T17:14:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.776+0000 7fc5b5365640 1 -- start start 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5b5365640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5b015ff70 0x7fc5b00b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5b5365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b00b15b0 0x7fc5b00cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5b5365640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00b0be0 con 0x7fc5b015fb90 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5b5365640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00affd0 con 0x7fc5b015ff70 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5b5365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00b02b0 con 0x7fc5b00b15b0 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5ae7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5b015ff70 0x7fc5b00b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5ae7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5b015ff70 0x7fc5b00b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33594/0 (socket says 172.21.15.5:33594) 2024-09-13T17:14:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.777+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/744255964 learned_addr learned my addr 172.21.15.5:0/744255964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.778+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/744255964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b00b15b0 msgr2=0x7fc5b00cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.778+0000 7fc5ae7fc640 1 --2- 172.21.15.5:0/744255964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b00b15b0 0x7fc5b00cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.778+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/744255964 >> v1:172.21.15.179:6789/0 conn(0x7fc5b015fb90 legacy=0x7fc5b00b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.778+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/744255964 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00b0590 con 0x7fc5b015ff70 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.778+0000 7fc5ae7fc640 1 --2- 172.21.15.5:0/744255964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015ff70 0x7fc5b00b1070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009850 tx=0x7fc5a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3e82eafd10c896 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5adffb640 1 -- 172.21.15.5:0/744255964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4004030 con 0x7fc5b015ff70 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5adffb640 1 -- 172.21.15.5:0/744255964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4004190 con 0x7fc5b015ff70 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5adffb640 1 -- 172.21.15.5:0/744255964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4003610 con 0x7fc5b015ff70 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 -- 172.21.15.5:0/744255964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015ff70 msgr2=0x7fc5b00b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 --2- 172.21.15.5:0/744255964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015ff70 0x7fc5b00b1070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009850 tx=0x7fc5a402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 -- 172.21.15.5:0/744255964 shutdown_connections 2024-09-13T17:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 --2- 172.21.15.5:0/744255964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b00b15b0 0x7fc5b00cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 --2- 172.21.15.5:0/744255964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015ff70 0x7fc5b00b1070 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 -- 172.21.15.5:0/744255964 >> 172.21.15.5:0/744255964 conn(0x7fc5b0089f90 msgr2=0x7fc5b00d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 -- 172.21.15.5:0/744255964 shutdown_connections 2024-09-13T17:14:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.779+0000 7fc5b5365640 1 -- 172.21.15.5:0/744255964 wait complete. 2024-09-13T17:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 Processor -- start 2024-09-13T17:14:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 -- start start 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b00b15b0 0x7fc5b0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b015ff70 0x7fc5b00b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b0153fa0 con 0x7fc5b015fb90 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b009ed40 con 0x7fc5b00b15b0 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5b5365640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b01f3370 con 0x7fc5b015ff70 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5ae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5ae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33604/0 (socket says 172.21.15.5:33604) 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.781+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/1441407020 learned_addr learned my addr 172.21.15.5:0/1441407020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5aeffd640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b00b15b0 0x7fc5b0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5af7fe640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b015ff70 0x7fc5b00b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b015ff70 msgr2=0x7fc5b00b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b015ff70 0x7fc5b00b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b00b15b0 msgr2=0x7fc5b0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b00b15b0 0x7fc5b0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 -- 172.21.15.5:0/1441407020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009460 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5ae7fc640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a220 tx=0x7fc5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4003a20 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4003ba0 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b01f3090 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4006040 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.782+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b009f230 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.783+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00cd1e0 con 0x7fc5b015fb90 2024-09-13T17:14:22.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.784+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5a40061a0 con 0x7fc5b015fb90 2024-09-13T17:14:22.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.784+0000 7fc5977fe640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 0x7fc59c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:22.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.784+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc5a40aa280 con 0x7fc5b015fb90 2024-09-13T17:14:22.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.784+0000 7fc5aeffd640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 0x7fc59c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:22.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.785+0000 7fc5aeffd640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 0x7fc59c06d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5b008be10 tx=0x7fc5a0003d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:22.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:22.788+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc5a4075840 con 0x7fc5b015fb90 2024-09-13T17:14:23.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.023+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc5b00d1890 con 0x7fc5b015fb90 2024-09-13T17:14:23.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.027+0000 7fc5977fe640 1 -- 172.21.15.5:0/1441407020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc5a4078e60 con 0x7fc5b015fb90 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.028+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 msgr2=0x7fc59c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.028+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 0x7fc59c06d0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5b008be10 tx=0x7fc5a0003d90 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.028+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 msgr2=0x7fc5b009fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.028+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402a220 tx=0x7fc5a40046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.028+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 shutdown_connections 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5b015ff70 0x7fc5b00b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc59c06ac00 0x7fc59c06d0c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5b015fb90 0x7fc5b009fa30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 --2- 172.21.15.5:0/1441407020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5b00b15b0 0x7fc5b0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 >> 172.21.15.5:0/1441407020 conn(0x7fc5b0089f90 msgr2=0x7fc5b00b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 shutdown_connections 2024-09-13T17:14:23.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.029+0000 7fc5b5365640 1 -- 172.21.15.5:0/1441407020 wait complete. 2024-09-13T17:14:23.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T17:14:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.142+0000 7fac646d0640 1 Processor -- start 2024-09-13T17:14:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.142+0000 7fac646d0640 1 -- start start 2024-09-13T17:14:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac646d0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 0x7fac5c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac646d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5c0ae320 0x7fac5c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac646d0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0b1ac0 con 0x7fac5c0b2230 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac646d0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c15cf70 con 0x7fac5c0ae320 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac646d0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c15d210 con 0x7fac5c0adf40 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac61c6b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5c0ae320 0x7fac5c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac62c6d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac5c0b2230 0x7fac5c06df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45972/0 (socket says 172.21.15.5:45972) 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac62c6d640 1 -- 172.21.15.5:0/2204646834 learned_addr learned my addr 172.21.15.5:0/2204646834 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac61c6b640 1 -- 172.21.15.5:0/2204646834 >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 msgr2=0x7fac5c160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac6246c640 1 --2- 172.21.15.5:0/2204646834 >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 0x7fac5c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac61c6b640 1 --2- 172.21.15.5:0/2204646834 >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 0x7fac5c160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac61c6b640 1 -- 172.21.15.5:0/2204646834 >> v1:172.21.15.5:6789/0 conn(0x7fac5c0b2230 legacy=0x7fac5c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac61c6b640 1 -- 172.21.15.5:0/2204646834 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c15d4f0 con 0x7fac5c0ae320 2024-09-13T17:14:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac6146a640 1 -- 172.21.15.5:0/2204646834 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036279585 0 0) 0x7fac5c0b1ac0 con 0x7fac5c0b2230 2024-09-13T17:14:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.143+0000 7fac6246c640 1 --2- 172.21.15.5:0/2204646834 >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 0x7fac5c160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.144+0000 7fac61c6b640 1 --2- 172.21.15.5:0/2204646834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0ae320 0x7fac5c15ca30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac5c071c60 tx=0x7fac4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85f793646a309a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.144+0000 7fac6146a640 1 -- 172.21.15.5:0/2204646834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c032440 con 0x7fac5c0ae320 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.144+0000 7fac6146a640 1 -- 172.21.15.5:0/2204646834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c0325a0 con 0x7fac5c0ae320 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.144+0000 7fac6146a640 1 -- 172.21.15.5:0/2204646834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c032930 con 0x7fac5c0ae320 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 -- 172.21.15.5:0/2204646834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0ae320 msgr2=0x7fac5c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 --2- 172.21.15.5:0/2204646834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0ae320 0x7fac5c15ca30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac5c071c60 tx=0x7fac4c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 -- 172.21.15.5:0/2204646834 shutdown_connections 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 --2- 172.21.15.5:0/2204646834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0ae320 0x7fac5c15ca30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 --2- 172.21.15.5:0/2204646834 >> v2:172.21.15.179:3300/0 conn(0x7fac5c0adf40 0x7fac5c160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 -- 172.21.15.5:0/2204646834 >> 172.21.15.5:0/2204646834 conn(0x7fac5c070af0 msgr2=0x7fac5c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 -- 172.21.15.5:0/2204646834 shutdown_connections 2024-09-13T17:14:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.145+0000 7fac646d0640 1 -- 172.21.15.5:0/2204646834 wait complete. 2024-09-13T17:14:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.146+0000 7fac646d0640 1 Processor -- start 2024-09-13T17:14:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.146+0000 7fac646d0640 1 -- start start 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac5c0adf40 0x7fac5c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 0x7fac5c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15a060 con 0x7fac5c0b2230 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15db40 con 0x7fac5c0adf40 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15e6c0 con 0x7fac5c0ae320 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33620/0 (socket says 172.21.15.5:33620) 2024-09-13T17:14:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 -- 172.21.15.5:0/517854477 learned_addr learned my addr 172.21.15.5:0/517854477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac6246c640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac5c0adf40 0x7fac5c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac61c6b640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 0x7fac5c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 -- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 msgr2=0x7fac5c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 0x7fac5c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 -- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac5c0adf40 msgr2=0x7fac5c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac5c0adf40 0x7fac5c152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 -- 172.21.15.5:0/517854477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009400 con 0x7fac5c0b2230 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac61c6b640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 0x7fac5c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac62c6d640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fac5400c7b0 tx=0x7fac5400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400a640 con 0x7fac5c0b2230 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400a7c0 con 0x7fac5c0b2230 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c15eb50 con 0x7fac5c0b2230 2024-09-13T17:14:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.147+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400ab70 con 0x7fac5c0b2230 2024-09-13T17:14:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.148+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c15e070 con 0x7fac5c0b2230 2024-09-13T17:14:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.148+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c0672e0 con 0x7fac5c0b2230 2024-09-13T17:14:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.149+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac5400acd0 con 0x7fac5c0b2230 2024-09-13T17:14:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.149+0000 7fac52ffd640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 0x7fac4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.150+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fac54088940 con 0x7fac5c0b2230 2024-09-13T17:14:23.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.150+0000 7fac6246c640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 0x7fac4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.150+0000 7fac6246c640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 0x7fac4006d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac5800ab60 tx=0x7fac58008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.154+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac54053d40 con 0x7fac5c0b2230 2024-09-13T17:14:23.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.390+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fac5c0b26a0 con 0x7fac5c0b2230 2024-09-13T17:14:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.394+0000 7fac52ffd640 1 -- 172.21.15.5:0/517854477 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fac54018020 con 0x7fac5c0b2230 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 msgr2=0x7fac4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 0x7fac4006d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fac5800ab60 tx=0x7fac58008040 comp rx=0 tx=0).stop 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 msgr2=0x7fac5c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fac5400c7b0 tx=0x7fac5400cc70 comp rx=0 tx=0).stop 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 shutdown_connections 2024-09-13T17:14:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac4006ac00 0x7fac4006d0c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5c0b2230 0x7fac5c1553b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac5c0ae320 0x7fac5c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 --2- 172.21.15.5:0/517854477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac5c0adf40 0x7fac5c152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 >> 172.21.15.5:0/517854477 conn(0x7fac5c070af0 msgr2=0x7fac5c0ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 shutdown_connections 2024-09-13T17:14:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.396+0000 7fac646d0640 1 -- 172.21.15.5:0/517854477 wait complete. 2024-09-13T17:14:23.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T17:14:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.509+0000 7f838730f640 1 Processor -- start 2024-09-13T17:14:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.509+0000 7f838730f640 1 -- start start 2024-09-13T17:14:23.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f838730f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83800b2c40 0x7f83800ad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f838730f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838006c1b0 con 0x7f838015a250 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f838730f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800b1b50 con 0x7f83800ad550 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f838730f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800b3080 con 0x7f83800b2c40 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83800b2c40 0x7f83800ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83800b2c40 0x7f83800ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36170/0 (socket says 172.21.15.5:36170) 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83850ab640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f838015a250 0x7f83800b1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40736/0 (socket says 172.21.15.5:40736) 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 -- 172.21.15.5:0/700715320 learned_addr learned my addr 172.21.15.5:0/700715320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 -- 172.21.15.5:0/700715320 >> v1:172.21.15.179:6789/0 conn(0x7f83800ad550 legacy=0x7f838006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 -- 172.21.15.5:0/700715320 >> v1:172.21.15.5:6789/0 conn(0x7f838015a250 legacy=0x7f83800b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f83848aa640 1 -- 172.21.15.5:0/700715320 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800b1e30 con 0x7f83800b2c40 2024-09-13T17:14:23.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.510+0000 7f8377fff640 1 -- 172.21.15.5:0/700715320 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414110559 0 0) 0x7f838006c1b0 con 0x7f838015a250 2024-09-13T17:14:23.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.511+0000 7f83848aa640 1 --2- 172.21.15.5:0/700715320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800b2c40 0x7f83800ad010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8370009870 tx=0x7f837002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c644a1d86ecf0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.511+0000 7f8377fff640 1 -- 172.21.15.5:0/700715320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370032440 con 0x7f83800b2c40 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.511+0000 7f8377fff640 1 -- 172.21.15.5:0/700715320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83700325a0 con 0x7f83800b2c40 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.511+0000 7f8377fff640 1 -- 172.21.15.5:0/700715320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370032930 con 0x7f83800b2c40 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 -- 172.21.15.5:0/700715320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800b2c40 msgr2=0x7f83800ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 --2- 172.21.15.5:0/700715320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800b2c40 0x7f83800ad010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8370009870 tx=0x7f837002a2a0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 -- 172.21.15.5:0/700715320 shutdown_connections 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 --2- 172.21.15.5:0/700715320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800b2c40 0x7f83800ad010 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 -- 172.21.15.5:0/700715320 >> 172.21.15.5:0/700715320 conn(0x7f83800ce0d0 msgr2=0x7f83800ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 -- 172.21.15.5:0/700715320 shutdown_connections 2024-09-13T17:14:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.512+0000 7f838730f640 1 -- 172.21.15.5:0/700715320 wait complete. 2024-09-13T17:14:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.513+0000 7f838730f640 1 Processor -- start 2024-09-13T17:14:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.513+0000 7f838730f640 1 -- start start 2024-09-13T17:14:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83800b2c40 0x7f8380152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 0x7f838015dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838014c6b0 con 0x7f83800ad550 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380153830 con 0x7f83800b2c40 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8380152c20 con 0x7f838015a250 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36186/0 (socket says 172.21.15.5:36186) 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 -- 172.21.15.5:0/2915357661 learned_addr learned my addr 172.21.15.5:0/2915357661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83848aa640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83800b2c40 0x7f8380152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83858ac640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 0x7f838015dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 -- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 msgr2=0x7f838015dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 0x7f838015dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 -- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83800b2c40 msgr2=0x7f8380152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83800b2c40 0x7f8380152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 -- 172.21.15.5:0/2915357661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700094d0 con 0x7f83800ad550 2024-09-13T17:14:23.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83858ac640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 0x7f838015dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f83850ab640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c430 tx=0x7f837c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0074e0 con 0x7f83800ad550 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c007660 con 0x7f83800ad550 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8380152f00 con 0x7f83800ad550 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.514+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c004a20 con 0x7f83800ad550 2024-09-13T17:14:23.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.515+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83801534c0 con 0x7f83800ad550 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.516+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83800672a0 con 0x7f83800ad550 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.516+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f837c004b80 con 0x7f83800ad550 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.516+0000 7f8375ffb640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 0x7f836406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.516+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f837c088f30 con 0x7f83800ad550 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.517+0000 7f83848aa640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 0x7f836406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.517+0000 7f83848aa640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 0x7f836406d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8370034000 tx=0x7f837002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.520+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f837c054320 con 0x7f83800ad550 2024-09-13T17:14:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.759+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f838006ce80 con 0x7f83800ad550 2024-09-13T17:14:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.763+0000 7f8375ffb640 1 -- 172.21.15.5:0/2915357661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f837c057940 con 0x7f83800ad550 2024-09-13T17:14:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 msgr2=0x7f836406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 0x7f836406d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8370034000 tx=0x7f837002e000 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 msgr2=0x7f838014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c430 tx=0x7f837c00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 shutdown_connections 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f838015a250 0x7f838015dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83800b2c40 0x7f8380152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f836406ac00 0x7f836406d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 --2- 172.21.15.5:0/2915357661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83800ad550 0x7f838014c170 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 >> 172.21.15.5:0/2915357661 conn(0x7f83800ce0d0 msgr2=0x7f83800af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 shutdown_connections 2024-09-13T17:14:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.765+0000 7f838730f640 1 -- 172.21.15.5:0/2915357661 wait complete. 2024-09-13T17:14:23.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T17:14:23.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.879+0000 7f4fb9f08640 1 Processor -- start 2024-09-13T17:14:23.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.879+0000 7f4fb9f08640 1 -- start start 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb9f08640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4fb406d670 0x7f4fb4164f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb9f08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb406c1b0 con 0x7f4fb40b2c40 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb9f08640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb40b1b50 con 0x7f4fb415a250 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb9f08640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb40b3080 con 0x7f4fb406d670 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fb40b2c40 0x7f4fb40ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40752/0 (socket says 172.21.15.5:40752) 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb2ffd640 1 -- 172.21.15.5:0/1314570206 learned_addr learned my addr 172.21.15.5:0/1314570206 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/1314570206 >> v2:172.21.15.179:3300/0 conn(0x7f4fb406d670 0x7f4fb4164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.880+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403991414 0 0) 0x7f4fb406c1b0 con 0x7f4fb40b2c40 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f9c003520 con 0x7f4fb40b2c40 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1610365171 0 0) 0x7f4f9c003520 con 0x7f4fb40b2c40 2024-09-13T17:14:23.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 >> v2:172.21.15.179:3300/0 conn(0x7f4fb406d670 msgr2=0x7f4fb4164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 --2- 172.21.15.5:0/1314570206 >> v2:172.21.15.179:3300/0 conn(0x7f4fb406d670 0x7f4fb4164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 >> v1:172.21.15.179:6789/0 conn(0x7f4fb415a250 legacy=0x7f4fb40b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40b1e30 con 0x7f4fb40b2c40 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f4fa8001670 con 0x7f4fb40b2c40 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 >> v1:172.21.15.5:6789/0 conn(0x7f4fb40b2c40 legacy=0x7f4fb40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f9c003970 0x7f4f9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f9c005180 0x7f4f9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00c0f0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00c260 con 0x7f4f9c005180 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c00c420 con 0x7f4f9c003970 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f9c005180 0x7f4f9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f9c003970 0x7f4f9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 -- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f9c003970 msgr2=0x7f4f9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f9c003970 0x7f4f9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 -- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f9c005180 msgr2=0x7f4f9c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f9c005180 0x7f4f9c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb2ffd640 1 -- 172.21.15.5:0/1314570206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c003520 con 0x7f4f9c0047c0 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f9c005180 0x7f4f9c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.881+0000 7f4fb3fff640 1 -- 172.21.15.5:0/1314570206 reap_dead start 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.882+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800c190 tx=0x7f4f9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b046c2a32d5804 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.882+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8005ad0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.882+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa802d070 con 0x7f4f9c0047c0 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.882+0000 7f4fb27fc640 1 -- 172.21.15.5:0/1314570206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8007070 con 0x7f4f9c0047c0 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 -- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 msgr2=0x7f4f9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800c190 tx=0x7f4f9c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 -- 172.21.15.5:0/1314570206 shutdown_connections 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/1314570206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4f9c004c40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 -- 172.21.15.5:0/1314570206 >> 172.21.15.5:0/1314570206 conn(0x7f4fb40ce0d0 msgr2=0x7f4fb40ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 -- 172.21.15.5:0/1314570206 shutdown_connections 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.883+0000 7f4fb9f08640 1 -- 172.21.15.5:0/1314570206 wait complete. 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.884+0000 7f4fb9f08640 1 Processor -- start 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.884+0000 7f4fb9f08640 1 -- start start 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fb4159160 0x7f4fb41f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb414a050 0x7f4fb4155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4148fb0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4149290 con 0x7f4fb414a050 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb9f08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4149570 con 0x7f4fb4159160 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36198/0 (socket says 172.21.15.5:36198) 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 -- 172.21.15.5:0/2081838781 learned_addr learned my addr 172.21.15.5:0/2081838781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb414a050 0x7f4fb4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fb4159160 0x7f4fb41f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 -- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fb4159160 msgr2=0x7f4fb41f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fb4159160 0x7f4fb41f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 -- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb414a050 msgr2=0x7f4fb4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb414a050 0x7f4fb4155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 -- 172.21.15.5:0/2081838781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4149850 con 0x7f4f9c0047c0 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e4d0 tx=0x7f4fa400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.885+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40053a0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.886+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa40035f0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.886+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb4149b30 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.886+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4003980 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.886+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41f2550 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.887+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb40672a0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.887+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4fa4003ae0 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.887+0000 7f4f9bfff640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 0x7f4fa006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.888+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4fa4088d20 con 0x7f4f9c0047c0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.888+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 0x7f4fa006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:23.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.888+0000 7f4fb2ffd640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 0x7f4fa006d0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8007fd0 tx=0x7f4fa802d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:23.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:23.892+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4fa4054250 con 0x7f4f9c0047c0 2024-09-13T17:14:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.130+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4fb40b1720 con 0x7f4f9c0047c0 2024-09-13T17:14:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.133+0000 7f4f9bfff640 1 -- 172.21.15.5:0/2081838781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4fa4057870 con 0x7f4f9c0047c0 2024-09-13T17:14:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 msgr2=0x7f4fa006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 0x7f4fa006d0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8007fd0 tx=0x7f4fa802d000 comp rx=0 tx=0).stop 2024-09-13T17:14:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 msgr2=0x7f4fb413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e4d0 tx=0x7f4fa400e990 comp rx=0 tx=0).stop 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 shutdown_connections 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb414a050 0x7f4fb4155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fb4159160 0x7f4fb41f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fa006ac30 0x7f4fa006d0f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 --2- 172.21.15.5:0/2081838781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f9c0047c0 0x7f4fb413c690 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 >> 172.21.15.5:0/2081838781 conn(0x7f4fb40ce0d0 msgr2=0x7f4fb415a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 shutdown_connections 2024-09-13T17:14:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.135+0000 7f4fb9f08640 1 -- 172.21.15.5:0/2081838781 wait complete. 2024-09-13T17:14:24.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T17:14:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.249+0000 7f4473273640 1 Processor -- start 2024-09-13T17:14:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.249+0000 7f4473273640 1 -- start start 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4473273640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 0x7f446c0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4473273640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0704a0 con 0x7f446c15fd80 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4473273640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c06bd80 con 0x7f446c099110 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4473273640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c06cc10 con 0x7f446c0cfd30 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f447100f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f446c15fd80 0x7f446c098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40758/0 (socket says 172.21.15.5:40758) 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f447100f640 1 -- 172.21.15.5:0/1910284236 learned_addr learned my addr 172.21.15.5:0/1910284236 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4471810640 1 --2- 172.21.15.5:0/1910284236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 0x7f446c0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763350596 0 0) 0x7f446c0704a0 con 0x7f446c15fd80 2024-09-13T17:14:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4458003520 con 0x7f446c15fd80 2024-09-13T17:14:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531315538 0 0) 0x7f446c06bd80 con 0x7f446c099110 2024-09-13T17:14:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c0704a0 con 0x7f446c099110 2024-09-13T17:14:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.250+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090829114 0 0) 0x7f4458003520 con 0x7f446c15fd80 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.251+0000 7f4471810640 1 -- 172.21.15.5:0/1910284236 >> v1:172.21.15.179:6789/0 conn(0x7f446c099110 legacy=0x7f446c06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.251+0000 7f4471810640 1 -- 172.21.15.5:0/1910284236 >> v1:172.21.15.5:6789/0 conn(0x7f446c15fd80 legacy=0x7f446c098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.251+0000 7f4471810640 1 -- 172.21.15.5:0/1910284236 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c06c210 con 0x7f446c0cfd30 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.251+0000 7f4471810640 1 --2- 172.21.15.5:0/1910284236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 0x7f446c0d0e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4464009dc0 tx=0x7f446402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5108c141e76dfccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468001670 con 0x7f446c0cfd30 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446402d050 con 0x7f446c0cfd30 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4463fff640 1 -- 172.21.15.5:0/1910284236 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464007740 con 0x7f446c0cfd30 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 -- 172.21.15.5:0/1910284236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 msgr2=0x7f446c0d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 --2- 172.21.15.5:0/1910284236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 0x7f446c0d0e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4464009dc0 tx=0x7f446402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 -- 172.21.15.5:0/1910284236 shutdown_connections 2024-09-13T17:14:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 --2- 172.21.15.5:0/1910284236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c0cfd30 0x7f446c0d0e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 -- 172.21.15.5:0/1910284236 >> 172.21.15.5:0/1910284236 conn(0x7f446c0d0310 msgr2=0x7f446c0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 -- 172.21.15.5:0/1910284236 shutdown_connections 2024-09-13T17:14:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.252+0000 7f4473273640 1 -- 172.21.15.5:0/1910284236 wait complete. 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.253+0000 7f4473273640 1 Processor -- start 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.253+0000 7f4473273640 1 -- start start 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c099110 0x7f446c0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f446c15fd80 0x7f446c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0c52b0 con 0x7f446c0cfd30 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b5220 con 0x7f446c15fd80 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4473273640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b54a0 con 0x7f446c099110 2024-09-13T17:14:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447080e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447080e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36212/0 (socket says 172.21.15.5:36212) 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447080e640 1 -- 172.21.15.5:0/152084092 learned_addr learned my addr 172.21.15.5:0/152084092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447100f640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c099110 0x7f446c0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f4471810640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f446c15fd80 0x7f446c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447080e640 1 -- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c099110 msgr2=0x7f446c0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.254+0000 7f447080e640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c099110 0x7f446c0b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f447080e640 1 -- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f446c15fd80 msgr2=0x7f446c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f447080e640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f446c15fd80 0x7f446c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f447080e640 1 -- 172.21.15.5:0/152084092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009a70 con 0x7f446c0cfd30 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f447080e640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c460 tx=0x7f445c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0052d0 con 0x7f446c0cfd30 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005450 con 0x7f446c0cfd30 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c156900 con 0x7f446c0cfd30 2024-09-13T17:14:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c012870 con 0x7f446c0cfd30 2024-09-13T17:14:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.255+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0c4c60 con 0x7f446c0cfd30 2024-09-13T17:14:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.256+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0c5460 con 0x7f446c0cfd30 2024-09-13T17:14:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.256+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f445c0129d0 con 0x7f446c0cfd30 2024-09-13T17:14:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.257+0000 7f4461ffb640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 0x7f445006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.257+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f445c088d20 con 0x7f446c0cfd30 2024-09-13T17:14:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.257+0000 7f447100f640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 0x7f445006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.258+0000 7f447100f640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 0x7f445006d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44680011e0 tx=0x7f4468009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.261+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f446c0c5460 con 0x7f446c0cfd30 2024-09-13T17:14:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.500+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f446c0c5460 con 0x7f446c0cfd30 2024-09-13T17:14:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.503+0000 7f4461ffb640 1 -- 172.21.15.5:0/152084092 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f446c0c5460 con 0x7f446c0cfd30 2024-09-13T17:14:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 msgr2=0x7f445006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 0x7f445006d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44680011e0 tx=0x7f4468009040 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 msgr2=0x7f446c0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c460 tx=0x7f445c00c920 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 shutdown_connections 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f446c15fd80 0x7f446c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f445006ac00 0x7f445006d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0cfd30 0x7f446c0b4ce0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 --2- 172.21.15.5:0/152084092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f446c099110 0x7f446c0b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 >> 172.21.15.5:0/152084092 conn(0x7f446c0d0310 msgr2=0x7f446c0d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 shutdown_connections 2024-09-13T17:14:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.505+0000 7f4473273640 1 -- 172.21.15.5:0/152084092 wait complete. 2024-09-13T17:14:24.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T17:14:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.618+0000 7fd0a0ec5640 1 Processor -- start 2024-09-13T17:14:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.618+0000 7fd0a0ec5640 1 -- start start 2024-09-13T17:14:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.619+0000 7fd0a0ec5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.619+0000 7fd0a0ec5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 0x7fd09c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.619+0000 7fd0a0ec5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0d0a00 con 0x7fd09c0cd920 2024-09-13T17:14:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.619+0000 7fd0a0ec5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0b1fb0 con 0x7fd09c15cb00 2024-09-13T17:14:24.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.619+0000 7fd0a0ec5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15d0a0 con 0x7fd09c0cd540 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 0x7fd09c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39174/0 (socket says 172.21.15.5:39174) 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd099d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd09c0cd920 0x7fd09c0d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:34360/0 (socket says 172.21.15.5:34360) 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 -- 172.21.15.5:0/3276509904 learned_addr learned my addr 172.21.15.5:0/3276509904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 -- 172.21.15.5:0/3276509904 >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 msgr2=0x7fd09c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 --2- 172.21.15.5:0/3276509904 >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 0x7fd09c0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 -- 172.21.15.5:0/3276509904 >> v1:172.21.15.179:6789/0 conn(0x7fd09c0cd920 legacy=0x7fd09c0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09a59c640 1 -- 172.21.15.5:0/3276509904 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c15d380 con 0x7fd09c0cd540 2024-09-13T17:14:24.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.620+0000 7fd09ad9d640 1 --2- 172.21.15.5:0/3276509904 >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 0x7fd09c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.621+0000 7fd09a59c640 1 --2- 172.21.15.5:0/3276509904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009870 tx=0x7fd08c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af90332e89e25837 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.621+0000 7fd09959a640 1 -- 172.21.15.5:0/3276509904 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c032640 con 0x7fd09c0cd540 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.621+0000 7fd09959a640 1 -- 172.21.15.5:0/3276509904 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c0327a0 con 0x7fd09c0cd540 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.621+0000 7fd09959a640 1 -- 172.21.15.5:0/3276509904 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c032b30 con 0x7fd09c0cd540 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/3276509904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 msgr2=0x7fd09c0b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/3276509904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009870 tx=0x7fd08c02a300 comp rx=0 tx=0).stop 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/3276509904 shutdown_connections 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/3276509904 >> v2:172.21.15.179:3300/0 conn(0x7fd09c15cb00 0x7fd09c0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/3276509904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c0cd540 0x7fd09c0b1a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/3276509904 >> 172.21.15.5:0/3276509904 conn(0x7fd09c0717a0 msgr2=0x7fd09c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/3276509904 shutdown_connections 2024-09-13T17:14:24.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.622+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/3276509904 wait complete. 2024-09-13T17:14:24.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.623+0000 7fd0a0ec5640 1 Processor -- start 2024-09-13T17:14:24.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.623+0000 7fd0a0ec5640 1 -- start start 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09c0cd920 0x7fd09c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c15cb00 0x7fd09c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c9c00 con 0x7fd09c0cd540 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c9890 con 0x7fd09c0cd920 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd0a0ec5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c6f60 con 0x7fd09c15cb00 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36220/0 (socket says 172.21.15.5:36220) 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 -- 172.21.15.5:0/2953818328 learned_addr learned my addr 172.21.15.5:0/2953818328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd099d9b640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09c0cd920 0x7fd09c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09ad9d640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c15cb00 0x7fd09c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 -- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c15cb00 msgr2=0x7fd09c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c15cb00 0x7fd09c0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 -- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09c0cd920 msgr2=0x7fd09c0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09c0cd920 0x7fd09c0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.624+0000 7fd09a59c640 1 -- 172.21.15.5:0/2953818328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009a70 con 0x7fd09c0cd540 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd09a59c640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c03d830 con 0x7fd09c0cd540 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c03d9b0 con 0x7fd09c0cd540 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0094d0 con 0x7fd09c0cd540 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c03dd60 con 0x7fd09c0cd540 2024-09-13T17:14:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.625+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c0c7520 con 0x7fd09c0cd540 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.626+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c0672a0 con 0x7fd09c0cd540 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.627+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd08c039040 con 0x7fd09c0cd540 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.627+0000 7fd08affd640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 0x7fd07c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.627+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd08c0a9ac0 con 0x7fd09c0cd540 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.627+0000 7fd099d9b640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 0x7fd07c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.628+0000 7fd099d9b640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 0x7fd07c06d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd090000f60 tx=0x7fd090000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.631+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd08c074f70 con 0x7fd09c0cd540 2024-09-13T17:14:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.868+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd09c0b1a70 con 0x7fd09c0cd540 2024-09-13T17:14:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.871+0000 7fd08affd640 1 -- 172.21.15.5:0/2953818328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd08c078590 con 0x7fd09c0cd540 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 msgr2=0x7fd07c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 0x7fd07c06d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd090000f60 tx=0x7fd090000ed0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 msgr2=0x7fd09c154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 shutdown_connections 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09c15cb00 0x7fd09c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09c0cd920 0x7fd09c0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd07c06ac00 0x7fd07c06d0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 --2- 172.21.15.5:0/2953818328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09c0cd540 0x7fd09c154d70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 >> 172.21.15.5:0/2953818328 conn(0x7fd09c0717a0 msgr2=0x7fd09c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 shutdown_connections 2024-09-13T17:14:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.874+0000 7fd0a0ec5640 1 -- 172.21.15.5:0/2953818328 wait complete. 2024-09-13T17:14:24.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:24.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.986+0000 7f66cc272640 1 Processor -- start 2024-09-13T17:14:24.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.986+0000 7f66cc272640 1 -- start start 2024-09-13T17:14:24.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66cc272640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66c40b1ac0 0x7f66c415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66cc272640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66c406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66cc272640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40b35f0 con 0x7f66c406eb80 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66cc272640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4160020 con 0x7f66c40b1ac0 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66cc272640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4156f50 con 0x7f66c406ef60 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66ca00e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f66c406eb80 0x7f66c40b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40764/0 (socket says 172.21.15.5:40764) 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66ca00e640 1 -- 172.21.15.5:0/1215184934 learned_addr learned my addr 172.21.15.5:0/1215184934 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66c980d640 1 --2- 172.21.15.5:0/1215184934 >> v2:172.21.15.179:3300/0 conn(0x7f66c40b1ac0 0x7f66c415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66ca80f640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66c406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285824396 0 0) 0x7f66c40b35f0 con 0x7f66c406eb80 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.987+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ac003520 con 0x7f66c406eb80 2024-09-13T17:14:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3235607159 0 0) 0x7f66ac003520 con 0x7f66c406eb80 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 msgr2=0x7f66c406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66c406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 >> v2:172.21.15.179:3300/0 conn(0x7f66c40b1ac0 msgr2=0x7f66c415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 --2- 172.21.15.5:0/1215184934 >> v2:172.21.15.179:3300/0 conn(0x7f66c40b1ac0 0x7f66c415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40b1fa0 con 0x7f66c406eb80 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f66b40019f0 con 0x7f66c406eb80 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 >> v1:172.21.15.5:6789/0 conn(0x7f66c406eb80 legacy=0x7f66c40b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66ac003ef0 0x7f66ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac004d00 0x7f66ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4160020 con 0x7f66ac003ef0 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4156f50 con 0x7f66ac004d00 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac00b980 con 0x7f66c406ef60 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66ac003ef0 0x7f66ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66ca00e640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66ca80f640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac004d00 0x7f66ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 -- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 msgr2=0x7f66ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c406ef60 0x7f66ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 -- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac004d00 msgr2=0x7f66ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac004d00 0x7f66ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.988+0000 7f66c980d640 1 -- 172.21.15.5:0/1215184934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac003520 con 0x7f66ac003ef0 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.989+0000 7f66c980d640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66ac003ef0 0x7f66ac0047c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009ac0 tx=0x7f66ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fba1ae2a7a7519 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.989+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8031400 con 0x7f66ac003ef0 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.989+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b802d050 con 0x7f66ac003ef0 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.989+0000 7f66c900c640 1 -- 172.21.15.5:0/1215184934 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8031780 con 0x7f66ac003ef0 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 -- 172.21.15.5:0/1215184934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66ac003ef0 msgr2=0x7f66ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 --2- 172.21.15.5:0/1215184934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66ac003ef0 0x7f66ac0047c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009ac0 tx=0x7f66ac0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66ca80f640 1 -- 172.21.15.5:0/1215184934 reap_dead start 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 -- 172.21.15.5:0/1215184934 shutdown_connections 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 -- 172.21.15.5:0/1215184934 >> 172.21.15.5:0/1215184934 conn(0x7f66c4070af0 msgr2=0x7f66c4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 -- 172.21.15.5:0/1215184934 shutdown_connections 2024-09-13T17:14:24.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.990+0000 7f66cc272640 1 -- 172.21.15.5:0/1215184934 wait complete. 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.991+0000 7f66cc272640 1 Processor -- start 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.991+0000 7f66cc272640 1 -- start start 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac003ef0 0x7f66c406a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c4153080 0x7f66c4153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c415bfb0 con 0x7f66c406b030 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4153a70 con 0x7f66ac003ef0 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66cc272640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c415b120 con 0x7f66c4153080 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36230/0 (socket says 172.21.15.5:36230) 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 -- 172.21.15.5:0/3643246287 learned_addr learned my addr 172.21.15.5:0/3643246287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66ca00e640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac003ef0 0x7f66c406a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66ca80f640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c4153080 0x7f66c4153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 -- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c4153080 msgr2=0x7f66c4153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c4153080 0x7f66c4153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 -- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac003ef0 msgr2=0x7f66c406a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac003ef0 0x7f66c406a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 -- 172.21.15.5:0/3643246287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c406ade0 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.992+0000 7f66c980d640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f66b802aaf0 tx=0x7f66b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.993+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8004520 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.993+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b8003c50 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.993+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c415b330 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.993+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8044410 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.993+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c415b8f0 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.994+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c40672e0 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.994+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f66b8038070 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.995+0000 7f66c2ffd640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 0x7f66b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.995+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f66b80a9090 con 0x7f66c406b030 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.995+0000 7f66ca00e640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 0x7f66b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.995+0000 7f66ca00e640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 0x7f66b006d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b4004d00 tx=0x7f66b4006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:24.999+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f66b8078080 con 0x7f66c406b030 2024-09-13T17:14:25.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.170+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c415c0f0 con 0x7f66c406b030 2024-09-13T17:14:25.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.171+0000 7f66c2ffd640 1 -- 172.21.15.5:0/3643246287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13026 (secure 0 0 0) 0x7f66b8077c10 con 0x7f66c406b030 2024-09-13T17:14:25.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:25.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:22.268576+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 msgr2=0x7f66b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 0x7f66b006d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b4004d00 tx=0x7f66b4006040 comp rx=0 tx=0).stop 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 msgr2=0x7f66c406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f66b802aaf0 tx=0x7f66b8004730 comp rx=0 tx=0).stop 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 shutdown_connections 2024-09-13T17:14:25.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66c4153080 0x7f66c4153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f66b006ac00 0x7f66b006d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c406b030 0x7f66c406cc70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 --2- 172.21.15.5:0/3643246287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac003ef0 0x7f66c406a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 >> 172.21.15.5:0/3643246287 conn(0x7f66c4070af0 msgr2=0x7f66c415dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 shutdown_connections 2024-09-13T17:14:25.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.173+0000 7f66cc272640 1 -- 172.21.15.5:0/3643246287 wait complete. 2024-09-13T17:14:25.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:25.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 Processor -- start 2024-09-13T17:14:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 -- start start 2024-09-13T17:14:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f140cf000 0x7f6f140cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f141645e0 0x7f6f141669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f140cf980 con 0x7f6f1415c6e0 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140ce570 con 0x7f6f141645e0 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.290+0000 7f6f1b23d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140d0630 con 0x7f6f140cf000 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f141645e0 0x7f6f141669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f141645e0 0x7f6f141669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36234/0 (socket says 172.21.15.5:36234) 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 -- 172.21.15.5:0/745757750 learned_addr learned my addr 172.21.15.5:0/745757750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f13fff640 1 --2- 172.21.15.5:0/745757750 >> v2:172.21.15.179:3300/0 conn(0x7f6f140cf000 0x7f6f140cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 -- 172.21.15.5:0/745757750 >> v2:172.21.15.179:3300/0 conn(0x7f6f140cf000 msgr2=0x7f6f140cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 --2- 172.21.15.5:0/745757750 >> v2:172.21.15.179:3300/0 conn(0x7f6f140cf000 0x7f6f140cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 -- 172.21.15.5:0/745757750 >> v1:172.21.15.179:6789/0 conn(0x7f6f1415c6e0 legacy=0x7f6f140cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.291+0000 7f6f197da640 1 -- 172.21.15.5:0/745757750 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140d0910 con 0x7f6f141645e0 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f197da640 1 --2- 172.21.15.5:0/745757750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f141645e0 0x7f6f141669d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6f1408bf40 tx=0x7f6f0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f274e5d5e77439b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f137fe640 1 -- 172.21.15.5:0/745757750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c031600 con 0x7f6f141645e0 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f137fe640 1 -- 172.21.15.5:0/745757750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c02d050 con 0x7f6f141645e0 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f137fe640 1 -- 172.21.15.5:0/745757750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c031980 con 0x7f6f141645e0 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 -- 172.21.15.5:0/745757750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f141645e0 msgr2=0x7f6f141669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/745757750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f141645e0 0x7f6f141669d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6f1408bf40 tx=0x7f6f0c02a730 comp rx=0 tx=0).stop 2024-09-13T17:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 -- 172.21.15.5:0/745757750 shutdown_connections 2024-09-13T17:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/745757750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f141645e0 0x7f6f141669d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/745757750 >> v2:172.21.15.179:3300/0 conn(0x7f6f140cf000 0x7f6f140cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.292+0000 7f6f1b23d640 1 -- 172.21.15.5:0/745757750 >> 172.21.15.5:0/745757750 conn(0x7f6f14089f90 msgr2=0x7f6f140d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.293+0000 7f6f1b23d640 1 -- 172.21.15.5:0/745757750 shutdown_connections 2024-09-13T17:14:25.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.293+0000 7f6f1b23d640 1 -- 172.21.15.5:0/745757750 wait complete. 2024-09-13T17:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.294+0000 7f6f1b23d640 1 Processor -- start 2024-09-13T17:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.294+0000 7f6f1b23d640 1 -- start start 2024-09-13T17:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f1415c6e0 0x7f6f14152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f141645e0 0x7f6f14157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f14152cc0 con 0x7f6f140cf000 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140caad0 con 0x7f6f141645e0 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140cad90 con 0x7f6f1415c6e0 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36238/0 (socket says 172.21.15.5:36238) 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 -- 172.21.15.5:0/456528655 learned_addr learned my addr 172.21.15.5:0/456528655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f197da640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f141645e0 0x7f6f14157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f13fff640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f1415c6e0 0x7f6f14152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 -- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f1415c6e0 msgr2=0x7f6f14152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f1415c6e0 0x7f6f14152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 -- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f141645e0 msgr2=0x7f6f14157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f141645e0 0x7f6f14157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 -- 172.21.15.5:0/456528655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009b30 con 0x7f6f140cf000 2024-09-13T17:14:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f18fd9640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800c450 tx=0x7f6f0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f080052d0 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f08005430 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08012870 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f140cb070 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.295+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f140cb630 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.296+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f140672e0 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.297+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f080129d0 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.298+0000 7f6f117fa640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 0x7f6ef806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.298+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6f08088bb0 con 0x7f6f140cf000 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.298+0000 7f6f13fff640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 0x7f6ef806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.298+0000 7f6f13fff640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 0x7f6ef806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6f140c9640 tx=0x7f6f00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.302+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f08053fa0 con 0x7f6f140cf000 2024-09-13T17:14:25.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.473+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f1415cac0 con 0x7f6f140cf000 2024-09-13T17:14:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.474+0000 7f6f117fa640 1 -- 172.21.15.5:0/456528655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f080575c0 con 0x7f6f140cf000 2024-09-13T17:14:25.476 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 msgr2=0x7f6ef806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 0x7f6ef806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6f140c9640 tx=0x7f6f00008040 comp rx=0 tx=0).stop 2024-09-13T17:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 msgr2=0x7f6f140ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800c450 tx=0x7f6f0800c910 comp rx=0 tx=0).stop 2024-09-13T17:14:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 shutdown_connections 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f141645e0 0x7f6f14157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f1415c6e0 0x7f6f14152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ef806ac30 0x7f6ef806d0f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 --2- 172.21.15.5:0/456528655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f140cf000 0x7f6f140ca590 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 >> 172.21.15.5:0/456528655 conn(0x7f6f14089f90 msgr2=0x7f6f1406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 shutdown_connections 2024-09-13T17:14:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.476+0000 7f6f1b23d640 1 -- 172.21.15.5:0/456528655 wait complete. 2024-09-13T17:14:25.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:14:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.588+0000 7f7b098e5640 1 Processor -- start 2024-09-13T17:14:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.588+0000 7f7b098e5640 1 -- start start 2024-09-13T17:14:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b098e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415d850 0x7f7b040b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b098e5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040b27f0 con 0x7f7b040ae7b0 2024-09-13T17:14:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b098e5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0406ed60 con 0x7f7b04069e90 2024-09-13T17:14:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b098e5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040b40d0 con 0x7f7b0415d850 2024-09-13T17:14:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b027fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415d850 0x7f7b040b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b037fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b040ae7b0 0x7f7b040ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40774/0 (socket says 172.21.15.5:40774) 2024-09-13T17:14:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b027fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415d850 0x7f7b040b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36252/0 (socket says 172.21.15.5:36252) 2024-09-13T17:14:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b037fe640 1 -- 172.21.15.5:0/491469949 learned_addr learned my addr 172.21.15.5:0/491469949 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b027fc640 1 -- 172.21.15.5:0/491469949 >> v1:172.21.15.179:6789/0 conn(0x7f7b04069e90 legacy=0x7f7b0406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b027fc640 1 -- 172.21.15.5:0/491469949 >> v1:172.21.15.5:6789/0 conn(0x7f7b040ae7b0 legacy=0x7f7b040ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.589+0000 7f7b027fc640 1 -- 172.21.15.5:0/491469949 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040ae390 con 0x7f7b0415d850 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.590+0000 7f7b027fc640 1 --2- 172.21.15.5:0/491469949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415d850 0x7f7b040b2130 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7af80097a0 tx=0x7f7af802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc958ad9a96748b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.590+0000 7f7b01ffb640 1 -- 172.21.15.5:0/491469949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8032440 con 0x7f7b0415d850 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.590+0000 7f7b01ffb640 1 -- 172.21.15.5:0/491469949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af80325a0 con 0x7f7b0415d850 2024-09-13T17:14:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.590+0000 7f7b01ffb640 1 -- 172.21.15.5:0/491469949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8032930 con 0x7f7b0415d850 2024-09-13T17:14:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 -- 172.21.15.5:0/491469949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415d850 msgr2=0x7f7b040b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 --2- 172.21.15.5:0/491469949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415d850 0x7f7b040b2130 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7af80097a0 tx=0x7f7af802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 -- 172.21.15.5:0/491469949 shutdown_connections 2024-09-13T17:14:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 --2- 172.21.15.5:0/491469949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415d850 0x7f7b040b2130 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 -- 172.21.15.5:0/491469949 >> 172.21.15.5:0/491469949 conn(0x7f7b040b4650 msgr2=0x7f7b040b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 -- 172.21.15.5:0/491469949 shutdown_connections 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.591+0000 7f7b098e5640 1 -- 172.21.15.5:0/491469949 wait complete. 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.592+0000 7f7b098e5640 1 Processor -- start 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.592+0000 7f7b098e5640 1 -- start start 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b04069e90 0x7f7b041f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 0x7f7b0409cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041f1af0 con 0x7f7b040ae7b0 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0409a620 con 0x7f7b04069e90 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b098e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0409a900 con 0x7f7b0415d850 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36254/0 (socket says 172.21.15.5:36254) 2024-09-13T17:14:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 -- 172.21.15.5:0/3971535585 learned_addr learned my addr 172.21.15.5:0/3971535585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b02ffd640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b04069e90 0x7f7b041f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b037fe640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 0x7f7b0409cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 -- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 msgr2=0x7f7b0409cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 0x7f7b0409cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 -- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b04069e90 msgr2=0x7f7b041f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b04069e90 0x7f7b041f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b027fc640 1 -- 172.21.15.5:0/3971535585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009400 con 0x7f7b040ae7b0 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.593+0000 7f7b037fe640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 0x7f7b0409cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7b027fc640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7af8035040 tx=0x7f7af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8006e10 con 0x7f7b040ae7b0 2024-09-13T17:14:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8030980 con 0x7f7b040ae7b0 2024-09-13T17:14:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8030d50 con 0x7f7b040ae7b0 2024-09-13T17:14:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0409c2d0 con 0x7f7b040ae7b0 2024-09-13T17:14:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.594+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0409abe0 con 0x7f7b040ae7b0 2024-09-13T17:14:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.595+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0409c130 con 0x7f7b040ae7b0 2024-09-13T17:14:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.595+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7af8039040 con 0x7f7b040ae7b0 2024-09-13T17:14:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.596+0000 7f7aebfff640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 0x7f7af006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.596+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7af80a99e0 con 0x7f7b040ae7b0 2024-09-13T17:14:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.596+0000 7f7b02ffd640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 0x7f7af006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.597+0000 7f7b02ffd640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 0x7f7af006d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000f60 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.600+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b0409c130 con 0x7f7b040ae7b0 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.774+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b0409c130 con 0x7f7b040ae7b0 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.774+0000 7f7aebfff640 1 -- 172.21.15.5:0/3971535585 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7b0409c130 con 0x7f7b040ae7b0 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:14:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:14:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:14:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:25.777 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:14:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 msgr2=0x7f7af006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 0x7f7af006d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000f60 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 msgr2=0x7f7b040c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7af8035040 tx=0x7f7af80046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 shutdown_connections 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0415d850 0x7f7b0409cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7af006ac00 0x7f7af006d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b040ae7b0 0x7f7b040c9d20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 --2- 172.21.15.5:0/3971535585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b04069e90 0x7f7b041f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 >> 172.21.15.5:0/3971535585 conn(0x7f7b040b4650 msgr2=0x7f7b0406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 shutdown_connections 2024-09-13T17:14:25.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.776+0000 7f7b098e5640 1 -- 172.21.15.5:0/3971535585 wait complete. 2024-09-13T17:14:25.790 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:14:25.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:14:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.893+0000 7ff85b8b7640 1 Processor -- start 2024-09-13T17:14:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.893+0000 7ff85b8b7640 1 -- start start 2024-09-13T17:14:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.893+0000 7ff85b8b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8540ccfe0 0x7ff8540cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff85b8b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540b6e80 0x7ff8540b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff85b8b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8540d3300 con 0x7ff8540cdbf0 2024-09-13T17:14:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff85b8b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540cd900 con 0x7ff8540ccfe0 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff85b8b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b5de0 con 0x7ff8540b6e80 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859653640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8540ccfe0 0x7ff8540cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff858e52640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8540cdbf0 0x7ff8540d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40786/0 (socket says 172.21.15.5:40786) 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff858e52640 1 -- 172.21.15.5:0/2239747788 learned_addr learned my addr 172.21.15.5:0/2239747788 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859e54640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540b6e80 0x7ff8540b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859653640 1 -- 172.21.15.5:0/2239747788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540b6e80 msgr2=0x7ff8540b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859653640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540b6e80 0x7ff8540b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859653640 1 -- 172.21.15.5:0/2239747788 >> v1:172.21.15.5:6789/0 conn(0x7ff8540cdbf0 legacy=0x7ff8540d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.894+0000 7ff859653640 1 -- 172.21.15.5:0/2239747788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540b60c0 con 0x7ff8540ccfe0 2024-09-13T17:14:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff859653640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff8540cd3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5ded70f9a8d9fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff853fff640 1 -- 172.21.15.5:0/2239747788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844007740 con 0x7ff8540ccfe0 2024-09-13T17:14:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff853fff640 1 -- 172.21.15.5:0/2239747788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84402d050 con 0x7ff8540ccfe0 2024-09-13T17:14:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff853fff640 1 -- 172.21.15.5:0/2239747788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844007ac0 con 0x7ff8540ccfe0 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 -- 172.21.15.5:0/2239747788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 msgr2=0x7ff8540cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff8540cd3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84402a560 comp rx=0 tx=0).stop 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 -- 172.21.15.5:0/2239747788 shutdown_connections 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540b6e80 0x7ff8540b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/2239747788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff8540cd3c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.895+0000 7ff85b8b7640 1 -- 172.21.15.5:0/2239747788 >> 172.21.15.5:0/2239747788 conn(0x7ff854089f90 msgr2=0x7ff8540d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.896+0000 7ff85b8b7640 1 -- 172.21.15.5:0/2239747788 shutdown_connections 2024-09-13T17:14:25.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.896+0000 7ff85b8b7640 1 -- 172.21.15.5:0/2239747788 wait complete. 2024-09-13T17:14:25.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 Processor -- start 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 -- start start 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8540b6e80 0x7ff8540c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540cdbf0 0x7ff8540cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540c8340 con 0x7ff8540ccfe0 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415d740 con 0x7ff8540b6e80 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.897+0000 7ff85b8b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541592a0 con 0x7ff8540cdbf0 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36262/0 (socket says 172.21.15.5:36262) 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 -- 172.21.15.5:0/4171509316 learned_addr learned my addr 172.21.15.5:0/4171509316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff859e54640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540cdbf0 0x7ff8540cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 -- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540cdbf0 msgr2=0x7ff8540cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540cdbf0 0x7ff8540cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 -- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8540b6e80 msgr2=0x7ff8540c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff859653640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8540b6e80 0x7ff8540c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8540b6e80 0x7ff8540c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 -- 172.21.15.5:0/4171509316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844009a70 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff858e52640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c750 tx=0x7ff84800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848005ab0 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848005c10 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848007070 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.898+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff854159580 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.899+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85415dc90 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.899+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff854065fa0 con 0x7ff8540ccfe0 2024-09-13T17:14:25.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.900+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8480071d0 con 0x7ff8540ccfe0 2024-09-13T17:14:25.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.900+0000 7ff851ffb640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 0x7ff84006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.900+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff848088690 con 0x7ff8540ccfe0 2024-09-13T17:14:25.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.901+0000 7ff859653640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 0x7ff84006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.901+0000 7ff859653640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 0x7ff84006d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff844034000 tx=0x7ff84402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:25.904+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff848053bf0 con 0x7ff8540ccfe0 2024-09-13T17:14:26.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.075+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff85415deb0 con 0x7ff8540ccfe0 2024-09-13T17:14:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.159+0000 7ff851ffb640 1 -- 172.21.15.5:0/4171509316 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8480170b0 con 0x7ff8540ccfe0 2024-09-13T17:14:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:14:26.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 msgr2=0x7ff84006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 0x7ff84006d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff844034000 tx=0x7ff84402f000 comp rx=0 tx=0).stop 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 msgr2=0x7ff854156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c750 tx=0x7ff84800cc10 comp rx=0 tx=0).stop 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 shutdown_connections 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8540cdbf0 0x7ff8540cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff84006ac00 0x7ff84006d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8540ccfe0 0x7ff854156790 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 --2- 172.21.15.5:0/4171509316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8540b6e80 0x7ff8540c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 >> 172.21.15.5:0/4171509316 conn(0x7ff854089f90 msgr2=0x7ff8540d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:26.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 shutdown_connections 2024-09-13T17:14:26.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.162+0000 7ff85b8b7640 1 -- 172.21.15.5:0/4171509316 wait complete. 2024-09-13T17:14:26.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:14:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.283+0000 7f0110591640 1 Processor -- start 2024-09-13T17:14:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.283+0000 7f0110591640 1 -- start start 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f0110591640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01081591e0 0x7f01080abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f0110591640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080ad050 con 0x7f010806da30 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f0110591640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080ac440 con 0x7f01080ad4e0 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f0110591640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080ac720 con 0x7f01081591e0 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010e32d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01081591e0 0x7f01080abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010eb2e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f010806da30 0x7f01080700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40796/0 (socket says 172.21.15.5:40796) 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010eb2e640 1 -- 172.21.15.5:0/4245178137 learned_addr learned my addr 172.21.15.5:0/4245178137 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010e32d640 1 -- 172.21.15.5:0/4245178137 >> v1:172.21.15.179:6789/0 conn(0x7f01080ad4e0 legacy=0x7f01080b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010e32d640 1 -- 172.21.15.5:0/4245178137 >> v1:172.21.15.5:6789/0 conn(0x7f010806da30 legacy=0x7f01080700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.284+0000 7f010d32b640 1 -- 172.21.15.5:0/4245178137 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809974734 0 0) 0x7f01080ad050 con 0x7f010806da30 2024-09-13T17:14:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.285+0000 7f010e32d640 1 -- 172.21.15.5:0/4245178137 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080aca00 con 0x7f01081591e0 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.285+0000 7f010e32d640 1 --2- 172.21.15.5:0/4245178137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01081591e0 0x7f01080abe60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f01040097a0 tx=0x7f010402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97e96674590e9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.285+0000 7f010d32b640 1 -- 172.21.15.5:0/4245178137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104032440 con 0x7f01081591e0 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.285+0000 7f010d32b640 1 -- 172.21.15.5:0/4245178137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040325a0 con 0x7f01081591e0 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.285+0000 7f010d32b640 1 -- 172.21.15.5:0/4245178137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104032930 con 0x7f01081591e0 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 -- 172.21.15.5:0/4245178137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01081591e0 msgr2=0x7f01080abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 --2- 172.21.15.5:0/4245178137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01081591e0 0x7f01080abe60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f01040097a0 tx=0x7f010402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 -- 172.21.15.5:0/4245178137 shutdown_connections 2024-09-13T17:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 --2- 172.21.15.5:0/4245178137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01081591e0 0x7f01080abe60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 -- 172.21.15.5:0/4245178137 >> 172.21.15.5:0/4245178137 conn(0x7f01080ce130 msgr2=0x7f01080ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 -- 172.21.15.5:0/4245178137 shutdown_connections 2024-09-13T17:14:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.286+0000 7f0110591640 1 -- 172.21.15.5:0/4245178137 wait complete. 2024-09-13T17:14:26.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.287+0000 7f0110591640 1 Processor -- start 2024-09-13T17:14:26.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.287+0000 7f0110591640 1 -- start start 2024-09-13T17:14:26.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010806da30 0x7f010809bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:26.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 0x7f0108151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108157b60 con 0x7f01080ad4e0 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081f0060 con 0x7f01081591e0 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f0110591640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108156f50 con 0x7f010806da30 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36278/0 (socket says 172.21.15.5:36278) 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 -- 172.21.15.5:0/3589599153 learned_addr learned my addr 172.21.15.5:0/3589599153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010e32d640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010806da30 0x7f010809bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010eb2e640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 0x7f0108151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 -- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010806da30 msgr2=0x7f010809bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010806da30 0x7f010809bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 -- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 msgr2=0x7f0108151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 0x7f0108151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010db2c640 1 -- 172.21.15.5:0/3589599153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104009400 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.288+0000 7f010eb2e640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 0x7f0108151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f010db2c640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c430 tx=0x7f00fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc011790 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0108157230 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc0118f0 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc011ce0 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.289+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01081577f0 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.290+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01080672a0 con 0x7f01080ad4e0 2024-09-13T17:14:26.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.290+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00fc01c460 con 0x7f01080ad4e0 2024-09-13T17:14:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.291+0000 7f00faffd640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 0x7f00ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.291+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f00fc089310 con 0x7f01080ad4e0 2024-09-13T17:14:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.291+0000 7f010e32d640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 0x7f00ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:26.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.292+0000 7f010e32d640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 0x7f00ec06d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0104034000 tx=0x7f010402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.295+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f00fc054470 con 0x7f01080ad4e0 2024-09-13T17:14:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:26.467+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0108072090 con 0x7f01080ad4e0 2024-09-13T17:14:27.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.162+0000 7f00faffd640 1 -- 172.21.15.5:0/3589599153 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f00fc057a90 con 0x7f01080ad4e0 2024-09-13T17:14:27.165 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:14:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.169+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 msgr2=0x7f00ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.169+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 0x7f00ec06d0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0104034000 tx=0x7f010402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.169+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 msgr2=0x7f0108151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.169+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c430 tx=0x7f00fc00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 shutdown_connections 2024-09-13T17:14:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01081591e0 0x7f0108151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f00ec06ac00 0x7f00ec06d0c0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0104034000 tx=0x7f010402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080ad4e0 0x7f0108151a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 --2- 172.21.15.5:0/3589599153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f010806da30 0x7f010809bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.170+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 >> 172.21.15.5:0/3589599153 conn(0x7f01080ce130 msgr2=0x7f01080b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.172+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 shutdown_connections 2024-09-13T17:14:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.172+0000 7f0110591640 1 -- 172.21.15.5:0/3589599153 wait complete. 2024-09-13T17:14:27.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:14:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.304+0000 7fd57b053640 1 Processor -- start 2024-09-13T17:14:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.304+0000 7fd57b053640 1 -- start start 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd57b053640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 0x7fd5740b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd57b053640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd57415d850 0x7fd5740ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd57b053640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5740b27f0 con 0x7fd5740ae7b0 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd57b053640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57406ed60 con 0x7fd57415d850 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd57b053640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b40d0 con 0x7fd574069e90 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd573fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5740ae7b0 0x7fd57406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40798/0 (socket says 172.21.15.5:40798) 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd573fff640 1 -- 172.21.15.5:0/2295231727 learned_addr learned my addr 172.21.15.5:0/2295231727 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd578def640 1 --2- 172.21.15.5:0/2295231727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 0x7fd5740b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd5795f0640 1 --2- 172.21.15.5:0/2295231727 >> v2:172.21.15.179:3300/0 conn(0x7fd57415d850 0x7fd5740ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551324449 0 0) 0x7fd5740b27f0 con 0x7fd5740ae7b0 2024-09-13T17:14:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd564003520 con 0x7fd5740ae7b0 2024-09-13T17:14:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.305+0000 7fd578def640 1 -- 172.21.15.5:0/2295231727 >> v2:172.21.15.179:3300/0 conn(0x7fd57415d850 msgr2=0x7fd5740ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.306+0000 7fd578def640 1 --2- 172.21.15.5:0/2295231727 >> v2:172.21.15.179:3300/0 conn(0x7fd57415d850 0x7fd5740ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.306+0000 7fd578def640 1 -- 172.21.15.5:0/2295231727 >> v1:172.21.15.5:6789/0 conn(0x7fd5740ae7b0 legacy=0x7fd57406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.306+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336135931 0 0) 0x7fd564003520 con 0x7fd5740ae7b0 2024-09-13T17:14:27.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.306+0000 7fd578def640 1 -- 172.21.15.5:0/2295231727 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740ae390 con 0x7fd574069e90 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.306+0000 7fd578def640 1 --2- 172.21.15.5:0/2295231727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 0x7fd5740b2130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5680097a0 tx=0x7fd56802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92edf17ebb5e2df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560001670 con 0x7fd574069e90 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56802aba0 con 0x7fd574069e90 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd5737fe640 1 -- 172.21.15.5:0/2295231727 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568032440 con 0x7fd574069e90 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 -- 172.21.15.5:0/2295231727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 msgr2=0x7fd5740b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 --2- 172.21.15.5:0/2295231727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 0x7fd5740b2130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5680097a0 tx=0x7fd56802a110 comp rx=0 tx=0).stop 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 -- 172.21.15.5:0/2295231727 shutdown_connections 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 --2- 172.21.15.5:0/2295231727 >> v2:172.21.15.179:3300/0 conn(0x7fd57415d850 0x7fd5740ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 --2- 172.21.15.5:0/2295231727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd574069e90 0x7fd5740b2130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 -- 172.21.15.5:0/2295231727 >> 172.21.15.5:0/2295231727 conn(0x7fd5740b4650 msgr2=0x7fd5740b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 -- 172.21.15.5:0/2295231727 shutdown_connections 2024-09-13T17:14:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.307+0000 7fd57b053640 1 -- 172.21.15.5:0/2295231727 wait complete. 2024-09-13T17:14:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.308+0000 7fd57b053640 1 Processor -- start 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.308+0000 7fd57b053640 1 -- start start 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5740ae7b0 0x7fd5740b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57415d850 0x7fd5741515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b0020 con 0x7fd574069e90 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b0300 con 0x7fd5740ae7b0 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd57b053640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b05e0 con 0x7fd57415d850 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd578def640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd578def640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36280/0 (socket says 172.21.15.5:36280) 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.309+0000 7fd578def640 1 -- 172.21.15.5:0/77404596 learned_addr learned my addr 172.21.15.5:0/77404596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd5795f0640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57415d850 0x7fd5741515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd573fff640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5740ae7b0 0x7fd5740b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 -- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57415d850 msgr2=0x7fd5741515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57415d850 0x7fd5741515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 -- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5740ae7b0 msgr2=0x7fd5740b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5740ae7b0 0x7fd5740b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 -- 172.21.15.5:0/77404596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568009400 con 0x7fd574069e90 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd578def640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd568035040 tx=0x7fd5680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56803d830 con 0x7fd574069e90 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56803d990 con 0x7fd574069e90 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740b08c0 con 0x7fd574069e90 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56803dd20 con 0x7fd574069e90 2024-09-13T17:14:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.310+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd574151b00 con 0x7fd574069e90 2024-09-13T17:14:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.311+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740672a0 con 0x7fd574069e90 2024-09-13T17:14:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.312+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd568039040 con 0x7fd574069e90 2024-09-13T17:14:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.312+0000 7fd5717fa640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 0x7fd55806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.312+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fd5680a9d30 con 0x7fd574069e90 2024-09-13T17:14:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.312+0000 7fd573fff640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 0x7fd55806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.313+0000 7fd573fff640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 0x7fd55806d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5740b17a0 tx=0x7fd560009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.317+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd568074e30 con 0x7fd574069e90 2024-09-13T17:14:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.523+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5740ac110 con 0x7fd574069e90 2024-09-13T17:14:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.530+0000 7fd5717fa640 1 -- 172.21.15.5:0/77404596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd568006e10 con 0x7fd574069e90 2024-09-13T17:14:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 5 and data pool 6 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 msgr2=0x7fd55806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 0x7fd55806d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5740b17a0 tx=0x7fd560009040 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 msgr2=0x7fd5740afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd568035040 tx=0x7fd5680046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 shutdown_connections 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57415d850 0x7fd5741515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5740ae7b0 0x7fd5740b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd55806ac00 0x7fd55806d0c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 --2- 172.21.15.5:0/77404596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd574069e90 0x7fd5740afa40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 >> 172.21.15.5:0/77404596 conn(0x7fd5740b4650 msgr2=0x7fd57415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 shutdown_connections 2024-09-13T17:14:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.541+0000 7fd57b053640 1 -- 172.21.15.5:0/77404596 wait complete. 2024-09-13T17:14:27.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:27.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.663+0000 7ff24710f640 1 Processor -- start 2024-09-13T17:14:27.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.663+0000 7ff24710f640 1 -- start start 2024-09-13T17:14:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff24710f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff240159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff24710f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff240159bb0 0x7ff240070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff24710f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400b1580 con 0x7ff2400b1970 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff24710f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2400b2ad0 con 0x7ff240159bb0 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff24710f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24006d9b0 con 0x7ff240159290 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff2456ac640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2400b1970 0x7ff24015c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40802/0 (socket says 172.21.15.5:40802) 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.664+0000 7ff2456ac640 1 -- 172.21.15.5:0/1714398946 learned_addr learned my addr 172.21.15.5:0/1714398946 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23ffff640 1 --2- 172.21.15.5:0/1714398946 >> v2:172.21.15.179:3300/0 conn(0x7ff240159bb0 0x7ff240070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff240159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707470450 0 0) 0x7ff2400b1580 con 0x7ff2400b1970 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003520 con 0x7ff2400b1970 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308488 0 0) 0x7ff228003520 con 0x7ff2400b1970 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 msgr2=0x7ff240159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff240159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 >> v2:172.21.15.179:3300/0 conn(0x7ff240159bb0 msgr2=0x7ff240070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/1714398946 >> v2:172.21.15.179:3300/0 conn(0x7ff240159bb0 0x7ff240070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400b1ec0 con 0x7ff2400b1970 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff2380019f0 con 0x7ff2400b1970 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 >> v1:172.21.15.5:6789/0 conn(0x7ff2400b1970 legacy=0x7ff24015c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff2280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228004d00 0x7ff228005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400b2ad0 con 0x7ff228003970 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24006d9b0 con 0x7ff228004d00 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800b980 con 0x7ff240159290 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff2456ac640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228004d00 0x7ff228005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff23ffff640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff2280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 -- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 msgr2=0x7ff2280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff240159290 0x7ff2280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 -- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228004d00 msgr2=0x7ff228005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228004d00 0x7ff228005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff244eab640 1 -- 172.21.15.5:0/1714398946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228003520 con 0x7ff228003970 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.665+0000 7ff2456ac640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228004d00 0x7ff228005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.666+0000 7ff244eab640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228003970 0x7ff228003d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff23000aac0 tx=0x7ff2280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67aa7dd7b5af595f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.666+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23002c720 con 0x7ff228003970 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.666+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23002c880 con 0x7ff228003970 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.666+0000 7ff23f7fe640 1 -- 172.21.15.5:0/1714398946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23002cc10 con 0x7ff228003970 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 -- 172.21.15.5:0/1714398946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228003970 msgr2=0x7ff228003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 --2- 172.21.15.5:0/1714398946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff228003970 0x7ff228003d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff23000aac0 tx=0x7ff2280057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff2456ac640 1 -- 172.21.15.5:0/1714398946 reap_dead start 2024-09-13T17:14:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 -- 172.21.15.5:0/1714398946 shutdown_connections 2024-09-13T17:14:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 -- 172.21.15.5:0/1714398946 >> 172.21.15.5:0/1714398946 conn(0x7ff2400ce0d0 msgr2=0x7ff2400ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 -- 172.21.15.5:0/1714398946 shutdown_connections 2024-09-13T17:14:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.667+0000 7ff24710f640 1 -- 172.21.15.5:0/1714398946 wait complete. 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.668+0000 7ff24710f640 1 Processor -- start 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.668+0000 7ff24710f640 1 -- start start 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff228003970 0x7ff240152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 0x7ff2401f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401f1110 con 0x7ff2401eff70 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401f0930 con 0x7ff2401486a0 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff24710f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff240152950 con 0x7ff228003970 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36296/0 (socket says 172.21.15.5:36296) 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 -- 172.21.15.5:0/1769555208 learned_addr learned my addr 172.21.15.5:0/1769555208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff244eab640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff228003970 0x7ff240152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff23ffff640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 0x7ff2401f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 -- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff228003970 msgr2=0x7ff240152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff228003970 0x7ff240152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.669+0000 7ff2456ac640 1 -- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 msgr2=0x7ff2401f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff2456ac640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 0x7ff2401f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff2456ac640 1 -- 172.21.15.5:0/1769555208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240152c30 con 0x7ff2401eff70 2024-09-13T17:14:27.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff23ffff640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 0x7ff2401f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff2456ac640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff2400ca5d0 tx=0x7ff23800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238007a80 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23800eda0 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240152f10 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238013620 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.670+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24014a410 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.671+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24014a9a0 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.671+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff238013780 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.672+0000 7ff23d7fa640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 0x7ff22c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.672+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff238089920 con 0x7ff2401eff70 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.672+0000 7ff244eab640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 0x7ff22c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.672+0000 7ff244eab640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 0x7ff22c06d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff230036000 tx=0x7ff230030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.677+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff24014a9a0 con 0x7ff2401eff70 2024-09-13T17:14:27.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.849+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2400672a0 con 0x7ff2401eff70 2024-09-13T17:14:27.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.850+0000 7ff23d7fa640 1 -- 172.21.15.5:0/1769555208 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16751 (secure 0 0 0) 0x7ff2380584e0 con 0x7ff2401eff70 2024-09-13T17:14:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:27.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:27.525654+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 msgr2=0x7ff22c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 0x7ff22c06d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff230036000 tx=0x7ff230030000 comp rx=0 tx=0).stop 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 msgr2=0x7ff2401f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff2400ca5d0 tx=0x7ff23800e530 comp rx=0 tx=0).stop 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 shutdown_connections 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff22c06ac00 0x7ff22c06d0c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2401eff70 0x7ff2401f03f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2401486a0 0x7ff2401f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 --2- 172.21.15.5:0/1769555208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff228003970 0x7ff240152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 >> 172.21.15.5:0/1769555208 conn(0x7ff2400ce0d0 msgr2=0x7ff24015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 shutdown_connections 2024-09-13T17:14:27.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.853+0000 7ff24710f640 1 -- 172.21.15.5:0/1769555208 wait complete. 2024-09-13T17:14:27.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:27.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.966+0000 7fcf7782b640 1 Processor -- start 2024-09-13T17:14:27.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.966+0000 7fcf7782b640 1 -- start start 2024-09-13T17:14:27.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf7782b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf7006e1c0 0x7fcf700aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf7782b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf700b2390 con 0x7fcf70156f40 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf7782b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7015a700 con 0x7fcf7015a290 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf7782b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700b1780 con 0x7fcf7006e1c0 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf74dc6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf7006e1c0 0x7fcf700aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf755c7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf70156f40 0x7fcf7006dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40810/0 (socket says 172.21.15.5:40810) 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf755c7640 1 -- 172.21.15.5:0/2923473284 learned_addr learned my addr 172.21.15.5:0/2923473284 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf74dc6640 1 -- 172.21.15.5:0/2923473284 >> v1:172.21.15.179:6789/0 conn(0x7fcf7015a290 legacy=0x7fcf70162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf74dc6640 1 -- 172.21.15.5:0/2923473284 >> v1:172.21.15.5:6789/0 conn(0x7fcf70156f40 legacy=0x7fcf7006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf67fff640 1 -- 172.21.15.5:0/2923473284 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981319140 0 0) 0x7fcf700b2390 con 0x7fcf70156f40 2024-09-13T17:14:27.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf74dc6640 1 -- 172.21.15.5:0/2923473284 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700b1a60 con 0x7fcf7006e1c0 2024-09-13T17:14:27.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf74dc6640 1 --2- 172.21.15.5:0/2923473284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7006e1c0 0x7fcf700aced0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf600097a0 tx=0x7fcf6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2301e50d16c283f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf67fff640 1 -- 172.21.15.5:0/2923473284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60032440 con 0x7fcf7006e1c0 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf67fff640 1 -- 172.21.15.5:0/2923473284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600325a0 con 0x7fcf7006e1c0 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.967+0000 7fcf67fff640 1 -- 172.21.15.5:0/2923473284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60032930 con 0x7fcf7006e1c0 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 -- 172.21.15.5:0/2923473284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7006e1c0 msgr2=0x7fcf700aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 --2- 172.21.15.5:0/2923473284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7006e1c0 0x7fcf700aced0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf600097a0 tx=0x7fcf6002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 -- 172.21.15.5:0/2923473284 shutdown_connections 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 --2- 172.21.15.5:0/2923473284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7006e1c0 0x7fcf700aced0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 -- 172.21.15.5:0/2923473284 >> 172.21.15.5:0/2923473284 conn(0x7fcf700ce0d0 msgr2=0x7fcf700ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 -- 172.21.15.5:0/2923473284 shutdown_connections 2024-09-13T17:14:27.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.968+0000 7fcf7782b640 1 -- 172.21.15.5:0/2923473284 wait complete. 2024-09-13T17:14:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.969+0000 7fcf7782b640 1 Processor -- start 2024-09-13T17:14:27.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.969+0000 7fcf7782b640 1 -- start start 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 0x7fcf701455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf70156f40 0x7fcf70156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700984c0 con 0x7fcf7015a290 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70098170 con 0x7fcf7006e1c0 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf7782b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7009a1a0 con 0x7fcf70156f40 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36304/0 (socket says 172.21.15.5:36304) 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 -- 172.21.15.5:0/802586232 learned_addr learned my addr 172.21.15.5:0/802586232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf74dc6640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf70156f40 0x7fcf70156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf755c7640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 0x7fcf701455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 -- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf70156f40 msgr2=0x7fcf70156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf70156f40 0x7fcf70156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 -- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 msgr2=0x7fcf701455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 0x7fcf701455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf75dc8640 1 -- 172.21.15.5:0/802586232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60009400 con 0x7fcf7015a290 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.970+0000 7fcf755c7640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 0x7fcf701455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf75dc8640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800b990 tx=0x7fcf6800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800cba0 con 0x7fcf7015a290 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6800cd00 con 0x7fcf7015a290 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf701545f0 con 0x7fcf7015a290 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68014680 con 0x7fcf7015a290 2024-09-13T17:14:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.971+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf701548b0 con 0x7fcf7015a290 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.972+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf70098600 con 0x7fcf7015a290 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.972+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf6801d3b0 con 0x7fcf7015a290 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.973+0000 7fcf65ffb640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 0x7fcf5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.973+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf680895a0 con 0x7fcf7015a290 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.973+0000 7fcf755c7640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 0x7fcf5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.973+0000 7fcf755c7640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 0x7fcf5406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000f60 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:27.978+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcf70098600 con 0x7fcf7015a290 2024-09-13T17:14:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.149+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf70098600 con 0x7fcf7015a290 2024-09-13T17:14:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.150+0000 7fcf65ffb640 1 -- 172.21.15.5:0/802586232 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16751 (secure 0 0 0) 0x7fcf70098600 con 0x7fcf7015a290 2024-09-13T17:14:28.152 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:27.525654+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 msgr2=0x7fcf5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 0x7fcf5406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000f60 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 msgr2=0x7fcf701e5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800b990 tx=0x7fcf6800be50 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 shutdown_connections 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcf5406ac00 0x7fcf5406d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf7015a290 0x7fcf701e5e00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf70156f40 0x7fcf70156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 --2- 172.21.15.5:0/802586232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf7006e1c0 0x7fcf701455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 >> 172.21.15.5:0/802586232 conn(0x7fcf700ce0d0 msgr2=0x7fcf700ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 shutdown_connections 2024-09-13T17:14:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.152+0000 7fcf7782b640 1 -- 172.21.15.5:0/802586232 wait complete. 2024-09-13T17:14:28.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:14:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.268+0000 7fd5eba9c640 1 Processor -- start 2024-09-13T17:14:28.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.268+0000 7fd5eba9c640 1 -- start start 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5eba9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5e406da30 0x7fd5e406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5eba9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e40ad050 con 0x7fd5e40abe60 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5eba9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e40ac440 con 0x7fd5e41591e0 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5eba9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e406e400 con 0x7fd5e406da30 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5e9037640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5e40abe60 0x7fd5e40b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40814/0 (socket says 172.21.15.5:40814) 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5e9037640 1 -- 172.21.15.5:0/3791885768 learned_addr learned my addr 172.21.15.5:0/3791885768 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5ea039640 1 --2- 172.21.15.5:0/3791885768 >> v2:172.21.15.179:3300/0 conn(0x7fd5e406da30 0x7fd5e406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169327769 0 0) 0x7fd5e40ad050 con 0x7fd5e40abe60 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.269+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d0003520 con 0x7fd5e40abe60 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232835043 0 0) 0x7fd5d0003520 con 0x7fd5e40abe60 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 >> v2:172.21.15.179:3300/0 conn(0x7fd5e406da30 msgr2=0x7fd5e406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 --2- 172.21.15.5:0/3791885768 >> v2:172.21.15.179:3300/0 conn(0x7fd5e406da30 0x7fd5e406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 >> v1:172.21.15.179:6789/0 conn(0x7fd5e41591e0 legacy=0x7fd5e40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40ac720 con 0x7fd5e40abe60 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd5e0001670 con 0x7fd5e40abe60 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 >> v1:172.21.15.5:6789/0 conn(0x7fd5e40abe60 legacy=0x7fd5e40b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d00039c0 0x7fd5d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d00047c0 0x7fd5d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 0x7fd5d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e406e400 con 0x7fd5d0005180 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d000e290 con 0x7fd5d00047c0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d000e450 con 0x7fd5d00039c0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 0x7fd5d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e9838640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d00039c0 0x7fd5d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5e9037640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d00047c0 0x7fd5d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 -- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d00039c0 msgr2=0x7fd5d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d00039c0 0x7fd5d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 -- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d00047c0 msgr2=0x7fd5d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5d00047c0 0x7fd5d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.270+0000 7fd5ea039640 1 -- 172.21.15.5:0/3791885768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0003520 con 0x7fd5d0005180 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.271+0000 7fd5ea039640 1 -- 172.21.15.5:0/3791885768 reap_dead start 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.271+0000 7fd5ea039640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 0x7fd5d000b980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009fc0 tx=0x7fd5d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa6fb6cf8eecccf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.271+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc003b90 con 0x7fd5d0005180 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.271+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00f040 con 0x7fd5d0005180 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.271+0000 7fd5e8836640 1 -- 172.21.15.5:0/3791885768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc004020 con 0x7fd5d0005180 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 -- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 msgr2=0x7fd5d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 0x7fd5d000b980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009fc0 tx=0x7fd5d00057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 -- 172.21.15.5:0/3791885768 shutdown_connections 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/3791885768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d0005180 0x7fd5d000b980 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 -- 172.21.15.5:0/3791885768 >> 172.21.15.5:0/3791885768 conn(0x7fd5e40ce130 msgr2=0x7fd5e40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 -- 172.21.15.5:0/3791885768 shutdown_connections 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.272+0000 7fd5eba9c640 1 -- 172.21.15.5:0/3791885768 wait complete. 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.273+0000 7fd5eba9c640 1 Processor -- start 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.273+0000 7fd5eba9c640 1 -- start start 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d0005180 0x7fd5e414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e4158510 0x7fd5e40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e414f2f0 con 0x7fd5e414d850 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e414e6e0 con 0x7fd5e4158510 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5eba9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e414e9c0 con 0x7fd5d0005180 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36316/0 (socket says 172.21.15.5:36316) 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 -- 172.21.15.5:0/2983149312 learned_addr learned my addr 172.21.15.5:0/2983149312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5e9838640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d0005180 0x7fd5e414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5e9037640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e4158510 0x7fd5e40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 -- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d0005180 msgr2=0x7fd5e414dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d0005180 0x7fd5e414dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 -- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e4158510 msgr2=0x7fd5e40703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e4158510 0x7fd5e40703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 -- 172.21.15.5:0/2983149312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e414eca0 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.274+0000 7fd5ea039640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e230 tx=0x7fd5dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.275+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031e90 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.275+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc03c470 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.275+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e414ef80 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.275+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc03c840 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.275+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e414e490 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.276+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e40672a0 con 0x7fd5e414d850 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.276+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5dc03c9a0 con 0x7fd5e414d850 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.276+0000 7fd5d67fc640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 0x7fd5c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.277+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd5dc0aa130 con 0x7fd5e414d850 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.277+0000 7fd5e9838640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 0x7fd5c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.277+0000 7fd5e9838640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 0x7fd5c806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000c00 tx=0x7fd5d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.281+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5dc075380 con 0x7fd5e414d850 2024-09-13T17:14:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.491+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd5e406dec0 con 0x7fd5e414d850 2024-09-13T17:14:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.533+0000 7fd5d67fc640 1 -- 172.21.15.5:0/2983149312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd5dc0789a0 con 0x7fd5e414d850 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 msgr2=0x7fd5c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 0x7fd5c806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000c00 tx=0x7fd5d8009040 comp rx=0 tx=0).stop 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 msgr2=0x7fd5e4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e230 tx=0x7fd5dc009750 comp rx=0 tx=0).stop 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 shutdown_connections 2024-09-13T17:14:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac00 0x7fd5c806d0c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e414d850 0x7fd5e4070900 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e4158510 0x7fd5e40703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 --2- 172.21.15.5:0/2983149312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5d0005180 0x7fd5e414dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 >> 172.21.15.5:0/2983149312 conn(0x7fd5e40ce130 msgr2=0x7fd5e40aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 shutdown_connections 2024-09-13T17:14:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.536+0000 7fd5eba9c640 1 -- 172.21.15.5:0/2983149312 wait complete. 2024-09-13T17:14:28.547 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:14:28.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:14:28.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.651+0000 7ff436d9d640 1 Processor -- start 2024-09-13T17:14:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 -- start start 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43006c3e0 0x7ff4300cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 0x7ff4300cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300d11e0 con 0x7ff4300d2ed0 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300d0c20 con 0x7ff43006c3e0 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.652+0000 7ff436d9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300d0f00 con 0x7ff4300cf960 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43006c3e0 0x7ff4300cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43006c3e0 0x7ff4300cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36326/0 (socket says 172.21.15.5:36326) 2024-09-13T17:14:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 -- 172.21.15.5:0/3979016298 learned_addr learned my addr 172.21.15.5:0/3979016298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff43559a640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 0x7ff4300cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 -- 172.21.15.5:0/3979016298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 msgr2=0x7ff4300cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 0x7ff4300cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 -- 172.21.15.5:0/3979016298 >> v1:172.21.15.179:6789/0 conn(0x7ff4300d2ed0 legacy=0x7ff43015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff435d9b640 1 -- 172.21.15.5:0/3979016298 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300d02a0 con 0x7ff43006c3e0 2024-09-13T17:14:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.653+0000 7ff43559a640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 0x7ff4300cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff435d9b640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cf420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff420009e50 tx=0x7ff42002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c634f651e55e43db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff434d99640 1 -- 172.21.15.5:0/3979016298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002aea0 con 0x7ff43006c3e0 2024-09-13T17:14:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff434d99640 1 -- 172.21.15.5:0/3979016298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42002d050 con 0x7ff43006c3e0 2024-09-13T17:14:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff434d99640 1 -- 172.21.15.5:0/3979016298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420031820 con 0x7ff43006c3e0 2024-09-13T17:14:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 -- 172.21.15.5:0/3979016298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 msgr2=0x7ff4300cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cf420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff420009e50 tx=0x7ff42002a6c0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 -- 172.21.15.5:0/3979016298 shutdown_connections 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300cf960 0x7ff4300cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 --2- 172.21.15.5:0/3979016298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cf420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 -- 172.21.15.5:0/3979016298 >> 172.21.15.5:0/3979016298 conn(0x7ff430089f90 msgr2=0x7ff4300d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 -- 172.21.15.5:0/3979016298 shutdown_connections 2024-09-13T17:14:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.654+0000 7ff436d9d640 1 -- 172.21.15.5:0/3979016298 wait complete. 2024-09-13T17:14:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 Processor -- start 2024-09-13T17:14:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 -- start start 2024-09-13T17:14:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 0x7ff430154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 0x7ff4300b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300b53d0 con 0x7ff43006c3e0 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430154e80 con 0x7ff4300cf960 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff436d9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300b6ac0 con 0x7ff4300d2ed0 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff435d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff435d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36330/0 (socket says 172.21.15.5:36330) 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.656+0000 7ff435d9b640 1 -- 172.21.15.5:0/1674807884 learned_addr learned my addr 172.21.15.5:0/1674807884 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff43559a640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 0x7ff430154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff43659c640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 0x7ff4300b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 -- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 msgr2=0x7ff4300b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 0x7ff4300b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 -- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 msgr2=0x7ff430154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 0x7ff430154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 -- 172.21.15.5:0/1674807884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009b30 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff43659c640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 0x7ff4300b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff43559a640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 0x7ff430154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff435d9b640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff420000f80 tx=0x7ff420004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42003d860 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42003d9c0 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300cbc60 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42003dd70 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.657+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4300cc220 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.658+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4300b1840 con 0x7ff43006c3e0 2024-09-13T17:14:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.659+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff42003b400 con 0x7ff43006c3e0 2024-09-13T17:14:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.659+0000 7ff42e7fc640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 0x7ff41c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.659+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4200aa390 con 0x7ff43006c3e0 2024-09-13T17:14:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.659+0000 7ff43559a640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 0x7ff41c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.660+0000 7ff43559a640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 0x7ff41c06d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff430158e40 tx=0x7ff424008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.663+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff420075430 con 0x7ff43006c3e0 2024-09-13T17:14:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:28.868+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff430073710 con 0x7ff43006c3e0 2024-09-13T17:14:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.535+0000 7ff42e7fc640 1 -- 172.21.15.5:0/1674807884 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff420009510 con 0x7ff43006c3e0 2024-09-13T17:14:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 msgr2=0x7ff41c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 0x7ff41c06d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff430158e40 tx=0x7ff424008040 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 msgr2=0x7ff4300cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff420000f80 tx=0x7ff420004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 shutdown_connections 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4300d2ed0 0x7ff4300b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4300cf960 0x7ff430154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff41c06ac00 0x7ff41c06d0c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 --2- 172.21.15.5:0/1674807884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43006c3e0 0x7ff4300cd920 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 >> 172.21.15.5:0/1674807884 conn(0x7ff430089f90 msgr2=0x7ff4300b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 shutdown_connections 2024-09-13T17:14:29.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.538+0000 7ff436d9d640 1 -- 172.21.15.5:0/1674807884 wait complete. 2024-09-13T17:14:29.552 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:14:29.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.659+0000 7f1043e87640 1 Processor -- start 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.659+0000 7f1043e87640 1 -- start start 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1043e87640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c156f40 0x7f103c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1043e87640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f103c06e1c0 0x7f103c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1043e87640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0b2390 con 0x7f103c0b1080 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1043e87640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0b14c0 con 0x7f103c06e1c0 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1043e87640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0b1780 con 0x7f103c156f40 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1042424640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f103c06e1c0 0x7f103c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1042424640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f103c06e1c0 0x7f103c0aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36346/0 (socket says 172.21.15.5:36346) 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.660+0000 7f1042424640 1 -- 172.21.15.5:0/2793884351 learned_addr learned my addr 172.21.15.5:0/2793884351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.661+0000 7f1041c23640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c156f40 0x7f103c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.661+0000 7f1042424640 1 -- 172.21.15.5:0/2793884351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c156f40 msgr2=0x7f103c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.661+0000 7f1042424640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c156f40 0x7f103c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.661+0000 7f1042424640 1 -- 172.21.15.5:0/2793884351 >> v1:172.21.15.179:6789/0 conn(0x7f103c0b1080 legacy=0x7f103c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.661+0000 7f1042424640 1 -- 172.21.15.5:0/2793884351 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0b1a60 con 0x7f103c06e1c0 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1042424640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c06e1c0 0x7f103c0aced0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f103400d150 tx=0x7f103402c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7304408e6c4552ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1040c21640 1 -- 172.21.15.5:0/2793884351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034009600 con 0x7f103c06e1c0 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1040c21640 1 -- 172.21.15.5:0/2793884351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034009760 con 0x7f103c06e1c0 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1040c21640 1 -- 172.21.15.5:0/2793884351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034009af0 con 0x7f103c06e1c0 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 -- 172.21.15.5:0/2793884351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c06e1c0 msgr2=0x7f103c0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c06e1c0 0x7f103c0aced0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f103400d150 tx=0x7f103402c930 comp rx=0 tx=0).stop 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 -- 172.21.15.5:0/2793884351 shutdown_connections 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c06e1c0 0x7f103c0aced0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 --2- 172.21.15.5:0/2793884351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c156f40 0x7f103c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.662+0000 7f1043e87640 1 -- 172.21.15.5:0/2793884351 >> 172.21.15.5:0/2793884351 conn(0x7f103c0ce0d0 msgr2=0x7f103c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.663+0000 7f1043e87640 1 -- 172.21.15.5:0/2793884351 shutdown_connections 2024-09-13T17:14:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.663+0000 7f1043e87640 1 -- 172.21.15.5:0/2793884351 wait complete. 2024-09-13T17:14:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 Processor -- start 2024-09-13T17:14:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 -- start start 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c06e1c0 0x7f103c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f103c0b1080 0x7f103c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c151e50 con 0x7f103c156f40 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c155a00 con 0x7f103c0b1080 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.664+0000 7f1043e87640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c155ce0 con 0x7f103c06e1c0 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36350/0 (socket says 172.21.15.5:36350) 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 -- 172.21.15.5:0/3440248753 learned_addr learned my addr 172.21.15.5:0/3440248753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1041422640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f103c0b1080 0x7f103c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1041c23640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c06e1c0 0x7f103c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 -- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c06e1c0 msgr2=0x7f103c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c06e1c0 0x7f103c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 -- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f103c0b1080 msgr2=0x7f103c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f103c0b1080 0x7f103c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 -- 172.21.15.5:0/3440248753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103400bd40 con 0x7f103c156f40 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1042424640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f103400d150 tx=0x7f1034004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034047680 con 0x7f103c156f40 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034040070 con 0x7f103c156f40 2024-09-13T17:14:29.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c155fc0 con 0x7f103c156f40 2024-09-13T17:14:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034047a20 con 0x7f103c156f40 2024-09-13T17:14:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.665+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c0cac40 con 0x7f103c156f40 2024-09-13T17:14:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.666+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0abb50 con 0x7f103c156f40 2024-09-13T17:14:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.667+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1034032420 con 0x7f103c156f40 2024-09-13T17:14:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.667+0000 7f10327fc640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 0x7f102006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.667+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1034042070 con 0x7f103c156f40 2024-09-13T17:14:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.668+0000 7f1041c23640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 0x7f102006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.668+0000 7f1041c23640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 0x7f102006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10380079a0 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.672+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1034077980 con 0x7f103c156f40 2024-09-13T17:14:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.877+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f103c151c20 con 0x7f103c156f40 2024-09-13T17:14:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.878+0000 7f10327fc640 1 -- 172.21.15.5:0/3440248753 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f103c151c20 con 0x7f103c156f40 2024-09-13T17:14:29.879 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:29.879 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:14:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:14:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 msgr2=0x7f102006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 0x7f102006d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10380079a0 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-09-13T17:14:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 msgr2=0x7f103c0ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f103400d150 tx=0x7f1034004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 shutdown_connections 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f102006ac00 0x7f102006d0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f103c156f40 0x7f103c0ca700 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f103c0b1080 0x7f103c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 --2- 172.21.15.5:0/3440248753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f103c06e1c0 0x7f103c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 >> 172.21.15.5:0/3440248753 conn(0x7f103c0ce0d0 msgr2=0x7f103c157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 shutdown_connections 2024-09-13T17:14:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.880+0000 7f1043e87640 1 -- 172.21.15.5:0/3440248753 wait complete. 2024-09-13T17:14:29.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.992+0000 7f60810f7640 1 Processor -- start 2024-09-13T17:14:29.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.992+0000 7f60810f7640 1 -- start start 2024-09-13T17:14:29.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f60810f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f607c06c820 0x7f607c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f60810f7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c0710c0 con 0x7f607c0b27c0 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f60810f7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c071550 con 0x7f607c15d4a0 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f60810f7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c15d9a0 con 0x7f607c06c820 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f6073fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f607c06c820 0x7f607c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f607ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f607c0b27c0 0x7f607c06c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40826/0 (socket says 172.21.15.5:40826) 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f607ad9d640 1 -- 172.21.15.5:0/1940399128 learned_addr learned my addr 172.21.15.5:0/1940399128 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f6073fff640 1 -- 172.21.15.5:0/1940399128 >> v1:172.21.15.179:6789/0 conn(0x7f607c15d4a0 legacy=0x7f607c153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f6073fff640 1 -- 172.21.15.5:0/1940399128 >> v1:172.21.15.5:6789/0 conn(0x7f607c0b27c0 legacy=0x7f607c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f6073fff640 1 -- 172.21.15.5:0/1940399128 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c153920 con 0x7f607c06c820 2024-09-13T17:14:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.993+0000 7f607a59c640 1 -- 172.21.15.5:0/1940399128 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137815725 0 0) 0x7f607c0710c0 con 0x7f607c0b27c0 2024-09-13T17:14:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.994+0000 7f6073fff640 1 --2- 172.21.15.5:0/1940399128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06c820 0x7f607c152cd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60640097d0 tx=0x7f606402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9468186a2e124e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.994+0000 7f607a59c640 1 -- 172.21.15.5:0/1940399128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064032440 con 0x7f607c06c820 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.994+0000 7f607a59c640 1 -- 172.21.15.5:0/1940399128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60640325a0 con 0x7f607c06c820 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.994+0000 7f607a59c640 1 -- 172.21.15.5:0/1940399128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064032930 con 0x7f607c06c820 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 -- 172.21.15.5:0/1940399128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06c820 msgr2=0x7f607c152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 --2- 172.21.15.5:0/1940399128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06c820 0x7f607c152cd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60640097d0 tx=0x7f606402a210 comp rx=0 tx=0).stop 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 -- 172.21.15.5:0/1940399128 shutdown_connections 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 --2- 172.21.15.5:0/1940399128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c06c820 0x7f607c152cd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 -- 172.21.15.5:0/1940399128 >> 172.21.15.5:0/1940399128 conn(0x7f607c0ce0d0 msgr2=0x7f607c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 -- 172.21.15.5:0/1940399128 shutdown_connections 2024-09-13T17:14:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.995+0000 7f60810f7640 1 -- 172.21.15.5:0/1940399128 wait complete. 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.996+0000 7f60810f7640 1 Processor -- start 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.996+0000 7f60810f7640 1 -- start start 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f607c06c820 0x7f607c13dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f607c15d4a0 0x7f607c09b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c14a650 con 0x7f607c0b27c0 2024-09-13T17:14:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c14a930 con 0x7f607c06c820 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f60810f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c14ac10 con 0x7f607c15d4a0 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36368/0 (socket says 172.21.15.5:36368) 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 -- 172.21.15.5:0/2235750652 learned_addr learned my addr 172.21.15.5:0/2235750652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f607ad9d640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f607c06c820 0x7f607c13dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f607b59e640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f607c15d4a0 0x7f607c09b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 -- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f607c15d4a0 msgr2=0x7f607c09b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f607c15d4a0 0x7f607c09b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 -- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f607c06c820 msgr2=0x7f607c13dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f607c06c820 0x7f607c13dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.997+0000 7f6073fff640 1 -- 172.21.15.5:0/2235750652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064009400 con 0x7f607c0b27c0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f6073fff640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f60640098f0 tx=0x7f60640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064004230 con 0x7f607c0b27c0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064004390 con 0x7f607c0b27c0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c14aef0 con 0x7f607c0b27c0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064030ac0 con 0x7f607c0b27c0 2024-09-13T17:14:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.998+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c15f680 con 0x7f607c0b27c0 2024-09-13T17:14:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.999+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c0672a0 con 0x7f607c0b27c0 2024-09-13T17:14:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:29.999+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6064039050 con 0x7f607c0b27c0 2024-09-13T17:14:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.000+0000 7f60737fe640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 0x7f605c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.000+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60640a9e80 con 0x7f607c0b27c0 2024-09-13T17:14:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.000+0000 7f607ad9d640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 0x7f605c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.001+0000 7f607ad9d640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 0x7f605c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f606c000f60 tx=0x7f606c007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.004+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6064074f40 con 0x7f607c0b27c0 2024-09-13T17:14:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.176+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f607c15f810 con 0x7f607c0b27c0 2024-09-13T17:14:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.177+0000 7f60737fe640 1 -- 172.21.15.5:0/2235750652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f60640a7180 con 0x7f607c0b27c0 2024-09-13T17:14:30.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:30.179 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 msgr2=0x7f605c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 0x7f605c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f606c000f60 tx=0x7f606c007d50 comp rx=0 tx=0).stop 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 msgr2=0x7f607c15f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f60640098f0 tx=0x7f60640046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 shutdown_connections 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f607c15d4a0 0x7f607c09b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f605c06ac30 0x7f605c06d0f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607c0b27c0 0x7f607c15f140 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 --2- 172.21.15.5:0/2235750652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f607c06c820 0x7f607c13dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.179+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 >> 172.21.15.5:0/2235750652 conn(0x7f607c0ce0d0 msgr2=0x7f607c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.180+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 shutdown_connections 2024-09-13T17:14:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.180+0000 7f60810f7640 1 -- 172.21.15.5:0/2235750652 wait complete. 2024-09-13T17:14:30.192 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:14:30.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:14:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.293+0000 7faac970f640 1 Processor -- start 2024-09-13T17:14:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.293+0000 7faac970f640 1 -- start start 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac970f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faac4099110 0x7faac40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac970f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac970f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40704a0 con 0x7faac415fd80 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac970f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac406cc10 con 0x7faac4099110 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac970f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40d12e0 con 0x7faac40d0e30 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac27fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faac4099110 0x7faac40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39388/0 (socket says 172.21.15.5:39388) 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.294+0000 7faac37fe640 1 -- 172.21.15.5:0/1398416471 learned_addr learned my addr 172.21.15.5:0/1398416471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac27fc640 1 -- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 msgr2=0x7faac406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac27fc640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac27fc640 1 -- 172.21.15.5:0/1398416471 >> v1:172.21.15.179:6789/0 conn(0x7faac415fd80 legacy=0x7faac4098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac27fc640 1 -- 172.21.15.5:0/1398416471 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac406bd80 con 0x7faac4099110 2024-09-13T17:14:30.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac37fe640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.295+0000 7faac27fc640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac4099110 0x7faac40cfd30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63a86d47fec6ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac1ffb640 1 -- 172.21.15.5:0/1398416471 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab802ae50 con 0x7faac4099110 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac1ffb640 1 -- 172.21.15.5:0/1398416471 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8032440 con 0x7faac4099110 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac1ffb640 1 -- 172.21.15.5:0/1398416471 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80327d0 con 0x7faac4099110 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 -- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac4099110 msgr2=0x7faac40cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac4099110 0x7faac40cfd30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802a100 comp rx=0 tx=0).stop 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 -- 172.21.15.5:0/1398416471 shutdown_connections 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac40d0e30 0x7faac406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 --2- 172.21.15.5:0/1398416471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac4099110 0x7faac40cfd30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 -- 172.21.15.5:0/1398416471 >> 172.21.15.5:0/1398416471 conn(0x7faac40d0310 msgr2=0x7faac40d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 -- 172.21.15.5:0/1398416471 shutdown_connections 2024-09-13T17:14:30.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.296+0000 7faac970f640 1 -- 172.21.15.5:0/1398416471 wait complete. 2024-09-13T17:14:30.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 Processor -- start 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 -- start start 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40d0e30 0x7faac4157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac415fd80 0x7faac41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b37f0 con 0x7faac4099110 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40b3200 con 0x7faac40d0e30 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac970f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac4157310 con 0x7faac415fd80 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.298+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36380/0 (socket says 172.21.15.5:36380) 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 -- 172.21.15.5:0/3164483849 learned_addr learned my addr 172.21.15.5:0/3164483849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac37fe640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac415fd80 0x7faac41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac27fc640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40d0e30 0x7faac4157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 -- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac415fd80 msgr2=0x7faac41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac415fd80 0x7faac41580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 -- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40d0e30 msgr2=0x7faac4157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40d0e30 0x7faac4157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 -- 172.21.15.5:0/3164483849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc009b30 con 0x7faac4099110 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac2ffd640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faab400c450 tx=0x7faab400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40052d0 con 0x7faac4099110 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4005430 con 0x7faac4099110 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab8009400 con 0x7faac4099110 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4012870 con 0x7faac4099110 2024-09-13T17:14:30.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.299+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40b3410 con 0x7faac4099110 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.300+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac40cfa60 con 0x7faac4099110 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.301+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faab40129d0 con 0x7faac4099110 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.301+0000 7faaab7fe640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 0x7faab006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.301+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faab4088dc0 con 0x7faac4099110 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.301+0000 7faac27fc640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 0x7faab006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.302+0000 7faac27fc640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 0x7faab006d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faab8034000 tx=0x7faab802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.305+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faab4053fa0 con 0x7faac4099110 2024-09-13T17:14:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.474+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faac40cf4e0 con 0x7faab006ac00 2024-09-13T17:14:30.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.482+0000 7faaab7fe640 1 -- 172.21.15.5:0/3164483849 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286468 (secure 0 0 0) 0x7faab8032960 con 0x7faab006ac00 2024-09-13T17:14:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:30.488 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 msgr2=0x7faab006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 0x7faab006d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faab8034000 tx=0x7faab802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 msgr2=0x7faac4154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faab400c450 tx=0x7faab400c910 comp rx=0 tx=0).stop 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 shutdown_connections 2024-09-13T17:14:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac415fd80 0x7faac41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac40d0e30 0x7faac4157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faab006ac00 0x7faab006d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 --2- 172.21.15.5:0/3164483849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac4099110 0x7faac4154980 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 >> 172.21.15.5:0/3164483849 conn(0x7faac40d0310 msgr2=0x7faac40d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 shutdown_connections 2024-09-13T17:14:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.485+0000 7faac970f640 1 -- 172.21.15.5:0/3164483849 wait complete. 2024-09-13T17:14:30.497 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-13T17:14:29.274613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4608000,"data_stored":2615075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000826"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172122+0000","last_change":"2024-09-13T17:14:27.172122+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172122+0000","last_undegraded":"2024-09-13T17:14:27.172122+0000","last_fullsized":"2024-09-13T17:14:27.172122+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169878+0000","last_change":"2024-09-13T17:14:27.169878+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169878+0000","last_undegraded":"2024-09-13T17:14:27.169878+0000","last_fullsized":"2024-09-13T17:14:27.169878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169655+0000","last_change":"2024-09-13T17:14:27.169655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169655+0000","last_undegraded":"2024-09-13T17:14:27.169655+0000","last_fullsized":"2024-09-13T17:14:27.169655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170655+0000","last_change":"2024-09-13T17:14:27.170655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170655+0000","last_undegraded":"2024-09-13T17:14:27.170655+0000","last_fullsized":"2024-09-13T17:14:27.170655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166677+0000","last_change":"2024-09-13T17:14:27.166677+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166677+0000","last_undegraded":"2024-09-13T17:14:27.166677+0000","last_fullsized":"2024-09-13T17:14:27.166677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175417+0000","last_change":"2024-09-13T17:14:27.175417+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175417+0000","last_undegraded":"2024-09-13T17:14:27.175417+0000","last_fullsized":"2024-09-13T17:14:27.175417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173107+0000","last_change":"2024-09-13T17:14:27.173107+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173107+0000","last_undegraded":"2024-09-13T17:14:27.173107+0000","last_fullsized":"2024-09-13T17:14:27.173107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169631+0000","last_change":"2024-09-13T17:14:27.169631+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169631+0000","last_undegraded":"2024-09-13T17:14:27.169631+0000","last_fullsized":"2024-09-13T17:14:27.169631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170943+0000","last_change":"2024-09-13T17:14:27.170943+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170943+0000","last_undegraded":"2024-09-13T17:14:27.170943+0000","last_fullsized":"2024-09-13T17:14:27.170943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172534+0000","last_change":"2024-09-13T17:14:27.172534+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172534+0000","last_undegraded":"2024-09-13T17:14:27.172534+0000","last_fullsized":"2024-09-13T17:14:27.172534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174357+0000","last_change":"2024-09-13T17:14:27.174357+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174357+0000","last_undegraded":"2024-09-13T17:14:27.174357+0000","last_fullsized":"2024-09-13T17:14:27.174357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170971+0000","last_change":"2024-09-13T17:14:27.170971+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170971+0000","last_undegraded":"2024-09-13T17:14:27.170971+0000","last_fullsized":"2024-09-13T17:14:27.170971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172831+0000","last_change":"2024-09-13T17:14:27.172831+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172831+0000","last_undegraded":"2024-09-13T17:14:27.172831+0000","last_fullsized":"2024-09-13T17:14:27.172831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171097+0000","last_change":"2024-09-13T17:14:27.171097+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171097+0000","last_undegraded":"2024-09-13T17:14:27.171097+0000","last_fullsized":"2024-09-13T17:14:27.171097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172563+0000","last_change":"2024-09-13T17:14:27.172563+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172563+0000","last_undegraded":"2024-09-13T17:14:27.172563+0000","last_fullsized":"2024-09-13T17:14:27.172563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165801+0000","last_change":"2024-09-13T17:14:27.165801+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165801+0000","last_undegraded":"2024-09-13T17:14:27.165801+0000","last_fullsized":"2024-09-13T17:14:27.165801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166291+0000","last_change":"2024-09-13T17:14:27.166291+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166291+0000","last_undegraded":"2024-09-13T17:14:27.166291+0000","last_fullsized":"2024-09-13T17:14:27.166291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166056+0000","last_change":"2024-09-13T17:14:27.166056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166056+0000","last_undegraded":"2024-09-13T17:14:27.166056+0000","last_fullsized":"2024-09-13T17:14:27.166056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170990+0000","last_change":"2024-09-13T17:14:27.170990+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170990+0000","last_undegraded":"2024-09-13T17:14:27.170990+0000","last_fullsized":"2024-09-13T17:14:27.170990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165504+0000","last_change":"2024-09-13T17:14:27.165504+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165504+0000","last_undegraded":"2024-09-13T17:14:27.165504+0000","last_fullsized":"2024-09-13T17:14:27.165504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171773+0000","last_change":"2024-09-13T17:14:27.171773+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171773+0000","last_undegraded":"2024-09-13T17:14:27.171773+0000","last_fullsized":"2024-09-13T17:14:27.171773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170224+0000","last_change":"2024-09-13T17:14:27.170224+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170224+0000","last_undegraded":"2024-09-13T17:14:27.170224+0000","last_fullsized":"2024-09-13T17:14:27.170224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166921+0000","last_change":"2024-09-13T17:14:27.166921+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166921+0000","last_undegraded":"2024-09-13T17:14:27.166921+0000","last_fullsized":"2024-09-13T17:14:27.166921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170070+0000","last_change":"2024-09-13T17:14:27.170070+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170070+0000","last_undegraded":"2024-09-13T17:14:27.170070+0000","last_fullsized":"2024-09-13T17:14:27.170070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165675+0000","last_change":"2024-09-13T17:14:27.165675+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165675+0000","last_undegraded":"2024-09-13T17:14:27.165675+0000","last_fullsized":"2024-09-13T17:14:27.165675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175048+0000","last_change":"2024-09-13T17:14:27.175048+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175048+0000","last_undegraded":"2024-09-13T17:14:27.175048+0000","last_fullsized":"2024-09-13T17:14:27.175048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165738+0000","last_change":"2024-09-13T17:14:27.165738+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165738+0000","last_undegraded":"2024-09-13T17:14:27.165738+0000","last_fullsized":"2024-09-13T17:14:27.165738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172095+0000","last_change":"2024-09-13T17:14:27.172095+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172095+0000","last_undegraded":"2024-09-13T17:14:27.172095+0000","last_fullsized":"2024-09-13T17:14:27.172095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165420+0000","last_change":"2024-09-13T17:14:27.165420+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165420+0000","last_undegraded":"2024-09-13T17:14:27.165420+0000","last_fullsized":"2024-09-13T17:14:27.165420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166100+0000","last_change":"2024-09-13T17:14:27.166100+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166100+0000","last_undegraded":"2024-09-13T17:14:27.166100+0000","last_fullsized":"2024-09-13T17:14:27.166100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166473+0000","last_change":"2024-09-13T17:14:27.166473+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166473+0000","last_undegraded":"2024-09-13T17:14:27.166473+0000","last_fullsized":"2024-09-13T17:14:27.166473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171152+0000","last_change":"2024-09-13T17:14:27.171152+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171152+0000","last_undegraded":"2024-09-13T17:14:27.171152+0000","last_fullsized":"2024-09-13T17:14:27.171152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168039+0000","last_change":"2024-09-13T17:14:27.168039+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168039+0000","last_undegraded":"2024-09-13T17:14:27.168039+0000","last_fullsized":"2024-09-13T17:14:27.168039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181867+0000","last_change":"2024-09-13T17:14:27.178887+0000","last_active":"2024-09-13T17:14:27.181867+0000","last_peered":"2024-09-13T17:14:27.181867+0000","last_clean":"2024-09-13T17:14:27.181867+0000","last_became_active":"2024-09-13T17:14:27.178489+0000","last_became_peered":"2024-09-13T17:14:27.178489+0000","last_unstale":"2024-09-13T17:14:27.181867+0000","last_undegraded":"2024-09-13T17:14:27.181867+0000","last_fullsized":"2024-09-13T17:14:27.181867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174566+0000","last_change":"2024-09-13T17:14:27.174566+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174566+0000","last_undegraded":"2024-09-13T17:14:27.174566+0000","last_fullsized":"2024-09-13T17:14:27.174566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185259+0000","last_change":"2024-09-13T17:14:27.182304+0000","last_active":"2024-09-13T17:14:27.185259+0000","last_peered":"2024-09-13T17:14:27.185259+0000","last_clean":"2024-09-13T17:14:27.185259+0000","last_became_active":"2024-09-13T17:14:27.182039+0000","last_became_peered":"2024-09-13T17:14:27.182039+0000","last_unstale":"2024-09-13T17:14:27.185259+0000","last_undegraded":"2024-09-13T17:14:27.185259+0000","last_fullsized":"2024-09-13T17:14:27.185259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171498+0000","last_change":"2024-09-13T17:14:27.171498+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171498+0000","last_undegraded":"2024-09-13T17:14:27.171498+0000","last_fullsized":"2024-09-13T17:14:27.171498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181738+0000","last_change":"2024-09-13T17:14:27.179507+0000","last_active":"2024-09-13T17:14:27.181738+0000","last_peered":"2024-09-13T17:14:27.181738+0000","last_clean":"2024-09-13T17:14:27.181738+0000","last_became_active":"2024-09-13T17:14:27.178726+0000","last_became_peered":"2024-09-13T17:14:27.178726+0000","last_unstale":"2024-09-13T17:14:27.181738+0000","last_undegraded":"2024-09-13T17:14:27.181738+0000","last_fullsized":"2024-09-13T17:14:27.181738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169825+0000","last_change":"2024-09-13T17:14:27.169825+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169825+0000","last_undegraded":"2024-09-13T17:14:27.169825+0000","last_fullsized":"2024-09-13T17:14:27.169825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184929+0000","last_change":"2024-09-13T17:14:27.180909+0000","last_active":"2024-09-13T17:14:27.184929+0000","last_peered":"2024-09-13T17:14:27.184929+0000","last_clean":"2024-09-13T17:14:27.184929+0000","last_became_active":"2024-09-13T17:14:27.180637+0000","last_became_peered":"2024-09-13T17:14:27.180637+0000","last_unstale":"2024-09-13T17:14:27.184929+0000","last_undegraded":"2024-09-13T17:14:27.184929+0000","last_fullsized":"2024-09-13T17:14:27.184929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167797+0000","last_change":"2024-09-13T17:14:27.167797+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167797+0000","last_undegraded":"2024-09-13T17:14:27.167797+0000","last_fullsized":"2024-09-13T17:14:27.167797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.188132+0000","last_change":"2024-09-13T17:14:27.184677+0000","last_active":"2024-09-13T17:14:27.188132+0000","last_peered":"2024-09-13T17:14:27.188132+0000","last_clean":"2024-09-13T17:14:27.188132+0000","last_became_active":"2024-09-13T17:14:27.184400+0000","last_became_peered":"2024-09-13T17:14:27.184400+0000","last_unstale":"2024-09-13T17:14:27.188132+0000","last_undegraded":"2024-09-13T17:14:27.188132+0000","last_fullsized":"2024-09-13T17:14:27.188132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171465+0000","last_change":"2024-09-13T17:14:27.171465+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171465+0000","last_undegraded":"2024-09-13T17:14:27.171465+0000","last_fullsized":"2024-09-13T17:14:27.171465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187948+0000","last_change":"2024-09-13T17:14:27.182479+0000","last_active":"2024-09-13T17:14:27.187948+0000","last_peered":"2024-09-13T17:14:27.187948+0000","last_clean":"2024-09-13T17:14:27.187948+0000","last_became_active":"2024-09-13T17:14:27.182170+0000","last_became_peered":"2024-09-13T17:14:27.182170+0000","last_unstale":"2024-09-13T17:14:27.187948+0000","last_undegraded":"2024-09-13T17:14:27.187948+0000","last_fullsized":"2024-09-13T17:14:27.187948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:34.671799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169769+0000","last_change":"2024-09-13T17:14:27.169769+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169769+0000","last_undegraded":"2024-09-13T17:14:27.169769+0000","last_fullsized":"2024-09-13T17:14:27.169769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184696+0000","last_change":"2024-09-13T17:14:27.183303+0000","last_active":"2024-09-13T17:14:27.184696+0000","last_peered":"2024-09-13T17:14:27.184696+0000","last_clean":"2024-09-13T17:14:27.184696+0000","last_became_active":"2024-09-13T17:14:27.183018+0000","last_became_peered":"2024-09-13T17:14:27.183018+0000","last_unstale":"2024-09-13T17:14:27.184696+0000","last_undegraded":"2024-09-13T17:14:27.184696+0000","last_fullsized":"2024-09-13T17:14:27.184696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.876181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168918+0000","last_change":"2024-09-13T17:14:27.168918+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168918+0000","last_undegraded":"2024-09-13T17:14:27.168918+0000","last_fullsized":"2024-09-13T17:14:27.168918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184890+0000","last_change":"2024-09-13T17:14:27.180537+0000","last_active":"2024-09-13T17:14:27.184890+0000","last_peered":"2024-09-13T17:14:27.184890+0000","last_clean":"2024-09-13T17:14:27.184890+0000","last_became_active":"2024-09-13T17:14:27.180234+0000","last_became_peered":"2024-09-13T17:14:27.180234+0000","last_unstale":"2024-09-13T17:14:27.184890+0000","last_undegraded":"2024-09-13T17:14:27.184890+0000","last_fullsized":"2024-09-13T17:14:27.184890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168250+0000","last_change":"2024-09-13T17:14:27.168250+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168250+0000","last_undegraded":"2024-09-13T17:14:27.168250+0000","last_fullsized":"2024-09-13T17:14:27.168250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183828+0000","last_change":"2024-09-13T17:14:27.180202+0000","last_active":"2024-09-13T17:14:27.183828+0000","last_peered":"2024-09-13T17:14:27.183828+0000","last_clean":"2024-09-13T17:14:27.183828+0000","last_became_active":"2024-09-13T17:14:27.179900+0000","last_became_peered":"2024-09-13T17:14:27.179900+0000","last_unstale":"2024-09-13T17:14:27.183828+0000","last_undegraded":"2024-09-13T17:14:27.183828+0000","last_fullsized":"2024-09-13T17:14:27.183828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:00.975889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168615+0000","last_change":"2024-09-13T17:14:27.168615+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168615+0000","last_undegraded":"2024-09-13T17:14:27.168615+0000","last_fullsized":"2024-09-13T17:14:27.168615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187923+0000","last_change":"2024-09-13T17:14:27.183493+0000","last_active":"2024-09-13T17:14:27.187923+0000","last_peered":"2024-09-13T17:14:27.187923+0000","last_clean":"2024-09-13T17:14:27.187923+0000","last_became_active":"2024-09-13T17:14:27.183219+0000","last_became_peered":"2024-09-13T17:14:27.183219+0000","last_unstale":"2024-09-13T17:14:27.187923+0000","last_undegraded":"2024-09-13T17:14:27.187923+0000","last_fullsized":"2024-09-13T17:14:27.187923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:51.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173520+0000","last_change":"2024-09-13T17:14:27.173520+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173520+0000","last_undegraded":"2024-09-13T17:14:27.173520+0000","last_fullsized":"2024-09-13T17:14:27.173520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182239+0000","last_change":"2024-09-13T17:14:27.180924+0000","last_active":"2024-09-13T17:14:27.182239+0000","last_peered":"2024-09-13T17:14:27.182239+0000","last_clean":"2024-09-13T17:14:27.182239+0000","last_became_active":"2024-09-13T17:14:27.180626+0000","last_became_peered":"2024-09-13T17:14:27.180626+0000","last_unstale":"2024-09-13T17:14:27.182239+0000","last_undegraded":"2024-09-13T17:14:27.182239+0000","last_fullsized":"2024-09-13T17:14:27.182239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:15.195575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170467+0000","last_change":"2024-09-13T17:14:27.170467+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170467+0000","last_undegraded":"2024-09-13T17:14:27.170467+0000","last_fullsized":"2024-09-13T17:14:27.170467+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184445+0000","last_change":"2024-09-13T17:14:27.183475+0000","last_active":"2024-09-13T17:14:27.184445+0000","last_peered":"2024-09-13T17:14:27.184445+0000","last_clean":"2024-09-13T17:14:27.184445+0000","last_became_active":"2024-09-13T17:14:27.183225+0000","last_became_peered":"2024-09-13T17:14:27.183225+0000","last_unstale":"2024-09-13T17:14:27.184445+0000","last_undegraded":"2024-09-13T17:14:27.184445+0000","last_fullsized":"2024-09-13T17:14:27.184445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:53.422345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167353+0000","last_change":"2024-09-13T17:14:27.167353+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167353+0000","last_undegraded":"2024-09-13T17:14:27.167353+0000","last_fullsized":"2024-09-13T17:14:27.167353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181191+0000","last_change":"2024-09-13T17:14:27.179542+0000","last_active":"2024-09-13T17:14:27.181191+0000","last_peered":"2024-09-13T17:14:27.181191+0000","last_clean":"2024-09-13T17:14:27.181191+0000","last_became_active":"2024-09-13T17:14:27.179295+0000","last_became_peered":"2024-09-13T17:14:27.179295+0000","last_unstale":"2024-09-13T17:14:27.181191+0000","last_undegraded":"2024-09-13T17:14:27.181191+0000","last_fullsized":"2024-09-13T17:14:27.181191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:14.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167545+0000","last_change":"2024-09-13T17:14:27.167545+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167545+0000","last_undegraded":"2024-09-13T17:14:27.167545+0000","last_fullsized":"2024-09-13T17:14:27.167545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184683+0000","last_change":"2024-09-13T17:14:27.183558+0000","last_active":"2024-09-13T17:14:27.184683+0000","last_peered":"2024-09-13T17:14:27.184683+0000","last_clean":"2024-09-13T17:14:27.184683+0000","last_became_active":"2024-09-13T17:14:27.183231+0000","last_became_peered":"2024-09-13T17:14:27.183231+0000","last_unstale":"2024-09-13T17:14:27.184683+0000","last_undegraded":"2024-09-13T17:14:27.184683+0000","last_fullsized":"2024-09-13T17:14:27.184683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167040+0000","last_change":"2024-09-13T17:14:27.167040+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167040+0000","last_undegraded":"2024-09-13T17:14:27.167040+0000","last_fullsized":"2024-09-13T17:14:27.167040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.179407+0000","last_change":"2024-09-13T17:14:27.175502+0000","last_active":"2024-09-13T17:14:27.179407+0000","last_peered":"2024-09-13T17:14:27.179407+0000","last_clean":"2024-09-13T17:14:27.179407+0000","last_became_active":"2024-09-13T17:14:27.175233+0000","last_became_peered":"2024-09-13T17:14:27.175233+0000","last_unstale":"2024-09-13T17:14:27.179407+0000","last_undegraded":"2024-09-13T17:14:27.179407+0000","last_fullsized":"2024-09-13T17:14:27.179407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166904+0000","last_change":"2024-09-13T17:14:27.166904+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166904+0000","last_undegraded":"2024-09-13T17:14:27.166904+0000","last_fullsized":"2024-09-13T17:14:27.166904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184713+0000","last_change":"2024-09-13T17:14:27.178968+0000","last_active":"2024-09-13T17:14:27.184713+0000","last_peered":"2024-09-13T17:14:27.184713+0000","last_clean":"2024-09-13T17:14:27.184713+0000","last_became_active":"2024-09-13T17:14:27.178691+0000","last_became_peered":"2024-09-13T17:14:27.178691+0000","last_unstale":"2024-09-13T17:14:27.184713+0000","last_undegraded":"2024-09-13T17:14:27.184713+0000","last_fullsized":"2024-09-13T17:14:27.184713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:18.175245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168135+0000","last_change":"2024-09-13T17:14:27.168135+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168135+0000","last_undegraded":"2024-09-13T17:14:27.168135+0000","last_fullsized":"2024-09-13T17:14:27.168135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182247+0000","last_change":"2024-09-13T17:14:27.179184+0000","last_active":"2024-09-13T17:14:27.182247+0000","last_peered":"2024-09-13T17:14:27.182247+0000","last_clean":"2024-09-13T17:14:27.182247+0000","last_became_active":"2024-09-13T17:14:27.178874+0000","last_became_peered":"2024-09-13T17:14:27.178874+0000","last_unstale":"2024-09-13T17:14:27.182247+0000","last_undegraded":"2024-09-13T17:14:27.182247+0000","last_fullsized":"2024-09-13T17:14:27.182247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173501+0000","last_change":"2024-09-13T17:14:27.173501+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173501+0000","last_undegraded":"2024-09-13T17:14:27.173501+0000","last_fullsized":"2024-09-13T17:14:27.173501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184953+0000","last_change":"2024-09-13T17:14:27.180947+0000","last_active":"2024-09-13T17:14:27.184953+0000","last_peered":"2024-09-13T17:14:27.184953+0000","last_clean":"2024-09-13T17:14:27.184953+0000","last_became_active":"2024-09-13T17:14:27.180683+0000","last_became_peered":"2024-09-13T17:14:27.180683+0000","last_unstale":"2024-09-13T17:14:27.184953+0000","last_undegraded":"2024-09-13T17:14:27.184953+0000","last_fullsized":"2024-09-13T17:14:27.184953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172898+0000","last_change":"2024-09-13T17:14:27.172898+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172898+0000","last_undegraded":"2024-09-13T17:14:27.172898+0000","last_fullsized":"2024-09-13T17:14:27.172898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178935+0000","last_change":"2024-09-13T17:14:27.172607+0000","last_active":"2024-09-13T17:14:27.178935+0000","last_peered":"2024-09-13T17:14:27.178935+0000","last_clean":"2024-09-13T17:14:27.178935+0000","last_became_active":"2024-09-13T17:14:27.172347+0000","last_became_peered":"2024-09-13T17:14:27.172347+0000","last_unstale":"2024-09-13T17:14:27.178935+0000","last_undegraded":"2024-09-13T17:14:27.178935+0000","last_fullsized":"2024-09-13T17:14:27.178935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:36.824007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169188+0000","last_change":"2024-09-13T17:14:27.169188+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169188+0000","last_undegraded":"2024-09-13T17:14:27.169188+0000","last_fullsized":"2024-09-13T17:14:27.169188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183626+0000","last_change":"2024-09-13T17:14:27.182516+0000","last_active":"2024-09-13T17:14:27.183626+0000","last_peered":"2024-09-13T17:14:27.183626+0000","last_clean":"2024-09-13T17:14:27.183626+0000","last_became_active":"2024-09-13T17:14:27.182251+0000","last_became_peered":"2024-09-13T17:14:27.182251+0000","last_unstale":"2024-09-13T17:14:27.183626+0000","last_undegraded":"2024-09-13T17:14:27.183626+0000","last_fullsized":"2024-09-13T17:14:27.183626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165262+0000","last_change":"2024-09-13T17:14:27.165262+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165262+0000","last_undegraded":"2024-09-13T17:14:27.165262+0000","last_fullsized":"2024-09-13T17:14:27.165262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178705+0000","last_change":"2024-09-13T17:14:27.176577+0000","last_active":"2024-09-13T17:14:27.178705+0000","last_peered":"2024-09-13T17:14:27.178705+0000","last_clean":"2024-09-13T17:14:27.178705+0000","last_became_active":"2024-09-13T17:14:27.176318+0000","last_became_peered":"2024-09-13T17:14:27.176318+0000","last_unstale":"2024-09-13T17:14:27.178705+0000","last_undegraded":"2024-09-13T17:14:27.178705+0000","last_fullsized":"2024-09-13T17:14:27.178705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166539+0000","last_change":"2024-09-13T17:14:27.166539+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166539+0000","last_undegraded":"2024-09-13T17:14:27.166539+0000","last_fullsized":"2024-09-13T17:14:27.166539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.177935+0000","last_change":"2024-09-13T17:14:27.175822+0000","last_active":"2024-09-13T17:14:27.177935+0000","last_peered":"2024-09-13T17:14:27.177935+0000","last_clean":"2024-09-13T17:14:27.177935+0000","last_became_active":"2024-09-13T17:14:27.175513+0000","last_became_peered":"2024-09-13T17:14:27.175513+0000","last_unstale":"2024-09-13T17:14:27.177935+0000","last_undegraded":"2024-09-13T17:14:27.177935+0000","last_fullsized":"2024-09-13T17:14:27.177935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172144+0000","last_change":"2024-09-13T17:14:27.172144+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172144+0000","last_undegraded":"2024-09-13T17:14:27.172144+0000","last_fullsized":"2024-09-13T17:14:27.172144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184637+0000","last_change":"2024-09-13T17:14:27.177681+0000","last_active":"2024-09-13T17:14:27.184637+0000","last_peered":"2024-09-13T17:14:27.184637+0000","last_clean":"2024-09-13T17:14:27.184637+0000","last_became_active":"2024-09-13T17:14:27.177376+0000","last_became_peered":"2024-09-13T17:14:27.177376+0000","last_unstale":"2024-09-13T17:14:27.184637+0000","last_undegraded":"2024-09-13T17:14:27.184637+0000","last_fullsized":"2024-09-13T17:14:27.184637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166329+0000","last_change":"2024-09-13T17:14:27.166329+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166329+0000","last_undegraded":"2024-09-13T17:14:27.166329+0000","last_fullsized":"2024-09-13T17:14:27.166329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178372+0000","last_change":"2024-09-13T17:14:27.172367+0000","last_active":"2024-09-13T17:14:27.178372+0000","last_peered":"2024-09-13T17:14:27.178372+0000","last_clean":"2024-09-13T17:14:27.178372+0000","last_became_active":"2024-09-13T17:14:27.172106+0000","last_became_peered":"2024-09-13T17:14:27.172106+0000","last_unstale":"2024-09-13T17:14:27.178372+0000","last_undegraded":"2024-09-13T17:14:27.178372+0000","last_fullsized":"2024-09-13T17:14:27.178372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170712+0000","last_change":"2024-09-13T17:14:27.170712+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170712+0000","last_undegraded":"2024-09-13T17:14:27.170712+0000","last_fullsized":"2024-09-13T17:14:27.170712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182267+0000","last_change":"2024-09-13T17:14:27.180268+0000","last_active":"2024-09-13T17:14:27.182267+0000","last_peered":"2024-09-13T17:14:27.182267+0000","last_clean":"2024-09-13T17:14:27.182267+0000","last_became_active":"2024-09-13T17:14:27.180020+0000","last_became_peered":"2024-09-13T17:14:27.180020+0000","last_unstale":"2024-09-13T17:14:27.182267+0000","last_undegraded":"2024-09-13T17:14:27.182267+0000","last_fullsized":"2024-09-13T17:14:27.182267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167999+0000","last_change":"2024-09-13T17:14:27.167999+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167999+0000","last_undegraded":"2024-09-13T17:14:27.167999+0000","last_fullsized":"2024-09-13T17:14:27.167999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178671+0000","last_change":"2024-09-13T17:14:27.177225+0000","last_active":"2024-09-13T17:14:27.178671+0000","last_peered":"2024-09-13T17:14:27.178671+0000","last_clean":"2024-09-13T17:14:27.178671+0000","last_became_active":"2024-09-13T17:14:27.176960+0000","last_became_peered":"2024-09-13T17:14:27.176960+0000","last_unstale":"2024-09-13T17:14:27.178671+0000","last_undegraded":"2024-09-13T17:14:27.178671+0000","last_fullsized":"2024-09-13T17:14:27.178671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168114+0000","last_change":"2024-09-13T17:14:27.168114+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168114+0000","last_undegraded":"2024-09-13T17:14:27.168114+0000","last_fullsized":"2024-09-13T17:14:27.168114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185089+0000","last_change":"2024-09-13T17:14:27.179591+0000","last_active":"2024-09-13T17:14:27.185089+0000","last_peered":"2024-09-13T17:14:27.185089+0000","last_clean":"2024-09-13T17:14:27.185089+0000","last_became_active":"2024-09-13T17:14:27.179239+0000","last_became_peered":"2024-09-13T17:14:27.179239+0000","last_unstale":"2024-09-13T17:14:27.185089+0000","last_undegraded":"2024-09-13T17:14:27.185089+0000","last_fullsized":"2024-09-13T17:14:27.185089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166605+0000","last_change":"2024-09-13T17:14:27.166605+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166605+0000","last_undegraded":"2024-09-13T17:14:27.166605+0000","last_fullsized":"2024-09-13T17:14:27.166605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183959+0000","last_change":"2024-09-13T17:14:27.177799+0000","last_active":"2024-09-13T17:14:27.183959+0000","last_peered":"2024-09-13T17:14:27.183959+0000","last_clean":"2024-09-13T17:14:27.183959+0000","last_became_active":"2024-09-13T17:14:27.177488+0000","last_became_peered":"2024-09-13T17:14:27.177488+0000","last_unstale":"2024-09-13T17:14:27.183959+0000","last_undegraded":"2024-09-13T17:14:27.183959+0000","last_fullsized":"2024-09-13T17:14:27.183959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174200+0000","last_change":"2024-09-13T17:14:27.174200+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174200+0000","last_undegraded":"2024-09-13T17:14:27.174200+0000","last_fullsized":"2024-09-13T17:14:27.174200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182119+0000","last_change":"2024-09-13T17:14:27.180015+0000","last_active":"2024-09-13T17:14:27.182119+0000","last_peered":"2024-09-13T17:14:27.182119+0000","last_clean":"2024-09-13T17:14:27.182119+0000","last_became_active":"2024-09-13T17:14:27.179758+0000","last_became_peered":"2024-09-13T17:14:27.179758+0000","last_unstale":"2024-09-13T17:14:27.182119+0000","last_undegraded":"2024-09-13T17:14:27.182119+0000","last_fullsized":"2024-09-13T17:14:27.182119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170676+0000","last_change":"2024-09-13T17:14:27.170676+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170676+0000","last_undegraded":"2024-09-13T17:14:27.170676+0000","last_fullsized":"2024-09-13T17:14:27.170676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184699+0000","last_change":"2024-09-13T17:14:27.178335+0000","last_active":"2024-09-13T17:14:27.184699+0000","last_peered":"2024-09-13T17:14:27.184699+0000","last_clean":"2024-09-13T17:14:27.184699+0000","last_became_active":"2024-09-13T17:14:27.178083+0000","last_became_peered":"2024-09-13T17:14:27.178083+0000","last_unstale":"2024-09-13T17:14:27.184699+0000","last_undegraded":"2024-09-13T17:14:27.184699+0000","last_fullsized":"2024-09-13T17:14:27.184699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168056+0000","last_change":"2024-09-13T17:14:27.168056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168056+0000","last_undegraded":"2024-09-13T17:14:27.168056+0000","last_fullsized":"2024-09-13T17:14:27.168056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183796+0000","last_change":"2024-09-13T17:14:27.180128+0000","last_active":"2024-09-13T17:14:27.183796+0000","last_peered":"2024-09-13T17:14:27.183796+0000","last_clean":"2024-09-13T17:14:27.183796+0000","last_became_active":"2024-09-13T17:14:27.179842+0000","last_became_peered":"2024-09-13T17:14:27.179842+0000","last_unstale":"2024-09-13T17:14:27.183796+0000","last_undegraded":"2024-09-13T17:14:27.183796+0000","last_fullsized":"2024-09-13T17:14:27.183796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:50.591272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172346+0000","last_change":"2024-09-13T17:14:27.172346+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172346+0000","last_undegraded":"2024-09-13T17:14:27.172346+0000","last_fullsized":"2024-09-13T17:14:27.172346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187871+0000","last_change":"2024-09-13T17:14:27.181872+0000","last_active":"2024-09-13T17:14:27.187871+0000","last_peered":"2024-09-13T17:14:27.187871+0000","last_clean":"2024-09-13T17:14:27.187871+0000","last_became_active":"2024-09-13T17:14:27.181519+0000","last_became_peered":"2024-09-13T17:14:27.181519+0000","last_unstale":"2024-09-13T17:14:27.187871+0000","last_undegraded":"2024-09-13T17:14:27.187871+0000","last_fullsized":"2024-09-13T17:14:27.187871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:13.569407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:14:26.164868+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:14:26.164868+0000","last_peered":"2024-09-13T17:14:26.164868+0000","last_clean":"2024-09-13T17:14:26.164868+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:14:26.164868+0000","last_undegraded":"2024-09-13T17:14:26.164868+0000","last_fullsized":"2024-09-13T17:14:26.164868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.317}]},{"osd":1,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.48799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.375}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.441},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:14:30.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:14:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.638+0000 7f18052e9640 1 Processor -- start 2024-09-13T17:14:30.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.638+0000 7f18052e9640 1 -- start start 2024-09-13T17:14:30.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f18052e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f180006e090 0x7f18000ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f18052e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f18000b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f18052e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180006d410 con 0x7f180015a3e0 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f18052e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180006e4d0 con 0x7f180006e090 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f18052e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000aba30 con 0x7f18000ab5a0 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fe7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f180006e090 0x7f18000ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17feffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f180015a3e0 0x7f180006c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40842/0 (socket says 172.21.15.5:40842) 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17feffd640 1 -- 172.21.15.5:0/77731559 learned_addr learned my addr 172.21.15.5:0/77731559 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fe7fc640 1 -- 172.21.15.5:0/77731559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 msgr2=0x7f18000b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17ff7fe640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f18000b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fe7fc640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f18000b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fdffb640 1 -- 172.21.15.5:0/77731559 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281584226 0 0) 0x7f180006d410 con 0x7f180015a3e0 2024-09-13T17:14:30.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fe7fc640 1 -- 172.21.15.5:0/77731559 >> v1:172.21.15.5:6789/0 conn(0x7f180015a3e0 legacy=0x7f180006c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17fe7fc640 1 -- 172.21.15.5:0/77731559 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180006cb70 con 0x7f180006e090 2024-09-13T17:14:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.639+0000 7f17ff7fe640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f18000b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.640+0000 7f17fe7fc640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18000ab060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17f40097a0 tx=0x7f17f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8316593a5420cac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.640+0000 7f17fdffb640 1 -- 172.21.15.5:0/77731559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4032440 con 0x7f180006e090 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.640+0000 7f17fdffb640 1 -- 172.21.15.5:0/77731559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f40325a0 con 0x7f180006e090 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.640+0000 7f17fdffb640 1 -- 172.21.15.5:0/77731559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4032930 con 0x7f180006e090 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 -- 172.21.15.5:0/77731559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 msgr2=0x7f18000ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18000ab060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17f40097a0 tx=0x7f17f402a180 comp rx=0 tx=0).stop 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 -- 172.21.15.5:0/77731559 shutdown_connections 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f18000b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 --2- 172.21.15.5:0/77731559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18000ab060 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 -- 172.21.15.5:0/77731559 >> 172.21.15.5:0/77731559 conn(0x7f18000ce0d0 msgr2=0x7f18000ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 -- 172.21.15.5:0/77731559 shutdown_connections 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.641+0000 7f18052e9640 1 -- 172.21.15.5:0/77731559 wait complete. 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.642+0000 7f18052e9640 1 Processor -- start 2024-09-13T17:14:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.642+0000 7f18052e9640 1 -- start start 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f180014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180015a3e0 0x7f18001556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000713c0 con 0x7f180006e090 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180015b810 con 0x7f180015a3e0 2024-09-13T17:14:30.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f18052e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180015baf0 con 0x7f18000ab5a0 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36398/0 (socket says 172.21.15.5:36398) 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 -- 172.21.15.5:0/269907792 learned_addr learned my addr 172.21.15.5:0/269907792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17fe7fc640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f180014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17ff7fe640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180015a3e0 0x7f18001556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 -- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 msgr2=0x7f180014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f180014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 -- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180015a3e0 msgr2=0x7f18001556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180015a3e0 0x7f18001556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 -- 172.21.15.5:0/269907792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009400 con 0x7f180006e090 2024-09-13T17:14:30.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.643+0000 7f17feffd640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c430 tx=0x7f17f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.644+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00074e0 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.644+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0007660 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.644+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180015bdd0 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.644+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004a20 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.644+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180015c390 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.645+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000672a0 con 0x7f180006e090 2024-09-13T17:14:30.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.645+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17f0004b80 con 0x7f180006e090 2024-09-13T17:14:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.646+0000 7f17e77fe640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.646+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f17f0089370 con 0x7f180006e090 2024-09-13T17:14:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.646+0000 7f17fe7fc640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.647+0000 7f17fe7fc640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 0x7f17ec06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17f4034000 tx=0x7f17f402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.650+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f17f0054370 con 0x7f180006e090 2024-09-13T17:14:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.816+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f180015dae0 con 0x7f17ec06ac00 2024-09-13T17:14:30.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.824+0000 7f17e77fe640 1 -- 172.21.15.5:0/269907792 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286468 (secure 0 0 0) 0x7f180015dae0 con 0x7f17ec06ac00 2024-09-13T17:14:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 msgr2=0x7f17ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 0x7f17ec06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f17f4034000 tx=0x7f17f402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 msgr2=0x7f18001f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c430 tx=0x7f17f000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 shutdown_connections 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f180015a3e0 0x7f18001556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18000ab5a0 0x7f180014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f17ec06ac00 0x7f17ec06d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 --2- 172.21.15.5:0/269907792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f180006e090 0x7f18001f1b00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 >> 172.21.15.5:0/269907792 conn(0x7f18000ce0d0 msgr2=0x7f180006c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 shutdown_connections 2024-09-13T17:14:30.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.827+0000 7f18052e9640 1 -- 172.21.15.5:0/269907792 wait complete. 2024-09-13T17:14:30.839 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-13T17:14:29.274613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4608000,"data_stored":2615075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000826"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172122+0000","last_change":"2024-09-13T17:14:27.172122+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172122+0000","last_undegraded":"2024-09-13T17:14:27.172122+0000","last_fullsized":"2024-09-13T17:14:27.172122+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169878+0000","last_change":"2024-09-13T17:14:27.169878+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169878+0000","last_undegraded":"2024-09-13T17:14:27.169878+0000","last_fullsized":"2024-09-13T17:14:27.169878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169655+0000","last_change":"2024-09-13T17:14:27.169655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169655+0000","last_undegraded":"2024-09-13T17:14:27.169655+0000","last_fullsized":"2024-09-13T17:14:27.169655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170655+0000","last_change":"2024-09-13T17:14:27.170655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170655+0000","last_undegraded":"2024-09-13T17:14:27.170655+0000","last_fullsized":"2024-09-13T17:14:27.170655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166677+0000","last_change":"2024-09-13T17:14:27.166677+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166677+0000","last_undegraded":"2024-09-13T17:14:27.166677+0000","last_fullsized":"2024-09-13T17:14:27.166677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175417+0000","last_change":"2024-09-13T17:14:27.175417+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175417+0000","last_undegraded":"2024-09-13T17:14:27.175417+0000","last_fullsized":"2024-09-13T17:14:27.175417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173107+0000","last_change":"2024-09-13T17:14:27.173107+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173107+0000","last_undegraded":"2024-09-13T17:14:27.173107+0000","last_fullsized":"2024-09-13T17:14:27.173107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169631+0000","last_change":"2024-09-13T17:14:27.169631+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169631+0000","last_undegraded":"2024-09-13T17:14:27.169631+0000","last_fullsized":"2024-09-13T17:14:27.169631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170943+0000","last_change":"2024-09-13T17:14:27.170943+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170943+0000","last_undegraded":"2024-09-13T17:14:27.170943+0000","last_fullsized":"2024-09-13T17:14:27.170943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172534+0000","last_change":"2024-09-13T17:14:27.172534+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172534+0000","last_undegraded":"2024-09-13T17:14:27.172534+0000","last_fullsized":"2024-09-13T17:14:27.172534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174357+0000","last_change":"2024-09-13T17:14:27.174357+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174357+0000","last_undegraded":"2024-09-13T17:14:27.174357+0000","last_fullsized":"2024-09-13T17:14:27.174357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170971+0000","last_change":"2024-09-13T17:14:27.170971+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170971+0000","last_undegraded":"2024-09-13T17:14:27.170971+0000","last_fullsized":"2024-09-13T17:14:27.170971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172831+0000","last_change":"2024-09-13T17:14:27.172831+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172831+0000","last_undegraded":"2024-09-13T17:14:27.172831+0000","last_fullsized":"2024-09-13T17:14:27.172831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171097+0000","last_change":"2024-09-13T17:14:27.171097+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171097+0000","last_undegraded":"2024-09-13T17:14:27.171097+0000","last_fullsized":"2024-09-13T17:14:27.171097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172563+0000","last_change":"2024-09-13T17:14:27.172563+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172563+0000","last_undegraded":"2024-09-13T17:14:27.172563+0000","last_fullsized":"2024-09-13T17:14:27.172563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165801+0000","last_change":"2024-09-13T17:14:27.165801+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165801+0000","last_undegraded":"2024-09-13T17:14:27.165801+0000","last_fullsized":"2024-09-13T17:14:27.165801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166291+0000","last_change":"2024-09-13T17:14:27.166291+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166291+0000","last_undegraded":"2024-09-13T17:14:27.166291+0000","last_fullsized":"2024-09-13T17:14:27.166291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166056+0000","last_change":"2024-09-13T17:14:27.166056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166056+0000","last_undegraded":"2024-09-13T17:14:27.166056+0000","last_fullsized":"2024-09-13T17:14:27.166056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170990+0000","last_change":"2024-09-13T17:14:27.170990+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170990+0000","last_undegraded":"2024-09-13T17:14:27.170990+0000","last_fullsized":"2024-09-13T17:14:27.170990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165504+0000","last_change":"2024-09-13T17:14:27.165504+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165504+0000","last_undegraded":"2024-09-13T17:14:27.165504+0000","last_fullsized":"2024-09-13T17:14:27.165504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171773+0000","last_change":"2024-09-13T17:14:27.171773+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171773+0000","last_undegraded":"2024-09-13T17:14:27.171773+0000","last_fullsized":"2024-09-13T17:14:27.171773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170224+0000","last_change":"2024-09-13T17:14:27.170224+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170224+0000","last_undegraded":"2024-09-13T17:14:27.170224+0000","last_fullsized":"2024-09-13T17:14:27.170224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166921+0000","last_change":"2024-09-13T17:14:27.166921+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166921+0000","last_undegraded":"2024-09-13T17:14:27.166921+0000","last_fullsized":"2024-09-13T17:14:27.166921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170070+0000","last_change":"2024-09-13T17:14:27.170070+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170070+0000","last_undegraded":"2024-09-13T17:14:27.170070+0000","last_fullsized":"2024-09-13T17:14:27.170070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165675+0000","last_change":"2024-09-13T17:14:27.165675+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165675+0000","last_undegraded":"2024-09-13T17:14:27.165675+0000","last_fullsized":"2024-09-13T17:14:27.165675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175048+0000","last_change":"2024-09-13T17:14:27.175048+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175048+0000","last_undegraded":"2024-09-13T17:14:27.175048+0000","last_fullsized":"2024-09-13T17:14:27.175048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165738+0000","last_change":"2024-09-13T17:14:27.165738+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165738+0000","last_undegraded":"2024-09-13T17:14:27.165738+0000","last_fullsized":"2024-09-13T17:14:27.165738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172095+0000","last_change":"2024-09-13T17:14:27.172095+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172095+0000","last_undegraded":"2024-09-13T17:14:27.172095+0000","last_fullsized":"2024-09-13T17:14:27.172095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165420+0000","last_change":"2024-09-13T17:14:27.165420+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165420+0000","last_undegraded":"2024-09-13T17:14:27.165420+0000","last_fullsized":"2024-09-13T17:14:27.165420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166100+0000","last_change":"2024-09-13T17:14:27.166100+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166100+0000","last_undegraded":"2024-09-13T17:14:27.166100+0000","last_fullsized":"2024-09-13T17:14:27.166100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166473+0000","last_change":"2024-09-13T17:14:27.166473+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166473+0000","last_undegraded":"2024-09-13T17:14:27.166473+0000","last_fullsized":"2024-09-13T17:14:27.166473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171152+0000","last_change":"2024-09-13T17:14:27.171152+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171152+0000","last_undegraded":"2024-09-13T17:14:27.171152+0000","last_fullsized":"2024-09-13T17:14:27.171152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168039+0000","last_change":"2024-09-13T17:14:27.168039+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168039+0000","last_undegraded":"2024-09-13T17:14:27.168039+0000","last_fullsized":"2024-09-13T17:14:27.168039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181867+0000","last_change":"2024-09-13T17:14:27.178887+0000","last_active":"2024-09-13T17:14:27.181867+0000","last_peered":"2024-09-13T17:14:27.181867+0000","last_clean":"2024-09-13T17:14:27.181867+0000","last_became_active":"2024-09-13T17:14:27.178489+0000","last_became_peered":"2024-09-13T17:14:27.178489+0000","last_unstale":"2024-09-13T17:14:27.181867+0000","last_undegraded":"2024-09-13T17:14:27.181867+0000","last_fullsized":"2024-09-13T17:14:27.181867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174566+0000","last_change":"2024-09-13T17:14:27.174566+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174566+0000","last_undegraded":"2024-09-13T17:14:27.174566+0000","last_fullsized":"2024-09-13T17:14:27.174566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185259+0000","last_change":"2024-09-13T17:14:27.182304+0000","last_active":"2024-09-13T17:14:27.185259+0000","last_peered":"2024-09-13T17:14:27.185259+0000","last_clean":"2024-09-13T17:14:27.185259+0000","last_became_active":"2024-09-13T17:14:27.182039+0000","last_became_peered":"2024-09-13T17:14:27.182039+0000","last_unstale":"2024-09-13T17:14:27.185259+0000","last_undegraded":"2024-09-13T17:14:27.185259+0000","last_fullsized":"2024-09-13T17:14:27.185259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171498+0000","last_change":"2024-09-13T17:14:27.171498+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171498+0000","last_undegraded":"2024-09-13T17:14:27.171498+0000","last_fullsized":"2024-09-13T17:14:27.171498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181738+0000","last_change":"2024-09-13T17:14:27.179507+0000","last_active":"2024-09-13T17:14:27.181738+0000","last_peered":"2024-09-13T17:14:27.181738+0000","last_clean":"2024-09-13T17:14:27.181738+0000","last_became_active":"2024-09-13T17:14:27.178726+0000","last_became_peered":"2024-09-13T17:14:27.178726+0000","last_unstale":"2024-09-13T17:14:27.181738+0000","last_undegraded":"2024-09-13T17:14:27.181738+0000","last_fullsized":"2024-09-13T17:14:27.181738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169825+0000","last_change":"2024-09-13T17:14:27.169825+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169825+0000","last_undegraded":"2024-09-13T17:14:27.169825+0000","last_fullsized":"2024-09-13T17:14:27.169825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184929+0000","last_change":"2024-09-13T17:14:27.180909+0000","last_active":"2024-09-13T17:14:27.184929+0000","last_peered":"2024-09-13T17:14:27.184929+0000","last_clean":"2024-09-13T17:14:27.184929+0000","last_became_active":"2024-09-13T17:14:27.180637+0000","last_became_peered":"2024-09-13T17:14:27.180637+0000","last_unstale":"2024-09-13T17:14:27.184929+0000","last_undegraded":"2024-09-13T17:14:27.184929+0000","last_fullsized":"2024-09-13T17:14:27.184929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167797+0000","last_change":"2024-09-13T17:14:27.167797+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167797+0000","last_undegraded":"2024-09-13T17:14:27.167797+0000","last_fullsized":"2024-09-13T17:14:27.167797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.188132+0000","last_change":"2024-09-13T17:14:27.184677+0000","last_active":"2024-09-13T17:14:27.188132+0000","last_peered":"2024-09-13T17:14:27.188132+0000","last_clean":"2024-09-13T17:14:27.188132+0000","last_became_active":"2024-09-13T17:14:27.184400+0000","last_became_peered":"2024-09-13T17:14:27.184400+0000","last_unstale":"2024-09-13T17:14:27.188132+0000","last_undegraded":"2024-09-13T17:14:27.188132+0000","last_fullsized":"2024-09-13T17:14:27.188132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171465+0000","last_change":"2024-09-13T17:14:27.171465+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171465+0000","last_undegraded":"2024-09-13T17:14:27.171465+0000","last_fullsized":"2024-09-13T17:14:27.171465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187948+0000","last_change":"2024-09-13T17:14:27.182479+0000","last_active":"2024-09-13T17:14:27.187948+0000","last_peered":"2024-09-13T17:14:27.187948+0000","last_clean":"2024-09-13T17:14:27.187948+0000","last_became_active":"2024-09-13T17:14:27.182170+0000","last_became_peered":"2024-09-13T17:14:27.182170+0000","last_unstale":"2024-09-13T17:14:27.187948+0000","last_undegraded":"2024-09-13T17:14:27.187948+0000","last_fullsized":"2024-09-13T17:14:27.187948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:34.671799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169769+0000","last_change":"2024-09-13T17:14:27.169769+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169769+0000","last_undegraded":"2024-09-13T17:14:27.169769+0000","last_fullsized":"2024-09-13T17:14:27.169769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184696+0000","last_change":"2024-09-13T17:14:27.183303+0000","last_active":"2024-09-13T17:14:27.184696+0000","last_peered":"2024-09-13T17:14:27.184696+0000","last_clean":"2024-09-13T17:14:27.184696+0000","last_became_active":"2024-09-13T17:14:27.183018+0000","last_became_peered":"2024-09-13T17:14:27.183018+0000","last_unstale":"2024-09-13T17:14:27.184696+0000","last_undegraded":"2024-09-13T17:14:27.184696+0000","last_fullsized":"2024-09-13T17:14:27.184696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.876181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168918+0000","last_change":"2024-09-13T17:14:27.168918+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168918+0000","last_undegraded":"2024-09-13T17:14:27.168918+0000","last_fullsized":"2024-09-13T17:14:27.168918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184890+0000","last_change":"2024-09-13T17:14:27.180537+0000","last_active":"2024-09-13T17:14:27.184890+0000","last_peered":"2024-09-13T17:14:27.184890+0000","last_clean":"2024-09-13T17:14:27.184890+0000","last_became_active":"2024-09-13T17:14:27.180234+0000","last_became_peered":"2024-09-13T17:14:27.180234+0000","last_unstale":"2024-09-13T17:14:27.184890+0000","last_undegraded":"2024-09-13T17:14:27.184890+0000","last_fullsized":"2024-09-13T17:14:27.184890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168250+0000","last_change":"2024-09-13T17:14:27.168250+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168250+0000","last_undegraded":"2024-09-13T17:14:27.168250+0000","last_fullsized":"2024-09-13T17:14:27.168250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183828+0000","last_change":"2024-09-13T17:14:27.180202+0000","last_active":"2024-09-13T17:14:27.183828+0000","last_peered":"2024-09-13T17:14:27.183828+0000","last_clean":"2024-09-13T17:14:27.183828+0000","last_became_active":"2024-09-13T17:14:27.179900+0000","last_became_peered":"2024-09-13T17:14:27.179900+0000","last_unstale":"2024-09-13T17:14:27.183828+0000","last_undegraded":"2024-09-13T17:14:27.183828+0000","last_fullsized":"2024-09-13T17:14:27.183828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:00.975889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168615+0000","last_change":"2024-09-13T17:14:27.168615+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168615+0000","last_undegraded":"2024-09-13T17:14:27.168615+0000","last_fullsized":"2024-09-13T17:14:27.168615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187923+0000","last_change":"2024-09-13T17:14:27.183493+0000","last_active":"2024-09-13T17:14:27.187923+0000","last_peered":"2024-09-13T17:14:27.187923+0000","last_clean":"2024-09-13T17:14:27.187923+0000","last_became_active":"2024-09-13T17:14:27.183219+0000","last_became_peered":"2024-09-13T17:14:27.183219+0000","last_unstale":"2024-09-13T17:14:27.187923+0000","last_undegraded":"2024-09-13T17:14:27.187923+0000","last_fullsized":"2024-09-13T17:14:27.187923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:51.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173520+0000","last_change":"2024-09-13T17:14:27.173520+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173520+0000","last_undegraded":"2024-09-13T17:14:27.173520+0000","last_fullsized":"2024-09-13T17:14:27.173520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182239+0000","last_change":"2024-09-13T17:14:27.180924+0000","last_active":"2024-09-13T17:14:27.182239+0000","last_peered":"2024-09-13T17:14:27.182239+0000","last_clean":"2024-09-13T17:14:27.182239+0000","last_became_active":"2024-09-13T17:14:27.180626+0000","last_became_peered":"2024-09-13T17:14:27.180626+0000","last_unstale":"2024-09-13T17:14:27.182239+0000","last_undegraded":"2024-09-13T17:14:27.182239+0000","last_fullsized":"2024-09-13T17:14:27.182239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:15.195575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170467+0000","last_change":"2024-09-13T17:14:27.170467+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170467+0000","last_undegraded":"2024-09-13T17:14:27.170467+0000","last_fullsized":"2024-09-13T17:14:27.170467+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184445+0000","last_change":"2024-09-13T17:14:27.183475+0000","last_active":"2024-09-13T17:14:27.184445+0000","last_peered":"2024-09-13T17:14:27.184445+0000","last_clean":"2024-09-13T17:14:27.184445+0000","last_became_active":"2024-09-13T17:14:27.183225+0000","last_became_peered":"2024-09-13T17:14:27.183225+0000","last_unstale":"2024-09-13T17:14:27.184445+0000","last_undegraded":"2024-09-13T17:14:27.184445+0000","last_fullsized":"2024-09-13T17:14:27.184445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:53.422345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167353+0000","last_change":"2024-09-13T17:14:27.167353+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167353+0000","last_undegraded":"2024-09-13T17:14:27.167353+0000","last_fullsized":"2024-09-13T17:14:27.167353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181191+0000","last_change":"2024-09-13T17:14:27.179542+0000","last_active":"2024-09-13T17:14:27.181191+0000","last_peered":"2024-09-13T17:14:27.181191+0000","last_clean":"2024-09-13T17:14:27.181191+0000","last_became_active":"2024-09-13T17:14:27.179295+0000","last_became_peered":"2024-09-13T17:14:27.179295+0000","last_unstale":"2024-09-13T17:14:27.181191+0000","last_undegraded":"2024-09-13T17:14:27.181191+0000","last_fullsized":"2024-09-13T17:14:27.181191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:14.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167545+0000","last_change":"2024-09-13T17:14:27.167545+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167545+0000","last_undegraded":"2024-09-13T17:14:27.167545+0000","last_fullsized":"2024-09-13T17:14:27.167545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184683+0000","last_change":"2024-09-13T17:14:27.183558+0000","last_active":"2024-09-13T17:14:27.184683+0000","last_peered":"2024-09-13T17:14:27.184683+0000","last_clean":"2024-09-13T17:14:27.184683+0000","last_became_active":"2024-09-13T17:14:27.183231+0000","last_became_peered":"2024-09-13T17:14:27.183231+0000","last_unstale":"2024-09-13T17:14:27.184683+0000","last_undegraded":"2024-09-13T17:14:27.184683+0000","last_fullsized":"2024-09-13T17:14:27.184683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167040+0000","last_change":"2024-09-13T17:14:27.167040+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167040+0000","last_undegraded":"2024-09-13T17:14:27.167040+0000","last_fullsized":"2024-09-13T17:14:27.167040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.179407+0000","last_change":"2024-09-13T17:14:27.175502+0000","last_active":"2024-09-13T17:14:27.179407+0000","last_peered":"2024-09-13T17:14:27.179407+0000","last_clean":"2024-09-13T17:14:27.179407+0000","last_became_active":"2024-09-13T17:14:27.175233+0000","last_became_peered":"2024-09-13T17:14:27.175233+0000","last_unstale":"2024-09-13T17:14:27.179407+0000","last_undegraded":"2024-09-13T17:14:27.179407+0000","last_fullsized":"2024-09-13T17:14:27.179407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166904+0000","last_change":"2024-09-13T17:14:27.166904+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166904+0000","last_undegraded":"2024-09-13T17:14:27.166904+0000","last_fullsized":"2024-09-13T17:14:27.166904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184713+0000","last_change":"2024-09-13T17:14:27.178968+0000","last_active":"2024-09-13T17:14:27.184713+0000","last_peered":"2024-09-13T17:14:27.184713+0000","last_clean":"2024-09-13T17:14:27.184713+0000","last_became_active":"2024-09-13T17:14:27.178691+0000","last_became_peered":"2024-09-13T17:14:27.178691+0000","last_unstale":"2024-09-13T17:14:27.184713+0000","last_undegraded":"2024-09-13T17:14:27.184713+0000","last_fullsized":"2024-09-13T17:14:27.184713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:18.175245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168135+0000","last_change":"2024-09-13T17:14:27.168135+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168135+0000","last_undegraded":"2024-09-13T17:14:27.168135+0000","last_fullsized":"2024-09-13T17:14:27.168135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182247+0000","last_change":"2024-09-13T17:14:27.179184+0000","last_active":"2024-09-13T17:14:27.182247+0000","last_peered":"2024-09-13T17:14:27.182247+0000","last_clean":"2024-09-13T17:14:27.182247+0000","last_became_active":"2024-09-13T17:14:27.178874+0000","last_became_peered":"2024-09-13T17:14:27.178874+0000","last_unstale":"2024-09-13T17:14:27.182247+0000","last_undegraded":"2024-09-13T17:14:27.182247+0000","last_fullsized":"2024-09-13T17:14:27.182247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173501+0000","last_change":"2024-09-13T17:14:27.173501+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173501+0000","last_undegraded":"2024-09-13T17:14:27.173501+0000","last_fullsized":"2024-09-13T17:14:27.173501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184953+0000","last_change":"2024-09-13T17:14:27.180947+0000","last_active":"2024-09-13T17:14:27.184953+0000","last_peered":"2024-09-13T17:14:27.184953+0000","last_clean":"2024-09-13T17:14:27.184953+0000","last_became_active":"2024-09-13T17:14:27.180683+0000","last_became_peered":"2024-09-13T17:14:27.180683+0000","last_unstale":"2024-09-13T17:14:27.184953+0000","last_undegraded":"2024-09-13T17:14:27.184953+0000","last_fullsized":"2024-09-13T17:14:27.184953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172898+0000","last_change":"2024-09-13T17:14:27.172898+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172898+0000","last_undegraded":"2024-09-13T17:14:27.172898+0000","last_fullsized":"2024-09-13T17:14:27.172898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178935+0000","last_change":"2024-09-13T17:14:27.172607+0000","last_active":"2024-09-13T17:14:27.178935+0000","last_peered":"2024-09-13T17:14:27.178935+0000","last_clean":"2024-09-13T17:14:27.178935+0000","last_became_active":"2024-09-13T17:14:27.172347+0000","last_became_peered":"2024-09-13T17:14:27.172347+0000","last_unstale":"2024-09-13T17:14:27.178935+0000","last_undegraded":"2024-09-13T17:14:27.178935+0000","last_fullsized":"2024-09-13T17:14:27.178935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:36.824007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169188+0000","last_change":"2024-09-13T17:14:27.169188+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169188+0000","last_undegraded":"2024-09-13T17:14:27.169188+0000","last_fullsized":"2024-09-13T17:14:27.169188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183626+0000","last_change":"2024-09-13T17:14:27.182516+0000","last_active":"2024-09-13T17:14:27.183626+0000","last_peered":"2024-09-13T17:14:27.183626+0000","last_clean":"2024-09-13T17:14:27.183626+0000","last_became_active":"2024-09-13T17:14:27.182251+0000","last_became_peered":"2024-09-13T17:14:27.182251+0000","last_unstale":"2024-09-13T17:14:27.183626+0000","last_undegraded":"2024-09-13T17:14:27.183626+0000","last_fullsized":"2024-09-13T17:14:27.183626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165262+0000","last_change":"2024-09-13T17:14:27.165262+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165262+0000","last_undegraded":"2024-09-13T17:14:27.165262+0000","last_fullsized":"2024-09-13T17:14:27.165262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178705+0000","last_change":"2024-09-13T17:14:27.176577+0000","last_active":"2024-09-13T17:14:27.178705+0000","last_peered":"2024-09-13T17:14:27.178705+0000","last_clean":"2024-09-13T17:14:27.178705+0000","last_became_active":"2024-09-13T17:14:27.176318+0000","last_became_peered":"2024-09-13T17:14:27.176318+0000","last_unstale":"2024-09-13T17:14:27.178705+0000","last_undegraded":"2024-09-13T17:14:27.178705+0000","last_fullsized":"2024-09-13T17:14:27.178705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166539+0000","last_change":"2024-09-13T17:14:27.166539+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166539+0000","last_undegraded":"2024-09-13T17:14:27.166539+0000","last_fullsized":"2024-09-13T17:14:27.166539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.177935+0000","last_change":"2024-09-13T17:14:27.175822+0000","last_active":"2024-09-13T17:14:27.177935+0000","last_peered":"2024-09-13T17:14:27.177935+0000","last_clean":"2024-09-13T17:14:27.177935+0000","last_became_active":"2024-09-13T17:14:27.175513+0000","last_became_peered":"2024-09-13T17:14:27.175513+0000","last_unstale":"2024-09-13T17:14:27.177935+0000","last_undegraded":"2024-09-13T17:14:27.177935+0000","last_fullsized":"2024-09-13T17:14:27.177935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172144+0000","last_change":"2024-09-13T17:14:27.172144+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172144+0000","last_undegraded":"2024-09-13T17:14:27.172144+0000","last_fullsized":"2024-09-13T17:14:27.172144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184637+0000","last_change":"2024-09-13T17:14:27.177681+0000","last_active":"2024-09-13T17:14:27.184637+0000","last_peered":"2024-09-13T17:14:27.184637+0000","last_clean":"2024-09-13T17:14:27.184637+0000","last_became_active":"2024-09-13T17:14:27.177376+0000","last_became_peered":"2024-09-13T17:14:27.177376+0000","last_unstale":"2024-09-13T17:14:27.184637+0000","last_undegraded":"2024-09-13T17:14:27.184637+0000","last_fullsized":"2024-09-13T17:14:27.184637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166329+0000","last_change":"2024-09-13T17:14:27.166329+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166329+0000","last_undegraded":"2024-09-13T17:14:27.166329+0000","last_fullsized":"2024-09-13T17:14:27.166329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178372+0000","last_change":"2024-09-13T17:14:27.172367+0000","last_active":"2024-09-13T17:14:27.178372+0000","last_peered":"2024-09-13T17:14:27.178372+0000","last_clean":"2024-09-13T17:14:27.178372+0000","last_became_active":"2024-09-13T17:14:27.172106+0000","last_became_peered":"2024-09-13T17:14:27.172106+0000","last_unstale":"2024-09-13T17:14:27.178372+0000","last_undegraded":"2024-09-13T17:14:27.178372+0000","last_fullsized":"2024-09-13T17:14:27.178372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170712+0000","last_change":"2024-09-13T17:14:27.170712+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170712+0000","last_undegraded":"2024-09-13T17:14:27.170712+0000","last_fullsized":"2024-09-13T17:14:27.170712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182267+0000","last_change":"2024-09-13T17:14:27.180268+0000","last_active":"2024-09-13T17:14:27.182267+0000","last_peered":"2024-09-13T17:14:27.182267+0000","last_clean":"2024-09-13T17:14:27.182267+0000","last_became_active":"2024-09-13T17:14:27.180020+0000","last_became_peered":"2024-09-13T17:14:27.180020+0000","last_unstale":"2024-09-13T17:14:27.182267+0000","last_undegraded":"2024-09-13T17:14:27.182267+0000","last_fullsized":"2024-09-13T17:14:27.182267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167999+0000","last_change":"2024-09-13T17:14:27.167999+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167999+0000","last_undegraded":"2024-09-13T17:14:27.167999+0000","last_fullsized":"2024-09-13T17:14:27.167999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178671+0000","last_change":"2024-09-13T17:14:27.177225+0000","last_active":"2024-09-13T17:14:27.178671+0000","last_peered":"2024-09-13T17:14:27.178671+0000","last_clean":"2024-09-13T17:14:27.178671+0000","last_became_active":"2024-09-13T17:14:27.176960+0000","last_became_peered":"2024-09-13T17:14:27.176960+0000","last_unstale":"2024-09-13T17:14:27.178671+0000","last_undegraded":"2024-09-13T17:14:27.178671+0000","last_fullsized":"2024-09-13T17:14:27.178671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168114+0000","last_change":"2024-09-13T17:14:27.168114+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168114+0000","last_undegraded":"2024-09-13T17:14:27.168114+0000","last_fullsized":"2024-09-13T17:14:27.168114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185089+0000","last_change":"2024-09-13T17:14:27.179591+0000","last_active":"2024-09-13T17:14:27.185089+0000","last_peered":"2024-09-13T17:14:27.185089+0000","last_clean":"2024-09-13T17:14:27.185089+0000","last_became_active":"2024-09-13T17:14:27.179239+0000","last_became_peered":"2024-09-13T17:14:27.179239+0000","last_unstale":"2024-09-13T17:14:27.185089+0000","last_undegraded":"2024-09-13T17:14:27.185089+0000","last_fullsized":"2024-09-13T17:14:27.185089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166605+0000","last_change":"2024-09-13T17:14:27.166605+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166605+0000","last_undegraded":"2024-09-13T17:14:27.166605+0000","last_fullsized":"2024-09-13T17:14:27.166605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183959+0000","last_change":"2024-09-13T17:14:27.177799+0000","last_active":"2024-09-13T17:14:27.183959+0000","last_peered":"2024-09-13T17:14:27.183959+0000","last_clean":"2024-09-13T17:14:27.183959+0000","last_became_active":"2024-09-13T17:14:27.177488+0000","last_became_peered":"2024-09-13T17:14:27.177488+0000","last_unstale":"2024-09-13T17:14:27.183959+0000","last_undegraded":"2024-09-13T17:14:27.183959+0000","last_fullsized":"2024-09-13T17:14:27.183959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174200+0000","last_change":"2024-09-13T17:14:27.174200+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174200+0000","last_undegraded":"2024-09-13T17:14:27.174200+0000","last_fullsized":"2024-09-13T17:14:27.174200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182119+0000","last_change":"2024-09-13T17:14:27.180015+0000","last_active":"2024-09-13T17:14:27.182119+0000","last_peered":"2024-09-13T17:14:27.182119+0000","last_clean":"2024-09-13T17:14:27.182119+0000","last_became_active":"2024-09-13T17:14:27.179758+0000","last_became_peered":"2024-09-13T17:14:27.179758+0000","last_unstale":"2024-09-13T17:14:27.182119+0000","last_undegraded":"2024-09-13T17:14:27.182119+0000","last_fullsized":"2024-09-13T17:14:27.182119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170676+0000","last_change":"2024-09-13T17:14:27.170676+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170676+0000","last_undegraded":"2024-09-13T17:14:27.170676+0000","last_fullsized":"2024-09-13T17:14:27.170676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184699+0000","last_change":"2024-09-13T17:14:27.178335+0000","last_active":"2024-09-13T17:14:27.184699+0000","last_peered":"2024-09-13T17:14:27.184699+0000","last_clean":"2024-09-13T17:14:27.184699+0000","last_became_active":"2024-09-13T17:14:27.178083+0000","last_became_peered":"2024-09-13T17:14:27.178083+0000","last_unstale":"2024-09-13T17:14:27.184699+0000","last_undegraded":"2024-09-13T17:14:27.184699+0000","last_fullsized":"2024-09-13T17:14:27.184699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168056+0000","last_change":"2024-09-13T17:14:27.168056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168056+0000","last_undegraded":"2024-09-13T17:14:27.168056+0000","last_fullsized":"2024-09-13T17:14:27.168056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183796+0000","last_change":"2024-09-13T17:14:27.180128+0000","last_active":"2024-09-13T17:14:27.183796+0000","last_peered":"2024-09-13T17:14:27.183796+0000","last_clean":"2024-09-13T17:14:27.183796+0000","last_became_active":"2024-09-13T17:14:27.179842+0000","last_became_peered":"2024-09-13T17:14:27.179842+0000","last_unstale":"2024-09-13T17:14:27.183796+0000","last_undegraded":"2024-09-13T17:14:27.183796+0000","last_fullsized":"2024-09-13T17:14:27.183796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:50.591272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172346+0000","last_change":"2024-09-13T17:14:27.172346+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172346+0000","last_undegraded":"2024-09-13T17:14:27.172346+0000","last_fullsized":"2024-09-13T17:14:27.172346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187871+0000","last_change":"2024-09-13T17:14:27.181872+0000","last_active":"2024-09-13T17:14:27.187871+0000","last_peered":"2024-09-13T17:14:27.187871+0000","last_clean":"2024-09-13T17:14:27.187871+0000","last_became_active":"2024-09-13T17:14:27.181519+0000","last_became_peered":"2024-09-13T17:14:27.181519+0000","last_unstale":"2024-09-13T17:14:27.187871+0000","last_undegraded":"2024-09-13T17:14:27.187871+0000","last_fullsized":"2024-09-13T17:14:27.187871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:13.569407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:14:26.164868+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:14:26.164868+0000","last_peered":"2024-09-13T17:14:26.164868+0000","last_clean":"2024-09-13T17:14:26.164868+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:14:26.164868+0000","last_undegraded":"2024-09-13T17:14:26.164868+0000","last_fullsized":"2024-09-13T17:14:26.164868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.317}]},{"osd":1,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.48799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.375}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.441},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:14:30.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:14:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.980+0000 7f6e5a8a3640 1 Processor -- start 2024-09-13T17:14:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.980+0000 7f6e5a8a3640 1 -- start start 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e5a8a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e5406e1c0 0x7f6e540aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e5a8a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415a290 0x7f6e540b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e5a8a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540b2390 con 0x7f6e54156f40 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e5a8a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5415a740 con 0x7f6e5406e1c0 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e5a8a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e540b1780 con 0x7f6e5415a290 2024-09-13T17:14:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e5406e1c0 0x7f6e540aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e53fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6e54156f40 0x7f6e5406dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40848/0 (socket says 172.21.15.5:40848) 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.981+0000 7f6e53fff640 1 -- 172.21.15.5:0/4197835162 learned_addr learned my addr 172.21.15.5:0/4197835162 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e58e40640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415a290 0x7f6e540b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e537fe640 1 -- 172.21.15.5:0/4197835162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415a290 msgr2=0x7f6e540b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e537fe640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415a290 0x7f6e540b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e537fe640 1 -- 172.21.15.5:0/4197835162 >> v1:172.21.15.5:6789/0 conn(0x7f6e54156f40 legacy=0x7f6e5406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e537fe640 1 -- 172.21.15.5:0/4197835162 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540b1a60 con 0x7f6e5406e1c0 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e52ffd640 1 -- 172.21.15.5:0/4197835162 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723799581 0 0) 0x7f6e540b2390 con 0x7f6e54156f40 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.982+0000 7f6e537fe640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5406e1c0 0x7f6e540aced0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6e480097a0 tx=0x7f6e4802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ec3e85724b78d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e52ffd640 1 -- 172.21.15.5:0/4197835162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48032440 con 0x7f6e5406e1c0 2024-09-13T17:14:30.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e52ffd640 1 -- 172.21.15.5:0/4197835162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e480325a0 con 0x7f6e5406e1c0 2024-09-13T17:14:30.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e52ffd640 1 -- 172.21.15.5:0/4197835162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48032930 con 0x7f6e5406e1c0 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/4197835162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5406e1c0 msgr2=0x7f6e540aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5406e1c0 0x7f6e540aced0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6e480097a0 tx=0x7f6e4802a180 comp rx=0 tx=0).stop 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/4197835162 shutdown_connections 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415a290 0x7f6e540b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/4197835162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5406e1c0 0x7f6e540aced0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/4197835162 >> 172.21.15.5:0/4197835162 conn(0x7f6e540ce0d0 msgr2=0x7f6e540ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/4197835162 shutdown_connections 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.983+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/4197835162 wait complete. 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.984+0000 7f6e5a8a3640 1 Processor -- start 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.985+0000 7f6e5a8a3640 1 -- start start 2024-09-13T17:14:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.985+0000 7f6e5a8a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5406e1c0 0x7f6e540979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.985+0000 7f6e5a8a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e54156f40 0x7f6e54155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.985+0000 7f6e5a8a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.985+0000 7f6e5a8a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54162540 con 0x7f6e5415a290 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e5a8a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54156910 con 0x7f6e5406e1c0 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e5a8a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54097f20 con 0x7f6e54156f40 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36410/0 (socket says 172.21.15.5:36410) 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 -- 172.21.15.5:0/3946717472 learned_addr learned my addr 172.21.15.5:0/3946717472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e537fe640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e54156f40 0x7f6e54155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e53fff640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5406e1c0 0x7f6e540979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 -- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e54156f40 msgr2=0x7f6e54155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e54156f40 0x7f6e54155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 -- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5406e1c0 msgr2=0x7f6e540979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5406e1c0 0x7f6e540979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 -- 172.21.15.5:0/3946717472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009400 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e58e40640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c007e60 tx=0x7f6e4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c014420 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c0145a0 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e54156630 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c014950 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.986+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e54162160 con 0x7f6e5415a290 2024-09-13T17:14:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.987+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54162680 con 0x7f6e5415a290 2024-09-13T17:14:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.988+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e4c014ab0 con 0x7f6e5415a290 2024-09-13T17:14:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.988+0000 7f6e50ff9640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 0x7f6e4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.989+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e4c089d90 con 0x7f6e5415a290 2024-09-13T17:14:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.989+0000 7f6e53fff640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 0x7f6e4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.989+0000 7f6e53fff640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 0x7f6e4006d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000f60 tx=0x7f6e44007b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:30.993+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6e54162680 con 0x7f6e5415a290 2024-09-13T17:14:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.159+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e540b2020 con 0x7f6e4006ac00 2024-09-13T17:14:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.167+0000 7f6e50ff9640 1 -- 172.21.15.5:0/3946717472 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286468 (secure 0 0 0) 0x7f6e44007170 con 0x7f6e4006ac00 2024-09-13T17:14:31.171 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:14:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 msgr2=0x7f6e4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 0x7f6e4006d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000f60 tx=0x7f6e44007b50 comp rx=0 tx=0).stop 2024-09-13T17:14:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 msgr2=0x7f6e54151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c007e60 tx=0x7f6e4c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 shutdown_connections 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e4006ac00 0x7f6e4006d0c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e5415a290 0x7f6e54151d60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e54156f40 0x7f6e54155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 --2- 172.21.15.5:0/3946717472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5406e1c0 0x7f6e540979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 >> 172.21.15.5:0/3946717472 conn(0x7f6e540ce0d0 msgr2=0x7f6e54159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 shutdown_connections 2024-09-13T17:14:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.170+0000 7f6e5a8a3640 1 -- 172.21.15.5:0/3946717472 wait complete. 2024-09-13T17:14:31.182 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-13T17:14:29.274613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4608000,"data_stored":2615075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000826"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172122+0000","last_change":"2024-09-13T17:14:27.172122+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172122+0000","last_undegraded":"2024-09-13T17:14:27.172122+0000","last_fullsized":"2024-09-13T17:14:27.172122+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169878+0000","last_change":"2024-09-13T17:14:27.169878+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169878+0000","last_undegraded":"2024-09-13T17:14:27.169878+0000","last_fullsized":"2024-09-13T17:14:27.169878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169655+0000","last_change":"2024-09-13T17:14:27.169655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169655+0000","last_undegraded":"2024-09-13T17:14:27.169655+0000","last_fullsized":"2024-09-13T17:14:27.169655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170655+0000","last_change":"2024-09-13T17:14:27.170655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170655+0000","last_undegraded":"2024-09-13T17:14:27.170655+0000","last_fullsized":"2024-09-13T17:14:27.170655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166677+0000","last_change":"2024-09-13T17:14:27.166677+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166677+0000","last_undegraded":"2024-09-13T17:14:27.166677+0000","last_fullsized":"2024-09-13T17:14:27.166677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175417+0000","last_change":"2024-09-13T17:14:27.175417+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175417+0000","last_undegraded":"2024-09-13T17:14:27.175417+0000","last_fullsized":"2024-09-13T17:14:27.175417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173107+0000","last_change":"2024-09-13T17:14:27.173107+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173107+0000","last_undegraded":"2024-09-13T17:14:27.173107+0000","last_fullsized":"2024-09-13T17:14:27.173107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169631+0000","last_change":"2024-09-13T17:14:27.169631+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169631+0000","last_undegraded":"2024-09-13T17:14:27.169631+0000","last_fullsized":"2024-09-13T17:14:27.169631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170943+0000","last_change":"2024-09-13T17:14:27.170943+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170943+0000","last_undegraded":"2024-09-13T17:14:27.170943+0000","last_fullsized":"2024-09-13T17:14:27.170943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172534+0000","last_change":"2024-09-13T17:14:27.172534+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172534+0000","last_undegraded":"2024-09-13T17:14:27.172534+0000","last_fullsized":"2024-09-13T17:14:27.172534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174357+0000","last_change":"2024-09-13T17:14:27.174357+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174357+0000","last_undegraded":"2024-09-13T17:14:27.174357+0000","last_fullsized":"2024-09-13T17:14:27.174357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170971+0000","last_change":"2024-09-13T17:14:27.170971+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170971+0000","last_undegraded":"2024-09-13T17:14:27.170971+0000","last_fullsized":"2024-09-13T17:14:27.170971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172831+0000","last_change":"2024-09-13T17:14:27.172831+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172831+0000","last_undegraded":"2024-09-13T17:14:27.172831+0000","last_fullsized":"2024-09-13T17:14:27.172831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171097+0000","last_change":"2024-09-13T17:14:27.171097+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171097+0000","last_undegraded":"2024-09-13T17:14:27.171097+0000","last_fullsized":"2024-09-13T17:14:27.171097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172563+0000","last_change":"2024-09-13T17:14:27.172563+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172563+0000","last_undegraded":"2024-09-13T17:14:27.172563+0000","last_fullsized":"2024-09-13T17:14:27.172563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165801+0000","last_change":"2024-09-13T17:14:27.165801+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165801+0000","last_undegraded":"2024-09-13T17:14:27.165801+0000","last_fullsized":"2024-09-13T17:14:27.165801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166291+0000","last_change":"2024-09-13T17:14:27.166291+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166291+0000","last_undegraded":"2024-09-13T17:14:27.166291+0000","last_fullsized":"2024-09-13T17:14:27.166291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166056+0000","last_change":"2024-09-13T17:14:27.166056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166056+0000","last_undegraded":"2024-09-13T17:14:27.166056+0000","last_fullsized":"2024-09-13T17:14:27.166056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170990+0000","last_change":"2024-09-13T17:14:27.170990+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170990+0000","last_undegraded":"2024-09-13T17:14:27.170990+0000","last_fullsized":"2024-09-13T17:14:27.170990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165504+0000","last_change":"2024-09-13T17:14:27.165504+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165504+0000","last_undegraded":"2024-09-13T17:14:27.165504+0000","last_fullsized":"2024-09-13T17:14:27.165504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171773+0000","last_change":"2024-09-13T17:14:27.171773+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171773+0000","last_undegraded":"2024-09-13T17:14:27.171773+0000","last_fullsized":"2024-09-13T17:14:27.171773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170224+0000","last_change":"2024-09-13T17:14:27.170224+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170224+0000","last_undegraded":"2024-09-13T17:14:27.170224+0000","last_fullsized":"2024-09-13T17:14:27.170224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166921+0000","last_change":"2024-09-13T17:14:27.166921+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166921+0000","last_undegraded":"2024-09-13T17:14:27.166921+0000","last_fullsized":"2024-09-13T17:14:27.166921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170070+0000","last_change":"2024-09-13T17:14:27.170070+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170070+0000","last_undegraded":"2024-09-13T17:14:27.170070+0000","last_fullsized":"2024-09-13T17:14:27.170070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165675+0000","last_change":"2024-09-13T17:14:27.165675+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165675+0000","last_undegraded":"2024-09-13T17:14:27.165675+0000","last_fullsized":"2024-09-13T17:14:27.165675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175048+0000","last_change":"2024-09-13T17:14:27.175048+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175048+0000","last_undegraded":"2024-09-13T17:14:27.175048+0000","last_fullsized":"2024-09-13T17:14:27.175048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165738+0000","last_change":"2024-09-13T17:14:27.165738+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165738+0000","last_undegraded":"2024-09-13T17:14:27.165738+0000","last_fullsized":"2024-09-13T17:14:27.165738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172095+0000","last_change":"2024-09-13T17:14:27.172095+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172095+0000","last_undegraded":"2024-09-13T17:14:27.172095+0000","last_fullsized":"2024-09-13T17:14:27.172095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165420+0000","last_change":"2024-09-13T17:14:27.165420+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165420+0000","last_undegraded":"2024-09-13T17:14:27.165420+0000","last_fullsized":"2024-09-13T17:14:27.165420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166100+0000","last_change":"2024-09-13T17:14:27.166100+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166100+0000","last_undegraded":"2024-09-13T17:14:27.166100+0000","last_fullsized":"2024-09-13T17:14:27.166100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166473+0000","last_change":"2024-09-13T17:14:27.166473+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166473+0000","last_undegraded":"2024-09-13T17:14:27.166473+0000","last_fullsized":"2024-09-13T17:14:27.166473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171152+0000","last_change":"2024-09-13T17:14:27.171152+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171152+0000","last_undegraded":"2024-09-13T17:14:27.171152+0000","last_fullsized":"2024-09-13T17:14:27.171152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168039+0000","last_change":"2024-09-13T17:14:27.168039+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168039+0000","last_undegraded":"2024-09-13T17:14:27.168039+0000","last_fullsized":"2024-09-13T17:14:27.168039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181867+0000","last_change":"2024-09-13T17:14:27.178887+0000","last_active":"2024-09-13T17:14:27.181867+0000","last_peered":"2024-09-13T17:14:27.181867+0000","last_clean":"2024-09-13T17:14:27.181867+0000","last_became_active":"2024-09-13T17:14:27.178489+0000","last_became_peered":"2024-09-13T17:14:27.178489+0000","last_unstale":"2024-09-13T17:14:27.181867+0000","last_undegraded":"2024-09-13T17:14:27.181867+0000","last_fullsized":"2024-09-13T17:14:27.181867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174566+0000","last_change":"2024-09-13T17:14:27.174566+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174566+0000","last_undegraded":"2024-09-13T17:14:27.174566+0000","last_fullsized":"2024-09-13T17:14:27.174566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185259+0000","last_change":"2024-09-13T17:14:27.182304+0000","last_active":"2024-09-13T17:14:27.185259+0000","last_peered":"2024-09-13T17:14:27.185259+0000","last_clean":"2024-09-13T17:14:27.185259+0000","last_became_active":"2024-09-13T17:14:27.182039+0000","last_became_peered":"2024-09-13T17:14:27.182039+0000","last_unstale":"2024-09-13T17:14:27.185259+0000","last_undegraded":"2024-09-13T17:14:27.185259+0000","last_fullsized":"2024-09-13T17:14:27.185259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171498+0000","last_change":"2024-09-13T17:14:27.171498+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171498+0000","last_undegraded":"2024-09-13T17:14:27.171498+0000","last_fullsized":"2024-09-13T17:14:27.171498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181738+0000","last_change":"2024-09-13T17:14:27.179507+0000","last_active":"2024-09-13T17:14:27.181738+0000","last_peered":"2024-09-13T17:14:27.181738+0000","last_clean":"2024-09-13T17:14:27.181738+0000","last_became_active":"2024-09-13T17:14:27.178726+0000","last_became_peered":"2024-09-13T17:14:27.178726+0000","last_unstale":"2024-09-13T17:14:27.181738+0000","last_undegraded":"2024-09-13T17:14:27.181738+0000","last_fullsized":"2024-09-13T17:14:27.181738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169825+0000","last_change":"2024-09-13T17:14:27.169825+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169825+0000","last_undegraded":"2024-09-13T17:14:27.169825+0000","last_fullsized":"2024-09-13T17:14:27.169825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184929+0000","last_change":"2024-09-13T17:14:27.180909+0000","last_active":"2024-09-13T17:14:27.184929+0000","last_peered":"2024-09-13T17:14:27.184929+0000","last_clean":"2024-09-13T17:14:27.184929+0000","last_became_active":"2024-09-13T17:14:27.180637+0000","last_became_peered":"2024-09-13T17:14:27.180637+0000","last_unstale":"2024-09-13T17:14:27.184929+0000","last_undegraded":"2024-09-13T17:14:27.184929+0000","last_fullsized":"2024-09-13T17:14:27.184929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167797+0000","last_change":"2024-09-13T17:14:27.167797+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167797+0000","last_undegraded":"2024-09-13T17:14:27.167797+0000","last_fullsized":"2024-09-13T17:14:27.167797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.188132+0000","last_change":"2024-09-13T17:14:27.184677+0000","last_active":"2024-09-13T17:14:27.188132+0000","last_peered":"2024-09-13T17:14:27.188132+0000","last_clean":"2024-09-13T17:14:27.188132+0000","last_became_active":"2024-09-13T17:14:27.184400+0000","last_became_peered":"2024-09-13T17:14:27.184400+0000","last_unstale":"2024-09-13T17:14:27.188132+0000","last_undegraded":"2024-09-13T17:14:27.188132+0000","last_fullsized":"2024-09-13T17:14:27.188132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171465+0000","last_change":"2024-09-13T17:14:27.171465+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171465+0000","last_undegraded":"2024-09-13T17:14:27.171465+0000","last_fullsized":"2024-09-13T17:14:27.171465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187948+0000","last_change":"2024-09-13T17:14:27.182479+0000","last_active":"2024-09-13T17:14:27.187948+0000","last_peered":"2024-09-13T17:14:27.187948+0000","last_clean":"2024-09-13T17:14:27.187948+0000","last_became_active":"2024-09-13T17:14:27.182170+0000","last_became_peered":"2024-09-13T17:14:27.182170+0000","last_unstale":"2024-09-13T17:14:27.187948+0000","last_undegraded":"2024-09-13T17:14:27.187948+0000","last_fullsized":"2024-09-13T17:14:27.187948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:34.671799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169769+0000","last_change":"2024-09-13T17:14:27.169769+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169769+0000","last_undegraded":"2024-09-13T17:14:27.169769+0000","last_fullsized":"2024-09-13T17:14:27.169769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184696+0000","last_change":"2024-09-13T17:14:27.183303+0000","last_active":"2024-09-13T17:14:27.184696+0000","last_peered":"2024-09-13T17:14:27.184696+0000","last_clean":"2024-09-13T17:14:27.184696+0000","last_became_active":"2024-09-13T17:14:27.183018+0000","last_became_peered":"2024-09-13T17:14:27.183018+0000","last_unstale":"2024-09-13T17:14:27.184696+0000","last_undegraded":"2024-09-13T17:14:27.184696+0000","last_fullsized":"2024-09-13T17:14:27.184696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.876181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168918+0000","last_change":"2024-09-13T17:14:27.168918+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168918+0000","last_undegraded":"2024-09-13T17:14:27.168918+0000","last_fullsized":"2024-09-13T17:14:27.168918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184890+0000","last_change":"2024-09-13T17:14:27.180537+0000","last_active":"2024-09-13T17:14:27.184890+0000","last_peered":"2024-09-13T17:14:27.184890+0000","last_clean":"2024-09-13T17:14:27.184890+0000","last_became_active":"2024-09-13T17:14:27.180234+0000","last_became_peered":"2024-09-13T17:14:27.180234+0000","last_unstale":"2024-09-13T17:14:27.184890+0000","last_undegraded":"2024-09-13T17:14:27.184890+0000","last_fullsized":"2024-09-13T17:14:27.184890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168250+0000","last_change":"2024-09-13T17:14:27.168250+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168250+0000","last_undegraded":"2024-09-13T17:14:27.168250+0000","last_fullsized":"2024-09-13T17:14:27.168250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183828+0000","last_change":"2024-09-13T17:14:27.180202+0000","last_active":"2024-09-13T17:14:27.183828+0000","last_peered":"2024-09-13T17:14:27.183828+0000","last_clean":"2024-09-13T17:14:27.183828+0000","last_became_active":"2024-09-13T17:14:27.179900+0000","last_became_peered":"2024-09-13T17:14:27.179900+0000","last_unstale":"2024-09-13T17:14:27.183828+0000","last_undegraded":"2024-09-13T17:14:27.183828+0000","last_fullsized":"2024-09-13T17:14:27.183828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:00.975889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168615+0000","last_change":"2024-09-13T17:14:27.168615+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168615+0000","last_undegraded":"2024-09-13T17:14:27.168615+0000","last_fullsized":"2024-09-13T17:14:27.168615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187923+0000","last_change":"2024-09-13T17:14:27.183493+0000","last_active":"2024-09-13T17:14:27.187923+0000","last_peered":"2024-09-13T17:14:27.187923+0000","last_clean":"2024-09-13T17:14:27.187923+0000","last_became_active":"2024-09-13T17:14:27.183219+0000","last_became_peered":"2024-09-13T17:14:27.183219+0000","last_unstale":"2024-09-13T17:14:27.187923+0000","last_undegraded":"2024-09-13T17:14:27.187923+0000","last_fullsized":"2024-09-13T17:14:27.187923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:51.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173520+0000","last_change":"2024-09-13T17:14:27.173520+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173520+0000","last_undegraded":"2024-09-13T17:14:27.173520+0000","last_fullsized":"2024-09-13T17:14:27.173520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182239+0000","last_change":"2024-09-13T17:14:27.180924+0000","last_active":"2024-09-13T17:14:27.182239+0000","last_peered":"2024-09-13T17:14:27.182239+0000","last_clean":"2024-09-13T17:14:27.182239+0000","last_became_active":"2024-09-13T17:14:27.180626+0000","last_became_peered":"2024-09-13T17:14:27.180626+0000","last_unstale":"2024-09-13T17:14:27.182239+0000","last_undegraded":"2024-09-13T17:14:27.182239+0000","last_fullsized":"2024-09-13T17:14:27.182239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:15.195575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170467+0000","last_change":"2024-09-13T17:14:27.170467+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170467+0000","last_undegraded":"2024-09-13T17:14:27.170467+0000","last_fullsized":"2024-09-13T17:14:27.170467+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184445+0000","last_change":"2024-09-13T17:14:27.183475+0000","last_active":"2024-09-13T17:14:27.184445+0000","last_peered":"2024-09-13T17:14:27.184445+0000","last_clean":"2024-09-13T17:14:27.184445+0000","last_became_active":"2024-09-13T17:14:27.183225+0000","last_became_peered":"2024-09-13T17:14:27.183225+0000","last_unstale":"2024-09-13T17:14:27.184445+0000","last_undegraded":"2024-09-13T17:14:27.184445+0000","last_fullsized":"2024-09-13T17:14:27.184445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:53.422345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167353+0000","last_change":"2024-09-13T17:14:27.167353+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167353+0000","last_undegraded":"2024-09-13T17:14:27.167353+0000","last_fullsized":"2024-09-13T17:14:27.167353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181191+0000","last_change":"2024-09-13T17:14:27.179542+0000","last_active":"2024-09-13T17:14:27.181191+0000","last_peered":"2024-09-13T17:14:27.181191+0000","last_clean":"2024-09-13T17:14:27.181191+0000","last_became_active":"2024-09-13T17:14:27.179295+0000","last_became_peered":"2024-09-13T17:14:27.179295+0000","last_unstale":"2024-09-13T17:14:27.181191+0000","last_undegraded":"2024-09-13T17:14:27.181191+0000","last_fullsized":"2024-09-13T17:14:27.181191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:14.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167545+0000","last_change":"2024-09-13T17:14:27.167545+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167545+0000","last_undegraded":"2024-09-13T17:14:27.167545+0000","last_fullsized":"2024-09-13T17:14:27.167545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184683+0000","last_change":"2024-09-13T17:14:27.183558+0000","last_active":"2024-09-13T17:14:27.184683+0000","last_peered":"2024-09-13T17:14:27.184683+0000","last_clean":"2024-09-13T17:14:27.184683+0000","last_became_active":"2024-09-13T17:14:27.183231+0000","last_became_peered":"2024-09-13T17:14:27.183231+0000","last_unstale":"2024-09-13T17:14:27.184683+0000","last_undegraded":"2024-09-13T17:14:27.184683+0000","last_fullsized":"2024-09-13T17:14:27.184683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167040+0000","last_change":"2024-09-13T17:14:27.167040+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167040+0000","last_undegraded":"2024-09-13T17:14:27.167040+0000","last_fullsized":"2024-09-13T17:14:27.167040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.179407+0000","last_change":"2024-09-13T17:14:27.175502+0000","last_active":"2024-09-13T17:14:27.179407+0000","last_peered":"2024-09-13T17:14:27.179407+0000","last_clean":"2024-09-13T17:14:27.179407+0000","last_became_active":"2024-09-13T17:14:27.175233+0000","last_became_peered":"2024-09-13T17:14:27.175233+0000","last_unstale":"2024-09-13T17:14:27.179407+0000","last_undegraded":"2024-09-13T17:14:27.179407+0000","last_fullsized":"2024-09-13T17:14:27.179407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166904+0000","last_change":"2024-09-13T17:14:27.166904+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166904+0000","last_undegraded":"2024-09-13T17:14:27.166904+0000","last_fullsized":"2024-09-13T17:14:27.166904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184713+0000","last_change":"2024-09-13T17:14:27.178968+0000","last_active":"2024-09-13T17:14:27.184713+0000","last_peered":"2024-09-13T17:14:27.184713+0000","last_clean":"2024-09-13T17:14:27.184713+0000","last_became_active":"2024-09-13T17:14:27.178691+0000","last_became_peered":"2024-09-13T17:14:27.178691+0000","last_unstale":"2024-09-13T17:14:27.184713+0000","last_undegraded":"2024-09-13T17:14:27.184713+0000","last_fullsized":"2024-09-13T17:14:27.184713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:18.175245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168135+0000","last_change":"2024-09-13T17:14:27.168135+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168135+0000","last_undegraded":"2024-09-13T17:14:27.168135+0000","last_fullsized":"2024-09-13T17:14:27.168135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182247+0000","last_change":"2024-09-13T17:14:27.179184+0000","last_active":"2024-09-13T17:14:27.182247+0000","last_peered":"2024-09-13T17:14:27.182247+0000","last_clean":"2024-09-13T17:14:27.182247+0000","last_became_active":"2024-09-13T17:14:27.178874+0000","last_became_peered":"2024-09-13T17:14:27.178874+0000","last_unstale":"2024-09-13T17:14:27.182247+0000","last_undegraded":"2024-09-13T17:14:27.182247+0000","last_fullsized":"2024-09-13T17:14:27.182247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173501+0000","last_change":"2024-09-13T17:14:27.173501+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173501+0000","last_undegraded":"2024-09-13T17:14:27.173501+0000","last_fullsized":"2024-09-13T17:14:27.173501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184953+0000","last_change":"2024-09-13T17:14:27.180947+0000","last_active":"2024-09-13T17:14:27.184953+0000","last_peered":"2024-09-13T17:14:27.184953+0000","last_clean":"2024-09-13T17:14:27.184953+0000","last_became_active":"2024-09-13T17:14:27.180683+0000","last_became_peered":"2024-09-13T17:14:27.180683+0000","last_unstale":"2024-09-13T17:14:27.184953+0000","last_undegraded":"2024-09-13T17:14:27.184953+0000","last_fullsized":"2024-09-13T17:14:27.184953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172898+0000","last_change":"2024-09-13T17:14:27.172898+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172898+0000","last_undegraded":"2024-09-13T17:14:27.172898+0000","last_fullsized":"2024-09-13T17:14:27.172898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178935+0000","last_change":"2024-09-13T17:14:27.172607+0000","last_active":"2024-09-13T17:14:27.178935+0000","last_peered":"2024-09-13T17:14:27.178935+0000","last_clean":"2024-09-13T17:14:27.178935+0000","last_became_active":"2024-09-13T17:14:27.172347+0000","last_became_peered":"2024-09-13T17:14:27.172347+0000","last_unstale":"2024-09-13T17:14:27.178935+0000","last_undegraded":"2024-09-13T17:14:27.178935+0000","last_fullsized":"2024-09-13T17:14:27.178935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:36.824007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169188+0000","last_change":"2024-09-13T17:14:27.169188+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169188+0000","last_undegraded":"2024-09-13T17:14:27.169188+0000","last_fullsized":"2024-09-13T17:14:27.169188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183626+0000","last_change":"2024-09-13T17:14:27.182516+0000","last_active":"2024-09-13T17:14:27.183626+0000","last_peered":"2024-09-13T17:14:27.183626+0000","last_clean":"2024-09-13T17:14:27.183626+0000","last_became_active":"2024-09-13T17:14:27.182251+0000","last_became_peered":"2024-09-13T17:14:27.182251+0000","last_unstale":"2024-09-13T17:14:27.183626+0000","last_undegraded":"2024-09-13T17:14:27.183626+0000","last_fullsized":"2024-09-13T17:14:27.183626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165262+0000","last_change":"2024-09-13T17:14:27.165262+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165262+0000","last_undegraded":"2024-09-13T17:14:27.165262+0000","last_fullsized":"2024-09-13T17:14:27.165262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178705+0000","last_change":"2024-09-13T17:14:27.176577+0000","last_active":"2024-09-13T17:14:27.178705+0000","last_peered":"2024-09-13T17:14:27.178705+0000","last_clean":"2024-09-13T17:14:27.178705+0000","last_became_active":"2024-09-13T17:14:27.176318+0000","last_became_peered":"2024-09-13T17:14:27.176318+0000","last_unstale":"2024-09-13T17:14:27.178705+0000","last_undegraded":"2024-09-13T17:14:27.178705+0000","last_fullsized":"2024-09-13T17:14:27.178705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166539+0000","last_change":"2024-09-13T17:14:27.166539+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166539+0000","last_undegraded":"2024-09-13T17:14:27.166539+0000","last_fullsized":"2024-09-13T17:14:27.166539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.177935+0000","last_change":"2024-09-13T17:14:27.175822+0000","last_active":"2024-09-13T17:14:27.177935+0000","last_peered":"2024-09-13T17:14:27.177935+0000","last_clean":"2024-09-13T17:14:27.177935+0000","last_became_active":"2024-09-13T17:14:27.175513+0000","last_became_peered":"2024-09-13T17:14:27.175513+0000","last_unstale":"2024-09-13T17:14:27.177935+0000","last_undegraded":"2024-09-13T17:14:27.177935+0000","last_fullsized":"2024-09-13T17:14:27.177935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172144+0000","last_change":"2024-09-13T17:14:27.172144+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172144+0000","last_undegraded":"2024-09-13T17:14:27.172144+0000","last_fullsized":"2024-09-13T17:14:27.172144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184637+0000","last_change":"2024-09-13T17:14:27.177681+0000","last_active":"2024-09-13T17:14:27.184637+0000","last_peered":"2024-09-13T17:14:27.184637+0000","last_clean":"2024-09-13T17:14:27.184637+0000","last_became_active":"2024-09-13T17:14:27.177376+0000","last_became_peered":"2024-09-13T17:14:27.177376+0000","last_unstale":"2024-09-13T17:14:27.184637+0000","last_undegraded":"2024-09-13T17:14:27.184637+0000","last_fullsized":"2024-09-13T17:14:27.184637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166329+0000","last_change":"2024-09-13T17:14:27.166329+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166329+0000","last_undegraded":"2024-09-13T17:14:27.166329+0000","last_fullsized":"2024-09-13T17:14:27.166329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178372+0000","last_change":"2024-09-13T17:14:27.172367+0000","last_active":"2024-09-13T17:14:27.178372+0000","last_peered":"2024-09-13T17:14:27.178372+0000","last_clean":"2024-09-13T17:14:27.178372+0000","last_became_active":"2024-09-13T17:14:27.172106+0000","last_became_peered":"2024-09-13T17:14:27.172106+0000","last_unstale":"2024-09-13T17:14:27.178372+0000","last_undegraded":"2024-09-13T17:14:27.178372+0000","last_fullsized":"2024-09-13T17:14:27.178372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170712+0000","last_change":"2024-09-13T17:14:27.170712+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170712+0000","last_undegraded":"2024-09-13T17:14:27.170712+0000","last_fullsized":"2024-09-13T17:14:27.170712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182267+0000","last_change":"2024-09-13T17:14:27.180268+0000","last_active":"2024-09-13T17:14:27.182267+0000","last_peered":"2024-09-13T17:14:27.182267+0000","last_clean":"2024-09-13T17:14:27.182267+0000","last_became_active":"2024-09-13T17:14:27.180020+0000","last_became_peered":"2024-09-13T17:14:27.180020+0000","last_unstale":"2024-09-13T17:14:27.182267+0000","last_undegraded":"2024-09-13T17:14:27.182267+0000","last_fullsized":"2024-09-13T17:14:27.182267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167999+0000","last_change":"2024-09-13T17:14:27.167999+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167999+0000","last_undegraded":"2024-09-13T17:14:27.167999+0000","last_fullsized":"2024-09-13T17:14:27.167999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178671+0000","last_change":"2024-09-13T17:14:27.177225+0000","last_active":"2024-09-13T17:14:27.178671+0000","last_peered":"2024-09-13T17:14:27.178671+0000","last_clean":"2024-09-13T17:14:27.178671+0000","last_became_active":"2024-09-13T17:14:27.176960+0000","last_became_peered":"2024-09-13T17:14:27.176960+0000","last_unstale":"2024-09-13T17:14:27.178671+0000","last_undegraded":"2024-09-13T17:14:27.178671+0000","last_fullsized":"2024-09-13T17:14:27.178671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168114+0000","last_change":"2024-09-13T17:14:27.168114+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168114+0000","last_undegraded":"2024-09-13T17:14:27.168114+0000","last_fullsized":"2024-09-13T17:14:27.168114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185089+0000","last_change":"2024-09-13T17:14:27.179591+0000","last_active":"2024-09-13T17:14:27.185089+0000","last_peered":"2024-09-13T17:14:27.185089+0000","last_clean":"2024-09-13T17:14:27.185089+0000","last_became_active":"2024-09-13T17:14:27.179239+0000","last_became_peered":"2024-09-13T17:14:27.179239+0000","last_unstale":"2024-09-13T17:14:27.185089+0000","last_undegraded":"2024-09-13T17:14:27.185089+0000","last_fullsized":"2024-09-13T17:14:27.185089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166605+0000","last_change":"2024-09-13T17:14:27.166605+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166605+0000","last_undegraded":"2024-09-13T17:14:27.166605+0000","last_fullsized":"2024-09-13T17:14:27.166605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183959+0000","last_change":"2024-09-13T17:14:27.177799+0000","last_active":"2024-09-13T17:14:27.183959+0000","last_peered":"2024-09-13T17:14:27.183959+0000","last_clean":"2024-09-13T17:14:27.183959+0000","last_became_active":"2024-09-13T17:14:27.177488+0000","last_became_peered":"2024-09-13T17:14:27.177488+0000","last_unstale":"2024-09-13T17:14:27.183959+0000","last_undegraded":"2024-09-13T17:14:27.183959+0000","last_fullsized":"2024-09-13T17:14:27.183959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174200+0000","last_change":"2024-09-13T17:14:27.174200+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174200+0000","last_undegraded":"2024-09-13T17:14:27.174200+0000","last_fullsized":"2024-09-13T17:14:27.174200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182119+0000","last_change":"2024-09-13T17:14:27.180015+0000","last_active":"2024-09-13T17:14:27.182119+0000","last_peered":"2024-09-13T17:14:27.182119+0000","last_clean":"2024-09-13T17:14:27.182119+0000","last_became_active":"2024-09-13T17:14:27.179758+0000","last_became_peered":"2024-09-13T17:14:27.179758+0000","last_unstale":"2024-09-13T17:14:27.182119+0000","last_undegraded":"2024-09-13T17:14:27.182119+0000","last_fullsized":"2024-09-13T17:14:27.182119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170676+0000","last_change":"2024-09-13T17:14:27.170676+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170676+0000","last_undegraded":"2024-09-13T17:14:27.170676+0000","last_fullsized":"2024-09-13T17:14:27.170676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184699+0000","last_change":"2024-09-13T17:14:27.178335+0000","last_active":"2024-09-13T17:14:27.184699+0000","last_peered":"2024-09-13T17:14:27.184699+0000","last_clean":"2024-09-13T17:14:27.184699+0000","last_became_active":"2024-09-13T17:14:27.178083+0000","last_became_peered":"2024-09-13T17:14:27.178083+0000","last_unstale":"2024-09-13T17:14:27.184699+0000","last_undegraded":"2024-09-13T17:14:27.184699+0000","last_fullsized":"2024-09-13T17:14:27.184699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168056+0000","last_change":"2024-09-13T17:14:27.168056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168056+0000","last_undegraded":"2024-09-13T17:14:27.168056+0000","last_fullsized":"2024-09-13T17:14:27.168056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183796+0000","last_change":"2024-09-13T17:14:27.180128+0000","last_active":"2024-09-13T17:14:27.183796+0000","last_peered":"2024-09-13T17:14:27.183796+0000","last_clean":"2024-09-13T17:14:27.183796+0000","last_became_active":"2024-09-13T17:14:27.179842+0000","last_became_peered":"2024-09-13T17:14:27.179842+0000","last_unstale":"2024-09-13T17:14:27.183796+0000","last_undegraded":"2024-09-13T17:14:27.183796+0000","last_fullsized":"2024-09-13T17:14:27.183796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:50.591272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172346+0000","last_change":"2024-09-13T17:14:27.172346+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172346+0000","last_undegraded":"2024-09-13T17:14:27.172346+0000","last_fullsized":"2024-09-13T17:14:27.172346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187871+0000","last_change":"2024-09-13T17:14:27.181872+0000","last_active":"2024-09-13T17:14:27.187871+0000","last_peered":"2024-09-13T17:14:27.187871+0000","last_clean":"2024-09-13T17:14:27.187871+0000","last_became_active":"2024-09-13T17:14:27.181519+0000","last_became_peered":"2024-09-13T17:14:27.181519+0000","last_unstale":"2024-09-13T17:14:27.187871+0000","last_undegraded":"2024-09-13T17:14:27.187871+0000","last_fullsized":"2024-09-13T17:14:27.187871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:13.569407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:14:26.164868+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:14:26.164868+0000","last_peered":"2024-09-13T17:14:26.164868+0000","last_clean":"2024-09-13T17:14:26.164868+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:14:26.164868+0000","last_undegraded":"2024-09-13T17:14:26.164868+0000","last_fullsized":"2024-09-13T17:14:26.164868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.317}]},{"osd":1,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.48799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.375}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.441},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:14:31.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-09-13T17:14:31.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172122+0000', 'last_change': '2024-09-13T17:14:27.172122+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172122+0000', 'last_undegraded': '2024-09-13T17:14:27.172122+0000', 'last_fullsized': '2024-09-13T17:14:27.172122+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169878+0000', 'last_change': '2024-09-13T17:14:27.169878+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169878+0000', 'last_undegraded': '2024-09-13T17:14:27.169878+0000', 'last_fullsized': '2024-09-13T17:14:27.169878+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169655+0000', 'last_change': '2024-09-13T17:14:27.169655+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169655+0000', 'last_undegraded': '2024-09-13T17:14:27.169655+0000', 'last_fullsized': '2024-09-13T17:14:27.169655+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170655+0000', 'last_change': '2024-09-13T17:14:27.170655+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170655+0000', 'last_undegraded': '2024-09-13T17:14:27.170655+0000', 'last_fullsized': '2024-09-13T17:14:27.170655+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166677+0000', 'last_change': '2024-09-13T17:14:27.166677+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166677+0000', 'last_undegraded': '2024-09-13T17:14:27.166677+0000', 'last_fullsized': '2024-09-13T17:14:27.166677+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.175417+0000', 'last_change': '2024-09-13T17:14:27.175417+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.175417+0000', 'last_undegraded': '2024-09-13T17:14:27.175417+0000', 'last_fullsized': '2024-09-13T17:14:27.175417+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.173107+0000', 'last_change': '2024-09-13T17:14:27.173107+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.173107+0000', 'last_undegraded': '2024-09-13T17:14:27.173107+0000', 'last_fullsized': '2024-09-13T17:14:27.173107+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169631+0000', 'last_change': '2024-09-13T17:14:27.169631+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169631+0000', 'last_undegraded': '2024-09-13T17:14:27.169631+0000', 'last_fullsized': '2024-09-13T17:14:27.169631+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170943+0000', 'last_change': '2024-09-13T17:14:27.170943+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170943+0000', 'last_undegraded': '2024-09-13T17:14:27.170943+0000', 'last_fullsized': '2024-09-13T17:14:27.170943+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172534+0000', 'last_change': '2024-09-13T17:14:27.172534+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172534+0000', 'last_undegraded': '2024-09-13T17:14:27.172534+0000', 'last_fullsized': '2024-09-13T17:14:27.172534+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-09-13T17:14:31.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.174357+0000', 'last_change': '2024-09-13T17:14:27.174357+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.174357+0000', 'last_undegraded': '2024-09-13T17:14:27.174357+0000', 'last_fullsized': '2024-09-13T17:14:27.174357+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170971+0000', 'last_change': '2024-09-13T17:14:27.170971+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170971+0000', 'last_undegraded': '2024-09-13T17:14:27.170971+0000', 'last_fullsized': '2024-09-13T17:14:27.170971+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172831+0000', 'last_change': '2024-09-13T17:14:27.172831+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172831+0000', 'last_undegraded': '2024-09-13T17:14:27.172831+0000', 'last_fullsized': '2024-09-13T17:14:27.172831+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.171097+0000', 'last_change': '2024-09-13T17:14:27.171097+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.171097+0000', 'last_undegraded': '2024-09-13T17:14:27.171097+0000', 'last_fullsized': '2024-09-13T17:14:27.171097+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172563+0000', 'last_change': '2024-09-13T17:14:27.172563+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172563+0000', 'last_undegraded': '2024-09-13T17:14:27.172563+0000', 'last_fullsized': '2024-09-13T17:14:27.172563+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165801+0000', 'last_change': '2024-09-13T17:14:27.165801+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165801+0000', 'last_undegraded': '2024-09-13T17:14:27.165801+0000', 'last_fullsized': '2024-09-13T17:14:27.165801+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-09-13T17:14:31.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166291+0000', 'last_change': '2024-09-13T17:14:27.166291+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166291+0000', 'last_undegraded': '2024-09-13T17:14:27.166291+0000', 'last_fullsized': '2024-09-13T17:14:27.166291+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166056+0000', 'last_change': '2024-09-13T17:14:27.166056+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166056+0000', 'last_undegraded': '2024-09-13T17:14:27.166056+0000', 'last_fullsized': '2024-09-13T17:14:27.166056+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170990+0000', 'last_change': '2024-09-13T17:14:27.170990+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170990+0000', 'last_undegraded': '2024-09-13T17:14:27.170990+0000', 'last_fullsized': '2024-09-13T17:14:27.170990+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165504+0000', 'last_change': '2024-09-13T17:14:27.165504+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165504+0000', 'last_undegraded': '2024-09-13T17:14:27.165504+0000', 'last_fullsized': '2024-09-13T17:14:27.165504+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.171773+0000', 'last_change': '2024-09-13T17:14:27.171773+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.171773+0000', 'last_undegraded': '2024-09-13T17:14:27.171773+0000', 'last_fullsized': '2024-09-13T17:14:27.171773+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170224+0000', 'last_change': '2024-09-13T17:14:27.170224+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170224+0000', 'last_undegraded': '2024-09-13T17:14:27.170224+0000', 'last_fullsized': '2024-09-13T17:14:27.170224+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166921+0000', 'last_change': '2024-09-13T17:14:27.166921+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166921+0000', 'last_undegraded': '2024-09-13T17:14:27.166921+0000', 'last_fullsized': '2024-09-13T17:14:27.166921+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170070+0000', 'last_change': '2024-09-13T17:14:27.170070+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170070+0000', 'last_undegraded': '2024-09-13T17:14:27.170070+0000', 'last_fullsized': '2024-09-13T17:14:27.170070+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165675+0000', 'last_change': '2024-09-13T17:14:27.165675+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165675+0000', 'last_undegraded': '2024-09-13T17:14:27.165675+0000', 'last_fullsized': '2024-09-13T17:14:27.165675+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.175048+0000', 'last_change': '2024-09-13T17:14:27.175048+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.175048+0000', 'last_undegraded': '2024-09-13T17:14:27.175048+0000', 'last_fullsized': '2024-09-13T17:14:27.175048+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165738+0000', 'last_change': '2024-09-13T17:14:27.165738+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165738+0000', 'last_undegraded': '2024-09-13T17:14:27.165738+0000', 'last_fullsized': '2024-09-13T17:14:27.165738+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-09-13T17:14:31.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172095+0000', 'last_change': '2024-09-13T17:14:27.172095+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172095+0000', 'last_undegraded': '2024-09-13T17:14:27.172095+0000', 'last_fullsized': '2024-09-13T17:14:27.172095+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165420+0000', 'last_change': '2024-09-13T17:14:27.165420+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165420+0000', 'last_undegraded': '2024-09-13T17:14:27.165420+0000', 'last_fullsized': '2024-09-13T17:14:27.165420+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166100+0000', 'last_change': '2024-09-13T17:14:27.166100+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166100+0000', 'last_undegraded': '2024-09-13T17:14:27.166100+0000', 'last_fullsized': '2024-09-13T17:14:27.166100+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166473+0000', 'last_change': '2024-09-13T17:14:27.166473+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166473+0000', 'last_undegraded': '2024-09-13T17:14:27.166473+0000', 'last_fullsized': '2024-09-13T17:14:27.166473+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.171152+0000', 'last_change': '2024-09-13T17:14:27.171152+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.171152+0000', 'last_undegraded': '2024-09-13T17:14:27.171152+0000', 'last_fullsized': '2024-09-13T17:14:27.171152+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168039+0000', 'last_change': '2024-09-13T17:14:27.168039+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168039+0000', 'last_undegraded': '2024-09-13T17:14:27.168039+0000', 'last_fullsized': '2024-09-13T17:14:27.168039+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.174566+0000', 'last_change': '2024-09-13T17:14:27.174566+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.174566+0000', 'last_undegraded': '2024-09-13T17:14:27.174566+0000', 'last_fullsized': '2024-09-13T17:14:27.174566+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.171498+0000', 'last_change': '2024-09-13T17:14:27.171498+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.171498+0000', 'last_undegraded': '2024-09-13T17:14:27.171498+0000', 'last_fullsized': '2024-09-13T17:14:27.171498+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169825+0000', 'last_change': '2024-09-13T17:14:27.169825+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169825+0000', 'last_undegraded': '2024-09-13T17:14:27.169825+0000', 'last_fullsized': '2024-09-13T17:14:27.169825+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.167797+0000', 'last_change': '2024-09-13T17:14:27.167797+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.167797+0000', 'last_undegraded': '2024-09-13T17:14:27.167797+0000', 'last_fullsized': '2024-09-13T17:14:27.167797+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.171465+0000', 'last_change': '2024-09-13T17:14:27.171465+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.171465+0000', 'last_undegraded': '2024-09-13T17:14:27.171465+0000', 'last_fullsized': '2024-09-13T17:14:27.171465+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-09-13T17:14:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169769+0000', 'last_change': '2024-09-13T17:14:27.169769+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169769+0000', 'last_undegraded': '2024-09-13T17:14:27.169769+0000', 'last_fullsized': '2024-09-13T17:14:27.169769+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168918+0000', 'last_change': '2024-09-13T17:14:27.168918+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168918+0000', 'last_undegraded': '2024-09-13T17:14:27.168918+0000', 'last_fullsized': '2024-09-13T17:14:27.168918+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168250+0000', 'last_change': '2024-09-13T17:14:27.168250+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168250+0000', 'last_undegraded': '2024-09-13T17:14:27.168250+0000', 'last_fullsized': '2024-09-13T17:14:27.168250+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168615+0000', 'last_change': '2024-09-13T17:14:27.168615+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168615+0000', 'last_undegraded': '2024-09-13T17:14:27.168615+0000', 'last_fullsized': '2024-09-13T17:14:27.168615+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.173520+0000', 'last_change': '2024-09-13T17:14:27.173520+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.173520+0000', 'last_undegraded': '2024-09-13T17:14:27.173520+0000', 'last_fullsized': '2024-09-13T17:14:27.173520+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170467+0000', 'last_change': '2024-09-13T17:14:27.170467+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170467+0000', 'last_undegraded': '2024-09-13T17:14:27.170467+0000', 'last_fullsized': '2024-09-13T17:14:27.170467+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-09-13T17:14:31.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.167353+0000', 'last_change': '2024-09-13T17:14:27.167353+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.167353+0000', 'last_undegraded': '2024-09-13T17:14:27.167353+0000', 'last_fullsized': '2024-09-13T17:14:27.167353+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.167545+0000', 'last_change': '2024-09-13T17:14:27.167545+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.167545+0000', 'last_undegraded': '2024-09-13T17:14:27.167545+0000', 'last_fullsized': '2024-09-13T17:14:27.167545+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.167040+0000', 'last_change': '2024-09-13T17:14:27.167040+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.167040+0000', 'last_undegraded': '2024-09-13T17:14:27.167040+0000', 'last_fullsized': '2024-09-13T17:14:27.167040+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166904+0000', 'last_change': '2024-09-13T17:14:27.166904+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166904+0000', 'last_undegraded': '2024-09-13T17:14:27.166904+0000', 'last_fullsized': '2024-09-13T17:14:27.166904+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-09-13T17:14:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168135+0000', 'last_change': '2024-09-13T17:14:27.168135+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168135+0000', 'last_undegraded': '2024-09-13T17:14:27.168135+0000', 'last_fullsized': '2024-09-13T17:14:27.168135+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.173501+0000', 'last_change': '2024-09-13T17:14:27.173501+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.173501+0000', 'last_undegraded': '2024-09-13T17:14:27.173501+0000', 'last_fullsized': '2024-09-13T17:14:27.173501+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172898+0000', 'last_change': '2024-09-13T17:14:27.172898+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172898+0000', 'last_undegraded': '2024-09-13T17:14:27.172898+0000', 'last_fullsized': '2024-09-13T17:14:27.172898+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.169188+0000', 'last_change': '2024-09-13T17:14:27.169188+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.169188+0000', 'last_undegraded': '2024-09-13T17:14:27.169188+0000', 'last_fullsized': '2024-09-13T17:14:27.169188+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.165262+0000', 'last_change': '2024-09-13T17:14:27.165262+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.165262+0000', 'last_undegraded': '2024-09-13T17:14:27.165262+0000', 'last_fullsized': '2024-09-13T17:14:27.165262+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166539+0000', 'last_change': '2024-09-13T17:14:27.166539+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166539+0000', 'last_undegraded': '2024-09-13T17:14:27.166539+0000', 'last_fullsized': '2024-09-13T17:14:27.166539+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172144+0000', 'last_change': '2024-09-13T17:14:27.172144+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172144+0000', 'last_undegraded': '2024-09-13T17:14:27.172144+0000', 'last_fullsized': '2024-09-13T17:14:27.172144+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166329+0000', 'last_change': '2024-09-13T17:14:27.166329+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166329+0000', 'last_undegraded': '2024-09-13T17:14:27.166329+0000', 'last_fullsized': '2024-09-13T17:14:27.166329+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170712+0000', 'last_change': '2024-09-13T17:14:27.170712+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170712+0000', 'last_undegraded': '2024-09-13T17:14:27.170712+0000', 'last_fullsized': '2024-09-13T17:14:27.170712+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.167999+0000', 'last_change': '2024-09-13T17:14:27.167999+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.167999+0000', 'last_undegraded': '2024-09-13T17:14:27.167999+0000', 'last_fullsized': '2024-09-13T17:14:27.167999+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168114+0000', 'last_change': '2024-09-13T17:14:27.168114+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168114+0000', 'last_undegraded': '2024-09-13T17:14:27.168114+0000', 'last_fullsized': '2024-09-13T17:14:27.168114+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-09-13T17:14:31.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.166605+0000', 'last_change': '2024-09-13T17:14:27.166605+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.166605+0000', 'last_undegraded': '2024-09-13T17:14:27.166605+0000', 'last_fullsized': '2024-09-13T17:14:27.166605+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.174200+0000', 'last_change': '2024-09-13T17:14:27.174200+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.174200+0000', 'last_undegraded': '2024-09-13T17:14:27.174200+0000', 'last_fullsized': '2024-09-13T17:14:27.174200+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.170676+0000', 'last_change': '2024-09-13T17:14:27.170676+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.170676+0000', 'last_undegraded': '2024-09-13T17:14:27.170676+0000', 'last_fullsized': '2024-09-13T17:14:27.170676+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.168056+0000', 'last_change': '2024-09-13T17:14:27.168056+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.168056+0000', 'last_undegraded': '2024-09-13T17:14:27.168056+0000', 'last_fullsized': '2024-09-13T17:14:27.168056+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-09-13T17:14:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:14:27.172346+0000', 'last_change': '2024-09-13T17:14:27.172346+0000', 'last_active': '2024-09-13T17:14:27.158922+0000', 'last_peered': '2024-09-13T17:14:27.158922+0000', 'last_clean': '2024-09-13T17:14:27.158922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:14:27.172346+0000', 'last_undegraded': '2024-09-13T17:14:27.172346+0000', 'last_fullsized': '2024-09-13T17:14:27.172346+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'last_clean_scrub_stamp': '2024-09-13T17:14:27.158922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:14:31.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:14:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.322+0000 7ff4ad3a3640 1 Processor -- start 2024-09-13T17:14:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.322+0000 7ff4ad3a3640 1 -- start start 2024-09-13T17:14:31.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.322+0000 7ff4ad3a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff4a8157e20 0x7ff4a815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4ad3a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a806c520 con 0x7ff4a80ad720 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4ad3a3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a806c800 con 0x7ff4a806c090 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4ad3a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a815b900 con 0x7ff4a8157e20 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4a80ad720 0x7ff4a80b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40850/0 (socket says 172.21.15.5:40850) 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a77fe640 1 -- 172.21.15.5:0/3073892412 learned_addr learned my addr 172.21.15.5:0/3073892412 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374557533 0 0) 0x7ff4a806c520 con 0x7ff4a80ad720 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490003520 con 0x7ff4a80ad720 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> v2:172.21.15.179:3300/0 conn(0x7ff4a8157e20 0x7ff4a815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952325546 0 0) 0x7ff490003520 con 0x7ff4a80ad720 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 >> v2:172.21.15.179:3300/0 conn(0x7ff4a8157e20 msgr2=0x7ff4a815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 --2- 172.21.15.5:0/3073892412 >> v2:172.21.15.179:3300/0 conn(0x7ff4a8157e20 0x7ff4a815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 >> v1:172.21.15.179:6789/0 conn(0x7ff4a806c090 legacy=0x7ff4a80ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a806cae0 con 0x7ff4a80ad720 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff4a00019f0 con 0x7ff4a80ad720 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> v2:172.21.15.179:3300/0 conn(0x7ff4a8157e20 0x7ff4a815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 >> v1:172.21.15.5:6789/0 conn(0x7ff4a80ad720 legacy=0x7ff4a80b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 0x7ff490003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4900047c0 0x7ff490004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490005180 0x7ff49000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a815b900 con 0x7ff490003970 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49000c0d0 con 0x7ff4900047c0 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49000c290 con 0x7ff490005180 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 0x7ff490003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.323+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4900047c0 0x7ff490004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a77fe640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490005180 0x7ff49000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 -- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490005180 msgr2=0x7ff49000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490005180 0x7ff49000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 -- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4900047c0 msgr2=0x7ff490004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4900047c0 0x7ff490004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 -- 172.21.15.5:0/3073892412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490003520 con 0x7ff490003970 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4900047c0 0x7ff490004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a77fe640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490005180 0x7ff49000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a77fe640 1 -- 172.21.15.5:0/3073892412 reap_dead start 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.324+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 0x7ff490003d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff4980098a0 tx=0x7ff4900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe25b91844a2e169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49802ace0 con 0x7ff490003970 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49802ae40 con 0x7ff490003970 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4a5ffb640 1 -- 172.21.15.5:0/3073892412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498004250 con 0x7ff490003970 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 msgr2=0x7ff490003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 0x7ff490003d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff4980098a0 tx=0x7ff4900057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3073892412 shutdown_connections 2024-09-13T17:14:31.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3073892412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff490003970 0x7ff490003d90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3073892412 >> 172.21.15.5:0/3073892412 conn(0x7ff4a80ce130 msgr2=0x7ff4a80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3073892412 shutdown_connections 2024-09-13T17:14:31.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.325+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3073892412 wait complete. 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.326+0000 7ff4ad3a3640 1 Processor -- start 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 -- start start 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490003970 0x7ff4a8155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a8070620 0x7ff4a8070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a814e130 con 0x7ff4a81437b0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8143c10 con 0x7ff4a8070620 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4ad3a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a81f24f0 con 0x7ff490003970 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4a67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4a67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36420/0 (socket says 172.21.15.5:36420) 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.327+0000 7ff4a67fc640 1 -- 172.21.15.5:0/3974814373 learned_addr learned my addr 172.21.15.5:0/3974814373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490003970 0x7ff4a8155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a77fe640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a8070620 0x7ff4a8070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 -- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490003970 msgr2=0x7ff4a8155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490003970 0x7ff4a8155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 -- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a8070620 msgr2=0x7ff4a8070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a8070620 0x7ff4a8070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 -- 172.21.15.5:0/3974814373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8140df0 con 0x7ff4a81437b0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4a67fc640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0052e0 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c005440 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a8143ea0 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c003830 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.328+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a8141370 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.329+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a80672a0 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.330+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff49c003990 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.330+0000 7ff48f7fe640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 0x7ff49406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.330+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff49c088c00 con 0x7ff4a81437b0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.330+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 0x7ff49406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.331+0000 7ff4a6ffd640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 0x7ff49406d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff498033000 tx=0x7ff49802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.334+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff49c08f080 con 0x7ff4a81437b0 2024-09-13T17:14:31.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.568+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff4a815b3c0 con 0x7ff4a81437b0 2024-09-13T17:14:31.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.569+0000 7ff48f7fe640 1 -- 172.21.15.5:0/3974814373 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7ff49c019080 con 0x7ff4a81437b0 2024-09-13T17:14:31.570 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:31.570 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":100,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247581,"num_in_osds":8,"osd_in_since":1726247573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242737152,"bytes_avail":772851376128,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5478}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-13T17:14:15.271916+0000","services":{}},"progress_events":{}} 2024-09-13T17:14:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 msgr2=0x7ff49406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 0x7ff49406d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff498033000 tx=0x7ff49802e000 comp rx=0 tx=0).stop 2024-09-13T17:14:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 msgr2=0x7ff4a80700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff49c000c00 tx=0x7ff49c00e8f0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 shutdown_connections 2024-09-13T17:14:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.570+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4a8070620 0x7ff4a8070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49406ac30 0x7ff49406d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a81437b0 0x7ff4a80700e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 --2- 172.21.15.5:0/3974814373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff490003970 0x7ff4a8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 >> 172.21.15.5:0/3974814373 conn(0x7ff4a80ce130 msgr2=0x7ff4a8158470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 shutdown_connections 2024-09-13T17:14:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.571+0000 7ff4ad3a3640 1 -- 172.21.15.5:0/3974814373 wait complete. 2024-09-13T17:14:31.582 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:14:31.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:14:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.683+0000 7f3f7d7ed640 1 Processor -- start 2024-09-13T17:14:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.683+0000 7f3f7d7ed640 1 -- start start 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f7d7ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f78156f40 0x7f3f7815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f7d7ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f7806e1c0 0x7f3f780aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f7d7ed640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780b2390 con 0x7f3f780b1080 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f7d7ed640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f780b14c0 con 0x7f3f7806e1c0 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f7d7ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780b1780 con 0x7f3f78156f40 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f7806e1c0 0x7f3f780aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f7806e1c0 0x7f3f780aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36422/0 (socket says 172.21.15.5:36422) 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 -- 172.21.15.5:0/785514127 learned_addr learned my addr 172.21.15.5:0/785514127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f76ffd640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f78156f40 0x7f3f7815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 -- 172.21.15.5:0/785514127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f78156f40 msgr2=0x7f3f7815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f78156f40 0x7f3f7815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 -- 172.21.15.5:0/785514127 >> v1:172.21.15.179:6789/0 conn(0x7f3f780b1080 legacy=0x7f3f7806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.684+0000 7f3f777fe640 1 -- 172.21.15.5:0/785514127 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780b1a60 con 0x7f3f7806e1c0 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.685+0000 7f3f777fe640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f7806e1c0 0x7f3f780aced0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000d150 tx=0x7f3f7002c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eba7c42af8050ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.685+0000 7f3f75ffb640 1 -- 172.21.15.5:0/785514127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70009600 con 0x7f3f7806e1c0 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.685+0000 7f3f75ffb640 1 -- 172.21.15.5:0/785514127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70009760 con 0x7f3f7806e1c0 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.685+0000 7f3f75ffb640 1 -- 172.21.15.5:0/785514127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70009af0 con 0x7f3f7806e1c0 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/785514127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f7806e1c0 msgr2=0x7f3f780aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f7806e1c0 0x7f3f780aced0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000d150 tx=0x7f3f7002c930 comp rx=0 tx=0).stop 2024-09-13T17:14:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/785514127 shutdown_connections 2024-09-13T17:14:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f7806e1c0 0x7f3f780aced0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/785514127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f78156f40 0x7f3f7815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/785514127 >> 172.21.15.5:0/785514127 conn(0x7f3f780ce0d0 msgr2=0x7f3f780ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/785514127 shutdown_connections 2024-09-13T17:14:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.686+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/785514127 wait complete. 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.687+0000 7f3f7d7ed640 1 Processor -- start 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.687+0000 7f3f7d7ed640 1 -- start start 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f7806e1c0 0x7f3f780cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f78156f40 0x7f3f780ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78151e50 con 0x7f3f780b1080 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78155a00 con 0x7f3f78156f40 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f7d7ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78155ce0 con 0x7f3f7806e1c0 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36438/0 (socket says 172.21.15.5:36438) 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 -- 172.21.15.5:0/2716523718 learned_addr learned my addr 172.21.15.5:0/2716523718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f76ffd640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f7806e1c0 0x7f3f780cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f777fe640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f78156f40 0x7f3f780ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 -- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f7806e1c0 msgr2=0x7f3f780cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f7806e1c0 0x7f3f780cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 -- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f78156f40 msgr2=0x7f3f780ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f78156f40 0x7f3f780ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 -- 172.21.15.5:0/2716523718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7000bd40 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.688+0000 7f3f767fc640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c400 tx=0x7f3f6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0052d0 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c005430 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f78155fc0 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c003830 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f780cac40 con 0x7f3f780b1080 2024-09-13T17:14:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.689+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780abb50 con 0x7f3f780b1080 2024-09-13T17:14:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.690+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f6c003990 con 0x7f3f780b1080 2024-09-13T17:14:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.691+0000 7f3f5f7fe640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 0x7f3f6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.691+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f6c088970 con 0x7f3f780b1080 2024-09-13T17:14:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.691+0000 7f3f76ffd640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 0x7f3f6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:31.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.691+0000 7f3f76ffd640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 0x7f3f6406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009aa0 tx=0x7f3f68009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:31.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.695+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f6c053b50 con 0x7f3f780b1080 2024-09-13T17:14:31.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.861+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f780b2020 con 0x7f3f6406ac00 2024-09-13T17:14:31.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.869+0000 7f3f5f7fe640 1 -- 172.21.15.5:0/2716523718 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286468 (secure 0 0 0) 0x7f3f68011a00 con 0x7f3f6406ac00 2024-09-13T17:14:31.874 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:31.875 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 msgr2=0x7f3f6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 0x7f3f6406d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009aa0 tx=0x7f3f68009190 comp rx=0 tx=0).stop 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 msgr2=0x7f3f781551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c400 tx=0x7f3f6c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 shutdown_connections 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f78156f40 0x7f3f780ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f6406ac00 0x7f3f6406d0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f780b1080 0x7f3f781551a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 --2- 172.21.15.5:0/2716523718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f7806e1c0 0x7f3f780cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 >> 172.21.15.5:0/2716523718 conn(0x7f3f780ce0d0 msgr2=0x7f3f78157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 shutdown_connections 2024-09-13T17:14:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:31.872+0000 7f3f7d7ed640 1 -- 172.21.15.5:0/2716523718 wait complete. 2024-09-13T17:14:31.885 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-13T17:14:31.275037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237048,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4608000,"data_stored":2615075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.112512"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172122+0000","last_change":"2024-09-13T17:14:27.172122+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172122+0000","last_undegraded":"2024-09-13T17:14:27.172122+0000","last_fullsized":"2024-09-13T17:14:27.172122+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169878+0000","last_change":"2024-09-13T17:14:27.169878+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169878+0000","last_undegraded":"2024-09-13T17:14:27.169878+0000","last_fullsized":"2024-09-13T17:14:27.169878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169655+0000","last_change":"2024-09-13T17:14:27.169655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169655+0000","last_undegraded":"2024-09-13T17:14:27.169655+0000","last_fullsized":"2024-09-13T17:14:27.169655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170655+0000","last_change":"2024-09-13T17:14:27.170655+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170655+0000","last_undegraded":"2024-09-13T17:14:27.170655+0000","last_fullsized":"2024-09-13T17:14:27.170655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166677+0000","last_change":"2024-09-13T17:14:27.166677+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166677+0000","last_undegraded":"2024-09-13T17:14:27.166677+0000","last_fullsized":"2024-09-13T17:14:27.166677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175417+0000","last_change":"2024-09-13T17:14:27.175417+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175417+0000","last_undegraded":"2024-09-13T17:14:27.175417+0000","last_fullsized":"2024-09-13T17:14:27.175417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173107+0000","last_change":"2024-09-13T17:14:27.173107+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173107+0000","last_undegraded":"2024-09-13T17:14:27.173107+0000","last_fullsized":"2024-09-13T17:14:27.173107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169631+0000","last_change":"2024-09-13T17:14:27.169631+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169631+0000","last_undegraded":"2024-09-13T17:14:27.169631+0000","last_fullsized":"2024-09-13T17:14:27.169631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170943+0000","last_change":"2024-09-13T17:14:27.170943+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170943+0000","last_undegraded":"2024-09-13T17:14:27.170943+0000","last_fullsized":"2024-09-13T17:14:27.170943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172534+0000","last_change":"2024-09-13T17:14:27.172534+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172534+0000","last_undegraded":"2024-09-13T17:14:27.172534+0000","last_fullsized":"2024-09-13T17:14:27.172534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174357+0000","last_change":"2024-09-13T17:14:27.174357+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174357+0000","last_undegraded":"2024-09-13T17:14:27.174357+0000","last_fullsized":"2024-09-13T17:14:27.174357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170971+0000","last_change":"2024-09-13T17:14:27.170971+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170971+0000","last_undegraded":"2024-09-13T17:14:27.170971+0000","last_fullsized":"2024-09-13T17:14:27.170971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172831+0000","last_change":"2024-09-13T17:14:27.172831+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172831+0000","last_undegraded":"2024-09-13T17:14:27.172831+0000","last_fullsized":"2024-09-13T17:14:27.172831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171097+0000","last_change":"2024-09-13T17:14:27.171097+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171097+0000","last_undegraded":"2024-09-13T17:14:27.171097+0000","last_fullsized":"2024-09-13T17:14:27.171097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172563+0000","last_change":"2024-09-13T17:14:27.172563+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172563+0000","last_undegraded":"2024-09-13T17:14:27.172563+0000","last_fullsized":"2024-09-13T17:14:27.172563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165801+0000","last_change":"2024-09-13T17:14:27.165801+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165801+0000","last_undegraded":"2024-09-13T17:14:27.165801+0000","last_fullsized":"2024-09-13T17:14:27.165801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166291+0000","last_change":"2024-09-13T17:14:27.166291+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166291+0000","last_undegraded":"2024-09-13T17:14:27.166291+0000","last_fullsized":"2024-09-13T17:14:27.166291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166056+0000","last_change":"2024-09-13T17:14:27.166056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166056+0000","last_undegraded":"2024-09-13T17:14:27.166056+0000","last_fullsized":"2024-09-13T17:14:27.166056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170990+0000","last_change":"2024-09-13T17:14:27.170990+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170990+0000","last_undegraded":"2024-09-13T17:14:27.170990+0000","last_fullsized":"2024-09-13T17:14:27.170990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165504+0000","last_change":"2024-09-13T17:14:27.165504+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165504+0000","last_undegraded":"2024-09-13T17:14:27.165504+0000","last_fullsized":"2024-09-13T17:14:27.165504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171773+0000","last_change":"2024-09-13T17:14:27.171773+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171773+0000","last_undegraded":"2024-09-13T17:14:27.171773+0000","last_fullsized":"2024-09-13T17:14:27.171773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170224+0000","last_change":"2024-09-13T17:14:27.170224+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170224+0000","last_undegraded":"2024-09-13T17:14:27.170224+0000","last_fullsized":"2024-09-13T17:14:27.170224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166921+0000","last_change":"2024-09-13T17:14:27.166921+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166921+0000","last_undegraded":"2024-09-13T17:14:27.166921+0000","last_fullsized":"2024-09-13T17:14:27.166921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170070+0000","last_change":"2024-09-13T17:14:27.170070+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170070+0000","last_undegraded":"2024-09-13T17:14:27.170070+0000","last_fullsized":"2024-09-13T17:14:27.170070+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165675+0000","last_change":"2024-09-13T17:14:27.165675+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165675+0000","last_undegraded":"2024-09-13T17:14:27.165675+0000","last_fullsized":"2024-09-13T17:14:27.165675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.175048+0000","last_change":"2024-09-13T17:14:27.175048+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.175048+0000","last_undegraded":"2024-09-13T17:14:27.175048+0000","last_fullsized":"2024-09-13T17:14:27.175048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165738+0000","last_change":"2024-09-13T17:14:27.165738+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165738+0000","last_undegraded":"2024-09-13T17:14:27.165738+0000","last_fullsized":"2024-09-13T17:14:27.165738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172095+0000","last_change":"2024-09-13T17:14:27.172095+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172095+0000","last_undegraded":"2024-09-13T17:14:27.172095+0000","last_fullsized":"2024-09-13T17:14:27.172095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165420+0000","last_change":"2024-09-13T17:14:27.165420+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165420+0000","last_undegraded":"2024-09-13T17:14:27.165420+0000","last_fullsized":"2024-09-13T17:14:27.165420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166100+0000","last_change":"2024-09-13T17:14:27.166100+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166100+0000","last_undegraded":"2024-09-13T17:14:27.166100+0000","last_fullsized":"2024-09-13T17:14:27.166100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166473+0000","last_change":"2024-09-13T17:14:27.166473+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166473+0000","last_undegraded":"2024-09-13T17:14:27.166473+0000","last_fullsized":"2024-09-13T17:14:27.166473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171152+0000","last_change":"2024-09-13T17:14:27.171152+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171152+0000","last_undegraded":"2024-09-13T17:14:27.171152+0000","last_fullsized":"2024-09-13T17:14:27.171152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168039+0000","last_change":"2024-09-13T17:14:27.168039+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168039+0000","last_undegraded":"2024-09-13T17:14:27.168039+0000","last_fullsized":"2024-09-13T17:14:27.168039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181867+0000","last_change":"2024-09-13T17:14:27.178887+0000","last_active":"2024-09-13T17:14:27.181867+0000","last_peered":"2024-09-13T17:14:27.181867+0000","last_clean":"2024-09-13T17:14:27.181867+0000","last_became_active":"2024-09-13T17:14:27.178489+0000","last_became_peered":"2024-09-13T17:14:27.178489+0000","last_unstale":"2024-09-13T17:14:27.181867+0000","last_undegraded":"2024-09-13T17:14:27.181867+0000","last_fullsized":"2024-09-13T17:14:27.181867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174566+0000","last_change":"2024-09-13T17:14:27.174566+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174566+0000","last_undegraded":"2024-09-13T17:14:27.174566+0000","last_fullsized":"2024-09-13T17:14:27.174566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185259+0000","last_change":"2024-09-13T17:14:27.182304+0000","last_active":"2024-09-13T17:14:27.185259+0000","last_peered":"2024-09-13T17:14:27.185259+0000","last_clean":"2024-09-13T17:14:27.185259+0000","last_became_active":"2024-09-13T17:14:27.182039+0000","last_became_peered":"2024-09-13T17:14:27.182039+0000","last_unstale":"2024-09-13T17:14:27.185259+0000","last_undegraded":"2024-09-13T17:14:27.185259+0000","last_fullsized":"2024-09-13T17:14:27.185259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171498+0000","last_change":"2024-09-13T17:14:27.171498+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171498+0000","last_undegraded":"2024-09-13T17:14:27.171498+0000","last_fullsized":"2024-09-13T17:14:27.171498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181738+0000","last_change":"2024-09-13T17:14:27.179507+0000","last_active":"2024-09-13T17:14:27.181738+0000","last_peered":"2024-09-13T17:14:27.181738+0000","last_clean":"2024-09-13T17:14:27.181738+0000","last_became_active":"2024-09-13T17:14:27.178726+0000","last_became_peered":"2024-09-13T17:14:27.178726+0000","last_unstale":"2024-09-13T17:14:27.181738+0000","last_undegraded":"2024-09-13T17:14:27.181738+0000","last_fullsized":"2024-09-13T17:14:27.181738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169825+0000","last_change":"2024-09-13T17:14:27.169825+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169825+0000","last_undegraded":"2024-09-13T17:14:27.169825+0000","last_fullsized":"2024-09-13T17:14:27.169825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184929+0000","last_change":"2024-09-13T17:14:27.180909+0000","last_active":"2024-09-13T17:14:27.184929+0000","last_peered":"2024-09-13T17:14:27.184929+0000","last_clean":"2024-09-13T17:14:27.184929+0000","last_became_active":"2024-09-13T17:14:27.180637+0000","last_became_peered":"2024-09-13T17:14:27.180637+0000","last_unstale":"2024-09-13T17:14:27.184929+0000","last_undegraded":"2024-09-13T17:14:27.184929+0000","last_fullsized":"2024-09-13T17:14:27.184929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167797+0000","last_change":"2024-09-13T17:14:27.167797+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167797+0000","last_undegraded":"2024-09-13T17:14:27.167797+0000","last_fullsized":"2024-09-13T17:14:27.167797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.188132+0000","last_change":"2024-09-13T17:14:27.184677+0000","last_active":"2024-09-13T17:14:27.188132+0000","last_peered":"2024-09-13T17:14:27.188132+0000","last_clean":"2024-09-13T17:14:27.188132+0000","last_became_active":"2024-09-13T17:14:27.184400+0000","last_became_peered":"2024-09-13T17:14:27.184400+0000","last_unstale":"2024-09-13T17:14:27.188132+0000","last_undegraded":"2024-09-13T17:14:27.188132+0000","last_fullsized":"2024-09-13T17:14:27.188132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.171465+0000","last_change":"2024-09-13T17:14:27.171465+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.171465+0000","last_undegraded":"2024-09-13T17:14:27.171465+0000","last_fullsized":"2024-09-13T17:14:27.171465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187948+0000","last_change":"2024-09-13T17:14:27.182479+0000","last_active":"2024-09-13T17:14:27.187948+0000","last_peered":"2024-09-13T17:14:27.187948+0000","last_clean":"2024-09-13T17:14:27.187948+0000","last_became_active":"2024-09-13T17:14:27.182170+0000","last_became_peered":"2024-09-13T17:14:27.182170+0000","last_unstale":"2024-09-13T17:14:27.187948+0000","last_undegraded":"2024-09-13T17:14:27.187948+0000","last_fullsized":"2024-09-13T17:14:27.187948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:34.671799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169769+0000","last_change":"2024-09-13T17:14:27.169769+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169769+0000","last_undegraded":"2024-09-13T17:14:27.169769+0000","last_fullsized":"2024-09-13T17:14:27.169769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184696+0000","last_change":"2024-09-13T17:14:27.183303+0000","last_active":"2024-09-13T17:14:27.184696+0000","last_peered":"2024-09-13T17:14:27.184696+0000","last_clean":"2024-09-13T17:14:27.184696+0000","last_became_active":"2024-09-13T17:14:27.183018+0000","last_became_peered":"2024-09-13T17:14:27.183018+0000","last_unstale":"2024-09-13T17:14:27.184696+0000","last_undegraded":"2024-09-13T17:14:27.184696+0000","last_fullsized":"2024-09-13T17:14:27.184696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.876181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168918+0000","last_change":"2024-09-13T17:14:27.168918+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168918+0000","last_undegraded":"2024-09-13T17:14:27.168918+0000","last_fullsized":"2024-09-13T17:14:27.168918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184890+0000","last_change":"2024-09-13T17:14:27.180537+0000","last_active":"2024-09-13T17:14:27.184890+0000","last_peered":"2024-09-13T17:14:27.184890+0000","last_clean":"2024-09-13T17:14:27.184890+0000","last_became_active":"2024-09-13T17:14:27.180234+0000","last_became_peered":"2024-09-13T17:14:27.180234+0000","last_unstale":"2024-09-13T17:14:27.184890+0000","last_undegraded":"2024-09-13T17:14:27.184890+0000","last_fullsized":"2024-09-13T17:14:27.184890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168250+0000","last_change":"2024-09-13T17:14:27.168250+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168250+0000","last_undegraded":"2024-09-13T17:14:27.168250+0000","last_fullsized":"2024-09-13T17:14:27.168250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183828+0000","last_change":"2024-09-13T17:14:27.180202+0000","last_active":"2024-09-13T17:14:27.183828+0000","last_peered":"2024-09-13T17:14:27.183828+0000","last_clean":"2024-09-13T17:14:27.183828+0000","last_became_active":"2024-09-13T17:14:27.179900+0000","last_became_peered":"2024-09-13T17:14:27.179900+0000","last_unstale":"2024-09-13T17:14:27.183828+0000","last_undegraded":"2024-09-13T17:14:27.183828+0000","last_fullsized":"2024-09-13T17:14:27.183828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:00.975889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168615+0000","last_change":"2024-09-13T17:14:27.168615+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168615+0000","last_undegraded":"2024-09-13T17:14:27.168615+0000","last_fullsized":"2024-09-13T17:14:27.168615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187923+0000","last_change":"2024-09-13T17:14:27.183493+0000","last_active":"2024-09-13T17:14:27.187923+0000","last_peered":"2024-09-13T17:14:27.187923+0000","last_clean":"2024-09-13T17:14:27.187923+0000","last_became_active":"2024-09-13T17:14:27.183219+0000","last_became_peered":"2024-09-13T17:14:27.183219+0000","last_unstale":"2024-09-13T17:14:27.187923+0000","last_undegraded":"2024-09-13T17:14:27.187923+0000","last_fullsized":"2024-09-13T17:14:27.187923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:51.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173520+0000","last_change":"2024-09-13T17:14:27.173520+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173520+0000","last_undegraded":"2024-09-13T17:14:27.173520+0000","last_fullsized":"2024-09-13T17:14:27.173520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182239+0000","last_change":"2024-09-13T17:14:27.180924+0000","last_active":"2024-09-13T17:14:27.182239+0000","last_peered":"2024-09-13T17:14:27.182239+0000","last_clean":"2024-09-13T17:14:27.182239+0000","last_became_active":"2024-09-13T17:14:27.180626+0000","last_became_peered":"2024-09-13T17:14:27.180626+0000","last_unstale":"2024-09-13T17:14:27.182239+0000","last_undegraded":"2024-09-13T17:14:27.182239+0000","last_fullsized":"2024-09-13T17:14:27.182239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:15.195575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170467+0000","last_change":"2024-09-13T17:14:27.170467+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170467+0000","last_undegraded":"2024-09-13T17:14:27.170467+0000","last_fullsized":"2024-09-13T17:14:27.170467+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184445+0000","last_change":"2024-09-13T17:14:27.183475+0000","last_active":"2024-09-13T17:14:27.184445+0000","last_peered":"2024-09-13T17:14:27.184445+0000","last_clean":"2024-09-13T17:14:27.184445+0000","last_became_active":"2024-09-13T17:14:27.183225+0000","last_became_peered":"2024-09-13T17:14:27.183225+0000","last_unstale":"2024-09-13T17:14:27.184445+0000","last_undegraded":"2024-09-13T17:14:27.184445+0000","last_fullsized":"2024-09-13T17:14:27.184445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:53.422345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167353+0000","last_change":"2024-09-13T17:14:27.167353+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167353+0000","last_undegraded":"2024-09-13T17:14:27.167353+0000","last_fullsized":"2024-09-13T17:14:27.167353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.181191+0000","last_change":"2024-09-13T17:14:27.179542+0000","last_active":"2024-09-13T17:14:27.181191+0000","last_peered":"2024-09-13T17:14:27.181191+0000","last_clean":"2024-09-13T17:14:27.181191+0000","last_became_active":"2024-09-13T17:14:27.179295+0000","last_became_peered":"2024-09-13T17:14:27.179295+0000","last_unstale":"2024-09-13T17:14:27.181191+0000","last_undegraded":"2024-09-13T17:14:27.181191+0000","last_fullsized":"2024-09-13T17:14:27.181191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:14.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167545+0000","last_change":"2024-09-13T17:14:27.167545+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167545+0000","last_undegraded":"2024-09-13T17:14:27.167545+0000","last_fullsized":"2024-09-13T17:14:27.167545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184683+0000","last_change":"2024-09-13T17:14:27.183558+0000","last_active":"2024-09-13T17:14:27.184683+0000","last_peered":"2024-09-13T17:14:27.184683+0000","last_clean":"2024-09-13T17:14:27.184683+0000","last_became_active":"2024-09-13T17:14:27.183231+0000","last_became_peered":"2024-09-13T17:14:27.183231+0000","last_unstale":"2024-09-13T17:14:27.184683+0000","last_undegraded":"2024-09-13T17:14:27.184683+0000","last_fullsized":"2024-09-13T17:14:27.184683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167040+0000","last_change":"2024-09-13T17:14:27.167040+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167040+0000","last_undegraded":"2024-09-13T17:14:27.167040+0000","last_fullsized":"2024-09-13T17:14:27.167040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.179407+0000","last_change":"2024-09-13T17:14:27.175502+0000","last_active":"2024-09-13T17:14:27.179407+0000","last_peered":"2024-09-13T17:14:27.179407+0000","last_clean":"2024-09-13T17:14:27.179407+0000","last_became_active":"2024-09-13T17:14:27.175233+0000","last_became_peered":"2024-09-13T17:14:27.175233+0000","last_unstale":"2024-09-13T17:14:27.179407+0000","last_undegraded":"2024-09-13T17:14:27.179407+0000","last_fullsized":"2024-09-13T17:14:27.179407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166904+0000","last_change":"2024-09-13T17:14:27.166904+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166904+0000","last_undegraded":"2024-09-13T17:14:27.166904+0000","last_fullsized":"2024-09-13T17:14:27.166904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184713+0000","last_change":"2024-09-13T17:14:27.178968+0000","last_active":"2024-09-13T17:14:27.184713+0000","last_peered":"2024-09-13T17:14:27.184713+0000","last_clean":"2024-09-13T17:14:27.184713+0000","last_became_active":"2024-09-13T17:14:27.178691+0000","last_became_peered":"2024-09-13T17:14:27.178691+0000","last_unstale":"2024-09-13T17:14:27.184713+0000","last_undegraded":"2024-09-13T17:14:27.184713+0000","last_fullsized":"2024-09-13T17:14:27.184713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:18.175245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168135+0000","last_change":"2024-09-13T17:14:27.168135+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168135+0000","last_undegraded":"2024-09-13T17:14:27.168135+0000","last_fullsized":"2024-09-13T17:14:27.168135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182247+0000","last_change":"2024-09-13T17:14:27.179184+0000","last_active":"2024-09-13T17:14:27.182247+0000","last_peered":"2024-09-13T17:14:27.182247+0000","last_clean":"2024-09-13T17:14:27.182247+0000","last_became_active":"2024-09-13T17:14:27.178874+0000","last_became_peered":"2024-09-13T17:14:27.178874+0000","last_unstale":"2024-09-13T17:14:27.182247+0000","last_undegraded":"2024-09-13T17:14:27.182247+0000","last_fullsized":"2024-09-13T17:14:27.182247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.173501+0000","last_change":"2024-09-13T17:14:27.173501+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.173501+0000","last_undegraded":"2024-09-13T17:14:27.173501+0000","last_fullsized":"2024-09-13T17:14:27.173501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184953+0000","last_change":"2024-09-13T17:14:27.180947+0000","last_active":"2024-09-13T17:14:27.184953+0000","last_peered":"2024-09-13T17:14:27.184953+0000","last_clean":"2024-09-13T17:14:27.184953+0000","last_became_active":"2024-09-13T17:14:27.180683+0000","last_became_peered":"2024-09-13T17:14:27.180683+0000","last_unstale":"2024-09-13T17:14:27.184953+0000","last_undegraded":"2024-09-13T17:14:27.184953+0000","last_fullsized":"2024-09-13T17:14:27.184953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172898+0000","last_change":"2024-09-13T17:14:27.172898+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172898+0000","last_undegraded":"2024-09-13T17:14:27.172898+0000","last_fullsized":"2024-09-13T17:14:27.172898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178935+0000","last_change":"2024-09-13T17:14:27.172607+0000","last_active":"2024-09-13T17:14:27.178935+0000","last_peered":"2024-09-13T17:14:27.178935+0000","last_clean":"2024-09-13T17:14:27.178935+0000","last_became_active":"2024-09-13T17:14:27.172347+0000","last_became_peered":"2024-09-13T17:14:27.172347+0000","last_unstale":"2024-09-13T17:14:27.178935+0000","last_undegraded":"2024-09-13T17:14:27.178935+0000","last_fullsized":"2024-09-13T17:14:27.178935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:36.824007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.169188+0000","last_change":"2024-09-13T17:14:27.169188+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.169188+0000","last_undegraded":"2024-09-13T17:14:27.169188+0000","last_fullsized":"2024-09-13T17:14:27.169188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183626+0000","last_change":"2024-09-13T17:14:27.182516+0000","last_active":"2024-09-13T17:14:27.183626+0000","last_peered":"2024-09-13T17:14:27.183626+0000","last_clean":"2024-09-13T17:14:27.183626+0000","last_became_active":"2024-09-13T17:14:27.182251+0000","last_became_peered":"2024-09-13T17:14:27.182251+0000","last_unstale":"2024-09-13T17:14:27.183626+0000","last_undegraded":"2024-09-13T17:14:27.183626+0000","last_fullsized":"2024-09-13T17:14:27.183626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.165262+0000","last_change":"2024-09-13T17:14:27.165262+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.165262+0000","last_undegraded":"2024-09-13T17:14:27.165262+0000","last_fullsized":"2024-09-13T17:14:27.165262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178705+0000","last_change":"2024-09-13T17:14:27.176577+0000","last_active":"2024-09-13T17:14:27.178705+0000","last_peered":"2024-09-13T17:14:27.178705+0000","last_clean":"2024-09-13T17:14:27.178705+0000","last_became_active":"2024-09-13T17:14:27.176318+0000","last_became_peered":"2024-09-13T17:14:27.176318+0000","last_unstale":"2024-09-13T17:14:27.178705+0000","last_undegraded":"2024-09-13T17:14:27.178705+0000","last_fullsized":"2024-09-13T17:14:27.178705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166539+0000","last_change":"2024-09-13T17:14:27.166539+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166539+0000","last_undegraded":"2024-09-13T17:14:27.166539+0000","last_fullsized":"2024-09-13T17:14:27.166539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.177935+0000","last_change":"2024-09-13T17:14:27.175822+0000","last_active":"2024-09-13T17:14:27.177935+0000","last_peered":"2024-09-13T17:14:27.177935+0000","last_clean":"2024-09-13T17:14:27.177935+0000","last_became_active":"2024-09-13T17:14:27.175513+0000","last_became_peered":"2024-09-13T17:14:27.175513+0000","last_unstale":"2024-09-13T17:14:27.177935+0000","last_undegraded":"2024-09-13T17:14:27.177935+0000","last_fullsized":"2024-09-13T17:14:27.177935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172144+0000","last_change":"2024-09-13T17:14:27.172144+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172144+0000","last_undegraded":"2024-09-13T17:14:27.172144+0000","last_fullsized":"2024-09-13T17:14:27.172144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184637+0000","last_change":"2024-09-13T17:14:27.177681+0000","last_active":"2024-09-13T17:14:27.184637+0000","last_peered":"2024-09-13T17:14:27.184637+0000","last_clean":"2024-09-13T17:14:27.184637+0000","last_became_active":"2024-09-13T17:14:27.177376+0000","last_became_peered":"2024-09-13T17:14:27.177376+0000","last_unstale":"2024-09-13T17:14:27.184637+0000","last_undegraded":"2024-09-13T17:14:27.184637+0000","last_fullsized":"2024-09-13T17:14:27.184637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166329+0000","last_change":"2024-09-13T17:14:27.166329+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166329+0000","last_undegraded":"2024-09-13T17:14:27.166329+0000","last_fullsized":"2024-09-13T17:14:27.166329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178372+0000","last_change":"2024-09-13T17:14:27.172367+0000","last_active":"2024-09-13T17:14:27.178372+0000","last_peered":"2024-09-13T17:14:27.178372+0000","last_clean":"2024-09-13T17:14:27.178372+0000","last_became_active":"2024-09-13T17:14:27.172106+0000","last_became_peered":"2024-09-13T17:14:27.172106+0000","last_unstale":"2024-09-13T17:14:27.178372+0000","last_undegraded":"2024-09-13T17:14:27.178372+0000","last_fullsized":"2024-09-13T17:14:27.178372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170712+0000","last_change":"2024-09-13T17:14:27.170712+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170712+0000","last_undegraded":"2024-09-13T17:14:27.170712+0000","last_fullsized":"2024-09-13T17:14:27.170712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182267+0000","last_change":"2024-09-13T17:14:27.180268+0000","last_active":"2024-09-13T17:14:27.182267+0000","last_peered":"2024-09-13T17:14:27.182267+0000","last_clean":"2024-09-13T17:14:27.182267+0000","last_became_active":"2024-09-13T17:14:27.180020+0000","last_became_peered":"2024-09-13T17:14:27.180020+0000","last_unstale":"2024-09-13T17:14:27.182267+0000","last_undegraded":"2024-09-13T17:14:27.182267+0000","last_fullsized":"2024-09-13T17:14:27.182267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.167999+0000","last_change":"2024-09-13T17:14:27.167999+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.167999+0000","last_undegraded":"2024-09-13T17:14:27.167999+0000","last_fullsized":"2024-09-13T17:14:27.167999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.178671+0000","last_change":"2024-09-13T17:14:27.177225+0000","last_active":"2024-09-13T17:14:27.178671+0000","last_peered":"2024-09-13T17:14:27.178671+0000","last_clean":"2024-09-13T17:14:27.178671+0000","last_became_active":"2024-09-13T17:14:27.176960+0000","last_became_peered":"2024-09-13T17:14:27.176960+0000","last_unstale":"2024-09-13T17:14:27.178671+0000","last_undegraded":"2024-09-13T17:14:27.178671+0000","last_fullsized":"2024-09-13T17:14:27.178671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168114+0000","last_change":"2024-09-13T17:14:27.168114+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168114+0000","last_undegraded":"2024-09-13T17:14:27.168114+0000","last_fullsized":"2024-09-13T17:14:27.168114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.185089+0000","last_change":"2024-09-13T17:14:27.179591+0000","last_active":"2024-09-13T17:14:27.185089+0000","last_peered":"2024-09-13T17:14:27.185089+0000","last_clean":"2024-09-13T17:14:27.185089+0000","last_became_active":"2024-09-13T17:14:27.179239+0000","last_became_peered":"2024-09-13T17:14:27.179239+0000","last_unstale":"2024-09-13T17:14:27.185089+0000","last_undegraded":"2024-09-13T17:14:27.185089+0000","last_fullsized":"2024-09-13T17:14:27.185089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.166605+0000","last_change":"2024-09-13T17:14:27.166605+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.166605+0000","last_undegraded":"2024-09-13T17:14:27.166605+0000","last_fullsized":"2024-09-13T17:14:27.166605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183959+0000","last_change":"2024-09-13T17:14:27.177799+0000","last_active":"2024-09-13T17:14:27.183959+0000","last_peered":"2024-09-13T17:14:27.183959+0000","last_clean":"2024-09-13T17:14:27.183959+0000","last_became_active":"2024-09-13T17:14:27.177488+0000","last_became_peered":"2024-09-13T17:14:27.177488+0000","last_unstale":"2024-09-13T17:14:27.183959+0000","last_undegraded":"2024-09-13T17:14:27.183959+0000","last_fullsized":"2024-09-13T17:14:27.183959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.174200+0000","last_change":"2024-09-13T17:14:27.174200+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.174200+0000","last_undegraded":"2024-09-13T17:14:27.174200+0000","last_fullsized":"2024-09-13T17:14:27.174200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.182119+0000","last_change":"2024-09-13T17:14:27.180015+0000","last_active":"2024-09-13T17:14:27.182119+0000","last_peered":"2024-09-13T17:14:27.182119+0000","last_clean":"2024-09-13T17:14:27.182119+0000","last_became_active":"2024-09-13T17:14:27.179758+0000","last_became_peered":"2024-09-13T17:14:27.179758+0000","last_unstale":"2024-09-13T17:14:27.182119+0000","last_undegraded":"2024-09-13T17:14:27.182119+0000","last_fullsized":"2024-09-13T17:14:27.182119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.170676+0000","last_change":"2024-09-13T17:14:27.170676+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.170676+0000","last_undegraded":"2024-09-13T17:14:27.170676+0000","last_fullsized":"2024-09-13T17:14:27.170676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.184699+0000","last_change":"2024-09-13T17:14:27.178335+0000","last_active":"2024-09-13T17:14:27.184699+0000","last_peered":"2024-09-13T17:14:27.184699+0000","last_clean":"2024-09-13T17:14:27.184699+0000","last_became_active":"2024-09-13T17:14:27.178083+0000","last_became_peered":"2024-09-13T17:14:27.178083+0000","last_unstale":"2024-09-13T17:14:27.184699+0000","last_undegraded":"2024-09-13T17:14:27.184699+0000","last_fullsized":"2024-09-13T17:14:27.184699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.168056+0000","last_change":"2024-09-13T17:14:27.168056+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.168056+0000","last_undegraded":"2024-09-13T17:14:27.168056+0000","last_fullsized":"2024-09-13T17:14:27.168056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.183796+0000","last_change":"2024-09-13T17:14:27.180128+0000","last_active":"2024-09-13T17:14:27.183796+0000","last_peered":"2024-09-13T17:14:27.183796+0000","last_clean":"2024-09-13T17:14:27.183796+0000","last_became_active":"2024-09-13T17:14:27.179842+0000","last_became_peered":"2024-09-13T17:14:27.179842+0000","last_unstale":"2024-09-13T17:14:27.183796+0000","last_undegraded":"2024-09-13T17:14:27.183796+0000","last_fullsized":"2024-09-13T17:14:27.183796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:50.591272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-13T17:14:27.172346+0000","last_change":"2024-09-13T17:14:27.172346+0000","last_active":"2024-09-13T17:14:27.158922+0000","last_peered":"2024-09-13T17:14:27.158922+0000","last_clean":"2024-09-13T17:14:27.158922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:14:27.172346+0000","last_undegraded":"2024-09-13T17:14:27.172346+0000","last_fullsized":"2024-09-13T17:14:27.172346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.187871+0000","last_change":"2024-09-13T17:14:27.181872+0000","last_active":"2024-09-13T17:14:27.187871+0000","last_peered":"2024-09-13T17:14:27.187871+0000","last_clean":"2024-09-13T17:14:27.187871+0000","last_became_active":"2024-09-13T17:14:27.181519+0000","last_became_peered":"2024-09-13T17:14:27.181519+0000","last_unstale":"2024-09-13T17:14:27.187871+0000","last_undegraded":"2024-09-13T17:14:27.187871+0000","last_fullsized":"2024-09-13T17:14:27.187871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:13.569407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:14:26.164868+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:14:26.164868+0000","last_peered":"2024-09-13T17:14:26.164868+0000","last_clean":"2024-09-13T17:14:26.164868+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:14:26.164868+0000","last_undegraded":"2024-09-13T17:14:26.164868+0000","last_fullsized":"2024-09-13T17:14:26.164868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.501},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.432},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.317}]},{"osd":1,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.48799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.379},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":178468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.375}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.441},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1019904,"data_stored":768836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:14:32.101 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-09-13T17:14:32.099+0000 7fc5e7c0b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:14:34.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:14:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.005+0000 7ff7d919d640 1 Processor -- start 2024-09-13T17:14:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.005+0000 7ff7d919d640 1 -- start start 2024-09-13T17:14:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d919d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 0x7ff7d40cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d919d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d40d0f50 0x7ff7d40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d919d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d4160490 con 0x7ff7d415ffd0 2024-09-13T17:14:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d919d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d4160770 con 0x7ff7d40d0f50 2024-09-13T17:14:35.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d919d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d4160a50 con 0x7ff7d415c5f0 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d899c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d40d0f50 0x7ff7d40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.006+0000 7ff7d899c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7d40d0f50 0x7ff7d40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46218/0 (socket says 172.21.15.5:46218) 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d899c640 1 -- 172.21.15.5:0/1820457373 learned_addr learned my addr 172.21.15.5:0/1820457373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d3fff640 1 --2- 172.21.15.5:0/1820457373 >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 0x7ff7d40cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d899c640 1 -- 172.21.15.5:0/1820457373 >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 msgr2=0x7ff7d40cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d899c640 1 --2- 172.21.15.5:0/1820457373 >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 0x7ff7d40cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d899c640 1 -- 172.21.15.5:0/1820457373 >> v1:172.21.15.179:6789/0 conn(0x7ff7d415ffd0 legacy=0x7ff7d40d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d899c640 1 -- 172.21.15.5:0/1820457373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4160d30 con 0x7ff7d40d0f50 2024-09-13T17:14:35.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.007+0000 7ff7d3fff640 1 --2- 172.21.15.5:0/1820457373 >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 0x7ff7d40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d899c640 1 --2- 172.21.15.5:0/1820457373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40cd320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7d406d180 tx=0x7ff7cc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78360d97e896797d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d2ffd640 1 -- 172.21.15.5:0/1820457373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc031600 con 0x7ff7d40d0f50 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d2ffd640 1 -- 172.21.15.5:0/1820457373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc02d050 con 0x7ff7d40d0f50 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d2ffd640 1 -- 172.21.15.5:0/1820457373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc031980 con 0x7ff7d40d0f50 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 -- 172.21.15.5:0/1820457373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 msgr2=0x7ff7d40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 --2- 172.21.15.5:0/1820457373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40cd320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7d406d180 tx=0x7ff7cc02a6f0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 -- 172.21.15.5:0/1820457373 shutdown_connections 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 --2- 172.21.15.5:0/1820457373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40cd320 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 --2- 172.21.15.5:0/1820457373 >> v2:172.21.15.179:3300/0 conn(0x7ff7d415c5f0 0x7ff7d40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 -- 172.21.15.5:0/1820457373 >> 172.21.15.5:0/1820457373 conn(0x7ff7d409b6c0 msgr2=0x7ff7d40d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 -- 172.21.15.5:0/1820457373 shutdown_connections 2024-09-13T17:14:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.008+0000 7ff7d919d640 1 -- 172.21.15.5:0/1820457373 wait complete. 2024-09-13T17:14:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.010+0000 7ff7d919d640 1 Processor -- start 2024-09-13T17:14:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.010+0000 7ff7d919d640 1 -- start start 2024-09-13T17:14:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d415c5f0 0x7ff7d40c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d415ffd0 0x7ff7d40b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40c8980 con 0x7ff7d40d0f50 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40b74e0 con 0x7ff7d415c5f0 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d919d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40c79d0 con 0x7ff7d415ffd0 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46232/0 (socket says 172.21.15.5:46232) 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 -- 172.21.15.5:0/718025871 learned_addr learned my addr 172.21.15.5:0/718025871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d37fe640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d415c5f0 0x7ff7d40c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d899c640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d415ffd0 0x7ff7d40b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 -- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d415ffd0 msgr2=0x7ff7d40b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d415ffd0 0x7ff7d40b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 -- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d415c5f0 msgr2=0x7ff7d40c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d415c5f0 0x7ff7d40c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 -- 172.21.15.5:0/718025871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009b30 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d3fff640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400c7f0 tx=0x7ff7c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.011+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4007a30 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.012+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4007b90 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.012+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d40b6bf0 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.012+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400ce40 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.012+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40b6e90 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.013+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d406aed0 con 0x7ff7d40d0f50 2024-09-13T17:14:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.013+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7c40113f0 con 0x7ff7d40d0f50 2024-09-13T17:14:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.013+0000 7ff7d0ff9640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.014+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7c4089500 con 0x7ff7d40d0f50 2024-09-13T17:14:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.014+0000 7ff7d37fe640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.014+0000 7ff7d37fe640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 0x7ff7c006d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7d415ca80 tx=0x7ff7c8009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.018+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7c40546e0 con 0x7ff7d40d0f50 2024-09-13T17:14:35.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.189+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7d40b7620 con 0x7ff7c006ac00 2024-09-13T17:14:35.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.197+0000 7ff7d0ff9640 1 -- 172.21.15.5:0/718025871 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289478 (secure 0 0 0) 0x7ff7c8009550 con 0x7ff7c006ac00 2024-09-13T17:14:35.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.200+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 msgr2=0x7ff7c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.200+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 0x7ff7c006d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7d415ca80 tx=0x7ff7c8009060 comp rx=0 tx=0).stop 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.200+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 msgr2=0x7ff7d40c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.200+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400c7f0 tx=0x7ff7c400cbf0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 shutdown_connections 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d415ffd0 0x7ff7d40b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d415c5f0 0x7ff7d40c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7c006ac00 0x7ff7c006d0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 --2- 172.21.15.5:0/718025871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7d40d0f50 0x7ff7d40c7490 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 >> 172.21.15.5:0/718025871 conn(0x7ff7d409b6c0 msgr2=0x7ff7d40cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 shutdown_connections 2024-09-13T17:14:35.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.201+0000 7ff7d919d640 1 -- 172.21.15.5:0/718025871 wait complete. 2024-09-13T17:14:35.212 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-13T17:14:33.275455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237408,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737312,"statfs":{"total":773094113280,"available":772851007488,"internally_reserved":0,"allocated":4956160,"data_stored":2775684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.112633"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550466+0000","last_change":"2024-09-13T17:14:27.545542+0000","last_active":"2024-09-13T17:14:27.550466+0000","last_peered":"2024-09-13T17:14:27.550466+0000","last_clean":"2024-09-13T17:14:27.550466+0000","last_became_active":"2024-09-13T17:14:27.545047+0000","last_became_peered":"2024-09-13T17:14:27.545047+0000","last_unstale":"2024-09-13T17:14:27.550466+0000","last_undegraded":"2024-09-13T17:14:27.550466+0000","last_fullsized":"2024-09-13T17:14:27.550466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:57.605275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.549337+0000","last_change":"2024-09-13T17:14:27.542855+0000","last_active":"2024-09-13T17:14:27.549337+0000","last_peered":"2024-09-13T17:14:27.549337+0000","last_clean":"2024-09-13T17:14:27.549337+0000","last_became_active":"2024-09-13T17:14:27.542611+0000","last_became_peered":"2024-09-13T17:14:27.542611+0000","last_unstale":"2024-09-13T17:14:27.549337+0000","last_undegraded":"2024-09-13T17:14:27.549337+0000","last_fullsized":"2024-09-13T17:14:27.549337+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545170+0000","last_change":"2024-09-13T17:14:27.543190+0000","last_active":"2024-09-13T17:14:27.545170+0000","last_peered":"2024-09-13T17:14:27.545170+0000","last_clean":"2024-09-13T17:14:27.545170+0000","last_became_active":"2024-09-13T17:14:27.542805+0000","last_became_peered":"2024-09-13T17:14:27.542805+0000","last_unstale":"2024-09-13T17:14:27.545170+0000","last_undegraded":"2024-09-13T17:14:27.545170+0000","last_fullsized":"2024-09-13T17:14:27.545170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554631+0000","last_change":"2024-09-13T17:14:27.551452+0000","last_active":"2024-09-13T17:14:27.554631+0000","last_peered":"2024-09-13T17:14:27.554631+0000","last_clean":"2024-09-13T17:14:27.554631+0000","last_became_active":"2024-09-13T17:14:27.551206+0000","last_became_peered":"2024-09-13T17:14:27.551206+0000","last_unstale":"2024-09-13T17:14:27.554631+0000","last_undegraded":"2024-09-13T17:14:27.554631+0000","last_fullsized":"2024-09-13T17:14:27.554631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554857+0000","last_change":"2024-09-13T17:14:27.550973+0000","last_active":"2024-09-13T17:14:27.554857+0000","last_peered":"2024-09-13T17:14:27.554857+0000","last_clean":"2024-09-13T17:14:27.554857+0000","last_became_active":"2024-09-13T17:14:27.550737+0000","last_became_peered":"2024-09-13T17:14:27.550737+0000","last_unstale":"2024-09-13T17:14:27.554857+0000","last_undegraded":"2024-09-13T17:14:27.554857+0000","last_fullsized":"2024-09-13T17:14:27.554857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553082+0000","last_change":"2024-09-13T17:14:27.551201+0000","last_active":"2024-09-13T17:14:27.553082+0000","last_peered":"2024-09-13T17:14:27.553082+0000","last_clean":"2024-09-13T17:14:27.553082+0000","last_became_active":"2024-09-13T17:14:27.550402+0000","last_became_peered":"2024-09-13T17:14:27.550402+0000","last_unstale":"2024-09-13T17:14:27.553082+0000","last_undegraded":"2024-09-13T17:14:27.553082+0000","last_fullsized":"2024-09-13T17:14:27.553082+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553846+0000","last_change":"2024-09-13T17:14:27.548064+0000","last_active":"2024-09-13T17:14:27.553846+0000","last_peered":"2024-09-13T17:14:27.553846+0000","last_clean":"2024-09-13T17:14:27.553846+0000","last_became_active":"2024-09-13T17:14:27.547788+0000","last_became_peered":"2024-09-13T17:14:27.547788+0000","last_unstale":"2024-09-13T17:14:27.553846+0000","last_undegraded":"2024-09-13T17:14:27.553846+0000","last_fullsized":"2024-09-13T17:14:27.553846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:23.443894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.541300+0000","last_change":"2024-09-13T17:14:27.534545+0000","last_active":"2024-09-13T17:14:27.541300+0000","last_peered":"2024-09-13T17:14:27.541300+0000","last_clean":"2024-09-13T17:14:27.541300+0000","last_became_active":"2024-09-13T17:14:27.534312+0000","last_became_peered":"2024-09-13T17:14:27.534312+0000","last_unstale":"2024-09-13T17:14:27.541300+0000","last_undegraded":"2024-09-13T17:14:27.541300+0000","last_fullsized":"2024-09-13T17:14:27.541300+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545201+0000","last_change":"2024-09-13T17:14:27.543064+0000","last_active":"2024-09-13T17:14:27.545201+0000","last_peered":"2024-09-13T17:14:27.545201+0000","last_clean":"2024-09-13T17:14:27.545201+0000","last_became_active":"2024-09-13T17:14:27.542826+0000","last_became_peered":"2024-09-13T17:14:27.542826+0000","last_unstale":"2024-09-13T17:14:27.545201+0000","last_undegraded":"2024-09-13T17:14:27.545201+0000","last_fullsized":"2024-09-13T17:14:27.545201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552341+0000","last_change":"2024-09-13T17:14:27.547473+0000","last_active":"2024-09-13T17:14:27.552341+0000","last_peered":"2024-09-13T17:14:27.552341+0000","last_clean":"2024-09-13T17:14:27.552341+0000","last_became_active":"2024-09-13T17:14:27.546914+0000","last_became_peered":"2024-09-13T17:14:27.546914+0000","last_unstale":"2024-09-13T17:14:27.552341+0000","last_undegraded":"2024-09-13T17:14:27.552341+0000","last_fullsized":"2024-09-13T17:14:27.552341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544402+0000","last_change":"2024-09-13T17:14:27.542091+0000","last_active":"2024-09-13T17:14:27.544402+0000","last_peered":"2024-09-13T17:14:27.544402+0000","last_clean":"2024-09-13T17:14:27.544402+0000","last_became_active":"2024-09-13T17:14:27.541835+0000","last_became_peered":"2024-09-13T17:14:27.541835+0000","last_unstale":"2024-09-13T17:14:27.544402+0000","last_undegraded":"2024-09-13T17:14:27.544402+0000","last_fullsized":"2024-09-13T17:14:27.544402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:47.229871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545039+0000","last_change":"2024-09-13T17:14:27.542715+0000","last_active":"2024-09-13T17:14:27.545039+0000","last_peered":"2024-09-13T17:14:27.545039+0000","last_clean":"2024-09-13T17:14:27.545039+0000","last_became_active":"2024-09-13T17:14:27.542264+0000","last_became_peered":"2024-09-13T17:14:27.542264+0000","last_unstale":"2024-09-13T17:14:27.545039+0000","last_undegraded":"2024-09-13T17:14:27.545039+0000","last_fullsized":"2024-09-13T17:14:27.545039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554040+0000","last_change":"2024-09-13T17:14:27.550419+0000","last_active":"2024-09-13T17:14:27.554040+0000","last_peered":"2024-09-13T17:14:27.554040+0000","last_clean":"2024-09-13T17:14:27.554040+0000","last_became_active":"2024-09-13T17:14:27.550170+0000","last_became_peered":"2024-09-13T17:14:27.550170+0000","last_unstale":"2024-09-13T17:14:27.554040+0000","last_undegraded":"2024-09-13T17:14:27.554040+0000","last_fullsized":"2024-09-13T17:14:27.554040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552312+0000","last_change":"2024-09-13T17:14:27.548428+0000","last_active":"2024-09-13T17:14:27.552312+0000","last_peered":"2024-09-13T17:14:27.552312+0000","last_clean":"2024-09-13T17:14:27.552312+0000","last_became_active":"2024-09-13T17:14:27.548036+0000","last_became_peered":"2024-09-13T17:14:27.548036+0000","last_unstale":"2024-09-13T17:14:27.552312+0000","last_undegraded":"2024-09-13T17:14:27.552312+0000","last_fullsized":"2024-09-13T17:14:27.552312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:15.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545393+0000","last_change":"2024-09-13T17:14:27.543752+0000","last_active":"2024-09-13T17:14:27.545393+0000","last_peered":"2024-09-13T17:14:27.545393+0000","last_clean":"2024-09-13T17:14:27.545393+0000","last_became_active":"2024-09-13T17:14:27.543483+0000","last_became_peered":"2024-09-13T17:14:27.543483+0000","last_unstale":"2024-09-13T17:14:27.545393+0000","last_undegraded":"2024-09-13T17:14:27.545393+0000","last_fullsized":"2024-09-13T17:14:27.545393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.543255+0000","last_change":"2024-09-13T17:14:27.540238+0000","last_active":"2024-09-13T17:14:27.543255+0000","last_peered":"2024-09-13T17:14:27.543255+0000","last_clean":"2024-09-13T17:14:27.543255+0000","last_became_active":"2024-09-13T17:14:27.539953+0000","last_became_peered":"2024-09-13T17:14:27.539953+0000","last_unstale":"2024-09-13T17:14:27.543255+0000","last_undegraded":"2024-09-13T17:14:27.543255+0000","last_fullsized":"2024-09-13T17:14:27.543255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.555477+0000","last_change":"2024-09-13T17:14:27.553107+0000","last_active":"2024-09-13T17:14:27.555477+0000","last_peered":"2024-09-13T17:14:27.555477+0000","last_clean":"2024-09-13T17:14:27.555477+0000","last_became_active":"2024-09-13T17:14:27.552695+0000","last_became_peered":"2024-09-13T17:14:27.552695+0000","last_unstale":"2024-09-13T17:14:27.555477+0000","last_undegraded":"2024-09-13T17:14:27.555477+0000","last_fullsized":"2024-09-13T17:14:27.555477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:52.894868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548833+0000","last_change":"2024-09-13T17:14:27.547018+0000","last_active":"2024-09-13T17:14:27.548833+0000","last_peered":"2024-09-13T17:14:27.548833+0000","last_clean":"2024-09-13T17:14:27.548833+0000","last_became_active":"2024-09-13T17:14:27.546687+0000","last_became_peered":"2024-09-13T17:14:27.546687+0000","last_unstale":"2024-09-13T17:14:27.548833+0000","last_undegraded":"2024-09-13T17:14:27.548833+0000","last_fullsized":"2024-09-13T17:14:27.548833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554085+0000","last_change":"2024-09-13T17:14:27.544173+0000","last_active":"2024-09-13T17:14:27.554085+0000","last_peered":"2024-09-13T17:14:27.554085+0000","last_clean":"2024-09-13T17:14:27.554085+0000","last_became_active":"2024-09-13T17:14:27.543912+0000","last_became_peered":"2024-09-13T17:14:27.543912+0000","last_unstale":"2024-09-13T17:14:27.554085+0000","last_undegraded":"2024-09-13T17:14:27.554085+0000","last_fullsized":"2024-09-13T17:14:27.554085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.549121+0000","last_change":"2024-09-13T17:14:27.547107+0000","last_active":"2024-09-13T17:14:27.549121+0000","last_peered":"2024-09-13T17:14:27.549121+0000","last_clean":"2024-09-13T17:14:27.549121+0000","last_became_active":"2024-09-13T17:14:27.546829+0000","last_became_peered":"2024-09-13T17:14:27.546829+0000","last_unstale":"2024-09-13T17:14:27.549121+0000","last_undegraded":"2024-09-13T17:14:27.549121+0000","last_fullsized":"2024-09-13T17:14:27.549121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548199+0000","last_change":"2024-09-13T17:14:27.545180+0000","last_active":"2024-09-13T17:14:27.548199+0000","last_peered":"2024-09-13T17:14:27.548199+0000","last_clean":"2024-09-13T17:14:27.548199+0000","last_became_active":"2024-09-13T17:14:27.544879+0000","last_became_peered":"2024-09-13T17:14:27.544879+0000","last_unstale":"2024-09-13T17:14:27.548199+0000","last_undegraded":"2024-09-13T17:14:27.548199+0000","last_fullsized":"2024-09-13T17:14:27.548199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:49.609306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552295+0000","last_change":"2024-09-13T17:14:27.546435+0000","last_active":"2024-09-13T17:14:27.552295+0000","last_peered":"2024-09-13T17:14:27.552295+0000","last_clean":"2024-09-13T17:14:27.552295+0000","last_became_active":"2024-09-13T17:14:27.546038+0000","last_became_peered":"2024-09-13T17:14:27.546038+0000","last_unstale":"2024-09-13T17:14:27.552295+0000","last_undegraded":"2024-09-13T17:14:27.552295+0000","last_fullsized":"2024-09-13T17:14:27.552295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544861+0000","last_change":"2024-09-13T17:14:27.543135+0000","last_active":"2024-09-13T17:14:27.544861+0000","last_peered":"2024-09-13T17:14:27.544861+0000","last_clean":"2024-09-13T17:14:27.544861+0000","last_became_active":"2024-09-13T17:14:27.542854+0000","last_became_peered":"2024-09-13T17:14:27.542854+0000","last_unstale":"2024-09-13T17:14:27.544861+0000","last_undegraded":"2024-09-13T17:14:27.544861+0000","last_fullsized":"2024-09-13T17:14:27.544861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.208018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554048+0000","last_change":"2024-09-13T17:14:27.544943+0000","last_active":"2024-09-13T17:14:27.554048+0000","last_peered":"2024-09-13T17:14:27.554048+0000","last_clean":"2024-09-13T17:14:27.554048+0000","last_became_active":"2024-09-13T17:14:27.544713+0000","last_became_peered":"2024-09-13T17:14:27.544713+0000","last_unstale":"2024-09-13T17:14:27.554048+0000","last_undegraded":"2024-09-13T17:14:27.554048+0000","last_fullsized":"2024-09-13T17:14:27.554048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552159+0000","last_change":"2024-09-13T17:14:27.550230+0000","last_active":"2024-09-13T17:14:27.552159+0000","last_peered":"2024-09-13T17:14:27.552159+0000","last_clean":"2024-09-13T17:14:27.552159+0000","last_became_active":"2024-09-13T17:14:27.549299+0000","last_became_peered":"2024-09-13T17:14:27.549299+0000","last_unstale":"2024-09-13T17:14:27.552159+0000","last_undegraded":"2024-09-13T17:14:27.552159+0000","last_fullsized":"2024-09-13T17:14:27.552159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553294+0000","last_change":"2024-09-13T17:14:27.551815+0000","last_active":"2024-09-13T17:14:27.553294+0000","last_peered":"2024-09-13T17:14:27.553294+0000","last_clean":"2024-09-13T17:14:27.553294+0000","last_became_active":"2024-09-13T17:14:27.551486+0000","last_became_peered":"2024-09-13T17:14:27.551486+0000","last_unstale":"2024-09-13T17:14:27.553294+0000","last_undegraded":"2024-09-13T17:14:27.553294+0000","last_fullsized":"2024-09-13T17:14:27.553294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.549105+0000","last_change":"2024-09-13T17:14:27.547600+0000","last_active":"2024-09-13T17:14:27.549105+0000","last_peered":"2024-09-13T17:14:27.549105+0000","last_clean":"2024-09-13T17:14:27.549105+0000","last_became_active":"2024-09-13T17:14:27.546120+0000","last_became_peered":"2024-09-13T17:14:27.546120+0000","last_unstale":"2024-09-13T17:14:27.549105+0000","last_undegraded":"2024-09-13T17:14:27.549105+0000","last_fullsized":"2024-09-13T17:14:27.549105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553596+0000","last_change":"2024-09-13T17:14:27.549677+0000","last_active":"2024-09-13T17:14:27.553596+0000","last_peered":"2024-09-13T17:14:27.553596+0000","last_clean":"2024-09-13T17:14:27.553596+0000","last_became_active":"2024-09-13T17:14:27.549427+0000","last_became_peered":"2024-09-13T17:14:27.549427+0000","last_unstale":"2024-09-13T17:14:27.553596+0000","last_undegraded":"2024-09-13T17:14:27.553596+0000","last_fullsized":"2024-09-13T17:14:27.553596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:22.322456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548478+0000","last_change":"2024-09-13T17:14:27.545967+0000","last_active":"2024-09-13T17:14:27.548478+0000","last_peered":"2024-09-13T17:14:27.548478+0000","last_clean":"2024-09-13T17:14:27.548478+0000","last_became_active":"2024-09-13T17:14:27.545637+0000","last_became_peered":"2024-09-13T17:14:27.545637+0000","last_unstale":"2024-09-13T17:14:27.548478+0000","last_undegraded":"2024-09-13T17:14:27.548478+0000","last_fullsized":"2024-09-13T17:14:27.548478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550641+0000","last_change":"2024-09-13T17:14:27.549018+0000","last_active":"2024-09-13T17:14:27.550641+0000","last_peered":"2024-09-13T17:14:27.550641+0000","last_clean":"2024-09-13T17:14:27.550641+0000","last_became_active":"2024-09-13T17:14:27.548755+0000","last_became_peered":"2024-09-13T17:14:27.548755+0000","last_unstale":"2024-09-13T17:14:27.550641+0000","last_undegraded":"2024-09-13T17:14:27.550641+0000","last_fullsized":"2024-09-13T17:14:27.550641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:02.832782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.546659+0000","last_change":"2024-09-13T17:14:27.544149+0000","last_active":"2024-09-13T17:14:27.546659+0000","last_peered":"2024-09-13T17:14:27.546659+0000","last_clean":"2024-09-13T17:14:27.546659+0000","last_became_active":"2024-09-13T17:14:27.543865+0000","last_became_peered":"2024-09-13T17:14:27.543865+0000","last_unstale":"2024-09-13T17:14:27.546659+0000","last_undegraded":"2024-09-13T17:14:27.546659+0000","last_fullsized":"2024-09-13T17:14:27.546659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:08.198894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550078+0000","last_change":"2024-09-13T17:14:27.544092+0000","last_active":"2024-09-13T17:14:27.550078+0000","last_peered":"2024-09-13T17:14:27.550078+0000","last_clean":"2024-09-13T17:14:27.550078+0000","last_became_active":"2024-09-13T17:14:27.543779+0000","last_became_peered":"2024-09-13T17:14:27.543779+0000","last_unstale":"2024-09-13T17:14:27.550078+0000","last_undegraded":"2024-09-13T17:14:27.550078+0000","last_fullsized":"2024-09-13T17:14:27.550078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544820+0000","last_change":"2024-09-13T17:14:27.543853+0000","last_active":"2024-09-13T17:14:27.544820+0000","last_peered":"2024-09-13T17:14:27.544820+0000","last_clean":"2024-09-13T17:14:27.544820+0000","last_became_active":"2024-09-13T17:14:27.543586+0000","last_became_peered":"2024-09-13T17:14:27.543586+0000","last_unstale":"2024-09-13T17:14:27.544820+0000","last_undegraded":"2024-09-13T17:14:27.544820+0000","last_fullsized":"2024-09-13T17:14:27.544820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552329+0000","last_change":"2024-09-13T17:14:27.178887+0000","last_active":"2024-09-13T17:14:27.552329+0000","last_peered":"2024-09-13T17:14:27.552329+0000","last_clean":"2024-09-13T17:14:27.552329+0000","last_became_active":"2024-09-13T17:14:27.178489+0000","last_became_peered":"2024-09-13T17:14:27.178489+0000","last_unstale":"2024-09-13T17:14:27.552329+0000","last_undegraded":"2024-09-13T17:14:27.552329+0000","last_fullsized":"2024-09-13T17:14:27.552329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550179+0000","last_change":"2024-09-13T17:14:27.546753+0000","last_active":"2024-09-13T17:14:27.550179+0000","last_peered":"2024-09-13T17:14:27.550179+0000","last_clean":"2024-09-13T17:14:27.550179+0000","last_became_active":"2024-09-13T17:14:27.545978+0000","last_became_peered":"2024-09-13T17:14:27.545978+0000","last_unstale":"2024-09-13T17:14:27.550179+0000","last_undegraded":"2024-09-13T17:14:27.550179+0000","last_fullsized":"2024-09-13T17:14:27.550179+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:07.149860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544550+0000","last_change":"2024-09-13T17:14:27.182304+0000","last_active":"2024-09-13T17:14:27.544550+0000","last_peered":"2024-09-13T17:14:27.544550+0000","last_clean":"2024-09-13T17:14:27.544550+0000","last_became_active":"2024-09-13T17:14:27.182039+0000","last_became_peered":"2024-09-13T17:14:27.182039+0000","last_unstale":"2024-09-13T17:14:27.544550+0000","last_undegraded":"2024-09-13T17:14:27.544550+0000","last_fullsized":"2024-09-13T17:14:27.544550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.551870+0000","last_change":"2024-09-13T17:14:27.549930+0000","last_active":"2024-09-13T17:14:27.551870+0000","last_peered":"2024-09-13T17:14:27.551870+0000","last_clean":"2024-09-13T17:14:27.551870+0000","last_became_active":"2024-09-13T17:14:27.549316+0000","last_became_peered":"2024-09-13T17:14:27.549316+0000","last_unstale":"2024-09-13T17:14:27.551870+0000","last_undegraded":"2024-09-13T17:14:27.551870+0000","last_fullsized":"2024-09-13T17:14:27.551870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:15.115737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548340+0000","last_change":"2024-09-13T17:14:27.179507+0000","last_active":"2024-09-13T17:14:27.548340+0000","last_peered":"2024-09-13T17:14:27.548340+0000","last_clean":"2024-09-13T17:14:27.548340+0000","last_became_active":"2024-09-13T17:14:27.178726+0000","last_became_peered":"2024-09-13T17:14:27.178726+0000","last_unstale":"2024-09-13T17:14:27.548340+0000","last_undegraded":"2024-09-13T17:14:27.548340+0000","last_fullsized":"2024-09-13T17:14:27.548340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.551081+0000","last_change":"2024-09-13T17:14:27.547854+0000","last_active":"2024-09-13T17:14:27.551081+0000","last_peered":"2024-09-13T17:14:27.551081+0000","last_clean":"2024-09-13T17:14:27.551081+0000","last_became_active":"2024-09-13T17:14:27.547383+0000","last_became_peered":"2024-09-13T17:14:27.547383+0000","last_unstale":"2024-09-13T17:14:27.551081+0000","last_undegraded":"2024-09-13T17:14:27.551081+0000","last_fullsized":"2024-09-13T17:14:27.551081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:13.935446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554110+0000","last_change":"2024-09-13T17:14:27.180909+0000","last_active":"2024-09-13T17:14:27.554110+0000","last_peered":"2024-09-13T17:14:27.554110+0000","last_clean":"2024-09-13T17:14:27.554110+0000","last_became_active":"2024-09-13T17:14:27.180637+0000","last_became_peered":"2024-09-13T17:14:27.180637+0000","last_unstale":"2024-09-13T17:14:27.554110+0000","last_undegraded":"2024-09-13T17:14:27.554110+0000","last_fullsized":"2024-09-13T17:14:27.554110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544582+0000","last_change":"2024-09-13T17:14:27.542014+0000","last_active":"2024-09-13T17:14:27.544582+0000","last_peered":"2024-09-13T17:14:27.544582+0000","last_clean":"2024-09-13T17:14:27.544582+0000","last_became_active":"2024-09-13T17:14:27.541779+0000","last_became_peered":"2024-09-13T17:14:27.541779+0000","last_unstale":"2024-09-13T17:14:27.544582+0000","last_undegraded":"2024-09-13T17:14:27.544582+0000","last_fullsized":"2024-09-13T17:14:27.544582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553946+0000","last_change":"2024-09-13T17:14:27.184677+0000","last_active":"2024-09-13T17:14:27.553946+0000","last_peered":"2024-09-13T17:14:27.553946+0000","last_clean":"2024-09-13T17:14:27.553946+0000","last_became_active":"2024-09-13T17:14:27.184400+0000","last_became_peered":"2024-09-13T17:14:27.184400+0000","last_unstale":"2024-09-13T17:14:27.553946+0000","last_undegraded":"2024-09-13T17:14:27.553946+0000","last_fullsized":"2024-09-13T17:14:27.553946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545374+0000","last_change":"2024-09-13T17:14:27.543016+0000","last_active":"2024-09-13T17:14:27.545374+0000","last_peered":"2024-09-13T17:14:27.545374+0000","last_clean":"2024-09-13T17:14:27.545374+0000","last_became_active":"2024-09-13T17:14:27.542513+0000","last_became_peered":"2024-09-13T17:14:27.542513+0000","last_unstale":"2024-09-13T17:14:27.545374+0000","last_undegraded":"2024-09-13T17:14:27.545374+0000","last_fullsized":"2024-09-13T17:14:27.545374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.558067+0000","last_change":"2024-09-13T17:14:27.182479+0000","last_active":"2024-09-13T17:14:27.558067+0000","last_peered":"2024-09-13T17:14:27.558067+0000","last_clean":"2024-09-13T17:14:27.558067+0000","last_became_active":"2024-09-13T17:14:27.182170+0000","last_became_peered":"2024-09-13T17:14:27.182170+0000","last_unstale":"2024-09-13T17:14:27.558067+0000","last_undegraded":"2024-09-13T17:14:27.558067+0000","last_fullsized":"2024-09-13T17:14:27.558067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:34.671799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544618+0000","last_change":"2024-09-13T17:14:27.543291+0000","last_active":"2024-09-13T17:14:27.544618+0000","last_peered":"2024-09-13T17:14:27.544618+0000","last_clean":"2024-09-13T17:14:27.544618+0000","last_became_active":"2024-09-13T17:14:27.543037+0000","last_became_peered":"2024-09-13T17:14:27.543037+0000","last_unstale":"2024-09-13T17:14:27.544618+0000","last_undegraded":"2024-09-13T17:14:27.544618+0000","last_fullsized":"2024-09-13T17:14:27.544618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.536117+0000","last_change":"2024-09-13T17:14:27.183303+0000","last_active":"2024-09-13T17:14:27.536117+0000","last_peered":"2024-09-13T17:14:27.536117+0000","last_clean":"2024-09-13T17:14:27.536117+0000","last_became_active":"2024-09-13T17:14:27.183018+0000","last_became_peered":"2024-09-13T17:14:27.183018+0000","last_unstale":"2024-09-13T17:14:27.536117+0000","last_undegraded":"2024-09-13T17:14:27.536117+0000","last_fullsized":"2024-09-13T17:14:27.536117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.876181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550573+0000","last_change":"2024-09-13T17:14:27.546221+0000","last_active":"2024-09-13T17:14:27.550573+0000","last_peered":"2024-09-13T17:14:27.550573+0000","last_clean":"2024-09-13T17:14:27.550573+0000","last_became_active":"2024-09-13T17:14:27.545972+0000","last_became_peered":"2024-09-13T17:14:27.545972+0000","last_unstale":"2024-09-13T17:14:27.550573+0000","last_undegraded":"2024-09-13T17:14:27.550573+0000","last_fullsized":"2024-09-13T17:14:27.550573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:23.035258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.531167+0000","last_change":"2024-09-13T17:14:27.180537+0000","last_active":"2024-09-13T17:14:27.531167+0000","last_peered":"2024-09-13T17:14:27.531167+0000","last_clean":"2024-09-13T17:14:27.531167+0000","last_became_active":"2024-09-13T17:14:27.180234+0000","last_became_peered":"2024-09-13T17:14:27.180234+0000","last_unstale":"2024-09-13T17:14:27.531167+0000","last_undegraded":"2024-09-13T17:14:27.531167+0000","last_fullsized":"2024-09-13T17:14:27.531167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554589+0000","last_change":"2024-09-13T17:14:27.551049+0000","last_active":"2024-09-13T17:14:27.554589+0000","last_peered":"2024-09-13T17:14:27.554589+0000","last_clean":"2024-09-13T17:14:27.554589+0000","last_became_active":"2024-09-13T17:14:27.550770+0000","last_became_peered":"2024-09-13T17:14:27.550770+0000","last_unstale":"2024-09-13T17:14:27.554589+0000","last_undegraded":"2024-09-13T17:14:27.554589+0000","last_fullsized":"2024-09-13T17:14:27.554589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.529680+0000","last_change":"2024-09-13T17:14:27.180202+0000","last_active":"2024-09-13T17:14:27.529680+0000","last_peered":"2024-09-13T17:14:27.529680+0000","last_clean":"2024-09-13T17:14:27.529680+0000","last_became_active":"2024-09-13T17:14:27.179900+0000","last_became_peered":"2024-09-13T17:14:27.179900+0000","last_unstale":"2024-09-13T17:14:27.529680+0000","last_undegraded":"2024-09-13T17:14:27.529680+0000","last_fullsized":"2024-09-13T17:14:27.529680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:00.975889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.557732+0000","last_change":"2024-09-13T17:14:27.556464+0000","last_active":"2024-09-13T17:14:27.557732+0000","last_peered":"2024-09-13T17:14:27.557732+0000","last_clean":"2024-09-13T17:14:27.557732+0000","last_became_active":"2024-09-13T17:14:27.556138+0000","last_became_peered":"2024-09-13T17:14:27.556138+0000","last_unstale":"2024-09-13T17:14:27.557732+0000","last_undegraded":"2024-09-13T17:14:27.557732+0000","last_fullsized":"2024-09-13T17:14:27.557732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:30.739601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.533571+0000","last_change":"2024-09-13T17:14:27.183493+0000","last_active":"2024-09-13T17:14:27.533571+0000","last_peered":"2024-09-13T17:14:27.533571+0000","last_clean":"2024-09-13T17:14:27.533571+0000","last_became_active":"2024-09-13T17:14:27.183219+0000","last_became_peered":"2024-09-13T17:14:27.183219+0000","last_unstale":"2024-09-13T17:14:27.533571+0000","last_undegraded":"2024-09-13T17:14:27.533571+0000","last_fullsized":"2024-09-13T17:14:27.533571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:51.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.543284+0000","last_change":"2024-09-13T17:14:27.541513+0000","last_active":"2024-09-13T17:14:27.543284+0000","last_peered":"2024-09-13T17:14:27.543284+0000","last_clean":"2024-09-13T17:14:27.543284+0000","last_became_active":"2024-09-13T17:14:27.541228+0000","last_became_peered":"2024-09-13T17:14:27.541228+0000","last_unstale":"2024-09-13T17:14:27.543284+0000","last_undegraded":"2024-09-13T17:14:27.543284+0000","last_fullsized":"2024-09-13T17:14:27.543284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:41.441721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.551871+0000","last_change":"2024-09-13T17:14:27.180924+0000","last_active":"2024-09-13T17:14:27.551871+0000","last_peered":"2024-09-13T17:14:27.551871+0000","last_clean":"2024-09-13T17:14:27.551871+0000","last_became_active":"2024-09-13T17:14:27.180626+0000","last_became_peered":"2024-09-13T17:14:27.180626+0000","last_unstale":"2024-09-13T17:14:27.551871+0000","last_undegraded":"2024-09-13T17:14:27.551871+0000","last_fullsized":"2024-09-13T17:14:27.551871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:15.195575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552268+0000","last_change":"2024-09-13T17:14:27.546523+0000","last_active":"2024-09-13T17:14:27.552268+0000","last_peered":"2024-09-13T17:14:27.552268+0000","last_clean":"2024-09-13T17:14:27.552268+0000","last_became_active":"2024-09-13T17:14:27.546158+0000","last_became_peered":"2024-09-13T17:14:27.546158+0000","last_unstale":"2024-09-13T17:14:27.552268+0000","last_undegraded":"2024-09-13T17:14:27.552268+0000","last_fullsized":"2024-09-13T17:14:27.552268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.556276+0000","last_change":"2024-09-13T17:14:27.183475+0000","last_active":"2024-09-13T17:14:27.556276+0000","last_peered":"2024-09-13T17:14:27.556276+0000","last_clean":"2024-09-13T17:14:27.556276+0000","last_became_active":"2024-09-13T17:14:27.183225+0000","last_became_peered":"2024-09-13T17:14:27.183225+0000","last_unstale":"2024-09-13T17:14:27.556276+0000","last_undegraded":"2024-09-13T17:14:27.556276+0000","last_fullsized":"2024-09-13T17:14:27.556276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:53.422345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.542489+0000","last_change":"2024-09-13T17:14:27.540116+0000","last_active":"2024-09-13T17:14:27.542489+0000","last_peered":"2024-09-13T17:14:27.542489+0000","last_clean":"2024-09-13T17:14:27.542489+0000","last_became_active":"2024-09-13T17:14:27.539845+0000","last_became_peered":"2024-09-13T17:14:27.539845+0000","last_unstale":"2024-09-13T17:14:27.542489+0000","last_undegraded":"2024-09-13T17:14:27.542489+0000","last_fullsized":"2024-09-13T17:14:27.542489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550643+0000","last_change":"2024-09-13T17:14:27.179542+0000","last_active":"2024-09-13T17:14:27.550643+0000","last_peered":"2024-09-13T17:14:27.550643+0000","last_clean":"2024-09-13T17:14:27.550643+0000","last_became_active":"2024-09-13T17:14:27.179295+0000","last_became_peered":"2024-09-13T17:14:27.179295+0000","last_unstale":"2024-09-13T17:14:27.550643+0000","last_undegraded":"2024-09-13T17:14:27.550643+0000","last_fullsized":"2024-09-13T17:14:27.550643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:14.885317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.549310+0000","last_change":"2024-09-13T17:14:27.544648+0000","last_active":"2024-09-13T17:14:27.549310+0000","last_peered":"2024-09-13T17:14:27.549310+0000","last_clean":"2024-09-13T17:14:27.549310+0000","last_became_active":"2024-09-13T17:14:27.544393+0000","last_became_peered":"2024-09-13T17:14:27.544393+0000","last_unstale":"2024-09-13T17:14:27.549310+0000","last_undegraded":"2024-09-13T17:14:27.549310+0000","last_fullsized":"2024-09-13T17:14:27.549310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:20.235977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.536573+0000","last_change":"2024-09-13T17:14:27.183558+0000","last_active":"2024-09-13T17:14:27.536573+0000","last_peered":"2024-09-13T17:14:27.536573+0000","last_clean":"2024-09-13T17:14:27.536573+0000","last_became_active":"2024-09-13T17:14:27.183231+0000","last_became_peered":"2024-09-13T17:14:27.183231+0000","last_unstale":"2024-09-13T17:14:27.536573+0000","last_undegraded":"2024-09-13T17:14:27.536573+0000","last_fullsized":"2024-09-13T17:14:27.536573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:29.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.544833+0000","last_change":"2024-09-13T17:14:27.543221+0000","last_active":"2024-09-13T17:14:27.544833+0000","last_peered":"2024-09-13T17:14:27.544833+0000","last_clean":"2024-09-13T17:14:27.544833+0000","last_became_active":"2024-09-13T17:14:27.542904+0000","last_became_peered":"2024-09-13T17:14:27.542904+0000","last_unstale":"2024-09-13T17:14:27.544833+0000","last_undegraded":"2024-09-13T17:14:27.544833+0000","last_fullsized":"2024-09-13T17:14:27.544833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.538485+0000","last_change":"2024-09-13T17:14:27.175502+0000","last_active":"2024-09-13T17:14:27.538485+0000","last_peered":"2024-09-13T17:14:27.538485+0000","last_clean":"2024-09-13T17:14:27.538485+0000","last_became_active":"2024-09-13T17:14:27.175233+0000","last_became_peered":"2024-09-13T17:14:27.175233+0000","last_unstale":"2024-09-13T17:14:27.538485+0000","last_undegraded":"2024-09-13T17:14:27.538485+0000","last_fullsized":"2024-09-13T17:14:27.538485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.549360+0000","last_change":"2024-09-13T17:14:27.541202+0000","last_active":"2024-09-13T17:14:27.549360+0000","last_peered":"2024-09-13T17:14:27.549360+0000","last_clean":"2024-09-13T17:14:27.549360+0000","last_became_active":"2024-09-13T17:14:27.540117+0000","last_became_peered":"2024-09-13T17:14:27.540117+0000","last_unstale":"2024-09-13T17:14:27.549360+0000","last_undegraded":"2024-09-13T17:14:27.549360+0000","last_fullsized":"2024-09-13T17:14:27.549360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:10.634191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.559951+0000","last_change":"2024-09-13T17:14:27.178968+0000","last_active":"2024-09-13T17:14:27.559951+0000","last_peered":"2024-09-13T17:14:27.559951+0000","last_clean":"2024-09-13T17:14:27.559951+0000","last_became_active":"2024-09-13T17:14:27.178691+0000","last_became_peered":"2024-09-13T17:14:27.178691+0000","last_unstale":"2024-09-13T17:14:27.559951+0000","last_undegraded":"2024-09-13T17:14:27.559951+0000","last_fullsized":"2024-09-13T17:14:27.559951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:18.175245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552402+0000","last_change":"2024-09-13T17:14:27.549635+0000","last_active":"2024-09-13T17:14:27.552402+0000","last_peered":"2024-09-13T17:14:27.552402+0000","last_clean":"2024-09-13T17:14:27.552402+0000","last_became_active":"2024-09-13T17:14:27.548107+0000","last_became_peered":"2024-09-13T17:14:27.548107+0000","last_unstale":"2024-09-13T17:14:27.552402+0000","last_undegraded":"2024-09-13T17:14:27.552402+0000","last_fullsized":"2024-09-13T17:14:27.552402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:06.491166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548264+0000","last_change":"2024-09-13T17:14:27.179184+0000","last_active":"2024-09-13T17:14:27.548264+0000","last_peered":"2024-09-13T17:14:27.548264+0000","last_clean":"2024-09-13T17:14:27.548264+0000","last_became_active":"2024-09-13T17:14:27.178874+0000","last_became_peered":"2024-09-13T17:14:27.178874+0000","last_unstale":"2024-09-13T17:14:27.548264+0000","last_undegraded":"2024-09-13T17:14:27.548264+0000","last_fullsized":"2024-09-13T17:14:27.548264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:07.196909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.547643+0000","last_change":"2024-09-13T17:14:27.544296+0000","last_active":"2024-09-13T17:14:27.547643+0000","last_peered":"2024-09-13T17:14:27.547643+0000","last_clean":"2024-09-13T17:14:27.547643+0000","last_became_active":"2024-09-13T17:14:27.544041+0000","last_became_peered":"2024-09-13T17:14:27.544041+0000","last_unstale":"2024-09-13T17:14:27.547643+0000","last_undegraded":"2024-09-13T17:14:27.547643+0000","last_fullsized":"2024-09-13T17:14:27.547643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:01.914947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554374+0000","last_change":"2024-09-13T17:14:27.180947+0000","last_active":"2024-09-13T17:14:27.554374+0000","last_peered":"2024-09-13T17:14:27.554374+0000","last_clean":"2024-09-13T17:14:27.554374+0000","last_became_active":"2024-09-13T17:14:27.180683+0000","last_became_peered":"2024-09-13T17:14:27.180683+0000","last_unstale":"2024-09-13T17:14:27.554374+0000","last_undegraded":"2024-09-13T17:14:27.554374+0000","last_fullsized":"2024-09-13T17:14:27.554374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.545066+0000","last_change":"2024-09-13T17:14:27.543910+0000","last_active":"2024-09-13T17:14:27.545066+0000","last_peered":"2024-09-13T17:14:27.545066+0000","last_clean":"2024-09-13T17:14:27.545066+0000","last_became_active":"2024-09-13T17:14:27.543256+0000","last_became_peered":"2024-09-13T17:14:27.543256+0000","last_unstale":"2024-09-13T17:14:27.545066+0000","last_undegraded":"2024-09-13T17:14:27.545066+0000","last_fullsized":"2024-09-13T17:14:27.545066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:40.135082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.555600+0000","last_change":"2024-09-13T17:14:27.172607+0000","last_active":"2024-09-13T17:14:27.555600+0000","last_peered":"2024-09-13T17:14:27.555600+0000","last_clean":"2024-09-13T17:14:27.555600+0000","last_became_active":"2024-09-13T17:14:27.172347+0000","last_became_peered":"2024-09-13T17:14:27.172347+0000","last_unstale":"2024-09-13T17:14:27.555600+0000","last_undegraded":"2024-09-13T17:14:27.555600+0000","last_fullsized":"2024-09-13T17:14:27.555600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:36.824007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554135+0000","last_change":"2024-09-13T17:14:27.546982+0000","last_active":"2024-09-13T17:14:27.554135+0000","last_peered":"2024-09-13T17:14:27.554135+0000","last_clean":"2024-09-13T17:14:27.554135+0000","last_became_active":"2024-09-13T17:14:27.546748+0000","last_became_peered":"2024-09-13T17:14:27.546748+0000","last_unstale":"2024-09-13T17:14:27.554135+0000","last_undegraded":"2024-09-13T17:14:27.554135+0000","last_fullsized":"2024-09-13T17:14:27.554135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.534026+0000","last_change":"2024-09-13T17:14:27.182516+0000","last_active":"2024-09-13T17:14:27.534026+0000","last_peered":"2024-09-13T17:14:27.534026+0000","last_clean":"2024-09-13T17:14:27.534026+0000","last_became_active":"2024-09-13T17:14:27.182251+0000","last_became_peered":"2024-09-13T17:14:27.182251+0000","last_unstale":"2024-09-13T17:14:27.534026+0000","last_undegraded":"2024-09-13T17:14:27.534026+0000","last_fullsized":"2024-09-13T17:14:27.534026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:18.206032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.547298+0000","last_change":"2024-09-13T17:14:27.544487+0000","last_active":"2024-09-13T17:14:27.547298+0000","last_peered":"2024-09-13T17:14:27.547298+0000","last_clean":"2024-09-13T17:14:27.547298+0000","last_became_active":"2024-09-13T17:14:27.544143+0000","last_became_peered":"2024-09-13T17:14:27.544143+0000","last_unstale":"2024-09-13T17:14:27.547298+0000","last_undegraded":"2024-09-13T17:14:27.547298+0000","last_fullsized":"2024-09-13T17:14:27.547298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:35.878166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.554974+0000","last_change":"2024-09-13T17:14:27.176577+0000","last_active":"2024-09-13T17:14:27.554974+0000","last_peered":"2024-09-13T17:14:27.554974+0000","last_clean":"2024-09-13T17:14:27.554974+0000","last_became_active":"2024-09-13T17:14:27.176318+0000","last_became_peered":"2024-09-13T17:14:27.176318+0000","last_unstale":"2024-09-13T17:14:27.554974+0000","last_undegraded":"2024-09-13T17:14:27.554974+0000","last_fullsized":"2024-09-13T17:14:27.554974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.546826+0000","last_change":"2024-09-13T17:14:27.545058+0000","last_active":"2024-09-13T17:14:27.546826+0000","last_peered":"2024-09-13T17:14:27.546826+0000","last_clean":"2024-09-13T17:14:27.546826+0000","last_became_active":"2024-09-13T17:14:27.544612+0000","last_became_peered":"2024-09-13T17:14:27.544612+0000","last_unstale":"2024-09-13T17:14:27.546826+0000","last_undegraded":"2024-09-13T17:14:27.546826+0000","last_fullsized":"2024-09-13T17:14:27.546826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:47.443074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.538657+0000","last_change":"2024-09-13T17:14:27.175822+0000","last_active":"2024-09-13T17:14:27.538657+0000","last_peered":"2024-09-13T17:14:27.538657+0000","last_clean":"2024-09-13T17:14:27.538657+0000","last_became_active":"2024-09-13T17:14:27.175513+0000","last_became_peered":"2024-09-13T17:14:27.175513+0000","last_unstale":"2024-09-13T17:14:27.538657+0000","last_undegraded":"2024-09-13T17:14:27.538657+0000","last_fullsized":"2024-09-13T17:14:27.538657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:34.503719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.556591+0000","last_change":"2024-09-13T17:14:27.554887+0000","last_active":"2024-09-13T17:14:27.556591+0000","last_peered":"2024-09-13T17:14:27.556591+0000","last_clean":"2024-09-13T17:14:27.556591+0000","last_became_active":"2024-09-13T17:14:27.554283+0000","last_became_peered":"2024-09-13T17:14:27.554283+0000","last_unstale":"2024-09-13T17:14:27.556591+0000","last_undegraded":"2024-09-13T17:14:27.556591+0000","last_fullsized":"2024-09-13T17:14:27.556591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.537618+0000","last_change":"2024-09-13T17:14:27.177681+0000","last_active":"2024-09-13T17:14:27.537618+0000","last_peered":"2024-09-13T17:14:27.537618+0000","last_clean":"2024-09-13T17:14:27.537618+0000","last_became_active":"2024-09-13T17:14:27.177376+0000","last_became_peered":"2024-09-13T17:14:27.177376+0000","last_unstale":"2024-09-13T17:14:27.537618+0000","last_undegraded":"2024-09-13T17:14:27.537618+0000","last_fullsized":"2024-09-13T17:14:27.537618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550556+0000","last_change":"2024-09-13T17:14:27.545929+0000","last_active":"2024-09-13T17:14:27.550556+0000","last_peered":"2024-09-13T17:14:27.550556+0000","last_clean":"2024-09-13T17:14:27.550556+0000","last_became_active":"2024-09-13T17:14:27.545652+0000","last_became_peered":"2024-09-13T17:14:27.545652+0000","last_unstale":"2024-09-13T17:14:27.550556+0000","last_undegraded":"2024-09-13T17:14:27.550556+0000","last_fullsized":"2024-09-13T17:14:27.550556+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:22.945646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.538149+0000","last_change":"2024-09-13T17:14:27.172367+0000","last_active":"2024-09-13T17:14:27.538149+0000","last_peered":"2024-09-13T17:14:27.538149+0000","last_clean":"2024-09-13T17:14:27.538149+0000","last_became_active":"2024-09-13T17:14:27.172106+0000","last_became_peered":"2024-09-13T17:14:27.172106+0000","last_unstale":"2024-09-13T17:14:27.538149+0000","last_undegraded":"2024-09-13T17:14:27.538149+0000","last_fullsized":"2024-09-13T17:14:27.538149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:18.191040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.550910+0000","last_change":"2024-09-13T17:14:27.550315+0000","last_active":"2024-09-13T17:14:27.550910+0000","last_peered":"2024-09-13T17:14:27.550910+0000","last_clean":"2024-09-13T17:14:27.550910+0000","last_became_active":"2024-09-13T17:14:27.546576+0000","last_became_peered":"2024-09-13T17:14:27.546576+0000","last_unstale":"2024-09-13T17:14:27.550910+0000","last_undegraded":"2024-09-13T17:14:27.550910+0000","last_fullsized":"2024-09-13T17:14:27.550910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.552589+0000","last_change":"2024-09-13T17:14:27.180268+0000","last_active":"2024-09-13T17:14:27.552589+0000","last_peered":"2024-09-13T17:14:27.552589+0000","last_clean":"2024-09-13T17:14:27.552589+0000","last_became_active":"2024-09-13T17:14:27.180020+0000","last_became_peered":"2024-09-13T17:14:27.180020+0000","last_unstale":"2024-09-13T17:14:27.552589+0000","last_undegraded":"2024-09-13T17:14:27.552589+0000","last_fullsized":"2024-09-13T17:14:27.552589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:46.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.557706+0000","last_change":"2024-09-13T17:14:27.556359+0000","last_active":"2024-09-13T17:14:27.557706+0000","last_peered":"2024-09-13T17:14:27.557706+0000","last_clean":"2024-09-13T17:14:27.557706+0000","last_became_active":"2024-09-13T17:14:27.556100+0000","last_became_peered":"2024-09-13T17:14:27.556100+0000","last_unstale":"2024-09-13T17:14:27.557706+0000","last_undegraded":"2024-09-13T17:14:27.557706+0000","last_fullsized":"2024-09-13T17:14:27.557706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:01.728939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T17:14:29.170226+0000","last_change":"2024-09-13T17:14:27.177225+0000","last_active":"2024-09-13T17:14:29.170226+0000","last_peered":"2024-09-13T17:14:29.170226+0000","last_clean":"2024-09-13T17:14:29.170226+0000","last_became_active":"2024-09-13T17:14:27.176960+0000","last_became_peered":"2024-09-13T17:14:27.176960+0000","last_unstale":"2024-09-13T17:14:29.170226+0000","last_undegraded":"2024-09-13T17:14:29.170226+0000","last_fullsized":"2024-09-13T17:14:29.170226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:41.329533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.541344+0000","last_change":"2024-09-13T17:14:27.535437+0000","last_active":"2024-09-13T17:14:27.541344+0000","last_peered":"2024-09-13T17:14:27.541344+0000","last_clean":"2024-09-13T17:14:27.541344+0000","last_became_active":"2024-09-13T17:14:27.535199+0000","last_became_peered":"2024-09-13T17:14:27.535199+0000","last_unstale":"2024-09-13T17:14:27.541344+0000","last_undegraded":"2024-09-13T17:14:27.541344+0000","last_fullsized":"2024-09-13T17:14:27.541344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:53.189965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.533712+0000","last_change":"2024-09-13T17:14:27.179591+0000","last_active":"2024-09-13T17:14:27.533712+0000","last_peered":"2024-09-13T17:14:27.533712+0000","last_clean":"2024-09-13T17:14:27.533712+0000","last_became_active":"2024-09-13T17:14:27.179239+0000","last_became_peered":"2024-09-13T17:14:27.179239+0000","last_unstale":"2024-09-13T17:14:27.533712+0000","last_undegraded":"2024-09-13T17:14:27.533712+0000","last_fullsized":"2024-09-13T17:14:27.533712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:01.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.548422+0000","last_change":"2024-09-13T17:14:27.547290+0000","last_active":"2024-09-13T17:14:27.548422+0000","last_peered":"2024-09-13T17:14:27.548422+0000","last_clean":"2024-09-13T17:14:27.548422+0000","last_became_active":"2024-09-13T17:14:27.547054+0000","last_became_peered":"2024-09-13T17:14:27.547054+0000","last_unstale":"2024-09-13T17:14:27.548422+0000","last_undegraded":"2024-09-13T17:14:27.548422+0000","last_fullsized":"2024-09-13T17:14:27.548422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:01.977874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.533532+0000","last_change":"2024-09-13T17:14:27.177799+0000","last_active":"2024-09-13T17:14:27.533532+0000","last_peered":"2024-09-13T17:14:27.533532+0000","last_clean":"2024-09-13T17:14:27.533532+0000","last_became_active":"2024-09-13T17:14:27.177488+0000","last_became_peered":"2024-09-13T17:14:27.177488+0000","last_unstale":"2024-09-13T17:14:27.533532+0000","last_undegraded":"2024-09-13T17:14:27.533532+0000","last_fullsized":"2024-09-13T17:14:27.533532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:05.126258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.551129+0000","last_change":"2024-09-13T17:14:27.550158+0000","last_active":"2024-09-13T17:14:27.551129+0000","last_peered":"2024-09-13T17:14:27.551129+0000","last_clean":"2024-09-13T17:14:27.551129+0000","last_became_active":"2024-09-13T17:14:27.549915+0000","last_became_peered":"2024-09-13T17:14:27.549915+0000","last_unstale":"2024-09-13T17:14:27.551129+0000","last_undegraded":"2024-09-13T17:14:27.551129+0000","last_fullsized":"2024-09-13T17:14:27.551129+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:32.926879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.539162+0000","last_change":"2024-09-13T17:14:27.180015+0000","last_active":"2024-09-13T17:14:27.539162+0000","last_peered":"2024-09-13T17:14:27.539162+0000","last_clean":"2024-09-13T17:14:27.539162+0000","last_became_active":"2024-09-13T17:14:27.179758+0000","last_became_peered":"2024-09-13T17:14:27.179758+0000","last_unstale":"2024-09-13T17:14:27.539162+0000","last_undegraded":"2024-09-13T17:14:27.539162+0000","last_fullsized":"2024-09-13T17:14:27.539162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:57.492040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.551019+0000","last_change":"2024-09-13T17:14:27.546262+0000","last_active":"2024-09-13T17:14:27.551019+0000","last_peered":"2024-09-13T17:14:27.551019+0000","last_clean":"2024-09-13T17:14:27.551019+0000","last_became_active":"2024-09-13T17:14:27.545977+0000","last_became_peered":"2024-09-13T17:14:27.545977+0000","last_unstale":"2024-09-13T17:14:27.551019+0000","last_undegraded":"2024-09-13T17:14:27.551019+0000","last_fullsized":"2024-09-13T17:14:27.551019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.703286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.531294+0000","last_change":"2024-09-13T17:14:27.178335+0000","last_active":"2024-09-13T17:14:27.531294+0000","last_peered":"2024-09-13T17:14:27.531294+0000","last_clean":"2024-09-13T17:14:27.531294+0000","last_became_active":"2024-09-13T17:14:27.178083+0000","last_became_peered":"2024-09-13T17:14:27.178083+0000","last_unstale":"2024-09-13T17:14:27.531294+0000","last_undegraded":"2024-09-13T17:14:27.531294+0000","last_fullsized":"2024-09-13T17:14:27.531294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:00.726954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.557686+0000","last_change":"2024-09-13T17:14:27.555917+0000","last_active":"2024-09-13T17:14:27.557686+0000","last_peered":"2024-09-13T17:14:27.557686+0000","last_clean":"2024-09-13T17:14:27.557686+0000","last_became_active":"2024-09-13T17:14:27.555544+0000","last_became_peered":"2024-09-13T17:14:27.555544+0000","last_unstale":"2024-09-13T17:14:27.557686+0000","last_undegraded":"2024-09-13T17:14:27.557686+0000","last_fullsized":"2024-09-13T17:14:27.557686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:06.128243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.529317+0000","last_change":"2024-09-13T17:14:27.180128+0000","last_active":"2024-09-13T17:14:27.529317+0000","last_peered":"2024-09-13T17:14:27.529317+0000","last_clean":"2024-09-13T17:14:27.529317+0000","last_became_active":"2024-09-13T17:14:27.179842+0000","last_became_peered":"2024-09-13T17:14:27.179842+0000","last_unstale":"2024-09-13T17:14:27.529317+0000","last_undegraded":"2024-09-13T17:14:27.529317+0000","last_fullsized":"2024-09-13T17:14:27.529317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:50.591272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.553568+0000","last_change":"2024-09-13T17:14:27.548659+0000","last_active":"2024-09-13T17:14:27.553568+0000","last_peered":"2024-09-13T17:14:27.553568+0000","last_clean":"2024-09-13T17:14:27.553568+0000","last_became_active":"2024-09-13T17:14:27.548391+0000","last_became_peered":"2024-09-13T17:14:27.548391+0000","last_unstale":"2024-09-13T17:14:27.553568+0000","last_undegraded":"2024-09-13T17:14:27.553568+0000","last_fullsized":"2024-09-13T17:14:27.553568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:27.158922+0000","last_clean_scrub_stamp":"2024-09-13T17:14:27.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:48.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.538218+0000","last_change":"2024-09-13T17:14:27.181872+0000","last_active":"2024-09-13T17:14:27.538218+0000","last_peered":"2024-09-13T17:14:27.538218+0000","last_clean":"2024-09-13T17:14:27.538218+0000","last_became_active":"2024-09-13T17:14:27.181519+0000","last_became_peered":"2024-09-13T17:14:27.181519+0000","last_unstale":"2024-09-13T17:14:27.538218+0000","last_undegraded":"2024-09-13T17:14:27.538218+0000","last_fullsized":"2024-09-13T17:14:27.538218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:14:26.156937+0000","last_clean_scrub_stamp":"2024-09-13T17:14:26.156937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:13.569407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:14:27.536251+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:14:27.536251+0000","last_peered":"2024-09-13T17:14:27.536251+0000","last_clean":"2024-09-13T17:14:27.536251+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:14:27.536251+0000","last_undegraded":"2024-09-13T17:14:27.536251+0000","last_fullsized":"2024-09-13T17:14:27.536251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":199360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.435},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.502},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":198890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.504}]},{"osd":1,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":199382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":479232,"data_stored":200376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.28799999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":466944,"data_stored":198848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.189},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.222}]},{"osd":3,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.23200000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:14:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.625},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":466944,"data_stored":198868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.374}]},{"osd":4,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.502}]},{"osd":5,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.441}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1060864,"data_stored":789180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.317},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.498},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.44},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.434}]},{"osd":6,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.40000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:14:35.217 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:14:35.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:14:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.360+0000 7f50450d0640 1 Processor -- start 2024-09-13T17:14:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.360+0000 7f50450d0640 1 -- start start 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f50450d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50400abe60 0x7f50400b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f50450d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504006da30 0x7f504006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f50450d0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400ad050 con 0x7f50401591e0 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f50450d0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504006e400 con 0x7f50400abe60 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f50450d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ac440 con 0x7f504006da30 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f503e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50400abe60 0x7f50400b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f503e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50400abe60 0x7f50400b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46246/0 (socket says 172.21.15.5:46246) 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.361+0000 7f503e59c640 1 -- 172.21.15.5:0/1295193705 learned_addr learned my addr 172.21.15.5:0/1295193705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503f59e640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504006da30 0x7f504006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503e59c640 1 -- 172.21.15.5:0/1295193705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504006da30 msgr2=0x7f504006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503e59c640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504006da30 0x7f504006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503e59c640 1 -- 172.21.15.5:0/1295193705 >> v1:172.21.15.179:6789/0 conn(0x7f50401591e0 legacy=0x7f50400ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503e59c640 1 -- 172.21.15.5:0/1295193705 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400ac720 con 0x7f50400abe60 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.362+0000 7f503e59c640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f50400b1b30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5034009870 tx=0x7f503402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41c749cbfe92463 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f503dd9b640 1 -- 172.21.15.5:0/1295193705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034032440 con 0x7f50400abe60 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f503dd9b640 1 -- 172.21.15.5:0/1295193705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340325a0 con 0x7f50400abe60 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f503dd9b640 1 -- 172.21.15.5:0/1295193705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034032930 con 0x7f50400abe60 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 -- 172.21.15.5:0/1295193705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 msgr2=0x7f50400b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f50400b1b30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5034009870 tx=0x7f503402a270 comp rx=0 tx=0).stop 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 -- 172.21.15.5:0/1295193705 shutdown_connections 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f504006da30 0x7f504006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 --2- 172.21.15.5:0/1295193705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f50400b1b30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 -- 172.21.15.5:0/1295193705 >> 172.21.15.5:0/1295193705 conn(0x7f50400ce130 msgr2=0x7f50400ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 -- 172.21.15.5:0/1295193705 shutdown_connections 2024-09-13T17:14:35.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.363+0000 7f50450d0640 1 -- 172.21.15.5:0/1295193705 wait complete. 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 Processor -- start 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 -- start start 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504006da30 0x7f504014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50401591e0 0x7f504014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504015a350 con 0x7f50400abe60 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504015a630 con 0x7f504006da30 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f50450d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504015a910 con 0x7f50401591e0 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f503e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f503e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46256/0 (socket says 172.21.15.5:46256) 2024-09-13T17:14:35.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.365+0000 7f503e59c640 1 -- 172.21.15.5:0/2133476071 learned_addr learned my addr 172.21.15.5:0/2133476071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503f59e640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50401591e0 0x7f504014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503ed9d640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504006da30 0x7f504014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 -- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50401591e0 msgr2=0x7f504014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50401591e0 0x7f504014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 -- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504006da30 msgr2=0x7f504014eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504006da30 0x7f504014eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 -- 172.21.15.5:0/2133476071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340094d0 con 0x7f50400abe60 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f503e59c640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5034000c00 tx=0x7f50340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034032440 con 0x7f50400abe60 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034030b80 con 0x7f50400abe60 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504015abf0 con 0x7f50400abe60 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503403d440 con 0x7f50400abe60 2024-09-13T17:14:35.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.366+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504014f1e0 con 0x7f50400abe60 2024-09-13T17:14:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.367+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504015b110 con 0x7f50400abe60 2024-09-13T17:14:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.368+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5034039040 con 0x7f50400abe60 2024-09-13T17:14:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.368+0000 7f50277fe640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.368+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f50340a9f30 con 0x7f50400abe60 2024-09-13T17:14:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.368+0000 7f503ed9d640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.369+0000 7f503ed9d640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 0x7f502c06d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5030001f10 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.372+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f504015b110 con 0x7f50400abe60 2024-09-13T17:14:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.608+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f504015b110 con 0x7f50400abe60 2024-09-13T17:14:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.611+0000 7f50277fe640 1 -- 172.21.15.5:0/2133476071 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f504015b110 con 0x7f50400abe60 2024-09-13T17:14:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 msgr2=0x7f502c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 0x7f502c06d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5030001f10 tx=0x7f5030009040 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 msgr2=0x7f504014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5034000c00 tx=0x7f50340046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 shutdown_connections 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50401591e0 0x7f504014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50400abe60 0x7f504014cee0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 --2- 172.21.15.5:0/2133476071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f504006da30 0x7f504014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 >> 172.21.15.5:0/2133476071 conn(0x7f50400ce130 msgr2=0x7f504015ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 shutdown_connections 2024-09-13T17:14:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.613+0000 7f50450d0640 1 -- 172.21.15.5:0/2133476071 wait complete. 2024-09-13T17:14:35.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.725+0000 7f70a6795640 1 Processor -- start 2024-09-13T17:14:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 -- start start 2024-09-13T17:14:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f70a015a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f70a00b1080 0x7f70a006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a00b2390 con 0x7f70a006dff0 2024-09-13T17:14:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a006e4a0 con 0x7f70a00b1080 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.726+0000 7f70a6795640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b14c0 con 0x7f70a0156f40 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f70a4d32640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70a006dff0 0x7f70a00abec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52432/0 (socket says 172.21.15.5:52432) 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f70a4d32640 1 -- 172.21.15.5:0/846736920 learned_addr learned my addr 172.21.15.5:0/846736920 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709ffff640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f70a015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709f7fe640 1 --2- 172.21.15.5:0/846736920 >> v2:172.21.15.179:3300/0 conn(0x7f70a00b1080 0x7f70a006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110591968 0 0) 0x7f70a00b2390 con 0x7f70a006dff0 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088003520 con 0x7f70a006dff0 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595263459 0 0) 0x7f7088003520 con 0x7f70a006dff0 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 msgr2=0x7f70a015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f70a015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 >> v2:172.21.15.179:3300/0 conn(0x7f70a00b1080 msgr2=0x7f70a006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 --2- 172.21.15.5:0/846736920 >> v2:172.21.15.179:3300/0 conn(0x7f70a00b1080 0x7f70a006dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00b1780 con 0x7f70a006dff0 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f70980019f0 con 0x7f70a006dff0 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 >> v1:172.21.15.5:6789/0 conn(0x7f70a006dff0 legacy=0x7f70a00abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7088003970 0x7f7088003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f7088004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f7088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a006e4a0 con 0x7f70880047c0 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b14c0 con 0x7f7088003970 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708800b980 con 0x7f70a0156f40 2024-09-13T17:14:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709f7fe640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f7088004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f709ffff640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7088003970 0x7f7088003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.727+0000 7f70a4d32640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f7088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 -- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 msgr2=0x7f7088005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a0156f40 0x7f7088005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 -- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7088003970 msgr2=0x7f7088003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7088003970 0x7f7088003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 -- 172.21.15.5:0/846736920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088003520 con 0x7f70880047c0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709f7fe640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f7088004c40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a90 tx=0x7f70880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda3da3a0a0c88a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094031400 con 0x7f70880047c0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709402d050 con 0x7f70880047c0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.728+0000 7f709effd640 1 -- 172.21.15.5:0/846736920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940317a0 con 0x7f70880047c0 2024-09-13T17:14:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 -- 172.21.15.5:0/846736920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 msgr2=0x7f7088004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 --2- 172.21.15.5:0/846736920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f7088004c40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7094009a90 tx=0x7f70880057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a4d32640 1 -- 172.21.15.5:0/846736920 reap_dead start 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 -- 172.21.15.5:0/846736920 shutdown_connections 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 -- 172.21.15.5:0/846736920 >> 172.21.15.5:0/846736920 conn(0x7f70a00ce0d0 msgr2=0x7f70a00ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 -- 172.21.15.5:0/846736920 shutdown_connections 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.729+0000 7f70a6795640 1 -- 172.21.15.5:0/846736920 wait complete. 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.730+0000 7f70a6795640 1 Processor -- start 2024-09-13T17:14:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.730+0000 7f70a6795640 1 -- start start 2024-09-13T17:14:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70a0145df0 0x7f70a00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a00af340 0x7f70a01f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0143b00 con 0x7f70880047c0 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00ae9e0 con 0x7f70a0145df0 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a6795640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0158c40 con 0x7f70a00af340 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f709ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f709ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46284/0 (socket says 172.21.15.5:46284) 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f709ffff640 1 -- 172.21.15.5:0/3591785733 learned_addr learned my addr 172.21.15.5:0/3591785733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f709f7fe640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70a0145df0 0x7f70a00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.731+0000 7f70a4d32640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a00af340 0x7f70a01f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 -- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a00af340 msgr2=0x7f70a01f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a00af340 0x7f70a01f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 -- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70a0145df0 msgr2=0x7f70a00aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70a0145df0 0x7f70a00aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 -- 172.21.15.5:0/3591785733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0158f20 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709ffff640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f70900118e0 tx=0x7f7090011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000f9d0 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000fb30 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a00ae600 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000fec0 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.732+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a00af7c0 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.733+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00672a0 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.733+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7090014440 con 0x7f70880047c0 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.734+0000 7f709cff9640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 0x7f708c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.734+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7090089a20 con 0x7f70880047c0 2024-09-13T17:14:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.734+0000 7f709f7fe640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 0x7f708c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.735+0000 7f709f7fe640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 0x7f708c06d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7094033000 tx=0x7f7094008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.738+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7090054ac0 con 0x7f70880047c0 2024-09-13T17:14:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.942+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70a006c2a0 con 0x7f70880047c0 2024-09-13T17:14:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.942+0000 7f709cff9640 1 -- 172.21.15.5:0/3591785733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f70900580e0 con 0x7f70880047c0 2024-09-13T17:14:35.944 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:35.944 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:14:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.944+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 msgr2=0x7f708c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 0x7f708c06d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7094033000 tx=0x7f7094008030 comp rx=0 tx=0).stop 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 msgr2=0x7f70a01458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f70900118e0 tx=0x7f7090011ce0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 shutdown_connections 2024-09-13T17:14:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70a00af340 0x7f70a01f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70a0145df0 0x7f70a00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f708c06ac30 0x7f708c06d0f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 --2- 172.21.15.5:0/3591785733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70880047c0 0x7f70a01458b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 >> 172.21.15.5:0/3591785733 conn(0x7f70a00ce0d0 msgr2=0x7f70a01592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 shutdown_connections 2024-09-13T17:14:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:35.945+0000 7f70a6795640 1 -- 172.21.15.5:0/3591785733 wait complete. 2024-09-13T17:14:36.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:14:27.525963+0000', 'modified': '2024-09-13T17:14:29.532867+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5478': {'gid': 5478, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1510530790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1510530790}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1510530790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:14:36.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:14:36.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:14:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.466+0000 7f20ca896640 1 Processor -- start 2024-09-13T17:14:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.466+0000 7f20ca896640 1 -- start start 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20ca896640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f20c406eaf0 0x7f20c40b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20ca896640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20c406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20ca896640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40b35f0 con 0x7f20c40b1ac0 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20ca896640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c415d140 con 0x7f20c406eaf0 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20ca896640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4160020 con 0x7f20c406eed0 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20c40b1ac0 0x7f20c415ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52440/0 (socket says 172.21.15.5:52440) 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c37fe640 1 -- 172.21.15.5:0/2837175903 learned_addr learned my addr 172.21.15.5:0/2837175903 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c8e33640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20c406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2837175903 >> v2:172.21.15.179:3300/0 conn(0x7f20c406eaf0 0x7f20c40b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799365636 0 0) 0x7f20c40b35f0 con 0x7f20c40b1ac0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ac003520 con 0x7f20c40b1ac0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266575775 0 0) 0x7f20ac003520 con 0x7f20c40b1ac0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 msgr2=0x7f20c406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20c406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 >> v2:172.21.15.179:3300/0 conn(0x7f20c406eaf0 msgr2=0x7f20c40b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 --2- 172.21.15.5:0/2837175903 >> v2:172.21.15.179:3300/0 conn(0x7f20c406eaf0 0x7f20c40b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4156f50 con 0x7f20c40b1ac0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.467+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f20b8001670 con 0x7f20c40b1ac0 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 >> v1:172.21.15.5:6789/0 conn(0x7f20c40b1ac0 legacy=0x7f20c415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac003970 0x7f20ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac0047c0 0x7f20ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4160020 con 0x7f20ac003970 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac00b980 con 0x7f20ac0047c0 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac00bac0 con 0x7f20c406eed0 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac003970 0x7f20ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c37fe640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac0047c0 0x7f20ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c8e33640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 -- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 msgr2=0x7f20ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c406eed0 0x7f20ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 -- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac0047c0 msgr2=0x7f20ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac0047c0 0x7f20ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.468+0000 7f20c3fff640 1 -- 172.21.15.5:0/2837175903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac003520 con 0x7f20ac003970 2024-09-13T17:14:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac003970 0x7f20ac003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009ac0 tx=0x7f20ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5ee9f7f12b4f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4031400 con 0x7f20ac003970 2024-09-13T17:14:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b402d050 con 0x7f20ac003970 2024-09-13T17:14:36.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20c2ffd640 1 -- 172.21.15.5:0/2837175903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4031780 con 0x7f20ac003970 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20ca896640 1 -- 172.21.15.5:0/2837175903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac003970 msgr2=0x7f20ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20ca896640 1 --2- 172.21.15.5:0/2837175903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac003970 0x7f20ac003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009ac0 tx=0x7f20ac0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.469+0000 7f20c8e33640 1 -- 172.21.15.5:0/2837175903 reap_dead start 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.470+0000 7f20ca896640 1 -- 172.21.15.5:0/2837175903 shutdown_connections 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.470+0000 7f20ca896640 1 -- 172.21.15.5:0/2837175903 >> 172.21.15.5:0/2837175903 conn(0x7f20c4070af0 msgr2=0x7f20c4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.470+0000 7f20ca896640 1 -- 172.21.15.5:0/2837175903 shutdown_connections 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.470+0000 7f20ca896640 1 -- 172.21.15.5:0/2837175903 wait complete. 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.471+0000 7f20ca896640 1 Processor -- start 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.471+0000 7f20ca896640 1 -- start start 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac003970 0x7f20c406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c4144e40 0x7f20c41452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4146550 con 0x7f20c406a050 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4145c20 con 0x7f20ac003970 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4145f00 con 0x7f20c4144e40 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46294/0 (socket says 172.21.15.5:46294) 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 -- 172.21.15.5:0/3767214859 learned_addr learned my addr 172.21.15.5:0/3767214859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c8e33640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c4144e40 0x7f20c41452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac003970 0x7f20c406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 -- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c4144e40 msgr2=0x7f20c41452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c4144e40 0x7f20c41452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 -- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac003970 msgr2=0x7f20c406d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac003970 0x7f20c406d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 -- 172.21.15.5:0/3767214859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c41461e0 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c37fe640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004f40 tx=0x7f20b80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c0ff9640 1 -- 172.21.15.5:0/3767214859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800f6d0 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20c0ff9640 1 -- 172.21.15.5:0/3767214859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800f870 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.472+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c4143940 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.473+0000 7f20c0ff9640 1 -- 172.21.15.5:0/3767214859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800fc20 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.473+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c406d8b0 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.474+0000 7f20c0ff9640 1 -- 172.21.15.5:0/3767214859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20b800fd80 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.474+0000 7f20c0ff9640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 0x7f20b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.475+0000 7f20c0ff9640 1 -- 172.21.15.5:0/3767214859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20b80891e0 con 0x7f20c406a050 2024-09-13T17:14:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.475+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 0x7f20b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.475+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 0x7f20b006d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20b4033000 tx=0x7f20b4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.475+0000 7f20cd1fd740 1 Processor -- start 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.475+0000 7f20cd1fd740 1 -- start start 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x563828404ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638283117c0 con 0x5638283b4860 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563828320b70 con 0x5638283de550 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56382831e300 con 0x5638283b70a0 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46302/0 (socket says 172.21.15.5:46302) 2024-09-13T17:14:36.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20c37fe640 1 -- 172.21.15.5:0/1347450182 learned_addr learned my addr 172.21.15.5:0/1347450182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20c3fff640 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.476+0000 7f20c8e33640 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x563828404ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 -- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 msgr2=0x5638283b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 -- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 msgr2=0x563828404ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x563828404ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 -- 172.21.15.5:0/1347450182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638282a64b0 con 0x5638283b4860 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004fd0 tx=0x7f20b8057c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10753bd0bf7f8ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20a9ffb640 1 -- 172.21.15.5:0/1347450182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b805bd60 con 0x5638283b4860 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20a9ffb640 1 -- 172.21.15.5:0/1347450182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8060320 con 0x5638283b4860 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20a9ffb640 1 -- 172.21.15.5:0/1347450182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80546f0 con 0x5638283b4860 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1347450182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 msgr2=0x563828404570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004fd0 tx=0x7f20b8057c50 comp rx=0 tx=0).stop 2024-09-13T17:14:36.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1347450182 shutdown_connections 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x563828404ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b4860 0x563828404570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1347450182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.477+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1347450182 >> 172.21.15.5:0/1347450182 conn(0x5638283b37d0 msgr2=0x5638283fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.478+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1347450182 shutdown_connections 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.478+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1347450182 wait complete. 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.478+0000 7f20cd1fd740 1 -- start start 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.478+0000 7f20cd1fd740 1 Processor -- start 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563828319bf0 con 0x5638283b70a0 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638282d8250 con 0x5638283de550 2024-09-13T17:14:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638282d7ef0 con 0x5638283ddb40 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20cd1fd740 10 client.0 _ll_register_callbacks cb 0x56382830a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46304/0 (socket says 172.21.15.5:46304) 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20c3fff640 1 -- 172.21.15.5:0/1240786702 learned_addr learned my addr 172.21.15.5:0/1240786702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20c8e33640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.479+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 -- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 msgr2=0x5638283dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283dfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 -- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 msgr2=0x5638283c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 -- 172.21.15.5:0/1240786702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c406d8b0 con 0x5638283b70a0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20c3fff640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20b4000c00 tx=0x7f20b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a401c724516db1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:14:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4052440 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20b4042070 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56382800d3c0 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b4048410 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 10 client.5682 fetch_fsmap learned FSMap version 15 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563828318270 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382800d3c0 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f20b4045040 con 0x5638283b70a0 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 10 client.5682 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 10 client.5682 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 20 client.5682 populate_metadata read hostname 'smithi005' 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283cc100 0x5638283f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 4 client.5682 mds_command: new command op to 5478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.480+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 --> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56382801e6c0 con 0x5638283cc100 2024-09-13T17:14:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283cc100 0x5638283f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20a2ffd640 10 client.5682 ms_handle_connect on v2:172.21.15.5:6832/1510530790 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20c37fe640 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283cc100 0x5638283f91f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50aa961e9c22181 server_cookie=6a036c76658349e in_seq=0 out_seq=0 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20a2ffd640 1 -- 172.21.15.5:0/1240786702 <== mds.0 v2:172.21.15.5:6832/1510530790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56382801e6c0 con 0x5638283cc100 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20a2ffd640 10 client.5682 handle_command_reply: tid=0 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.481+0000 7f20cd1fd740 1 client.5682 shutdown 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 msgr2=0x5638283c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20b4000c00 tx=0x7f20b40046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 shutdown_connections 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283cc100 0x5638283f91f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20a2ffd640 0 client.5682 ms_handle_reset on v2:172.21.15.5:6832/1510530790 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/1240786702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283b70a0 0x5638283c84d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 >> 172.21.15.5:0/1240786702 conn(0x5638283b4860 msgr2=0x5638283ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 shutdown_connections 2024-09-13T17:14:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 1 -- 172.21.15.5:0/1240786702 wait complete. 2024-09-13T17:14:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.482+0000 7f20cd1fd740 20 client.5682 trim_cache size 0 max 16384 2024-09-13T17:14:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 Processor -- start 2024-09-13T17:14:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 -- start start 2024-09-13T17:14:36.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283e2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.497+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382829d460 con 0x5638283ddb40 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638283fe2d0 con 0x5638283de550 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638283cb020 con 0x5638283b70a0 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46306/0 (socket says 172.21.15.5:46306) 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 -- 172.21.15.5:0/2542555061 learned_addr learned my addr 172.21.15.5:0/2542555061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c8e33640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 -- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 msgr2=0x5638283fdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283fdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 -- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 msgr2=0x5638283e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283e2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 -- 172.21.15.5:0/2542555061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638282ba5f0 con 0x5638283ddb40 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c3fff640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c8e33640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20c37fe640 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f20b8087610 tx=0x7f20b805e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f862b5b4527275 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20aa7fc640 1 -- 172.21.15.5:0/2542555061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8056380 con 0x5638283ddb40 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20aa7fc640 1 -- 172.21.15.5:0/2542555061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80546f0 con 0x5638283ddb40 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.498+0000 7f20aa7fc640 1 -- 172.21.15.5:0/2542555061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80872c0 con 0x5638283ddb40 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- 172.21.15.5:0/2542555061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 msgr2=0x5638283e1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f20b8087610 tx=0x7f20b805e000 comp rx=0 tx=0).stop 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- 172.21.15.5:0/2542555061 shutdown_connections 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283de550 0x5638283e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283ddb40 0x5638283e1e20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/2542555061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283b70a0 0x5638283fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- 172.21.15.5:0/2542555061 >> 172.21.15.5:0/2542555061 conn(0x5638283b4860 msgr2=0x5638283c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- 172.21.15.5:0/2542555061 shutdown_connections 2024-09-13T17:14:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- 172.21.15.5:0/2542555061 wait complete. 2024-09-13T17:14:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.499+0000 7f20cd1fd740 1 -- start start 2024-09-13T17:14:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 Processor -- start 2024-09-13T17:14:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283b70a0 0x56382844bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638284660f0 con 0x5638283de550 2024-09-13T17:14:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638283dee60 con 0x5638283b70a0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638283dfac0 con 0x5638283ddb40 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20cd1fd740 10 client.0 _ll_register_callbacks cb 0x7f20b8089050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20c8e33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20c8e33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46310/0 (socket says 172.21.15.5:46310) 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20c8e33640 1 -- 172.21.15.5:0/3193400218 learned_addr learned my addr 172.21.15.5:0/3193400218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20c37fe640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.500+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283b70a0 0x56382844bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 -- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 msgr2=0x5638283df580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283df580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 -- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283b70a0 msgr2=0x56382844bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283b70a0 0x56382844bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 -- 172.21.15.5:0/3193400218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638282a64b0 con 0x5638283de550 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20c8e33640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f20c40b1ea0 tx=0x7f20bc015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758d1d5d30d3165a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00e040 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20bc003b90 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20b8060320 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20bc003d50 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 10 client.5688 fetch_fsmap learned FSMap version 15 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5638282dfd00 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8060320 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f20bc004030 con 0x5638283de550 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 10 client.5688 fetch_fsmap finished waiting for FSMap version 15 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 10 client.5688 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 20 client.5688 populate_metadata read hostname 'smithi005' 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.501+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283dc9f0 0x5638283dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 4 client.5688 mds_command: new command op to 5478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 --> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563828071d10 con 0x5638283dc9f0 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283dc9f0 0x5638283dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20c3fff640 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283dc9f0 0x5638283dcdd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd3d4d2d3239b905 server_cookie=70967a9b8c3ebf2e in_seq=0 out_seq=0 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20a2ffd640 10 client.5688 ms_handle_connect on v2:172.21.15.5:6832/1510530790 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20a2ffd640 1 -- 172.21.15.5:0/3193400218 <== mds.0 v2:172.21.15.5:6832/1510530790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563828071d10 con 0x5638283dc9f0 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20a2ffd640 10 client.5688 handle_command_reply: tid=0 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 client.5688 shutdown 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 msgr2=0x5638283e1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f20c40b1ea0 tx=0x7f20bc015760 comp rx=0 tx=0).stop 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 shutdown_connections 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:6832/1510530790,v1:172.21.15.5:6835/1510530790] conn(0x5638283dc9f0 0x5638283dcdd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638283de550 0x5638283e1da0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638283ddb40 0x5638283df580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 --2- 172.21.15.5:0/3193400218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638283b70a0 0x56382844bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20a2ffd640 0 client.5688 ms_handle_reset on v2:172.21.15.5:6832/1510530790 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 >> 172.21.15.5:0/3193400218 conn(0x5638283b4860 msgr2=0x5638283fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 shutdown_connections 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.502+0000 7f20cd1fd740 1 -- 172.21.15.5:0/3193400218 wait complete. 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20cd1fd740 20 client.5688 trim_cache size 0 max 16384 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5478, 2024-09-13T17:14:36.510 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 8.9752875949999993, 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 15, 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 40, 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 40, 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.255527743 2024-09-13T17:14:36.511 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 msgr2=0x7f20b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 0x7f20b006d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20b4033000 tx=0x7f20b4008030 comp rx=0 tx=0).stop 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 msgr2=0x7f20c406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004f40 tx=0x7f20b80074f0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 shutdown_connections 2024-09-13T17:14:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c4144e40 0x7f20c41452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b006ac00 0x7f20b006d0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c406a050 0x7f20c406a4d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 --2- 172.21.15.5:0/3767214859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20ac003970 0x7f20c406d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 >> 172.21.15.5:0/3767214859 conn(0x7f20c4070af0 msgr2=0x7f20c415dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 shutdown_connections 2024-09-13T17:14:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.503+0000 7f20ca896640 1 -- 172.21.15.5:0/3767214859 wait complete. 2024-09-13T17:14:36.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:14:36.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.615+0000 7fbf2db9d640 1 Processor -- start 2024-09-13T17:14:36.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.615+0000 7fbf2db9d640 1 -- start start 2024-09-13T17:14:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2db9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf280af070 0x7fbf280d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2db9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf280d08d0 0x7fbf280b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2db9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280d0d00 con 0x7fbf2815f920 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2db9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280af4e0 con 0x7fbf280d08d0 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2db9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280af700 con 0x7fbf280af070 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2d39c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf280d08d0 0x7fbf280b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2cb9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf2815f920 0x7fbf2806c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52454/0 (socket says 172.21.15.5:52454) 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.616+0000 7fbf2cb9b640 1 -- 172.21.15.5:0/2909243482 learned_addr learned my addr 172.21.15.5:0/2909243482 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf27fff640 1 --2- 172.21.15.5:0/2909243482 >> v2:172.21.15.179:3300/0 conn(0x7fbf280af070 0x7fbf280d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf2d39c640 1 -- 172.21.15.5:0/2909243482 >> v2:172.21.15.179:3300/0 conn(0x7fbf280af070 msgr2=0x7fbf280d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf2d39c640 1 --2- 172.21.15.5:0/2909243482 >> v2:172.21.15.179:3300/0 conn(0x7fbf280af070 0x7fbf280d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf2d39c640 1 -- 172.21.15.5:0/2909243482 >> v1:172.21.15.5:6789/0 conn(0x7fbf2815f920 legacy=0x7fbf2806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf277fe640 1 -- 172.21.15.5:0/2909243482 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733864733 0 0) 0x7fbf280d0d00 con 0x7fbf2815f920 2024-09-13T17:14:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf2d39c640 1 -- 172.21.15.5:0/2909243482 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280af9e0 con 0x7fbf280d08d0 2024-09-13T17:14:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.617+0000 7fbf2d39c640 1 --2- 172.21.15.5:0/2909243482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280d08d0 0x7fbf280b07a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbf280d0e90 tx=0x7fbf1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea91d8a8702234a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf277fe640 1 -- 172.21.15.5:0/2909243482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18032440 con 0x7fbf280d08d0 2024-09-13T17:14:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf277fe640 1 -- 172.21.15.5:0/2909243482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf180325a0 con 0x7fbf280d08d0 2024-09-13T17:14:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf277fe640 1 -- 172.21.15.5:0/2909243482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18032930 con 0x7fbf280d08d0 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 -- 172.21.15.5:0/2909243482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280d08d0 msgr2=0x7fbf280b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/2909243482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280d08d0 0x7fbf280b07a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbf280d0e90 tx=0x7fbf1802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 -- 172.21.15.5:0/2909243482 shutdown_connections 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/2909243482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280d08d0 0x7fbf280b07a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/2909243482 >> v2:172.21.15.179:3300/0 conn(0x7fbf280af070 0x7fbf280d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 -- 172.21.15.5:0/2909243482 >> 172.21.15.5:0/2909243482 conn(0x7fbf28089f90 msgr2=0x7fbf280d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 -- 172.21.15.5:0/2909243482 shutdown_connections 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.618+0000 7fbf2db9d640 1 -- 172.21.15.5:0/2909243482 wait complete. 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 Processor -- start 2024-09-13T17:14:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 -- start start 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 0x7fbf280b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 0x7fbf281f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c6f90 con 0x7fbf280af070 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b3a70 con 0x7fbf280d08d0 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.620+0000 7fbf2db9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c6310 con 0x7fbf2815f920 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46320/0 (socket says 172.21.15.5:46320) 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 -- 172.21.15.5:0/630489145 learned_addr learned my addr 172.21.15.5:0/630489145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf27fff640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 0x7fbf280b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2d39c640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 0x7fbf281f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 -- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 msgr2=0x7fbf281f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 0x7fbf281f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 -- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 msgr2=0x7fbf280b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 0x7fbf280b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 -- 172.21.15.5:0/630489145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009400 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf27fff640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 0x7fbf280b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2d39c640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 0x7fbf281f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2cb9b640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c7c0 tx=0x7fbf2000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000a640 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2000a7c0 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000ab70 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf280c65f0 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.621+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280c6bb0 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.622+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2806cfe0 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.623+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf2000acd0 con 0x7fbf280af070 2024-09-13T17:14:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.623+0000 7fbf257fa640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 0x7fbf0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.623+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbf200889b0 con 0x7fbf280af070 2024-09-13T17:14:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.624+0000 7fbf27fff640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 0x7fbf0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.624+0000 7fbf27fff640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 0x7fbf0806d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.627+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf20053a50 con 0x7fbf280af070 2024-09-13T17:14:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.836+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf280d0390 con 0x7fbf280af070 2024-09-13T17:14:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.836+0000 7fbf257fa640 1 -- 172.21.15.5:0/630489145 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbf20018020 con 0x7fbf280af070 2024-09-13T17:14:36.838 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 msgr2=0x7fbf0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 0x7fbf0806d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 msgr2=0x7fbf280c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c7c0 tx=0x7fbf2000cc80 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 shutdown_connections 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf2815f920 0x7fbf281f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280d08d0 0x7fbf280b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf0806ac00 0x7fbf0806d0c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 --2- 172.21.15.5:0/630489145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf280af070 0x7fbf280c7ef0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 >> 172.21.15.5:0/630489145 conn(0x7fbf28089f90 msgr2=0x7fbf280b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 shutdown_connections 2024-09-13T17:14:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:36.838+0000 7fbf2db9d640 1 -- 172.21.15.5:0/630489145 wait complete. 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:14:36.850 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:14:36.851 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:36.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:36.851 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:14:36.867 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:14:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:14:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:14:36.867 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42653sec preferred_lft 42653sec 2024-09-13T17:14:36.868 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:14:36.869 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.870 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:14:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:14:36.870 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:36.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:36.870 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:14:36.932 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:14:36.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:36.934 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:14:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:14:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:14:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:14:36.991 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:14:36.991 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:14:36.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:14:36.991 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:14:37.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:37.080 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:14:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:14:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:14:37.096 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:37.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:37.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:14:37.163 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:14:37.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:37.164 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:37.218 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:37.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:37.219 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:37.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:14:37.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:37.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:37.407 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:37.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:37.407 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:14:37.464 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:14:37.464 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:14:37.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:14:37.532 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:37.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:37.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:14:37.589+0000 7f4159277480 -1 init, newargv = 0x55880067e410 newargc=15 2024-09-13T17:14:37.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[52747]: starting ceph client 2024-09-13T17:14:37.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[52747]: starting fuse 2024-09-13T17:14:37.599 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:37.601 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:37.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:37.602 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:14:37.658 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:14:37.658 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:14:37.659 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:14:37.660 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:14:37.774 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.52747.asok 2024-09-13T17:14:37.960 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52747.asok 2024-09-13T17:14:37.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:37.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52747.asok status 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:14:38.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "52747", 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5706, 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 5706 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:14:38.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2035669256 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2035669256 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.5706 192.168.0.1:0/2035669256", 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2035669256", 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 15, 2024-09-13T17:14:38.099 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 40, 2024-09-13T17:14:38.100 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:14:38.100 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:14:38.100 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:14:38.100 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:14:38.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.105 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:14:38.105 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:38.122 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:14:38.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:38.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:38.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:14:38.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.328+0000 7f7c1aa87640 1 Processor -- start 2024-09-13T17:14:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.328+0000 7f7c1aa87640 1 -- start start 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c1aa87640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c14156f40 0x7f7c1415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c1aa87640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c140b1080 0x7f7c1406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c1aa87640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c140b2390 con 0x7f7c1406dff0 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c1aa87640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1406e440 con 0x7f7c140b1080 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c1aa87640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140b14c0 con 0x7f7c14156f40 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c140b1080 0x7f7c1406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c140b1080 0x7f7c1406dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46334/0 (socket says 172.21.15.5:46334) 2024-09-13T17:14:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c13fff640 1 -- 172.21.15.5:0/4290055762 learned_addr learned my addr 172.21.15.5:0/4290055762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.329+0000 7f7c18823640 1 --2- 172.21.15.5:0/4290055762 >> v2:172.21.15.179:3300/0 conn(0x7f7c14156f40 0x7f7c1415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.330+0000 7f7c13fff640 1 -- 172.21.15.5:0/4290055762 >> v2:172.21.15.179:3300/0 conn(0x7f7c14156f40 msgr2=0x7f7c1415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.330+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4290055762 >> v2:172.21.15.179:3300/0 conn(0x7f7c14156f40 0x7f7c1415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.330+0000 7f7c13fff640 1 -- 172.21.15.5:0/4290055762 >> v1:172.21.15.179:6789/0 conn(0x7f7c1406dff0 legacy=0x7f7c140abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.330+0000 7f7c13fff640 1 -- 172.21.15.5:0/4290055762 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140b1780 con 0x7f7c140b1080 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.330+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4290055762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c140b1080 0x7f7c1406dab0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406aea0 tx=0x7f7c0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c420268927c330 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c137fe640 1 -- 172.21.15.5:0/4290055762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08031600 con 0x7f7c140b1080 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c137fe640 1 -- 172.21.15.5:0/4290055762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0802d050 con 0x7f7c140b1080 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c137fe640 1 -- 172.21.15.5:0/4290055762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08031980 con 0x7f7c140b1080 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4290055762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c140b1080 msgr2=0x7f7c1406dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4290055762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c140b1080 0x7f7c1406dab0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c1406aea0 tx=0x7f7c0802a730 comp rx=0 tx=0).stop 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4290055762 shutdown_connections 2024-09-13T17:14:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4290055762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c140b1080 0x7f7c1406dab0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4290055762 >> v2:172.21.15.179:3300/0 conn(0x7f7c14156f40 0x7f7c1415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4290055762 >> 172.21.15.5:0/4290055762 conn(0x7f7c140ce0d0 msgr2=0x7f7c140ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4290055762 shutdown_connections 2024-09-13T17:14:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.331+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4290055762 wait complete. 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.332+0000 7f7c1aa87640 1 Processor -- start 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.332+0000 7f7c1aa87640 1 -- start start 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 0x7f7c141f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c14156f40 0x7f7c141f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1414b2c0 con 0x7f7c1406dff0 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1414b6c0 con 0x7f7c14156f40 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c1aa87640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1409bde0 con 0x7f7c140b1080 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c18823640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c18823640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46348/0 (socket says 172.21.15.5:46348) 2024-09-13T17:14:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.333+0000 7f7c18823640 1 -- 172.21.15.5:0/4276566650 learned_addr learned my addr 172.21.15.5:0/4276566650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 0x7f7c141f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c19024640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c14156f40 0x7f7c141f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 -- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 msgr2=0x7f7c141f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 0x7f7c141f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 -- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c14156f40 msgr2=0x7f7c141f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c14156f40 0x7f7c141f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 -- 172.21.15.5:0/4276566650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009b30 con 0x7f7c1406dff0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 0x7f7c141f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c18823640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400d5d0 tx=0x7f7c0400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c040125f0 con 0x7f7c1406dff0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04012770 con 0x7f7c1406dff0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14151840 con 0x7f7c1406dff0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04012b20 con 0x7f7c1406dff0 2024-09-13T17:14:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.334+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1414aed0 con 0x7f7c1406dff0 2024-09-13T17:14:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.335+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c140672a0 con 0x7f7c1406dff0 2024-09-13T17:14:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.336+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c04012c80 con 0x7f7c1406dff0 2024-09-13T17:14:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.336+0000 7f7c117fa640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 0x7f7c0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.336+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7c04089a20 con 0x7f7c1406dff0 2024-09-13T17:14:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.336+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 0x7f7c0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.337+0000 7f7c13fff640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 0x7f7c0006d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c08033000 tx=0x7f7c08009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.341+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c04054ac0 con 0x7f7c1406dff0 2024-09-13T17:14:38.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.548+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c1406ac20 con 0x7f7c1406dff0 2024-09-13T17:14:38.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.549+0000 7f7c117fa640 1 -- 172.21.15.5:0/4276566650 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c040580e0 con 0x7f7c1406dff0 2024-09-13T17:14:38.550 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.550+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 msgr2=0x7f7c0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.550+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 0x7f7c0006d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c08033000 tx=0x7f7c08009000 comp rx=0 tx=0).stop 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.550+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 msgr2=0x7f7c140aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.550+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400d5d0 tx=0x7f7c0400da90 comp rx=0 tx=0).stop 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 shutdown_connections 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c14156f40 0x7f7c141f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c140b1080 0x7f7c141f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c0006ac00 0x7f7c0006d0c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 --2- 172.21.15.5:0/4276566650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1406dff0 0x7f7c140aeeb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 >> 172.21.15.5:0/4276566650 conn(0x7f7c140ce0d0 msgr2=0x7f7c14069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 shutdown_connections 2024-09-13T17:14:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:38.551+0000 7f7c1aa87640 1 -- 172.21.15.5:0/4276566650 wait complete. 2024-09-13T17:14:38.563 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:14:38.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:14:38.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:14:38.563 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:14:38.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:38.564 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:14:38.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:14:38.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:14:38.564 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:14:38.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.564 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42617sec preferred_lft 42617sec 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:14:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:14:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:38.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.587 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:14:38.652 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:14:38.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.654 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:14:38.712 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:14:38.712 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:14:38.712 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:14:38.713 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:14:38.713 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:14:38.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:14:38.713 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:14:38.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.805 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:14:38.821 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:14:38.821 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:14:38.821 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:14:38.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:38.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:14:38.889 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:14:38.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:38.890 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:38.945 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:14:38.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:38.946 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:39.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:14:39.069 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:39.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:39.133 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:39.134 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:39.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:39.135 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:14:39.190 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:14:39.191 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:14:39.234 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:14:39.258 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:39.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:39.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:14:39.314+0000 7f46e8ae7480 -1 init, newargv = 0x564121bf57a0 newargc=15 2024-09-13T17:14:39.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[43783]: starting ceph client 2024-09-13T17:14:39.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[43783]: starting fuse 2024-09-13T17:14:39.325 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:39.326 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:39.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:39.327 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:14:39.383 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:14:39.383 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:14:39.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:14:39.383 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:14:39.383 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:14:39.383 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:14:39.383 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:14:39.384 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:14:39.385 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:14:39.496 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.43783.asok 2024-09-13T17:14:39.683 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43783.asok 2024-09-13T17:14:39.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:39.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43783.asok status 2024-09-13T17:14:39.817 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:14:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:14:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:14:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "43783", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 5198, 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 5198 2024-09-13T17:14:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 463971269 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 463971269 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.5198 192.168.0.1:0/463971269", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/463971269", 2024-09-13T17:14:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 15, 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 40, 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:14:39.820 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:14:39.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:39.826 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:14:39.826 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:39.842 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:14:39.842 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:39.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:39.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:39.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-13T17:14:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.025+0000 7f03f575e640 1 Processor -- start 2024-09-13T17:14:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.025+0000 7f03f575e640 1 -- start start 2024-09-13T17:14:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03f575e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03f015e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03f575e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03f006aea0 0x7f03f006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03f575e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00b1ff0 con 0x7f03f00cc730 2024-09-13T17:14:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03f575e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f006b850 con 0x7f03f006aea0 2024-09-13T17:14:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03f575e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00cd470 con 0x7f03f015a060 2024-09-13T17:14:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03ee7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03f00cc730 0x7f03f00b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52456/0 (socket says 172.21.15.5:52456) 2024-09-13T17:14:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03ee7fc640 1 -- 172.21.15.5:0/920141840 learned_addr learned my addr 172.21.15.5:0/920141840 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03eeffd640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03f015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/920141840 >> v2:172.21.15.179:3300/0 conn(0x7f03f006aea0 0x7f03f006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.026+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286196387 0 0) 0x7f03f00b1ff0 con 0x7f03f00cc730 2024-09-13T17:14:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d8003520 con 0x7f03f00cc730 2024-09-13T17:14:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202706534 0 0) 0x7f03d8003520 con 0x7f03f00cc730 2024-09-13T17:14:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 msgr2=0x7f03f015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03f015e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 >> v2:172.21.15.179:3300/0 conn(0x7f03f006aea0 msgr2=0x7f03f006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 --2- 172.21.15.5:0/920141840 >> v2:172.21.15.179:3300/0 conn(0x7f03f006aea0 0x7f03f006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00cceb0 con 0x7f03f00cc730 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f03e4001670 con 0x7f03f00cc730 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 >> v1:172.21.15.5:6789/0 conn(0x7f03f00cc730 legacy=0x7f03f00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03d8004d00 0x7f03d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f006b850 con 0x7f03d8004d00 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00cd470 con 0x7f03d8003970 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d800b980 con 0x7f03f015a060 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03d8004d00 0x7f03d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ee7fc640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03eeffd640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 -- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 msgr2=0x7f03d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f015a060 0x7f03d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 -- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03d8003970 msgr2=0x7f03d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03d8003970 0x7f03d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.027+0000 7f03ef7fe640 1 -- 172.21.15.5:0/920141840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8003520 con 0x7f03d8004d00 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.028+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03d8004d00 0x7f03d8005180 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009ac0 tx=0x7f03d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7951ad37dd417ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.028+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8031400 con 0x7f03d8004d00 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.028+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e802d050 con 0x7f03d8004d00 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.028+0000 7f03edffb640 1 -- 172.21.15.5:0/920141840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8031780 con 0x7f03d8004d00 2024-09-13T17:14:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 -- 172.21.15.5:0/920141840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03d8004d00 msgr2=0x7f03d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 --2- 172.21.15.5:0/920141840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03d8004d00 0x7f03d8005180 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009ac0 tx=0x7f03d80057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03ef7fe640 1 -- 172.21.15.5:0/920141840 reap_dead start 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 -- 172.21.15.5:0/920141840 shutdown_connections 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 -- 172.21.15.5:0/920141840 >> 172.21.15.5:0/920141840 conn(0x7f03f0070af0 msgr2=0x7f03f0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 -- 172.21.15.5:0/920141840 shutdown_connections 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.029+0000 7f03f575e640 1 -- 172.21.15.5:0/920141840 wait complete. 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.030+0000 7f03f575e640 1 Processor -- start 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.030+0000 7f03f575e640 1 -- start start 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 0x7f03f0155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03f0153810 0x7f03f0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0155060 con 0x7f03f014f3f0 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0151410 con 0x7f03f0153810 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03f575e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0154aa0 con 0x7f03f014f010 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03ee7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03ee7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46368/0 (socket says 172.21.15.5:46368) 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03ee7fc640 1 -- 172.21.15.5:0/1503891607 learned_addr learned my addr 172.21.15.5:0/1503891607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03eeffd640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 0x7f03f0155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.031+0000 7f03ef7fe640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03f0153810 0x7f03f0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 -- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 msgr2=0x7f03f0155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 0x7f03f0155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 -- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03f0153810 msgr2=0x7f03f0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03f0153810 0x7f03f0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 -- 172.21.15.5:0/1503891607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0154d80 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03eeffd640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 0x7f03f0155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03ee7fc640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f03e4004840 tx=0x7f03e4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40014e0 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400fa20 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01516b0 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400fdb0 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.032+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f0154700 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.033+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00672e0 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.034+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f03e401d460 con 0x7f03f014f3f0 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.034+0000 7f03d77fe640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.034+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f03e4089610 con 0x7f03f014f3f0 2024-09-13T17:14:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.034+0000 7f03eeffd640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.035+0000 7f03eeffd640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 0x7f03dc06d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009fd0 tx=0x7f03e000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.038+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f03e40547f0 con 0x7f03f014f3f0 2024-09-13T17:14:40.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.210+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7f03f01518f0 con 0x7f03f014f3f0 2024-09-13T17:14:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.213+0000 7f03d77fe640 1 -- 172.21.15.5:0/1503891607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f03f01518f0 con 0x7f03f014f3f0 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 msgr2=0x7f03dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 0x7f03dc06d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009fd0 tx=0x7f03e000b040 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 msgr2=0x7f03f01563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f03e4004840 tx=0x7f03e4007720 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 shutdown_connections 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03f0153810 0x7f03f0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f03dc06ac00 0x7f03dc06d0c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f014f3f0 0x7f03f01563f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 --2- 172.21.15.5:0/1503891607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03f014f010 0x7f03f0155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 >> 172.21.15.5:0/1503891607 conn(0x7f03f0070af0 msgr2=0x7f03f00af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 shutdown_connections 2024-09-13T17:14:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.215+0000 7f03f575e640 1 -- 172.21.15.5:0/1503891607 wait complete. 2024-09-13T17:14:40.228 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:40.228 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:40.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.385+0000 7f285bb5e640 1 Processor -- start 2024-09-13T17:14:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 -- start start 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28540b4cf0 0x7f28540cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 0x7f28540b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540d1e80 con 0x7f285415c810 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540d1750 con 0x7f28540b4cf0 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.386+0000 7f285bb5e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540d0bd0 con 0x7f28540d06d0 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28598fa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f285415c810 0x7f28540b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52472/0 (socket says 172.21.15.5:52472) 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28598fa640 1 -- 172.21.15.5:0/940063821 learned_addr learned my addr 172.21.15.5:0/940063821 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:40.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28590f9640 1 --2- 172.21.15.5:0/940063821 >> v2:172.21.15.5:3300/0 conn(0x7f28540b4cf0 0x7f28540cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f285a0fb640 1 --2- 172.21.15.5:0/940063821 >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 0x7f28540b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28588f8640 1 -- 172.21.15.5:0/940063821 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751403664 0 0) 0x7f28540d1e80 con 0x7f285415c810 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28588f8640 1 -- 172.21.15.5:0/940063821 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2840003520 con 0x7f285415c810 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28590f9640 1 -- 172.21.15.5:0/940063821 >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 msgr2=0x7f28540b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28590f9640 1 --2- 172.21.15.5:0/940063821 >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 0x7f28540b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28590f9640 1 -- 172.21.15.5:0/940063821 >> v1:172.21.15.5:6789/0 conn(0x7f285415c810 legacy=0x7f28540b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f28590f9640 1 -- 172.21.15.5:0/940063821 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540d0eb0 con 0x7f28540b4cf0 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.387+0000 7f285a0fb640 1 --2- 172.21.15.5:0/940063821 >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 0x7f28540b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f28590f9640 1 --2- 172.21.15.5:0/940063821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f28540cd780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f28540b80e0 tx=0x7f284402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d17a2b48117c52b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f28588f8640 1 -- 172.21.15.5:0/940063821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844032440 con 0x7f28540b4cf0 2024-09-13T17:14:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f28588f8640 1 -- 172.21.15.5:0/940063821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28440325a0 con 0x7f28540b4cf0 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f28588f8640 1 -- 172.21.15.5:0/940063821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844032930 con 0x7f28540b4cf0 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 -- 172.21.15.5:0/940063821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 msgr2=0x7f28540cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 --2- 172.21.15.5:0/940063821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f28540cd780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f28540b80e0 tx=0x7f284402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 -- 172.21.15.5:0/940063821 shutdown_connections 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 --2- 172.21.15.5:0/940063821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f28540cd780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 --2- 172.21.15.5:0/940063821 >> v2:172.21.15.179:3300/0 conn(0x7f28540d06d0 0x7f28540b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 -- 172.21.15.5:0/940063821 >> 172.21.15.5:0/940063821 conn(0x7f28540717a0 msgr2=0x7f2854071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 -- 172.21.15.5:0/940063821 shutdown_connections 2024-09-13T17:14:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.388+0000 7f285bb5e640 1 -- 172.21.15.5:0/940063821 wait complete. 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 Processor -- start 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 -- start start 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 0x7f28540cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 0x7f28540cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540cc470 con 0x7f28540b4cf0 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540c7ec0 con 0x7f285415c810 2024-09-13T17:14:40.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f285bb5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540c81a0 con 0x7f28540d06d0 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.390+0000 7f28598fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46374/0 (socket says 172.21.15.5:46374) 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 -- 172.21.15.5:0/1181440598 learned_addr learned my addr 172.21.15.5:0/1181440598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28590f9640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 0x7f28540cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f285a0fb640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 0x7f28540cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 -- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 msgr2=0x7f28540cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 0x7f28540cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 -- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 msgr2=0x7f28540cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 0x7f28540cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 -- 172.21.15.5:0/1181440598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009400 con 0x7f28540b4cf0 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f285a0fb640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 0x7f28540cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28590f9640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 0x7f28540cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:40.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f28598fa640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f285000c410 tx=0x7f285000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850005ce0 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850005e40 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500072f0 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28540c8480 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.391+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28540c8a40 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.392+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28540672a0 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.393+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2850007510 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.393+0000 7f284a7fc640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 0x7f283806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.393+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2850088b00 con 0x7f28540b4cf0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.393+0000 7f28590f9640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 0x7f283806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.394+0000 7f28590f9640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 0x7f283806d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2844034000 tx=0x7f284402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.397+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2850053c60 con 0x7f28540b4cf0 2024-09-13T17:14:40.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.570+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28540d2090 con 0x7f28540b4cf0 2024-09-13T17:14:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.571+0000 7f284a7fc640 1 -- 172.21.15.5:0/1181440598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f2850017090 con 0x7f28540b4cf0 2024-09-13T17:14:40.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:40.573 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 msgr2=0x7f283806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 0x7f283806d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2844034000 tx=0x7f284402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 msgr2=0x7f285414db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f285000c410 tx=0x7f285000c8d0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 shutdown_connections 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285415c810 0x7f28540cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28540d06d0 0x7f28540cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f283806ac00 0x7f283806d0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 --2- 172.21.15.5:0/1181440598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28540b4cf0 0x7f285414db00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 >> 172.21.15.5:0/1181440598 conn(0x7f28540717a0 msgr2=0x7f28540b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 shutdown_connections 2024-09-13T17:14:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.573+0000 7f285bb5e640 1 -- 172.21.15.5:0/1181440598 wait complete. 2024-09-13T17:14:40.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:40.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.690+0000 7fc281f8a640 1 Processor -- start 2024-09-13T17:14:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.690+0000 7fc281f8a640 1 -- start start 2024-09-13T17:14:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc281f8a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 0x7fc27c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc281f8a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc27c0ad720 0x7fc27c06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc281f8a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c06c520 con 0x7fc27c06c090 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc281f8a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c15b900 con 0x7fc27c0ad720 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc281f8a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c06db00 con 0x7fc27c157e20 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc27c0ad720 0x7fc27c06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc27c06c090 0x7fc27c0ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52486/0 (socket says 172.21.15.5:52486) 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27affd640 1 -- 172.21.15.5:0/96683121 learned_addr learned my addr 172.21.15.5:0/96683121 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27b7fe640 1 --2- 172.21.15.5:0/96683121 >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 0x7fc27c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27bfff640 1 -- 172.21.15.5:0/96683121 >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 msgr2=0x7fc27c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27bfff640 1 --2- 172.21.15.5:0/96683121 >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 0x7fc27c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27bfff640 1 -- 172.21.15.5:0/96683121 >> v1:172.21.15.5:6789/0 conn(0x7fc27c06c090 legacy=0x7fc27c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27bfff640 1 -- 172.21.15.5:0/96683121 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c06c800 con 0x7fc27c0ad720 2024-09-13T17:14:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.691+0000 7fc27b7fe640 1 --2- 172.21.15.5:0/96683121 >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 0x7fc27c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.692+0000 7fc27bfff640 1 --2- 172.21.15.5:0/96683121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c06d5c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cee60 tx=0x7fc27402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98018b6abaf955e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.692+0000 7fc27a7fc640 1 -- 172.21.15.5:0/96683121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27402aea0 con 0x7fc27c0ad720 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.692+0000 7fc27a7fc640 1 -- 172.21.15.5:0/96683121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27402d050 con 0x7fc27c0ad720 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.692+0000 7fc27a7fc640 1 -- 172.21.15.5:0/96683121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274007960 con 0x7fc27c0ad720 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 -- 172.21.15.5:0/96683121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 msgr2=0x7fc27c06d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 --2- 172.21.15.5:0/96683121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c06d5c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cee60 tx=0x7fc27402a680 comp rx=0 tx=0).stop 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 -- 172.21.15.5:0/96683121 shutdown_connections 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 --2- 172.21.15.5:0/96683121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c06d5c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 --2- 172.21.15.5:0/96683121 >> v2:172.21.15.179:3300/0 conn(0x7fc27c157e20 0x7fc27c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 -- 172.21.15.5:0/96683121 >> 172.21.15.5:0/96683121 conn(0x7fc27c0ce130 msgr2=0x7fc27c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 -- 172.21.15.5:0/96683121 shutdown_connections 2024-09-13T17:14:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.693+0000 7fc281f8a640 1 -- 172.21.15.5:0/96683121 wait complete. 2024-09-13T17:14:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.694+0000 7fc281f8a640 1 Processor -- start 2024-09-13T17:14:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.694+0000 7fc281f8a640 1 -- start start 2024-09-13T17:14:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc27c157e20 0x7fc27c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc27c1535b0 0x7fc27c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0ae510 con 0x7fc27c0ad720 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0ccf80 con 0x7fc27c157e20 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc281f8a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c153b70 con 0x7fc27c1535b0 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46402/0 (socket says 172.21.15.5:46402) 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 -- 172.21.15.5:0/2325623995 learned_addr learned my addr 172.21.15.5:0/2325623995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27bfff640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc27c1535b0 0x7fc27c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27affd640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc27c157e20 0x7fc27c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 -- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc27c1535b0 msgr2=0x7fc27c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc27c1535b0 0x7fc27c0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 -- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc27c157e20 msgr2=0x7fc27c070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc27c157e20 0x7fc27c070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.695+0000 7fc27b7fe640 1 -- 172.21.15.5:0/2325623995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009a70 con 0x7fc27c0ad720 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc27b7fe640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00d7d0 tx=0x7fc26c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c004030 con 0x7fc27c0ad720 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c004190 con 0x7fc27c0ad720 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0ae720 con 0x7fc27c0ad720 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c004520 con 0x7fc27c0ad720 2024-09-13T17:14:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.696+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c0aece0 con 0x7fc27c0ad720 2024-09-13T17:14:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.697+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c0672a0 con 0x7fc27c0ad720 2024-09-13T17:14:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.697+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc26c0096a0 con 0x7fc27c0ad720 2024-09-13T17:14:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.698+0000 7fc263fff640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 0x7fc26806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.698+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc26c089520 con 0x7fc27c0ad720 2024-09-13T17:14:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.698+0000 7fc27affd640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 0x7fc26806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.698+0000 7fc27affd640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 0x7fc26806d0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc27c15d5b0 tx=0x7fc270009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.702+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc26c054670 con 0x7fc27c0ad720 2024-09-13T17:14:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.872+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc27c158200 con 0x7fc27c0ad720 2024-09-13T17:14:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.872+0000 7fc263fff640 1 -- 172.21.15.5:0/2325623995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc26c057c90 con 0x7fc27c0ad720 2024-09-13T17:14:40.874 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.874+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 msgr2=0x7fc26806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.874+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 0x7fc26806d0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc27c15d5b0 tx=0x7fc270009040 comp rx=0 tx=0).stop 2024-09-13T17:14:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.874+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 msgr2=0x7fc27c0cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.874+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00d7d0 tx=0x7fc26c00dc90 comp rx=0 tx=0).stop 2024-09-13T17:14:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 shutdown_connections 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc27c1535b0 0x7fc27c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc27c157e20 0x7fc27c070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc26806ac00 0x7fc26806d0c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 --2- 172.21.15.5:0/2325623995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc27c0ad720 0x7fc27c0cca40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 >> 172.21.15.5:0/2325623995 conn(0x7fc27c0ce130 msgr2=0x7fc27c14ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 shutdown_connections 2024-09-13T17:14:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.875+0000 7fc281f8a640 1 -- 172.21.15.5:0/2325623995 wait complete. 2024-09-13T17:14:40.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:40.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.990+0000 7fc3d942b640 1 Processor -- start 2024-09-13T17:14:40.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 -- start start 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3d4157e20 0x7fc3d415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc3d406c090 0x7fc3d406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40ad010 0x7fc3d40ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d415b900 con 0x7fc3d4157e20 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d406db00 con 0x7fc3d406c090 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d942b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d406c520 con 0x7fc3d40ad010 2024-09-13T17:14:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.991+0000 7fc3d2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3d4157e20 0x7fc3d415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3d4157e20 0x7fc3d415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46410/0 (socket says 172.21.15.5:46410) 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/1664139580 learned_addr learned my addr 172.21.15.5:0/1664139580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/1664139580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40ad010 msgr2=0x7fc3d40ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/1664139580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40ad010 0x7fc3d40ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/1664139580 >> v2:172.21.15.179:3300/0 conn(0x7fc3d406c090 msgr2=0x7fc3d406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d27fc640 1 --2- 172.21.15.5:0/1664139580 >> v2:172.21.15.179:3300/0 conn(0x7fc3d406c090 0x7fc3d406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/1664139580 >> v2:172.21.15.179:3300/0 conn(0x7fc3d406c090 0x7fc3d406d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.992+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/1664139580 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d406c800 con 0x7fc3d4157e20 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/1664139580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d4157e20 0x7fc3d415b3c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40cee30 tx=0x7fc3c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30dff0e4b939f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d1ffb640 1 -- 172.21.15.5:0/1664139580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4032440 con 0x7fc3d4157e20 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d1ffb640 1 -- 172.21.15.5:0/1664139580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40325a0 con 0x7fc3d4157e20 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d1ffb640 1 -- 172.21.15.5:0/1664139580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4032930 con 0x7fc3d4157e20 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 -- 172.21.15.5:0/1664139580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d4157e20 msgr2=0x7fc3d415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 --2- 172.21.15.5:0/1664139580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d4157e20 0x7fc3d415b3c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40cee30 tx=0x7fc3c402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 -- 172.21.15.5:0/1664139580 shutdown_connections 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 --2- 172.21.15.5:0/1664139580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40ad010 0x7fc3d40ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 --2- 172.21.15.5:0/1664139580 >> v2:172.21.15.179:3300/0 conn(0x7fc3d406c090 0x7fc3d406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 --2- 172.21.15.5:0/1664139580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d4157e20 0x7fc3d415b3c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 -- 172.21.15.5:0/1664139580 >> 172.21.15.5:0/1664139580 conn(0x7fc3d40ce130 msgr2=0x7fc3d40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 -- 172.21.15.5:0/1664139580 shutdown_connections 2024-09-13T17:14:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.993+0000 7fc3d942b640 1 -- 172.21.15.5:0/1664139580 wait complete. 2024-09-13T17:14:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 Processor -- start 2024-09-13T17:14:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 -- start start 2024-09-13T17:14:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 0x7fc3d4155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 0x7fc3d4156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d414e2f0 con 0x7fc3d40ad010 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4097f00 con 0x7fc3d4157e20 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.995+0000 7fc3d942b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d414d3d0 con 0x7fc3d414e710 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46416/0 (socket says 172.21.15.5:46416) 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/551025643 learned_addr learned my addr 172.21.15.5:0/551025643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d37fe640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 0x7fc3d4156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d27fc640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 0x7fc3d4155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 msgr2=0x7fc3d4156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 0x7fc3d4156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 msgr2=0x7fc3d4155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 0x7fc3d4155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 -- 172.21.15.5:0/551025643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40094d0 con 0x7fc3d40ad010 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d37fe640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 0x7fc3d4156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d27fc640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 0x7fc3d4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d2ffd640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000c00 tx=0x7fc3c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4032440 con 0x7fc3d40ad010 2024-09-13T17:14:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c4030b80 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d414d670 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c403d420 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.996+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d414dc30 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.997+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d414e430 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.998+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3c4039040 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.998+0000 7fc3bb7fe640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 0x7fc3c006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.998+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3c40aa0f0 con 0x7fc3d40ad010 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.999+0000 7fc3d27fc640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 0x7fc3c006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:40.999+0000 7fc3d27fc640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 0x7fc3c006d0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4157b80 tx=0x7fc3c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.003+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc3d414e430 con 0x7fc3d40ad010 2024-09-13T17:14:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.172+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3d414e430 con 0x7fc3d40ad010 2024-09-13T17:14:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.172+0000 7fc3bb7fe640 1 -- 172.21.15.5:0/551025643 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3d414e430 con 0x7fc3d40ad010 2024-09-13T17:14:41.173 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 msgr2=0x7fc3c006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 0x7fc3c006d0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4157b80 tx=0x7fc3c8008040 comp rx=0 tx=0).stop 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 msgr2=0x7fc3d40979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000c00 tx=0x7fc3c40046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 shutdown_connections 2024-09-13T17:14:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d414e710 0x7fc3d4156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3d4157e20 0x7fc3d4155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3c006ac30 0x7fc3c006d0f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 --2- 172.21.15.5:0/551025643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3d40ad010 0x7fc3d40979c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 >> 172.21.15.5:0/551025643 conn(0x7fc3d40ce130 msgr2=0x7fc3d40732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 shutdown_connections 2024-09-13T17:14:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.174+0000 7fc3d942b640 1 -- 172.21.15.5:0/551025643 wait complete. 2024-09-13T17:14:41.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.292+0000 7f478b72c640 1 Processor -- start 2024-09-13T17:14:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.292+0000 7f478b72c640 1 -- start start 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f478b72c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f478415c6e0 0x7f47840cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f478b72c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f47840cf440 0x7f47841609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f478b72c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47840d0630 con 0x7f47840cf000 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f478b72c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47840d0910 con 0x7f478415c6e0 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f478b72c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47840d0bf0 con 0x7f47840cf440 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f47894c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f478415c6e0 0x7f47840cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f4788cc7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47840cf000 0x7f47841602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52494/0 (socket says 172.21.15.5:52494) 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f4788cc7640 1 -- 172.21.15.5:0/386143343 learned_addr learned my addr 172.21.15.5:0/386143343 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.293+0000 7f4789cc9640 1 --2- 172.21.15.5:0/386143343 >> v2:172.21.15.179:3300/0 conn(0x7f47840cf440 0x7f47841609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f47894c8640 1 -- 172.21.15.5:0/386143343 >> v2:172.21.15.179:3300/0 conn(0x7f47840cf440 msgr2=0x7f47841609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f47894c8640 1 --2- 172.21.15.5:0/386143343 >> v2:172.21.15.179:3300/0 conn(0x7f47840cf440 0x7f47841609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f47894c8640 1 -- 172.21.15.5:0/386143343 >> v1:172.21.15.5:6789/0 conn(0x7f47840cf000 legacy=0x7f47841602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f477bfff640 1 -- 172.21.15.5:0/386143343 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886197712 0 0) 0x7f47840d0630 con 0x7f47840cf000 2024-09-13T17:14:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f47894c8640 1 -- 172.21.15.5:0/386143343 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840d0ed0 con 0x7f478415c6e0 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.294+0000 7f47894c8640 1 --2- 172.21.15.5:0/386143343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840cde60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f47840d0140 tx=0x7f478002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcaa3f7ea7b7266d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f477bfff640 1 -- 172.21.15.5:0/386143343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780032440 con 0x7f478415c6e0 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f477bfff640 1 -- 172.21.15.5:0/386143343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47800325a0 con 0x7f478415c6e0 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f477bfff640 1 -- 172.21.15.5:0/386143343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780032930 con 0x7f478415c6e0 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 -- 172.21.15.5:0/386143343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 msgr2=0x7f47840cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 --2- 172.21.15.5:0/386143343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840cde60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f47840d0140 tx=0x7f478002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 -- 172.21.15.5:0/386143343 shutdown_connections 2024-09-13T17:14:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 --2- 172.21.15.5:0/386143343 >> v2:172.21.15.179:3300/0 conn(0x7f47840cf440 0x7f47841609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 --2- 172.21.15.5:0/386143343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840cde60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 -- 172.21.15.5:0/386143343 >> 172.21.15.5:0/386143343 conn(0x7f4784089f90 msgr2=0x7f47840d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 -- 172.21.15.5:0/386143343 shutdown_connections 2024-09-13T17:14:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.295+0000 7f478b72c640 1 -- 172.21.15.5:0/386143343 wait complete. 2024-09-13T17:14:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.296+0000 7f478b72c640 1 Processor -- start 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 -- start start 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47840cf000 0x7f478415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47840cf440 0x7f47840b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47840b3c90 con 0x7f478415c6e0 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47840c6120 con 0x7f47840cf000 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f478b72c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47840c6400 con 0x7f47840cf440 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f4789cc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f4789cc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46442/0 (socket says 172.21.15.5:46442) 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f4789cc9640 1 -- 172.21.15.5:0/741691269 learned_addr learned my addr 172.21.15.5:0/741691269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f47894c8640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47840cf000 0x7f478415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.297+0000 7f4788cc7640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47840cf440 0x7f47840b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 -- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47840cf440 msgr2=0x7f47840b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47840cf440 0x7f47840b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 -- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47840cf000 msgr2=0x7f478415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47840cf000 0x7f478415bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 -- 172.21.15.5:0/741691269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009400 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4789cc9640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f477c007e40 tx=0x7f477c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c014620 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00ee90 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47840c66e0 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0149e0 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.298+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47840c6ca0 con 0x7f478415c6e0 2024-09-13T17:14:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.299+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47840672e0 con 0x7f478415c6e0 2024-09-13T17:14:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.300+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f477c014b40 con 0x7f478415c6e0 2024-09-13T17:14:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.301+0000 7f4779ffb640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 0x7f476806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.301+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f477c089c30 con 0x7f478415c6e0 2024-09-13T17:14:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.301+0000 7f47894c8640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 0x7f476806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.302+0000 7f47894c8640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 0x7f476806d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4780034000 tx=0x7f478002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.305+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f477c054e10 con 0x7f478415c6e0 2024-09-13T17:14:41.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.476+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47840c6ec0 con 0x7f478415c6e0 2024-09-13T17:14:41.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.477+0000 7f4779ffb640 1 -- 172.21.15.5:0/741691269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f477c058430 con 0x7f478415c6e0 2024-09-13T17:14:41.478 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 msgr2=0x7f476806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 0x7f476806d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4780034000 tx=0x7f478002e000 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 msgr2=0x7f47840b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f477c007e40 tx=0x7f477c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 shutdown_connections 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f476806ac00 0x7f476806d0c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f478415c6e0 0x7f47840b5440 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47840cf440 0x7f47840b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 --2- 172.21.15.5:0/741691269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47840cf000 0x7f478415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 >> 172.21.15.5:0/741691269 conn(0x7f4784089f90 msgr2=0x7f47840b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 shutdown_connections 2024-09-13T17:14:41.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.479+0000 7f478b72c640 1 -- 172.21.15.5:0/741691269 wait complete. 2024-09-13T17:14:41.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.594+0000 7f6a041ff640 1 Processor -- start 2024-09-13T17:14:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 -- start start 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69fc0b4cf0 0x7f69fc0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f69fc0d06d0 0x7f69fc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0d1e80 con 0x7f69fc15c810 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0d1750 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.595+0000 7f6a041ff640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0d0bd0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69fc0b4cf0 0x7f69fc0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69fc0b4cf0 0x7f69fc0cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 -- 172.21.15.5:0/932142813 learned_addr learned my addr 172.21.15.5:0/932142813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0279c640 1 --2- 172.21.15.5:0/932142813 >> v2:172.21.15.179:3300/0 conn(0x7f69fc0d06d0 0x7f69fc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 -- 172.21.15.5:0/932142813 >> v2:172.21.15.179:3300/0 conn(0x7f69fc0d06d0 msgr2=0x7f69fc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 --2- 172.21.15.5:0/932142813 >> v2:172.21.15.179:3300/0 conn(0x7f69fc0d06d0 0x7f69fc0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 -- 172.21.15.5:0/932142813 >> v1:172.21.15.179:6789/0 conn(0x7f69fc15c810 legacy=0x7f69fc0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.596+0000 7f6a0179a640 1 -- 172.21.15.5:0/932142813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0d0eb0 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.598+0000 7f6a0179a640 1 --2- 172.21.15.5:0/932142813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc0cd780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0b80e0 tx=0x7f69f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ebe52c4c995d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.598+0000 7f6a00f99640 1 -- 172.21.15.5:0/932142813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0032440 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.598+0000 7f6a00f99640 1 -- 172.21.15.5:0/932142813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00325a0 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.598+0000 7f6a00f99640 1 -- 172.21.15.5:0/932142813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0032930 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 -- 172.21.15.5:0/932142813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0b4cf0 msgr2=0x7f69fc0cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 --2- 172.21.15.5:0/932142813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc0cd780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0b80e0 tx=0x7f69f002a270 comp rx=0 tx=0).stop 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 -- 172.21.15.5:0/932142813 shutdown_connections 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 --2- 172.21.15.5:0/932142813 >> v2:172.21.15.179:3300/0 conn(0x7f69fc0d06d0 0x7f69fc0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 --2- 172.21.15.5:0/932142813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc0cd780 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 -- 172.21.15.5:0/932142813 >> 172.21.15.5:0/932142813 conn(0x7f69fc0717a0 msgr2=0x7f69fc071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 -- 172.21.15.5:0/932142813 shutdown_connections 2024-09-13T17:14:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.599+0000 7f6a041ff640 1 -- 172.21.15.5:0/932142813 wait complete. 2024-09-13T17:14:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.600+0000 7f6a041ff640 1 Processor -- start 2024-09-13T17:14:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.600+0000 7f6a041ff640 1 -- start start 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69fc15c810 0x7f69fc15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1f20c0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1f23a0 con 0x7f69fc0b4cf0 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a041ff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1f2680 con 0x7f69fc15c810 2024-09-13T17:14:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46454/0 (socket says 172.21.15.5:46454) 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 -- 172.21.15.5:0/2179733858 learned_addr learned my addr 172.21.15.5:0/2179733858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a01f9b640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0279c640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69fc15c810 0x7f69fc15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 -- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69fc15c810 msgr2=0x7f69fc15f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69fc15c810 0x7f69fc15f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 -- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69fc0b4cf0 msgr2=0x7f69fc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.601+0000 7f6a0179a640 1 -- 172.21.15.5:0/2179733858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00094d0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f6a0179a640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f69f002a2b0 tx=0x7f69f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0032440 con 0x7f69fc0d06d0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f0030ba0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc1f2960 con 0x7f69fc0d06d0 2024-09-13T17:14:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f003d440 con 0x7f69fc0d06d0 2024-09-13T17:14:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.602+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc150f40 con 0x7f69fc0d06d0 2024-09-13T17:14:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.603+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc1f27c0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.603+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69f0039040 con 0x7f69fc0d06d0 2024-09-13T17:14:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.604+0000 7f69ee7fc640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.604+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f69f00a9f20 con 0x7f69fc0d06d0 2024-09-13T17:14:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.604+0000 7f6a01f9b640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.605+0000 7f6a01f9b640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 0x7f69e006d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000f60 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.608+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f69fc1f27c0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.794+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69fc1f27c0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.795+0000 7f69ee7fc640 1 -- 172.21.15.5:0/2179733858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69fc1f27c0 con 0x7f69fc0d06d0 2024-09-13T17:14:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 msgr2=0x7f69e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 0x7f69e006d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000f60 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2024-09-13T17:14:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 msgr2=0x7f69fc15f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f69f002a2b0 tx=0x7f69f00046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 shutdown_connections 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69fc15c810 0x7f69fc15f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69e006ac00 0x7f69e006d0c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc0d06d0 0x7f69fc15f180 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 --2- 172.21.15.5:0/2179733858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69fc0b4cf0 0x7f69fc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 >> 172.21.15.5:0/2179733858 conn(0x7f69fc0717a0 msgr2=0x7f69fc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 shutdown_connections 2024-09-13T17:14:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.797+0000 7f6a041ff640 1 -- 172.21.15.5:0/2179733858 wait complete. 2024-09-13T17:14:41.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:41.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:41.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.966+0000 7fe647b76640 1 Processor -- start 2024-09-13T17:14:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.966+0000 7fe647b76640 1 -- start start 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe647b76640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe6400d06d0 0x7fe6400cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe647b76640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400d1e80 con 0x7fe6400b4cf0 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe647b76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400d1750 con 0x7fe64015c810 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe647b76640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400d0bd0 con 0x7fe6400d06d0 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe645111640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe6400b4cf0 0x7fe6400b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52510/0 (socket says 172.21.15.5:52510) 2024-09-13T17:14:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe645111640 1 -- 172.21.15.5:0/2291095876 learned_addr learned my addr 172.21.15.5:0/2291095876 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe646113640 1 --2- 172.21.15.5:0/2291095876 >> v2:172.21.15.179:3300/0 conn(0x7fe6400d06d0 0x7fe6400cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438255630 0 0) 0x7fe6400d1e80 con 0x7fe6400b4cf0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.967+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c003520 con 0x7fe6400b4cf0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012119300 0 0) 0x7fe6400d1750 con 0x7fe64015c810 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6400d1e80 con 0x7fe64015c810 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748460658 0 0) 0x7fe62c003520 con 0x7fe6400b4cf0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 >> v2:172.21.15.179:3300/0 conn(0x7fe6400d06d0 msgr2=0x7fe6400cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 --2- 172.21.15.5:0/2291095876 >> v2:172.21.15.179:3300/0 conn(0x7fe6400d06d0 0x7fe6400cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 >> v1:172.21.15.179:6789/0 conn(0x7fe64015c810 legacy=0x7fe6400b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400d0eb0 con 0x7fe6400b4cf0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe630001670 con 0x7fe6400b4cf0 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe646113640 1 --2- 172.21.15.5:0/2291095876 >> v2:172.21.15.179:3300/0 conn(0x7fe6400d06d0 0x7fe6400cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 >> v1:172.21.15.5:6789/0 conn(0x7fe6400b4cf0 legacy=0x7fe6400b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c003b00 0x7fe62c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 0x7fe62c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c005180 0x7fe62c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400d0bd0 con 0x7fe62c0047c0 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c00c000 con 0x7fe62c005180 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c00c1c0 con 0x7fe62c003b00 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 0x7fe62c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645912640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c003b00 0x7fe62c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe646113640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c005180 0x7fe62c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 -- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c003b00 msgr2=0x7fe62c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c003b00 0x7fe62c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 -- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c005180 msgr2=0x7fe62c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe62c005180 0x7fe62c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe645111640 1 -- 172.21.15.5:0/2291095876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c003520 con 0x7fe62c0047c0 2024-09-13T17:14:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.968+0000 7fe646113640 1 -- 172.21.15.5:0/2291095876 reap_dead start 2024-09-13T17:14:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.969+0000 7fe645111640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 0x7fe62c004c40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c160 tx=0x7fe62c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10feabfabb9f38fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.969+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630005ad0 con 0x7fe62c0047c0 2024-09-13T17:14:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.969+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63002d070 con 0x7fe62c0047c0 2024-09-13T17:14:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.969+0000 7fe644910640 1 -- 172.21.15.5:0/2291095876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630007070 con 0x7fe62c0047c0 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 -- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 msgr2=0x7fe62c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 0x7fe62c004c40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c160 tx=0x7fe62c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 -- 172.21.15.5:0/2291095876 shutdown_connections 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 --2- 172.21.15.5:0/2291095876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe62c0047c0 0x7fe62c004c40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 -- 172.21.15.5:0/2291095876 >> 172.21.15.5:0/2291095876 conn(0x7fe6400717a0 msgr2=0x7fe640071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 -- 172.21.15.5:0/2291095876 shutdown_connections 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.970+0000 7fe647b76640 1 -- 172.21.15.5:0/2291095876 wait complete. 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.971+0000 7fe647b76640 1 Processor -- start 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.971+0000 7fe647b76640 1 -- start start 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0047c0 0x7fe6401f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64015d610 0x7fe64015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640145330 con 0x7fe6400ca840 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64015dfd0 con 0x7fe64015d610 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401422d0 con 0x7fe62c0047c0 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46470/0 (socket says 172.21.15.5:46470) 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 -- 172.21.15.5:0/495235642 learned_addr learned my addr 172.21.15.5:0/495235642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe645912640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0047c0 0x7fe6401f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe645111640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64015d610 0x7fe64015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 -- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0047c0 msgr2=0x7fe6401f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0047c0 0x7fe6401f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 -- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64015d610 msgr2=0x7fe64015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64015d610 0x7fe64015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 -- 172.21.15.5:0/495235642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640157850 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe646113640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe6400d0380 tx=0x7fe6380115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63800e070 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe638011e70 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe640145050 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.972+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638003990 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.973+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe640157db0 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.974+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6400672a0 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.974+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe638003af0 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.974+0000 7fe6367fc640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 0x7fe62406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.975+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe638089c80 con 0x7fe6400ca840 2024-09-13T17:14:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.975+0000 7fe645912640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 0x7fe62406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:41.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.975+0000 7fe645912640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 0x7fe62406d0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe63c000c00 tx=0x7fe63c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:41.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:41.979+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe638054d20 con 0x7fe6400ca840 2024-09-13T17:14:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.155+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6400b45e0 con 0x7fe6400ca840 2024-09-13T17:14:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.156+0000 7fe6367fc640 1 -- 172.21.15.5:0/495235642 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7fe638058340 con 0x7fe6400ca840 2024-09-13T17:14:42.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:42.158 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 msgr2=0x7fe62406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 0x7fe62406d0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe63c000c00 tx=0x7fe63c009040 comp rx=0 tx=0).stop 2024-09-13T17:14:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 msgr2=0x7fe6400cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe6400d0380 tx=0x7fe6380115a0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 shutdown_connections 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe62406ac30 0x7fe62406d0f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca840 0x7fe6400cacc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe64015d610 0x7fe64015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 --2- 172.21.15.5:0/495235642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe62c0047c0 0x7fe6401f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 >> 172.21.15.5:0/495235642 conn(0x7fe6400717a0 msgr2=0x7fe6400b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 shutdown_connections 2024-09-13T17:14:42.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.158+0000 7fe647b76640 1 -- 172.21.15.5:0/495235642 wait complete. 2024-09-13T17:14:42.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:42.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:42.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:14:42.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:14:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.276+0000 7f2f183b5640 1 Processor -- start 2024-09-13T17:14:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.276+0000 7f2f183b5640 1 -- start start 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f183b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f100cf440 0x7f2f10167d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f183b5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100ce570 con 0x7f2f100cf000 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f183b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100d0630 con 0x7f2f1015c6e0 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f183b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100d0910 con 0x7f2f100cf440 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f16952640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f100cf440 0x7f2f10167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f15950640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f100cf000 0x7f2f101645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52520/0 (socket says 172.21.15.5:52520) 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.277+0000 7f2f15950640 1 -- 172.21.15.5:0/505444415 learned_addr learned my addr 172.21.15.5:0/505444415 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.278+0000 7f2f16952640 1 -- 172.21.15.5:0/505444415 >> v1:172.21.15.179:6789/0 conn(0x7f2f1015c6e0 legacy=0x7f2f100cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.278+0000 7f2f16952640 1 -- 172.21.15.5:0/505444415 >> v1:172.21.15.5:6789/0 conn(0x7f2f100cf000 legacy=0x7f2f101645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.278+0000 7f2f16952640 1 -- 172.21.15.5:0/505444415 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100d0bf0 con 0x7f2f100cf440 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f16952640 1 --2- 172.21.15.5:0/505444415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf440 0x7f2f10167d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6c24eef82cbfc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f1514f640 1 -- 172.21.15.5:0/505444415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007740 con 0x7f2f100cf440 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f1514f640 1 -- 172.21.15.5:0/505444415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0802d050 con 0x7f2f100cf440 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f1514f640 1 -- 172.21.15.5:0/505444415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007ac0 con 0x7f2f100cf440 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f183b5640 1 -- 172.21.15.5:0/505444415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf440 msgr2=0x7f2f10167d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.279+0000 7f2f183b5640 1 --2- 172.21.15.5:0/505444415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf440 0x7f2f10167d10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.280+0000 7f2f183b5640 1 -- 172.21.15.5:0/505444415 shutdown_connections 2024-09-13T17:14:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.280+0000 7f2f183b5640 1 --2- 172.21.15.5:0/505444415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf440 0x7f2f10167d10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.280+0000 7f2f183b5640 1 -- 172.21.15.5:0/505444415 >> 172.21.15.5:0/505444415 conn(0x7f2f10089f90 msgr2=0x7f2f100d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.280+0000 7f2f183b5640 1 -- 172.21.15.5:0/505444415 shutdown_connections 2024-09-13T17:14:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.280+0000 7f2f183b5640 1 -- 172.21.15.5:0/505444415 wait complete. 2024-09-13T17:14:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.281+0000 7f2f183b5640 1 Processor -- start 2024-09-13T17:14:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.281+0000 7f2f183b5640 1 -- start start 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 0x7f2f100ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f1015c6e0 0x7f2f100ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100cbfa0 con 0x7f2f100cf000 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100cbb10 con 0x7f2f1015c6e0 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f183b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100caf00 con 0x7f2f100cf440 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46492/0 (socket says 172.21.15.5:46492) 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 -- 172.21.15.5:0/1825478893 learned_addr learned my addr 172.21.15.5:0/1825478893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16952640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f1015c6e0 0x7f2f100ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f15950640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 0x7f2f100ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 -- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 msgr2=0x7f2f100ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 0x7f2f100ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 -- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f1015c6e0 msgr2=0x7f2f100ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f1015c6e0 0x7f2f100ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 -- 172.21.15.5:0/1825478893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009a70 con 0x7f2f100cf000 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f15950640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 0x7f2f100ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.282+0000 7f2f16151640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c450 tx=0x7f2f0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.283+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0052d0 con 0x7f2f100cf000 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.283+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c005430 con 0x7f2f100cf000 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.283+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100cb1e0 con 0x7f2f100cf000 2024-09-13T17:14:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.283+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c012870 con 0x7f2f100cf000 2024-09-13T17:14:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.283+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100cb7a0 con 0x7f2f100cf000 2024-09-13T17:14:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.284+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f100672e0 con 0x7f2f100cf000 2024-09-13T17:14:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.284+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f0c0129d0 con 0x7f2f100cf000 2024-09-13T17:14:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.285+0000 7f2f02ffd640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 0x7f2ef406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.285+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f0c088f60 con 0x7f2f100cf000 2024-09-13T17:14:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.285+0000 7f2f15950640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 0x7f2ef406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.286+0000 7f2f15950640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 0x7f2ef406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f101f5ef0 tx=0x7f2f04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.289+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f0c054000 con 0x7f2f100cf000 2024-09-13T17:14:42.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.460+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f1015cac0 con 0x7f2f100cf000 2024-09-13T17:14:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.461+0000 7f2f02ffd640 1 -- 172.21.15.5:0/1825478893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f0c057620 con 0x7f2f100cf000 2024-09-13T17:14:42.462 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 msgr2=0x7f2ef406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 0x7f2ef406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f101f5ef0 tx=0x7f2f04009040 comp rx=0 tx=0).stop 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 msgr2=0x7f2f101e7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c450 tx=0x7f2f0c00c910 comp rx=0 tx=0).stop 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 shutdown_connections 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f1015c6e0 0x7f2f100ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f100cf440 0x7f2f100ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2ef406ac00 0x7f2ef406d0c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 --2- 172.21.15.5:0/1825478893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f100cf000 0x7f2f101e7740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 >> 172.21.15.5:0/1825478893 conn(0x7f2f10089f90 msgr2=0x7f2f100b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 shutdown_connections 2024-09-13T17:14:42.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.463+0000 7f2f183b5640 1 -- 172.21.15.5:0/1825478893 wait complete. 2024-09-13T17:14:42.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:42.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.579+0000 7f5545545640 1 Processor -- start 2024-09-13T17:14:42.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.579+0000 7f5545545640 1 -- start start 2024-09-13T17:14:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f5545545640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f554006da30 0x7f554006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f5545545640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55400ad050 con 0x7f55400abe60 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f5545545640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55400ac440 con 0x7f55401591e0 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f5545545640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554006e400 con 0x7f554006da30 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f55400abe60 0x7f55400b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52532/0 (socket says 172.21.15.5:52532) 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553e7fc640 1 -- 172.21.15.5:0/1019527515 learned_addr learned my addr 172.21.15.5:0/1019527515 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553f7fe640 1 --2- 172.21.15.5:0/1019527515 >> v2:172.21.15.5:3300/0 conn(0x7f554006da30 0x7f554006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553dffb640 1 -- 172.21.15.5:0/1019527515 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539991488 0 0) 0x7f55400ad050 con 0x7f55400abe60 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553dffb640 1 -- 172.21.15.5:0/1019527515 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5528003520 con 0x7f55400abe60 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553f7fe640 1 -- 172.21.15.5:0/1019527515 >> v1:172.21.15.179:6789/0 conn(0x7f55401591e0 legacy=0x7f55400ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553f7fe640 1 -- 172.21.15.5:0/1019527515 >> v1:172.21.15.5:6789/0 conn(0x7f55400abe60 legacy=0x7f55400b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.580+0000 7f553f7fe640 1 -- 172.21.15.5:0/1019527515 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55400ac720 con 0x7f554006da30 2024-09-13T17:14:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.581+0000 7f553f7fe640 1 --2- 172.21.15.5:0/1019527515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f554006da30 0x7f554006dec0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5538009d90 tx=0x7f553802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17dff364808731a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.581+0000 7f553dffb640 1 -- 172.21.15.5:0/1019527515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538007740 con 0x7f554006da30 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.581+0000 7f553dffb640 1 -- 172.21.15.5:0/1019527515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553802d050 con 0x7f554006da30 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.581+0000 7f553dffb640 1 -- 172.21.15.5:0/1019527515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538007ac0 con 0x7f554006da30 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 -- 172.21.15.5:0/1019527515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f554006da30 msgr2=0x7f554006dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 --2- 172.21.15.5:0/1019527515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f554006da30 0x7f554006dec0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5538009d90 tx=0x7f553802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 -- 172.21.15.5:0/1019527515 shutdown_connections 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 --2- 172.21.15.5:0/1019527515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f554006da30 0x7f554006dec0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 -- 172.21.15.5:0/1019527515 >> 172.21.15.5:0/1019527515 conn(0x7f55400ce130 msgr2=0x7f55400ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 -- 172.21.15.5:0/1019527515 shutdown_connections 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.582+0000 7f5545545640 1 -- 172.21.15.5:0/1019527515 wait complete. 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.583+0000 7f5545545640 1 Processor -- start 2024-09-13T17:14:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.583+0000 7f5545545640 1 -- start start 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f554006da30 0x7f554015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55401591e0 0x7f5540150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540150f90 con 0x7f55400abe60 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554015a4a0 con 0x7f554006da30 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f5545545640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554015a740 con 0x7f55401591e0 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46514/0 (socket says 172.21.15.5:46514) 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 -- 172.21.15.5:0/4181292248 learned_addr learned my addr 172.21.15.5:0/4181292248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553effd640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f554006da30 0x7f554015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553f7fe640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55401591e0 0x7f5540150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 -- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55401591e0 msgr2=0x7f5540150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55401591e0 0x7f5540150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 -- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f554006da30 msgr2=0x7f554015c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f554006da30 0x7f554015c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 -- 172.21.15.5:0/4181292248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009a70 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f553e7fc640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f553400c500 tx=0x7f553400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.584+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534005ce0 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.585+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534005e40 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.585+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554015aa20 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.585+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534007330 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.585+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554015afe0 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.586+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554015b200 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.586+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5534007550 con 0x7f55400abe60 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.586+0000 7f55277fe640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 0x7f552c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.586+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5534088a00 con 0x7f55400abe60 2024-09-13T17:14:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.587+0000 7f553effd640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 0x7f552c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.587+0000 7f553effd640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 0x7f552c06d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5530000f60 tx=0x7f5530009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.591+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5534053ca0 con 0x7f55400abe60 2024-09-13T17:14:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.760+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55400672a0 con 0x7f55400abe60 2024-09-13T17:14:42.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.761+0000 7f55277fe640 1 -- 172.21.15.5:0/4181292248 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55340572c0 con 0x7f55400abe60 2024-09-13T17:14:42.762 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 msgr2=0x7f552c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 0x7f552c06d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5530000f60 tx=0x7f5530009040 comp rx=0 tx=0).stop 2024-09-13T17:14:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 msgr2=0x7f5540150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f553400c500 tx=0x7f553400c9c0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 shutdown_connections 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55401591e0 0x7f5540150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552c06ac00 0x7f552c06d0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55400abe60 0x7f5540150510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 --2- 172.21.15.5:0/4181292248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f554006da30 0x7f554015c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 >> 172.21.15.5:0/4181292248 conn(0x7f55400ce130 msgr2=0x7f5540070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 shutdown_connections 2024-09-13T17:14:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.763+0000 7f5545545640 1 -- 172.21.15.5:0/4181292248 wait complete. 2024-09-13T17:14:42.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.878+0000 7fd0ab791640 1 Processor -- start 2024-09-13T17:14:42.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.878+0000 7fd0ab791640 1 -- start start 2024-09-13T17:14:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0ab791640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0a4069e90 0x7fd0a40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0ab791640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a406a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0ab791640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40b27f0 con 0x7fd0a40ac110 2024-09-13T17:14:42.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0ab791640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a406ed60 con 0x7fd0a4069e90 2024-09-13T17:14:42.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0ab791640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40b40d0 con 0x7fd0a40ae7b0 2024-09-13T17:14:42.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0a4069e90 0x7fd0a40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0a4069e90 0x7fd0a40b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46518/0 (socket says 172.21.15.5:46518) 2024-09-13T17:14:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 -- 172.21.15.5:0/4292662920 learned_addr learned my addr 172.21.15.5:0/4292662920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a8d2c640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 -- 172.21.15.5:0/4292662920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 msgr2=0x7fd0a406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:42.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a406a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 -- 172.21.15.5:0/4292662920 >> v1:172.21.15.179:6789/0 conn(0x7fd0a40ac110 legacy=0x7fd0a406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.879+0000 7fd0a952d640 1 -- 172.21.15.5:0/4292662920 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40ae390 con 0x7fd0a4069e90 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd0a952d640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a40b2130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009870 tx=0x7fd0a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971c47aca6dca58e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd09bfff640 1 -- 172.21.15.5:0/4292662920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0032440 con 0x7fd0a4069e90 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd09bfff640 1 -- 172.21.15.5:0/4292662920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00325a0 con 0x7fd0a4069e90 2024-09-13T17:14:42.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd09bfff640 1 -- 172.21.15.5:0/4292662920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0032930 con 0x7fd0a4069e90 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd0ab791640 1 -- 172.21.15.5:0/4292662920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 msgr2=0x7fd0a40b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.880+0000 7fd0ab791640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a40b2130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009870 tx=0x7fd0a002a270 comp rx=0 tx=0).stop 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 -- 172.21.15.5:0/4292662920 shutdown_connections 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 --2- 172.21.15.5:0/4292662920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a40b2130 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 -- 172.21.15.5:0/4292662920 >> 172.21.15.5:0/4292662920 conn(0x7fd0a40b4650 msgr2=0x7fd0a40b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 -- 172.21.15.5:0/4292662920 shutdown_connections 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.881+0000 7fd0ab791640 1 -- 172.21.15.5:0/4292662920 wait complete. 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.882+0000 7fd0ab791640 1 Processor -- start 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.882+0000 7fd0ab791640 1 -- start start 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.882+0000 7fd0ab791640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.882+0000 7fd0ab791640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a40ac110 0x7fd0a41439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0ab791640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a40cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0ab791640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cb7d0 con 0x7fd0a4069e90 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0ab791640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cb2d0 con 0x7fd0a40ac110 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0ab791640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cb4f0 con 0x7fd0a40ae7b0 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46522/0 (socket says 172.21.15.5:46522) 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 -- 172.21.15.5:0/2793199580 learned_addr learned my addr 172.21.15.5:0/2793199580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a8d2c640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a40ac110 0x7fd0a41439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a9d2e640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a40cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 -- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 msgr2=0x7fd0a40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a40cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 -- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a40ac110 msgr2=0x7fd0a41439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a40ac110 0x7fd0a41439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 -- 172.21.15.5:0/2793199580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00094d0 con 0x7fd0a4069e90 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0a952d640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd0a002a2b0 tx=0x7fd0a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0032440 con 0x7fd0a4069e90 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0030b80 con 0x7fd0a4069e90 2024-09-13T17:14:42.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a003d440 con 0x7fd0a4069e90 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.883+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a41576a0 con 0x7fd0a4069e90 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.884+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a4157c60 con 0x7fd0a4069e90 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.884+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4157500 con 0x7fd0a4069e90 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.885+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd0a0039040 con 0x7fd0a4069e90 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.885+0000 7fd099ffb640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:42.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.885+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd0a00a9f40 con 0x7fd0a4069e90 2024-09-13T17:14:42.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.886+0000 7fd0a8d2c640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:42.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.886+0000 7fd0a8d2c640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd094006fd0 tx=0x7fd094008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:42.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:42.889+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd0a4157500 con 0x7fd0a4069e90 2024-09-13T17:14:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.059+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0a4157500 con 0x7fd0a4069e90 2024-09-13T17:14:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.060+0000 7fd099ffb640 1 -- 172.21.15.5:0/2793199580 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0a4157500 con 0x7fd0a4069e90 2024-09-13T17:14:43.063 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 msgr2=0x7fd08806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd094006fd0 tx=0x7fd094008040 comp rx=0 tx=0).stop 2024-09-13T17:14:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 msgr2=0x7fd0a41e4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd0a002a2b0 tx=0x7fd0a00046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 shutdown_connections 2024-09-13T17:14:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd0a40ae7b0 0x7fd0a40cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a40ac110 0x7fd0a41439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 --2- 172.21.15.5:0/2793199580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0a4069e90 0x7fd0a41e4150 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 >> 172.21.15.5:0/2793199580 conn(0x7fd0a40b4650 msgr2=0x7fd0a40b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 shutdown_connections 2024-09-13T17:14:43.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.062+0000 7fd0ab791640 1 -- 172.21.15.5:0/2793199580 wait complete. 2024-09-13T17:14:43.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.176+0000 7fdc68273640 1 Processor -- start 2024-09-13T17:14:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.176+0000 7fdc68273640 1 -- start start 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc68273640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 0x7fdc600cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc68273640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc600d06d0 0x7fdc600b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc68273640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600d1e80 con 0x7fdc600b4b20 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc68273640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600b4fb0 con 0x7fdc600d06d0 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc68273640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600d1750 con 0x7fdc6015c810 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc66810640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdc600b4b20 0x7fdc600d26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52534/0 (socket says 172.21.15.5:52534) 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc66810640 1 -- 172.21.15.5:0/2279087098 learned_addr learned my addr 172.21.15.5:0/2279087098 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc6600f640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 0x7fdc600cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2279087098 >> v2:172.21.15.179:3300/0 conn(0x7fdc600d06d0 0x7fdc600b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc6500d640 1 -- 172.21.15.5:0/2279087098 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773644936 0 0) 0x7fdc600d1e80 con 0x7fdc600b4b20 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.177+0000 7fdc6500d640 1 -- 172.21.15.5:0/2279087098 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc4c003520 con 0x7fdc600b4b20 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6580e640 1 -- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 msgr2=0x7fdc600cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 0x7fdc600cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6580e640 1 -- 172.21.15.5:0/2279087098 >> v1:172.21.15.5:6789/0 conn(0x7fdc600b4b20 legacy=0x7fdc600d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6580e640 1 -- 172.21.15.5:0/2279087098 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600d0bd0 con 0x7fdc600d06d0 2024-09-13T17:14:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6600f640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 0x7fdc600cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.178+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc600d06d0 0x7fdc600b45e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097a0 tx=0x7fdc5002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d598f43d05c9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc6500d640 1 -- 172.21.15.5:0/2279087098 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50032440 con 0x7fdc600d06d0 2024-09-13T17:14:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc6500d640 1 -- 172.21.15.5:0/2279087098 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500325a0 con 0x7fdc600d06d0 2024-09-13T17:14:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc6500d640 1 -- 172.21.15.5:0/2279087098 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50032910 con 0x7fdc600d06d0 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 -- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc600d06d0 msgr2=0x7fdc600b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc600d06d0 0x7fdc600b45e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdc500097a0 tx=0x7fdc5002a180 comp rx=0 tx=0).stop 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 -- 172.21.15.5:0/2279087098 shutdown_connections 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc600d06d0 0x7fdc600b45e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 --2- 172.21.15.5:0/2279087098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc6015c810 0x7fdc600cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 -- 172.21.15.5:0/2279087098 >> 172.21.15.5:0/2279087098 conn(0x7fdc600717a0 msgr2=0x7fdc60071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.179+0000 7fdc68273640 1 -- 172.21.15.5:0/2279087098 shutdown_connections 2024-09-13T17:14:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.180+0000 7fdc68273640 1 -- 172.21.15.5:0/2279087098 wait complete. 2024-09-13T17:14:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.181+0000 7fdc68273640 1 Processor -- start 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.181+0000 7fdc68273640 1 -- start start 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc600b4b20 0x7fdc600cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6015c810 0x7fdc601f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600cbe60 con 0x7fdc600d06d0 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601f28c0 con 0x7fdc6015c810 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc68273640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c7d30 con 0x7fdc600b4b20 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46534/0 (socket says 172.21.15.5:46534) 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 -- 172.21.15.5:0/2215492781 learned_addr learned my addr 172.21.15.5:0/2215492781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6600f640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc600b4b20 0x7fdc600cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc66810640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6015c810 0x7fdc601f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 -- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc600b4b20 msgr2=0x7fdc600cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc600b4b20 0x7fdc600cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 -- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6015c810 msgr2=0x7fdc601f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6015c810 0x7fdc601f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 -- 172.21.15.5:0/2215492781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c009400 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.182+0000 7fdc6580e640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdc500098c0 tx=0x7fdc500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.183+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5003e920 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.183+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5003eaa0 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.183+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5003ee50 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.183+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc50009400 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.183+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc600c82f0 con 0x7fdc600d06d0 2024-09-13T17:14:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.184+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc600672a0 con 0x7fdc600d06d0 2024-09-13T17:14:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.184+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc5003c400 con 0x7fdc600d06d0 2024-09-13T17:14:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.185+0000 7fdc56ffd640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 0x7fdc4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.185+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc500aa1e0 con 0x7fdc600d06d0 2024-09-13T17:14:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.185+0000 7fdc6600f640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 0x7fdc4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:43.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.185+0000 7fdc6600f640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 0x7fdc4406d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009c30 tx=0x7fdc5c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:43.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.189+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc50075330 con 0x7fdc600d06d0 2024-09-13T17:14:43.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.371+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc600b45e0 con 0x7fdc600d06d0 2024-09-13T17:14:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.371+0000 7fdc56ffd640 1 -- 172.21.15.5:0/2215492781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc50078950 con 0x7fdc600d06d0 2024-09-13T17:14:43.373 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 msgr2=0x7fdc4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 0x7fdc4406d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009c30 tx=0x7fdc5c009190 comp rx=0 tx=0).stop 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 msgr2=0x7fdc600a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdc500098c0 tx=0x7fdc500046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 shutdown_connections 2024-09-13T17:14:43.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc6015c810 0x7fdc601f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdc4406ac00 0x7fdc4406d0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc600d06d0 0x7fdc600a9140 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 --2- 172.21.15.5:0/2215492781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc600b4b20 0x7fdc600cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 >> 172.21.15.5:0/2215492781 conn(0x7fdc600717a0 msgr2=0x7fdc60071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 shutdown_connections 2024-09-13T17:14:43.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:43.373+0000 7fdc68273640 1 -- 172.21.15.5:0/2215492781 wait complete. 2024-09-13T17:14:43.385 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:14:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:43.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:43.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[52747]: fuse finished with error 0 and tester_r 0 2024-09-13T17:14:43.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:49.513 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:49.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:49.514 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:14:49.534 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:49.534 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:49.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.688+0000 7f0fea22b640 1 Processor -- start 2024-09-13T17:14:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.688+0000 7f0fea22b640 1 -- start start 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0fe415a3e0 0x7f0fe406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fe40ab5a0 0x7f0fe415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe40aba50 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe406d410 con 0x7f0fe415a3e0 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fea22b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe406cb70 con 0x7f0fe406c320 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fe40ab5a0 0x7f0fe415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fe40ab5a0 0x7f0fe415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46730/0 (socket says 172.21.15.5:46730) 2024-09-13T17:14:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 -- 172.21.15.5:0/4050801806 learned_addr learned my addr 172.21.15.5:0/4050801806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe2ffd640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe37fe640 1 --2- 172.21.15.5:0/4050801806 >> v2:172.21.15.179:3300/0 conn(0x7f0fe415a3e0 0x7f0fe406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 -- 172.21.15.5:0/4050801806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 msgr2=0x7f0fe40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe40ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 -- 172.21.15.5:0/4050801806 >> v2:172.21.15.179:3300/0 conn(0x7f0fe415a3e0 msgr2=0x7f0fe406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/4050801806 >> v2:172.21.15.179:3300/0 conn(0x7f0fe415a3e0 0x7f0fe406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.689+0000 7f0fe3fff640 1 -- 172.21.15.5:0/4050801806 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe406ce50 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.690+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe415de00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40b0e40 tx=0x7f0fdc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ec97c2140cdca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.690+0000 7f0fe27fc640 1 -- 172.21.15.5:0/4050801806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc031600 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.690+0000 7f0fe27fc640 1 -- 172.21.15.5:0/4050801806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc02d050 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.690+0000 7f0fe27fc640 1 -- 172.21.15.5:0/4050801806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc031980 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 -- 172.21.15.5:0/4050801806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe40ab5a0 msgr2=0x7f0fe415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe415de00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40b0e40 tx=0x7f0fdc02a6a0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 -- 172.21.15.5:0/4050801806 shutdown_connections 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe415de00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 --2- 172.21.15.5:0/4050801806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 --2- 172.21.15.5:0/4050801806 >> v2:172.21.15.179:3300/0 conn(0x7f0fe415a3e0 0x7f0fe406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 -- 172.21.15.5:0/4050801806 >> 172.21.15.5:0/4050801806 conn(0x7f0fe40ce0d0 msgr2=0x7f0fe40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 -- 172.21.15.5:0/4050801806 shutdown_connections 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.691+0000 7f0fea22b640 1 -- 172.21.15.5:0/4050801806 wait complete. 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.692+0000 7f0fea22b640 1 Processor -- start 2024-09-13T17:14:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 -- start start 2024-09-13T17:14:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe4150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe414c040 con 0x7f0fe415a3e0 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe414c320 con 0x7f0fe40ab5a0 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fea22b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe414c600 con 0x7f0fe406c320 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fe3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fe3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46746/0 (socket says 172.21.15.5:46746) 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.693+0000 7f0fe3fff640 1 -- 172.21.15.5:0/3133595120 learned_addr learned my addr 172.21.15.5:0/3133595120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe37fe640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe4150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe2ffd640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 -- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 msgr2=0x7f0fe4150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe4150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 -- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe40ab5a0 msgr2=0x7f0fe41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 -- 172.21.15.5:0/3133595120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc009b30 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fe3fff640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc034040 tx=0x7f0fdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc03b820 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc03b9a0 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe414c8e0 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc03bd50 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.694+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe414cea0 con 0x7f0fe415a3e0 2024-09-13T17:14:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.695+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe414d640 con 0x7f0fe415a3e0 2024-09-13T17:14:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.696+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fdc038050 con 0x7f0fe415a3e0 2024-09-13T17:14:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.696+0000 7f0fcbfff640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 0x7f0fd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.696+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fdc0a9f40 con 0x7f0fe415a3e0 2024-09-13T17:14:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.697+0000 7f0fe37fe640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 0x7f0fd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.697+0000 7f0fe37fe640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 0x7f0fd006d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4006fd0 tx=0x7f0fd4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.701+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0fdc075070 con 0x7f0fe415a3e0 2024-09-13T17:14:49.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.873+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fe40672a0 con 0x7f0fe415a3e0 2024-09-13T17:14:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.875+0000 7f0fcbfff640 1 -- 172.21.15.5:0/3133595120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f0fdc04b090 con 0x7f0fe415a3e0 2024-09-13T17:14:49.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:49.876 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 msgr2=0x7f0fd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 0x7f0fd006d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4006fd0 tx=0x7f0fd4008040 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 msgr2=0x7f0fe40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc034040 tx=0x7f0fdc004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 shutdown_connections 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0fd006ac00 0x7f0fd006d0c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fe415a3e0 0x7f0fe40cd120 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe40ab5a0 0x7f0fe41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.876+0000 7f0fea22b640 1 --2- 172.21.15.5:0/3133595120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe406c320 0x7f0fe4150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.877+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 >> 172.21.15.5:0/3133595120 conn(0x7f0fe40ce0d0 msgr2=0x7f0fe40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.877+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 shutdown_connections 2024-09-13T17:14:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.877+0000 7f0fea22b640 1 -- 172.21.15.5:0/3133595120 wait complete. 2024-09-13T17:14:49.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:49.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.992+0000 7f471dbc7640 1 Processor -- start 2024-09-13T17:14:49.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.993+0000 7f471dbc7640 1 -- start start 2024-09-13T17:14:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.993+0000 7f471dbc7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47180cf000 0x7f47180cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.993+0000 7f471dbc7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180cf980 con 0x7f471815c6e0 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.993+0000 7f471dbc7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180ce570 con 0x7f47181645e0 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.993+0000 7f471dbc7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180d0630 con 0x7f47180cf000 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f47177fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f471815c6e0 0x7f47180cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49254/0 (socket says 172.21.15.5:49254) 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f4716ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47180cf000 0x7f47180cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f47177fe640 1 -- 172.21.15.5:0/951789158 learned_addr learned my addr 172.21.15.5:0/951789158 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f4716ffd640 1 -- 172.21.15.5:0/951789158 >> v1:172.21.15.179:6789/0 conn(0x7f47181645e0 legacy=0x7f47181669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f4716ffd640 1 -- 172.21.15.5:0/951789158 >> v1:172.21.15.5:6789/0 conn(0x7f471815c6e0 legacy=0x7f47180cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f47167fc640 1 -- 172.21.15.5:0/951789158 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682714317 0 0) 0x7f47180cf980 con 0x7f471815c6e0 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.994+0000 7f4716ffd640 1 -- 172.21.15.5:0/951789158 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180d0910 con 0x7f47180cf000 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f4716ffd640 1 --2- 172.21.15.5:0/951789158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47180cf000 0x7f47180cf440 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f470c0097a0 tx=0x7f470c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fceb3d137f9028 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f47167fc640 1 -- 172.21.15.5:0/951789158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c032440 con 0x7f47180cf000 2024-09-13T17:14:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f47167fc640 1 -- 172.21.15.5:0/951789158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c0325a0 con 0x7f47180cf000 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f47167fc640 1 -- 172.21.15.5:0/951789158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c032930 con 0x7f47180cf000 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 -- 172.21.15.5:0/951789158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47180cf000 msgr2=0x7f47180cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 --2- 172.21.15.5:0/951789158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47180cf000 0x7f47180cf440 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f470c0097a0 tx=0x7f470c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 -- 172.21.15.5:0/951789158 shutdown_connections 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 --2- 172.21.15.5:0/951789158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47180cf000 0x7f47180cf440 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 -- 172.21.15.5:0/951789158 >> 172.21.15.5:0/951789158 conn(0x7f4718089f90 msgr2=0x7f47180d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 -- 172.21.15.5:0/951789158 shutdown_connections 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.995+0000 7f471dbc7640 1 -- 172.21.15.5:0/951789158 wait complete. 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.997+0000 7f471dbc7640 1 Processor -- start 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.997+0000 7f471dbc7640 1 -- start start 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 0x7f47180b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f471815c6e0 0x7f47180b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180b4650 con 0x7f47181645e0 2024-09-13T17:14:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180b2ed0 con 0x7f47180cf000 2024-09-13T17:14:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47180b7b00 con 0x7f471815c6e0 2024-09-13T17:14:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46756/0 (socket says 172.21.15.5:46756) 2024-09-13T17:14:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 -- 172.21.15.5:0/173239329 learned_addr learned my addr 172.21.15.5:0/173239329 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f47177fe640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 0x7f47180b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4716ffd640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f471815c6e0 0x7f47180b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 -- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f471815c6e0 msgr2=0x7f47180b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f471815c6e0 0x7f47180b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 -- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 msgr2=0x7f47180b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 0x7f47180b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 -- 172.21.15.5:0/173239329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009400 con 0x7f47181645e0 2024-09-13T17:14:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f47177fe640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 0x7f47180b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f4717fff640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f471000b9a0 tx=0x7f471000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000cba0 con 0x7f47181645e0 2024-09-13T17:14:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471000cd00 con 0x7f47181645e0 2024-09-13T17:14:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180b2630 con 0x7f47181645e0 2024-09-13T17:14:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710014680 con 0x7f47181645e0 2024-09-13T17:14:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.998+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4718162060 con 0x7f47181645e0 2024-09-13T17:14:50.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:49.999+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47180672e0 con 0x7f47181645e0 2024-09-13T17:14:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.000+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f471001d3b0 con 0x7f47181645e0 2024-09-13T17:14:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.000+0000 7f46fffff640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 0x7f470406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.000+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f47100892c0 con 0x7f47181645e0 2024-09-13T17:14:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.001+0000 7f47177fe640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 0x7f470406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.001+0000 7f47177fe640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 0x7f470406d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4708000f60 tx=0x7f4708009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.005+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4710054350 con 0x7f47181645e0 2024-09-13T17:14:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.175+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f471815cac0 con 0x7f47181645e0 2024-09-13T17:14:50.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.176+0000 7f46fffff640 1 -- 172.21.15.5:0/173239329 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4710057970 con 0x7f47181645e0 2024-09-13T17:14:50.177 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 msgr2=0x7f470406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 0x7f470406d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4708000f60 tx=0x7f4708009040 comp rx=0 tx=0).stop 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 msgr2=0x7f4718155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f471000b9a0 tx=0x7f471000be60 comp rx=0 tx=0).stop 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 shutdown_connections 2024-09-13T17:14:50.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f470406ac00 0x7f470406d0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47181645e0 0x7f4718155c50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f471815c6e0 0x7f47180b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 --2- 172.21.15.5:0/173239329 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47180cf000 0x7f47180b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 >> 172.21.15.5:0/173239329 conn(0x7f4718089f90 msgr2=0x7f47180b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 shutdown_connections 2024-09-13T17:14:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.178+0000 7f471dbc7640 1 -- 172.21.15.5:0/173239329 wait complete. 2024-09-13T17:14:50.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.293+0000 7f06d9e96640 1 Processor -- start 2024-09-13T17:14:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.293+0000 7f06d9e96640 1 -- start start 2024-09-13T17:14:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.293+0000 7f06d9e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06d40abe60 0x7f06d40b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.293+0000 7f06d9e96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40ad050 con 0x7f06d41591e0 2024-09-13T17:14:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d9e96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40ac440 con 0x7f06d406da30 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d9e96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d40ac720 con 0x7f06d40abe60 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06d41591e0 0x7f06d40ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49266/0 (socket says 172.21.15.5:49266) 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06d40abe60 0x7f06d40b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d37fe640 1 -- 172.21.15.5:0/1136511243 learned_addr learned my addr 172.21.15.5:0/1136511243 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d2ffd640 1 -- 172.21.15.5:0/1136511243 >> v1:172.21.15.179:6789/0 conn(0x7f06d406da30 legacy=0x7f06d40700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d2ffd640 1 -- 172.21.15.5:0/1136511243 >> v1:172.21.15.5:6789/0 conn(0x7f06d41591e0 legacy=0x7f06d40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d27fc640 1 -- 172.21.15.5:0/1136511243 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735333253 0 0) 0x7f06d40ad050 con 0x7f06d41591e0 2024-09-13T17:14:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.294+0000 7f06d2ffd640 1 -- 172.21.15.5:0/1136511243 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40aca00 con 0x7f06d40abe60 2024-09-13T17:14:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d2ffd640 1 --2- 172.21.15.5:0/1136511243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40b1b30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0097a0 tx=0x7f06bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930fed72a91e9cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d27fc640 1 -- 172.21.15.5:0/1136511243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc032440 con 0x7f06d40abe60 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d27fc640 1 -- 172.21.15.5:0/1136511243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc0325a0 con 0x7f06d40abe60 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d27fc640 1 -- 172.21.15.5:0/1136511243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc032930 con 0x7f06d40abe60 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 -- 172.21.15.5:0/1136511243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 msgr2=0x7f06d40b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 --2- 172.21.15.5:0/1136511243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40b1b30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0097a0 tx=0x7f06bc02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 -- 172.21.15.5:0/1136511243 shutdown_connections 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 --2- 172.21.15.5:0/1136511243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40b1b30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 -- 172.21.15.5:0/1136511243 >> 172.21.15.5:0/1136511243 conn(0x7f06d40ce130 msgr2=0x7f06d40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 -- 172.21.15.5:0/1136511243 shutdown_connections 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.295+0000 7f06d9e96640 1 -- 172.21.15.5:0/1136511243 wait complete. 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.297+0000 7f06d9e96640 1 Processor -- start 2024-09-13T17:14:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.297+0000 7f06d9e96640 1 -- start start 2024-09-13T17:14:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 0x7f06d4144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d41591e0 0x7f06d40af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4145a80 con 0x7f06d40abe60 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4144e90 con 0x7f06d406da30 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4099100 con 0x7f06d41591e0 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46764/0 (socket says 172.21.15.5:46764) 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 -- 172.21.15.5:0/932184128 learned_addr learned my addr 172.21.15.5:0/932184128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d37fe640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 0x7f06d4144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d3fff640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d41591e0 0x7f06d40af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 -- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d41591e0 msgr2=0x7f06d40af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d41591e0 0x7f06d40af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 -- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 msgr2=0x7f06d4144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 0x7f06d4144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 -- 172.21.15.5:0/932184128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc009400 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d37fe640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 0x7f06d4144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d2ffd640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f06bc000c00 tx=0x7f06bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc030b80 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc030ce0 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc03b640 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.298+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4145150 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.299+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d4145710 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.299+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d41458d0 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.300+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06bc039040 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.300+0000 7f06cbfff640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 0x7f06b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.300+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06bc0a9e80 con 0x7f06d40abe60 2024-09-13T17:14:50.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.301+0000 7f06d37fe640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 0x7f06b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.301+0000 7f06d37fe640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 0x7f06b406d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06c4000f60 tx=0x7f06c4007cc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.305+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06bc074e80 con 0x7f06d40abe60 2024-09-13T17:14:50.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.477+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06d40672a0 con 0x7f06d40abe60 2024-09-13T17:14:50.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.478+0000 7f06cbfff640 1 -- 172.21.15.5:0/932184128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06bc04c020 con 0x7f06d40abe60 2024-09-13T17:14:50.479 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 msgr2=0x7f06b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 0x7f06b406d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06c4000f60 tx=0x7f06c4007cc0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 msgr2=0x7f06d40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f06bc000c00 tx=0x7f06bc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 shutdown_connections 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d41591e0 0x7f06d40af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06b406ac00 0x7f06b406d0c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d40abe60 0x7f06d40aed90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 --2- 172.21.15.5:0/932184128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d406da30 0x7f06d4144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 >> 172.21.15.5:0/932184128 conn(0x7f06d40ce130 msgr2=0x7f06d4071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 shutdown_connections 2024-09-13T17:14:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.480+0000 7f06d9e96640 1 -- 172.21.15.5:0/932184128 wait complete. 2024-09-13T17:14:50.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.596+0000 7fb02b965640 1 Processor -- start 2024-09-13T17:14:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.596+0000 7fb02b965640 1 -- start start 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb02b965640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb024069e90 0x7fb0240b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb02b965640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb0240ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb02b965640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240b27f0 con 0x7fb0240ae7b0 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb02b965640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02406ed60 con 0x7fb024069e90 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb02b965640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b40d0 con 0x7fb02415d850 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb028f00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb0240ae7b0 0x7fb02406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49278/0 (socket says 172.21.15.5:49278) 2024-09-13T17:14:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb028f00640 1 -- 172.21.15.5:0/3099169924 learned_addr learned my addr 172.21.15.5:0/3099169924 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb029f02640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb0240ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb029701640 1 --2- 172.21.15.5:0/3099169924 >> v2:172.21.15.179:3300/0 conn(0x7fb024069e90 0x7fb0240b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009471326 0 0) 0x7fb0240b27f0 con 0x7fb0240ae7b0 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb010003520 con 0x7fb0240ae7b0 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691165852 0 0) 0x7fb010003520 con 0x7fb0240ae7b0 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 msgr2=0x7fb0240ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb0240ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 >> v2:172.21.15.179:3300/0 conn(0x7fb024069e90 msgr2=0x7fb0240b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 --2- 172.21.15.5:0/3099169924 >> v2:172.21.15.179:3300/0 conn(0x7fb024069e90 0x7fb0240b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240ae390 con 0x7fb0240ae7b0 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb014001670 con 0x7fb0240ae7b0 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 >> v1:172.21.15.5:6789/0 conn(0x7fb0240ae7b0 legacy=0x7fb02406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb010003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0100047c0 0x7fb010004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.597+0000 7fb01bfff640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb010005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02406ed60 con 0x7fb010003970 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b40d0 con 0x7fb0100047c0 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01000b980 con 0x7fb02415d850 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb010003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb028f00640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0100047c0 0x7fb010004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029f02640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb010005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 -- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 msgr2=0x7fb010005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb02415d850 0x7fb010005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 -- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0100047c0 msgr2=0x7fb010004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0100047c0 0x7fb010004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.598+0000 7fb029701640 1 -- 172.21.15.5:0/3099169924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010003520 con 0x7fb010003970 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb029701640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb010003d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb020009ac0 tx=0x7fb0100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efad4fa6f7e7366 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020031400 con 0x7fb010003970 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02002d050 con 0x7fb010003970 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb01bfff640 1 -- 172.21.15.5:0/3099169924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020031780 con 0x7fb010003970 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 -- 172.21.15.5:0/3099169924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 msgr2=0x7fb010003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 --2- 172.21.15.5:0/3099169924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb010003d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb020009ac0 tx=0x7fb0100057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb029f02640 1 -- 172.21.15.5:0/3099169924 reap_dead start 2024-09-13T17:14:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 -- 172.21.15.5:0/3099169924 shutdown_connections 2024-09-13T17:14:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 -- 172.21.15.5:0/3099169924 >> 172.21.15.5:0/3099169924 conn(0x7fb0240b4650 msgr2=0x7fb0240b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 -- 172.21.15.5:0/3099169924 shutdown_connections 2024-09-13T17:14:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.599+0000 7fb02b965640 1 -- 172.21.15.5:0/3099169924 wait complete. 2024-09-13T17:14:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 Processor -- start 2024-09-13T17:14:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 -- start start 2024-09-13T17:14:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024158d60 0x7fb0240ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0240cae70 0x7fb0240cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cb830 con 0x7fb010003970 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cfaf0 con 0x7fb0240cae70 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb02b965640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cff80 con 0x7fb024158d60 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb029701640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb029701640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46778/0 (socket says 172.21.15.5:46778) 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.601+0000 7fb029701640 1 -- 172.21.15.5:0/1442978854 learned_addr learned my addr 172.21.15.5:0/1442978854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 -- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024158d60 msgr2=0x7fb0240ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024158d60 0x7fb0240ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 -- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0240cae70 msgr2=0x7fb0240cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0240cae70 0x7fb0240cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 -- 172.21.15.5:0/1442978854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240ceee0 con 0x7fb010003970 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb029701640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb020034040 tx=0x7fb020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020003ab0 con 0x7fb010003970 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020003c10 con 0x7fb010003970 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0240cf1c0 con 0x7fb010003970 2024-09-13T17:14:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020044410 con 0x7fb010003970 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.602+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0240cf780 con 0x7fb010003970 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.603+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0240672a0 con 0x7fb010003970 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.604+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb020038070 con 0x7fb010003970 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.604+0000 7fb019ffb640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 0x7fb00806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.604+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0200a8fd0 con 0x7fb010003970 2024-09-13T17:14:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.605+0000 7fb028f00640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 0x7fb00806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.605+0000 7fb028f00640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 0x7fb00806d0f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb0140079d0 tx=0x7fb014007960 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.609+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb020074100 con 0x7fb010003970 2024-09-13T17:14:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.777+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0240b2c20 con 0x7fb010003970 2024-09-13T17:14:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.778+0000 7fb019ffb640 1 -- 172.21.15.5:0/1442978854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb020077720 con 0x7fb010003970 2024-09-13T17:14:50.779 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 msgr2=0x7fb00806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 0x7fb00806d0f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb0140079d0 tx=0x7fb014007960 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 msgr2=0x7fb024151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb020034040 tx=0x7fb020004730 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 shutdown_connections 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0240cae70 0x7fb0240cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb024158d60 0x7fb0240ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00806ac30 0x7fb00806d0f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 --2- 172.21.15.5:0/1442978854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb010003970 0x7fb024151e00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 >> 172.21.15.5:0/1442978854 conn(0x7fb0240b4650 msgr2=0x7fb0240730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 shutdown_connections 2024-09-13T17:14:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.780+0000 7fb02b965640 1 -- 172.21.15.5:0/1442978854 wait complete. 2024-09-13T17:14:50.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.893+0000 7fec7a56c640 1 Processor -- start 2024-09-13T17:14:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.893+0000 7fec7a56c640 1 -- start start 2024-09-13T17:14:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec7a56c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec7406e1c0 0x7fec740aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec7a56c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec740b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec7a56c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740b2390 con 0x7fec74156f40 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec7a56c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7415a740 con 0x7fec7406e1c0 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec7a56c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740b1780 con 0x7fec7415a290 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec73fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec74156f40 0x7fec7406dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49292/0 (socket says 172.21.15.5:49292) 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec73fff640 1 -- 172.21.15.5:0/734303487 learned_addr learned my addr 172.21.15.5:0/734303487 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec78b09640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec740b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.894+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> v2:172.21.15.179:3300/0 conn(0x7fec7406e1c0 0x7fec740aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551958108 0 0) 0x7fec740b2390 con 0x7fec74156f40 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec5c003520 con 0x7fec74156f40 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1557061533 0 0) 0x7fec5c003520 con 0x7fec74156f40 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 msgr2=0x7fec740b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec740b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 >> v2:172.21.15.179:3300/0 conn(0x7fec7406e1c0 msgr2=0x7fec740aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 --2- 172.21.15.5:0/734303487 >> v2:172.21.15.179:3300/0 conn(0x7fec7406e1c0 0x7fec740aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740b1a60 con 0x7fec74156f40 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fec64001670 con 0x7fec74156f40 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec78b09640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec740b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> v2:172.21.15.179:3300/0 conn(0x7fec7406e1c0 0x7fec740aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:50.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 >> v1:172.21.15.5:6789/0 conn(0x7fec74156f40 legacy=0x7fec7406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec5c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5c003eb0 0x7fec5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c004d00 0x7fec5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7415a740 con 0x7fec5c003eb0 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740b1780 con 0x7fec5c004d00 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c00db90 con 0x7fec7415a290 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5c003eb0 0x7fec5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec73fff640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec5c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec78b09640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c004d00 0x7fec5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 -- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 msgr2=0x7fec5c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec7415a290 0x7fec5c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 -- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c004d00 msgr2=0x7fec5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c004d00 0x7fec5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.895+0000 7fec737fe640 1 -- 172.21.15.5:0/734303487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009a70 con 0x7fec5c003eb0 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.896+0000 7fec737fe640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5c003eb0 0x7fec5c0047c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c90 tx=0x7fec5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7407d6d40d34548b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.896+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68031400 con 0x7fec5c003eb0 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.896+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6802d050 con 0x7fec5c003eb0 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.896+0000 7fec72ffd640 1 -- 172.21.15.5:0/734303487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68031760 con 0x7fec5c003eb0 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 -- 172.21.15.5:0/734303487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5c003eb0 msgr2=0x7fec5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 --2- 172.21.15.5:0/734303487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec5c003eb0 0x7fec5c0047c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c90 tx=0x7fec5c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec78b09640 1 -- 172.21.15.5:0/734303487 reap_dead start 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 -- 172.21.15.5:0/734303487 shutdown_connections 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 -- 172.21.15.5:0/734303487 >> 172.21.15.5:0/734303487 conn(0x7fec740ce0d0 msgr2=0x7fec740ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 -- 172.21.15.5:0/734303487 shutdown_connections 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.897+0000 7fec7a56c640 1 -- 172.21.15.5:0/734303487 wait complete. 2024-09-13T17:14:50.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.898+0000 7fec7a56c640 1 Processor -- start 2024-09-13T17:14:50.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.898+0000 7fec7a56c640 1 -- start start 2024-09-13T17:14:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c003eb0 0x7fec74145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 0x7fec740af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec74070b10 con 0x7fec74070150 2024-09-13T17:14:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740ca450 con 0x7fec5c003eb0 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec7a56c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740ca730 con 0x7fec740af010 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46794/0 (socket says 172.21.15.5:46794) 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 -- 172.21.15.5:0/155154138 learned_addr learned my addr 172.21.15.5:0/155154138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec73fff640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c003eb0 0x7fec74145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec78b09640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 0x7fec740af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 -- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 msgr2=0x7fec740af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 0x7fec740af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 -- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c003eb0 msgr2=0x7fec74145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c003eb0 0x7fec74145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec737fe640 1 -- 172.21.15.5:0/155154138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740caa10 con 0x7fec74070150 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.899+0000 7fec78b09640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 0x7fec740af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec737fe640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c90 tx=0x7fec68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6803a600 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6803a7a0 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740cacf0 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6803ab50 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.900+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74145990 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.901+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740672a0 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.901+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec68038040 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.902+0000 7fec70ff9640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 0x7fec6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.902+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec680a9470 con 0x7fec74070150 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.902+0000 7fec73fff640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 0x7fec6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.903+0000 7fec73fff640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 0x7fec6006d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec64007fd0 tx=0x7fec640078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:50.906+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec68074650 con 0x7fec74070150 2024-09-13T17:14:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.088+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec740abec0 con 0x7fec74070150 2024-09-13T17:14:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.088+0000 7fec70ff9640 1 -- 172.21.15.5:0/155154138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec68077c70 con 0x7fec74070150 2024-09-13T17:14:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 msgr2=0x7fec6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 0x7fec6006d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec64007fd0 tx=0x7fec640078f0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 msgr2=0x7fec740705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c90 tx=0x7fec68004730 comp rx=0 tx=0).stop 2024-09-13T17:14:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 shutdown_connections 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740af010 0x7fec740af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec6006ac00 0x7fec6006d0c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec74070150 0x7fec740705d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 --2- 172.21.15.5:0/155154138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5c003eb0 0x7fec74145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.090+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 >> 172.21.15.5:0/155154138 conn(0x7fec740ce0d0 msgr2=0x7fec740ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.091+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 shutdown_connections 2024-09-13T17:14:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.091+0000 7fec7a56c640 1 -- 172.21.15.5:0/155154138 wait complete. 2024-09-13T17:14:51.102 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:51.102 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:51.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 Processor -- start 2024-09-13T17:14:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 -- start start 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb01806e1c0 0x7fb0180aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb01815a290 0x7fb0180b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180b2390 con 0x7fb018156f40 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01815a740 con 0x7fb01815a290 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.224+0000 7fb01df57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180b1780 con 0x7fb01806e1c0 2024-09-13T17:14:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb0177fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb018156f40 0x7fb01806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49302/0 (socket says 172.21.15.5:49302) 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb017fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb01815a290 0x7fb0180b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb0177fe640 1 -- 172.21.15.5:0/1696712373 learned_addr learned my addr 172.21.15.5:0/1696712373 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb016ffd640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb01806e1c0 0x7fb0180aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb017fff640 1 -- 172.21.15.5:0/1696712373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb01806e1c0 msgr2=0x7fb0180aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb017fff640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb01806e1c0 0x7fb0180aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb017fff640 1 -- 172.21.15.5:0/1696712373 >> v1:172.21.15.5:6789/0 conn(0x7fb018156f40 legacy=0x7fb01806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb017fff640 1 -- 172.21.15.5:0/1696712373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180b1a60 con 0x7fb01815a290 2024-09-13T17:14:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.225+0000 7fb0167fc640 1 -- 172.21.15.5:0/1696712373 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807454157 0 0) 0x7fb0180b2390 con 0x7fb018156f40 2024-09-13T17:14:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb017fff640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815a290 0x7fb0180b1080 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffe65d0eda4ca7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb0167fc640 1 -- 172.21.15.5:0/1696712373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010007740 con 0x7fb01815a290 2024-09-13T17:14:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb0167fc640 1 -- 172.21.15.5:0/1696712373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01002d050 con 0x7fb01815a290 2024-09-13T17:14:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb0167fc640 1 -- 172.21.15.5:0/1696712373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010007ac0 con 0x7fb01815a290 2024-09-13T17:14:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 -- 172.21.15.5:0/1696712373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815a290 msgr2=0x7fb0180b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815a290 0x7fb0180b1080 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002a660 comp rx=0 tx=0).stop 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 -- 172.21.15.5:0/1696712373 shutdown_connections 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815a290 0x7fb0180b1080 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 --2- 172.21.15.5:0/1696712373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb01806e1c0 0x7fb0180aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 -- 172.21.15.5:0/1696712373 >> 172.21.15.5:0/1696712373 conn(0x7fb0180ce0d0 msgr2=0x7fb0180ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.226+0000 7fb01df57640 1 -- 172.21.15.5:0/1696712373 shutdown_connections 2024-09-13T17:14:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.227+0000 7fb01df57640 1 -- 172.21.15.5:0/1696712373 wait complete. 2024-09-13T17:14:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.228+0000 7fb01df57640 1 Processor -- start 2024-09-13T17:14:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.228+0000 7fb01df57640 1 -- start start 2024-09-13T17:14:51.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb018156f40 0x7fb0181518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb01815a290 0x7fb018151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018154770 con 0x7fb01806e1c0 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018154a50 con 0x7fb01815a290 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01814e360 con 0x7fb018156f40 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46798/0 (socket says 172.21.15.5:46798) 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 -- 172.21.15.5:0/1635853734 learned_addr learned my addr 172.21.15.5:0/1635853734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb017fff640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb01815a290 0x7fb018151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb016ffd640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb018156f40 0x7fb0181518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 -- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb018156f40 msgr2=0x7fb0181518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb018156f40 0x7fb0181518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 -- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb01815a290 msgr2=0x7fb018151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb01815a290 0x7fb018151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 -- 172.21.15.5:0/1635853734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009a70 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb0177fe640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c4d0 tx=0x7fb00800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080074e0 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008007660 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008004a20 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.229+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01814e640 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.230+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01814ade0 con 0x7fb01806e1c0 2024-09-13T17:14:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.230+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0180672a0 con 0x7fb01806e1c0 2024-09-13T17:14:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.231+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb008004b80 con 0x7fb01806e1c0 2024-09-13T17:14:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.231+0000 7faffffff640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 0x7fb00406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.231+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb008088600 con 0x7fb01806e1c0 2024-09-13T17:14:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.232+0000 7fb016ffd640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 0x7fb00406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.232+0000 7fb016ffd640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 0x7fb00406d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb0180af580 tx=0x7fb00c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.236+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb008053740 con 0x7fb01806e1c0 2024-09-13T17:14:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.409+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0181548b0 con 0x7fb01806e1c0 2024-09-13T17:14:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.410+0000 7faffffff640 1 -- 172.21.15.5:0/1635853734 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7fb0181548b0 con 0x7fb01806e1c0 2024-09-13T17:14:51.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:51.412 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 msgr2=0x7fb00406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 0x7fb00406d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb0180af580 tx=0x7fb00c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 msgr2=0x7fb0181489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c4d0 tx=0x7fb00800c990 comp rx=0 tx=0).stop 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 shutdown_connections 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb01815a290 0x7fb018151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb018156f40 0x7fb0181518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb00406ac00 0x7fb00406d0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 --2- 172.21.15.5:0/1635853734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01806e1c0 0x7fb0181489b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 >> 172.21.15.5:0/1635853734 conn(0x7fb0180ce0d0 msgr2=0x7fb0180abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 shutdown_connections 2024-09-13T17:14:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.412+0000 7fb01df57640 1 -- 172.21.15.5:0/1635853734 wait complete. 2024-09-13T17:14:51.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:51.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:51.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.527+0000 7fee10733640 1 Processor -- start 2024-09-13T17:14:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.527+0000 7fee10733640 1 -- start start 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee10733640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee0806eb80 0x7fee080b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee10733640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee080b35f0 con 0x7fee0806ef60 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee10733640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee08156f50 con 0x7fee080b1ac0 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee10733640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0815d140 con 0x7fee0806eb80 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee0ecd0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee0806ef60 0x7fee0806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49310/0 (socket says 172.21.15.5:49310) 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee0ecd0640 1 -- 172.21.15.5:0/3162973791 learned_addr learned my addr 172.21.15.5:0/3162973791 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.528+0000 7fee0e4cf640 1 --2- 172.21.15.5:0/3162973791 >> v2:172.21.15.179:3300/0 conn(0x7fee0806eb80 0x7fee080b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476144937 0 0) 0x7fee080b35f0 con 0x7fee0806ef60 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf0003520 con 0x7fee0806ef60 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1460403518 0 0) 0x7fedf0003520 con 0x7fee0806ef60 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 >> v2:172.21.15.179:3300/0 conn(0x7fee0806eb80 msgr2=0x7fee080b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 --2- 172.21.15.5:0/3162973791 >> v2:172.21.15.179:3300/0 conn(0x7fee0806eb80 0x7fee080b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 >> v1:172.21.15.179:6789/0 conn(0x7fee080b1ac0 legacy=0x7fee0815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080b3f60 con 0x7fee0806ef60 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fee00001670 con 0x7fee0806ef60 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 >> v1:172.21.15.5:6789/0 conn(0x7fee0806ef60 legacy=0x7fee0806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf0003970 0x7fedf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fedf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf0005180 0x7fedf000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf000bff0 con 0x7fedf00047c0 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf000c160 con 0x7fedf0005180 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf000c320 con 0x7fedf0003970 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fedf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0e4cf640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf0003970 0x7fedf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0ecd0640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf0005180 0x7fedf000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 -- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf0003970 msgr2=0x7fedf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedf0003970 0x7fedf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 -- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf0005180 msgr2=0x7fedf000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf0005180 0x7fedf000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0dcce640 1 -- 172.21.15.5:0/3162973791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0003520 con 0x7fedf00047c0 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0ecd0640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedf0005180 0x7fedf000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.529+0000 7fee0ecd0640 1 -- 172.21.15.5:0/3162973791 reap_dead start 2024-09-13T17:14:51.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.530+0000 7fee0dcce640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fedf0004c40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001580 tx=0x7fedf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1369720c920a792 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.530+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0052d0 con 0x7fedf00047c0 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.530+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc005430 con 0x7fedf00047c0 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.530+0000 7fee0d4cd640 1 -- 172.21.15.5:0/3162973791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc02aa00 con 0x7fedf00047c0 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 -- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 msgr2=0x7fedf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fedf0004c40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001580 tx=0x7fedf00057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 -- 172.21.15.5:0/3162973791 shutdown_connections 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 --2- 172.21.15.5:0/3162973791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fedf0004c40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 -- 172.21.15.5:0/3162973791 >> 172.21.15.5:0/3162973791 conn(0x7fee08070af0 msgr2=0x7fee08070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 -- 172.21.15.5:0/3162973791 shutdown_connections 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.531+0000 7fee10733640 1 -- 172.21.15.5:0/3162973791 wait complete. 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.532+0000 7fee10733640 1 Processor -- start 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.532+0000 7fee10733640 1 -- start start 2024-09-13T17:14:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee081426e0 0x7fee0814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 0x7fee0814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0814ef00 con 0x7fedf00047c0 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee080ce370 con 0x7fee0814e510 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee10733640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee080cc710 con 0x7fee081426e0 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46818/0 (socket says 172.21.15.5:46818) 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 -- 172.21.15.5:0/2906222982 learned_addr learned my addr 172.21.15.5:0/2906222982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0dcce640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee081426e0 0x7fee0814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0ecd0640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 0x7fee0814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 -- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee081426e0 msgr2=0x7fee0814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee081426e0 0x7fee0814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 -- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 msgr2=0x7fee0814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 0x7fee0814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 -- 172.21.15.5:0/2906222982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080ce0a0 con 0x7fedf00047c0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0ecd0640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 0x7fee0814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.533+0000 7fee0e4cf640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fedf8011e60 tx=0x7fedf800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.534+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800e040 con 0x7fedf00047c0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.534+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800f040 con 0x7fedf00047c0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.534+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee080ccba0 con 0x7fedf00047c0 2024-09-13T17:14:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.534+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8015850 con 0x7fedf00047c0 2024-09-13T17:14:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.534+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee080cc0c0 con 0x7fedf00047c0 2024-09-13T17:14:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.535+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee080672e0 con 0x7fedf00047c0 2024-09-13T17:14:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.535+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedf80159b0 con 0x7fedf00047c0 2024-09-13T17:14:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.536+0000 7fee06ffd640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 0x7fedf406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.536+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fedf808a0d0 con 0x7fedf00047c0 2024-09-13T17:14:51.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.536+0000 7fee0dcce640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 0x7fedf406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.536+0000 7fee0dcce640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 0x7fedf406d0f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fedfc032000 tx=0x7fedfc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.540+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fedf8055200 con 0x7fedf00047c0 2024-09-13T17:14:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.711+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee080b3a20 con 0x7fedf00047c0 2024-09-13T17:14:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.711+0000 7fee06ffd640 1 -- 172.21.15.5:0/2906222982 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedf8058820 con 0x7fedf00047c0 2024-09-13T17:14:51.713 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 msgr2=0x7fedf406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 0x7fedf406d0f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fedfc032000 tx=0x7fedfc02e000 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 msgr2=0x7fee080cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fedf8011e60 tx=0x7fedf800f580 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 shutdown_connections 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee0814e510 0x7fee0814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee081426e0 0x7fee0814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fedf406ac30 0x7fedf406d0f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 --2- 172.21.15.5:0/2906222982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedf00047c0 0x7fee080cdb60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 >> 172.21.15.5:0/2906222982 conn(0x7fee08070af0 msgr2=0x7fee08070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 shutdown_connections 2024-09-13T17:14:51.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.713+0000 7fee10733640 1 -- 172.21.15.5:0/2906222982 wait complete. 2024-09-13T17:14:51.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.830+0000 7f163a2c3640 1 Processor -- start 2024-09-13T17:14:51.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.830+0000 7f163a2c3640 1 -- start start 2024-09-13T17:14:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f163a2c3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1634157e20 0x7f163415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f163a2c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 0x7f163406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f163a2c3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163406c520 con 0x7f16340ad010 2024-09-13T17:14:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f163a2c3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163415b900 con 0x7f1634157e20 2024-09-13T17:14:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f163a2c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163406db00 con 0x7f163406c090 2024-09-13T17:14:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f1633fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1634157e20 0x7f163415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f16337fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 0x7f163406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f1633fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1634157e20 0x7f163415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:34026/0 (socket says 172.21.15.5:34026) 2024-09-13T17:14:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f1633fff640 1 -- 172.21.15.5:0/3593523388 learned_addr learned my addr 172.21.15.5:0/3593523388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f1638860640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f16340ad010 0x7f16340ad460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:60666/0 (socket says 172.21.15.5:60666) 2024-09-13T17:14:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.831+0000 7f1633fff640 1 -- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 msgr2=0x7f163406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1633fff640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 0x7f163406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1633fff640 1 -- 172.21.15.5:0/3593523388 >> v1:172.21.15.179:6789/0 conn(0x7f16340ad010 legacy=0x7f16340ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1633fff640 1 -- 172.21.15.5:0/3593523388 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163406c800 con 0x7f1634157e20 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1632ffd640 1 -- 172.21.15.5:0/3593523388 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301041249 0 0) 0x7f163406c520 con 0x7f16340ad010 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f16337fe640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 0x7f163406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1633fff640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634157e20 0x7f163415b3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f162402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18be1ae0eeb54312 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.832+0000 7f1632ffd640 1 -- 172.21.15.5:0/3593523388 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624032440 con 0x7f1634157e20 2024-09-13T17:14:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f1632ffd640 1 -- 172.21.15.5:0/3593523388 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16240325a0 con 0x7f1634157e20 2024-09-13T17:14:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f1632ffd640 1 -- 172.21.15.5:0/3593523388 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624032930 con 0x7f1634157e20 2024-09-13T17:14:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 -- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634157e20 msgr2=0x7f163415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634157e20 0x7f163415b3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f162402a250 comp rx=0 tx=0).stop 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 -- 172.21.15.5:0/3593523388 shutdown_connections 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f163406c090 0x7f163406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 --2- 172.21.15.5:0/3593523388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1634157e20 0x7f163415b3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 -- 172.21.15.5:0/3593523388 >> 172.21.15.5:0/3593523388 conn(0x7f16340ce130 msgr2=0x7f16340ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 -- 172.21.15.5:0/3593523388 shutdown_connections 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.833+0000 7f163a2c3640 1 -- 172.21.15.5:0/3593523388 wait complete. 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.834+0000 7f163a2c3640 1 Processor -- start 2024-09-13T17:14:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.834+0000 7f163a2c3640 1 -- start start 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16340ad010 0x7f163414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 0x7f1634154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163414e580 con 0x7f1634157e20 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163414d970 con 0x7f16340b1ec0 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f163a2c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163414dc50 con 0x7f16340ad010 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f16337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f16337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46820/0 (socket says 172.21.15.5:46820) 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f16337fe640 1 -- 172.21.15.5:0/2396355838 learned_addr learned my addr 172.21.15.5:0/2396355838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.835+0000 7f1633fff640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16340ad010 0x7f163414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f1638860640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 0x7f1634154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 -- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16340ad010 msgr2=0x7f163414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16340ad010 0x7f163414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 -- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 msgr2=0x7f1634154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 0x7f1634154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 -- 172.21.15.5:0/2396355838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009400 con 0x7f1634157e20 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f1638860640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 0x7f1634154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f16337fe640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f161c00ebe0 tx=0x7f161c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c009760 con 0x7f1634157e20 2024-09-13T17:14:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00cc30 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240094d0 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00eee0 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.836+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163414e210 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.837+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340672a0 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.837+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f161c013470 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.838+0000 7f1630ff9640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 0x7f161406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.838+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f161c089a80 con 0x7f1634157e20 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.838+0000 7f1633fff640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 0x7f161406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.839+0000 7f1633fff640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 0x7f161406d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1624034000 tx=0x7f162402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:51.842+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f161c054bb0 con 0x7f1634157e20 2024-09-13T17:14:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.015+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1634158200 con 0x7f1634157e20 2024-09-13T17:14:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.015+0000 7f1630ff9640 1 -- 172.21.15.5:0/2396355838 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f161c017020 con 0x7f1634157e20 2024-09-13T17:14:52.016 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 msgr2=0x7f161406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 0x7f161406d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1624034000 tx=0x7f162402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 msgr2=0x7f1634097a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f161c00ebe0 tx=0x7f161c00c520 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 shutdown_connections 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16340b1ec0 0x7f1634154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f161406ac00 0x7f161406d0c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1634157e20 0x7f1634097a50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 --2- 172.21.15.5:0/2396355838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16340ad010 0x7f163414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 >> 172.21.15.5:0/2396355838 conn(0x7f16340ce130 msgr2=0x7f16340af560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 shutdown_connections 2024-09-13T17:14:52.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.017+0000 7f163a2c3640 1 -- 172.21.15.5:0/2396355838 wait complete. 2024-09-13T17:14:52.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.133+0000 7fa627b65640 1 Processor -- start 2024-09-13T17:14:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.133+0000 7fa627b65640 1 -- start start 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa627b65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa62015fd80 0x7fa6200cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa627b65640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa620099110 0x7fa62006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa627b65640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6200704a0 con 0x7fa6200d0e30 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa627b65640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62006cc10 con 0x7fa620099110 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa627b65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62006bd80 con 0x7fa62015fd80 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa625100640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6200d0e30 0x7fa620098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49320/0 (socket says 172.21.15.5:49320) 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa626102640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa620099110 0x7fa62006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa625100640 1 -- 172.21.15.5:0/3383905037 learned_addr learned my addr 172.21.15.5:0/3383905037 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa625901640 1 --2- 172.21.15.5:0/3383905037 >> v2:172.21.15.179:3300/0 conn(0x7fa62015fd80 0x7fa6200cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa626102640 1 -- 172.21.15.5:0/3383905037 >> v2:172.21.15.179:3300/0 conn(0x7fa62015fd80 msgr2=0x7fa6200cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa626102640 1 --2- 172.21.15.5:0/3383905037 >> v2:172.21.15.179:3300/0 conn(0x7fa62015fd80 0x7fa6200cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa626102640 1 -- 172.21.15.5:0/3383905037 >> v1:172.21.15.5:6789/0 conn(0x7fa6200d0e30 legacy=0x7fa620098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.134+0000 7fa626102640 1 -- 172.21.15.5:0/3383905037 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200d1270 con 0x7fa620099110 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.135+0000 7fa626102640 1 --2- 172.21.15.5:0/3383905037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa620099110 0x7fa62006e870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa620071620 tx=0x7fa61802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e1357e6f7b9a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.135+0000 7fa6248ff640 1 -- 172.21.15.5:0/3383905037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618007740 con 0x7fa620099110 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.135+0000 7fa6248ff640 1 -- 172.21.15.5:0/3383905037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61802d050 con 0x7fa620099110 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.135+0000 7fa6248ff640 1 -- 172.21.15.5:0/3383905037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618007ac0 con 0x7fa620099110 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 -- 172.21.15.5:0/3383905037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa620099110 msgr2=0x7fa62006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 --2- 172.21.15.5:0/3383905037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa620099110 0x7fa62006e870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa620071620 tx=0x7fa61802a5f0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 -- 172.21.15.5:0/3383905037 shutdown_connections 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 --2- 172.21.15.5:0/3383905037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa620099110 0x7fa62006e870 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 --2- 172.21.15.5:0/3383905037 >> v2:172.21.15.179:3300/0 conn(0x7fa62015fd80 0x7fa6200cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 -- 172.21.15.5:0/3383905037 >> 172.21.15.5:0/3383905037 conn(0x7fa6200d0310 msgr2=0x7fa6200d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 -- 172.21.15.5:0/3383905037 shutdown_connections 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.136+0000 7fa627b65640 1 -- 172.21.15.5:0/3383905037 wait complete. 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.137+0000 7fa627b65640 1 Processor -- start 2024-09-13T17:14:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.137+0000 7fa627b65640 1 -- start start 2024-09-13T17:14:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa620099110 0x7fa620159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 0x7fa6200c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c48f0 con 0x7fa62015fd80 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c4bd0 con 0x7fa6200d0e30 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa627b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200c4eb0 con 0x7fa620099110 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46834/0 (socket says 172.21.15.5:46834) 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 -- 172.21.15.5:0/3730951223 learned_addr learned my addr 172.21.15.5:0/3730951223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa625901640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa620099110 0x7fa620159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa625100640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 0x7fa6200c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 -- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa620099110 msgr2=0x7fa620159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa620099110 0x7fa620159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 -- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 msgr2=0x7fa6200c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 0x7fa6200c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa626102640 1 -- 172.21.15.5:0/3730951223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009a70 con 0x7fa62015fd80 2024-09-13T17:14:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.138+0000 7fa625100640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 0x7fa6200c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa626102640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa61802abe0 tx=0x7fa618004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618031890 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6180319f0 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6200c5190 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618031d60 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.139+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6200adec0 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.140+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6200c56b0 con 0x7fa62015fd80 2024-09-13T17:14:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.140+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa61803c420 con 0x7fa62015fd80 2024-09-13T17:14:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.141+0000 7fa6167fc640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 0x7fa60406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.141+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa6180ab190 con 0x7fa62015fd80 2024-09-13T17:14:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.141+0000 7fa625901640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 0x7fa60406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.141+0000 7fa625901640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 0x7fa60406d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006fd0 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.145+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa6200c56b0 con 0x7fa62015fd80 2024-09-13T17:14:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.315+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6200c56b0 con 0x7fa62015fd80 2024-09-13T17:14:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.315+0000 7fa6167fc640 1 -- 172.21.15.5:0/3730951223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6200c56b0 con 0x7fa62015fd80 2024-09-13T17:14:52.316 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 msgr2=0x7fa60406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 0x7fa60406d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006fd0 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 msgr2=0x7fa6200ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa61802abe0 tx=0x7fa618004a40 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 shutdown_connections 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa60406ac00 0x7fa60406d0c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62015fd80 0x7fa6200ad1e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6200d0e30 0x7fa6200c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 --2- 172.21.15.5:0/3730951223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa620099110 0x7fa620159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 >> 172.21.15.5:0/3730951223 conn(0x7fa6200d0310 msgr2=0x7fa6200ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 shutdown_connections 2024-09-13T17:14:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.317+0000 7fa627b65640 1 -- 172.21.15.5:0/3730951223 wait complete. 2024-09-13T17:14:52.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.431+0000 7f2389733640 1 Processor -- start 2024-09-13T17:14:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.431+0000 7f2389733640 1 -- start start 2024-09-13T17:14:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f2389733640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f238415a3e0 0x7f238406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f2389733640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238406d410 con 0x7f23840ab770 2024-09-13T17:14:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f2389733640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238406cb70 con 0x7f238406c320 2024-09-13T17:14:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f2389733640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238406ce50 con 0x7f238415a3e0 2024-09-13T17:14:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f23837fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23840ab770 0x7f23840b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49336/0 (socket says 172.21.15.5:49336) 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f23837fe640 1 -- 172.21.15.5:0/873712437 learned_addr learned my addr 172.21.15.5:0/873712437 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.432+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484576024 0 0) 0x7f238406d410 con 0x7f23840ab770 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2382ffd640 1 --2- 172.21.15.5:0/873712437 >> v2:172.21.15.179:3300/0 conn(0x7f238415a3e0 0x7f238406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2370003520 con 0x7f23840ab770 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398320981 0 0) 0x7f2370003520 con 0x7f23840ab770 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 >> v2:172.21.15.179:3300/0 conn(0x7f238415a3e0 msgr2=0x7f238406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 --2- 172.21.15.5:0/873712437 >> v2:172.21.15.179:3300/0 conn(0x7f238415a3e0 0x7f238406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 >> v1:172.21.15.179:6789/0 conn(0x7f238406c320 legacy=0x7f23840ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238406d130 con 0x7f23840ab770 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f23740019f0 con 0x7f23840ab770 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 >> v1:172.21.15.5:6789/0 conn(0x7f23840ab770 legacy=0x7f23840b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2370003970 0x7f2370003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 0x7f2370004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2370005180 0x7f237000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238406ce50 con 0x7f23700047c0 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237000c020 con 0x7f2370005180 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237000c1e0 con 0x7f2370003970 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 0x7f2370004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f2382ffd640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2370003970 0x7f2370003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23837fe640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2370005180 0x7f237000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 -- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2370003970 msgr2=0x7f2370003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2370003970 0x7f2370003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 -- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2370005180 msgr2=0x7f237000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2370005180 0x7f237000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23837fe640 1 -- 172.21.15.5:0/873712437 reap_dead start 2024-09-13T17:14:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.433+0000 7f23827fc640 1 -- 172.21.15.5:0/873712437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2370003520 con 0x7f23700047c0 2024-09-13T17:14:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.434+0000 7f23827fc640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 0x7f2370004c40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f236c001750 tx=0x7f23700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ace08c12e0af02d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.434+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c0052d0 con 0x7f23700047c0 2024-09-13T17:14:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.434+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c005430 con 0x7f23700047c0 2024-09-13T17:14:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.434+0000 7f2381ffb640 1 -- 172.21.15.5:0/873712437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c02abc0 con 0x7f23700047c0 2024-09-13T17:14:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 -- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 msgr2=0x7f2370004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 0x7f2370004c40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f236c001750 tx=0x7f23700057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 -- 172.21.15.5:0/873712437 shutdown_connections 2024-09-13T17:14:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 --2- 172.21.15.5:0/873712437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23700047c0 0x7f2370004c40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 -- 172.21.15.5:0/873712437 >> 172.21.15.5:0/873712437 conn(0x7f23840ce0d0 msgr2=0x7f23840ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 -- 172.21.15.5:0/873712437 shutdown_connections 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.435+0000 7f2389733640 1 -- 172.21.15.5:0/873712437 wait complete. 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.436+0000 7f2389733640 1 Processor -- start 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.436+0000 7f2389733640 1 -- start start 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700047c0 0x7f2384159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414d990 0x7f238414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384159840 con 0x7f238414b550 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238414e760 con 0x7f23700047c0 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2389733640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238414ea40 con 0x7f238414d990 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46852/0 (socket says 172.21.15.5:46852) 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 -- 172.21.15.5:0/3526862832 learned_addr learned my addr 172.21.15.5:0/3526862832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23837fe640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414d990 0x7f238414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f2382ffd640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700047c0 0x7f2384159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 -- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414d990 msgr2=0x7f238414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414d990 0x7f238414de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 -- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700047c0 msgr2=0x7f2384159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700047c0 0x7f2384159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.437+0000 7f23827fc640 1 -- 172.21.15.5:0/3526862832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238414ed20 con 0x7f238414b550 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f23827fc640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f236c000c00 tx=0x7f236c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c007240 con 0x7f238414b550 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c0073a0 con 0x7f238414b550 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c0067d0 con 0x7f238414b550 2024-09-13T17:14:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238414f000 con 0x7f238414b550 2024-09-13T17:14:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.438+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841f1f60 con 0x7f238414b550 2024-09-13T17:14:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.439+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23841f1f60 con 0x7f238414b550 2024-09-13T17:14:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.439+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f236c006930 con 0x7f238414b550 2024-09-13T17:14:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.440+0000 7f237b7fe640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 0x7f236406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.440+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f236c0a9290 con 0x7f238414b550 2024-09-13T17:14:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.440+0000 7f2382ffd640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 0x7f236406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.441+0000 7f2382ffd640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 0x7f236406d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f237c009bc0 tx=0x7f237c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.444+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f236c0742a0 con 0x7f238414b550 2024-09-13T17:14:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.655+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23841f1f60 con 0x7f238414b550 2024-09-13T17:14:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.655+0000 7f237b7fe640 1 -- 172.21.15.5:0/3526862832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f236c0778c0 con 0x7f238414b550 2024-09-13T17:14:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:52.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 msgr2=0x7f236406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 0x7f236406d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f237c009bc0 tx=0x7f237c009190 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 msgr2=0x7f23841f1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f236c000c00 tx=0x7f236c001120 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 shutdown_connections 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f238414d990 0x7f238414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f236406ac00 0x7f236406d0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f238414b550 0x7f23841f1a20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 --2- 172.21.15.5:0/3526862832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700047c0 0x7f2384159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 >> 172.21.15.5:0/3526862832 conn(0x7f23840ce0d0 msgr2=0x7f238415e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 shutdown_connections 2024-09-13T17:14:52.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.657+0000 7f2389733640 1 -- 172.21.15.5:0/3526862832 wait complete. 2024-09-13T17:14:52.669 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:14:52.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:52.669 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:14:52.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[43783]: fuse finished with error 0 and tester_r 0 2024-09-13T17:14:52.701 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:52.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:14:52.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:52.723 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:14:52.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:52.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.881+0000 7f930fa41640 1 Processor -- start 2024-09-13T17:14:52.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 -- start start 2024-09-13T17:14:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93080b1970 0x7f930806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 0x7f9308070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93080b1580 con 0x7f9308159290 2024-09-13T17:14:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9308071450 con 0x7f93080b1970 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.882+0000 7f930fa41640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080b2ad0 con 0x7f9308070a80 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93080b1970 0x7f930806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93080b1970 0x7f930806c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46858/0 (socket says 172.21.15.5:46858) 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 -- 172.21.15.5:0/2853876364 learned_addr learned my addr 172.21.15.5:0/2853876364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 -- 172.21.15.5:0/2853876364 >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 msgr2=0x7f9308070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2853876364 >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 0x7f9308070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 --2- 172.21.15.5:0/2853876364 >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 0x7f9308070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 -- 172.21.15.5:0/2853876364 >> v1:172.21.15.179:6789/0 conn(0x7f9308159290 legacy=0x7f9308159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930d7dd640 1 -- 172.21.15.5:0/2853876364 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080b1ec0 con 0x7f93080b1970 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.883+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2853876364 >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 0x7f9308070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f930d7dd640 1 --2- 172.21.15.5:0/2853876364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b1970 0x7f930806c110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f93080b0e20 tx=0x7f930402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bf2391b677cf7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f92fffff640 1 -- 172.21.15.5:0/2853876364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930402f070 con 0x7f93080b1970 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f92fffff640 1 -- 172.21.15.5:0/2853876364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93040325a0 con 0x7f93080b1970 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f92fffff640 1 -- 172.21.15.5:0/2853876364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304032930 con 0x7f93080b1970 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f930fa41640 1 -- 172.21.15.5:0/2853876364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b1970 msgr2=0x7f930806c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.884+0000 7f930fa41640 1 --2- 172.21.15.5:0/2853876364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b1970 0x7f930806c110 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f93080b0e20 tx=0x7f930402c8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 -- 172.21.15.5:0/2853876364 shutdown_connections 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 --2- 172.21.15.5:0/2853876364 >> v2:172.21.15.179:3300/0 conn(0x7f9308070a80 0x7f9308070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 --2- 172.21.15.5:0/2853876364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93080b1970 0x7f930806c110 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 -- 172.21.15.5:0/2853876364 >> 172.21.15.5:0/2853876364 conn(0x7f93080ce0d0 msgr2=0x7f93080ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 -- 172.21.15.5:0/2853876364 shutdown_connections 2024-09-13T17:14:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.885+0000 7f930fa41640 1 -- 172.21.15.5:0/2853876364 wait complete. 2024-09-13T17:14:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.886+0000 7f930fa41640 1 Processor -- start 2024-09-13T17:14:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.886+0000 7f930fa41640 1 -- start start 2024-09-13T17:14:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 0x7f93081ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 0x7f930809bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080ca7a0 con 0x7f9308070a80 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080caa80 con 0x7f9308159290 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080cad60 con 0x7f93080b1970 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46870/0 (socket says 172.21.15.5:46870) 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 -- 172.21.15.5:0/2701950961 learned_addr learned my addr 172.21.15.5:0/2701950961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 0x7f93081ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930dfde640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 0x7f930809bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 -- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 msgr2=0x7f93081ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 0x7f93081ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 -- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 msgr2=0x7f930809bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 0x7f930809bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 -- 172.21.15.5:0/2701950961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930400b770 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 0x7f93081ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930dfde640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 0x7f930809bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930d7dd640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9304000c00 tx=0x7f9304004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304033d30 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304033e90 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080cb040 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.887+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930403c660 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.888+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308151e00 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.889+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080672a0 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.889+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f930403c7c0 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.889+0000 7f92fdffb640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 0x7f92ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.890+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93040aa500 con 0x7f9308070a80 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.890+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 0x7f92ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.890+0000 7f930cfdc640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 0x7f92ec06d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f930806c230 tx=0x7f92f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:52.894+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9304075590 con 0x7f9308070a80 2024-09-13T17:14:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.100+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93080b2f60 con 0x7f9308070a80 2024-09-13T17:14:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.100+0000 7f92fdffb640 1 -- 172.21.15.5:0/2701950961 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f9304078bb0 con 0x7f9308070a80 2024-09-13T17:14:53.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:53.102 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:14:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:14:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 msgr2=0x7f92ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 0x7f92ec06d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f930806c230 tx=0x7f92f8008040 comp rx=0 tx=0).stop 2024-09-13T17:14:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 msgr2=0x7f930814c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9304000c00 tx=0x7f9304004730 comp rx=0 tx=0).stop 2024-09-13T17:14:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 shutdown_connections 2024-09-13T17:14:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9308159290 0x7f930809bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b1970 0x7f93081ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92ec06ac00 0x7f92ec06d0c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 --2- 172.21.15.5:0/2701950961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9308070a80 0x7f930814c300 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 >> 172.21.15.5:0/2701950961 conn(0x7f93080ce0d0 msgr2=0x7f9308159670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 shutdown_connections 2024-09-13T17:14:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.102+0000 7f930fa41640 1 -- 172.21.15.5:0/2701950961 wait complete. 2024-09-13T17:14:53.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-13T17:14:53.231 INFO:teuthology.orchestra.run.smithi005.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":44,"msgr_send_messages":33,"msgr_recv_bytes":13412,"msgr_send_bytes":20917,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.009206760,"msgr_running_send_time":0.000948955,"msgr_running_recv_time":0.005513949,"msgr_running_fast_dispatch_time":0.001206606,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.234317173,"avgtime":0.007322411},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000013649,"avgtime":0.000000620},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":73,"msgr_send_messages":67,"msgr_recv_bytes":115592,"msgr_send_bytes":18216,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.007712374,"msgr_running_send_time":0.001621520,"msgr_running_recv_time":0.008778093,"msgr_running_fast_dispatch_time":0.000208288,"msgr_send_messages_queue_lat":{"avgcount":67,"sum":0.042754999,"avgtime":0.000638134},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":112880,"msgr_send_encrypted_bytes":13632},"AsyncMessenger::Worker-2":{"msgr_recv_messages":22,"msgr_send_messages":27,"msgr_recv_bytes":6133,"msgr_send_bytes":122381,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.004844124,"msgr_running_send_time":0.001064538,"msgr_running_recv_time":0.003132337,"msgr_running_fast_dispatch_time":0.000368680,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.055898202,"avgtime":0.002149930},"msgr_handle_ack_lat":{"avgcount":19,"sum":0.000002343,"avgtime":0.000000123},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":96544},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":45,"sum":0.003078074,"avgtime":0.000068401}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010860,"avgtime":0.000005430}},"mds":{"request":3,"reply":3,"reply_latency":{"avgcount":3,"sum":0.000674695,"avgtime":0.000224898},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":5,"traverse_hit":5,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":6,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197177,"rdpos":0,"jlat":{"avgcount":5,"sum":0.009374815,"avgtime":0.001874963},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":41988,"heap":207200},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":8,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":2,"sum":0.000442060,"avgtime":0.000221030},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000232635,"avgtime":0.000232635},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":2,"average_load":1,"avg_session_uptime":11,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229507,"buffer_anon_items":67,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":14083,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.750985494,"avgtime":0.017067852},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":135,"get_sum":118620,"get_or_fail_fail":0,"get_or_fail_success":135,"take":0,"take_sum":0,"put":135,"put_sum":118620,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":14083,"put":44,"put_sum":14083,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b782dc00a0":{"val":0,"max":3758096384,"get_started":0,"get":6,"get_sum":2873,"get_or_fail_fail":0,"get_or_fail_success":6,"take":0,"take_sum":0,"put":5,"put_sum":2873,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T17:14:53.232 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.2e-07, "sum": 1.3649e-05 }, "msgr_recv_bytes": 13412, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.001206606, "msgr_running_recv_time": 0.005513949, "msgr_running_send_time": 0.000948955, "msgr_running_total_time": 0.00920676, "msgr_send_bytes": 20917, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.007322411, "sum": 0.234317173 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 115592, "msgr_recv_encrypted_bytes": 112880, "msgr_recv_messages": 73, "msgr_running_fast_dispatch_time": 0.000208288, "msgr_running_recv_time": 0.008778093, "msgr_running_send_time": 0.00162152, "msgr_running_total_time": 0.007712374, "msgr_send_bytes": 18216, "msgr_send_encrypted_bytes": 13632, "msgr_send_messages": 67, "msgr_send_messages_queue_lat": { "avgcount": 67, "avgtime": 0.000638134, "sum": 0.042754999 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 19, "avgtime": 1.23e-07, "sum": 2.343e-06 }, "msgr_recv_bytes": 6133, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.00036868, "msgr_running_recv_time": 0.003132337, "msgr_running_send_time": 0.001064538, "msgr_running_total_time": 0.004844124, "msgr_send_bytes": 122381, "msgr_send_encrypted_bytes": 96544, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.00214993, "sum": 0.055898202 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 45, "avgtime": 6.8401e-05, "sum": 0.003078074 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.43e-06, "sum": 1.086e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 3, "reply_latency": { "avgcount": 3, "avgtime": 0.000224898, "sum": 0.000674695 }, "request": 3, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 6, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001874963, "sum": 0.009374815 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197177 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 41988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 8, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 2, "avgtime": 0.00022103, "sum": 0.00044206 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000232635, "sum": 0.000232635 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 11, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 2 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229507, "buffer_anon_items": 67, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.017067852, "sum": 0.750985494 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 14083, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 135, "get_or_fail_fail": 0, "get_or_fail_success": 135, "get_started": 0, "get_sum": 118620, "max": 104857600, "put": 135, "put_sum": 118620, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 14083, "take": 44, "take_sum": 14083, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b782dc00a0": { "get": 6, "get_or_fail_fail": 0, "get_or_fail_success": 6, "get_started": 0, "get_sum": 2873, "max": 3758096384, "put": 5, "put_sum": 2873, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T17:14:53.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:14:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.333+0000 7fef6d220640 1 Processor -- start 2024-09-13T17:14:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.333+0000 7fef6d220640 1 -- start start 2024-09-13T17:14:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6d220640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef6815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6d220640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef6806e1c0 0x7fef680aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6d220640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680b2390 con 0x7fef680b1080 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6d220640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680b14c0 con 0x7fef6806e1c0 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6d220640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680b1780 con 0x7fef68156f40 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef680b1080 0x7fef6806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49346/0 (socket says 172.21.15.5:49346) 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6659c640 1 -- 172.21.15.5:0/68895369 learned_addr learned my addr 172.21.15.5:0/68895369 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef66d9d640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef6815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef6759e640 1 --2- 172.21.15.5:0/68895369 >> v2:172.21.15.179:3300/0 conn(0x7fef6806e1c0 0x7fef680aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804394551 0 0) 0x7fef680b2390 con 0x7fef680b1080 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef50003520 con 0x7fef680b1080 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000288523 0 0) 0x7fef50003520 con 0x7fef680b1080 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 msgr2=0x7fef6815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef6815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 >> v2:172.21.15.179:3300/0 conn(0x7fef6806e1c0 msgr2=0x7fef680aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 --2- 172.21.15.5:0/68895369 >> v2:172.21.15.179:3300/0 conn(0x7fef6806e1c0 0x7fef680aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680b1a60 con 0x7fef680b1080 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.334+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fef5c001670 con 0x7fef680b1080 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 >> v1:172.21.15.5:6789/0 conn(0x7fef680b1080 legacy=0x7fef6806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef50003970 0x7fef50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef50004d00 0x7fef50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680b14c0 con 0x7fef50004d00 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680b1780 con 0x7fef50003970 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5000b980 con 0x7fef68156f40 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef50004d00 0x7fef50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef66d9d640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef50003970 0x7fef50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6659c640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 -- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 msgr2=0x7fef500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef68156f40 0x7fef500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 -- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef50003970 msgr2=0x7fef50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef50003970 0x7fef50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.335+0000 7fef6759e640 1 -- 172.21.15.5:0/68895369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50003520 con 0x7fef50004d00 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6759e640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef50004d00 0x7fef50005180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fef6806b910 tx=0x7fef500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c91208c45b323f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60031610 con 0x7fef50004d00 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6000f040 con 0x7fef50004d00 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef65d9b640 1 -- 172.21.15.5:0/68895369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60031970 con 0x7fef50004d00 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6d220640 1 -- 172.21.15.5:0/68895369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef50004d00 msgr2=0x7fef50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6d220640 1 --2- 172.21.15.5:0/68895369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef50004d00 0x7fef50005180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fef6806b910 tx=0x7fef500057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6759e640 1 -- 172.21.15.5:0/68895369 reap_dead start 2024-09-13T17:14:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6d220640 1 -- 172.21.15.5:0/68895369 shutdown_connections 2024-09-13T17:14:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.336+0000 7fef6d220640 1 -- 172.21.15.5:0/68895369 >> 172.21.15.5:0/68895369 conn(0x7fef680ce0d0 msgr2=0x7fef680ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.337+0000 7fef6d220640 1 -- 172.21.15.5:0/68895369 shutdown_connections 2024-09-13T17:14:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.337+0000 7fef6d220640 1 -- 172.21.15.5:0/68895369 wait complete. 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.338+0000 7fef6d220640 1 Processor -- start 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.338+0000 7fef6d220640 1 -- start start 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef50004d00 0x7fef6814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef68099ec0 0x7fef6814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef68098e50 con 0x7fef681e5db0 2024-09-13T17:14:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681e6770 con 0x7fef68099ec0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6d220640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68098210 con 0x7fef50004d00 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46882/0 (socket says 172.21.15.5:46882) 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 -- 172.21.15.5:0/1579228097 learned_addr learned my addr 172.21.15.5:0/1579228097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef66d9d640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef50004d00 0x7fef6814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6659c640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef68099ec0 0x7fef6814ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 -- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef50004d00 msgr2=0x7fef6814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef50004d00 0x7fef6814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 -- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef68099ec0 msgr2=0x7fef6814ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef68099ec0 0x7fef6814ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.339+0000 7fef6759e640 1 -- 172.21.15.5:0/1579228097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6814e540 con 0x7fef681e5db0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef6759e640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fef6002ade0 tx=0x7fef60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60045430 con 0x7fef681e5db0 2024-09-13T17:14:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60040070 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680984b0 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600457d0 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.340+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68098a70 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.341+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef680672a0 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.341+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef60042030 con 0x7fef681e5db0 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.342+0000 7fef4f7fe640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 0x7fef5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.342+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fef600aa930 con 0x7fef681e5db0 2024-09-13T17:14:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.342+0000 7fef66d9d640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 0x7fef5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.343+0000 7fef66d9d640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 0x7fef5406d0f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fef58009b40 tx=0x7fef58009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.346+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef60075b80 con 0x7fef681e5db0 2024-09-13T17:14:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.551+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef6806dab0 con 0x7fef681e5db0 2024-09-13T17:14:53.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.551+0000 7fef4f7fe640 1 -- 172.21.15.5:0/1579228097 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef600791a0 con 0x7fef681e5db0 2024-09-13T17:14:53.552 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:14:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 msgr2=0x7fef5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 0x7fef5406d0f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fef58009b40 tx=0x7fef58009190 comp rx=0 tx=0).stop 2024-09-13T17:14:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 msgr2=0x7fef681e6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fef6002ade0 tx=0x7fef60009750 comp rx=0 tx=0).stop 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 shutdown_connections 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fef5406ac30 0x7fef5406d0f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef681e5db0 0x7fef681e6230 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef68099ec0 0x7fef6814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 --2- 172.21.15.5:0/1579228097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef50004d00 0x7fef6814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 >> 172.21.15.5:0/1579228097 conn(0x7fef680ce0d0 msgr2=0x7fef6809a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 shutdown_connections 2024-09-13T17:14:53.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:53.553+0000 7fef6d220640 1 -- 172.21.15.5:0/1579228097 wait complete. 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:14:53.565 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:14:53.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:14:53.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:53.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.566 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:14:53.582 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:14:53.582 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:14:53.583 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:14:53.584 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:14:53.585 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:14:53.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.586 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:14:53.648 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:14:53.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.649 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:14:53.706 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:14:53.706 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:14:53.707 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:14:53.707 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:14:53.707 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:14:53.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.707 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:14:53.707 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:14:53.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:14:53.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:14:53.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:14:53.708 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:14:53.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.796 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:14:53.811 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:14:53.811 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:14:53.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:53.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:53.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:14:53.877 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:14:53.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:53.878 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:53.934 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:14:53.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:14:53.934 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:53.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:14:54.056 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:54.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:54.122 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:54.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:54.122 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:14:54.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:14:54.179 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:14:54.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:14:54.247 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:14:54.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:14:54.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:14:54.303+0000 7f33f88fb480 -1 init, newargv = 0x55d048946100 newargc=15 2024-09-13T17:14:54.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[54248]: starting ceph client 2024-09-13T17:14:54.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[54248]: starting fuse 2024-09-13T17:14:54.314 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:14:54.316 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:14:54.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:54.316 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:14:54.373 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:14:54.373 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:14:54.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:14:54.373 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:14:54.373 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:14:54.373 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:14:54.374 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:14:54.375 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:14:54.488 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.54248.asok 2024-09-13T17:14:54.675 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54248.asok 2024-09-13T17:14:54.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:54.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54248.asok status 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:14:54.814 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "54248", 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5880, 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 5880 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:54.815 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3619974198 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3619974198 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.5880 192.168.0.1:0/3619974198", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/3619974198", 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:14:54.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 15, 2024-09-13T17:14:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 40, 2024-09-13T17:14:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:14:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:14:54.817 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:14:54.817 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:14:54.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:54.823 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:14:54.823 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:54.839 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:14:54.839 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:54.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:54.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:54.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-13T17:14:55.062 INFO:teuthology.orchestra.run.smithi005.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":45,"msgr_send_messages":34,"msgr_recv_bytes":13658,"msgr_send_bytes":21670,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.009344429,"msgr_running_send_time":0.000980313,"msgr_running_recv_time":0.005533411,"msgr_running_fast_dispatch_time":0.001237832,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.234336177,"avgtime":0.007101096},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000013649,"avgtime":0.000000620},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":73,"msgr_send_messages":67,"msgr_recv_bytes":115592,"msgr_send_bytes":18216,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.007769582,"msgr_running_send_time":0.001644738,"msgr_running_recv_time":0.008788113,"msgr_running_fast_dispatch_time":0.000208288,"msgr_send_messages_queue_lat":{"avgcount":67,"sum":0.042754999,"avgtime":0.000638134},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":112880,"msgr_send_encrypted_bytes":13632},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":30,"msgr_recv_bytes":6962,"msgr_send_bytes":123223,"msgr_created_connections":9,"msgr_active_connections":4,"msgr_running_total_time":0.005293572,"msgr_running_send_time":0.001143808,"msgr_running_recv_time":0.003521699,"msgr_running_fast_dispatch_time":0.000368680,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.055931192,"avgtime":0.001928661},"msgr_handle_ack_lat":{"avgcount":25,"sum":0.000004888,"avgtime":0.000000195},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":96544},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":47,"sum":0.003131940,"avgtime":0.000066637}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010860,"avgtime":0.000005430}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000943680,"avgtime":0.000235920},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197619,"rdpos":0,"jlat":{"avgcount":6,"sum":0.011295123,"avgtime":0.001882520},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":42244,"heap":207200},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":10,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000711045,"avgtime":0.000237015},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000232635,"avgtime":0.000232635},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":3,"average_load":3,"avg_session_uptime":11,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229507,"buffer_anon_items":67,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14525,"op_resend":37,"op_reply":45,"op_latency":{"avgcount":45,"sum":0.751985475,"avgtime":0.016710788},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":139,"get_sum":119335,"get_or_fail_fail":0,"get_or_fail_success":139,"take":0,"take_sum":0,"put":139,"put_sum":119335,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14525,"put":45,"put_sum":14525,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b782dc00a0":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":3315,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":6,"put_sum":3315,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T17:14:55.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.2e-07, "sum": 1.3649e-05 }, "msgr_recv_bytes": 13658, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 45, "msgr_running_fast_dispatch_time": 0.001237832, "msgr_running_recv_time": 0.005533411, "msgr_running_send_time": 0.000980313, "msgr_running_total_time": 0.009344429, "msgr_send_bytes": 21670, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.007101096, "sum": 0.234336177 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 115592, "msgr_recv_encrypted_bytes": 112880, "msgr_recv_messages": 73, "msgr_running_fast_dispatch_time": 0.000208288, "msgr_running_recv_time": 0.008788113, "msgr_running_send_time": 0.001644738, "msgr_running_total_time": 0.007769582, "msgr_send_bytes": 18216, "msgr_send_encrypted_bytes": 13632, "msgr_send_messages": 67, "msgr_send_messages_queue_lat": { "avgcount": 67, "avgtime": 0.000638134, "sum": 0.042754999 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 25, "avgtime": 1.95e-07, "sum": 4.888e-06 }, "msgr_recv_bytes": 6962, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.00036868, "msgr_running_recv_time": 0.003521699, "msgr_running_send_time": 0.001143808, "msgr_running_total_time": 0.005293572, "msgr_send_bytes": 123223, "msgr_send_encrypted_bytes": 96544, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.001928661, "sum": 0.055931192 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 47, "avgtime": 6.6637e-05, "sum": 0.00313194 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.43e-06, "sum": 1.086e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.00023592, "sum": 0.00094368 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.00188252, "sum": 0.011295123 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197619 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42244 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 10, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000237015, "sum": 0.000711045 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000232635, "sum": 0.000232635 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 3, "avg_session_uptime": 11, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229507, "buffer_anon_items": 67, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.016710788, "sum": 0.751985475 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14525, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 139, "get_or_fail_fail": 0, "get_or_fail_success": 139, "get_started": 0, "get_sum": 119335, "max": 104857600, "put": 139, "put_sum": 119335, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14525, "take": 45, "take_sum": 14525, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b782dc00a0": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 3315, "max": 3758096384, "put": 6, "put_sum": 3315, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T17:14:55.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:55.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:55.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:55.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.220+0000 7f1019672640 1 Processor -- start 2024-09-13T17:14:55.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.220+0000 7f1019672640 1 -- start start 2024-09-13T17:14:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1019672640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10140ce1f0 0x7f10141674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1019672640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140b0be0 con 0x7f101415fb90 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1019672640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140affd0 con 0x7f101415ff70 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1019672640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140b02b0 con 0x7f10140ce1f0 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1012ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f101415fb90 0x7f10140b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50754/0 (socket says 172.21.15.5:50754) 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.221+0000 7f1012ffd640 1 -- 172.21.15.5:0/2909717142 learned_addr learned my addr 172.21.15.5:0/2909717142 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f10137fe640 1 --2- 172.21.15.5:0/2909717142 >> v2:172.21.15.179:3300/0 conn(0x7f10140ce1f0 0x7f10141674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765919955 0 0) 0x7f10140b0be0 con 0x7f101415fb90 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1000003520 con 0x7f101415fb90 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3340448023 0 0) 0x7f1000003520 con 0x7f101415fb90 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 >> v2:172.21.15.179:3300/0 conn(0x7f10140ce1f0 msgr2=0x7f10141674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 --2- 172.21.15.5:0/2909717142 >> v2:172.21.15.179:3300/0 conn(0x7f10140ce1f0 0x7f10141674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 >> v1:172.21.15.179:6789/0 conn(0x7f101415ff70 legacy=0x7f10140b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140b0590 con 0x7f101415fb90 2024-09-13T17:14:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f10040019f0 con 0x7f101415fb90 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 >> v1:172.21.15.5:6789/0 conn(0x7f101415fb90 legacy=0x7f10140b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1000003970 0x7f1000003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10000047c0 0x7f1000004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f100000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b02b0 con 0x7f1000005180 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100000c020 con 0x7f1000003970 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100000c1e0 con 0x7f10000047c0 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f10137fe640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f100000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f1012ffd640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1000003970 0x7f1000003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f10127fc640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10000047c0 0x7f1000004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f10137fe640 1 -- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10000047c0 msgr2=0x7f1000004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.222+0000 7f10137fe640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10000047c0 0x7f1000004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f10137fe640 1 -- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1000003970 msgr2=0x7f1000003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f10137fe640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1000003970 0x7f1000003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f10137fe640 1 -- 172.21.15.5:0/2909717142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000003520 con 0x7f1000005180 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f10137fe640 1 -- 172.21.15.5:0/2909717142 reap_dead start 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f10137fe640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f100000b980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f100c009ac0 tx=0x7f10000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2a700325968b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c004020 con 0x7f1000005180 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c02d050 con 0x7f1000005180 2024-09-13T17:14:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.223+0000 7f1011ffb640 1 -- 172.21.15.5:0/2909717142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0043c0 con 0x7f1000005180 2024-09-13T17:14:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 -- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 msgr2=0x7f100000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f100000b980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f100c009ac0 tx=0x7f10000057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 -- 172.21.15.5:0/2909717142 shutdown_connections 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 --2- 172.21.15.5:0/2909717142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f100000b980 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 -- 172.21.15.5:0/2909717142 >> 172.21.15.5:0/2909717142 conn(0x7f1014089f90 msgr2=0x7f10140d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 -- 172.21.15.5:0/2909717142 shutdown_connections 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.224+0000 7f1019672640 1 -- 172.21.15.5:0/2909717142 wait complete. 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.225+0000 7f1019672640 1 Processor -- start 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.225+0000 7f1019672640 1 -- start start 2024-09-13T17:14:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 0x7f10140b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f101406c5a0 0x7f101406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101406cf60 con 0x7f1000005180 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101415a580 con 0x7f101414b8e0 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1019672640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b4b00 con 0x7f101406c5a0 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41500/0 (socket says 172.21.15.5:41500) 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 -- 172.21.15.5:0/283542161 learned_addr learned my addr 172.21.15.5:0/283542161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f10137fe640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f101406c5a0 0x7f101406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f10127fc640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 0x7f10140b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 -- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f101406c5a0 msgr2=0x7f101406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f101406c5a0 0x7f101406ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 -- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 msgr2=0x7f10140b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 0x7f10140b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f1012ffd640 1 -- 172.21.15.5:0/283542161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101415a820 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.226+0000 7f10127fc640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 0x7f10140b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f1012ffd640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f10040021e0 tx=0x7f1004007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400acb0 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400ae10 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101415ab00 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004013630 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.227+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140b4760 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.228+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10140b5860 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.228+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1004013790 con 0x7f1000005180 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.229+0000 7f100b7fe640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 0x7f0ff406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.229+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f100408a0f0 con 0x7f1000005180 2024-09-13T17:14:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.229+0000 7f10127fc640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 0x7f0ff406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.229+0000 7f10127fc640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 0x7f0ff406d0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f101415c6e0 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.233+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1004055190 con 0x7f1000005180 2024-09-13T17:14:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.410+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10140cec50 con 0x7f1000005180 2024-09-13T17:14:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.411+0000 7f100b7fe640 1 -- 172.21.15.5:0/283542161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f10040587b0 con 0x7f1000005180 2024-09-13T17:14:55.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:55.413 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:28.527404+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 msgr2=0x7f0ff406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 0x7f0ff406d0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f101415c6e0 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 msgr2=0x7f10141f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f10040021e0 tx=0x7f1004007ba0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 shutdown_connections 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f101406c5a0 0x7f101406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f101414b8e0 0x7f10140b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0ff406ac30 0x7f0ff406d0f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 --2- 172.21.15.5:0/283542161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1000005180 0x7f10141f5df0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 >> 172.21.15.5:0/283542161 conn(0x7f1014089f90 msgr2=0x7f101406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 shutdown_connections 2024-09-13T17:14:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.413+0000 7f1019672640 1 -- 172.21.15.5:0/283542161 wait complete. 2024-09-13T17:14:55.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:55.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 Processor -- start 2024-09-13T17:14:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 -- start start 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb61c1591e0 0x7fb61c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb61c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c0ad050 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61c06e400 con 0x7fb61c1591e0 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.530+0000 7fb6229ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0ac440 con 0x7fb61c06da30 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb613fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb61c0ad4e0 0x7fb61c0b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50764/0 (socket says 172.21.15.5:50764) 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb613fff640 1 -- 172.21.15.5:0/382629068 learned_addr learned my addr 172.21.15.5:0/382629068 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb61c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61bfff640 1 --2- 172.21.15.5:0/382629068 >> v2:172.21.15.179:3300/0 conn(0x7fb61c1591e0 0x7fb61c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095691180 0 0) 0x7fb61c0ad050 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb608003520 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945895782 0 0) 0x7fb608003520 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 msgr2=0x7fb61c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb61c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 >> v2:172.21.15.179:3300/0 conn(0x7fb61c1591e0 msgr2=0x7fb61c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 --2- 172.21.15.5:0/382629068 >> v2:172.21.15.179:3300/0 conn(0x7fb61c1591e0 0x7fb61c0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0ac720 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb604001670 con 0x7fb61c0ad4e0 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb61c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 >> v1:172.21.15.5:6789/0 conn(0x7fb61c0ad4e0 legacy=0x7fb61c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608003970 0x7fb608003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb6080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb608004d00 0x7fb608005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c06e400 con 0x7fb608004d00 2024-09-13T17:14:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0ac440 con 0x7fb608003970 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60800b980 con 0x7fb61c06da30 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.531+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb608004d00 0x7fb608005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb61bfff640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608003970 0x7fb608003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb613fff640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb6080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb620f8a640 1 -- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 msgr2=0x7fb6080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c06da30 0x7fb6080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb620f8a640 1 -- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608003970 msgr2=0x7fb608003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb608003970 0x7fb608003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.532+0000 7fb620f8a640 1 -- 172.21.15.5:0/382629068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009a70 con 0x7fb608004d00 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb620f8a640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb608004d00 0x7fb608005180 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e350 tx=0x7fb6080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c20e033343bea5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61402f660 con 0x7fb608004d00 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400f040 con 0x7fb608004d00 2024-09-13T17:14:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb61b7fe640 1 -- 172.21.15.5:0/382629068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61402f9c0 con 0x7fb608004d00 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 -- 172.21.15.5:0/382629068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb608004d00 msgr2=0x7fb608005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 --2- 172.21.15.5:0/382629068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb608004d00 0x7fb608005180 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e350 tx=0x7fb6080057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb620f8a640 1 -- 172.21.15.5:0/382629068 reap_dead start 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 -- 172.21.15.5:0/382629068 shutdown_connections 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 -- 172.21.15.5:0/382629068 >> 172.21.15.5:0/382629068 conn(0x7fb61c0ce130 msgr2=0x7fb61c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 -- 172.21.15.5:0/382629068 shutdown_connections 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.533+0000 7fb6229ed640 1 -- 172.21.15.5:0/382629068 wait complete. 2024-09-13T17:14:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 Processor -- start 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 -- start start 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 0x7fb61c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 0x7fb61c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c1f2b40 con 0x7fb61c157fa0 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c09a760 con 0x7fb61c09af60 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb6229ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c152c50 con 0x7fb608004d00 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb620f8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb620f8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41518/0 (socket says 172.21.15.5:41518) 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.535+0000 7fb620f8a640 1 -- 172.21.15.5:0/3546079752 learned_addr learned my addr 172.21.15.5:0/3546079752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb613fff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 0x7fb61c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb61bfff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 0x7fb61c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 -- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 msgr2=0x7fb61c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 0x7fb61c152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 -- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 msgr2=0x7fb61c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 0x7fb61c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 -- 172.21.15.5:0/3546079752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c1f1ec0 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb613fff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 0x7fb61c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb61bfff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 0x7fb61c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb620f8a640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e470 tx=0x7fb614009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61403e070 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614003990 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614003d20 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c1f21a0 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.536+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1f2760 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.537+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c0672a0 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.538+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb61402f670 con 0x7fb61c157fa0 2024-09-13T17:14:55.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.538+0000 7fb6197fa640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 0x7fb5fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.538+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb6140aa6c0 con 0x7fb61c157fa0 2024-09-13T17:14:55.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.538+0000 7fb61bfff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 0x7fb5fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.539+0000 7fb61bfff640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 0x7fb5fc06d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb61c1539c0 tx=0x7fb60c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.542+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb614079100 con 0x7fb61c157fa0 2024-09-13T17:14:55.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.718+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb61c1595c0 con 0x7fb61c157fa0 2024-09-13T17:14:55.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.719+0000 7fb6197fa640 1 -- 172.21.15.5:0/3546079752 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb614009de0 con 0x7fb61c157fa0 2024-09-13T17:14:55.720 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 msgr2=0x7fb5fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 0x7fb5fc06d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb61c1539c0 tx=0x7fb60c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 msgr2=0x7fb61c0713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e470 tx=0x7fb614009750 comp rx=0 tx=0).stop 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 shutdown_connections 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb5fc06ac00 0x7fb5fc06d0c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c157fa0 0x7fb61c0713b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c09af60 0x7fb61c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 --2- 172.21.15.5:0/3546079752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb608004d00 0x7fb61c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 >> 172.21.15.5:0/3546079752 conn(0x7fb61c0ce130 msgr2=0x7fb61c15cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 shutdown_connections 2024-09-13T17:14:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.721+0000 7fb6229ed640 1 -- 172.21.15.5:0/3546079752 wait complete. 2024-09-13T17:14:55.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.838+0000 7f397e376640 1 Processor -- start 2024-09-13T17:14:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.838+0000 7f397e376640 1 -- start start 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f397e376640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3978160000 0x7f39780b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f397e376640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3978160510 con 0x7f39780b3b00 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f397e376640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39781607f0 con 0x7f39780b2000 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f397e376640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397806e7b0 con 0x7f3978160000 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3977fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39780b3b00 0x7f397806eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50776/0 (socket says 172.21.15.5:50776) 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3977fff640 1 -- 172.21.15.5:0/3483618563 learned_addr learned my addr 172.21.15.5:0/3483618563 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f39777fe640 1 --2- 172.21.15.5:0/3483618563 >> v2:172.21.15.179:3300/0 conn(0x7f3978160000 0x7f39780b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410088514 0 0) 0x7f3978160510 con 0x7f39780b3b00 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3960003520 con 0x7f39780b3b00 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102886175 0 0) 0x7f3960003520 con 0x7f39780b3b00 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 >> v2:172.21.15.179:3300/0 conn(0x7f3978160000 msgr2=0x7f39780b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 --2- 172.21.15.5:0/3483618563 >> v2:172.21.15.179:3300/0 conn(0x7f3978160000 0x7f39780b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 >> v1:172.21.15.179:6789/0 conn(0x7f39780b2000 legacy=0x7f397815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978160ad0 con 0x7f39780b3b00 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3968001670 con 0x7f39780b3b00 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 >> v1:172.21.15.5:6789/0 conn(0x7f39780b3b00 legacy=0x7f397806eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960003970 0x7f3960003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39600047c0 0x7f3960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 0x7f396000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397806e7b0 con 0x7f3960005180 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396000c020 con 0x7f39600047c0 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.839+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396000c1e0 con 0x7f3960003970 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 0x7f396000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f3977fff640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960003970 0x7f3960003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f39777fe640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39600047c0 0x7f3960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 -- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960003970 msgr2=0x7f3960003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960003970 0x7f3960003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 -- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39600047c0 msgr2=0x7f3960004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39600047c0 0x7f3960004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 -- 172.21.15.5:0/3483618563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960003520 con 0x7f3960005180 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.840+0000 7f397c913640 1 -- 172.21.15.5:0/3483618563 reap_dead start 2024-09-13T17:14:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397c913640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 0x7f396000b980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f397806e3d0 tx=0x7f39600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19ad8ad13a6f2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397002ae10 con 0x7f3960005180 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970003970 con 0x7f3960005180 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f3976ffd640 1 -- 172.21.15.5:0/3483618563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970003d20 con 0x7f3960005180 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 -- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 msgr2=0x7f396000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 0x7f396000b980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f397806e3d0 tx=0x7f39600057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 -- 172.21.15.5:0/3483618563 shutdown_connections 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 --2- 172.21.15.5:0/3483618563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3960005180 0x7f396000b980 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 -- 172.21.15.5:0/3483618563 >> 172.21.15.5:0/3483618563 conn(0x7f3978070af0 msgr2=0x7f3978070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 -- 172.21.15.5:0/3483618563 shutdown_connections 2024-09-13T17:14:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.841+0000 7f397e376640 1 -- 172.21.15.5:0/3483618563 wait complete. 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.842+0000 7f397e376640 1 Processor -- start 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 -- start start 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960005180 0x7f39780c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 0x7f39781f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780af9e0 con 0x7f39780af020 2024-09-13T17:14:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39781f2ec0 con 0x7f397815f070 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397e376640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39781f22b0 con 0x7f3960005180 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397c913640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397c913640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41534/0 (socket says 172.21.15.5:41534) 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.843+0000 7f397c913640 1 -- 172.21.15.5:0/3506732973 learned_addr learned my addr 172.21.15.5:0/3506732973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f3977fff640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960005180 0x7f39780c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f39777fe640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 0x7f39781f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 -- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960005180 msgr2=0x7f39780c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960005180 0x7f39780c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 -- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 msgr2=0x7f39781f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 0x7f39781f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 -- 172.21.15.5:0/3506732973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39781f2590 con 0x7f39780af020 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f39777fe640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 0x7f39781f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397c913640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3970001f10 tx=0x7f39700014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970039070 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970005860 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39781f2870 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970006d70 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.844+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39780cd990 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.845+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39780672e0 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.846+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3970007030 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.846+0000 7f3974ff9640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 0x7f396406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.846+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39700a88e0 con 0x7f39780af020 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.846+0000 7f3977fff640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 0x7f396406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:55.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.847+0000 7f3977fff640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 0x7f396406d0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3968007ba0 tx=0x7f3968009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:55.850+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3970073af0 con 0x7f39780af020 2024-09-13T17:14:56.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.020+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f397806eb30 con 0x7f39780af020 2024-09-13T17:14:56.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.020+0000 7f3974ff9640 1 -- 172.21.15.5:0/3506732973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3970077110 con 0x7f39780af020 2024-09-13T17:14:56.021 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 msgr2=0x7f396406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 0x7f396406d0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3968007ba0 tx=0x7f3968009040 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 msgr2=0x7f39780af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3970001f10 tx=0x7f39700014a0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 shutdown_connections 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f396406ac30 0x7f396406d0f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39780af020 0x7f39780af4a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f397815f070 0x7f39781f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 --2- 172.21.15.5:0/3506732973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3960005180 0x7f39780c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 >> 172.21.15.5:0/3506732973 conn(0x7f3978070af0 msgr2=0x7f3978070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 shutdown_connections 2024-09-13T17:14:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.022+0000 7f397e376640 1 -- 172.21.15.5:0/3506732973 wait complete. 2024-09-13T17:14:56.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.137+0000 7f135419c640 1 Processor -- start 2024-09-13T17:14:56.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 -- start start 2024-09-13T17:14:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f134c1591e0 0x7f134c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f134c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c0ad050 con 0x7f134c06da30 2024-09-13T17:14:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0ac440 con 0x7f134c1591e0 2024-09-13T17:14:56.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.138+0000 7f135419c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c0ac720 con 0x7f134c0ad4e0 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1352739640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f134c06da30 0x7f134c0700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50780/0 (socket says 172.21.15.5:50780) 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1352739640 1 -- 172.21.15.5:0/2322294833 learned_addr learned my addr 172.21.15.5:0/2322294833 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1351737640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f134c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1351f38640 1 --2- 172.21.15.5:0/2322294833 >> v2:172.21.15.179:3300/0 conn(0x7f134c1591e0 0x7f134c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716159371 0 0) 0x7f134c0ad050 con 0x7f134c06da30 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1338005730 con 0x7f134c06da30 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 781427398 0 0) 0x7f1338005730 con 0x7f134c06da30 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 msgr2=0x7f134c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f134c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 >> v2:172.21.15.179:3300/0 conn(0x7f134c1591e0 msgr2=0x7f134c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 --2- 172.21.15.5:0/2322294833 >> v2:172.21.15.179:3300/0 conn(0x7f134c1591e0 0x7f134c0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0aca00 con 0x7f134c06da30 2024-09-13T17:14:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f13440019f0 con 0x7f134c06da30 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1351f38640 1 --2- 172.21.15.5:0/2322294833 >> v2:172.21.15.179:3300/0 conn(0x7f134c1591e0 0x7f134c0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 >> v1:172.21.15.5:6789/0 conn(0x7f134c06da30 legacy=0x7f134c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f1338005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1338006100 0x7f13380069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006f10 0x7f1338007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c0ac440 con 0x7f1338006100 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c0ac720 con 0x7f1338006f10 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133800db90 con 0x7f134c0ad4e0 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1351737640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1338006100 0x7f13380069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1351f38640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f1338005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.139+0000 7f1352739640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006f10 0x7f1338007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 -- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 msgr2=0x7f1338005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c0ad4e0 0x7f1338005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 -- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006f10 msgr2=0x7f1338007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006f10 0x7f1338007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 -- 172.21.15.5:0/2322294833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338005730 con 0x7f1338006100 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1351737640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1338006100 0x7f13380069d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f133c009a90 tx=0x7f1338007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d981089fe6d1e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c031400 con 0x7f1338006100 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c02d050 con 0x7f1338006100 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.140+0000 7f1350f36640 1 -- 172.21.15.5:0/2322294833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c0317a0 con 0x7f1338006100 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 -- 172.21.15.5:0/2322294833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1338006100 msgr2=0x7f13380069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 --2- 172.21.15.5:0/2322294833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1338006100 0x7f13380069d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f133c009a90 tx=0x7f1338007a00 comp rx=0 tx=0).stop 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f1352739640 1 -- 172.21.15.5:0/2322294833 reap_dead start 2024-09-13T17:14:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 -- 172.21.15.5:0/2322294833 shutdown_connections 2024-09-13T17:14:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 -- 172.21.15.5:0/2322294833 >> 172.21.15.5:0/2322294833 conn(0x7f134c0ce130 msgr2=0x7f134c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 -- 172.21.15.5:0/2322294833 shutdown_connections 2024-09-13T17:14:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.141+0000 7f135419c640 1 -- 172.21.15.5:0/2322294833 wait complete. 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.142+0000 7f135419c640 1 Processor -- start 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.142+0000 7f135419c640 1 -- start start 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 0x7f134c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 0x7f134c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c150990 con 0x7f134c159940 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15c9d0 con 0x7f1338006100 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f135419c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c1500f0 con 0x7f134c1f5c80 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f1351737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f1351737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41540/0 (socket says 172.21.15.5:41540) 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.143+0000 7f1351737640 1 -- 172.21.15.5:0/4219317173 learned_addr learned my addr 172.21.15.5:0/4219317173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351f38640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 0x7f134c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1352739640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 0x7f134c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 -- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 msgr2=0x7f134c157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 0x7f134c157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 -- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 msgr2=0x7f134c14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 0x7f134c14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 -- 172.21.15.5:0/4219317173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c1503d0 con 0x7f134c159940 2024-09-13T17:14:56.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1352739640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 0x7f134c157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351f38640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 0x7f134c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f1351737640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f133c009bb0 tx=0x7f133c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c03a810 con 0x7f134c159940 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c03a970 con 0x7f134c159940 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c03ace0 con 0x7f134c159940 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c1506b0 con 0x7f134c159940 2024-09-13T17:14:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.144+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c1f6130 con 0x7f134c159940 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.145+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c14dd70 con 0x7f134c159940 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.146+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f133c038040 con 0x7f134c159940 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.146+0000 7f13427fc640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 0x7f133006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.146+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f133c0a97e0 con 0x7f134c159940 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.146+0000 7f1351f38640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 0x7f133006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.147+0000 7f1351f38640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 0x7f133006d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1348009cc0 tx=0x7f1348008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.150+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f134c14dd70 con 0x7f134c159940 2024-09-13T17:14:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.320+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f134c14dd70 con 0x7f134c159940 2024-09-13T17:14:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.321+0000 7f13427fc640 1 -- 172.21.15.5:0/4219317173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f134c14dd70 con 0x7f134c159940 2024-09-13T17:14:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 msgr2=0x7f133006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 0x7f133006d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1348009cc0 tx=0x7f1348008040 comp rx=0 tx=0).stop 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 msgr2=0x7f134c15c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f133c009bb0 tx=0x7f133c004730 comp rx=0 tx=0).stop 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 shutdown_connections 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f134c1f5c80 0x7f134c157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f133006ac00 0x7f133006d0c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f134c159940 0x7f134c15c490 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 --2- 172.21.15.5:0/4219317173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1338006100 0x7f134c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 >> 172.21.15.5:0/4219317173 conn(0x7f134c0ce130 msgr2=0x7f134c0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 shutdown_connections 2024-09-13T17:14:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.323+0000 7f135419c640 1 -- 172.21.15.5:0/4219317173 wait complete. 2024-09-13T17:14:56.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:56.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.436+0000 7ff86c241640 1 Processor -- start 2024-09-13T17:14:56.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.436+0000 7ff86c241640 1 -- start start 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86c241640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff86415fd80 0x7ff8640cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86c241640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff8640d0e30 0x7ff864098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86c241640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640704a0 con 0x7ff864098f40 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86c241640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86406cc10 con 0x7ff86415fd80 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86c241640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8640993b0 con 0x7ff8640d0e30 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff869fdd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff86415fd80 0x7ff8640cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86a7de640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff864098f40 0x7ff8640ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50796/0 (socket says 172.21.15.5:50796) 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.437+0000 7ff86a7de640 1 -- 172.21.15.5:0/2955870863 learned_addr learned my addr 172.21.15.5:0/2955870863 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff8697dc640 1 --2- 172.21.15.5:0/2955870863 >> v2:172.21.15.179:3300/0 conn(0x7ff8640d0e30 0x7ff864098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff869fdd640 1 -- 172.21.15.5:0/2955870863 >> v2:172.21.15.179:3300/0 conn(0x7ff8640d0e30 msgr2=0x7ff864098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2955870863 >> v2:172.21.15.179:3300/0 conn(0x7ff8640d0e30 0x7ff864098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff869fdd640 1 -- 172.21.15.5:0/2955870863 >> v1:172.21.15.5:6789/0 conn(0x7ff864098f40 legacy=0x7ff8640ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff869fdd640 1 -- 172.21.15.5:0/2955870863 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86406bd80 con 0x7ff86415fd80 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.438+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2955870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff8640cfd30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff86406cb60 tx=0x7ff85402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657a0b69491fb7af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff868fdb640 1 -- 172.21.15.5:0/2955870863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854031600 con 0x7ff86415fd80 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff868fdb640 1 -- 172.21.15.5:0/2955870863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85402d050 con 0x7ff86415fd80 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff868fdb640 1 -- 172.21.15.5:0/2955870863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854031980 con 0x7ff86415fd80 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 -- 172.21.15.5:0/2955870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 msgr2=0x7ff8640cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 --2- 172.21.15.5:0/2955870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff8640cfd30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff86406cb60 tx=0x7ff85402a610 comp rx=0 tx=0).stop 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 -- 172.21.15.5:0/2955870863 shutdown_connections 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 --2- 172.21.15.5:0/2955870863 >> v2:172.21.15.179:3300/0 conn(0x7ff8640d0e30 0x7ff864098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 --2- 172.21.15.5:0/2955870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff8640cfd30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 -- 172.21.15.5:0/2955870863 >> 172.21.15.5:0/2955870863 conn(0x7ff8640d0310 msgr2=0x7ff8640d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 -- 172.21.15.5:0/2955870863 shutdown_connections 2024-09-13T17:14:56.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.439+0000 7ff86c241640 1 -- 172.21.15.5:0/2955870863 wait complete. 2024-09-13T17:14:56.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 Processor -- start 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 -- start start 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 0x7ff8640b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 0x7ff86409a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640b4e20 con 0x7ff86415fd80 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640b5100 con 0x7ff864098f40 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86c241640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640b53e0 con 0x7ff8640d0e30 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86a7de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86a7de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41562/0 (socket says 172.21.15.5:41562) 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.441+0000 7ff86a7de640 1 -- 172.21.15.5:0/2551818428 learned_addr learned my addr 172.21.15.5:0/2551818428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff8697dc640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 0x7ff86409a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 0x7ff8640b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 -- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 msgr2=0x7ff86409a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 0x7ff86409a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 -- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 msgr2=0x7ff8640b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 0x7ff8640b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 -- 172.21.15.5:0/2551818428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854009a70 con 0x7ff86415fd80 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 0x7ff8640b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff8697dc640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 0x7ff86409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86a7de640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c370 tx=0x7ff85c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c005ce0 con 0x7ff86415fd80 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c005e40 con 0x7ff86415fd80 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640b56c0 con 0x7ff86415fd80 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0072d0 con 0x7ff86415fd80 2024-09-13T17:14:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.442+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86409aec0 con 0x7ff86415fd80 2024-09-13T17:14:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.443+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86414b570 con 0x7ff86415fd80 2024-09-13T17:14:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.444+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff85c0074f0 con 0x7ff86415fd80 2024-09-13T17:14:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.444+0000 7ff8627fc640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 0x7ff85006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.444+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff85c088810 con 0x7ff86415fd80 2024-09-13T17:14:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.444+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 0x7ff85006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.445+0000 7ff869fdd640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 0x7ff85006d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff854034000 tx=0x7ff85402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.448+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff86414b570 con 0x7ff86415fd80 2024-09-13T17:14:56.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.631+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff86414b570 con 0x7ff86415fd80 2024-09-13T17:14:56.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.631+0000 7ff8627fc640 1 -- 172.21.15.5:0/2551818428 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff86414b570 con 0x7ff86415fd80 2024-09-13T17:14:56.632 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 msgr2=0x7ff85006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 0x7ff85006d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff854034000 tx=0x7ff85402f000 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 msgr2=0x7ff86409d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c370 tx=0x7ff85c00c830 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 shutdown_connections 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff85006ac00 0x7ff85006d0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86415fd80 0x7ff86409d370 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8640d0e30 0x7ff86409a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 --2- 172.21.15.5:0/2551818428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff864098f40 0x7ff8640b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 >> 172.21.15.5:0/2551818428 conn(0x7ff8640d0310 msgr2=0x7ff86415e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 shutdown_connections 2024-09-13T17:14:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.633+0000 7ff86c241640 1 -- 172.21.15.5:0/2551818428 wait complete. 2024-09-13T17:14:56.645 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:56.645 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:56.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.802+0000 7fae4b0f7640 1 Processor -- start 2024-09-13T17:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.802+0000 7fae4b0f7640 1 -- start start 2024-09-13T17:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae4b0f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae4406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae4b0f7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4406d410 con 0x7fae4406c320 2024-09-13T17:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae4b0f7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4406cb70 con 0x7fae440ab770 2024-09-13T17:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae4b0f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4406ce50 con 0x7fae4415a3e0 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae43fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae4406c320 0x7fae440ab060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50806/0 (socket says 172.21.15.5:50806) 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae43fff640 1 -- 172.21.15.5:0/2619293315 learned_addr learned my addr 172.21.15.5:0/2619293315 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260051246 0 0) 0x7fae4406d410 con 0x7fae4406c320 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae48e93640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae4406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.803+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae2c003520 con 0x7fae4406c320 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469695401 0 0) 0x7fae2c003520 con 0x7fae4406c320 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 msgr2=0x7fae4406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae4406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 >> v1:172.21.15.179:6789/0 conn(0x7fae440ab770 legacy=0x7fae440b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4406d130 con 0x7fae4406c320 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fae380019f0 con 0x7fae4406c320 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 >> v1:172.21.15.5:6789/0 conn(0x7fae4406c320 legacy=0x7fae440ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2c0039a0 0x7fae2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0047c0 0x7fae2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4406ce50 con 0x7fae2c0039a0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00ba30 con 0x7fae2c0047c0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c00bbf0 con 0x7fae4415a3e0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2c0039a0 0x7fae2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae43fff640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0047c0 0x7fae2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae49694640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 -- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 msgr2=0x7fae2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4415a3e0 0x7fae2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 -- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0047c0 msgr2=0x7fae2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0047c0 0x7fae2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.804+0000 7fae48e93640 1 -- 172.21.15.5:0/2619293315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c003520 con 0x7fae2c0039a0 2024-09-13T17:14:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.805+0000 7fae48e93640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2c0039a0 0x7fae2c003dc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fae34009a90 tx=0x7fae2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9e9f84c57dfc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.805+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34031400 con 0x7fae2c0039a0 2024-09-13T17:14:56.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.805+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3402d050 con 0x7fae2c0039a0 2024-09-13T17:14:56.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.805+0000 7fae437fe640 1 -- 172.21.15.5:0/2619293315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34031780 con 0x7fae2c0039a0 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 -- 172.21.15.5:0/2619293315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2c0039a0 msgr2=0x7fae2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/2619293315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae2c0039a0 0x7fae2c003dc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fae34009a90 tx=0x7fae2c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae49694640 1 -- 172.21.15.5:0/2619293315 reap_dead start 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 -- 172.21.15.5:0/2619293315 shutdown_connections 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 -- 172.21.15.5:0/2619293315 >> 172.21.15.5:0/2619293315 conn(0x7fae440ce0d0 msgr2=0x7fae440ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 -- 172.21.15.5:0/2619293315 shutdown_connections 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.806+0000 7fae4b0f7640 1 -- 172.21.15.5:0/2619293315 wait complete. 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.807+0000 7fae4b0f7640 1 Processor -- start 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.807+0000 7fae4b0f7640 1 -- start start 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 0x7fae4414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4414d300 0x7fae4414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4414ce50 con 0x7fae4414f6c0 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4414dcc0 con 0x7fae2c0039a0 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae4b0f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4414f220 con 0x7fae4414d300 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41580/0 (socket says 172.21.15.5:41580) 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 -- 172.21.15.5:0/1867863731 learned_addr learned my addr 172.21.15.5:0/1867863731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae48e93640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 0x7fae4414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae49694640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4414d300 0x7fae4414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 -- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4414d300 msgr2=0x7fae4414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4414d300 0x7fae4414d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 -- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 msgr2=0x7fae4414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 0x7fae4414ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 -- 172.21.15.5:0/1867863731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae441523b0 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae48e93640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 0x7fae4414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.808+0000 7fae43fff640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fae38007970 tx=0x7fae3800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.809+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380133f0 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.809+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38013550 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.809+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380138c0 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.809+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae44152690 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.809+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4414bd40 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.810+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae440672a0 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.810+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae38013a20 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.811+0000 7fae417fa640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 0x7fae3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.811+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae3808a220 con 0x7fae4414f6c0 2024-09-13T17:14:56.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.811+0000 7fae48e93640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 0x7fae3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:56.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.811+0000 7fae48e93640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 0x7fae3006d0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae34033000 tx=0x7fae34008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:56.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.815+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae380552a0 con 0x7fae4414f6c0 2024-09-13T17:14:56.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.985+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae440ab060 con 0x7fae4414f6c0 2024-09-13T17:14:56.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.986+0000 7fae417fa640 1 -- 172.21.15.5:0/1867863731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16731 (secure 0 0 0) 0x7fae380588c0 con 0x7fae4414f6c0 2024-09-13T17:14:56.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:56.988 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:56.591368+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:56.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 msgr2=0x7fae3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 0x7fae3006d0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae34033000 tx=0x7fae34008030 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 msgr2=0x7fae440700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fae38007970 tx=0x7fae3800a6e0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 shutdown_connections 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae4414d300 0x7fae4414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3006ac00 0x7fae3006d0c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4414f6c0 0x7fae440700e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 --2- 172.21.15.5:0/1867863731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae2c0039a0 0x7fae4414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 >> 172.21.15.5:0/1867863731 conn(0x7fae440ce0d0 msgr2=0x7fae4415d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 shutdown_connections 2024-09-13T17:14:56.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:56.988+0000 7fae4b0f7640 1 -- 172.21.15.5:0/1867863731 wait complete. 2024-09-13T17:14:57.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:57.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.108+0000 7f7aee619640 1 Processor -- start 2024-09-13T17:14:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.108+0000 7f7aee619640 1 -- start start 2024-09-13T17:14:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7aee619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae815fd80 0x7f7ae80cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7aee619640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae80d0e30 0x7f7ae8098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7aee619640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80704a0 con 0x7f7ae8098f40 2024-09-13T17:14:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7aee619640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae80993f0 con 0x7f7ae80d0e30 2024-09-13T17:14:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7aee619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae806cc10 con 0x7f7ae815fd80 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae80d0e30 0x7f7ae8098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ae80d0e30 0x7f7ae8098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41586/0 (socket says 172.21.15.5:41586) 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 -- 172.21.15.5:0/3747906186 learned_addr learned my addr 172.21.15.5:0/3747906186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae7fff640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae815fd80 0x7f7ae80cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 -- 172.21.15.5:0/3747906186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae815fd80 msgr2=0x7f7ae80cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae815fd80 0x7f7ae80cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 -- 172.21.15.5:0/3747906186 >> v1:172.21.15.179:6789/0 conn(0x7f7ae8098f40 legacy=0x7f7ae80ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.109+0000 7f7ae77fe640 1 -- 172.21.15.5:0/3747906186 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae806bd80 con 0x7f7ae80d0e30 2024-09-13T17:14:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.110+0000 7f7ae77fe640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae80d0e30 0x7f7ae8098a00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009870 tx=0x7f7adc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b58b1058a3ac2db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.110+0000 7f7ae6ffd640 1 -- 172.21.15.5:0/3747906186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc032440 con 0x7f7ae80d0e30 2024-09-13T17:14:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.110+0000 7f7ae6ffd640 1 -- 172.21.15.5:0/3747906186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc0325a0 con 0x7f7ae80d0e30 2024-09-13T17:14:57.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.110+0000 7f7ae6ffd640 1 -- 172.21.15.5:0/3747906186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc032930 con 0x7f7ae80d0e30 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 -- 172.21.15.5:0/3747906186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae80d0e30 msgr2=0x7f7ae8098a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae80d0e30 0x7f7ae8098a00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009870 tx=0x7f7adc02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 -- 172.21.15.5:0/3747906186 shutdown_connections 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae80d0e30 0x7f7ae8098a00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 --2- 172.21.15.5:0/3747906186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae815fd80 0x7f7ae80cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 -- 172.21.15.5:0/3747906186 >> 172.21.15.5:0/3747906186 conn(0x7f7ae80d0310 msgr2=0x7f7ae80d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 -- 172.21.15.5:0/3747906186 shutdown_connections 2024-09-13T17:14:57.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.111+0000 7f7aee619640 1 -- 172.21.15.5:0/3747906186 wait complete. 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.112+0000 7f7aee619640 1 Processor -- start 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.112+0000 7f7aee619640 1 -- start start 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae8098f40 0x7f7ae8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80d0e30 0x7f7ae80adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80b0180 con 0x7f7ae815fd80 2024-09-13T17:14:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80c6880 con 0x7f7ae80d0e30 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aee619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80c5c70 con 0x7f7ae8098f40 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41588/0 (socket says 172.21.15.5:41588) 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 -- 172.21.15.5:0/4166227537 learned_addr learned my addr 172.21.15.5:0/4166227537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7ae7fff640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae8098f40 0x7f7ae8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7ae77fe640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80d0e30 0x7f7ae80adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 -- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae8098f40 msgr2=0x7f7ae8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae8098f40 0x7f7ae8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 -- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80d0e30 msgr2=0x7f7ae80adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80d0e30 0x7f7ae80adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 -- 172.21.15.5:0/4166227537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0094d0 con 0x7f7ae815fd80 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.113+0000 7f7aecbb6640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c6b0 tx=0x7f7ae000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.114+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0003b70 con 0x7f7ae815fd80 2024-09-13T17:14:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.114+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0003cf0 con 0x7f7ae815fd80 2024-09-13T17:14:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.114+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80c5f50 con 0x7f7ae815fd80 2024-09-13T17:14:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.114+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0003ea0 con 0x7f7ae815fd80 2024-09-13T17:14:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.114+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae80c6510 con 0x7f7ae815fd80 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.115+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80c69f0 con 0x7f7ae815fd80 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.115+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7ae0005310 con 0x7f7ae815fd80 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.115+0000 7f7ae4ff9640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 0x7f7ad406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.116+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ae0089150 con 0x7f7ae815fd80 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.116+0000 7f7ae7fff640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 0x7f7ad406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.116+0000 7f7ae7fff640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 0x7f7ad406d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009b40 tx=0x7f7ad8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.120+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7ae0054280 con 0x7f7ae815fd80 2024-09-13T17:14:57.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.289+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ae8160160 con 0x7f7ae815fd80 2024-09-13T17:14:57.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.289+0000 7f7ae4ff9640 1 -- 172.21.15.5:0/4166227537 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ae00578a0 con 0x7f7ae815fd80 2024-09-13T17:14:57.290 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 msgr2=0x7f7ad406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 0x7f7ad406d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009b40 tx=0x7f7ad8009190 comp rx=0 tx=0).stop 2024-09-13T17:14:57.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 msgr2=0x7f7ae80ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c6b0 tx=0x7f7ae000cb70 comp rx=0 tx=0).stop 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 shutdown_connections 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7ad406ac00 0x7f7ad406d0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae815fd80 0x7f7ae80ae4c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ae80d0e30 0x7f7ae80adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 --2- 172.21.15.5:0/4166227537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ae8098f40 0x7f7ae8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 >> 172.21.15.5:0/4166227537 conn(0x7f7ae80d0310 msgr2=0x7f7ae8099530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 shutdown_connections 2024-09-13T17:14:57.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.291+0000 7f7aee619640 1 -- 172.21.15.5:0/4166227537 wait complete. 2024-09-13T17:14:57.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:57.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.408+0000 7f51892c9640 1 Processor -- start 2024-09-13T17:14:57.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.408+0000 7f51892c9640 1 -- start start 2024-09-13T17:14:57.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5184157e20 0x7f518415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 0x7f518406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51840ad010 0x7f51840ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518415b900 con 0x7f5184157e20 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518406db00 con 0x7f51840ad010 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51892c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518406c520 con 0x7f518406c090 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5184157e20 0x7f518415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5184157e20 0x7f518415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41600/0 (socket says 172.21.15.5:41600) 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 -- 172.21.15.5:0/872678531 learned_addr learned my addr 172.21.15.5:0/872678531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51837fe640 1 --2- 172.21.15.5:0/872678531 >> v2:172.21.15.179:3300/0 conn(0x7f51840ad010 0x7f51840ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51827fc640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 0x7f518406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 -- 172.21.15.5:0/872678531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 msgr2=0x7f518406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 0x7f518406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 -- 172.21.15.5:0/872678531 >> v2:172.21.15.179:3300/0 conn(0x7f51840ad010 msgr2=0x7f51840ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 --2- 172.21.15.5:0/872678531 >> v2:172.21.15.179:3300/0 conn(0x7f51840ad010 0x7f51840ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f5182ffd640 1 -- 172.21.15.5:0/872678531 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518406c800 con 0x7f5184157e20 2024-09-13T17:14:57.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.409+0000 7f51827fc640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 0x7f518406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.410+0000 7f5182ffd640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f518415b3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f51840ce0e0 tx=0x7f517402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b9e2c1f0c6941b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.410+0000 7f5181ffb640 1 -- 172.21.15.5:0/872678531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174032440 con 0x7f5184157e20 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.410+0000 7f5181ffb640 1 -- 172.21.15.5:0/872678531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51740325a0 con 0x7f5184157e20 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.410+0000 7f5181ffb640 1 -- 172.21.15.5:0/872678531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174032930 con 0x7f5184157e20 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 -- 172.21.15.5:0/872678531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 msgr2=0x7f518415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f518415b3c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f51840ce0e0 tx=0x7f517402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 -- 172.21.15.5:0/872678531 shutdown_connections 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 --2- 172.21.15.5:0/872678531 >> v2:172.21.15.179:3300/0 conn(0x7f51840ad010 0x7f51840ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f518406c090 0x7f518406d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 --2- 172.21.15.5:0/872678531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f518415b3c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 -- 172.21.15.5:0/872678531 >> 172.21.15.5:0/872678531 conn(0x7f51840ce130 msgr2=0x7f51840ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 -- 172.21.15.5:0/872678531 shutdown_connections 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.411+0000 7f51892c9640 1 -- 172.21.15.5:0/872678531 wait complete. 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.412+0000 7f51892c9640 1 Processor -- start 2024-09-13T17:14:57.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.412+0000 7f51892c9640 1 -- start start 2024-09-13T17:14:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840ad010 0x7f518414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51841efe80 0x7f5184158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51841f43c0 con 0x7f5184157e20 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51841f40e0 con 0x7f51841efe80 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51892c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5184099db0 con 0x7f51840ad010 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41604/0 (socket says 172.21.15.5:41604) 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51827fc640 1 -- 172.21.15.5:0/1645131616 learned_addr learned my addr 172.21.15.5:0/1645131616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f5182ffd640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840ad010 0x7f518414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51837fe640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51841efe80 0x7f5184158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51827fc640 1 -- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840ad010 msgr2=0x7f518414b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.413+0000 7f51827fc640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840ad010 0x7f518414b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51827fc640 1 -- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51841efe80 msgr2=0x7f5184158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51827fc640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51841efe80 0x7f5184158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51827fc640 1 -- 172.21.15.5:0/1645131616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740094d0 con 0x7f5184157e20 2024-09-13T17:14:57.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51827fc640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f517800c7c0 tx=0x7f517800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178007a30 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178007b90 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518409a090 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800ce70 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.414+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518414b9b0 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.415+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5184099c10 con 0x7f5184157e20 2024-09-13T17:14:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.416+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f51780113f0 con 0x7f5184157e20 2024-09-13T17:14:57.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.416+0000 7f516b7fe640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 0x7f517006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.416+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5178089520 con 0x7f5184157e20 2024-09-13T17:14:57.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.416+0000 7f5182ffd640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 0x7f517006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.417+0000 7f5182ffd640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 0x7f517006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5174034000 tx=0x7f517402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.420+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5184099c10 con 0x7f5184157e20 2024-09-13T17:14:57.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.589+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f518409a5b0 con 0x7f5184157e20 2024-09-13T17:14:57.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.590+0000 7f516b7fe640 1 -- 172.21.15.5:0/1645131616 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f518409a5b0 con 0x7f5184157e20 2024-09-13T17:14:57.591 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:14:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 msgr2=0x7f517006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 0x7f517006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5174034000 tx=0x7f517402e000 comp rx=0 tx=0).stop 2024-09-13T17:14:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 msgr2=0x7f51841585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f517800c7c0 tx=0x7f517800cc80 comp rx=0 tx=0).stop 2024-09-13T17:14:57.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 shutdown_connections 2024-09-13T17:14:57.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51841efe80 0x7f5184158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f517006ac00 0x7f517006d0c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5184157e20 0x7f51841585f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 --2- 172.21.15.5:0/1645131616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51840ad010 0x7f518414b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 >> 172.21.15.5:0/1645131616 conn(0x7f51840ce130 msgr2=0x7f518415e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 shutdown_connections 2024-09-13T17:14:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.592+0000 7f51892c9640 1 -- 172.21.15.5:0/1645131616 wait complete. 2024-09-13T17:14:57.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:14:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.708+0000 7f809d553640 1 Processor -- start 2024-09-13T17:14:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.708+0000 7f809d553640 1 -- start start 2024-09-13T17:14:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f809d553640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8098152fa0 0x7f8098071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f809d553640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80980b22b0 0x7f809806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f809d553640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098153380 con 0x7f80981598a0 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f809d553640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8098070f10 con 0x7f80980b22b0 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f809d553640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980711f0 con 0x7f8098152fa0 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80980b22b0 0x7f809806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80967fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80981598a0 0x7f80980b1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50810/0 (socket says 172.21.15.5:50810) 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80967fc640 1 -- 172.21.15.5:0/241406327 learned_addr learned my addr 172.21.15.5:0/241406327 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f8096ffd640 1 --2- 172.21.15.5:0/241406327 >> v2:172.21.15.179:3300/0 conn(0x7f8098152fa0 0x7f8098071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80977fe640 1 -- 172.21.15.5:0/241406327 >> v2:172.21.15.179:3300/0 conn(0x7f8098152fa0 msgr2=0x7f8098071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80977fe640 1 --2- 172.21.15.5:0/241406327 >> v2:172.21.15.179:3300/0 conn(0x7f8098152fa0 0x7f8098071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80977fe640 1 -- 172.21.15.5:0/241406327 >> v1:172.21.15.5:6789/0 conn(0x7f80981598a0 legacy=0x7f80980b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f8095ffb640 1 -- 172.21.15.5:0/241406327 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494737040 0 0) 0x7f8098153380 con 0x7f80981598a0 2024-09-13T17:14:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.709+0000 7f80977fe640 1 -- 172.21.15.5:0/241406327 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980714d0 con 0x7f80980b22b0 2024-09-13T17:14:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.710+0000 7f80977fe640 1 --2- 172.21.15.5:0/241406327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f809806c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f809806e4c0 tx=0x7f809002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6983e3d57db7d0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.710+0000 7f8095ffb640 1 -- 172.21.15.5:0/241406327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809002aea0 con 0x7f80980b22b0 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.710+0000 7f8095ffb640 1 -- 172.21.15.5:0/241406327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809002d050 con 0x7f80980b22b0 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.710+0000 7f8095ffb640 1 -- 172.21.15.5:0/241406327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090007960 con 0x7f80980b22b0 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 -- 172.21.15.5:0/241406327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 msgr2=0x7f809806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 --2- 172.21.15.5:0/241406327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f809806c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f809806e4c0 tx=0x7f809002a680 comp rx=0 tx=0).stop 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 -- 172.21.15.5:0/241406327 shutdown_connections 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 --2- 172.21.15.5:0/241406327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f809806c920 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 --2- 172.21.15.5:0/241406327 >> v2:172.21.15.179:3300/0 conn(0x7f8098152fa0 0x7f8098071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 -- 172.21.15.5:0/241406327 >> 172.21.15.5:0/241406327 conn(0x7f80980ce130 msgr2=0x7f80980ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 -- 172.21.15.5:0/241406327 shutdown_connections 2024-09-13T17:14:57.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.711+0000 7f809d553640 1 -- 172.21.15.5:0/241406327 wait complete. 2024-09-13T17:14:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.712+0000 7f809d553640 1 Processor -- start 2024-09-13T17:14:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.712+0000 7f809d553640 1 -- start start 2024-09-13T17:14:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8098152fa0 0x7f8098151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 0x7f8098151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809814a9d0 con 0x7f80980b22b0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8098097cd0 con 0x7f8098152fa0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f809d553640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809814ac40 con 0x7f80981598a0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41622/0 (socket says 172.21.15.5:41622) 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 -- 172.21.15.5:0/3586051515 learned_addr learned my addr 172.21.15.5:0/3586051515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f80967fc640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8098152fa0 0x7f8098151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f80977fe640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 0x7f8098151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 -- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 msgr2=0x7f8098151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 0x7f8098151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 -- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8098152fa0 msgr2=0x7f8098151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8098152fa0 0x7f8098151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 -- 172.21.15.5:0/3586051515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090009a70 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f80977fe640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 0x7f8098151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.713+0000 7f8096ffd640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f808800d800 tx=0x7f808800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.714+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800b6c0 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.714+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800b820 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.714+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809814af20 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.714+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800bbb0 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.714+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80981f2c20 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.715+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980672a0 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.715+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f808800bd10 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.716+0000 7f807f7fe640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 0x7f808406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.716+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8088089a50 con 0x7f80980b22b0 2024-09-13T17:14:57.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.716+0000 7f80967fc640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 0x7f808406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:57.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.716+0000 7f80967fc640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 0x7f808406d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8098148a20 tx=0x7f808c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:57.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.720+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8088054ad0 con 0x7f80980b22b0 2024-09-13T17:14:57.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.888+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8098070b70 con 0x7f80980b22b0 2024-09-13T17:14:57.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.888+0000 7f807f7fe640 1 -- 172.21.15.5:0/3586051515 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80880580f0 con 0x7f80980b22b0 2024-09-13T17:14:57.890 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 msgr2=0x7f808406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 0x7f808406d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8098148a20 tx=0x7f808c009040 comp rx=0 tx=0).stop 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 msgr2=0x7f8098097790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f808800d800 tx=0x7f808800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 shutdown_connections 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80981598a0 0x7f8098151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8098152fa0 0x7f8098151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f808406ac00 0x7f808406d0c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 --2- 172.21.15.5:0/3586051515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980b22b0 0x7f8098097790 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 >> 172.21.15.5:0/3586051515 conn(0x7f80980ce130 msgr2=0x7f8098152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 shutdown_connections 2024-09-13T17:14:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:57.890+0000 7f809d553640 1 -- 172.21.15.5:0/3586051515 wait complete. 2024-09-13T17:14:57.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:14:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.004+0000 7f2dbb55a640 1 Processor -- start 2024-09-13T17:14:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.004+0000 7f2dbb55a640 1 -- start start 2024-09-13T17:14:58.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2dbb55a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2db40b1ac0 0x7f2db415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2dbb55a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2db406eed0 0x7f2db406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2dbb55a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db40b35f0 con 0x7f2db406eaf0 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2dbb55a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db4160020 con 0x7f2db406eed0 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2dbb55a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db4156f50 con 0x7f2db40b1ac0 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2db406eed0 0x7f2db406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2db406eed0 0x7f2db406aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41634/0 (socket says 172.21.15.5:41634) 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 -- 172.21.15.5:0/349873783 learned_addr learned my addr 172.21.15.5:0/349873783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db8af5640 1 --2- 172.21.15.5:0/349873783 >> v2:172.21.15.179:3300/0 conn(0x7f2db40b1ac0 0x7f2db415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 -- 172.21.15.5:0/349873783 >> v2:172.21.15.179:3300/0 conn(0x7f2db40b1ac0 msgr2=0x7f2db415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 --2- 172.21.15.5:0/349873783 >> v2:172.21.15.179:3300/0 conn(0x7f2db40b1ac0 0x7f2db415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 -- 172.21.15.5:0/349873783 >> v1:172.21.15.179:6789/0 conn(0x7f2db406eaf0 legacy=0x7f2db40b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.005+0000 7f2db9af7640 1 -- 172.21.15.5:0/349873783 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40b1fa0 con 0x7f2db406eed0 2024-09-13T17:14:58.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.006+0000 7f2db9af7640 1 --2- 172.21.15.5:0/349873783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db406eed0 0x7f2db406aea0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2db406f4c0 tx=0x7f2dac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7a151ade1840e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.006+0000 7f2db3fff640 1 -- 172.21.15.5:0/349873783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac032440 con 0x7f2db406eed0 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.006+0000 7f2db3fff640 1 -- 172.21.15.5:0/349873783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac0325a0 con 0x7f2db406eed0 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.006+0000 7f2db3fff640 1 -- 172.21.15.5:0/349873783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac032930 con 0x7f2db406eed0 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 -- 172.21.15.5:0/349873783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db406eed0 msgr2=0x7f2db406aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/349873783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db406eed0 0x7f2db406aea0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2db406f4c0 tx=0x7f2dac02a270 comp rx=0 tx=0).stop 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 -- 172.21.15.5:0/349873783 shutdown_connections 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/349873783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db406eed0 0x7f2db406aea0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/349873783 >> v2:172.21.15.179:3300/0 conn(0x7f2db40b1ac0 0x7f2db415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 -- 172.21.15.5:0/349873783 >> 172.21.15.5:0/349873783 conn(0x7f2db4070af0 msgr2=0x7f2db4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 -- 172.21.15.5:0/349873783 shutdown_connections 2024-09-13T17:14:58.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.007+0000 7f2dbb55a640 1 -- 172.21.15.5:0/349873783 wait complete. 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.008+0000 7f2dbb55a640 1 Processor -- start 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.008+0000 7f2dbb55a640 1 -- start start 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 0x7f2db4154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 0x7f2db4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415c210 con 0x7f2db40b1ac0 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415b590 con 0x7f2db406eed0 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2dbb55a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415b870 con 0x7f2db406eaf0 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41636/0 (socket says 172.21.15.5:41636) 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 -- 172.21.15.5:0/2046198944 learned_addr learned my addr 172.21.15.5:0/2046198944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db8af5640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 0x7f2db4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db92f6640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 0x7f2db4154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 -- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 msgr2=0x7f2db4154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 0x7f2db4154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 -- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 msgr2=0x7f2db4154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 0x7f2db4154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db9af7640 1 -- 172.21.15.5:0/2046198944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0094d0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db92f6640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 0x7f2db4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.009+0000 7f2db8af5640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 0x7f2db4154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2db9af7640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0090b0 tx=0x7f2dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac03d830 con 0x7f2db40b1ac0 2024-09-13T17:14:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac03d9b0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db415bb50 con 0x7f2db40b1ac0 2024-09-13T17:14:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac03dd60 con 0x7f2db40b1ac0 2024-09-13T17:14:58.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.010+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db4154ea0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.011+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db40672e0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.011+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2dac039040 con 0x7f2db40b1ac0 2024-09-13T17:14:58.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.012+0000 7f2db1ffb640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 0x7f2da006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.012+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2dac0a9fb0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.012+0000 7f2db92f6640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 0x7f2da006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.013+0000 7f2db92f6640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 0x7f2da006d0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2da40012e0 tx=0x7f2da4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.016+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2dac0dd9c0 con 0x7f2db40b1ac0 2024-09-13T17:14:58.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.200+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2db415c350 con 0x7f2db40b1ac0 2024-09-13T17:14:58.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.200+0000 7f2db1ffb640 1 -- 172.21.15.5:0/2046198944 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2dac075030 con 0x7f2db40b1ac0 2024-09-13T17:14:58.201 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 msgr2=0x7f2da006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 0x7f2da006d0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2da40012e0 tx=0x7f2da4009040 comp rx=0 tx=0).stop 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 msgr2=0x7f2db4159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0090b0 tx=0x7f2dac0046c0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 shutdown_connections 2024-09-13T17:14:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2da006ac00 0x7f2da006d0c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2db40b1ac0 0x7f2db4159490 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2db406eed0 0x7f2db4154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 --2- 172.21.15.5:0/2046198944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2db406eaf0 0x7f2db4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 >> 172.21.15.5:0/2046198944 conn(0x7f2db4070af0 msgr2=0x7f2db40b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 shutdown_connections 2024-09-13T17:14:58.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.202+0000 7f2dbb55a640 1 -- 172.21.15.5:0/2046198944 wait complete. 2024-09-13T17:14:58.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:14:58.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:14:58.238 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[54248]: fuse finished with error 0 and tester_r 0 2024-09-13T17:14:58.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:14:58.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:58.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:14:58.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-13T17:14:58.470 INFO:teuthology.orchestra.run.smithi005.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":46,"msgr_send_messages":35,"msgr_recv_bytes":13904,"msgr_send_bytes":22122,"msgr_created_connections":8,"msgr_active_connections":2,"msgr_running_total_time":0.009438504,"msgr_running_send_time":0.001007228,"msgr_running_recv_time":0.005550505,"msgr_running_fast_dispatch_time":0.001266245,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.234355605,"avgtime":0.006892811},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000013649,"avgtime":0.000000620},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":76,"msgr_send_messages":70,"msgr_recv_bytes":116744,"msgr_send_bytes":19160,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.007995523,"msgr_running_send_time":0.001754294,"msgr_running_recv_time":0.008955655,"msgr_running_fast_dispatch_time":0.000208288,"msgr_send_messages_queue_lat":{"avgcount":70,"sum":0.042820024,"avgtime":0.000611714},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":114032,"msgr_send_encrypted_bytes":14576},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":33,"msgr_recv_bytes":8452,"msgr_send_bytes":125235,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.005811199,"msgr_running_send_time":0.001324272,"msgr_running_recv_time":0.003719930,"msgr_running_fast_dispatch_time":0.000473457,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.055984449,"avgtime":0.001749514},"msgr_handle_ack_lat":{"avgcount":31,"sum":0.000005691,"avgtime":0.000000183},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":98320},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":49,"sum":0.003190628,"avgtime":0.000065114}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010860,"avgtime":0.000005430}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000943680,"avgtime":0.000235920},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197760,"rdpos":0,"jlat":{"avgcount":7,"sum":0.013390810,"avgtime":0.001912972},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":42372,"heap":207200},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":12,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000711045,"avgtime":0.000237015},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000232635,"avgtime":0.000232635},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":3,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229819,"buffer_anon_items":70,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5520,"osdmap_items":78,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":14666,"op_resend":37,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.753985436,"avgtime":0.016390987},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":70},"op":46,"op_r":0,"op_w":46,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":42,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":148,"get_sum":121274,"get_or_fail_fail":0,"get_or_fail_success":148,"take":0,"take_sum":0,"put":148,"put_sum":121274,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":14666,"put":46,"put_sum":14666,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b782dc00a0":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":3456,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":7,"put_sum":3456,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T17:14:58.472 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 6.2e-07, "sum": 1.3649e-05 }, "msgr_recv_bytes": 13904, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 46, "msgr_running_fast_dispatch_time": 0.001266245, "msgr_running_recv_time": 0.005550505, "msgr_running_send_time": 0.001007228, "msgr_running_total_time": 0.009438504, "msgr_send_bytes": 22122, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.006892811, "sum": 0.234355605 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 116744, "msgr_recv_encrypted_bytes": 114032, "msgr_recv_messages": 76, "msgr_running_fast_dispatch_time": 0.000208288, "msgr_running_recv_time": 0.008955655, "msgr_running_send_time": 0.001754294, "msgr_running_total_time": 0.007995523, "msgr_send_bytes": 19160, "msgr_send_encrypted_bytes": 14576, "msgr_send_messages": 70, "msgr_send_messages_queue_lat": { "avgcount": 70, "avgtime": 0.000611714, "sum": 0.042820024 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 31, "avgtime": 1.83e-07, "sum": 5.691e-06 }, "msgr_recv_bytes": 8452, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000473457, "msgr_running_recv_time": 0.00371993, "msgr_running_send_time": 0.001324272, "msgr_running_total_time": 0.005811199, "msgr_send_bytes": 125235, "msgr_send_encrypted_bytes": 98320, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.001749514, "sum": 0.055984449 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 49, "avgtime": 6.5114e-05, "sum": 0.003190628 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.43e-06, "sum": 1.086e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.00023592, "sum": 0.00094368 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.001912972, "sum": 0.01339081 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197760 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 42372 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 12, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000237015, "sum": 0.000711045 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000232635, "sum": 0.000232635 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 3, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229819, "buffer_anon_items": 70, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5520, "osdmap_items": 78, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 42, "map_full": 0, "map_inc": 3, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.016390987, "sum": 0.753985436 }, "op_pg": 0, "op_r": 0, "op_reply": 46, "op_resend": 37, "op_rmw": 0, "op_send": 46, "op_send_bytes": 14666, "op_w": 46, "oplen_avg": { "avgcount": 46, "sum": 70 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 148, "get_or_fail_fail": 0, "get_or_fail_success": 148, "get_started": 0, "get_sum": 121274, "max": 104857600, "put": 148, "put_sum": 121274, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 14666, "take": 46, "take_sum": 14666, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b782dc00a0": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 3456, "max": 3758096384, "put": 7, "put_sum": 3456, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T17:14:58.472 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T17:14:58.472 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:14:58.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:14:58.516 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:14:58.557 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:14:58.557 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:58.557 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:58.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:14:58.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:58.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.574 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:14:58.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:14:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T17:14:58.630 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:58.631 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:58.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:14:58.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:14:58.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.650 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:14:58.707 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T17:14:58.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:14:58.708 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:14:58.708 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:58.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:14:58.725 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:14:58.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.725 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:14:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:14:58.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:14:58.781 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:14:58.781 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:14:58.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:14:58.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:14:58.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:14:58.800 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:14:58.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:14:58.858 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:14:58.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.959+0000 7ff23f14c640 1 Processor -- start 2024-09-13T17:14:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.959+0000 7ff23f14c640 1 -- start start 2024-09-13T17:14:58.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23f14c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff23806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23f14c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff238071ea0 0x7ff23806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23f14c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2380710c0 con 0x7ff23815d4a0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23f14c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23815d9a0 con 0x7ff238071ea0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23f14c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff238071550 con 0x7ff2380b27c0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff237fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff23815d4a0 0x7ff238152cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50816/0 (socket says 172.21.15.5:50816) 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff237fff640 1 -- 172.21.15.5:0/1976762028 learned_addr learned my addr 172.21.15.5:0/1976762028 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23d6e9640 1 --2- 172.21.15.5:0/1976762028 >> v2:172.21.15.179:3300/0 conn(0x7ff238071ea0 0x7ff23806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff23cee8640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff23806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155545063 0 0) 0x7ff2380710c0 con 0x7ff23815d4a0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003520 con 0x7ff23815d4a0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568784650 0 0) 0x7ff228003520 con 0x7ff23815d4a0 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 msgr2=0x7ff23806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:58.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff23806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 >> v2:172.21.15.179:3300/0 conn(0x7ff238071ea0 msgr2=0x7ff23806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 --2- 172.21.15.5:0/1976762028 >> v2:172.21.15.179:3300/0 conn(0x7ff238071ea0 0x7ff23806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2380b2ba0 con 0x7ff23815d4a0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.960+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff224001670 con 0x7ff23815d4a0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 >> v1:172.21.15.5:6789/0 conn(0x7ff23815d4a0 legacy=0x7ff238152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff228005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23815d9a0 con 0x7ff2280047c0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238071550 con 0x7ff228003970 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800b980 con 0x7ff2380b27c0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff23d6e9640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff228005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff23cee8640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 -- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 msgr2=0x7ff228005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2380b27c0 0x7ff228005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 -- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228003970 msgr2=0x7ff228003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff237fff640 1 -- 172.21.15.5:0/1976762028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228003520 con 0x7ff2280047c0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.961+0000 7ff23cee8640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff228003970 0x7ff228003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff237fff640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff2380adc80 tx=0x7ff2280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e756dedbd32a7d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005ad0 con 0x7ff2280047c0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22402d070 con 0x7ff2280047c0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff2377fe640 1 -- 172.21.15.5:0/1976762028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005e70 con 0x7ff2280047c0 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 -- 172.21.15.5:0/1976762028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2280047c0 msgr2=0x7ff228004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 --2- 172.21.15.5:0/1976762028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2280047c0 0x7ff228004c40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff2380adc80 tx=0x7ff2280057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23d6e9640 1 -- 172.21.15.5:0/1976762028 reap_dead start 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 -- 172.21.15.5:0/1976762028 shutdown_connections 2024-09-13T17:14:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 -- 172.21.15.5:0/1976762028 >> 172.21.15.5:0/1976762028 conn(0x7ff2380ce0d0 msgr2=0x7ff2380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 -- 172.21.15.5:0/1976762028 shutdown_connections 2024-09-13T17:14:58.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.962+0000 7ff23f14c640 1 -- 172.21.15.5:0/1976762028 wait complete. 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.964+0000 7ff23f14c640 1 Processor -- start 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.964+0000 7ff23f14c640 1 -- start start 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.964+0000 7ff23f14c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2280047c0 0x7ff238149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.964+0000 7ff23f14c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2381e6a70 0x7ff2381e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381e6650 con 0x7ff2381e5450 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238149a60 con 0x7ff2381e6a70 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381e59d0 con 0x7ff2280047c0 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41654/0 (socket says 172.21.15.5:41654) 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 -- 172.21.15.5:0/754120516 learned_addr learned my addr 172.21.15.5:0/754120516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23cee8640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2280047c0 0x7ff238149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff237fff640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2381e6a70 0x7ff2381e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 -- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2280047c0 msgr2=0x7ff238149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2280047c0 0x7ff238149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 -- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2381e6a70 msgr2=0x7ff2381e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2381e6a70 0x7ff2381e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 -- 172.21.15.5:0/754120516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2381e5cb0 con 0x7ff2381e5450 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23d6e9640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff23806b030 tx=0x7ff23000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000e040 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000f040 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2381e5f90 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230015670 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.965+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238156a00 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.966+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2381e6790 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.967+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2300157d0 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.967+0000 7ff2357fa640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 0x7ff21c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.967+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff230089b40 con 0x7ff2381e5450 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.968+0000 7ff23cee8640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 0x7ff21c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:58.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.968+0000 7ff23cee8640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 0x7ff21c06d0f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006f80 tx=0x7ff22c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:58.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:58.972+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2381e6790 con 0x7ff2381e5450 2024-09-13T17:14:59.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.176+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2381e6790 con 0x7ff2381e5450 2024-09-13T17:14:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.177+0000 7ff2357fa640 1 -- 172.21.15.5:0/754120516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7ff2381e6790 con 0x7ff2381e5450 2024-09-13T17:14:59.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:59.179 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:14:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:14:59.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 msgr2=0x7ff21c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 0x7ff21c06d0f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006f80 tx=0x7ff22c008040 comp rx=0 tx=0).stop 2024-09-13T17:14:59.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 msgr2=0x7ff2380aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff23806b030 tx=0x7ff23000f580 comp rx=0 tx=0).stop 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 shutdown_connections 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21c06ac30 0x7ff21c06d0f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2381e5450 0x7ff2380aed40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2381e6a70 0x7ff2381e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 --2- 172.21.15.5:0/754120516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2280047c0 0x7ff238149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 >> 172.21.15.5:0/754120516 conn(0x7ff2380ce0d0 msgr2=0x7ff2380ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 shutdown_connections 2024-09-13T17:14:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.179+0000 7ff23f14c640 1 -- 172.21.15.5:0/754120516 wait complete. 2024-09-13T17:14:59.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:14:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.292+0000 7f7557df4640 1 Processor -- start 2024-09-13T17:14:59.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.292+0000 7f7557df4640 1 -- start start 2024-09-13T17:14:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7557df4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f7550070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7557df4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500b1580 con 0x7f7550070fc0 2024-09-13T17:14:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7557df4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7550071410 con 0x7f7550159290 2024-09-13T17:14:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7557df4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75500b2ad0 con 0x7f75500b1970 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7556391640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7550070fc0 0x7f755006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50822/0 (socket says 172.21.15.5:50822) 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7556391640 1 -- 172.21.15.5:0/583937100 learned_addr learned my addr 172.21.15.5:0/583937100 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.293+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079678455 0 0) 0x7f75500b1580 con 0x7f7550070fc0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f755538f640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f7550070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f753c003520 con 0x7f7550070fc0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259242819 0 0) 0x7f753c003520 con 0x7f7550070fc0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 msgr2=0x7f7550070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f7550070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 >> v1:172.21.15.179:6789/0 conn(0x7f7550159290 legacy=0x7f7550159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500b1ec0 con 0x7f7550070fc0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f75480019f0 con 0x7f7550070fc0 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 >> v1:172.21.15.5:6789/0 conn(0x7f7550070fc0 legacy=0x7f755006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f753c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f753c0047c0 0x7f753c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f753c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500b2ad0 con 0x7f753c0039a0 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c00ba60 con 0x7f753c0047c0 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c00bc20 con 0x7f75500b1970 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f753c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f755538f640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f753c0047c0 0x7f753c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7556391640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f753c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 -- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 msgr2=0x7f753c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f753c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 -- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f753c0047c0 msgr2=0x7f753c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f753c0047c0 0x7f753c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7555b90640 1 -- 172.21.15.5:0/583937100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c003520 con 0x7f753c0039a0 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f755538f640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f753c0047c0 0x7f753c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.294+0000 7f7556391640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500b1970 0x7f753c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.295+0000 7f7555b90640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f753c003dc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f754c001580 tx=0x7f753c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684db7916b6837cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.295+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0052d0 con 0x7f753c0039a0 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.295+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c005430 con 0x7f753c0039a0 2024-09-13T17:14:59.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.295+0000 7f7554b8e640 1 -- 172.21.15.5:0/583937100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c02aa00 con 0x7f753c0039a0 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 -- 172.21.15.5:0/583937100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 msgr2=0x7f753c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 --2- 172.21.15.5:0/583937100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f753c003dc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f754c001580 tx=0x7f753c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7556391640 1 -- 172.21.15.5:0/583937100 reap_dead start 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 -- 172.21.15.5:0/583937100 shutdown_connections 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 -- 172.21.15.5:0/583937100 >> 172.21.15.5:0/583937100 conn(0x7f75500ce0d0 msgr2=0x7f75500ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 -- 172.21.15.5:0/583937100 shutdown_connections 2024-09-13T17:14:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.296+0000 7f7557df4640 1 -- 172.21.15.5:0/583937100 wait complete. 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.297+0000 7f7557df4640 1 Processor -- start 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.297+0000 7f7557df4640 1 -- start start 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 0x7f75500ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500cd280 0x7f7550144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550146410 con 0x7f753c0039a0 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550146660 con 0x7f7550147420 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7557df4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7550146940 con 0x7f75500cd280 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41674/0 (socket says 172.21.15.5:41674) 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 -- 172.21.15.5:0/2428229074 learned_addr learned my addr 172.21.15.5:0/2428229074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f755538f640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 0x7f75500ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7556391640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500cd280 0x7f7550144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 -- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500cd280 msgr2=0x7f7550144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500cd280 0x7f7550144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 -- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 msgr2=0x7f75500ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 0x7f75500ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 -- 172.21.15.5:0/2428229074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550146c20 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f755538f640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 0x7f75500ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.298+0000 7f7555b90640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f754c02a2e0 tx=0x7f754c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.299+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0067d0 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.299+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c006930 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.299+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7550146f00 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.299+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c006ce0 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.299+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75500ac730 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.300+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75500672a0 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.300+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f754c02a7c0 con 0x7f753c0039a0 2024-09-13T17:14:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.300+0000 7f75467fc640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 0x7f753406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.301+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f754c0a9210 con 0x7f753c0039a0 2024-09-13T17:14:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.301+0000 7f755538f640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 0x7f753406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.301+0000 7f755538f640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 0x7f753406d0e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7550148f40 tx=0x7f7540008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.305+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f754c0741f0 con 0x7f753c0039a0 2024-09-13T17:14:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.476+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7550071410 con 0x7f753c0039a0 2024-09-13T17:14:59.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.477+0000 7f75467fc640 1 -- 172.21.15.5:0/2428229074 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16731 (secure 0 0 0) 0x7f7550071410 con 0x7f753c0039a0 2024-09-13T17:14:59.479 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:14:59.480 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:56.591368+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 msgr2=0x7f753406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 0x7f753406d0e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7550148f40 tx=0x7f7540008040 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 msgr2=0x7f75500cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f754c02a2e0 tx=0x7f754c001120 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 shutdown_connections 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75500cd280 0x7f7550144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7550147420 0x7f75500ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f753406ac20 0x7f753406d0e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 --2- 172.21.15.5:0/2428229074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f753c0039a0 0x7f75500cbab0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.479+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 >> 172.21.15.5:0/2428229074 conn(0x7f75500ce0d0 msgr2=0x7f75500af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.480+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 shutdown_connections 2024-09-13T17:14:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.480+0000 7f7557df4640 1 -- 172.21.15.5:0/2428229074 wait complete. 2024-09-13T17:14:59.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:14:26.106783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:14:26.498581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:14:59.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.597+0000 7ffb9b63a640 1 Processor -- start 2024-09-13T17:14:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.597+0000 7ffb9b63a640 1 -- start start 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb9b63a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb9406c090 0x7ffb9415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb9b63a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9406c520 con 0x7ffb940ad720 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb9b63a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9406c800 con 0x7ffb94157e20 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb9b63a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9415b900 con 0x7ffb9406c090 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb99bd7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb940ad720 0x7ffb940b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50828/0 (socket says 172.21.15.5:50828) 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb99bd7640 1 -- 172.21.15.5:0/4222582209 learned_addr learned my addr 172.21.15.5:0/4222582209 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb98bd5640 1 --2- 172.21.15.5:0/4222582209 >> v2:172.21.15.179:3300/0 conn(0x7ffb9406c090 0x7ffb9415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834105288 0 0) 0x7ffb9406c520 con 0x7ffb940ad720 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb80003520 con 0x7ffb940ad720 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145193750 0 0) 0x7ffb80003520 con 0x7ffb940ad720 2024-09-13T17:14:59.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 >> v2:172.21.15.179:3300/0 conn(0x7ffb9406c090 msgr2=0x7ffb9415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 --2- 172.21.15.5:0/4222582209 >> v2:172.21.15.179:3300/0 conn(0x7ffb9406c090 0x7ffb9415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 >> v1:172.21.15.179:6789/0 conn(0x7ffb94157e20 legacy=0x7ffb940ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9406cae0 con 0x7ffb940ad720 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ffb8c0019f0 con 0x7ffb940ad720 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 >> v1:172.21.15.5:6789/0 conn(0x7ffb940ad720 legacy=0x7ffb940b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb80003970 0x7ffb80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9415b900 con 0x7ffb80005180 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8000c020 con 0x7ffb80003970 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.598+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8000c1e0 con 0x7ffb800047c0 2024-09-13T17:14:59.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb993d6640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb80003970 0x7ffb80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb98bd5640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 -- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb800047c0 msgr2=0x7ffb80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 -- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb80003970 msgr2=0x7ffb80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb80003970 0x7ffb80003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.599+0000 7ffb99bd7640 1 -- 172.21.15.5:0/4222582209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80003520 con 0x7ffb80005180 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb99bd7640 1 -- 172.21.15.5:0/4222582209 reap_dead start 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00a820 tx=0x7ffb800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8304d66cd921d2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c02ba30 con 0x7ffb80005180 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c02bbd0 con 0x7ffb80005180 2024-09-13T17:14:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb8bfff640 1 -- 172.21.15.5:0/4222582209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c034470 con 0x7ffb80005180 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb9b63a640 1 -- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 msgr2=0x7ffb8000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00a820 tx=0x7ffb800057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb9b63a640 1 -- 172.21.15.5:0/4222582209 shutdown_connections 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/4222582209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.600+0000 7ffb9b63a640 1 -- 172.21.15.5:0/4222582209 >> 172.21.15.5:0/4222582209 conn(0x7ffb940ce130 msgr2=0x7ffb940ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.601+0000 7ffb9b63a640 1 -- 172.21.15.5:0/4222582209 shutdown_connections 2024-09-13T17:14:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.601+0000 7ffb9b63a640 1 -- 172.21.15.5:0/4222582209 wait complete. 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.602+0000 7ffb9b63a640 1 Processor -- start 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.602+0000 7ffb9b63a640 1 -- start start 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80005180 0x7ffb94154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 0x7ffb94141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94142180 con 0x7ffb94140cf0 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94141260 con 0x7ffb94141790 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb9b63a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940b3040 con 0x7ffb80005180 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41694/0 (socket says 172.21.15.5:41694) 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 -- 172.21.15.5:0/2608766561 learned_addr learned my addr 172.21.15.5:0/2608766561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb993d6640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80005180 0x7ffb94154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 0x7ffb94141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 -- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80005180 msgr2=0x7ffb94154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80005180 0x7ffb94154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 -- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 msgr2=0x7ffb94141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 0x7ffb94141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 -- 172.21.15.5:0/2608766561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940b3320 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb99bd7640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 0x7ffb94141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.603+0000 7ffb98bd5640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffb84019e90 tx=0x7ffb84010620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.604+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84021410 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.604+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb84021570 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.604+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb940b3600 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.604+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840216e0 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.604+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb94154920 con 0x7ffb94140cf0 2024-09-13T17:14:59.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.605+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb940b3180 con 0x7ffb94140cf0 2024-09-13T17:14:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.606+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb84021840 con 0x7ffb94140cf0 2024-09-13T17:14:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.606+0000 7ffb89ffb640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 0x7ffb7806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.606+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb84091610 con 0x7ffb94140cf0 2024-09-13T17:14:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.606+0000 7ffb993d6640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 0x7ffb7806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.607+0000 7ffb993d6640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 0x7ffb7806d0f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000c00 tx=0x7ffb90009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.611+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffb940b3180 con 0x7ffb94140cf0 2024-09-13T17:14:59.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.780+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb940b3180 con 0x7ffb94140cf0 2024-09-13T17:14:59.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.780+0000 7ffb89ffb640 1 -- 172.21.15.5:0/2608766561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb940b3180 con 0x7ffb94140cf0 2024-09-13T17:14:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:14:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 msgr2=0x7ffb7806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 0x7ffb7806d0f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000c00 tx=0x7ffb90009040 comp rx=0 tx=0).stop 2024-09-13T17:14:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 msgr2=0x7ffb94097a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ffb84019e90 tx=0x7ffb84010620 comp rx=0 tx=0).stop 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 shutdown_connections 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb94141790 0x7ffb94141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb7806ac30 0x7ffb7806d0f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb94140cf0 0x7ffb94097a50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 --2- 172.21.15.5:0/2608766561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80005180 0x7ffb94154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 >> 172.21.15.5:0/2608766561 conn(0x7ffb940ce130 msgr2=0x7ffb940700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 shutdown_connections 2024-09-13T17:14:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.782+0000 7ffb9b63a640 1 -- 172.21.15.5:0/2608766561 wait complete. 2024-09-13T17:14:59.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:14:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.897+0000 7f39d4a44640 1 Processor -- start 2024-09-13T17:14:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.897+0000 7f39d4a44640 1 -- start start 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39d4a44640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f39d0070510 0x7f39d006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39d4a44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39d00cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39d4a44640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d0071570 con 0x7f39d015a4a0 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39d4a44640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d006d850 con 0x7f39d0070510 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39d4a44640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00ce330 con 0x7f39d006d3a0 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39ce59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39d015a4a0 0x7f39d015b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50844/0 (socket says 172.21.15.5:50844) 2024-09-13T17:14:59.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39ce59c640 1 -- 172.21.15.5:0/3394968679 learned_addr learned my addr 172.21.15.5:0/3394968679 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177326456 0 0) 0x7f39d0071570 con 0x7f39d015a4a0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b8003520 con 0x7f39d015a4a0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39ced9d640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39d00cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.898+0000 7f39cdd9b640 1 --2- 172.21.15.5:0/3394968679 >> v2:172.21.15.179:3300/0 conn(0x7f39d0070510 0x7f39d006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667276131 0 0) 0x7f39b8003520 con 0x7f39d015a4a0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 msgr2=0x7f39d00cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39d00cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 >> v2:172.21.15.179:3300/0 conn(0x7f39d0070510 msgr2=0x7f39d006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 --2- 172.21.15.5:0/3394968679 >> v2:172.21.15.179:3300/0 conn(0x7f39d0070510 0x7f39d006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d015a880 con 0x7f39d015a4a0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f39c0001670 con 0x7f39d015a4a0 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 >> v1:172.21.15.5:6789/0 conn(0x7f39d015a4a0 legacy=0x7f39d015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39b8003ef0 0x7f39b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b8004d00 0x7f39b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d006d850 con 0x7f39b8004d00 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00ce330 con 0x7f39b8003ef0 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b800b980 con 0x7f39d006d3a0 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b8004d00 0x7f39b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ce59c640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39cdd9b640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39b8003ef0 0x7f39b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 -- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 msgr2=0x7f39b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39d006d3a0 0x7f39b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 -- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39b8003ef0 msgr2=0x7f39b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39b8003ef0 0x7f39b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.899+0000 7f39ced9d640 1 -- 172.21.15.5:0/3394968679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8003520 con 0x7f39b8004d00 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39ced9d640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b8004d00 0x7f39b8005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009fc0 tx=0x7f39b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bada61cdc32f7c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c802d070 con 0x7f39b8004d00 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c800f040 con 0x7f39b8004d00 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39cd59a640 1 -- 172.21.15.5:0/3394968679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8031670 con 0x7f39b8004d00 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39d4a44640 1 -- 172.21.15.5:0/3394968679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b8004d00 msgr2=0x7f39b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39d4a44640 1 --2- 172.21.15.5:0/3394968679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b8004d00 0x7f39b8005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009fc0 tx=0x7f39b80057f0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.900+0000 7f39ced9d640 1 -- 172.21.15.5:0/3394968679 reap_dead start 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.901+0000 7f39d4a44640 1 -- 172.21.15.5:0/3394968679 shutdown_connections 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.901+0000 7f39d4a44640 1 -- 172.21.15.5:0/3394968679 >> 172.21.15.5:0/3394968679 conn(0x7f39d00b0420 msgr2=0x7f39d00b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.901+0000 7f39d4a44640 1 -- 172.21.15.5:0/3394968679 shutdown_connections 2024-09-13T17:14:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.901+0000 7f39d4a44640 1 -- 172.21.15.5:0/3394968679 wait complete. 2024-09-13T17:14:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.902+0000 7f39d4a44640 1 Processor -- start 2024-09-13T17:14:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.902+0000 7f39d4a44640 1 -- start start 2024-09-13T17:14:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39b8004d00 0x7f39d0148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 0x7f39d00b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0146700 con 0x7f39d01532b0 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0146110 con 0x7f39d0145b80 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39d4a44640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015d5b0 con 0x7f39b8004d00 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41708/0 (socket says 172.21.15.5:41708) 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 -- 172.21.15.5:0/472796351 learned_addr learned my addr 172.21.15.5:0/472796351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39ce59c640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39b8004d00 0x7f39d0148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39ced9d640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 0x7f39d00b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 -- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39b8004d00 msgr2=0x7f39d0148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39b8004d00 0x7f39d0148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 -- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 msgr2=0x7f39d00b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 0x7f39d00b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 -- 172.21.15.5:0/472796351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d015d890 con 0x7f39d01532b0 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39ced9d640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 0x7f39d00b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39cdd9b640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f39c4011960 tx=0x7f39c4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.903+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400faf0 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.904+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400fc50 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.904+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4014440 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.904+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0146320 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.904+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d0148f40 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.905+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d015da80 con 0x7f39d01532b0 2024-09-13T17:14:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.905+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39c40145a0 con 0x7f39d01532b0 2024-09-13T17:14:59.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.906+0000 7f39beffd640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 0x7f39b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.906+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39c4089cb0 con 0x7f39d01532b0 2024-09-13T17:14:59.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.906+0000 7f39ce59c640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 0x7f39b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.906+0000 7f39ce59c640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 0x7f39b006d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39c0001cf0 tx=0x7f39c00078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:14:59.910+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f39c4054d30 con 0x7f39d01532b0 2024-09-13T17:15:00.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.078+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39d006ce60 con 0x7f39d01532b0 2024-09-13T17:15:00.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.078+0000 7f39beffd640 1 -- 172.21.15.5:0/472796351 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39c4058350 con 0x7f39d01532b0 2024-09-13T17:15:00.081 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.080+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 msgr2=0x7f39b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.080+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 0x7f39b006d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39c0001cf0 tx=0x7f39c00078f0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.080+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 msgr2=0x7f39d00b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.080+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f39c4011960 tx=0x7f39c4011e20 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 shutdown_connections 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39d0145b80 0x7f39d00b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f39b006ac00 0x7f39b006d0c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d01532b0 0x7f39d00b1fb0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 --2- 172.21.15.5:0/472796351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39b8004d00 0x7f39d0148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 >> 172.21.15.5:0/472796351 conn(0x7f39d00b0420 msgr2=0x7f39d0159630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 shutdown_connections 2024-09-13T17:15:00.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.081+0000 7f39d4a44640 1 -- 172.21.15.5:0/472796351 wait complete. 2024-09-13T17:15:00.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:15:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.196+0000 7fe689933640 1 Processor -- start 2024-09-13T17:15:00.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.196+0000 7fe689933640 1 -- start start 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.197+0000 7fe689933640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe6840cea20 0x7fe6840d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.197+0000 7fe689933640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6840ce590 con 0x7fe68415fce0 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.197+0000 7fe689933640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6840d3340 con 0x7fe6840b1230 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.197+0000 7fe689933640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6840b4fc0 con 0x7fe6840cea20 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe682ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe68415fce0 0x7fe6840b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50848/0 (socket says 172.21.15.5:50848) 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe682ffd640 1 -- 172.21.15.5:0/1302100654 learned_addr learned my addr 172.21.15.5:0/1302100654 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe6837fe640 1 --2- 172.21.15.5:0/1302100654 >> v2:172.21.15.179:3300/0 conn(0x7fe6840cea20 0x7fe6840d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142127002 0 0) 0x7fe6840ce590 con 0x7fe68415fce0 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe670003520 con 0x7fe68415fce0 2024-09-13T17:15:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593216160 0 0) 0x7fe670003520 con 0x7fe68415fce0 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 >> v2:172.21.15.179:3300/0 conn(0x7fe6840cea20 msgr2=0x7fe6840d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 --2- 172.21.15.5:0/1302100654 >> v2:172.21.15.179:3300/0 conn(0x7fe6840cea20 0x7fe6840d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 >> v1:172.21.15.179:6789/0 conn(0x7fe6840b1230 legacy=0x7fe68406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840b4ce0 con 0x7fe68415fce0 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe6740019f0 con 0x7fe68415fce0 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 >> v1:172.21.15.5:6789/0 conn(0x7fe68415fce0 legacy=0x7fe6840b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670003970 0x7fe670003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 0x7fe670004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe670005180 0x7fe67000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840b4fc0 con 0x7fe6700047c0 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67000c020 con 0x7fe670005180 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67000c1e0 con 0x7fe670003970 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 0x7fe670004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe682ffd640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670003970 0x7fe670003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.198+0000 7fe6837fe640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe670005180 0x7fe67000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 -- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670003970 msgr2=0x7fe670003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe670003970 0x7fe670003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 -- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe670005180 msgr2=0x7fe67000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe670005180 0x7fe67000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6837fe640 1 -- 172.21.15.5:0/1302100654 reap_dead start 2024-09-13T17:15:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 -- 172.21.15.5:0/1302100654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670003520 con 0x7fe6700047c0 2024-09-13T17:15:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 0x7fe670004c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe66c001750 tx=0x7fe6700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da26b072db92d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0052d0 con 0x7fe6700047c0 2024-09-13T17:15:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.199+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c005430 con 0x7fe6700047c0 2024-09-13T17:15:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe681ffb640 1 -- 172.21.15.5:0/1302100654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c02abc0 con 0x7fe6700047c0 2024-09-13T17:15:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 -- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 msgr2=0x7fe670004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 0x7fe670004c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe66c001750 tx=0x7fe6700057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 -- 172.21.15.5:0/1302100654 shutdown_connections 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 --2- 172.21.15.5:0/1302100654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700047c0 0x7fe670004c40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 -- 172.21.15.5:0/1302100654 >> 172.21.15.5:0/1302100654 conn(0x7fe684089f90 msgr2=0x7fe6840d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 -- 172.21.15.5:0/1302100654 shutdown_connections 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.200+0000 7fe689933640 1 -- 172.21.15.5:0/1302100654 wait complete. 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.201+0000 7fe689933640 1 Processor -- start 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 -- start start 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700047c0 0x7fe6840b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6840ca750 0x7fe68415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6841510c0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840cc450 con 0x7fe6840ca750 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe689933640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840caf30 con 0x7fe6700047c0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe6827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe6827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41726/0 (socket says 172.21.15.5:41726) 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.202+0000 7fe6827fc640 1 -- 172.21.15.5:0/1470645848 learned_addr learned my addr 172.21.15.5:0/1470645848 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe682ffd640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700047c0 0x7fe6840b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6837fe640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6840ca750 0x7fe68415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 -- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700047c0 msgr2=0x7fe6840b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700047c0 0x7fe6840b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 -- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6840ca750 msgr2=0x7fe68415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6840ca750 0x7fe68415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 -- 172.21.15.5:0/1470645848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840cb210 con 0x7fe6840cbfd0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe6827fc640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe66c02a4a0 tx=0x7fe66c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c007300 con 0x7fe6840cbfd0 2024-09-13T17:15:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c007460 con 0x7fe6840cbfd0 2024-09-13T17:15:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0067d0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6840cb4f0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.203+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6840cbab0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.204+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6840b5640 con 0x7fe6840cbfd0 2024-09-13T17:15:00.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.205+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe66c006930 con 0x7fe6840cbfd0 2024-09-13T17:15:00.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.205+0000 7fe67bfff640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 0x7fe66406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.205+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe66c0a91c0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.205+0000 7fe682ffd640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 0x7fe66406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.206+0000 7fe682ffd640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 0x7fe66406d0f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe674002030 tx=0x7fe674006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.209+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe66c074380 con 0x7fe6840cbfd0 2024-09-13T17:15:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.382+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6840b5640 con 0x7fe6840cbfd0 2024-09-13T17:15:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.382+0000 7fe67bfff640 1 -- 172.21.15.5:0/1470645848 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe66c0779a0 con 0x7fe6840cbfd0 2024-09-13T17:15:00.384 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 msgr2=0x7fe66406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 0x7fe66406d0f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe674002030 tx=0x7fe674006040 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 msgr2=0x7fe684150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe66c02a4a0 tx=0x7fe66c001120 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 shutdown_connections 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6840ca750 0x7fe68415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66406ac30 0x7fe66406d0f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6840cbfd0 0x7fe684150b80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 --2- 172.21.15.5:0/1470645848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6700047c0 0x7fe6840b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.384+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 >> 172.21.15.5:0/1470645848 conn(0x7fe684089f90 msgr2=0x7fe68415d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.385+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 shutdown_connections 2024-09-13T17:15:00.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.385+0000 7fe689933640 1 -- 172.21.15.5:0/1470645848 wait complete. 2024-09-13T17:15:00.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:00.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.496+0000 7f9b68ff4640 1 Processor -- start 2024-09-13T17:15:00.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.496+0000 7f9b68ff4640 1 -- start start 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b68ff4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b640b4cf0 0x7f9b640cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b68ff4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640d1e80 con 0x7f9b6415c810 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b68ff4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640d1750 con 0x7f9b640d06d0 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b68ff4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640d0bd0 con 0x7f9b640b4cf0 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b6259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b6415c810 0x7f9b640b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50852/0 (socket says 172.21.15.5:50852) 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.497+0000 7f9b6259c640 1 -- 172.21.15.5:0/290983186 learned_addr learned my addr 172.21.15.5:0/290983186 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b61d9b640 1 --2- 172.21.15.5:0/290983186 >> v2:172.21.15.179:3300/0 conn(0x7f9b640b4cf0 0x7f9b640cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691309897 0 0) 0x7f9b640d1e80 con 0x7f9b6415c810 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b50003520 con 0x7f9b6415c810 2024-09-13T17:15:00.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697187220 0 0) 0x7f9b50003520 con 0x7f9b6415c810 2024-09-13T17:15:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b61d9b640 1 -- 172.21.15.5:0/290983186 >> v1:172.21.15.179:6789/0 conn(0x7f9b640d06d0 legacy=0x7f9b640b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b61d9b640 1 -- 172.21.15.5:0/290983186 >> v1:172.21.15.5:6789/0 conn(0x7f9b6415c810 legacy=0x7f9b640b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.498+0000 7f9b61d9b640 1 -- 172.21.15.5:0/290983186 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640d0eb0 con 0x7f9b640b4cf0 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b61d9b640 1 --2- 172.21.15.5:0/290983186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b640cd780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0097a0 tx=0x7f9b4c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc8f0f4856626b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540019f0 con 0x7f9b640b4cf0 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c02ac50 con 0x7f9b640b4cf0 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b6159a640 1 -- 172.21.15.5:0/290983186 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c032440 con 0x7f9b640b4cf0 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b68ff4640 1 -- 172.21.15.5:0/290983186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 msgr2=0x7f9b640cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.499+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/290983186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b640cd780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0097a0 tx=0x7f9b4c02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.500+0000 7f9b68ff4640 1 -- 172.21.15.5:0/290983186 shutdown_connections 2024-09-13T17:15:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.500+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/290983186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b640cd780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.500+0000 7f9b68ff4640 1 -- 172.21.15.5:0/290983186 >> 172.21.15.5:0/290983186 conn(0x7f9b640717a0 msgr2=0x7f9b64071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.500+0000 7f9b68ff4640 1 -- 172.21.15.5:0/290983186 shutdown_connections 2024-09-13T17:15:00.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.500+0000 7f9b68ff4640 1 -- 172.21.15.5:0/290983186 wait complete. 2024-09-13T17:15:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.501+0000 7f9b68ff4640 1 Processor -- start 2024-09-13T17:15:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.501+0000 7f9b68ff4640 1 -- start start 2024-09-13T17:15:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b641f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6415c810 0x7f9b641564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64159520 con 0x7f9b640d06d0 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b641f2fd0 con 0x7f9b640b4cf0 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b68ff4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64158910 con 0x7f9b6415c810 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41738/0 (socket says 172.21.15.5:41738) 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 -- 172.21.15.5:0/3220488116 learned_addr learned my addr 172.21.15.5:0/3220488116 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b641f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b62d9d640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6415c810 0x7f9b641564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 -- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6415c810 msgr2=0x7f9b641564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6415c810 0x7f9b641564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 -- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 msgr2=0x7f9b641f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b641f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 -- 172.21.15.5:0/3220488116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c009400 con 0x7f9b640d06d0 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.502+0000 7f9b61d9b640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c02a7b0 tx=0x7f9b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.503+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0039a0 con 0x7f9b640d06d0 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.503+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c003b00 con 0x7f9b640d06d0 2024-09-13T17:15:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.503+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64158bf0 con 0x7f9b640d06d0 2024-09-13T17:15:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.503+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c003e90 con 0x7f9b640d06d0 2024-09-13T17:15:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.503+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b641591b0 con 0x7f9b640d06d0 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.504+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b640b7390 con 0x7f9b640d06d0 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.504+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b4c032440 con 0x7f9b640d06d0 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.505+0000 7f9b5affd640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 0x7f9b4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.505+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b4c0a9cd0 con 0x7f9b640d06d0 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.505+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 0x7f9b4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.505+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 0x7f9b4406d0f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b54002230 tx=0x7f9b54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.509+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9b4c074e00 con 0x7f9b640d06d0 2024-09-13T17:15:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.715+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b640672a0 con 0x7f9b640d06d0 2024-09-13T17:15:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.716+0000 7f9b5affd640 1 -- 172.21.15.5:0/3220488116 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f9b4c041090 con 0x7f9b640d06d0 2024-09-13T17:15:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:00.718 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:15:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 msgr2=0x7f9b4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 0x7f9b4406d0f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b54002230 tx=0x7f9b54009040 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 msgr2=0x7f9b6414bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c02a7b0 tx=0x7f9b4c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 shutdown_connections 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6415c810 0x7f9b641564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac30 0x7f9b4406d0f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b640d06d0 0x7f9b6414bc50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 --2- 172.21.15.5:0/3220488116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b640b4cf0 0x7f9b641f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 >> 172.21.15.5:0/3220488116 conn(0x7f9b640717a0 msgr2=0x7f9b640b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 shutdown_connections 2024-09-13T17:15:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.718+0000 7f9b68ff4640 1 -- 172.21.15.5:0/3220488116 wait complete. 2024-09-13T17:15:00.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.832+0000 7fbb34501640 1 Processor -- start 2024-09-13T17:15:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.832+0000 7fbb34501640 1 -- start start 2024-09-13T17:15:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb34501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb34501640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 0x7fbb2c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb34501640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0d0110 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb34501640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c099540 con 0x7fbb2c15dc30 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb34501640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c099820 con 0x7fbb2c06f160 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41740/0 (socket says 172.21.15.5:41740) 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 -- 172.21.15.5:0/407774608 learned_addr learned my addr 172.21.15.5:0/407774608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb32a9e640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 0x7fbb2c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 -- 172.21.15.5:0/407774608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 msgr2=0x7fbb2c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 0x7fbb2c0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 -- 172.21.15.5:0/407774608 >> v1:172.21.15.179:6789/0 conn(0x7fbb2c06e5c0 legacy=0x7fbb2c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb3229d640 1 -- 172.21.15.5:0/407774608 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c099b00 con 0x7fbb2c15dc30 2024-09-13T17:15:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.833+0000 7fbb32a9e640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 0x7fbb2c0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.834+0000 7fbb3229d640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb2802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e73b1708162e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.834+0000 7fbb3129b640 1 -- 172.21.15.5:0/407774608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2802ae10 con 0x7fbb2c15dc30 2024-09-13T17:15:00.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.834+0000 7fbb3129b640 1 -- 172.21.15.5:0/407774608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28032440 con 0x7fbb2c15dc30 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.834+0000 7fbb3129b640 1 -- 172.21.15.5:0/407774608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb280327d0 con 0x7fbb2c15dc30 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 -- 172.21.15.5:0/407774608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c15dc30 msgr2=0x7fbb2c0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb2802a100 comp rx=0 tx=0).stop 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 -- 172.21.15.5:0/407774608 shutdown_connections 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c06f160 0x7fbb2c0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 --2- 172.21.15.5:0/407774608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c15dc30 0x7fbb2c0cfb30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 -- 172.21.15.5:0/407774608 >> 172.21.15.5:0/407774608 conn(0x7fbb2c0d0310 msgr2=0x7fbb2c0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 -- 172.21.15.5:0/407774608 shutdown_connections 2024-09-13T17:15:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.835+0000 7fbb34501640 1 -- 172.21.15.5:0/407774608 wait complete. 2024-09-13T17:15:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.836+0000 7fbb34501640 1 Processor -- start 2024-09-13T17:15:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.836+0000 7fbb34501640 1 -- start start 2024-09-13T17:15:00.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb2c06f160 0x7fbb2c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c15dc30 0x7fbb2c143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0b45d0 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0b48b0 con 0x7fbb2c06f160 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb34501640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0b4b90 con 0x7fbb2c15dc30 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41750/0 (socket says 172.21.15.5:41750) 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 -- 172.21.15.5:0/1035771877 learned_addr learned my addr 172.21.15.5:0/1035771877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb32a9e640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c15dc30 0x7fbb2c143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb31a9c640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb2c06f160 0x7fbb2c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 -- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c15dc30 msgr2=0x7fbb2c143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c15dc30 0x7fbb2c143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 -- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb2c06f160 msgr2=0x7fbb2c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb2c06f160 0x7fbb2c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 -- 172.21.15.5:0/1035771877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280094d0 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb3229d640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.837+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28030b80 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.838+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28030ce0 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.838+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c0b4e70 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.838+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2803d660 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.838+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c0b4250 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.839+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c0b5390 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.839+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb28039040 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.840+0000 7fbb22ffd640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 0x7fbb1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.840+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb280aa0f0 con 0x7fbb2c06e5c0 2024-09-13T17:15:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.840+0000 7fbb31a9c640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 0x7fbb1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.840+0000 7fbb31a9c640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 0x7fbb1006d0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0c7920 tx=0x7fbb1c007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:00.844+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb2c0b5390 con 0x7fbb2c06e5c0 2024-09-13T17:15:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.015+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb2c0b5390 con 0x7fbb2c06e5c0 2024-09-13T17:15:01.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.016+0000 7fbb22ffd640 1 -- 172.21.15.5:0/1035771877 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16731 (secure 0 0 0) 0x7fbb2c0b5390 con 0x7fbb2c06e5c0 2024-09-13T17:15:01.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:01.019 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:56.591368+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 msgr2=0x7fbb1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 0x7fbb1006d0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0c7920 tx=0x7fbb1c007e30 comp rx=0 tx=0).stop 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 msgr2=0x7fbb2c0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009870 tx=0x7fbb280046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 shutdown_connections 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb2c15dc30 0x7fbb2c143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb2c06f160 0x7fbb2c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbb1006ac30 0x7fbb1006d0f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 --2- 172.21.15.5:0/1035771877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c06e5c0 0x7fbb2c0b5670 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 >> 172.21.15.5:0/1035771877 conn(0x7fbb2c0d0310 msgr2=0x7fbb2c15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 shutdown_connections 2024-09-13T17:15:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.019+0000 7fbb34501640 1 -- 172.21.15.5:0/1035771877 wait complete. 2024-09-13T17:15:01.032 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:15:01.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:01.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.132+0000 7fd71c432640 1 Processor -- start 2024-09-13T17:15:01.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.132+0000 7fd71c432640 1 -- start start 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71c432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 0x7fd7141674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71c432640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140b0be0 con 0x7fd71415fb90 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71c432640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140affd0 con 0x7fd71415ff70 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71c432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140b02b0 con 0x7fd7140ce1f0 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71a1ce640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd71415fb90 0x7fd7140b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50868/0 (socket says 172.21.15.5:50868) 2024-09-13T17:15:01.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.133+0000 7fd71a1ce640 1 -- 172.21.15.5:0/2260498253 learned_addr learned my addr 172.21.15.5:0/2260498253 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd71a9cf640 1 --2- 172.21.15.5:0/2260498253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 0x7fd7141674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd7191cc640 1 -- 172.21.15.5:0/2260498253 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262731016 0 0) 0x7fd7140b0be0 con 0x7fd71415fb90 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd7191cc640 1 -- 172.21.15.5:0/2260498253 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6fc003520 con 0x7fd71415fb90 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd71a9cf640 1 -- 172.21.15.5:0/2260498253 >> v1:172.21.15.179:6789/0 conn(0x7fd71415ff70 legacy=0x7fd7140b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd71a9cf640 1 -- 172.21.15.5:0/2260498253 >> v1:172.21.15.5:6789/0 conn(0x7fd71415fb90 legacy=0x7fd7140b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.134+0000 7fd71a9cf640 1 -- 172.21.15.5:0/2260498253 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140b0590 con 0x7fd7140ce1f0 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71a9cf640 1 --2- 172.21.15.5:0/2260498253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 0x7fd7141674e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097d0 tx=0x7fd70c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47a418cdae21a3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd7191cc640 1 -- 172.21.15.5:0/2260498253 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c032440 con 0x7fd7140ce1f0 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd7191cc640 1 -- 172.21.15.5:0/2260498253 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0325a0 con 0x7fd7140ce1f0 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd7191cc640 1 -- 172.21.15.5:0/2260498253 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c032930 con 0x7fd7140ce1f0 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 -- 172.21.15.5:0/2260498253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 msgr2=0x7fd7141674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 --2- 172.21.15.5:0/2260498253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 0x7fd7141674e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097d0 tx=0x7fd70c02a210 comp rx=0 tx=0).stop 2024-09-13T17:15:01.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 -- 172.21.15.5:0/2260498253 shutdown_connections 2024-09-13T17:15:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 --2- 172.21.15.5:0/2260498253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7140ce1f0 0x7fd7141674e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 -- 172.21.15.5:0/2260498253 >> 172.21.15.5:0/2260498253 conn(0x7fd714089f90 msgr2=0x7fd7140d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.135+0000 7fd71c432640 1 -- 172.21.15.5:0/2260498253 shutdown_connections 2024-09-13T17:15:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.136+0000 7fd71c432640 1 -- 172.21.15.5:0/2260498253 wait complete. 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 Processor -- start 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 -- start start 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 0x7fd71415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd71415ff70 0x7fd71415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71414c590 con 0x7fd7140ce1f0 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71415c250 con 0x7fd71415fb90 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.137+0000 7fd71c432640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71414c850 con 0x7fd71415ff70 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41764/0 (socket says 172.21.15.5:41764) 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 -- 172.21.15.5:0/3248195223 learned_addr learned my addr 172.21.15.5:0/3248195223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a9cf640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd71415ff70 0x7fd71415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd7199cd640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 0x7fd71415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 -- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd71415ff70 msgr2=0x7fd71415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd71415ff70 0x7fd71415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 -- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 msgr2=0x7fd71415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 0x7fd71415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 -- 172.21.15.5:0/3248195223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009400 con 0x7fd7140ce1f0 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd7199cd640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 0x7fd71415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71a1ce640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd70400cbc0 tx=0x7fd70400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400ad40 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704012400 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71414cb30 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400aea0 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.138+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71415b4b0 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.139+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71414cd70 con 0x7fd7140ce1f0 2024-09-13T17:15:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.140+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd704007070 con 0x7fd7140ce1f0 2024-09-13T17:15:01.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.140+0000 7fd712ffd640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 0x7fd70006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.141+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd704089440 con 0x7fd7140ce1f0 2024-09-13T17:15:01.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.141+0000 7fd7199cd640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 0x7fd70006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.141+0000 7fd7199cd640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 0x7fd70006d0f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd714159180 tx=0x7fd708009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.145+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd71414cd70 con 0x7fd7140ce1f0 2024-09-13T17:15:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.352+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd71414cd70 con 0x7fd7140ce1f0 2024-09-13T17:15:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.352+0000 7fd712ffd640 1 -- 172.21.15.5:0/3248195223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fd71414cd70 con 0x7fd7140ce1f0 2024-09-13T17:15:01.355 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:01.355 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:15:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 msgr2=0x7fd70006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 0x7fd70006d0f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd714159180 tx=0x7fd708009040 comp rx=0 tx=0).stop 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 msgr2=0x7fd71414ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd70400cbc0 tx=0x7fd70400a430 comp rx=0 tx=0).stop 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 shutdown_connections 2024-09-13T17:15:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd71415ff70 0x7fd71415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd71415fb90 0x7fd71415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd70006ac30 0x7fd70006d0f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 --2- 172.21.15.5:0/3248195223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7140ce1f0 0x7fd71414ec70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 >> 172.21.15.5:0/3248195223 conn(0x7fd714089f90 msgr2=0x7fd7140cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 shutdown_connections 2024-09-13T17:15:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.355+0000 7fd71c432640 1 -- 172.21.15.5:0/3248195223 wait complete. 2024-09-13T17:15:01.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 Processor -- start 2024-09-13T17:15:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 -- start start 2024-09-13T17:15:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde3c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fde3c15a290 0x7fde3c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0b2390 con 0x7fde3c156f40 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c15a740 con 0x7fde3c15a290 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.467+0000 7fde42f8a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b1780 con 0x7fde3c06e1c0 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde40d26640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fde3c156f40 0x7fde3c06dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50874/0 (socket says 172.21.15.5:50874) 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde40d26640 1 -- 172.21.15.5:0/3730297994 learned_addr learned my addr 172.21.15.5:0/3730297994 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3bfff640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde3c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde41527640 1 --2- 172.21.15.5:0/3730297994 >> v2:172.21.15.179:3300/0 conn(0x7fde3c15a290 0x7fde3c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199382346 0 0) 0x7fde3c0b2390 con 0x7fde3c156f40 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde28003520 con 0x7fde3c156f40 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501674446 0 0) 0x7fde28003520 con 0x7fde3c156f40 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 msgr2=0x7fde3c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde3c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 >> v2:172.21.15.179:3300/0 conn(0x7fde3c15a290 msgr2=0x7fde3c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 --2- 172.21.15.5:0/3730297994 >> v2:172.21.15.179:3300/0 conn(0x7fde3c15a290 0x7fde3c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0b1a60 con 0x7fde3c156f40 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fde340019f0 con 0x7fde3c156f40 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 >> v1:172.21.15.5:6789/0 conn(0x7fde3c156f40 legacy=0x7fde3c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde280047c0 0x7fde28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c15a740 con 0x7fde28003970 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b1780 con 0x7fde280047c0 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2800b980 con 0x7fde3c06e1c0 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde40d26640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde41527640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.468+0000 7fde3bfff640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde280047c0 0x7fde28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 -- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 msgr2=0x7fde28005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c06e1c0 0x7fde28005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 -- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde280047c0 msgr2=0x7fde28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde280047c0 0x7fde28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 -- 172.21.15.5:0/3730297994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28003520 con 0x7fde28003970 2024-09-13T17:15:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.469+0000 7fde40d26640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde28003d90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a780 tx=0x7fde280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578bc41e53c3acb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3402b9a0 con 0x7fde28003970 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3402bb00 con 0x7fde28003970 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde3b7fe640 1 -- 172.21.15.5:0/3730297994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34034470 con 0x7fde28003970 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 -- 172.21.15.5:0/3730297994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 msgr2=0x7fde28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 --2- 172.21.15.5:0/3730297994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde28003d90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a780 tx=0x7fde280057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde41527640 1 -- 172.21.15.5:0/3730297994 reap_dead start 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 -- 172.21.15.5:0/3730297994 shutdown_connections 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 -- 172.21.15.5:0/3730297994 >> 172.21.15.5:0/3730297994 conn(0x7fde3c0ce0d0 msgr2=0x7fde3c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 -- 172.21.15.5:0/3730297994 shutdown_connections 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.470+0000 7fde42f8a640 1 -- 172.21.15.5:0/3730297994 wait complete. 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.471+0000 7fde42f8a640 1 Processor -- start 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.471+0000 7fde42f8a640 1 -- start start 2024-09-13T17:15:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde3c0af8c0 0x7fde3c0974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c144830 0x7fde3c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c14c130 con 0x7fde28003970 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c06a650 con 0x7fde3c0af8c0 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde42f8a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c06a930 con 0x7fde3c144830 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde40d26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde40d26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41782/0 (socket says 172.21.15.5:41782) 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.472+0000 7fde40d26640 1 -- 172.21.15.5:0/2852282590 learned_addr learned my addr 172.21.15.5:0/2852282590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde41527640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c144830 0x7fde3c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde3bfff640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde3c0af8c0 0x7fde3c0974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 -- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c144830 msgr2=0x7fde3c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c144830 0x7fde3c0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 -- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde3c0af8c0 msgr2=0x7fde3c0974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde3c0af8c0 0x7fde3c0974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 -- 172.21.15.5:0/2852282590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c14bdc0 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde40d26640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde3402b380 tx=0x7fde34001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3403b040 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34004b60 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c1495a0 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34034470 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.473+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c097c00 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.474+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c0672a0 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.475+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde34031070 con 0x7fde28003970 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.475+0000 7fde397fa640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.475+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde340a9380 con 0x7fde28003970 2024-09-13T17:15:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.475+0000 7fde3bfff640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.476+0000 7fde3bfff640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 0x7fde1c06d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fde3c145790 tx=0x7fde24009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.479+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fde340744d0 con 0x7fde28003970 2024-09-13T17:15:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.686+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde3c097c00 con 0x7fde28003970 2024-09-13T17:15:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.686+0000 7fde397fa640 1 -- 172.21.15.5:0/2852282590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fde3c097c00 con 0x7fde28003970 2024-09-13T17:15:01.688 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:01.688 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:14:27.525963+0000","modified":"2024-09-13T17:14:29.532867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1510530790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1510530790},{"type":"v1","addr":"172.21.15.5:6835","nonce":1510530790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:15:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 15 2024-09-13T17:15:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 msgr2=0x7fde1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 0x7fde1c06d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fde3c145790 tx=0x7fde24009190 comp rx=0 tx=0).stop 2024-09-13T17:15:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 msgr2=0x7fde3c149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde3402b380 tx=0x7fde34001360 comp rx=0 tx=0).stop 2024-09-13T17:15:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 shutdown_connections 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde3c144830 0x7fde3c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde3c0af8c0 0x7fde3c0974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 --2- 172.21.15.5:0/2852282590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde28003970 0x7fde3c149060 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 >> 172.21.15.5:0/2852282590 conn(0x7fde3c0ce0d0 msgr2=0x7fde3c06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 shutdown_connections 2024-09-13T17:15:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.688+0000 7fde42f8a640 1 -- 172.21.15.5:0/2852282590 wait complete. 2024-09-13T17:15:01.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.800+0000 7f9b68e90640 1 Processor -- start 2024-09-13T17:15:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.800+0000 7f9b68e90640 1 -- start start 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b68e90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b68e90640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 0x7f9b640b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b68e90640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6406d410 con 0x7f9b6415a3e0 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b68e90640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640aba50 con 0x7f9b640ab5a0 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b68e90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6406e4d0 con 0x7f9b6406e090 2024-09-13T17:15:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b62d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 0x7f9b640b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39974/0 (socket says 172.21.15.5:39974) 2024-09-13T17:15:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b6259c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9b6415a3e0 0x7f9b6406c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:57334/0 (socket says 172.21.15.5:57334) 2024-09-13T17:15:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b62d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 0x7f9b640b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:35258/0 (socket says 172.21.15.5:35258) 2024-09-13T17:15:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 -- 172.21.15.5:0/2989908781 learned_addr learned my addr 172.21.15.5:0/2989908781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 -- 172.21.15.5:0/2989908781 >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 msgr2=0x7f9b640b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 --2- 172.21.15.5:0/2989908781 >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 0x7f9b640b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.801+0000 7f9b5bfff640 1 -- 172.21.15.5:0/2989908781 >> v1:172.21.15.179:6789/0 conn(0x7f9b6415a3e0 legacy=0x7f9b6406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.802+0000 7f9b5bfff640 1 -- 172.21.15.5:0/2989908781 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6406cb70 con 0x7f9b6406e090 2024-09-13T17:15:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.802+0000 7f9b5bfff640 1 --2- 172.21.15.5:0/2989908781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009870 tx=0x7f9b4c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3101f25a2c656a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.802+0000 7f9b61d9b640 1 -- 172.21.15.5:0/2989908781 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c032440 con 0x7f9b6406e090 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b61d9b640 1 -- 172.21.15.5:0/2989908781 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c0325a0 con 0x7f9b6406e090 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b61d9b640 1 -- 172.21.15.5:0/2989908781 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c032930 con 0x7f9b6406e090 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 -- 172.21.15.5:0/2989908781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 msgr2=0x7f9b640ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 --2- 172.21.15.5:0/2989908781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009870 tx=0x7f9b4c02a270 comp rx=0 tx=0).stop 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 -- 172.21.15.5:0/2989908781 shutdown_connections 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 --2- 172.21.15.5:0/2989908781 >> v2:172.21.15.179:3300/0 conn(0x7f9b640ab5a0 0x7f9b640b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 --2- 172.21.15.5:0/2989908781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b6406e090 0x7f9b640ab060 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 -- 172.21.15.5:0/2989908781 >> 172.21.15.5:0/2989908781 conn(0x7f9b640ce0d0 msgr2=0x7f9b640ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 -- 172.21.15.5:0/2989908781 shutdown_connections 2024-09-13T17:15:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.803+0000 7f9b68e90640 1 -- 172.21.15.5:0/2989908781 wait complete. 2024-09-13T17:15:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.804+0000 7f9b68e90640 1 Processor -- start 2024-09-13T17:15:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.804+0000 7f9b68e90640 1 -- start start 2024-09-13T17:15:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b640ab5a0 0x7f9b64099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 0x7f9b64157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64156790 con 0x7f9b6406e090 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64156a70 con 0x7f9b6415a3e0 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b68e90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64156d50 con 0x7f9b640ab5a0 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b6259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b6259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41784/0 (socket says 172.21.15.5:41784) 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.805+0000 7f9b6259c640 1 -- 172.21.15.5:0/3198903459 learned_addr learned my addr 172.21.15.5:0/3198903459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b5bfff640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b640ab5a0 0x7f9b64099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b62d9d640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 0x7f9b64157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 -- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b640ab5a0 msgr2=0x7f9b64099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b640ab5a0 0x7f9b64099cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 -- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 msgr2=0x7f9b64157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 0x7f9b64157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 -- 172.21.15.5:0/3198903459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0094d0 con 0x7f9b6406e090 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b62d9d640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 0x7f9b64157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b6259c640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c3e0 tx=0x7f9b5400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540074e0 con 0x7f9b6406e090 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54007640 con 0x7f9b6406e090 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540049e0 con 0x7f9b6406e090 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64157030 con 0x7f9b6406e090 2024-09-13T17:15:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.806+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6409bae0 con 0x7f9b6406e090 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.807+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64157550 con 0x7f9b6406e090 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.808+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b54004b40 con 0x7f9b6406e090 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.808+0000 7f9b5affd640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 0x7f9b4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.808+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b54088e50 con 0x7f9b6406e090 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.808+0000 7f9b5bfff640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 0x7f9b4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.809+0000 7f9b5bfff640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 0x7f9b4406d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c034000 tx=0x7f9b4c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.812+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9b64157550 con 0x7f9b6406e090 2024-09-13T17:15:01.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.985+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b640672a0 con 0x7f9b6406e090 2024-09-13T17:15:01.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.986+0000 7f9b5affd640 1 -- 172.21.15.5:0/3198903459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16731 (secure 0 0 0) 0x7f9b54053f60 con 0x7f9b6406e090 2024-09-13T17:15:01.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:01.989 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:14:56.591368+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:14:26.106783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:14:26.498581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:01.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 msgr2=0x7f9b4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 0x7f9b4406d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c034000 tx=0x7f9b4c02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 msgr2=0x7f9b641f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c3e0 tx=0x7f9b5400c8a0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 shutdown_connections 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b6415a3e0 0x7f9b64157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b640ab5a0 0x7f9b64099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9b4406ac00 0x7f9b4406d0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 --2- 172.21.15.5:0/3198903459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b6406e090 0x7f9b641f2ef0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 >> 172.21.15.5:0/3198903459 conn(0x7f9b640ce0d0 msgr2=0x7f9b640ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 shutdown_connections 2024-09-13T17:15:01.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:01.988+0000 7f9b68e90640 1 -- 172.21.15.5:0/3198903459 wait complete. 2024-09-13T17:15:02.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:15:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.101+0000 7fb2122b7640 1 Processor -- start 2024-09-13T17:15:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 -- start start 2024-09-13T17:15:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0704a0 con 0x7fb20c15fd80 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c06cc10 con 0x7fb20c099110 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.102+0000 7fb2122b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0d12e0 con 0x7fb20c0d0e30 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb203fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb203fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:35276/0 (socket says 172.21.15.5:35276) 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb20bfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb20c15fd80 0x7fb20c098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:57350/0 (socket says 172.21.15.5:57350) 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb203fff640 1 -- 172.21.15.5:0/1768669202 learned_addr learned my addr 172.21.15.5:0/1768669202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39998/0 (socket says 172.21.15.5:39998) 2024-09-13T17:15:02.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb20b7fe640 1 -- 172.21.15.5:0/1768669202 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192042088 0 0) 0x7fb20c0704a0 con 0x7fb20c15fd80 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb20b7fe640 1 -- 172.21.15.5:0/1768669202 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f8003520 con 0x7fb20c15fd80 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 -- 172.21.15.5:0/1768669202 >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 msgr2=0x7fb20c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 --2- 172.21.15.5:0/1768669202 >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 -- 172.21.15.5:0/1768669202 >> v1:172.21.15.179:6789/0 conn(0x7fb20c15fd80 legacy=0x7fb20c098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb210854640 1 -- 172.21.15.5:0/1768669202 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c06bd80 con 0x7fb20c0d0e30 2024-09-13T17:15:02.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.103+0000 7fb203fff640 1 --2- 172.21.15.5:0/1768669202 >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:02.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.104+0000 7fb210854640 1 --2- 172.21.15.5:0/1768669202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb204009d90 tx=0x7fb20402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b61d8bf9c53e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.104+0000 7fb20b7fe640 1 -- 172.21.15.5:0/1768669202 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204031600 con 0x7fb20c0d0e30 2024-09-13T17:15:02.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.104+0000 7fb20b7fe640 1 -- 172.21.15.5:0/1768669202 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20402d050 con 0x7fb20c0d0e30 2024-09-13T17:15:02.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.104+0000 7fb20b7fe640 1 -- 172.21.15.5:0/1768669202 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204031980 con 0x7fb20c0d0e30 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 -- 172.21.15.5:0/1768669202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 msgr2=0x7fb20c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 --2- 172.21.15.5:0/1768669202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb204009d90 tx=0x7fb20402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 -- 172.21.15.5:0/1768669202 shutdown_connections 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 --2- 172.21.15.5:0/1768669202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c06e870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 --2- 172.21.15.5:0/1768669202 >> v2:172.21.15.179:3300/0 conn(0x7fb20c099110 0x7fb20c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 -- 172.21.15.5:0/1768669202 >> 172.21.15.5:0/1768669202 conn(0x7fb20c0d0310 msgr2=0x7fb20c0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 -- 172.21.15.5:0/1768669202 shutdown_connections 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.105+0000 7fb2122b7640 1 -- 172.21.15.5:0/1768669202 wait complete. 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.106+0000 7fb2122b7640 1 Processor -- start 2024-09-13T17:15:02.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.106+0000 7fb2122b7640 1 -- start start 2024-09-13T17:15:02.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c09cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c15fd80 0x7fb20c09a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c14fde0 con 0x7fb20c099110 2024-09-13T17:15:02.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c09d560 con 0x7fb20c15fd80 2024-09-13T17:15:02.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2122b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c09d840 con 0x7fb20c0d0e30 2024-09-13T17:15:02.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41800/0 (socket says 172.21.15.5:41800) 2024-09-13T17:15:02.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 -- 172.21.15.5:0/930277909 learned_addr learned my addr 172.21.15.5:0/930277909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:02.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb203fff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c09cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb210854640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c15fd80 0x7fb20c09a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 -- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 msgr2=0x7fb20c09cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c09cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 -- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c15fd80 msgr2=0x7fb20c09a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c15fd80 0x7fb20c09a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 -- 172.21.15.5:0/930277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40094d0 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb20bfff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00c500 tx=0x7fb1fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.107+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc007500 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.108+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc007660 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.108+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb204009a70 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.108+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc004a20 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.108+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c09de00 con 0x7fb20c099110 2024-09-13T17:15:02.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.109+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c0cfa60 con 0x7fb20c099110 2024-09-13T17:15:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.109+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1fc004c40 con 0x7fb20c099110 2024-09-13T17:15:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.110+0000 7fb2097fa640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 0x7fb1ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.110+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1fc088890 con 0x7fb20c099110 2024-09-13T17:15:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.110+0000 7fb203fff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 0x7fb1ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.110+0000 7fb203fff640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 0x7fb1ec06d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0d02e0 tx=0x7fb1f4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.114+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb1fc053b10 con 0x7fb20c099110 2024-09-13T17:15:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.321+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb20c06cf90 con 0x7fb20c099110 2024-09-13T17:15:02.324 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:15:02.322+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:15:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.328+0000 7fb2097fa640 1 -- 172.21.15.5:0/930277909 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb1fc018020 con 0x7fb20c099110 2024-09-13T17:15:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:15:02.333 INFO:tasks.ceph.mds.a.smithi005.stderr: -1629> 2024-09-13T17:14:32.099+0000 7fc5e7c0b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 msgr2=0x7fb1ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 0x7fb1ec06d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0d02e0 tx=0x7fb1f4009240 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 msgr2=0x7fb20c14f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00c500 tx=0x7fb1fc00c9c0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 shutdown_connections 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c15fd80 0x7fb20c09a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0d0e30 0x7fb20c09cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1ec06ac00 0x7fb1ec06d0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 --2- 172.21.15.5:0/930277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c099110 0x7fb20c14f8a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 >> 172.21.15.5:0/930277909 conn(0x7fb20c0d0310 msgr2=0x7fb20c06e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 shutdown_connections 2024-09-13T17:15:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.331+0000 7fb2122b7640 1 -- 172.21.15.5:0/930277909 wait complete. 2024-09-13T17:15:02.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:15:02.359 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:15:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.447+0000 7f15a8308640 1 Processor -- start 2024-09-13T17:15:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.447+0000 7f15a8308640 1 -- start start 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a8308640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15a00abe60 0x7f15a00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a8308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f15a006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a8308640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a00ad050 con 0x7f15a01591e0 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a8308640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a006e400 con 0x7f15a00abe60 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a8308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00ac440 con 0x7f15a006da30 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a60a4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15a01591e0 0x7f15a00ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50892/0 (socket says 172.21.15.5:50892) 2024-09-13T17:15:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a60a4640 1 -- 172.21.15.5:0/2098484174 learned_addr learned my addr 172.21.15.5:0/2098484174 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304297169 0 0) 0x7f15a00ad050 con 0x7f15a01591e0 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a68a5640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f15a006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f158c003520 con 0x7f15a01591e0 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a58a3640 1 --2- 172.21.15.5:0/2098484174 >> v2:172.21.15.179:3300/0 conn(0x7f15a00abe60 0x7f15a00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3685862515 0 0) 0x7f158c003520 con 0x7f15a01591e0 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 msgr2=0x7f15a006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f15a006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 >> v2:172.21.15.179:3300/0 conn(0x7f15a00abe60 msgr2=0x7f15a00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 --2- 172.21.15.5:0/2098484174 >> v2:172.21.15.179:3300/0 conn(0x7f15a00abe60 0x7f15a00b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00ac720 con 0x7f15a01591e0 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.448+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f159c001670 con 0x7f15a01591e0 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 >> v1:172.21.15.5:6789/0 conn(0x7f15a01591e0 legacy=0x7f15a00ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c003970 0x7f158c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c0047c0 0x7f158c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f158c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a006e400 con 0x7f158c003970 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00ac440 con 0x7f158c0047c0 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c00b980 con 0x7f15a006da30 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c003970 0x7f158c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a58a3640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c0047c0 0x7f158c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a68a5640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f158c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 -- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 msgr2=0x7f158c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15a006da30 0x7f158c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 -- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c0047c0 msgr2=0x7f158c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f158c0047c0 0x7f158c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.449+0000 7f15a60a4640 1 -- 172.21.15.5:0/2098484174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c003520 con 0x7f158c003970 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a60a4640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c003970 0x7f158c003d90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c210 tx=0x7f158c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c2f7ec373d1fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c005ad0 con 0x7f158c003970 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c005c50 con 0x7f158c003970 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a50a2640 1 -- 172.21.15.5:0/2098484174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c007070 con 0x7f158c003970 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a8308640 1 -- 172.21.15.5:0/2098484174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c003970 msgr2=0x7f158c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a8308640 1 --2- 172.21.15.5:0/2098484174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f158c003970 0x7f158c003d90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c210 tx=0x7f158c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.450+0000 7f15a68a5640 1 -- 172.21.15.5:0/2098484174 reap_dead start 2024-09-13T17:15:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.451+0000 7f15a8308640 1 -- 172.21.15.5:0/2098484174 shutdown_connections 2024-09-13T17:15:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.451+0000 7f15a8308640 1 -- 172.21.15.5:0/2098484174 >> 172.21.15.5:0/2098484174 conn(0x7f15a00ce130 msgr2=0x7f15a00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.451+0000 7f15a8308640 1 -- 172.21.15.5:0/2098484174 shutdown_connections 2024-09-13T17:15:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.451+0000 7f15a8308640 1 -- 172.21.15.5:0/2098484174 wait complete. 2024-09-13T17:15:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 Processor -- start 2024-09-13T17:15:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 -- start start 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f158c003970 0x7f15a014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a014e7f0 0x7f15a00ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.452+0000 7f15a8308640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014dc00 con 0x7f15a0155050 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a8308640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a01555f0 con 0x7f15a014e7f0 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a8308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0156fd0 con 0x7f158c003970 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41846/0 (socket says 172.21.15.5:41846) 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 -- 172.21.15.5:0/225034014 learned_addr learned my addr 172.21.15.5:0/225034014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a60a4640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f158c003970 0x7f15a014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a68a5640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a014e7f0 0x7f15a00ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 -- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f158c003970 msgr2=0x7f15a014d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f158c003970 0x7f15a014d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 -- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a014e7f0 msgr2=0x7f15a00ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a014e7f0 0x7f15a00ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 -- 172.21.15.5:0/225034014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a01572b0 con 0x7f15a0155050 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a58a3640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1590011960 tx=0x7f1590011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000faf0 con 0x7f15a0155050 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000fc50 con 0x7f15a0155050 2024-09-13T17:15:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590014540 con 0x7f15a0155050 2024-09-13T17:15:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a0157590 con 0x7f15a0155050 2024-09-13T17:15:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.453+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a0156c80 con 0x7f15a0155050 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.454+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00ceb10 con 0x7f15a0155050 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.455+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15900146a0 con 0x7f15a0155050 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.455+0000 7f1596ffd640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 0x7f158406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.455+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f159008b950 con 0x7f15a0155050 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.456+0000 7f15a60a4640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 0x7f158406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.456+0000 7f15a60a4640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 0x7f158406d0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f159c001eb0 tx=0x7f159c009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.460+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f15900569b0 con 0x7f15a0155050 2024-09-13T17:15:02.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:02.665+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15a0156e10 con 0x7f15a0155050 2024-09-13T17:15:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.331+0000 7f1596ffd640 1 -- 172.21.15.5:0/225034014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15900210a0 con 0x7f15a0155050 2024-09-13T17:15:03.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 msgr2=0x7f158406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 0x7f158406d0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f159c001eb0 tx=0x7f159c009030 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 msgr2=0x7f15a01ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1590011960 tx=0x7f1590011e20 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 shutdown_connections 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a014e7f0 0x7f15a00ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f158406ac00 0x7f158406d0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a0155050 0x7f15a01ef600 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 --2- 172.21.15.5:0/225034014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f158c003970 0x7f15a014d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 >> 172.21.15.5:0/225034014 conn(0x7f15a00ce130 msgr2=0x7f15a0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 shutdown_connections 2024-09-13T17:15:03.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.334+0000 7f15a8308640 1 -- 172.21.15.5:0/225034014 wait complete. 2024-09-13T17:15:03.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:15:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.503+0000 7f860979c640 1 Processor -- start 2024-09-13T17:15:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.503+0000 7f860979c640 1 -- start start 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f860979c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f860415d7e0 0x7f860406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f860979c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f86040b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f860979c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860415cd90 con 0x7f8604150280 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f860979c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8604150660 con 0x7f860415d7e0 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f860979c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860415dc70 con 0x7f860406df80 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f8602ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8604150280 0x7f86041597a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35936/0 (socket says 172.21.15.5:35936) 2024-09-13T17:15:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f8602ffd640 1 -- 172.21.15.5:0/3245909233 learned_addr learned my addr 172.21.15.5:0/3245909233 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f86037fe640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f86040b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f86027fc640 1 --2- 172.21.15.5:0/3245909233 >> v2:172.21.15.179:3300/0 conn(0x7f860415d7e0 0x7f860406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670795544 0 0) 0x7f860415cd90 con 0x7f8604150280 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.504+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f0003520 con 0x7f8604150280 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3431545046 0 0) 0x7f85f0003520 con 0x7f8604150280 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 msgr2=0x7f86040b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f86040b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 >> v2:172.21.15.179:3300/0 conn(0x7f860415d7e0 msgr2=0x7f860406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 --2- 172.21.15.5:0/3245909233 >> v2:172.21.15.179:3300/0 conn(0x7f860415d7e0 0x7f860406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860406e390 con 0x7f8604150280 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f85f40019f0 con 0x7f8604150280 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 >> v1:172.21.15.5:6789/0 conn(0x7f8604150280 legacy=0x7f86041597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f85f0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f85f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f0004d00 0x7f85f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604150660 con 0x7f85f0003970 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415dc70 con 0x7f85f0004d00 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f000b9b0 con 0x7f860406df80 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f85f0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f86027fc640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f85f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f86037fe640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f0004d00 0x7f85f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 -- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 msgr2=0x7f85f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f860406df80 0x7f85f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 -- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f0004d00 msgr2=0x7f85f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f0004d00 0x7f85f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.505+0000 7f8602ffd640 1 -- 172.21.15.5:0/3245909233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0003520 con 0x7f85f0003970 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.506+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f85f0003db0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f85f400a830 tx=0x7f85f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936551be74207f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.506+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f402ba50 con 0x7f85f0003970 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.506+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f402bbb0 con 0x7f85f0003970 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.506+0000 7f8601ffb640 1 -- 172.21.15.5:0/3245909233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4034470 con 0x7f85f0003970 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 -- 172.21.15.5:0/3245909233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 msgr2=0x7f85f0003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 --2- 172.21.15.5:0/3245909233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f85f0003db0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f85f400a830 tx=0x7f85f00057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f86037fe640 1 -- 172.21.15.5:0/3245909233 reap_dead start 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 -- 172.21.15.5:0/3245909233 shutdown_connections 2024-09-13T17:15:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 -- 172.21.15.5:0/3245909233 >> 172.21.15.5:0/3245909233 conn(0x7f86040ce0f0 msgr2=0x7f86040ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 -- 172.21.15.5:0/3245909233 shutdown_connections 2024-09-13T17:15:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.507+0000 7f860979c640 1 -- 172.21.15.5:0/3245909233 wait complete. 2024-09-13T17:15:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.508+0000 7f860979c640 1 Processor -- start 2024-09-13T17:15:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.508+0000 7f860979c640 1 -- start start 2024-09-13T17:15:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86040cb360 0x7f86040cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8604149c40 0x7f860414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cbd20 con 0x7f85f0003970 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860414aaf0 con 0x7f8604149c40 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f860979c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860414a5e0 con 0x7f86040cb360 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35466/0 (socket says 172.21.15.5:35466) 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 -- 172.21.15.5:0/3328561465 learned_addr learned my addr 172.21.15.5:0/3328561465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f86027fc640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86040cb360 0x7f86040cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f86037fe640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8604149c40 0x7f860414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 -- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86040cb360 msgr2=0x7f86040cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86040cb360 0x7f86040cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 -- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8604149c40 msgr2=0x7f860414a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8604149c40 0x7f860414a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.509+0000 7f8602ffd640 1 -- 172.21.15.5:0/3328561465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860414c2d0 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f8602ffd640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f85f402b430 tx=0x7f8604153d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4038070 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4034670 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860414c5b0 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f403b040 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.510+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860414cb70 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.511+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86040672a0 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.511+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85f4031070 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.512+0000 7f85fb7fe640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 0x7f85e406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.512+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f85f40a98b0 con 0x7f85f0003970 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.512+0000 7f86027fc640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 0x7f85e406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.512+0000 7f86027fc640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 0x7f85e406d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86040b28e0 tx=0x7f85ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.516+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85f4074990 con 0x7f85f0003970 2024-09-13T17:15:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:03.689+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f860406c5e0 con 0x7f85f0003970 2024-09-13T17:15:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.628+0000 7f85fb7fe640 1 -- 172.21.15.5:0/3328561465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85f4045070 con 0x7f85f0003970 2024-09-13T17:15:04.630 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.631+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 msgr2=0x7f85e406d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.631+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 0x7f85e406d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86040b28e0 tx=0x7f85ec008040 comp rx=0 tx=0).stop 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.631+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 msgr2=0x7f86040af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.631+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f85f402b430 tx=0x7f8604153d60 comp rx=0 tx=0).stop 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 shutdown_connections 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8604149c40 0x7f860414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86040cb360 0x7f86040cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85e406abf0 0x7f85e406d0b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 --2- 172.21.15.5:0/3328561465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85f0003970 0x7f86040af070 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 >> 172.21.15.5:0/3328561465 conn(0x7f86040ce0f0 msgr2=0x7f860406c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:04.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 shutdown_connections 2024-09-13T17:15:04.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.632+0000 7f860979c640 1 -- 172.21.15.5:0/3328561465 wait complete. 2024-09-13T17:15:04.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:15:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.758+0000 7f900346b640 1 Processor -- start 2024-09-13T17:15:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.758+0000 7f900346b640 1 -- start start 2024-09-13T17:15:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f900346b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ffc0b7e90 0x7f8ffc1671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f900346b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0d3300 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f900346b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0b5de0 con 0x7f8ffc0cdbf0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f900346b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0b60c0 con 0x7f8ffc0b7e90 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f9001207640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ffc0ccfe0 0x7f8ffc0cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35950/0 (socket says 172.21.15.5:35950) 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.759+0000 7f9001207640 1 -- 172.21.15.5:0/410422489 learned_addr learned my addr 172.21.15.5:0/410422489 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913782397 0 0) 0x7f8ffc0d3300 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe8003520 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9001a08640 1 --2- 172.21.15.5:0/410422489 >> v2:172.21.15.179:3300/0 conn(0x7f8ffc0b7e90 0x7f8ffc1671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455605202 0 0) 0x7f8fe8003520 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 >> v2:172.21.15.179:3300/0 conn(0x7f8ffc0b7e90 msgr2=0x7f8ffc1671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 --2- 172.21.15.5:0/410422489 >> v2:172.21.15.179:3300/0 conn(0x7f8ffc0b7e90 0x7f8ffc1671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 >> v1:172.21.15.179:6789/0 conn(0x7f8ffc0cdbf0 legacy=0x7f8ffc0d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0b63a0 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9001a08640 1 --2- 172.21.15.5:0/410422489 >> v2:172.21.15.179:3300/0 conn(0x7f8ffc0b7e90 0x7f8ffc1671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8ff8001670 con 0x7f8ffc0ccfe0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 >> v1:172.21.15.5:6789/0 conn(0x7f8ffc0ccfe0 legacy=0x7f8ffc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fe80052a0 0x7f8fe800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0b60c0 con 0x7f8fe80047c0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800c170 con 0x7f8fe8003970 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800c330 con 0x7f8fe80052a0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9000a06640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9001207640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9001a08640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fe80052a0 0x7f8fe800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9000a06640 1 -- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fe80052a0 msgr2=0x7f8fe800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9000a06640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fe80052a0 0x7f8fe800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.760+0000 7f9000a06640 1 -- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe8003970 msgr2=0x7f8fe8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f9000a06640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe8003970 0x7f8fe8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f9000a06640 1 -- 172.21.15.5:0/410422489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8003520 con 0x7f8fe80047c0 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f9001a08640 1 -- 172.21.15.5:0/410422489 reap_dead start 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f9000a06640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001720 tx=0x7f8fe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee78f7a155b2ffef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0052d0 con 0x7f8fe80047c0 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec005430 con 0x7f8fe80047c0 2024-09-13T17:15:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.761+0000 7f8ff3fff640 1 -- 172.21.15.5:0/410422489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec02ab90 con 0x7f8fe80047c0 2024-09-13T17:15:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 -- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 msgr2=0x7f8fe8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001720 tx=0x7f8fe80057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 -- 172.21.15.5:0/410422489 shutdown_connections 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 --2- 172.21.15.5:0/410422489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8fe8004c40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 -- 172.21.15.5:0/410422489 >> 172.21.15.5:0/410422489 conn(0x7f8ffc089f90 msgr2=0x7f8ffc0d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 -- 172.21.15.5:0/410422489 shutdown_connections 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.762+0000 7f900346b640 1 -- 172.21.15.5:0/410422489 wait complete. 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.763+0000 7f900346b640 1 Processor -- start 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.763+0000 7f900346b640 1 -- start start 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 0x7f8ffc1f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 0x7f8ffc15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc15d820 con 0x7f8fe80047c0 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1f6120 con 0x7f8ffc15dc40 2024-09-13T17:15:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f900346b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c8db0 con 0x7f8ffc1f5c70 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f9001207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f9001207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35476/0 (socket says 172.21.15.5:35476) 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f9001207640 1 -- 172.21.15.5:0/3673018075 learned_addr learned my addr 172.21.15.5:0/3673018075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f9000a06640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 0x7f8ffc1f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.764+0000 7f9001a08640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 0x7f8ffc15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 -- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 msgr2=0x7f8ffc15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 0x7f8ffc15ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 -- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 msgr2=0x7f8ffc1f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 0x7f8ffc1f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 -- 172.21.15.5:0/3673018075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc15cba0 con 0x7f8fe80047c0 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9000a06640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 0x7f8ffc1f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001a08640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 0x7f8ffc15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f9001207640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80011e0 tx=0x7f8ff8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8001650 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff800f940 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc15ce80 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800fcd0 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.765+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc15d440 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.766+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc15d960 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.767+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ff801d460 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.767+0000 7f8ff1ffb640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.767+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f8ff8089370 con 0x7f8fe80047c0 2024-09-13T17:15:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.768+0000 7f9000a06640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.768+0000 7f9000a06640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 0x7f8fe006d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8fec032000 tx=0x7f8fec02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.771+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8ffc15d960 con 0x7f8fe80047c0 2024-09-13T17:15:04.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:04.939+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ffc15d960 con 0x7f8fe80047c0 2024-09-13T17:15:05.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.633+0000 7f8ff1ffb640 1 -- 172.21.15.5:0/3673018075 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ffc15d960 con 0x7f8fe80047c0 2024-09-13T17:15:05.636 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 msgr2=0x7f8fe006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 0x7f8fe006d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8fec032000 tx=0x7f8fec02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 msgr2=0x7f8ffc0c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80011e0 tx=0x7f8ff8007720 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 shutdown_connections 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ffc1f5c70 0x7f8ffc15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ffc15dc40 0x7f8ffc1f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8fe006ac30 0x7f8fe006d0f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 --2- 172.21.15.5:0/3673018075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fe80047c0 0x7f8ffc0c8870 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 >> 172.21.15.5:0/3673018075 conn(0x7f8ffc089f90 msgr2=0x7f8ffc0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 shutdown_connections 2024-09-13T17:15:05.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.638+0000 7f900346b640 1 -- 172.21.15.5:0/3673018075 wait complete. 2024-09-13T17:15:05.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:15:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.768+0000 7f4923280640 1 Processor -- start 2024-09-13T17:15:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.768+0000 7f4923280640 1 -- start start 2024-09-13T17:15:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c157e20 0x7f491c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491c06c090 0x7f491c06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f491c0ad010 0x7f491c0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c15b900 con 0x7f491c06c090 2024-09-13T17:15:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c06db00 con 0x7f491c0ad010 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f4923280640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06c520 con 0x7f491c157e20 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491c06c090 0x7f491c06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491c06c090 0x7f491c06d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35482/0 (socket says 172.21.15.5:35482) 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 -- 172.21.15.5:0/2971819085 learned_addr learned my addr 172.21.15.5:0/2971819085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 -- 172.21.15.5:0/2971819085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c157e20 msgr2=0x7f491c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 --2- 172.21.15.5:0/2971819085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c157e20 0x7f491c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 -- 172.21.15.5:0/2971819085 >> v2:172.21.15.179:3300/0 conn(0x7f491c0ad010 msgr2=0x7f491c0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 --2- 172.21.15.5:0/2971819085 >> v2:172.21.15.179:3300/0 conn(0x7f491c0ad010 0x7f491c0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.769+0000 7f492081b640 1 -- 172.21.15.5:0/2971819085 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c06c800 con 0x7f491c06c090 2024-09-13T17:15:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.770+0000 7f492081b640 1 --2- 172.21.15.5:0/2971819085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c06c090 0x7f491c06d5c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f491c06e310 tx=0x7f490c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19848904329aea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.770+0000 7f4913fff640 1 -- 172.21.15.5:0/2971819085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c032440 con 0x7f491c06c090 2024-09-13T17:15:05.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.770+0000 7f4913fff640 1 -- 172.21.15.5:0/2971819085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c0325a0 con 0x7f491c06c090 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.770+0000 7f4913fff640 1 -- 172.21.15.5:0/2971819085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c032930 con 0x7f491c06c090 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 -- 172.21.15.5:0/2971819085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c06c090 msgr2=0x7f491c06d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 --2- 172.21.15.5:0/2971819085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c06c090 0x7f491c06d5c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f491c06e310 tx=0x7f490c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 -- 172.21.15.5:0/2971819085 shutdown_connections 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 --2- 172.21.15.5:0/2971819085 >> v2:172.21.15.179:3300/0 conn(0x7f491c0ad010 0x7f491c0ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 --2- 172.21.15.5:0/2971819085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c06c090 0x7f491c06d5c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 --2- 172.21.15.5:0/2971819085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c157e20 0x7f491c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 -- 172.21.15.5:0/2971819085 >> 172.21.15.5:0/2971819085 conn(0x7f491c0ce130 msgr2=0x7f491c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 -- 172.21.15.5:0/2971819085 shutdown_connections 2024-09-13T17:15:05.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.771+0000 7f4923280640 1 -- 172.21.15.5:0/2971819085 wait complete. 2024-09-13T17:15:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.772+0000 7f4923280640 1 Processor -- start 2024-09-13T17:15:05.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.772+0000 7f4923280640 1 -- start start 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f491c157e20 0x7f491c0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c0ae9e0 0x7f491c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c153210 con 0x7f491c0ad010 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0af3d0 con 0x7f491c157e20 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f4923280640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c097ad0 con 0x7f491c0ae9e0 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35484/0 (socket says 172.21.15.5:35484) 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 -- 172.21.15.5:0/1440361563 learned_addr learned my addr 172.21.15.5:0/1440361563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492181d640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c0ae9e0 0x7f491c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492081b640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f491c157e20 0x7f491c0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 -- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c0ae9e0 msgr2=0x7f491c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c0ae9e0 0x7f491c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 -- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f491c157e20 msgr2=0x7f491c0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f491c157e20 0x7f491c0ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 -- 172.21.15.5:0/1440361563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0094d0 con 0x7f491c0ad010 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.773+0000 7f492101c640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f491800b410 tx=0x7f491800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.774+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918011830 con 0x7f491c0ad010 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.774+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49180119b0 con 0x7f491c0ad010 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.774+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918011d60 con 0x7f491c0ad010 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.774+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c14d6c0 con 0x7f491c0ad010 2024-09-13T17:15:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.774+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c14dc80 con 0x7f491c0ad010 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.775+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0672a0 con 0x7f491c0ad010 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.775+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f491801a400 con 0x7f491c0ad010 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.775+0000 7f4911ffb640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 0x7f490006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.775+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4918089130 con 0x7f491c0ad010 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.776+0000 7f492081b640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 0x7f490006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.776+0000 7f492081b640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 0x7f490006d0f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f490c034000 tx=0x7f490c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.780+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4918054580 con 0x7f491c0ad010 2024-09-13T17:15:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.952+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f491c158200 con 0x7f491c0ad010 2024-09-13T17:15:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.955+0000 7f4911ffb640 1 -- 172.21.15.5:0/1440361563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4918057ba0 con 0x7f491c0ad010 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 msgr2=0x7f490006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 0x7f490006d0f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f490c034000 tx=0x7f490c02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 msgr2=0x7f491c097590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f491800b410 tx=0x7f491800b8d0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 shutdown_connections 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f491c0ae9e0 0x7f491c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f491c157e20 0x7f491c0ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f490006ac30 0x7f490006d0f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 --2- 172.21.15.5:0/1440361563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491c0ad010 0x7f491c097590 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 >> 172.21.15.5:0/1440361563 conn(0x7f491c0ce130 msgr2=0x7f491c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 shutdown_connections 2024-09-13T17:15:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:05.957+0000 7f4923280640 1 -- 172.21.15.5:0/1440361563 wait complete. 2024-09-13T17:15:05.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-09-13T17:15:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.071+0000 7fcc7955a640 1 Processor -- start 2024-09-13T17:15:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.071+0000 7fcc7955a640 1 -- start start 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc7955a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc7415c6e0 0x7fcc740cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc7955a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc740cf000 0x7fcc740cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc7955a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc740cf980 con 0x7fcc741602c0 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc7955a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc740d0630 con 0x7fcc740cf000 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc7955a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc740d0910 con 0x7fcc7415c6e0 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.072+0000 7fcc727fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc740cf000 0x7fcc740cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc740cf000 0x7fcc740cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35488/0 (socket says 172.21.15.5:35488) 2024-09-13T17:15:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 -- 172.21.15.5:0/2578913097 learned_addr learned my addr 172.21.15.5:0/2578913097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc72ffd640 1 --2- 172.21.15.5:0/2578913097 >> v2:172.21.15.179:3300/0 conn(0x7fcc7415c6e0 0x7fcc740cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 -- 172.21.15.5:0/2578913097 >> v2:172.21.15.179:3300/0 conn(0x7fcc7415c6e0 msgr2=0x7fcc740cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 --2- 172.21.15.5:0/2578913097 >> v2:172.21.15.179:3300/0 conn(0x7fcc7415c6e0 0x7fcc740cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 -- 172.21.15.5:0/2578913097 >> v1:172.21.15.179:6789/0 conn(0x7fcc741602c0 legacy=0x7fcc74160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.073+0000 7fcc727fc640 1 -- 172.21.15.5:0/2578913097 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc740d0bf0 con 0x7fcc740cf000 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc727fc640 1 --2- 172.21.15.5:0/2578913097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc740cf000 0x7fcc740cf440 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b51b0 tx=0x7fcc5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a078dd6c3faf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc71ffb640 1 -- 172.21.15.5:0/2578913097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c032440 con 0x7fcc740cf000 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc71ffb640 1 -- 172.21.15.5:0/2578913097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0325a0 con 0x7fcc740cf000 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc71ffb640 1 -- 172.21.15.5:0/2578913097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c032930 con 0x7fcc740cf000 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 -- 172.21.15.5:0/2578913097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc740cf000 msgr2=0x7fcc740cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 --2- 172.21.15.5:0/2578913097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc740cf000 0x7fcc740cf440 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b51b0 tx=0x7fcc5c02a230 comp rx=0 tx=0).stop 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 -- 172.21.15.5:0/2578913097 shutdown_connections 2024-09-13T17:15:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 --2- 172.21.15.5:0/2578913097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc740cf000 0x7fcc740cf440 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 --2- 172.21.15.5:0/2578913097 >> v2:172.21.15.179:3300/0 conn(0x7fcc7415c6e0 0x7fcc740cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 -- 172.21.15.5:0/2578913097 >> 172.21.15.5:0/2578913097 conn(0x7fcc74089f90 msgr2=0x7fcc740d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 -- 172.21.15.5:0/2578913097 shutdown_connections 2024-09-13T17:15:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.074+0000 7fcc7955a640 1 -- 172.21.15.5:0/2578913097 wait complete. 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 Processor -- start 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 -- start start 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740cf000 0x7fcc740c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc7415c6e0 0x7fcc740c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc74153d80 con 0x7fcc741602c0 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740c9db0 con 0x7fcc740cf000 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.076+0000 7fcc7955a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740c6410 con 0x7fcc7415c6e0 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35504/0 (socket says 172.21.15.5:35504) 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 -- 172.21.15.5:0/654681891 learned_addr learned my addr 172.21.15.5:0/654681891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc72ffd640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740cf000 0x7fcc740c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc727fc640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc7415c6e0 0x7fcc740c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 -- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc7415c6e0 msgr2=0x7fcc740c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc7415c6e0 0x7fcc740c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 -- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740cf000 msgr2=0x7fcc740c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740cf000 0x7fcc740c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 -- 172.21.15.5:0/654681891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0094d0 con 0x7fcc741602c0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc737fe640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b410 tx=0x7fcc6c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004020 con 0x7fcc741602c0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c004180 con 0x7fcc741602c0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc740c9760 con 0x7fcc741602c0 2024-09-13T17:15:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c011630 con 0x7fcc741602c0 2024-09-13T17:15:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.077+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc740c66f0 con 0x7fcc741602c0 2024-09-13T17:15:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.078+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc740672e0 con 0x7fcc741602c0 2024-09-13T17:15:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.079+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc6c011790 con 0x7fcc741602c0 2024-09-13T17:15:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.079+0000 7fcc6b7fe640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 0x7fcc5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.079+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcc6c088ea0 con 0x7fcc741602c0 2024-09-13T17:15:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.079+0000 7fcc72ffd640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 0x7fcc5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.080+0000 7fcc72ffd640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 0x7fcc5406d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcc64008ef0 tx=0x7fcc64008440 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.083+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc6c054240 con 0x7fcc741602c0 2024-09-13T17:15:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.256+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7fcc740c9f20 con 0x7fcc741602c0 2024-09-13T17:15:06.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.259+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/654681891 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v13) v1 ==== 106+0+0 (secure 0 0 0) 0x7fcc6c057860 con 0x7fcc741602c0 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 msgr2=0x7fcc5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 0x7fcc5406d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcc64008ef0 tx=0x7fcc64008440 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 msgr2=0x7fcc74158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b410 tx=0x7fcc6c00b8d0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 shutdown_connections 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc5406ac00 0x7fcc5406d0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc741602c0 0x7fcc74158ca0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc7415c6e0 0x7fcc740c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 --2- 172.21.15.5:0/654681891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740cf000 0x7fcc740c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 >> 172.21.15.5:0/654681891 conn(0x7fcc74089f90 msgr2=0x7fcc741606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 shutdown_connections 2024-09-13T17:15:06.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.261+0000 7fcc7955a640 1 -- 172.21.15.5:0/654681891 wait complete. 2024-09-13T17:15:06.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-13T17:15:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.373+0000 7f96ebb5e640 1 Processor -- start 2024-09-13T17:15:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 -- start start 2024-09-13T17:15:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96e40b4cf0 0x7f96e40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e40d1e80 con 0x7f96e415c810 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e40d1750 con 0x7f96e40b4cf0 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96ebb5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40d0bd0 con 0x7f96e40d06d0 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.374+0000 7f96e98fa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96e415c810 0x7f96e40b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35958/0 (socket says 172.21.15.5:35958) 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e90f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96e40b4cf0 0x7f96e40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e98fa640 1 -- 172.21.15.5:0/495336365 learned_addr learned my addr 172.21.15.5:0/495336365 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96ea0fb640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e90f9640 1 -- 172.21.15.5:0/495336365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 msgr2=0x7f96e40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e90f9640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e90f9640 1 -- 172.21.15.5:0/495336365 >> v1:172.21.15.5:6789/0 conn(0x7f96e415c810 legacy=0x7f96e40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e90f9640 1 -- 172.21.15.5:0/495336365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40d0eb0 con 0x7f96e40b4cf0 2024-09-13T17:15:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.375+0000 7f96e88f8640 1 -- 172.21.15.5:0/495336365 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518596302 0 0) 0x7f96e40d1e80 con 0x7f96e415c810 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96e90f9640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e40cd780 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34e59694c6a4ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96e88f8640 1 -- 172.21.15.5:0/495336365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8032440 con 0x7f96e40b4cf0 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96e88f8640 1 -- 172.21.15.5:0/495336365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80325a0 con 0x7f96e40b4cf0 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96e88f8640 1 -- 172.21.15.5:0/495336365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8032930 con 0x7f96e40b4cf0 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 -- 172.21.15.5:0/495336365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 msgr2=0x7f96e40cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e40cd780 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d802a180 comp rx=0 tx=0).stop 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 -- 172.21.15.5:0/495336365 shutdown_connections 2024-09-13T17:15:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/495336365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e40cd780 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.376+0000 7f96ebb5e640 1 -- 172.21.15.5:0/495336365 >> 172.21.15.5:0/495336365 conn(0x7f96e40717a0 msgr2=0x7f96e4071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.377+0000 7f96ebb5e640 1 -- 172.21.15.5:0/495336365 shutdown_connections 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.377+0000 7f96ebb5e640 1 -- 172.21.15.5:0/495336365 wait complete. 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.378+0000 7f96ebb5e640 1 Processor -- start 2024-09-13T17:15:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.378+0000 7f96ebb5e640 1 -- start start 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.378+0000 7f96ebb5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96e415c810 0x7f96e40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40c6230 con 0x7f96e40b4cf0 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e41f2f50 con 0x7f96e415c810 2024-09-13T17:15:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40c7520 con 0x7f96e40d06d0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35512/0 (socket says 172.21.15.5:35512) 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 -- 172.21.15.5:0/951686445 learned_addr learned my addr 172.21.15.5:0/951686445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e90f9640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ea0fb640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96e415c810 0x7f96e40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 -- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 msgr2=0x7f96e40c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 -- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96e415c810 msgr2=0x7f96e40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96e415c810 0x7f96e40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 -- 172.21.15.5:0/951686445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009400 con 0x7f96e40b4cf0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e98fa640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c7f0 tx=0x7f96d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400a640 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d400a7c0 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e40c6480 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400ab70 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.379+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e40c6a40 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.380+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e40b7560 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.381+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f96d400acd0 con 0x7f96e40b4cf0 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.381+0000 7f96e27fc640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 0x7f96d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.381+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f96d4088950 con 0x7f96e40b4cf0 2024-09-13T17:15:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.381+0000 7f96e90f9640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 0x7f96d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.382+0000 7f96e90f9640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 0x7f96d006d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96d8034000 tx=0x7f96d802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.385+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f96d4053d80 con 0x7f96e40b4cf0 2024-09-13T17:15:06.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.624+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f96e40672a0 con 0x7f96e40b4cf0 2024-09-13T17:15:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.634+0000 7f96e27fc640 1 -- 172.21.15.5:0/951686445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v126) v1 ==== 144+0+0 (secure 0 0 0) 0x7f96d4018020 con 0x7f96e40b4cf0 2024-09-13T17:15:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 msgr2=0x7f96d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 0x7f96d006d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96d8034000 tx=0x7f96d802e000 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 msgr2=0x7f96e41f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c7f0 tx=0x7f96d400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 shutdown_connections 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96e415c810 0x7f96e40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96e40d06d0 0x7f96e40c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f96d006ac00 0x7f96d006d0c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 --2- 172.21.15.5:0/951686445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96e40b4cf0 0x7f96e41f2a10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 >> 172.21.15.5:0/951686445 conn(0x7f96e40717a0 msgr2=0x7f96e40cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 shutdown_connections 2024-09-13T17:15:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.636+0000 7f96ebb5e640 1 -- 172.21.15.5:0/951686445 wait complete. 2024-09-13T17:15:06.648 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-09-13T17:15:06.649 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-09-13T17:15:06.649 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:15:06.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.748+0000 7f1b9e3b5640 1 Processor -- start 2024-09-13T17:15:06.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.748+0000 7f1b9e3b5640 1 -- start start 2024-09-13T17:15:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b9e3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b9815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b9e3b5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980b35f0 con 0x7f1b9806eb80 2024-09-13T17:15:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b9e3b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b98156f50 con 0x7f1b9806ef60 2024-09-13T17:15:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b9e3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98160020 con 0x7f1b980b1ac0 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b97fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b9806eb80 0x7f1b980b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35964/0 (socket says 172.21.15.5:35964) 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.749+0000 7f1b97fff640 1 -- 172.21.15.5:0/372697833 learned_addr learned my addr 172.21.15.5:0/372697833 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852743593 0 0) 0x7f1b980b35f0 con 0x7f1b9806eb80 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b9815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b84003520 con 0x7f1b9806eb80 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3565412540 0 0) 0x7f1b84003520 con 0x7f1b9806eb80 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 msgr2=0x7f1b9815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b9815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 >> v1:172.21.15.179:6789/0 conn(0x7f1b9806ef60 legacy=0x7f1b9806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980b1fa0 con 0x7f1b9806eb80 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f1b88001670 con 0x7f1b9806eb80 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 >> v1:172.21.15.5:6789/0 conn(0x7f1b9806eb80 legacy=0x7f1b980b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b840039a0 0x7f1b84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98160020 con 0x7f1b840047c0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8400ba60 con 0x7f1b840039a0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8400bc20 con 0x7f1b980b1ac0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b97fff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b840039a0 0x7f1b84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.750+0000 7f1b9c952640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 -- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 msgr2=0x7f1b84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b980b1ac0 0x7f1b84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 -- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b840039a0 msgr2=0x7f1b84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b840039a0 0x7f1b84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 -- 172.21.15.5:0/372697833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84003520 con 0x7f1b840047c0 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b84004c40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1b980b4130 tx=0x7f1b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652f3d246bf30a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.751+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80031400 con 0x7f1b840047c0 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8002d050 con 0x7f1b840047c0 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b977fe640 1 -- 172.21.15.5:0/372697833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80031780 con 0x7f1b840047c0 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/372697833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 msgr2=0x7f1b84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/372697833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b84004c40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1b980b4130 tx=0x7f1b840057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9c952640 1 -- 172.21.15.5:0/372697833 reap_dead start 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/372697833 shutdown_connections 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/372697833 >> 172.21.15.5:0/372697833 conn(0x7f1b98070af0 msgr2=0x7f1b98070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/372697833 shutdown_connections 2024-09-13T17:15:06.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.752+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/372697833 wait complete. 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.753+0000 7f1b9e3b5640 1 Processor -- start 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.753+0000 7f1b9e3b5640 1 -- start start 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9814c200 0x7f1b981f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b981f5670 0x7f1b981f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b981510f0 con 0x7f1b840047c0 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9814eb50 con 0x7f1b9814c200 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9e3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98150750 con 0x7f1b981f5670 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35522/0 (socket says 172.21.15.5:35522) 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b97fff640 1 -- 172.21.15.5:0/3450751064 learned_addr learned my addr 172.21.15.5:0/3450751064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b9c952640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b981f5670 0x7f1b981f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.754+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9814c200 0x7f1b981f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 -- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b981f5670 msgr2=0x7f1b981f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b981f5670 0x7f1b981f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 -- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9814c200 msgr2=0x7f1b981f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9814c200 0x7f1b981f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 -- 172.21.15.5:0/3450751064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98150a30 con 0x7f1b840047c0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b97fff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1b880072c0 tx=0x7f1b88007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800f8e0 con 0x7f1b840047c0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8800fa40 con 0x7f1b840047c0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b98150d10 con 0x7f1b840047c0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800fdf0 con 0x7f1b840047c0 2024-09-13T17:15:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.755+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98149dc0 con 0x7f1b840047c0 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.756+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b980672e0 con 0x7f1b840047c0 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.756+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b8801d460 con 0x7f1b840047c0 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.757+0000 7f1b957fa640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 0x7f1b7806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.757+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1b88088f80 con 0x7f1b840047c0 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.757+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 0x7f1b7806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.758+0000 7f1b8ffff640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 0x7f1b7806d0f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1b80033000 tx=0x7f1b80008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.761+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b880bc9c0 con 0x7f1b840047c0 2024-09-13T17:15:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.931+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b98149dc0 con 0x7f1b840047c0 2024-09-13T17:15:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.932+0000 7f1b957fa640 1 -- 172.21.15.5:0/3450751064 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13153 (secure 0 0 0) 0x7f1b98149dc0 con 0x7f1b840047c0 2024-09-13T17:15:06.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:06.934 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":45,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:05.628338+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1510530790":"2024-09-14T17:15:02.323790+0000","172.21.15.5:6832/1510530790":"2024-09-14T17:15:02.323790+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:06.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 msgr2=0x7f1b7806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 0x7f1b7806d0f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1b80033000 tx=0x7f1b80008030 comp rx=0 tx=0).stop 2024-09-13T17:15:06.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 msgr2=0x7f1b9814fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:06.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1b880072c0 tx=0x7f1b88007780 comp rx=0 tx=0).stop 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 shutdown_connections 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b981f5670 0x7f1b981f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b9814c200 0x7f1b981f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1b7806ac30 0x7f1b7806d0f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 --2- 172.21.15.5:0/3450751064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b840047c0 0x7f1b9814fe30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 >> 172.21.15.5:0/3450751064 conn(0x7f1b98070af0 msgr2=0x7f1b980aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 shutdown_connections 2024-09-13T17:15:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:06.934+0000 7f1b9e3b5640 1 -- 172.21.15.5:0/3450751064 wait complete. 2024-09-13T17:15:06.947 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:06.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 Processor -- start 2024-09-13T17:15:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 -- start start 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d940cf000 0x7f7d940cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940cf980 con 0x7f7d941645e0 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940ce570 con 0x7f7d9415c6e0 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.050+0000 7f7d9a553640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d940d0630 con 0x7f7d940cf000 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d940cf000 0x7f7d940cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d940cf000 0x7f7d940cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35526/0 (socket says 172.21.15.5:35526) 2024-09-13T17:15:07.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d98af0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7d941645e0 0x7f7d941669d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35968/0 (socket says 172.21.15.5:35968) 2024-09-13T17:15:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 -- 172.21.15.5:0/1423388110 learned_addr learned my addr 172.21.15.5:0/1423388110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 -- 172.21.15.5:0/1423388110 >> v1:172.21.15.179:6789/0 conn(0x7f7d9415c6e0 legacy=0x7f7d940cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 -- 172.21.15.5:0/1423388110 >> v1:172.21.15.5:6789/0 conn(0x7f7d941645e0 legacy=0x7f7d941669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d937fe640 1 -- 172.21.15.5:0/1423388110 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940d0910 con 0x7f7d940cf000 2024-09-13T17:15:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.051+0000 7f7d92ffd640 1 -- 172.21.15.5:0/1423388110 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604865499 0 0) 0x7f7d940cf980 con 0x7f7d941645e0 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d937fe640 1 --2- 172.21.15.5:0/1423388110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d940cf000 0x7f7d940cf440 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009870 tx=0x7f7d8802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70629c3772734a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d92ffd640 1 -- 172.21.15.5:0/1423388110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88032640 con 0x7f7d940cf000 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d92ffd640 1 -- 172.21.15.5:0/1423388110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d880327a0 con 0x7f7d940cf000 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d92ffd640 1 -- 172.21.15.5:0/1423388110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88032b30 con 0x7f7d940cf000 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 -- 172.21.15.5:0/1423388110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d940cf000 msgr2=0x7f7d940cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 --2- 172.21.15.5:0/1423388110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d940cf000 0x7f7d940cf440 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009870 tx=0x7f7d8802a300 comp rx=0 tx=0).stop 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 -- 172.21.15.5:0/1423388110 shutdown_connections 2024-09-13T17:15:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 --2- 172.21.15.5:0/1423388110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d940cf000 0x7f7d940cf440 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 -- 172.21.15.5:0/1423388110 >> 172.21.15.5:0/1423388110 conn(0x7f7d94089f90 msgr2=0x7f7d940d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.052+0000 7f7d9a553640 1 -- 172.21.15.5:0/1423388110 shutdown_connections 2024-09-13T17:15:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.053+0000 7f7d9a553640 1 -- 172.21.15.5:0/1423388110 wait complete. 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.054+0000 7f7d9a553640 1 Processor -- start 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.054+0000 7f7d9a553640 1 -- start start 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.054+0000 7f7d9a553640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d940cf000 0x7f7d9415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d9415c6e0 0x7f7d9415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cbe70 con 0x7f7d941645e0 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9415f310 con 0x7f7d9415c6e0 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9415f5f0 con 0x7f7d940cf000 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35528/0 (socket says 172.21.15.5:35528) 2024-09-13T17:15:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 -- 172.21.15.5:0/329576160 learned_addr learned my addr 172.21.15.5:0/329576160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d937fe640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d9415c6e0 0x7f7d9415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d93fff640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d940cf000 0x7f7d9415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 -- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d940cf000 msgr2=0x7f7d9415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d940cf000 0x7f7d9415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 -- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d9415c6e0 msgr2=0x7f7d9415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d9415c6e0 0x7f7d9415ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 -- 172.21.15.5:0/329576160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880094d0 con 0x7f7d941645e0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d98af0640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00c780 tx=0x7f7d8c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00ce90 con 0x7f7d941645e0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00a640 con 0x7f7d941645e0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d941f2650 con 0x7f7d941645e0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00a9d0 con 0x7f7d941645e0 2024-09-13T17:15:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.055+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d941f2300 con 0x7f7d941645e0 2024-09-13T17:15:07.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.056+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d940672e0 con 0x7f7d941645e0 2024-09-13T17:15:07.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.057+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d8c00ab30 con 0x7f7d941645e0 2024-09-13T17:15:07.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.057+0000 7f7d90ff9640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 0x7f7d8006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.057+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7d8c0889f0 con 0x7f7d941645e0 2024-09-13T17:15:07.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.057+0000 7f7d93fff640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 0x7f7d8006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.058+0000 7f7d93fff640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 0x7f7d8006d0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000f60 tx=0x7f7d84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.061+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7d8c053d10 con 0x7f7d941645e0 2024-09-13T17:15:07.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.234+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d941f2b70 con 0x7f7d941645e0 2024-09-13T17:15:07.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.234+0000 7f7d90ff9640 1 -- 172.21.15.5:0/329576160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d941f2b70 con 0x7f7d941645e0 2024-09-13T17:15:07.236 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 msgr2=0x7f7d8006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 0x7f7d8006d0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d84000f60 tx=0x7f7d84009040 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 msgr2=0x7f7d940caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00c780 tx=0x7f7d8c00cc40 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 shutdown_connections 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d8006ac30 0x7f7d8006d0f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d941645e0 0x7f7d940caa30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d9415c6e0 0x7f7d9415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 --2- 172.21.15.5:0/329576160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d940cf000 0x7f7d9415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 >> 172.21.15.5:0/329576160 conn(0x7f7d94089f90 msgr2=0x7f7d9406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 shutdown_connections 2024-09-13T17:15:07.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.236+0000 7f7d9a553640 1 -- 172.21.15.5:0/329576160 wait complete. 2024-09-13T17:15:07.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-13T17:15:07.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.351+0000 7fdd5a108640 1 Processor -- start 2024-09-13T17:15:07.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.351+0000 7fdd5a108640 1 -- start start 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd5a108640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd5406eb80 0x7fdd540b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd5a108640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540b35f0 con 0x7fdd540b1ac0 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd5a108640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd54156f50 con 0x7fdd5406ef60 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd5a108640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5415d140 con 0x7fdd5406eb80 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd5406eb80 0x7fdd540b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd52ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd540b1ac0 0x7fdd5415ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35976/0 (socket says 172.21.15.5:35976) 2024-09-13T17:15:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd52ffd640 1 -- 172.21.15.5:0/136362515 learned_addr learned my addr 172.21.15.5:0/136362515 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd537fe640 1 -- 172.21.15.5:0/136362515 >> v1:172.21.15.179:6789/0 conn(0x7fdd5406ef60 legacy=0x7fdd5406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd537fe640 1 -- 172.21.15.5:0/136362515 >> v1:172.21.15.5:6789/0 conn(0x7fdd540b1ac0 legacy=0x7fdd5415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd537fe640 1 -- 172.21.15.5:0/136362515 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540b3f60 con 0x7fdd5406eb80 2024-09-13T17:15:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.352+0000 7fdd527fc640 1 -- 172.21.15.5:0/136362515 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486982395 0 0) 0x7fdd540b35f0 con 0x7fdd540b1ac0 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd537fe640 1 --2- 172.21.15.5:0/136362515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540b3a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ee6526b2ae9ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd527fc640 1 -- 172.21.15.5:0/136362515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44032440 con 0x7fdd5406eb80 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd527fc640 1 -- 172.21.15.5:0/136362515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd440325a0 con 0x7fdd5406eb80 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd527fc640 1 -- 172.21.15.5:0/136362515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44032930 con 0x7fdd5406eb80 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd5a108640 1 -- 172.21.15.5:0/136362515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 msgr2=0x7fdd540b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.353+0000 7fdd5a108640 1 --2- 172.21.15.5:0/136362515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540b3a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402a230 comp rx=0 tx=0).stop 2024-09-13T17:15:07.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.354+0000 7fdd5a108640 1 -- 172.21.15.5:0/136362515 shutdown_connections 2024-09-13T17:15:07.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.354+0000 7fdd5a108640 1 --2- 172.21.15.5:0/136362515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540b3a20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.354+0000 7fdd5a108640 1 -- 172.21.15.5:0/136362515 >> 172.21.15.5:0/136362515 conn(0x7fdd54070af0 msgr2=0x7fdd54070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.354+0000 7fdd5a108640 1 -- 172.21.15.5:0/136362515 shutdown_connections 2024-09-13T17:15:07.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.354+0000 7fdd5a108640 1 -- 172.21.15.5:0/136362515 wait complete. 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.355+0000 7fdd5a108640 1 Processor -- start 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.355+0000 7fdd5a108640 1 -- start start 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd5406ef60 0x7fdd54151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 0x7fdd5415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540c54a0 con 0x7fdd5406eb80 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54152160 con 0x7fdd540b1ac0 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd5a108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5415c030 con 0x7fdd5406ef60 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35552/0 (socket says 172.21.15.5:35552) 2024-09-13T17:15:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 -- 172.21.15.5:0/3373029831 learned_addr learned my addr 172.21.15.5:0/3373029831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd52ffd640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd5406ef60 0x7fdd54151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd53fff640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 0x7fdd5415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 -- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd5406ef60 msgr2=0x7fdd54151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd5406ef60 0x7fdd54151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 -- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 msgr2=0x7fdd5415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 0x7fdd5415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 -- 172.21.15.5:0/3373029831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009400 con 0x7fdd5406eb80 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd53fff640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 0x7fdd5415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.356+0000 7fdd537fe640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.357+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44030880 con 0x7fdd5406eb80 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.357+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd440309e0 con 0x7fdd5406eb80 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.357+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5415a770 con 0x7fdd5406eb80 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.357+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44030d70 con 0x7fdd5406eb80 2024-09-13T17:15:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.357+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5415ad30 con 0x7fdd5406eb80 2024-09-13T17:15:07.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.358+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540672e0 con 0x7fdd5406eb80 2024-09-13T17:15:07.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.358+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd4403d420 con 0x7fdd5406eb80 2024-09-13T17:15:07.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.359+0000 7fdd4bfff640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 0x7fdd3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.359+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdd440a9f60 con 0x7fdd5406eb80 2024-09-13T17:15:07.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.359+0000 7fdd52ffd640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 0x7fdd3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.359+0000 7fdd52ffd640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 0x7fdd3406d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd541f5040 tx=0x7fdd3c007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.363+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdd440753b0 con 0x7fdd5406eb80 2024-09-13T17:15:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.602+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7fdd540b3a20 con 0x7fdd5406eb80 2024-09-13T17:15:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.634+0000 7fdd4bfff640 1 -- 172.21.15.5:0/3373029831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v127) v1 ==== 156+0+0 (secure 0 0 0) 0x7fdd440410e0 con 0x7fdd5406eb80 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 msgr2=0x7fdd3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 0x7fdd3406d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd541f5040 tx=0x7fdd3c007e40 comp rx=0 tx=0).stop 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 msgr2=0x7fdd540c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd440046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 shutdown_connections 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd540b1ac0 0x7fdd5415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd5406ef60 0x7fdd54151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdd3406ac00 0x7fdd3406d0c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 --2- 172.21.15.5:0/3373029831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd5406eb80 0x7fdd540c4f60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 >> 172.21.15.5:0/3373029831 conn(0x7fdd54070af0 msgr2=0x7fdd540cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 shutdown_connections 2024-09-13T17:15:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.637+0000 7fdd5a108640 1 -- 172.21.15.5:0/3373029831 wait complete. 2024-09-13T17:15:07.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:15:07.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.752+0000 7f9ae799c640 1 Processor -- start 2024-09-13T17:15:07.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.752+0000 7f9ae799c640 1 -- start start 2024-09-13T17:15:07.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ae006eb80 0x7f9ae00b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b1ac0 0x7f9ae015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ae006ef60 0x7f9ae006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae0160020 con 0x7f9ae006ef60 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00b35f0 con 0x7f9ae006eb80 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae799c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0156f50 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ae006ef60 0x7f9ae006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ae006ef60 0x7f9ae006aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35568/0 (socket says 172.21.15.5:35568) 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 -- 172.21.15.5:0/1846629327 learned_addr learned my addr 172.21.15.5:0/1846629327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 -- 172.21.15.5:0/1846629327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b1ac0 msgr2=0x7f9ae015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae4f37640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b1ac0 0x7f9ae015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5738640 1 --2- 172.21.15.5:0/1846629327 >> v2:172.21.15.179:3300/0 conn(0x7f9ae006eb80 0x7f9ae00b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b1ac0 0x7f9ae015ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 -- 172.21.15.5:0/1846629327 >> v2:172.21.15.179:3300/0 conn(0x7f9ae006eb80 msgr2=0x7f9ae00b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:07.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/1846629327 >> v2:172.21.15.179:3300/0 conn(0x7f9ae006eb80 0x7f9ae00b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.753+0000 7f9ae5f39640 1 -- 172.21.15.5:0/1846629327 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00b3f60 con 0x7f9ae006ef60 2024-09-13T17:15:07.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.754+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae006ef60 0x7f9ae006aea0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01570c0 tx=0x7f9ad802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ceb498d42e4d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.754+0000 7f9ad7fff640 1 -- 172.21.15.5:0/1846629327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad802aea0 con 0x7f9ae006ef60 2024-09-13T17:15:07.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.754+0000 7f9ad7fff640 1 -- 172.21.15.5:0/1846629327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad802d050 con 0x7f9ae006ef60 2024-09-13T17:15:07.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.754+0000 7f9ad7fff640 1 -- 172.21.15.5:0/1846629327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8031820 con 0x7f9ae006ef60 2024-09-13T17:15:07.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 -- 172.21.15.5:0/1846629327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae006ef60 msgr2=0x7f9ae006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae006ef60 0x7f9ae006aea0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01570c0 tx=0x7f9ad802a680 comp rx=0 tx=0).stop 2024-09-13T17:15:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 -- 172.21.15.5:0/1846629327 shutdown_connections 2024-09-13T17:15:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae006ef60 0x7f9ae006aea0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 --2- 172.21.15.5:0/1846629327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae00b1ac0 0x7f9ae015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 --2- 172.21.15.5:0/1846629327 >> v2:172.21.15.179:3300/0 conn(0x7f9ae006eb80 0x7f9ae00b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 -- 172.21.15.5:0/1846629327 >> 172.21.15.5:0/1846629327 conn(0x7f9ae0070af0 msgr2=0x7f9ae0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 -- 172.21.15.5:0/1846629327 shutdown_connections 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.755+0000 7f9ae799c640 1 -- 172.21.15.5:0/1846629327 wait complete. 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.756+0000 7f9ae799c640 1 Processor -- start 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.756+0000 7f9ae799c640 1 -- start start 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae006eb80 0x7f9ae0146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 0x7f9ae0154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01570c0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00af100 con 0x7f9ae006ef60 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae799c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00ae2a0 con 0x7f9ae006eb80 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35584/0 (socket says 172.21.15.5:35584) 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 -- 172.21.15.5:0/3966460390 learned_addr learned my addr 172.21.15.5:0/3966460390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae4f37640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 0x7f9ae0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 -- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae006eb80 msgr2=0x7f9ae0146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae006eb80 0x7f9ae0146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 -- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 msgr2=0x7f9ae0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 0x7f9ae0154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 -- 172.21.15.5:0/3966460390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009b30 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae4f37640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 0x7f9ae0154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.757+0000 7f9ae5f39640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802ac70 tx=0x7f9ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.758+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad803d860 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.758+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad803d9e0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.758+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00ae4f0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.758+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad803dd90 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.758+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00aeab0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.759+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae00672e0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.759+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ad803b400 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.760+0000 7f9ad5ffb640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 0x7f9ac406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.760+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9ad80aa040 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.760+0000 7f9ae5738640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 0x7f9ac406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.760+0000 7f9ae5738640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 0x7f9ac406d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00a810 tx=0x7f9adc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.764+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9ad80753e0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.932+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9ae015ade0 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.936+0000 7f9ad5ffb640 1 -- 172.21.15.5:0/3966460390 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9ad8009510 con 0x7f9ae00b1ac0 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 msgr2=0x7f9ac406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 0x7f9ac406d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00a810 tx=0x7f9adc008040 comp rx=0 tx=0).stop 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 msgr2=0x7f9ae0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802ac70 tx=0x7f9ad8004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 shutdown_connections 2024-09-13T17:15:07.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ac406ac30 0x7f9ac406d0f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ae00b1ac0 0x7f9ae0154b80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae006ef60 0x7f9ae0154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 --2- 172.21.15.5:0/3966460390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ae006eb80 0x7f9ae0146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 >> 172.21.15.5:0/3966460390 conn(0x7f9ae0070af0 msgr2=0x7f9ae015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 shutdown_connections 2024-09-13T17:15:07.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:07.938+0000 7f9ae799c640 1 -- 172.21.15.5:0/3966460390 wait complete. 2024-09-13T17:15:07.951 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:15:07.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:15:07.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:15:08.035 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:15:08.035 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:15:08.035 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:08.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:15:08.052 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:15:08.052 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:08.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:15:08.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:15:08.094 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:08.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:15:08.111 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:15:08.111 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:08.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:15:08.153 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:15:08.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.253+0000 7fac3a983640 1 Processor -- start 2024-09-13T17:15:08.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.253+0000 7fac3a983640 1 -- start start 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 0x7fac340cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac340d06d0 0x7fac340b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 0x7fac340d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340b4fb0 con 0x7fac340d06d0 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340d1e80 con 0x7fac340b4b20 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac3a983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340d1750 con 0x7fac3415c810 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac340d06d0 0x7fac340b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac340d06d0 0x7fac340b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35600/0 (socket says 172.21.15.5:35600) 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.254+0000 7fac2bfff640 1 -- 172.21.15.5:0/3734530447 learned_addr learned my addr 172.21.15.5:0/3734530447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac33fff640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 0x7fac340cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac38f20640 1 --2- 172.21.15.5:0/3734530447 >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 0x7fac340d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac2bfff640 1 -- 172.21.15.5:0/3734530447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 msgr2=0x7fac340cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac2bfff640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 0x7fac340cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac2bfff640 1 -- 172.21.15.5:0/3734530447 >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 msgr2=0x7fac340d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac2bfff640 1 --2- 172.21.15.5:0/3734530447 >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 0x7fac340d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac2bfff640 1 -- 172.21.15.5:0/3734530447 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340d0bd0 con 0x7fac340d06d0 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac33fff640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 0x7fac340cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.255+0000 7fac38f20640 1 --2- 172.21.15.5:0/3734530447 >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 0x7fac340d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac2bfff640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340b45e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac340d37d0 tx=0x7fac1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e822096004a695ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac337fe640 1 -- 172.21.15.5:0/3734530447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c032440 con 0x7fac340d06d0 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac337fe640 1 -- 172.21.15.5:0/3734530447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0325a0 con 0x7fac340d06d0 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac337fe640 1 -- 172.21.15.5:0/3734530447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c032930 con 0x7fac340d06d0 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 -- 172.21.15.5:0/3734530447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 msgr2=0x7fac340b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340b45e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac340d37d0 tx=0x7fac1c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 -- 172.21.15.5:0/3734530447 shutdown_connections 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 --2- 172.21.15.5:0/3734530447 >> v2:172.21.15.179:3300/0 conn(0x7fac340b4b20 0x7fac340d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340b45e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 --2- 172.21.15.5:0/3734530447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3415c810 0x7fac340cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 -- 172.21.15.5:0/3734530447 >> 172.21.15.5:0/3734530447 conn(0x7fac340717a0 msgr2=0x7fac34071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 -- 172.21.15.5:0/3734530447 shutdown_connections 2024-09-13T17:15:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.256+0000 7fac3a983640 1 -- 172.21.15.5:0/3734530447 wait complete. 2024-09-13T17:15:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.257+0000 7fac3a983640 1 Processor -- start 2024-09-13T17:15:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 -- start start 2024-09-13T17:15:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 0x7fac341549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3415c810 0x7fac340c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34156d00 con 0x7fac340d06d0 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b40a0 con 0x7fac3415c810 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac3a983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b3dc0 con 0x7fac340b4b20 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35614/0 (socket says 172.21.15.5:35614) 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac2bfff640 1 -- 172.21.15.5:0/828457308 learned_addr learned my addr 172.21.15.5:0/828457308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.258+0000 7fac33fff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 0x7fac341549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac38f20640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3415c810 0x7fac340c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 -- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 msgr2=0x7fac341549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 0x7fac341549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 -- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3415c810 msgr2=0x7fac340c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3415c810 0x7fac340c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 -- 172.21.15.5:0/828457308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0094d0 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac33fff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 0x7fac341549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac2bfff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000c00 tx=0x7fac1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c032440 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c030b80 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac34156ef0 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c03b400 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.259+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac34154ef0 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.260+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac340672a0 con 0x7fac340d06d0 2024-09-13T17:15:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.261+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac1c039040 con 0x7fac340d06d0 2024-09-13T17:15:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.261+0000 7fac317fa640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 0x7fac1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.261+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fac1c0a99e0 con 0x7fac340d06d0 2024-09-13T17:15:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.261+0000 7fac33fff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 0x7fac1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.262+0000 7fac33fff640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 0x7fac1406d0f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac2400a990 tx=0x7fac24008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.265+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac1c074e30 con 0x7fac340d06d0 2024-09-13T17:15:08.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.471+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac3415d300 con 0x7fac340d06d0 2024-09-13T17:15:08.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.471+0000 7fac317fa640 1 -- 172.21.15.5:0/828457308 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fac1c037090 con 0x7fac340d06d0 2024-09-13T17:15:08.473 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:08.474 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2180592170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2180592170},{"type":"v1","addr":"172.21.15.179:6836","nonce":2180592170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5048,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3309868850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3309868850},{"type":"v1","addr":"172.21.15.179:6837","nonce":3309868850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2603737786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2603737786},{"type":"v1","addr":"172.21.15.5:6834","nonce":2603737786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":6015,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1599992123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1599992123},{"type":"v1","addr":"172.21.15.5:6835","nonce":1599992123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[]} 2024-09-13T17:15:08.474 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 msgr2=0x7fac1406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 0x7fac1406d0f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fac2400a990 tx=0x7fac24008040 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 msgr2=0x7fac340c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000c00 tx=0x7fac1c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 shutdown_connections 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3415c810 0x7fac340c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fac1406ac30 0x7fac1406d0f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac340d06d0 0x7fac340c7500 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 --2- 172.21.15.5:0/828457308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac340b4b20 0x7fac341549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 >> 172.21.15.5:0/828457308 conn(0x7fac340717a0 msgr2=0x7fac3415cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 shutdown_connections 2024-09-13T17:15:08.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.473+0000 7fac3a983640 1 -- 172.21.15.5:0/828457308 wait complete. 2024-09-13T17:15:08.486 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:15:08.487 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:15:08.487 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:15:08.487 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:15:08.487 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:15:08.487 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:15:08.487 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:15:08.487 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:15:08.488 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:15:08.488 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:15:08.488 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:15:08.488 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:15:08.488 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:15:08.488 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:15:08.488 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:15:08.489 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:15:08.497 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:15:08.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:15:08.498 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:15:08.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:15:08.500 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:15:08.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:15:08.501 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:15:08.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:15:08.539 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:15:08.540 DEBUG:teuthology.parallel:result is None 2024-09-13T17:15:08.540 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:15:08.540 DEBUG:teuthology.parallel:result is None 2024-09-13T17:15:08.543 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:15:08.543 DEBUG:teuthology.parallel:result is None 2024-09-13T17:15:08.544 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:15:08.544 DEBUG:teuthology.parallel:result is None 2024-09-13T17:15:08.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:15:08.617 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:15:08.618 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:15:08.627 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:15:08.629 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:15:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.653+0000 7f1a18a20640 1 Processor -- start 2024-09-13T17:15:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.653+0000 7f1a18a20640 1 -- start start 2024-09-13T17:15:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a18a20640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a1415c810 0x7f1a140cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a18a20640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140d1e80 con 0x7f1a140d06d0 2024-09-13T17:15:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a18a20640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140d1750 con 0x7f1a140b4cf0 2024-09-13T17:15:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a18a20640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140d0bd0 con 0x7f1a1415c810 2024-09-13T17:15:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a1415c810 0x7f1a140cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a1415c810 0x7f1a140cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35666/0 (socket says 172.21.15.5:35666) 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 -- 172.21.15.5:0/4020484752 learned_addr learned my addr 172.21.15.5:0/4020484752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a11d9b640 1 --1- 172.21.15.5:0/4020484752 >> v1:172.21.15.5:6789/0 conn(0x7f1a140d06d0 0x7f1a140b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35994/0 (socket says 172.21.15.5:35994) 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 -- 172.21.15.5:0/4020484752 >> v1:172.21.15.179:6789/0 conn(0x7f1a140b4cf0 legacy=0x7f1a140b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 -- 172.21.15.5:0/4020484752 >> v1:172.21.15.5:6789/0 conn(0x7f1a140d06d0 legacy=0x7f1a140b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1259c640 1 -- 172.21.15.5:0/4020484752 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140d0eb0 con 0x7f1a1415c810 2024-09-13T17:15:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.654+0000 7f1a1159a640 1 -- 172.21.15.5:0/4020484752 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879941329 0 0) 0x7f1a140d1e80 con 0x7f1a140d06d0 2024-09-13T17:15:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a1259c640 1 --2- 172.21.15.5:0/4020484752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140cd780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009870 tx=0x7f1a0402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5224a578ff461ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a1159a640 1 -- 172.21.15.5:0/4020484752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04032440 con 0x7f1a1415c810 2024-09-13T17:15:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a1159a640 1 -- 172.21.15.5:0/4020484752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040325a0 con 0x7f1a1415c810 2024-09-13T17:15:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a1159a640 1 -- 172.21.15.5:0/4020484752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04032930 con 0x7f1a1415c810 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a18a20640 1 -- 172.21.15.5:0/4020484752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 msgr2=0x7f1a140cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.655+0000 7f1a18a20640 1 --2- 172.21.15.5:0/4020484752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140cd780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009870 tx=0x7f1a0402a2a0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.656+0000 7f1a18a20640 1 -- 172.21.15.5:0/4020484752 shutdown_connections 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.656+0000 7f1a18a20640 1 --2- 172.21.15.5:0/4020484752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140cd780 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.656+0000 7f1a18a20640 1 -- 172.21.15.5:0/4020484752 >> 172.21.15.5:0/4020484752 conn(0x7f1a140717a0 msgr2=0x7f1a14071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.656+0000 7f1a18a20640 1 -- 172.21.15.5:0/4020484752 shutdown_connections 2024-09-13T17:15:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.656+0000 7f1a18a20640 1 -- 172.21.15.5:0/4020484752 wait complete. 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.657+0000 7f1a18a20640 1 Processor -- start 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.657+0000 7f1a18a20640 1 -- start start 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a140b4cf0 0x7f1a14153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a140d06d0 0x7f1a141566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140ca6c0 con 0x7f1a1415c810 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14153bc0 con 0x7f1a140d06d0 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c97f0 con 0x7f1a140b4cf0 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a11d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a140d06d0 0x7f1a141566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35674/0 (socket says 172.21.15.5:35674) 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 -- 172.21.15.5:0/2894624120 learned_addr learned my addr 172.21.15.5:0/2894624120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a1259c640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a140b4cf0 0x7f1a14153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 -- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a140b4cf0 msgr2=0x7f1a14153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a140b4cf0 0x7f1a14153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 -- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a140d06d0 msgr2=0x7f1a141566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a140d06d0 0x7f1a141566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 -- 172.21.15.5:0/2894624120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040094d0 con 0x7f1a1415c810 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a12d9d640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c7b0 tx=0x7f1a0c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c004b60 con 0x7f1a1415c810 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c004cc0 con 0x7f1a1415c810 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00aa90 con 0x7f1a1415c810 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.658+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a141f3090 con 0x7f1a1415c810 2024-09-13T17:15:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.659+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a140ca000 con 0x7f1a1415c810 2024-09-13T17:15:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.660+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a140672a0 con 0x7f1a1415c810 2024-09-13T17:15:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.660+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a0c00abf0 con 0x7f1a1415c810 2024-09-13T17:15:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.660+0000 7f1a02ffd640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 0x7f19f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.661+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1a0c089200 con 0x7f1a1415c810 2024-09-13T17:15:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.661+0000 7f1a1259c640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 0x7f19f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.661+0000 7f1a1259c640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 0x7f19f406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a0402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.665+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a0c054650 con 0x7f1a1415c810 2024-09-13T17:15:08.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:08.846+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1a140c9aa0 con 0x7f1a1415c810 2024-09-13T17:15:09.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.648+0000 7f1a02ffd640 1 -- 172.21.15.5:0/2894624120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1a0c057c70 con 0x7f1a1415c810 2024-09-13T17:15:09.651 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:15:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 msgr2=0x7f19f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 0x7f19f406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a0402e000 comp rx=0 tx=0).stop 2024-09-13T17:15:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 msgr2=0x7f1a140caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c7b0 tx=0x7f1a0c00cc70 comp rx=0 tx=0).stop 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 shutdown_connections 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19f406ac00 0x7f19f406d0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a1415c810 0x7f1a140caae0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a140d06d0 0x7f1a141566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 --2- 172.21.15.5:0/2894624120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a140b4cf0 0x7f1a14153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 >> 172.21.15.5:0/2894624120 conn(0x7f1a140717a0 msgr2=0x7f1a14071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 shutdown_connections 2024-09-13T17:15:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.651+0000 7f1a18a20640 1 -- 172.21.15.5:0/2894624120 wait complete. 2024-09-13T17:15:09.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:15:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.773+0000 7f0c969d4640 1 Processor -- start 2024-09-13T17:15:09.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.773+0000 7f0c969d4640 1 -- start start 2024-09-13T17:15:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c969d4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c900b1970 0x7f0c90070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c969d4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900b1580 con 0x7f0c90070fc0 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c969d4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900b2ad0 con 0x7f0c90159290 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c969d4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900713f0 con 0x7f0c900b1970 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c94f71640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0c90070fc0 0x7f0c9006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35998/0 (socket says 172.21.15.5:35998) 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.774+0000 7f0c94f71640 1 -- 172.21.15.5:0/3569937072 learned_addr learned my addr 172.21.15.5:0/3569937072 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/3569937072 >> v2:172.21.15.179:3300/0 conn(0x7f0c900b1970 0x7f0c90070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388238509 0 0) 0x7f0c900b1580 con 0x7f0c90070fc0 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c78003520 con 0x7f0c90070fc0 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3604553985 0 0) 0x7f0c78003520 con 0x7f0c90070fc0 2024-09-13T17:15:09.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 >> v2:172.21.15.179:3300/0 conn(0x7f0c900b1970 msgr2=0x7f0c90070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 --2- 172.21.15.5:0/3569937072 >> v2:172.21.15.179:3300/0 conn(0x7f0c900b1970 0x7f0c90070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 >> v1:172.21.15.179:6789/0 conn(0x7f0c90159290 legacy=0x7f0c90159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900b1ec0 con 0x7f0c90070fc0 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0c880019f0 con 0x7f0c90070fc0 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 >> v1:172.21.15.5:6789/0 conn(0x7f0c90070fc0 legacy=0x7f0c9006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78003970 0x7f0c78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c780047c0 0x7f0c78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 0x7f0c7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900713f0 con 0x7f0c78005180 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800d130 con 0x7f0c780047c0 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800c070 con 0x7f0c78003970 2024-09-13T17:15:09.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 0x7f0c7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8ffff640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78003970 0x7f0c78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c780047c0 0x7f0c78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 -- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78003970 msgr2=0x7f0c78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78003970 0x7f0c78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 -- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c780047c0 msgr2=0x7f0c78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c780047c0 0x7f0c78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c94f71640 1 -- 172.21.15.5:0/3569937072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78003520 con 0x7f0c78005180 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.775+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c780047c0 0x7f0c78004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.776+0000 7f0c94f71640 1 -- 172.21.15.5:0/3569937072 reap_dead start 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.776+0000 7f0c94f71640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 0x7f0c7800b980 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800a830 tx=0x7f0c780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc6665bc1be2efb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.776+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8802ba50 con 0x7f0c78005180 2024-09-13T17:15:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.776+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8802bbf0 con 0x7f0c78005180 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.776+0000 7f0c8effd640 1 -- 172.21.15.5:0/3569937072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88034470 con 0x7f0c78005180 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 -- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 msgr2=0x7f0c7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 0x7f0c7800b980 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800a830 tx=0x7f0c780057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 -- 172.21.15.5:0/3569937072 shutdown_connections 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 --2- 172.21.15.5:0/3569937072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c78005180 0x7f0c7800b980 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 -- 172.21.15.5:0/3569937072 >> 172.21.15.5:0/3569937072 conn(0x7f0c900ce0d0 msgr2=0x7f0c900ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 -- 172.21.15.5:0/3569937072 shutdown_connections 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.777+0000 7f0c969d4640 1 -- 172.21.15.5:0/3569937072 wait complete. 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.778+0000 7f0c969d4640 1 Processor -- start 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.778+0000 7f0c969d4640 1 -- start start 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78005180 0x7f0c901415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 0x7f0c900ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9014eb40 con 0x7f0c90151060 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cc660 con 0x7f0c9014e350 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c969d4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901e3a30 con 0x7f0c78005180 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35686/0 (socket says 172.21.15.5:35686) 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/987221771 learned_addr learned my addr 172.21.15.5:0/987221771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c8ffff640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78005180 0x7f0c901415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.779+0000 7f0c94f71640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 0x7f0c900ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78005180 msgr2=0x7f0c901415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78005180 0x7f0c901415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 msgr2=0x7f0c900ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 0x7f0c900ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/987221771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c901e3190 con 0x7f0c90151060 2024-09-13T17:15:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c94f71640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 0x7f0c900ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c84011540 tx=0x7f0c84011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84015870 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c840159d0 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84015d40 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c901e3470 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.780+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c900cc890 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.781+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c900672a0 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.782+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c8401d400 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.782+0000 7f0c8cff9640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 0x7f0c7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.782+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0c840898a0 con 0x7f0c90151060 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.782+0000 7f0c8ffff640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 0x7f0c7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.783+0000 7f0c8ffff640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 0x7f0c7c06d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c80000c00 tx=0x7f0c80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:09.787+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c84054c90 con 0x7f0c90151060 2024-09-13T17:15:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.023+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0c901e43f0 con 0x7f0c90151060 2024-09-13T17:15:10.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.023+0000 7f0c8cff9640 1 -- 172.21.15.5:0/987221771 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0c840582b0 con 0x7f0c90151060 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:15:10.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.028 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.029 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:15:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.032 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:15:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:15:10.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.036 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:15:10.037 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:15:10.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:15:10.040 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 msgr2=0x7f0c7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 0x7f0c7c06d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c80000c00 tx=0x7f0c80009040 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 msgr2=0x7f0c901e1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0c84011540 tx=0x7f0c84011a00 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 shutdown_connections 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c9014e350 0x7f0c900ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c7c06ac00 0x7f0c7c06d0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c90151060 0x7f0c901e1de0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 --2- 172.21.15.5:0/987221771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c78005180 0x7f0c901415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 >> 172.21.15.5:0/987221771 conn(0x7f0c900ce0d0 msgr2=0x7f0c9014f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 shutdown_connections 2024-09-13T17:15:10.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.026+0000 7f0c969d4640 1 -- 172.21.15.5:0/987221771 wait complete. 2024-09-13T17:15:10.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.143+0000 7f0f69fec640 1 Processor -- start 2024-09-13T17:15:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.143+0000 7f0f69fec640 1 -- start start 2024-09-13T17:15:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f69fec640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0f640b4cf0 0x7f0f640cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f69fec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f640b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f69fec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640d1e80 con 0x7f0f6415c810 2024-09-13T17:15:10.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f69fec640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f640d1750 con 0x7f0f640b4cf0 2024-09-13T17:15:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f69fec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640d0bd0 con 0x7f0f640d06d0 2024-09-13T17:15:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f637fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f6415c810 0x7f0f640b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36002/0 (socket says 172.21.15.5:36002) 2024-09-13T17:15:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.144+0000 7f0f637fe640 1 -- 172.21.15.5:0/2717344456 learned_addr learned my addr 172.21.15.5:0/2717344456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977693981 0 0) 0x7f0f640d1e80 con 0x7f0f6415c810 2024-09-13T17:15:10.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c003520 con 0x7f0f6415c810 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f63fff640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f640b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/2717344456 >> v2:172.21.15.179:3300/0 conn(0x7f0f640b4cf0 0x7f0f640cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903228935 0 0) 0x7f0f4c003520 con 0x7f0f6415c810 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 msgr2=0x7f0f640b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f640b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 >> v2:172.21.15.179:3300/0 conn(0x7f0f640b4cf0 msgr2=0x7f0f640cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 --2- 172.21.15.5:0/2717344456 >> v2:172.21.15.179:3300/0 conn(0x7f0f640b4cf0 0x7f0f640cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640d0eb0 con 0x7f0f6415c810 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0f54001670 con 0x7f0f6415c810 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 >> v1:172.21.15.5:6789/0 conn(0x7f0f6415c810 legacy=0x7f0f640b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f4c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c004d00 0x7f0f4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640d1750 con 0x7f0f4c003ef0 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640d0bd0 con 0x7f0f4c004d00 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c00b980 con 0x7f0f640d06d0 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f637fe640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f4c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f63fff640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c004d00 0x7f0f4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 -- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 msgr2=0x7f0f4c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f4c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 -- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c004d00 msgr2=0x7f0f4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.145+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c004d00 0x7f0f4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f62ffd640 1 -- 172.21.15.5:0/2717344456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c003520 con 0x7f0f4c003ef0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f637fe640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640d06d0 0x7f0f4c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f4c0047c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ac0 tx=0x7f0f4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1483f1e672ed36d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58031400 con 0x7f0f4c003ef0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5802d050 con 0x7f0f4c003ef0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.146+0000 7f0f627fc640 1 -- 172.21.15.5:0/2717344456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58031780 con 0x7f0f4c003ef0 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 -- 172.21.15.5:0/2717344456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 msgr2=0x7f0f4c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 --2- 172.21.15.5:0/2717344456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f4c0047c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ac0 tx=0x7f0f4c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f63fff640 1 -- 172.21.15.5:0/2717344456 reap_dead start 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 -- 172.21.15.5:0/2717344456 shutdown_connections 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 -- 172.21.15.5:0/2717344456 >> 172.21.15.5:0/2717344456 conn(0x7f0f640717a0 msgr2=0x7f0f64071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 -- 172.21.15.5:0/2717344456 shutdown_connections 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.147+0000 7f0f69fec640 1 -- 172.21.15.5:0/2717344456 wait complete. 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.148+0000 7f0f69fec640 1 Processor -- start 2024-09-13T17:15:10.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.148+0000 7f0f69fec640 1 -- start start 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f641f1410 0x7f0f641f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640cb1c0 0x7f0f640cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6414c040 con 0x7f0f4c003ef0 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c97f0 con 0x7f0f641f1410 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f69fec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64157690 con 0x7f0f640cb1c0 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35718/0 (socket says 172.21.15.5:35718) 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f637fe640 1 -- 172.21.15.5:0/3987205964 learned_addr learned my addr 172.21.15.5:0/3987205964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f63fff640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640cb1c0 0x7f0f640cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.149+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f641f1410 0x7f0f641f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 -- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640cb1c0 msgr2=0x7f0f640cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640cb1c0 0x7f0f640cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 -- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f641f1410 msgr2=0x7f0f641f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f641f1410 0x7f0f641f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 -- 172.21.15.5:0/3987205964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64145c50 con 0x7f0f4c003ef0 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f637fe640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e870 tx=0x7f0f5400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400c850 con 0x7f0f4c003ef0 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400c9b0 con 0x7f0f4c003ef0 2024-09-13T17:15:10.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f640c9d20 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400cd60 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.150+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f640cbb80 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.151+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f64157ca0 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.152+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f5401d460 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.152+0000 7f0f4bfff640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 0x7f0f5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.152+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0f54089040 con 0x7f0f4c003ef0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.152+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 0x7f0f5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.153+0000 7f0f62ffd640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 0x7f0f5006d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f58033000 tx=0x7f0f58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.156+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f54054570 con 0x7f0f4c003ef0 2024-09-13T17:15:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.328+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f641574f0 con 0x7f0f4c003ef0 2024-09-13T17:15:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.329+0000 7f0f4bfff640 1 -- 172.21.15.5:0/3987205964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13026 (secure 0 0 0) 0x7f0f641574f0 con 0x7f0f4c003ef0 2024-09-13T17:15:10.331 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:10.331 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:09.647245+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 msgr2=0x7f0f5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 0x7f0f5006d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f58033000 tx=0x7f0f58008030 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 msgr2=0x7f0f640c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e870 tx=0x7f0f5400ed30 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 shutdown_connections 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f640cb1c0 0x7f0f640cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f641f1410 0x7f0f641f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0f5006ac00 0x7f0f5006d0c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 --2- 172.21.15.5:0/3987205964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f4c003ef0 0x7f0f640c8b90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.330+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 >> 172.21.15.5:0/3987205964 conn(0x7f0f640717a0 msgr2=0x7f0f64071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.331+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 shutdown_connections 2024-09-13T17:15:10.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.331+0000 7f0f69fec640 1 -- 172.21.15.5:0/3987205964 wait complete. 2024-09-13T17:15:10.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:10.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.446+0000 7f1aebee5640 1 Processor -- start 2024-09-13T17:15:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.446+0000 7f1aebee5640 1 -- start start 2024-09-13T17:15:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1aebee5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae415fd80 0x7f1ae40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1aebee5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 0x7f1ae4098a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1aebee5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae40704a0 con 0x7f1ae4098f40 2024-09-13T17:15:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1aebee5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae40993f0 con 0x7f1ae415fd80 2024-09-13T17:15:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1aebee5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae406cc10 con 0x7f1ae40d0e30 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.447+0000 7f1ae9480640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 0x7f1ae4098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9c81640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ae415fd80 0x7f1ae40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1aea482640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1ae4098f40 0x7f1ae40ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:47782/0 (socket says 172.21.15.5:47782) 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1aea482640 1 -- 172.21.15.5:0/2254782668 learned_addr learned my addr 172.21.15.5:0/2254782668 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9480640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 0x7f1ae4098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:50370/0 (socket says 172.21.15.5:50370) 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9c81640 1 -- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 msgr2=0x7f1ae4098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 0x7f1ae4098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9c81640 1 -- 172.21.15.5:0/2254782668 >> v1:172.21.15.179:6789/0 conn(0x7f1ae4098f40 legacy=0x7f1ae40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.448+0000 7f1ae9c81640 1 -- 172.21.15.5:0/2254782668 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae406bd80 con 0x7f1ae415fd80 2024-09-13T17:15:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40cfd30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00097a0 tx=0x7f1ae002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0d9e2571de4f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1ae8c7f640 1 -- 172.21.15.5:0/2254782668 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae002ae50 con 0x7f1ae415fd80 2024-09-13T17:15:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1ae8c7f640 1 -- 172.21.15.5:0/2254782668 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0032440 con 0x7f1ae415fd80 2024-09-13T17:15:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1ae8c7f640 1 -- 172.21.15.5:0/2254782668 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00327d0 con 0x7f1ae415fd80 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 -- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 msgr2=0x7f1ae40cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 --2- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40cfd30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00097a0 tx=0x7f1ae002a100 comp rx=0 tx=0).stop 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 -- 172.21.15.5:0/2254782668 shutdown_connections 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 --2- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae40d0e30 0x7f1ae4098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 --2- 172.21.15.5:0/2254782668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40cfd30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.449+0000 7f1aebee5640 1 -- 172.21.15.5:0/2254782668 >> 172.21.15.5:0/2254782668 conn(0x7f1ae40d0310 msgr2=0x7f1ae40d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.450+0000 7f1aebee5640 1 -- 172.21.15.5:0/2254782668 shutdown_connections 2024-09-13T17:15:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.450+0000 7f1aebee5640 1 -- 172.21.15.5:0/2254782668 wait complete. 2024-09-13T17:15:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.451+0000 7f1aebee5640 1 Processor -- start 2024-09-13T17:15:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.451+0000 7f1aebee5640 1 -- start start 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 0x7f1ae40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae41580e0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae4157230 con 0x7f1ae415fd80 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae41574d0 con 0x7f1ae4098f40 2024-09-13T17:15:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35730/0 (socket says 172.21.15.5:35730) 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 -- 172.21.15.5:0/1622299612 learned_addr learned my addr 172.21.15.5:0/1622299612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 0x7f1ae40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aea482640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 -- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 msgr2=0x7f1ae40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 0x7f1ae40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 -- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 msgr2=0x7f1ae40af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 -- 172.21.15.5:0/1622299612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009400 con 0x7f1ae40d0e30 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 0x7f1ae40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ae9480640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400e980 tx=0x7f1ad400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4009670 con 0x7f1ae40d0e30 2024-09-13T17:15:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400ca00 con 0x7f1ae40d0e30 2024-09-13T17:15:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae41577b0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400cd90 con 0x7f1ae40d0e30 2024-09-13T17:15:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.452+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae4157d70 con 0x7f1ae40d0e30 2024-09-13T17:15:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.454+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae406c1f0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.454+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ad4013470 con 0x7f1ae40d0e30 2024-09-13T17:15:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.454+0000 7f1ada7fc640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 0x7f1ac806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.454+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1ad40893f0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.455+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 0x7f1ac806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.455+0000 7f1ae9c81640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 0x7f1ac806d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0034000 tx=0x7f1ae002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.459+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1ae406c1f0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.628+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ae406c1f0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.628+0000 7f1ada7fc640 1 -- 172.21.15.5:0/1622299612 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ae406c1f0 con 0x7f1ae40d0e30 2024-09-13T17:15:10.631 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 msgr2=0x7f1ac806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 0x7f1ac806d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0034000 tx=0x7f1ae002e000 comp rx=0 tx=0).stop 2024-09-13T17:15:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 msgr2=0x7f1ae40aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400e980 tx=0x7f1ad400ee40 comp rx=0 tx=0).stop 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 shutdown_connections 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae415fd80 0x7f1ae40af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ac806ac00 0x7f1ac806d0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ae40d0e30 0x7f1ae40aeea0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 --2- 172.21.15.5:0/1622299612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae4098f40 0x7f1ae40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 >> 172.21.15.5:0/1622299612 conn(0x7f1ae40d0310 msgr2=0x7f1ae40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 shutdown_connections 2024-09-13T17:15:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.631+0000 7f1aebee5640 1 -- 172.21.15.5:0/1622299612 wait complete. 2024-09-13T17:15:10.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:15:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.743+0000 7f8804bbc640 1 Processor -- start 2024-09-13T17:15:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.743+0000 7f8804bbc640 1 -- start start 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f8804bbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b4cf0 0x7f88000cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f8804bbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88000d06d0 0x7f88000b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f8804bbc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000d1e80 con 0x7f880015c810 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f8804bbc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000d1750 con 0x7f88000d06d0 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f8804bbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88000d0bd0 con 0x7f88000b4cf0 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f87fed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88000d06d0 0x7f88000b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f87fed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88000d06d0 0x7f88000b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35734/0 (socket says 172.21.15.5:35734) 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.744+0000 7f87fed9d640 1 -- 172.21.15.5:0/526816289 learned_addr learned my addr 172.21.15.5:0/526816289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fdd9b640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b4cf0 0x7f88000cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fed9d640 1 -- 172.21.15.5:0/526816289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b4cf0 msgr2=0x7f88000cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fed9d640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b4cf0 0x7f88000cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fed9d640 1 -- 172.21.15.5:0/526816289 >> v1:172.21.15.179:6789/0 conn(0x7f880015c810 legacy=0x7f88000b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fed9d640 1 -- 172.21.15.5:0/526816289 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000d0eb0 con 0x7f88000d06d0 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.745+0000 7f87fed9d640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000d06d0 0x7f88000b5a90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009870 tx=0x7f87f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd94410aaa263dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f87fd59a640 1 -- 172.21.15.5:0/526816289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8032440 con 0x7f88000d06d0 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f87fd59a640 1 -- 172.21.15.5:0/526816289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80325a0 con 0x7f88000d06d0 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f87fd59a640 1 -- 172.21.15.5:0/526816289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8032930 con 0x7f88000d06d0 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 -- 172.21.15.5:0/526816289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000d06d0 msgr2=0x7f88000b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000d06d0 0x7f88000b5a90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009870 tx=0x7f87f802a270 comp rx=0 tx=0).stop 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 -- 172.21.15.5:0/526816289 shutdown_connections 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000d06d0 0x7f88000b5a90 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 --2- 172.21.15.5:0/526816289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88000b4cf0 0x7f88000cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 -- 172.21.15.5:0/526816289 >> 172.21.15.5:0/526816289 conn(0x7f88000717a0 msgr2=0x7f8800071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 -- 172.21.15.5:0/526816289 shutdown_connections 2024-09-13T17:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.746+0000 7f8804bbc640 1 -- 172.21.15.5:0/526816289 wait complete. 2024-09-13T17:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 Processor -- start 2024-09-13T17:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 -- start start 2024-09-13T17:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88000d06d0 0x7f8800156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880015c810 0x7f88001594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c76a0 con 0x7f88000b4cf0 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c7c20 con 0x7f88000d06d0 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f8804bbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800153600 con 0x7f880015c810 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.748+0000 7f87fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35740/0 (socket says 172.21.15.5:35740) 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 -- 172.21.15.5:0/2403798324 learned_addr learned my addr 172.21.15.5:0/2403798324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fed9d640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880015c810 0x7f88001594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fdd9b640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88000d06d0 0x7f8800156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 -- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880015c810 msgr2=0x7f88001594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880015c810 0x7f88001594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 -- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88000d06d0 msgr2=0x7f8800156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88000d06d0 0x7f8800156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 -- 172.21.15.5:0/2403798324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80094d0 con 0x7f88000b4cf0 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87fe59c640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c730 tx=0x7f87f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0003b70 con 0x7f88000b4cf0 2024-09-13T17:15:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0003cf0 con 0x7f88000b4cf0 2024-09-13T17:15:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880015f220 con 0x7f88000b4cf0 2024-09-13T17:15:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0003ea0 con 0x7f88000b4cf0 2024-09-13T17:15:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.749+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880015e980 con 0x7f88000b4cf0 2024-09-13T17:15:10.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.750+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88000672a0 con 0x7f88000b4cf0 2024-09-13T17:15:10.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.751+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87f000aa90 con 0x7f88000b4cf0 2024-09-13T17:15:10.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.751+0000 7f87eeffd640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 0x7f87e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:10.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.751+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f87f0088e30 con 0x7f88000b4cf0 2024-09-13T17:15:10.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.752+0000 7f87fdd9b640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 0x7f87e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:10.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.752+0000 7f87fdd9b640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 0x7f87e006d0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f880015f900 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:10.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.756+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87f00542d0 con 0x7f88000b4cf0 2024-09-13T17:15:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.928+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f88000b5a90 con 0x7f88000b4cf0 2024-09-13T17:15:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.929+0000 7f87eeffd640 1 -- 172.21.15.5:0/2403798324 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+65 (secure 0 0 0) 0x7f87f00578f0 con 0x7f88000b4cf0 2024-09-13T17:15:10.932 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:10.932 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:15:10.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:10.932 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:15:10.932 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:15:10.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:10.933 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:15:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 msgr2=0x7f87e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 0x7f87e006d0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f880015f900 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2024-09-13T17:15:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 msgr2=0x7f8800152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c730 tx=0x7f87f000cbf0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 shutdown_connections 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f880015c810 0x7f88001594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88000d06d0 0x7f8800156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e006ac00 0x7f87e006d0c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 --2- 172.21.15.5:0/2403798324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88000b4cf0 0x7f8800152e50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 >> 172.21.15.5:0/2403798324 conn(0x7f88000717a0 msgr2=0x7f880015d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 shutdown_connections 2024-09-13T17:15:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:10.931+0000 7f8804bbc640 1 -- 172.21.15.5:0/2403798324 wait complete. 2024-09-13T17:15:10.944 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:15:10.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:15:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.048+0000 7fa00359c640 1 Processor -- start 2024-09-13T17:15:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.048+0000 7fa00359c640 1 -- start start 2024-09-13T17:15:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa00359c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ffc151290 0x7f9ffc06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa00359c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9ffc0ab060 0x7f9ffc0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa00359c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc06e070 con 0x7f9ffc15a8f0 2024-09-13T17:15:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa00359c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc0ab9e0 con 0x7f9ffc151290 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa00359c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc15b540 con 0x7f9ffc0ab060 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001338640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ffc151290 0x7f9ffc06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001b39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9ffc15a8f0 0x7f9ffc15ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36016/0 (socket says 172.21.15.5:36016) 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001b39640 1 -- 172.21.15.5:0/2802785891 learned_addr learned my addr 172.21.15.5:0/2802785891 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001338640 1 -- 172.21.15.5:0/2802785891 >> v2:172.21.15.179:3300/0 conn(0x7f9ffc0ab060 msgr2=0x7f9ffc0ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001338640 1 --2- 172.21.15.5:0/2802785891 >> v2:172.21.15.179:3300/0 conn(0x7f9ffc0ab060 0x7f9ffc0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001338640 1 -- 172.21.15.5:0/2802785891 >> v1:172.21.15.5:6789/0 conn(0x7f9ffc15a8f0 legacy=0x7f9ffc15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7fa001338640 1 -- 172.21.15.5:0/2802785891 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc15b820 con 0x7f9ffc151290 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.049+0000 7f9ff3fff640 1 -- 172.21.15.5:0/2802785891 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374444975 0 0) 0x7f9ffc06e070 con 0x7f9ffc15a8f0 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.050+0000 7fa001338640 1 --2- 172.21.15.5:0/2802785891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc151290 0x7f9ffc06ce30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0cedf0 tx=0x7f9ff802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6365ed98640d2423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.050+0000 7f9ff3fff640 1 -- 172.21.15.5:0/2802785891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032440 con 0x7f9ffc151290 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.050+0000 7f9ff3fff640 1 -- 172.21.15.5:0/2802785891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff80325a0 con 0x7f9ffc151290 2024-09-13T17:15:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.050+0000 7f9ff3fff640 1 -- 172.21.15.5:0/2802785891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032930 con 0x7f9ffc151290 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 -- 172.21.15.5:0/2802785891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc151290 msgr2=0x7f9ffc06ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 --2- 172.21.15.5:0/2802785891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc151290 0x7f9ffc06ce30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0cedf0 tx=0x7f9ff802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 -- 172.21.15.5:0/2802785891 shutdown_connections 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 --2- 172.21.15.5:0/2802785891 >> v2:172.21.15.179:3300/0 conn(0x7f9ffc0ab060 0x7f9ffc0ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 --2- 172.21.15.5:0/2802785891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc151290 0x7f9ffc06ce30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 -- 172.21.15.5:0/2802785891 >> 172.21.15.5:0/2802785891 conn(0x7f9ffc0ce0f0 msgr2=0x7f9ffc0ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 -- 172.21.15.5:0/2802785891 shutdown_connections 2024-09-13T17:15:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.051+0000 7fa00359c640 1 -- 172.21.15.5:0/2802785891 wait complete. 2024-09-13T17:15:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.052+0000 7fa00359c640 1 Processor -- start 2024-09-13T17:15:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.052+0000 7fa00359c640 1 -- start start 2024-09-13T17:15:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ffc151290 0x7f9ffc0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ffc15a8f0 0x7f9ffc0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc155f10 con 0x7f9ffc0ab060 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc145df0 con 0x7f9ffc151290 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc155150 con 0x7f9ffc15a8f0 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35748/0 (socket says 172.21.15.5:35748) 2024-09-13T17:15:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 -- 172.21.15.5:0/2556207750 learned_addr learned my addr 172.21.15.5:0/2556207750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa000b37640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ffc151290 0x7f9ffc0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 -- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ffc15a8f0 msgr2=0x7f9ffc0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ffc15a8f0 0x7f9ffc0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 -- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ffc151290 msgr2=0x7f9ffc0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ffc151290 0x7f9ffc0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 -- 172.21.15.5:0/2556207750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009400 con 0x7f9ffc0ab060 2024-09-13T17:15:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa001338640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009890 tx=0x7f9ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032440 con 0x7f9ffc0ab060 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8004230 con 0x7f9ffc0ab060 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc155430 con 0x7f9ffc0ab060 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.053+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8006e10 con 0x7f9ffc0ab060 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.054+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc1559f0 con 0x7f9ffc0ab060 2024-09-13T17:15:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.054+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc0672a0 con 0x7f9ffc0ab060 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.055+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ff8030980 con 0x7f9ffc0ab060 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.055+0000 7f9ff1ffb640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 0x7f9fe006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.056+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9ff80aa350 con 0x7f9ffc0ab060 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.056+0000 7fa000b37640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 0x7f9fe006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.056+0000 7fa000b37640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 0x7f9fe006d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0afa40 tx=0x7f9fec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.060+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9ff80756a0 con 0x7f9ffc0ab060 2024-09-13T17:15:11.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.232+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9ffc151670 con 0x7f9ffc0ab060 2024-09-13T17:15:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.655+0000 7f9ff1ffb640 1 -- 172.21.15.5:0/2556207750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9ff8078cc0 con 0x7f9ffc0ab060 2024-09-13T17:15:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:15:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 msgr2=0x7f9fe006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 0x7f9fe006d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0afa40 tx=0x7f9fec008040 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 msgr2=0x7f9ffc1458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009890 tx=0x7f9ff80046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 shutdown_connections 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ffc15a8f0 0x7f9ffc0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ffc151290 0x7f9ffc0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9fe006ac00 0x7f9fe006d0c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 --2- 172.21.15.5:0/2556207750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc0ab060 0x7f9ffc1458b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 >> 172.21.15.5:0/2556207750 conn(0x7f9ffc0ce0f0 msgr2=0x7f9ffc0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 shutdown_connections 2024-09-13T17:15:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.658+0000 7fa00359c640 1 -- 172.21.15.5:0/2556207750 wait complete. 2024-09-13T17:15:11.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:15:11.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.784+0000 7f1243511640 1 Processor -- start 2024-09-13T17:15:11.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.785+0000 7f1243511640 1 -- start start 2024-09-13T17:15:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.785+0000 7f1243511640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f123c06eaf0 0x7f123c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.785+0000 7f1243511640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 0x7f123c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1243511640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0b35f0 con 0x7f123c06eed0 2024-09-13T17:15:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1243511640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c160020 con 0x7f123c06eaf0 2024-09-13T17:15:11.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1243511640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c156f50 con 0x7f123c0b1ac0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f123c06eaf0 0x7f123c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f123c06eaf0 0x7f123c0b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35764/0 (socket says 172.21.15.5:35764) 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1241aae640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f123c06eed0 0x7f123c06aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36020/0 (socket says 172.21.15.5:36020) 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 -- 172.21.15.5:0/3893682059 learned_addr learned my addr 172.21.15.5:0/3893682059 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1240aac640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 0x7f123c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 -- 172.21.15.5:0/3893682059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 msgr2=0x7f123c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 0x7f123c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 -- 172.21.15.5:0/3893682059 >> v1:172.21.15.5:6789/0 conn(0x7f123c06eed0 legacy=0x7f123c06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1233fff640 1 -- 172.21.15.5:0/3893682059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178559943 0 0) 0x7f123c0b35f0 con 0x7f123c06eed0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f12412ad640 1 -- 172.21.15.5:0/3893682059 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0b3f60 con 0x7f123c06eaf0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.786+0000 7f1240aac640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 0x7f123c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f12412ad640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c06eaf0 0x7f123c0b3a20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1238009870 tx=0x7f123802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b8807533124bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f1233fff640 1 -- 172.21.15.5:0/3893682059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238032440 con 0x7f123c06eaf0 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f1233fff640 1 -- 172.21.15.5:0/3893682059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380325a0 con 0x7f123c06eaf0 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f1233fff640 1 -- 172.21.15.5:0/3893682059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238032930 con 0x7f123c06eaf0 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f1243511640 1 -- 172.21.15.5:0/3893682059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c06eaf0 msgr2=0x7f123c0b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.787+0000 7f1243511640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c06eaf0 0x7f123c0b3a20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1238009870 tx=0x7f123802a270 comp rx=0 tx=0).stop 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 -- 172.21.15.5:0/3893682059 shutdown_connections 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c0b1ac0 0x7f123c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 --2- 172.21.15.5:0/3893682059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c06eaf0 0x7f123c0b3a20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 -- 172.21.15.5:0/3893682059 >> 172.21.15.5:0/3893682059 conn(0x7f123c070af0 msgr2=0x7f123c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 -- 172.21.15.5:0/3893682059 shutdown_connections 2024-09-13T17:15:11.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.788+0000 7f1243511640 1 -- 172.21.15.5:0/3893682059 wait complete. 2024-09-13T17:15:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.789+0000 7f1243511640 1 Processor -- start 2024-09-13T17:15:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.789+0000 7f1243511640 1 -- start start 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.789+0000 7f1243511640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c06eaf0 0x7f123c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123c06eed0 0x7f123c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1f2a10 con 0x7f123c0b1ac0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0cabf0 con 0x7f123c06eed0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c15f990 con 0x7f123c06eaf0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35770/0 (socket says 172.21.15.5:35770) 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 -- 172.21.15.5:0/2442206167 learned_addr learned my addr 172.21.15.5:0/2442206167 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f12412ad640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c06eaf0 0x7f123c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1240aac640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123c06eed0 0x7f123c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 -- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c06eaf0 msgr2=0x7f123c15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c06eaf0 0x7f123c15f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 -- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123c06eed0 msgr2=0x7f123c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123c06eed0 0x7f123c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 -- 172.21.15.5:0/2442206167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380094d0 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1241aae640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f123400c7e0 tx=0x7f123400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400a640 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400a7c0 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400ab70 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.790+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c1f2070 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.791+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c1f2630 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.791+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c0672e0 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.792+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f123400acd0 con 0x7f123c0b1ac0 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.792+0000 7f1231ffb640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 0x7f122006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:11.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.793+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f1234088800 con 0x7f123c0b1ac0 2024-09-13T17:15:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.793+0000 7f12412ad640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 0x7f122006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.793+0000 7f12412ad640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 0x7f122006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1238034000 tx=0x7f123802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:11.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.797+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1234053b20 con 0x7f123c0b1ac0 2024-09-13T17:15:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:11.966+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f123c1f2b50 con 0x7f123c0b1ac0 2024-09-13T17:15:12.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:15:12.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:15:12.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.662+0000 7f1231ffb640 1 -- 172.21.15.5:0/2442206167 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f123c1f2b50 con 0x7f123c0b1ac0 2024-09-13T17:15:12.665 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:15:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.675+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 msgr2=0x7f122006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.676+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 0x7f122006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1238034000 tx=0x7f123802e000 comp rx=0 tx=0).stop 2024-09-13T17:15:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.676+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 msgr2=0x7f123c1597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.676+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f123400c7e0 tx=0x7f123400cca0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 shutdown_connections 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f122006ac00 0x7f122006d0c0 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1238034000 tx=0x7f123802e000 comp rx=0 tx=0).stop 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f123c0b1ac0 0x7f123c1597f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f123c06eed0 0x7f123c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 --2- 172.21.15.5:0/2442206167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f123c06eaf0 0x7f123c15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.677+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 >> 172.21.15.5:0/2442206167 conn(0x7f123c070af0 msgr2=0x7f123c15dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.680+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 shutdown_connections 2024-09-13T17:15:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.680+0000 7f1243511640 1 -- 172.21.15.5:0/2442206167 wait complete. 2024-09-13T17:15:12.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:15:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.802+0000 7f28fe765640 1 Processor -- start 2024-09-13T17:15:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.802+0000 7f28fe765640 1 -- start start 2024-09-13T17:15:12.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fe765640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 0x7f28f8071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fe765640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28f81598a0 0x7f28f80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fe765640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f8153380 con 0x7f28f80b20e0 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fe765640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80b24f0 con 0x7f28f81598a0 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fe765640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f8070f10 con 0x7f28f8152fa0 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28f81598a0 0x7f28f80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fcd02640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28f80b20e0 0x7f28f806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36030/0 (socket says 172.21.15.5:36030) 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.803+0000 7f28fcd02640 1 -- 172.21.15.5:0/867354863 learned_addr learned my addr 172.21.15.5:0/867354863 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28f7fff640 1 --2- 172.21.15.5:0/867354863 >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 0x7f28f8071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28effff640 1 -- 172.21.15.5:0/867354863 >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 msgr2=0x7f28f8071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28effff640 1 --2- 172.21.15.5:0/867354863 >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 0x7f28f8071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28effff640 1 -- 172.21.15.5:0/867354863 >> v1:172.21.15.5:6789/0 conn(0x7f28f80b20e0 legacy=0x7f28f806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28f77fe640 1 -- 172.21.15.5:0/867354863 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081552993 0 0) 0x7f28f8153380 con 0x7f28f80b20e0 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28effff640 1 -- 172.21.15.5:0/867354863 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80711f0 con 0x7f28f81598a0 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.804+0000 7f28f7fff640 1 --2- 172.21.15.5:0/867354863 >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 0x7f28f8071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28effff640 1 --2- 172.21.15.5:0/867354863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80b1ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f28f806e4c0 tx=0x7f28e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1451f4974fda90ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28f77fe640 1 -- 172.21.15.5:0/867354863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0032440 con 0x7f28f81598a0 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28f77fe640 1 -- 172.21.15.5:0/867354863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e00325a0 con 0x7f28f81598a0 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28f77fe640 1 -- 172.21.15.5:0/867354863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0032930 con 0x7f28f81598a0 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 -- 172.21.15.5:0/867354863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 msgr2=0x7f28f80b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 --2- 172.21.15.5:0/867354863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80b1ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f28f806e4c0 tx=0x7f28e002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 -- 172.21.15.5:0/867354863 shutdown_connections 2024-09-13T17:15:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 --2- 172.21.15.5:0/867354863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80b1ba0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 --2- 172.21.15.5:0/867354863 >> v2:172.21.15.179:3300/0 conn(0x7f28f8152fa0 0x7f28f8071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 -- 172.21.15.5:0/867354863 >> 172.21.15.5:0/867354863 conn(0x7f28f80ce130 msgr2=0x7f28f80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 -- 172.21.15.5:0/867354863 shutdown_connections 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.805+0000 7f28fe765640 1 -- 172.21.15.5:0/867354863 wait complete. 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 Processor -- start 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 -- start start 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f80b20e0 0x7f28f80ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 0x7f28f815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80adf40 con 0x7f28f81598a0 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8154260 con 0x7f28f8152fa0 2024-09-13T17:15:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.807+0000 7f28fe765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80ad330 con 0x7f28f80b20e0 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35786/0 (socket says 172.21.15.5:35786) 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 -- 172.21.15.5:0/2964524033 learned_addr learned my addr 172.21.15.5:0/2964524033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28f7fff640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f80b20e0 0x7f28f80ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28effff640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 0x7f28f815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 -- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f80b20e0 msgr2=0x7f28f80ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f80b20e0 0x7f28f80ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 -- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 msgr2=0x7f28f815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 0x7f28f815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 -- 172.21.15.5:0/2964524033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009400 con 0x7f28f81598a0 2024-09-13T17:15:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28effff640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 0x7f28f815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fcd02640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c7e0 tx=0x7f28f000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000a640 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000a7c0 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f80ad610 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000ab70 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.808+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f80adbd0 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.809+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f80672a0 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.810+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28f000acd0 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.810+0000 7f28f57fa640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 0x7f28d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.811+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f28f0088bd0 con 0x7f28f81598a0 2024-09-13T17:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.811+0000 7f28f7fff640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 0x7f28d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.811+0000 7f28f7fff640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 0x7f28d806d0f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28e800a990 tx=0x7f28e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:12.815+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28f0053d60 con 0x7f28f81598a0 2024-09-13T17:15:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.022+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28f80b12d0 con 0x7f28f81598a0 2024-09-13T17:15:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 7 and data pool 8 2024-09-13T17:15:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.028+0000 7f28f57fa640 1 -- 172.21.15.5:0/2964524033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f28f0018020 con 0x7f28f81598a0 2024-09-13T17:15:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.035+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 msgr2=0x7f28d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.035+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 0x7f28d806d0f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28e800a990 tx=0x7f28e8008040 comp rx=0 tx=0).stop 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.035+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 msgr2=0x7f28f80aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.035+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f28f000c7e0 tx=0x7f28f000cca0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 shutdown_connections 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f28d806ac30 0x7f28d806d0f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28f81598a0 0x7f28f80aed80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28f8152fa0 0x7f28f815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 --2- 172.21.15.5:0/2964524033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28f80b20e0 0x7f28f80ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 >> 172.21.15.5:0/2964524033 conn(0x7f28f80ce130 msgr2=0x7f28f80b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 shutdown_connections 2024-09-13T17:15:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.036+0000 7f28fe765640 1 -- 172.21.15.5:0/2964524033 wait complete. 2024-09-13T17:15:13.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:13.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.159+0000 7f77acac9640 1 Processor -- start 2024-09-13T17:15:13.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.159+0000 7f77acac9640 1 -- start start 2024-09-13T17:15:13.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77a8156f40 0x7f77a815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a806dff0 0x7f77a80abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a806e4a0 con 0x7f77a806dff0 2024-09-13T17:15:13.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a80b2390 con 0x7f77a8156f40 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77acac9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80b14c0 con 0x7f77a80b1080 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a806dff0 0x7f77a80abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77a806dff0 0x7f77a80abec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35796/0 (socket says 172.21.15.5:35796) 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2652665077 learned_addr learned my addr 172.21.15.5:0/2652665077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f779ffff640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a659c640 1 --2- 172.21.15.5:0/2652665077 >> v2:172.21.15.179:3300/0 conn(0x7f77a8156f40 0x7f77a815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2652665077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 msgr2=0x7f77a806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2652665077 >> v2:172.21.15.179:3300/0 conn(0x7f77a8156f40 msgr2=0x7f77a815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2652665077 >> v2:172.21.15.179:3300/0 conn(0x7f77a8156f40 0x7f77a815a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2652665077 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80b1780 con 0x7f77a806dff0 2024-09-13T17:15:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.160+0000 7f779ffff640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a806dff0 0x7f77a80abec0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f77a806aea0 tx=0x7f77a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f42f9854f0bd2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77a5d9b640 1 -- 172.21.15.5:0/2652665077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0031600 con 0x7f77a806dff0 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77a5d9b640 1 -- 172.21.15.5:0/2652665077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a002d050 con 0x7f77a806dff0 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77a5d9b640 1 -- 172.21.15.5:0/2652665077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0031980 con 0x7f77a806dff0 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77acac9640 1 -- 172.21.15.5:0/2652665077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a806dff0 msgr2=0x7f77a80abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77acac9640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a806dff0 0x7f77a80abec0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f77a806aea0 tx=0x7f77a002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.161+0000 7f77acac9640 1 -- 172.21.15.5:0/2652665077 shutdown_connections 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a806dff0 0x7f77a80abec0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 --2- 172.21.15.5:0/2652665077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 --2- 172.21.15.5:0/2652665077 >> v2:172.21.15.179:3300/0 conn(0x7f77a8156f40 0x7f77a815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 -- 172.21.15.5:0/2652665077 >> 172.21.15.5:0/2652665077 conn(0x7f77a80ce0d0 msgr2=0x7f77a80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 -- 172.21.15.5:0/2652665077 shutdown_connections 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.162+0000 7f77acac9640 1 -- 172.21.15.5:0/2652665077 wait complete. 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.163+0000 7f77acac9640 1 Processor -- start 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.163+0000 7f77acac9640 1 -- start start 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a806dff0 0x7f77a8149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a814e100 con 0x7f77a8156f40 2024-09-13T17:15:13.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a814e3e0 con 0x7f77a806dff0 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77acac9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a814e6c0 con 0x7f77a80b1080 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a806dff0 0x7f77a8149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35806/0 (socket says 172.21.15.5:35806) 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2694506658 learned_addr learned my addr 172.21.15.5:0/2694506658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f779ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 msgr2=0x7f77a80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a806dff0 msgr2=0x7f77a8149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a806dff0 0x7f77a8149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 -- 172.21.15.5:0/2694506658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009b30 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f77a6d9d640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f77a002ac90 tx=0x7f77a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.164+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a003b820 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.165+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a003b980 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.165+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a814e9a0 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.165+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a003bcf0 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.165+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a8164d10 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.166+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a80672a0 con 0x7f77a8156f40 2024-09-13T17:15:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.166+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f77a0038050 con 0x7f77a8156f40 2024-09-13T17:15:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.167+0000 7f779effd640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 0x7f778806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.167+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f77a00aa090 con 0x7f77a8156f40 2024-09-13T17:15:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.167+0000 7f77a659c640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 0x7f778806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.167+0000 7f77a659c640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 0x7f778806d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f779800aa20 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.171+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f77a00751e0 con 0x7f77a8156f40 2024-09-13T17:15:13.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.344+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77a80b2c30 con 0x7f77a8156f40 2024-09-13T17:15:13.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.345+0000 7f779effd640 1 -- 172.21.15.5:0/2694506658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f77a0009510 con 0x7f77a8156f40 2024-09-13T17:15:13.347 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:13.347 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:13.024792+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 msgr2=0x7f778806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 0x7f778806d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f779800aa20 tx=0x7f7798008040 comp rx=0 tx=0).stop 2024-09-13T17:15:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 msgr2=0x7f77a80aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f77a002ac90 tx=0x7f77a0004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 shutdown_connections 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f778806ac00 0x7f778806d0c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77a8156f40 0x7f77a80aedf0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77a80b1080 0x7f77a80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 --2- 172.21.15.5:0/2694506658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77a806dff0 0x7f77a8149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 >> 172.21.15.5:0/2694506658 conn(0x7f77a80ce0d0 msgr2=0x7f77a8159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 shutdown_connections 2024-09-13T17:15:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.347+0000 7f77acac9640 1 -- 172.21.15.5:0/2694506658 wait complete. 2024-09-13T17:15:13.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.459+0000 7f36cff5e640 1 Processor -- start 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 -- start start 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 0x7f36c80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c80b4cf0 0x7f36c80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c80d1e80 con 0x7f36c80d06d0 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80d1750 con 0x7f36c80b4cf0 2024-09-13T17:15:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.460+0000 7f36cff5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80d0bd0 con 0x7f36c815c810 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c80b4cf0 0x7f36c80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c80b4cf0 0x7f36c80b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53866/0 (socket says 172.21.15.5:53866) 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 -- 172.21.15.5:0/112752438 learned_addr learned my addr 172.21.15.5:0/112752438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36cdcfa640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 0x7f36c80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 -- 172.21.15.5:0/112752438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 msgr2=0x7f36c80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 0x7f36c80cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 -- 172.21.15.5:0/112752438 >> v1:172.21.15.179:6789/0 conn(0x7f36c80d06d0 legacy=0x7f36c80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36ce4fb640 1 -- 172.21.15.5:0/112752438 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80d0eb0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.461+0000 7f36cdcfa640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 0x7f36c80cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36ce4fb640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c80b5a90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009e50 tx=0x7f36c002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80d5d4f6aa1aff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cccf8640 1 -- 172.21.15.5:0/112752438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c002aea0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cccf8640 1 -- 172.21.15.5:0/112752438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c002d050 con 0x7f36c80b4cf0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cccf8640 1 -- 172.21.15.5:0/112752438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0031820 con 0x7f36c80b4cf0 2024-09-13T17:15:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 -- 172.21.15.5:0/112752438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 msgr2=0x7f36c80b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c80b5a90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009e50 tx=0x7f36c002a6c0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 -- 172.21.15.5:0/112752438 shutdown_connections 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c80b5a90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 --2- 172.21.15.5:0/112752438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c815c810 0x7f36c80cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 -- 172.21.15.5:0/112752438 >> 172.21.15.5:0/112752438 conn(0x7f36c80717a0 msgr2=0x7f36c8071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 -- 172.21.15.5:0/112752438 shutdown_connections 2024-09-13T17:15:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.462+0000 7f36cff5e640 1 -- 172.21.15.5:0/112752438 wait complete. 2024-09-13T17:15:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 Processor -- start 2024-09-13T17:15:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 -- start start 2024-09-13T17:15:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80d06d0 0x7f36c80cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 0x7f36c815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80c8350 con 0x7f36c80b4cf0 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80c8630 con 0x7f36c815c810 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cff5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80c8910 con 0x7f36c80d06d0 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cdcfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cdcfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53870/0 (socket says 172.21.15.5:53870) 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.464+0000 7f36cdcfa640 1 -- 172.21.15.5:0/3623260796 learned_addr learned my addr 172.21.15.5:0/3623260796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36ce4fb640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 0x7f36c815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cd4f9640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80d06d0 0x7f36c80cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 -- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80d06d0 msgr2=0x7f36c80cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80d06d0 0x7f36c80cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 -- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 msgr2=0x7f36c815ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 0x7f36c815ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 -- 172.21.15.5:0/3623260796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009b30 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36ce4fb640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 0x7f36c815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cdcfa640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f36c400c7f0 tx=0x7f36c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4007820 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4007980 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c80c8bf0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4007cf0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.465+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c80cb7b0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.466+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c80672a0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.467+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36c40113f0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.467+0000 7f36be7fc640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 0x7f36ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.467+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f36c40897b0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.467+0000 7f36cd4f9640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 0x7f36ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.468+0000 7f36cd4f9640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 0x7f36ac06d0c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36c81f51d0 tx=0x7f36b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.471+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f36c4054850 con 0x7f36c80b4cf0 2024-09-13T17:15:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.642+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36c80c8de0 con 0x7f36c80b4cf0 2024-09-13T17:15:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.643+0000 7f36be7fc640 1 -- 172.21.15.5:0/3623260796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f36c4057e70 con 0x7f36c80b4cf0 2024-09-13T17:15:13.645 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:13.645 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:13.024792+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 msgr2=0x7f36ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 0x7f36ac06d0c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36c81f51d0 tx=0x7f36b8009040 comp rx=0 tx=0).stop 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 msgr2=0x7f36c8150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f36c400c7f0 tx=0x7f36c400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 shutdown_connections 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815c810 0x7f36c815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80d06d0 0x7f36c80cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36ac06ac00 0x7f36ac06d0c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 --2- 172.21.15.5:0/3623260796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c80b4cf0 0x7f36c8150c10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 >> 172.21.15.5:0/3623260796 conn(0x7f36c80717a0 msgr2=0x7f36c80b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 shutdown_connections 2024-09-13T17:15:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.645+0000 7f36cff5e640 1 -- 172.21.15.5:0/3623260796 wait complete. 2024-09-13T17:15:13.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:15:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.763+0000 7fd41aa6b640 1 Processor -- start 2024-09-13T17:15:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.764+0000 7fd41aa6b640 1 -- start start 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.764+0000 7fd41aa6b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4140cf000 0x7fd4140cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.764+0000 7fd41aa6b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4140cf980 con 0x7fd4141645e0 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.764+0000 7fd41aa6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4140ce570 con 0x7fd41415c6e0 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.764+0000 7fd41aa6b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4140d0630 con 0x7fd4140cf000 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4140cf000 0x7fd4140cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4140cf000 0x7fd4140cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53880/0 (socket says 172.21.15.5:53880) 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 -- 172.21.15.5:0/1192999218 learned_addr learned my addr 172.21.15.5:0/1192999218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 -- 172.21.15.5:0/1192999218 >> v1:172.21.15.179:6789/0 conn(0x7fd41415c6e0 legacy=0x7fd4140cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 -- 172.21.15.5:0/1192999218 >> v1:172.21.15.5:6789/0 conn(0x7fd4141645e0 legacy=0x7fd4141669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.765+0000 7fd413fff640 1 -- 172.21.15.5:0/1192999218 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140d0910 con 0x7fd4140cf000 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd413fff640 1 --2- 172.21.15.5:0/1192999218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4140cf000 0x7fd4140cf440 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009e50 tx=0x7fd3fc02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e8a1184bb2497 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd4137fe640 1 -- 172.21.15.5:0/1192999218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc031600 con 0x7fd4140cf000 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd4137fe640 1 -- 172.21.15.5:0/1192999218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc02d050 con 0x7fd4140cf000 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd4137fe640 1 -- 172.21.15.5:0/1192999218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc031980 con 0x7fd4140cf000 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 -- 172.21.15.5:0/1192999218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4140cf000 msgr2=0x7fd4140cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/1192999218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4140cf000 0x7fd4140cf440 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009e50 tx=0x7fd3fc02a760 comp rx=0 tx=0).stop 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 -- 172.21.15.5:0/1192999218 shutdown_connections 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/1192999218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4140cf000 0x7fd4140cf440 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 -- 172.21.15.5:0/1192999218 >> 172.21.15.5:0/1192999218 conn(0x7fd414089f90 msgr2=0x7fd4140d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 -- 172.21.15.5:0/1192999218 shutdown_connections 2024-09-13T17:15:13.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.766+0000 7fd41aa6b640 1 -- 172.21.15.5:0/1192999218 wait complete. 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 Processor -- start 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 -- start start 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4140cf000 0x7fd414154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 0x7fd4140b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b5e90 con 0x7fd41415c6e0 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b3670 con 0x7fd4140cf000 2024-09-13T17:15:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.768+0000 7fd41aa6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b38c0 con 0x7fd4141645e0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53882/0 (socket says 172.21.15.5:53882) 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 -- 172.21.15.5:0/2065193688 learned_addr learned my addr 172.21.15.5:0/2065193688 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd419008640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 0x7fd4140b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd418807640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4140cf000 0x7fd414154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 -- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 msgr2=0x7fd4140b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 0x7fd4140b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 -- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4140cf000 msgr2=0x7fd414154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4140cf000 0x7fd414154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 -- 172.21.15.5:0/2065193688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc009b30 con 0x7fd41415c6e0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd419008640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 0x7fd4140b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd413fff640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009e50 tx=0x7fd3fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc03d860 con 0x7fd41415c6e0 2024-09-13T17:15:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc03d9c0 con 0x7fd41415c6e0 2024-09-13T17:15:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4140b3ba0 con 0x7fd41415c6e0 2024-09-13T17:15:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc03dd70 con 0x7fd41415c6e0 2024-09-13T17:15:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.769+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140b4160 con 0x7fd41415c6e0 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.770+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4140672e0 con 0x7fd41415c6e0 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.771+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3fc03b400 con 0x7fd41415c6e0 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.771+0000 7fd4117fa640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 0x7fd3f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.771+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd3fc0aa4a0 con 0x7fd41415c6e0 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.771+0000 7fd418807640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 0x7fd3f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.772+0000 7fd418807640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 0x7fd3f406d0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4141f5e40 tx=0x7fd404009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.775+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3fc0754a0 con 0x7fd41415c6e0 2024-09-13T17:15:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:13.982+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd41415cac0 con 0x7fd41415c6e0 2024-09-13T17:15:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.036+0000 7fd4117fa640 1 -- 172.21.15.5:0/2065193688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd3fc009510 con 0x7fd41415c6e0 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 msgr2=0x7fd3f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 0x7fd3f406d0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4141f5e40 tx=0x7fd404009040 comp rx=0 tx=0).stop 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 msgr2=0x7fd414154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009e50 tx=0x7fd3fc004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 shutdown_connections 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4141645e0 0x7fd4140b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd3f406ac00 0x7fd3f406d0c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd41415c6e0 0x7fd414154430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 --2- 172.21.15.5:0/2065193688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4140cf000 0x7fd414154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.038+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 >> 172.21.15.5:0/2065193688 conn(0x7fd414089f90 msgr2=0x7fd4140aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.039+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 shutdown_connections 2024-09-13T17:15:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.039+0000 7fd41aa6b640 1 -- 172.21.15.5:0/2065193688 wait complete. 2024-09-13T17:15:14.051 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:15:14.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:15:14.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.154+0000 7fbe567f4640 1 Processor -- start 2024-09-13T17:15:14.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.154+0000 7fbe567f4640 1 -- start start 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe567f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe500abe60 0x7fbe500b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe567f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe567f4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500ad050 con 0x7fbe501591e0 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe567f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5006e400 con 0x7fbe500abe60 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe567f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ac440 con 0x7fbe5006da30 2024-09-13T17:15:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe500abe60 0x7fbe500b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbe500abe60 0x7fbe500b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53898/0 (socket says 172.21.15.5:53898) 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 -- 172.21.15.5:0/276347620 learned_addr learned my addr 172.21.15.5:0/276347620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe54d91640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 -- 172.21.15.5:0/276347620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 msgr2=0x7fbe5006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 -- 172.21.15.5:0/276347620 >> v1:172.21.15.179:6789/0 conn(0x7fbe501591e0 legacy=0x7fbe500ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe47fff640 1 -- 172.21.15.5:0/276347620 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500ac720 con 0x7fbe500abe60 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.155+0000 7fbe54d91640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.156+0000 7fbe47fff640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe500abe60 0x7fbe500b1b30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009870 tx=0x7fbe3802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c249090788d7271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.156+0000 7fbe4f7fe640 1 -- 172.21.15.5:0/276347620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38032440 con 0x7fbe500abe60 2024-09-13T17:15:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.156+0000 7fbe4f7fe640 1 -- 172.21.15.5:0/276347620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380325a0 con 0x7fbe500abe60 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.156+0000 7fbe4f7fe640 1 -- 172.21.15.5:0/276347620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38032930 con 0x7fbe500abe60 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 -- 172.21.15.5:0/276347620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe500abe60 msgr2=0x7fbe500b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe500abe60 0x7fbe500b1b30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009870 tx=0x7fbe3802a210 comp rx=0 tx=0).stop 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 -- 172.21.15.5:0/276347620 shutdown_connections 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 --2- 172.21.15.5:0/276347620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe500abe60 0x7fbe500b1b30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 -- 172.21.15.5:0/276347620 >> 172.21.15.5:0/276347620 conn(0x7fbe500ce130 msgr2=0x7fbe500ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 -- 172.21.15.5:0/276347620 shutdown_connections 2024-09-13T17:15:14.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.157+0000 7fbe567f4640 1 -- 172.21.15.5:0/276347620 wait complete. 2024-09-13T17:15:14.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.158+0000 7fbe567f4640 1 Processor -- start 2024-09-13T17:15:14.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.158+0000 7fbe567f4640 1 -- start start 2024-09-13T17:15:14.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500abe60 0x7fbe5014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5014d960 con 0x7fbe501591e0 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5014d030 con 0x7fbe500abe60 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe567f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5014d310 con 0x7fbe5006da30 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53906/0 (socket says 172.21.15.5:53906) 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 -- 172.21.15.5:0/1438607893 learned_addr learned my addr 172.21.15.5:0/1438607893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe4ffff640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe47fff640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500abe60 0x7fbe5014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 -- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 msgr2=0x7fbe5014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 -- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500abe60 msgr2=0x7fbe5014aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500abe60 0x7fbe5014aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:14.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 -- 172.21.15.5:0/1438607893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380094d0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.159+0000 7fbe54d91640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800cef0 tx=0x7fbe4800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.160+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800d840 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.160+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800d9c0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.160+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800dd70 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.160+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5014d5f0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.160+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501ef470 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.161+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe501efee0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.161+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe4801e3b0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.162+0000 7fbe4d7fa640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 0x7fbe3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.162+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbe48089ec0 con 0x7fbe501591e0 2024-09-13T17:15:14.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.162+0000 7fbe4ffff640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 0x7fbe3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:14.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.163+0000 7fbe4ffff640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 0x7fbe3006d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe40006fd0 tx=0x7fbe40009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:14.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.167+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe480550d0 con 0x7fbe501591e0 2024-09-13T17:15:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:14.373+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbe500672a0 con 0x7fbe501591e0 2024-09-13T17:15:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.038+0000 7fbe4d7fa640 1 -- 172.21.15.5:0/1438607893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe4801a020 con 0x7fbe501591e0 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.040+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 msgr2=0x7fbe3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.040+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 0x7fbe3006d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe40006fd0 tx=0x7fbe40009060 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.040+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 msgr2=0x7fbe5014b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.040+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800cef0 tx=0x7fbe4800a710 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 shutdown_connections 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3006ac00 0x7fbe3006d0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe501591e0 0x7fbe5014b410 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500abe60 0x7fbe5014aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 --2- 172.21.15.5:0/1438607893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe5006da30 0x7fbe5014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 >> 172.21.15.5:0/1438607893 conn(0x7fbe500ce130 msgr2=0x7fbe500701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 shutdown_connections 2024-09-13T17:15:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.041+0000 7fbe567f4640 1 -- 172.21.15.5:0/1438607893 wait complete. 2024-09-13T17:15:15.056 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:15:15.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.163+0000 7f5612419640 1 Processor -- start 2024-09-13T17:15:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.163+0000 7f5612419640 1 -- start start 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 0x7f560c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 0x7f560c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c06eed0 0x7f560c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c160020 con 0x7f560c06eed0 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0b35f0 con 0x7f560c06eaf0 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f5612419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c156f50 con 0x7f560c0b1ac0 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f56109b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c06eed0 0x7f560c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f56109b6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f560c06eed0 0x7f560c06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53912/0 (socket says 172.21.15.5:53912) 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f56109b6640 1 -- 172.21.15.5:0/1585241255 learned_addr learned my addr 172.21.15.5:0/1585241255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f560bfff640 1 --2- 172.21.15.5:0/1585241255 >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 0x7f560c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.164+0000 7f560b7fe640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 0x7f560c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 -- 172.21.15.5:0/1585241255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 msgr2=0x7f560c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 0x7f560c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 -- 172.21.15.5:0/1585241255 >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 msgr2=0x7f560c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 --2- 172.21.15.5:0/1585241255 >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 0x7f560c0b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 -- 172.21.15.5:0/1585241255 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0b3f60 con 0x7f560c06eed0 2024-09-13T17:15:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f560bfff640 1 --2- 172.21.15.5:0/1585241255 >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 0x7f560c0b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f560b7fe640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 0x7f560c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f56109b6640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c06eed0 0x7f560c06aea0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f560c1570c0 tx=0x7f560402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcf8ce5ff1c40ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f560affd640 1 -- 172.21.15.5:0/1585241255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560402aea0 con 0x7f560c06eed0 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f560affd640 1 -- 172.21.15.5:0/1585241255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560402d050 con 0x7f560c06eed0 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.165+0000 7f560affd640 1 -- 172.21.15.5:0/1585241255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604031820 con 0x7f560c06eed0 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 -- 172.21.15.5:0/1585241255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c06eed0 msgr2=0x7f560c06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c06eed0 0x7f560c06aea0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f560c1570c0 tx=0x7f560402a680 comp rx=0 tx=0).stop 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 -- 172.21.15.5:0/1585241255 shutdown_connections 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c06eed0 0x7f560c06aea0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 --2- 172.21.15.5:0/1585241255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c0b1ac0 0x7f560c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 --2- 172.21.15.5:0/1585241255 >> v2:172.21.15.179:3300/0 conn(0x7f560c06eaf0 0x7f560c0b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 -- 172.21.15.5:0/1585241255 >> 172.21.15.5:0/1585241255 conn(0x7f560c070af0 msgr2=0x7f560c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 -- 172.21.15.5:0/1585241255 shutdown_connections 2024-09-13T17:15:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.166+0000 7f5612419640 1 -- 172.21.15.5:0/1585241255 wait complete. 2024-09-13T17:15:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.167+0000 7f5612419640 1 Processor -- start 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.167+0000 7f5612419640 1 -- start start 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c06eaf0 0x7f560c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c06eed0 0x7f560c0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c145cc0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c145080 con 0x7f560c06eaf0 2024-09-13T17:15:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f5612419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0ca8e0 con 0x7f560c06eed0 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f56109b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f56109b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53918/0 (socket says 172.21.15.5:53918) 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f56109b6640 1 -- 172.21.15.5:0/1567498114 learned_addr learned my addr 172.21.15.5:0/1567498114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f560bfff640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c06eaf0 0x7f560c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.168+0000 7f560b7fe640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c06eed0 0x7f560c0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 -- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c06eed0 msgr2=0x7f560c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c06eed0 0x7f560c0ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 -- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c06eaf0 msgr2=0x7f560c157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c06eaf0 0x7f560c157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 -- 172.21.15.5:0/1567498114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009b30 con 0x7f560c0b1ac0 2024-09-13T17:15:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f56109b6640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5604009f10 tx=0x7f5604004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560403d860 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560403d9e0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560403dd90 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c145320 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.169+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c1458e0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.170+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c0672e0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.171+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5604046400 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.171+0000 7f5608ff9640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 0x7f55f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.171+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f56040aa1e0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.172+0000 7f560bfff640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 0x7f55f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.172+0000 7f560bfff640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 0x7f55f806d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00ab60 tx=0x7f55fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.175+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f56040753c0 con 0x7f560c0b1ac0 2024-09-13T17:15:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.381+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f560c145e00 con 0x7f560c0b1ac0 2024-09-13T17:15:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.382+0000 7f5608ff9640 1 -- 172.21.15.5:0/1567498114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f560c145e00 con 0x7f560c0b1ac0 2024-09-13T17:15:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:15.385 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:15.036494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:15:15.385 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-09-13T17:15:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 msgr2=0x7f55f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 0x7f55f806d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00ab60 tx=0x7f55fc008040 comp rx=0 tx=0).stop 2024-09-13T17:15:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 msgr2=0x7f560c15a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5604009f10 tx=0x7f5604004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 shutdown_connections 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55f806ac00 0x7f55f806d0c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f560c0b1ac0 0x7f560c15a140 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f560c06eed0 0x7f560c0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 --2- 172.21.15.5:0/1567498114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f560c06eaf0 0x7f560c157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 >> 172.21.15.5:0/1567498114 conn(0x7f560c070af0 msgr2=0x7f560c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 shutdown_connections 2024-09-13T17:15:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.384+0000 7f5612419640 1 -- 172.21.15.5:0/1567498114 wait complete. 2024-09-13T17:15:15.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.496+0000 7f5a4cbaa640 1 Processor -- start 2024-09-13T17:15:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.496+0000 7f5a4cbaa640 1 -- start start 2024-09-13T17:15:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4cbaa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4806e090 0x7f5a480ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4cbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a480b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4cbaa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4806d410 con 0x7f5a4815a3e0 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4cbaa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4806e4d0 con 0x7f5a4806e090 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4cbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480aba30 con 0x7f5a480ab5a0 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4806e090 0x7f5a480ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4806e090 0x7f5a480ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53934/0 (socket says 172.21.15.5:53934) 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a4815a3e0 0x7f5a4806c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41016/0 (socket says 172.21.15.5:41016) 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 -- 172.21.15.5:0/2850836359 learned_addr learned my addr 172.21.15.5:0/2850836359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 -- 172.21.15.5:0/2850836359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 msgr2=0x7f5a480b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a46d9d640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a480b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a480b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a4559a640 1 -- 172.21.15.5:0/2850836359 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490443268 0 0) 0x7f5a4806d410 con 0x7f5a4815a3e0 2024-09-13T17:15:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 -- 172.21.15.5:0/2850836359 >> v1:172.21.15.5:6789/0 conn(0x7f5a4815a3e0 legacy=0x7f5a4806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.497+0000 7f5a45d9b640 1 -- 172.21.15.5:0/2850836359 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4806cb70 con 0x7f5a4806e090 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.498+0000 7f5a45d9b640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4806e090 0x7f5a480ab060 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009870 tx=0x7f5a3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5ee011ca16bd74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.498+0000 7f5a4559a640 1 -- 172.21.15.5:0/2850836359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c032440 con 0x7f5a4806e090 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.498+0000 7f5a4559a640 1 -- 172.21.15.5:0/2850836359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0325a0 con 0x7f5a4806e090 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.498+0000 7f5a4559a640 1 -- 172.21.15.5:0/2850836359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c032930 con 0x7f5a4806e090 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/2850836359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4806e090 msgr2=0x7f5a480ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4806e090 0x7f5a480ab060 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009870 tx=0x7f5a3c02a270 comp rx=0 tx=0).stop 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/2850836359 shutdown_connections 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a480b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/2850836359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4806e090 0x7f5a480ab060 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/2850836359 >> 172.21.15.5:0/2850836359 conn(0x7f5a480ce0d0 msgr2=0x7f5a480ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/2850836359 shutdown_connections 2024-09-13T17:15:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.499+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/2850836359 wait complete. 2024-09-13T17:15:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.500+0000 7f5a4cbaa640 1 Processor -- start 2024-09-13T17:15:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.500+0000 7f5a4cbaa640 1 -- start start 2024-09-13T17:15:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 0x7f5a4809bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a4809a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48099880 con 0x7f5a4815a3e0 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48099b60 con 0x7f5a4806e090 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a4cbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48099e40 con 0x7f5a480ab5a0 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53942/0 (socket says 172.21.15.5:53942) 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.501+0000 7f5a46d9d640 1 -- 172.21.15.5:0/1026121931 learned_addr learned my addr 172.21.15.5:0/1026121931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a45d9b640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a4809a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a4659c640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 0x7f5a4809bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 -- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 msgr2=0x7f5a4809a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a4809a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 -- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 msgr2=0x7f5a4809bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 0x7f5a4809bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 -- 172.21.15.5:0/1026121931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0094d0 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a4659c640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 0x7f5a4809bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a46d9d640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000cd70 tx=0x7f5a4000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40003b90 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a40003cf0 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4809a120 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40004240 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.502+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4809ae60 con 0x7f5a4815a3e0 2024-09-13T17:15:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.503+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4809a640 con 0x7f5a4815a3e0 2024-09-13T17:15:15.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.504+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a400043a0 con 0x7f5a4815a3e0 2024-09-13T17:15:15.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.504+0000 7f5a36ffd640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 0x7f5a2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.504+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5a40012070 con 0x7f5a4815a3e0 2024-09-13T17:15:15.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.504+0000 7f5a4659c640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 0x7f5a2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.505+0000 7f5a4659c640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 0x7f5a2806d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000f60 tx=0x7f5a38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.508+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a4809a640 con 0x7f5a4815a3e0 2024-09-13T17:15:15.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.680+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a4809a640 con 0x7f5a4815a3e0 2024-09-13T17:15:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.681+0000 7f5a36ffd640 1 -- 172.21.15.5:0/1026121931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f5a4809a640 con 0x7f5a4815a3e0 2024-09-13T17:15:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:15.683 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":54,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:14.026915+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 msgr2=0x7f5a2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 0x7f5a2806d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a38000f60 tx=0x7f5a38009040 comp rx=0 tx=0).stop 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 msgr2=0x7f5a481531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000cd70 tx=0x7f5a4000a660 comp rx=0 tx=0).stop 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 shutdown_connections 2024-09-13T17:15:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a2806ac00 0x7f5a2806d0c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4815a3e0 0x7f5a481531b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480ab5a0 0x7f5a4809a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 --2- 172.21.15.5:0/1026121931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a4806e090 0x7f5a4809bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 >> 172.21.15.5:0/1026121931 conn(0x7f5a480ce0d0 msgr2=0x7f5a480ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 shutdown_connections 2024-09-13T17:15:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.683+0000 7f5a4cbaa640 1 -- 172.21.15.5:0/1026121931 wait complete. 2024-09-13T17:15:15.696 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:15:15.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:15:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.799+0000 7f5014472640 1 Processor -- start 2024-09-13T17:15:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.799+0000 7f5014472640 1 -- start start 2024-09-13T17:15:15.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5014472640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f500c159290 0x7f500c159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5014472640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f500c159bb0 0x7f500c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5014472640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0b1580 con 0x7f500c0b1970 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5014472640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0b2ad0 con 0x7f500c159bb0 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5014472640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c06d9b0 con 0x7f500c159290 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5011a0d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f500c159bb0 0x7f500c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5012a0f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f500c0b1970 0x7f500c15c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41024/0 (socket says 172.21.15.5:41024) 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5012a0f640 1 -- 172.21.15.5:0/574457054 learned_addr learned my addr 172.21.15.5:0/574457054 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f501220e640 1 --2- 172.21.15.5:0/574457054 >> v2:172.21.15.179:3300/0 conn(0x7f500c159290 0x7f500c159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5011a0d640 1 -- 172.21.15.5:0/574457054 >> v2:172.21.15.179:3300/0 conn(0x7f500c159290 msgr2=0x7f500c159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5011a0d640 1 --2- 172.21.15.5:0/574457054 >> v2:172.21.15.179:3300/0 conn(0x7f500c159290 0x7f500c159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5011a0d640 1 -- 172.21.15.5:0/574457054 >> v1:172.21.15.5:6789/0 conn(0x7f500c0b1970 legacy=0x7f500c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.800+0000 7f5011a0d640 1 -- 172.21.15.5:0/574457054 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0b1ec0 con 0x7f500c159bb0 2024-09-13T17:15:15.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.801+0000 7f5011a0d640 1 --2- 172.21.15.5:0/574457054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c070a80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f500c06e570 tx=0x7f4ffc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af904b69964f8a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.801+0000 7f501120c640 1 -- 172.21.15.5:0/574457054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc032440 con 0x7f500c159bb0 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.801+0000 7f501120c640 1 -- 172.21.15.5:0/574457054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0325a0 con 0x7f500c159bb0 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.801+0000 7f501120c640 1 -- 172.21.15.5:0/574457054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc032930 con 0x7f500c159bb0 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 -- 172.21.15.5:0/574457054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 msgr2=0x7f500c070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 --2- 172.21.15.5:0/574457054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c070a80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f500c06e570 tx=0x7f4ffc02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 -- 172.21.15.5:0/574457054 shutdown_connections 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 --2- 172.21.15.5:0/574457054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c070a80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 --2- 172.21.15.5:0/574457054 >> v2:172.21.15.179:3300/0 conn(0x7f500c159290 0x7f500c159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 -- 172.21.15.5:0/574457054 >> 172.21.15.5:0/574457054 conn(0x7f500c0ce0d0 msgr2=0x7f500c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 -- 172.21.15.5:0/574457054 shutdown_connections 2024-09-13T17:15:15.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.802+0000 7f5014472640 1 -- 172.21.15.5:0/574457054 wait complete. 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.803+0000 7f5014472640 1 Processor -- start 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.803+0000 7f5014472640 1 -- start start 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 0x7f500c1e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c159290 0x7f500c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c142960 con 0x7f500c159bb0 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1e2b90 con 0x7f500c0b1970 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5014472640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1e1f80 con 0x7f500c159290 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53954/0 (socket says 172.21.15.5:53954) 2024-09-13T17:15:15.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 -- 172.21.15.5:0/1882501733 learned_addr learned my addr 172.21.15.5:0/1882501733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f501220e640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 0x7f500c1e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5011a0d640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c159290 0x7f500c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 -- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c159290 msgr2=0x7f500c0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c159290 0x7f500c0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 -- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 msgr2=0x7f500c1e19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 0x7f500c1e19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 -- 172.21.15.5:0/1882501733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009400 con 0x7f500c159bb0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f501220e640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 0x7f500c1e19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.804+0000 7f5012a0f640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f500400ca80 tx=0x7f500400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.805+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400ac30 con 0x7f500c159bb0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.805+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500400ad90 con 0x7f500c159bb0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.805+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c1e2260 con 0x7f500c159bb0 2024-09-13T17:15:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.805+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004012600 con 0x7f500c159bb0 2024-09-13T17:15:15.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.805+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c1e2820 con 0x7f500c159bb0 2024-09-13T17:15:15.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.806+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c0672a0 con 0x7f500c159bb0 2024-09-13T17:15:15.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.806+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5004007070 con 0x7f500c159bb0 2024-09-13T17:15:15.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.807+0000 7f5002ffd640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:15.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.807+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5004089270 con 0x7f500c159bb0 2024-09-13T17:15:15.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.807+0000 7f501220e640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:15.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.808+0000 7f501220e640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5008006fd0 tx=0x7f5008008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:15.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.811+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50040543c0 con 0x7f500c159bb0 2024-09-13T17:15:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.976+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f500c0b2760 con 0x7f4ff006ac00 2024-09-13T17:15:15.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.984+0000 7f5002ffd640 1 -- 172.21.15.5:0/1882501733 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278725 (secure 0 0 0) 0x7f500800f860 con 0x7f4ff006ac00 2024-09-13T17:15:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 msgr2=0x7f4ff006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5008006fd0 tx=0x7f5008008040 comp rx=0 tx=0).stop 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 msgr2=0x7f500c142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f500400ca80 tx=0x7f500400cf40 comp rx=0 tx=0).stop 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 shutdown_connections 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c159bb0 0x7f500c142420 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c159290 0x7f500c0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 --2- 172.21.15.5:0/1882501733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c0b1970 0x7f500c1e19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 >> 172.21.15.5:0/1882501733 conn(0x7f500c0ce0d0 msgr2=0x7f500c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 shutdown_connections 2024-09-13T17:15:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:15.987+0000 7f5014472640 1 -- 172.21.15.5:0/1882501733 wait complete. 2024-09-13T17:15:16.000 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T17:15:15.286104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238376,"kb_used_data":5812,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736344,"statfs":{"total":773094113280,"available":772850016256,"internally_reserved":0,"allocated":5951488,"data_stored":3246765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662536+0000","last_change":"2024-09-13T17:15:11.662536+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662536+0000","last_undegraded":"2024-09-13T17:15:11.662536+0000","last_fullsized":"2024-09-13T17:15:11.662536+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661321+0000","last_change":"2024-09-13T17:15:11.661321+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661321+0000","last_undegraded":"2024-09-13T17:15:11.661321+0000","last_fullsized":"2024-09-13T17:15:11.661321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659155+0000","last_change":"2024-09-13T17:15:11.659155+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659155+0000","last_undegraded":"2024-09-13T17:15:11.659155+0000","last_fullsized":"2024-09-13T17:15:11.659155+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662964+0000","last_change":"2024-09-13T17:15:11.662964+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662964+0000","last_undegraded":"2024-09-13T17:15:11.662964+0000","last_fullsized":"2024-09-13T17:15:11.662964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658196+0000","last_change":"2024-09-13T17:15:11.658196+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658196+0000","last_undegraded":"2024-09-13T17:15:11.658196+0000","last_fullsized":"2024-09-13T17:15:11.658196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661794+0000","last_change":"2024-09-13T17:15:11.661794+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661794+0000","last_undegraded":"2024-09-13T17:15:11.661794+0000","last_fullsized":"2024-09-13T17:15:11.661794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662341+0000","last_change":"2024-09-13T17:15:11.662341+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662341+0000","last_undegraded":"2024-09-13T17:15:11.662341+0000","last_fullsized":"2024-09-13T17:15:11.662341+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661125+0000","last_change":"2024-09-13T17:15:11.661125+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661125+0000","last_undegraded":"2024-09-13T17:15:11.661125+0000","last_fullsized":"2024-09-13T17:15:11.661125+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658220+0000","last_change":"2024-09-13T17:15:11.658220+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658220+0000","last_undegraded":"2024-09-13T17:15:11.658220+0000","last_fullsized":"2024-09-13T17:15:11.658220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661700+0000","last_change":"2024-09-13T17:15:11.661700+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661700+0000","last_undegraded":"2024-09-13T17:15:11.661700+0000","last_fullsized":"2024-09-13T17:15:11.661700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661765+0000","last_change":"2024-09-13T17:15:11.661765+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661765+0000","last_undegraded":"2024-09-13T17:15:11.661765+0000","last_fullsized":"2024-09-13T17:15:11.661765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662098+0000","last_change":"2024-09-13T17:15:11.662098+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662098+0000","last_undegraded":"2024-09-13T17:15:11.662098+0000","last_fullsized":"2024-09-13T17:15:11.662098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662400+0000","last_change":"2024-09-13T17:15:11.662400+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662400+0000","last_undegraded":"2024-09-13T17:15:11.662400+0000","last_fullsized":"2024-09-13T17:15:11.662400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661184+0000","last_change":"2024-09-13T17:15:11.661184+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661184+0000","last_undegraded":"2024-09-13T17:15:11.661184+0000","last_fullsized":"2024-09-13T17:15:11.661184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662127+0000","last_change":"2024-09-13T17:15:11.662127+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662127+0000","last_undegraded":"2024-09-13T17:15:11.662127+0000","last_fullsized":"2024-09-13T17:15:11.662127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658087+0000","last_change":"2024-09-13T17:15:11.658087+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658087+0000","last_undegraded":"2024-09-13T17:15:11.658087+0000","last_fullsized":"2024-09-13T17:15:11.658087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662197+0000","last_change":"2024-09-13T17:15:11.662197+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662197+0000","last_undegraded":"2024-09-13T17:15:11.662197+0000","last_fullsized":"2024-09-13T17:15:11.662197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661917+0000","last_change":"2024-09-13T17:15:11.661917+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661917+0000","last_undegraded":"2024-09-13T17:15:11.661917+0000","last_fullsized":"2024-09-13T17:15:11.661917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661180+0000","last_change":"2024-09-13T17:15:11.661180+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661180+0000","last_undegraded":"2024-09-13T17:15:11.661180+0000","last_fullsized":"2024-09-13T17:15:11.661180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662006+0000","last_change":"2024-09-13T17:15:11.662006+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662006+0000","last_undegraded":"2024-09-13T17:15:11.662006+0000","last_fullsized":"2024-09-13T17:15:11.662006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662247+0000","last_change":"2024-09-13T17:15:11.662247+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662247+0000","last_undegraded":"2024-09-13T17:15:11.662247+0000","last_fullsized":"2024-09-13T17:15:11.662247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.657837+0000","last_change":"2024-09-13T17:15:11.657837+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.657837+0000","last_undegraded":"2024-09-13T17:15:11.657837+0000","last_fullsized":"2024-09-13T17:15:11.657837+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661921+0000","last_change":"2024-09-13T17:15:11.661921+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661921+0000","last_undegraded":"2024-09-13T17:15:11.661921+0000","last_fullsized":"2024-09-13T17:15:11.661921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661120+0000","last_change":"2024-09-13T17:15:11.661120+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661120+0000","last_undegraded":"2024-09-13T17:15:11.661120+0000","last_fullsized":"2024-09-13T17:15:11.661120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662411+0000","last_change":"2024-09-13T17:15:11.662411+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662411+0000","last_undegraded":"2024-09-13T17:15:11.662411+0000","last_fullsized":"2024-09-13T17:15:11.662411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662507+0000","last_change":"2024-09-13T17:15:11.662507+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662507+0000","last_undegraded":"2024-09-13T17:15:11.662507+0000","last_fullsized":"2024-09-13T17:15:11.662507+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661314+0000","last_change":"2024-09-13T17:15:11.661314+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661314+0000","last_undegraded":"2024-09-13T17:15:11.661314+0000","last_fullsized":"2024-09-13T17:15:11.661314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658137+0000","last_change":"2024-09-13T17:15:11.658137+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658137+0000","last_undegraded":"2024-09-13T17:15:11.658137+0000","last_fullsized":"2024-09-13T17:15:11.658137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659130+0000","last_change":"2024-09-13T17:15:11.659130+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659130+0000","last_undegraded":"2024-09-13T17:15:11.659130+0000","last_fullsized":"2024-09-13T17:15:11.659130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662208+0000","last_change":"2024-09-13T17:15:11.662208+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662208+0000","last_undegraded":"2024-09-13T17:15:11.662208+0000","last_fullsized":"2024-09-13T17:15:11.662208+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T17:15:11.476721+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:15:11.476721+0000","last_peered":"2024-09-13T17:15:11.476721+0000","last_clean":"2024-09-13T17:15:11.476721+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:15:11.476721+0000","last_undegraded":"2024-09-13T17:15:11.476721+0000","last_fullsized":"2024-09-13T17:15:11.476721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.28699999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.372,"15min":0.372},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65500000000000003,"5min":0.752,"15min":0.752},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.88,"15min":0.88},"last":0.501},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.443,"15min":0.432},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.46300000000000002},"min":{"1min":0.35699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.034,"15min":1.034},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.43099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.67000000000000004,"5min":1.458,"15min":1.458},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.434,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52800000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54200000000000004,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.44},"min":{"1min":0.312,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.73799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":1.226,"15min":1.226},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.379,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.378,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.504},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.503,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48899999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.871,"15min":0.871},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77100000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56200000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.53300000000000003,"5min":1.159,"15min":1.159},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52400000000000002,"5min":1.081,"15min":1.081},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.747,"5min":1.286,"15min":1.286},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80200000000000005,"5min":1.046,"15min":1.046},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.254,"15min":1.254},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56699999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.21299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.307}]},{"osd":4,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.998,"15min":0.998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.47099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:15:16.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:15:16.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.139+0000 7ff1b39fb640 1 Processor -- start 2024-09-13T17:15:16.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.139+0000 7ff1b39fb640 1 -- start start 2024-09-13T17:15:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b39fb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1ac06e090 0x7ff1ac0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b39fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b39fb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0ab9f0 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b39fb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac06e4d0 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b39fb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac06d410 con 0x7ff1ac06e090 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b1f98640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b1f98640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53962/0 (socket says 172.21.15.5:53962) 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.140+0000 7ff1b1f98640 1 -- 172.21.15.5:0/2646811073 learned_addr learned my addr 172.21.15.5:0/2646811073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b0f96640 1 --2- 172.21.15.5:0/2646811073 >> v2:172.21.15.179:3300/0 conn(0x7ff1ac06e090 0x7ff1ac0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b1f98640 1 -- 172.21.15.5:0/2646811073 >> v2:172.21.15.179:3300/0 conn(0x7ff1ac06e090 msgr2=0x7ff1ac0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b1f98640 1 --2- 172.21.15.5:0/2646811073 >> v2:172.21.15.179:3300/0 conn(0x7ff1ac06e090 0x7ff1ac0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b1f98640 1 -- 172.21.15.5:0/2646811073 >> v1:172.21.15.179:6789/0 conn(0x7ff1ac15a3e0 legacy=0x7ff1ac06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b1f98640 1 -- 172.21.15.5:0/2646811073 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac06cb70 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.141+0000 7ff1b1f98640 1 --2- 172.21.15.5:0/2646811073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0b3190 tx=0x7ff1a402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98151819c170ad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1a3fff640 1 -- 172.21.15.5:0/2646811073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031600 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1a3fff640 1 -- 172.21.15.5:0/2646811073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a402d050 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1a3fff640 1 -- 172.21.15.5:0/2646811073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031980 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 -- 172.21.15.5:0/2646811073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac0ab5a0 msgr2=0x7ff1ac0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/2646811073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0b3190 tx=0x7ff1a402a6f0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 -- 172.21.15.5:0/2646811073 shutdown_connections 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/2646811073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac0b1640 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/2646811073 >> v2:172.21.15.179:3300/0 conn(0x7ff1ac06e090 0x7ff1ac0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 -- 172.21.15.5:0/2646811073 >> 172.21.15.5:0/2646811073 conn(0x7ff1ac0ce0d0 msgr2=0x7ff1ac0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 -- 172.21.15.5:0/2646811073 shutdown_connections 2024-09-13T17:15:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.142+0000 7ff1b39fb640 1 -- 172.21.15.5:0/2646811073 wait complete. 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.143+0000 7ff1b39fb640 1 Processor -- start 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.143+0000 7ff1b39fb640 1 -- start start 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1ac06e090 0x7ff1ac1f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1f10b0 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1e4c90 con 0x7ff1ac0ab5a0 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b39fb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac149260 con 0x7ff1ac06e090 2024-09-13T17:15:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b1f98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b1f98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53970/0 (socket says 172.21.15.5:53970) 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b1f98640 1 -- 172.21.15.5:0/150140633 learned_addr learned my addr 172.21.15.5:0/150140633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b0f96640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.144+0000 7ff1b1797640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1ac06e090 0x7ff1ac1f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 -- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1ac06e090 msgr2=0x7ff1ac1f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1ac06e090 0x7ff1ac1f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 -- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1ac0ab5a0 msgr2=0x7ff1ac15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 -- 172.21.15.5:0/150140633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4009b30 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b1f98640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4034040 tx=0x7ff1a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a403d860 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a403d9e0 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac1f3b10 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a403dd90 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.145+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac1f43b0 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.146+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac1e4e00 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.147+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff1a403b400 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.147+0000 7ff1a1ffb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 0x7ff19006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.147+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff1a40aa120 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.148+0000 7ff1b1797640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 0x7ff19006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.148+0000 7ff1b1797640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 0x7ff19006d0f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006fd0 tx=0x7ff1a8009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.152+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff1a4075260 con 0x7ff1ac15a3e0 2024-09-13T17:15:16.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.319+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1ac1f3f60 con 0x7ff19006ac30 2024-09-13T17:15:16.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.326+0000 7ff1a1ffb640 1 -- 172.21.15.5:0/150140633 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278725 (secure 0 0 0) 0x7ff1ac1f3f60 con 0x7ff19006ac30 2024-09-13T17:15:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:16.333 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.329+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 msgr2=0x7ff19006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 0x7ff19006d0f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8006fd0 tx=0x7ff1a8009060 comp rx=0 tx=0).stop 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 msgr2=0x7ff1ac1ef890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4034040 tx=0x7ff1a4004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 shutdown_connections 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff19006ac30 0x7ff19006d0f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1ac15a3e0 0x7ff1ac1ef890 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1ac0ab5a0 0x7ff1ac15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 --2- 172.21.15.5:0/150140633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1ac06e090 0x7ff1ac1f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 >> 172.21.15.5:0/150140633 conn(0x7ff1ac0ce0d0 msgr2=0x7ff1ac0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:16.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 shutdown_connections 2024-09-13T17:15:16.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.330+0000 7ff1b39fb640 1 -- 172.21.15.5:0/150140633 wait complete. 2024-09-13T17:15:16.342 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T17:15:15.286104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238376,"kb_used_data":5812,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736344,"statfs":{"total":773094113280,"available":772850016256,"internally_reserved":0,"allocated":5951488,"data_stored":3246765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662536+0000","last_change":"2024-09-13T17:15:11.662536+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662536+0000","last_undegraded":"2024-09-13T17:15:11.662536+0000","last_fullsized":"2024-09-13T17:15:11.662536+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661321+0000","last_change":"2024-09-13T17:15:11.661321+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661321+0000","last_undegraded":"2024-09-13T17:15:11.661321+0000","last_fullsized":"2024-09-13T17:15:11.661321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659155+0000","last_change":"2024-09-13T17:15:11.659155+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659155+0000","last_undegraded":"2024-09-13T17:15:11.659155+0000","last_fullsized":"2024-09-13T17:15:11.659155+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662964+0000","last_change":"2024-09-13T17:15:11.662964+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662964+0000","last_undegraded":"2024-09-13T17:15:11.662964+0000","last_fullsized":"2024-09-13T17:15:11.662964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658196+0000","last_change":"2024-09-13T17:15:11.658196+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658196+0000","last_undegraded":"2024-09-13T17:15:11.658196+0000","last_fullsized":"2024-09-13T17:15:11.658196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661794+0000","last_change":"2024-09-13T17:15:11.661794+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661794+0000","last_undegraded":"2024-09-13T17:15:11.661794+0000","last_fullsized":"2024-09-13T17:15:11.661794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662341+0000","last_change":"2024-09-13T17:15:11.662341+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662341+0000","last_undegraded":"2024-09-13T17:15:11.662341+0000","last_fullsized":"2024-09-13T17:15:11.662341+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661125+0000","last_change":"2024-09-13T17:15:11.661125+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661125+0000","last_undegraded":"2024-09-13T17:15:11.661125+0000","last_fullsized":"2024-09-13T17:15:11.661125+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658220+0000","last_change":"2024-09-13T17:15:11.658220+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658220+0000","last_undegraded":"2024-09-13T17:15:11.658220+0000","last_fullsized":"2024-09-13T17:15:11.658220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661700+0000","last_change":"2024-09-13T17:15:11.661700+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661700+0000","last_undegraded":"2024-09-13T17:15:11.661700+0000","last_fullsized":"2024-09-13T17:15:11.661700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661765+0000","last_change":"2024-09-13T17:15:11.661765+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661765+0000","last_undegraded":"2024-09-13T17:15:11.661765+0000","last_fullsized":"2024-09-13T17:15:11.661765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662098+0000","last_change":"2024-09-13T17:15:11.662098+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662098+0000","last_undegraded":"2024-09-13T17:15:11.662098+0000","last_fullsized":"2024-09-13T17:15:11.662098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662400+0000","last_change":"2024-09-13T17:15:11.662400+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662400+0000","last_undegraded":"2024-09-13T17:15:11.662400+0000","last_fullsized":"2024-09-13T17:15:11.662400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661184+0000","last_change":"2024-09-13T17:15:11.661184+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661184+0000","last_undegraded":"2024-09-13T17:15:11.661184+0000","last_fullsized":"2024-09-13T17:15:11.661184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662127+0000","last_change":"2024-09-13T17:15:11.662127+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662127+0000","last_undegraded":"2024-09-13T17:15:11.662127+0000","last_fullsized":"2024-09-13T17:15:11.662127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658087+0000","last_change":"2024-09-13T17:15:11.658087+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658087+0000","last_undegraded":"2024-09-13T17:15:11.658087+0000","last_fullsized":"2024-09-13T17:15:11.658087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662197+0000","last_change":"2024-09-13T17:15:11.662197+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662197+0000","last_undegraded":"2024-09-13T17:15:11.662197+0000","last_fullsized":"2024-09-13T17:15:11.662197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661917+0000","last_change":"2024-09-13T17:15:11.661917+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661917+0000","last_undegraded":"2024-09-13T17:15:11.661917+0000","last_fullsized":"2024-09-13T17:15:11.661917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661180+0000","last_change":"2024-09-13T17:15:11.661180+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661180+0000","last_undegraded":"2024-09-13T17:15:11.661180+0000","last_fullsized":"2024-09-13T17:15:11.661180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662006+0000","last_change":"2024-09-13T17:15:11.662006+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662006+0000","last_undegraded":"2024-09-13T17:15:11.662006+0000","last_fullsized":"2024-09-13T17:15:11.662006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662247+0000","last_change":"2024-09-13T17:15:11.662247+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662247+0000","last_undegraded":"2024-09-13T17:15:11.662247+0000","last_fullsized":"2024-09-13T17:15:11.662247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.657837+0000","last_change":"2024-09-13T17:15:11.657837+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.657837+0000","last_undegraded":"2024-09-13T17:15:11.657837+0000","last_fullsized":"2024-09-13T17:15:11.657837+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661921+0000","last_change":"2024-09-13T17:15:11.661921+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661921+0000","last_undegraded":"2024-09-13T17:15:11.661921+0000","last_fullsized":"2024-09-13T17:15:11.661921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661120+0000","last_change":"2024-09-13T17:15:11.661120+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661120+0000","last_undegraded":"2024-09-13T17:15:11.661120+0000","last_fullsized":"2024-09-13T17:15:11.661120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662411+0000","last_change":"2024-09-13T17:15:11.662411+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662411+0000","last_undegraded":"2024-09-13T17:15:11.662411+0000","last_fullsized":"2024-09-13T17:15:11.662411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662507+0000","last_change":"2024-09-13T17:15:11.662507+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662507+0000","last_undegraded":"2024-09-13T17:15:11.662507+0000","last_fullsized":"2024-09-13T17:15:11.662507+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661314+0000","last_change":"2024-09-13T17:15:11.661314+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661314+0000","last_undegraded":"2024-09-13T17:15:11.661314+0000","last_fullsized":"2024-09-13T17:15:11.661314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658137+0000","last_change":"2024-09-13T17:15:11.658137+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658137+0000","last_undegraded":"2024-09-13T17:15:11.658137+0000","last_fullsized":"2024-09-13T17:15:11.658137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659130+0000","last_change":"2024-09-13T17:15:11.659130+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659130+0000","last_undegraded":"2024-09-13T17:15:11.659130+0000","last_fullsized":"2024-09-13T17:15:11.659130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662208+0000","last_change":"2024-09-13T17:15:11.662208+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662208+0000","last_undegraded":"2024-09-13T17:15:11.662208+0000","last_fullsized":"2024-09-13T17:15:11.662208+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T17:15:11.476721+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:15:11.476721+0000","last_peered":"2024-09-13T17:15:11.476721+0000","last_clean":"2024-09-13T17:15:11.476721+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:15:11.476721+0000","last_undegraded":"2024-09-13T17:15:11.476721+0000","last_fullsized":"2024-09-13T17:15:11.476721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.28699999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.372,"15min":0.372},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65500000000000003,"5min":0.752,"15min":0.752},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.88,"15min":0.88},"last":0.501},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.443,"15min":0.432},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.46300000000000002},"min":{"1min":0.35699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.034,"15min":1.034},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.43099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.67000000000000004,"5min":1.458,"15min":1.458},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.434,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52800000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54200000000000004,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.44},"min":{"1min":0.312,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.73799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":1.226,"15min":1.226},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.379,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.378,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.504},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.503,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48899999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.871,"15min":0.871},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77100000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56200000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.53300000000000003,"5min":1.159,"15min":1.159},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52400000000000002,"5min":1.081,"15min":1.081},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.747,"5min":1.286,"15min":1.286},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80200000000000005,"5min":1.046,"15min":1.046},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.254,"15min":1.254},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56699999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.21299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.307}]},{"osd":4,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.998,"15min":0.998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.47099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:15:16.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:15:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.483+0000 7ff53a0b1640 1 Processor -- start 2024-09-13T17:15:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.483+0000 7ff53a0b1640 1 -- start start 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff53a0b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff53415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff53a0b1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340b2390 con 0x7ff53406e1c0 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff53a0b1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340b1780 con 0x7ff534156f40 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff53a0b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b1a60 con 0x7ff5340aced0 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff532ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff53406e1c0 0x7ff534160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41030/0 (socket says 172.21.15.5:41030) 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff532ffd640 1 -- 172.21.15.5:0/2391977644 learned_addr learned my addr 172.21.15.5:0/2391977644 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff533fff640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff53415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701112277 0 0) 0x7ff5340b2390 con 0x7ff53406e1c0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c003520 con 0x7ff53406e1c0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032010030 0 0) 0x7ff51c003520 con 0x7ff53406e1c0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 msgr2=0x7ff53415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff53415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 >> v1:172.21.15.179:6789/0 conn(0x7ff534156f40 legacy=0x7ff53406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340b1d40 con 0x7ff53406e1c0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.484+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff528001670 con 0x7ff53406e1c0 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 >> v1:172.21.15.5:6789/0 conn(0x7ff53406e1c0 legacy=0x7ff534160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff51c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff51c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51c004d00 0x7ff51c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b1a60 con 0x7ff51c0039a0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c00ba30 con 0x7ff51c004d00 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c00de00 con 0x7ff5340aced0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff51c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff532ffd640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff51c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff533fff640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51c004d00 0x7ff51c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 -- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 msgr2=0x7ff51c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5340aced0 0x7ff51c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 -- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51c004d00 msgr2=0x7ff51c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff51c004d00 0x7ff51c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.485+0000 7ff5337fe640 1 -- 172.21.15.5:0/2391977644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c003520 con 0x7ff51c0039a0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff51c003dc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff524001720 tx=0x7ff51c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2935b64066061dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240052d0 con 0x7ff51c0039a0 2024-09-13T17:15:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524005430 con 0x7ff51c0039a0 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff5327fc640 1 -- 172.21.15.5:0/2391977644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52402abc0 con 0x7ff51c0039a0 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2391977644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 msgr2=0x7ff51c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2391977644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff51c003dc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff524001720 tx=0x7ff51c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff533fff640 1 -- 172.21.15.5:0/2391977644 reap_dead start 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2391977644 shutdown_connections 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2391977644 >> 172.21.15.5:0/2391977644 conn(0x7ff5340ce0d0 msgr2=0x7ff5340ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2391977644 shutdown_connections 2024-09-13T17:15:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.486+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2391977644 wait complete. 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.488+0000 7ff53a0b1640 1 Processor -- start 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.488+0000 7ff53a0b1640 1 -- start start 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.488+0000 7ff53a0b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.488+0000 7ff53a0b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534150a70 0x7ff534152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5340adbf0 0x7ff5340ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534151cb0 con 0x7ff51c0039a0 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534151030 con 0x7ff5340adbf0 2024-09-13T17:15:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff534151310 con 0x7ff534150a70 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54002/0 (socket says 172.21.15.5:54002) 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 -- 172.21.15.5:0/2241665098 learned_addr learned my addr 172.21.15.5:0/2241665098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff532ffd640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534150a70 0x7ff534152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff533fff640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5340adbf0 0x7ff5340ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 -- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534150a70 msgr2=0x7ff534152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534150a70 0x7ff534152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 -- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5340adbf0 msgr2=0x7ff5340ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5340adbf0 0x7ff5340ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 -- 172.21.15.5:0/2241665098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5341515f0 con 0x7ff51c0039a0 2024-09-13T17:15:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff5337fe640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a4a0 tx=0x7ff524001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524007a30 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524007250 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5341518d0 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240075e0 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.489+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5341520d0 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.490+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340672a0 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.491+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5240067d0 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.491+0000 7ff51bfff640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 0x7ff52006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.491+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff5240a9540 con 0x7ff51c0039a0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.492+0000 7ff532ffd640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 0x7ff52006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.492+0000 7ff532ffd640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 0x7ff52006d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff534155990 tx=0x7ff528000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.496+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff524074670 con 0x7ff51c0039a0 2024-09-13T17:15:16.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.663+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5340672a0 con 0x7ff52006ac00 2024-09-13T17:15:16.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.671+0000 7ff51bfff640 1 -- 172.21.15.5:0/2241665098 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278725 (secure 0 0 0) 0x7ff5340672a0 con 0x7ff52006ac00 2024-09-13T17:15:16.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:16.677 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 msgr2=0x7ff52006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 0x7ff52006d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff534155990 tx=0x7ff528000ed0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 msgr2=0x7ff5340aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a4a0 tx=0x7ff524001120 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 shutdown_connections 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5340adbf0 0x7ff5340ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff534150a70 0x7ff534152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff52006ac00 0x7ff52006d0c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 --2- 172.21.15.5:0/2241665098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff51c0039a0 0x7ff5340aefc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 >> 172.21.15.5:0/2241665098 conn(0x7ff5340ce0d0 msgr2=0x7ff53415b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 shutdown_connections 2024-09-13T17:15:16.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.674+0000 7ff53a0b1640 1 -- 172.21.15.5:0/2241665098 wait complete. 2024-09-13T17:15:16.687 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-13T17:15:15.286104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238376,"kb_used_data":5812,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736344,"statfs":{"total":773094113280,"available":772850016256,"internally_reserved":0,"allocated":5951488,"data_stored":3246765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662536+0000","last_change":"2024-09-13T17:15:11.662536+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662536+0000","last_undegraded":"2024-09-13T17:15:11.662536+0000","last_fullsized":"2024-09-13T17:15:11.662536+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661321+0000","last_change":"2024-09-13T17:15:11.661321+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661321+0000","last_undegraded":"2024-09-13T17:15:11.661321+0000","last_fullsized":"2024-09-13T17:15:11.661321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659155+0000","last_change":"2024-09-13T17:15:11.659155+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659155+0000","last_undegraded":"2024-09-13T17:15:11.659155+0000","last_fullsized":"2024-09-13T17:15:11.659155+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662964+0000","last_change":"2024-09-13T17:15:11.662964+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662964+0000","last_undegraded":"2024-09-13T17:15:11.662964+0000","last_fullsized":"2024-09-13T17:15:11.662964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658196+0000","last_change":"2024-09-13T17:15:11.658196+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658196+0000","last_undegraded":"2024-09-13T17:15:11.658196+0000","last_fullsized":"2024-09-13T17:15:11.658196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661794+0000","last_change":"2024-09-13T17:15:11.661794+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661794+0000","last_undegraded":"2024-09-13T17:15:11.661794+0000","last_fullsized":"2024-09-13T17:15:11.661794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662341+0000","last_change":"2024-09-13T17:15:11.662341+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662341+0000","last_undegraded":"2024-09-13T17:15:11.662341+0000","last_fullsized":"2024-09-13T17:15:11.662341+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661125+0000","last_change":"2024-09-13T17:15:11.661125+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661125+0000","last_undegraded":"2024-09-13T17:15:11.661125+0000","last_fullsized":"2024-09-13T17:15:11.661125+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658220+0000","last_change":"2024-09-13T17:15:11.658220+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658220+0000","last_undegraded":"2024-09-13T17:15:11.658220+0000","last_fullsized":"2024-09-13T17:15:11.658220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661700+0000","last_change":"2024-09-13T17:15:11.661700+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661700+0000","last_undegraded":"2024-09-13T17:15:11.661700+0000","last_fullsized":"2024-09-13T17:15:11.661700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661765+0000","last_change":"2024-09-13T17:15:11.661765+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661765+0000","last_undegraded":"2024-09-13T17:15:11.661765+0000","last_fullsized":"2024-09-13T17:15:11.661765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662098+0000","last_change":"2024-09-13T17:15:11.662098+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662098+0000","last_undegraded":"2024-09-13T17:15:11.662098+0000","last_fullsized":"2024-09-13T17:15:11.662098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662400+0000","last_change":"2024-09-13T17:15:11.662400+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662400+0000","last_undegraded":"2024-09-13T17:15:11.662400+0000","last_fullsized":"2024-09-13T17:15:11.662400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661184+0000","last_change":"2024-09-13T17:15:11.661184+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661184+0000","last_undegraded":"2024-09-13T17:15:11.661184+0000","last_fullsized":"2024-09-13T17:15:11.661184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662127+0000","last_change":"2024-09-13T17:15:11.662127+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662127+0000","last_undegraded":"2024-09-13T17:15:11.662127+0000","last_fullsized":"2024-09-13T17:15:11.662127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658087+0000","last_change":"2024-09-13T17:15:11.658087+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658087+0000","last_undegraded":"2024-09-13T17:15:11.658087+0000","last_fullsized":"2024-09-13T17:15:11.658087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662197+0000","last_change":"2024-09-13T17:15:11.662197+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662197+0000","last_undegraded":"2024-09-13T17:15:11.662197+0000","last_fullsized":"2024-09-13T17:15:11.662197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661917+0000","last_change":"2024-09-13T17:15:11.661917+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661917+0000","last_undegraded":"2024-09-13T17:15:11.661917+0000","last_fullsized":"2024-09-13T17:15:11.661917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661180+0000","last_change":"2024-09-13T17:15:11.661180+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661180+0000","last_undegraded":"2024-09-13T17:15:11.661180+0000","last_fullsized":"2024-09-13T17:15:11.661180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662006+0000","last_change":"2024-09-13T17:15:11.662006+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662006+0000","last_undegraded":"2024-09-13T17:15:11.662006+0000","last_fullsized":"2024-09-13T17:15:11.662006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662247+0000","last_change":"2024-09-13T17:15:11.662247+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662247+0000","last_undegraded":"2024-09-13T17:15:11.662247+0000","last_fullsized":"2024-09-13T17:15:11.662247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.657837+0000","last_change":"2024-09-13T17:15:11.657837+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.657837+0000","last_undegraded":"2024-09-13T17:15:11.657837+0000","last_fullsized":"2024-09-13T17:15:11.657837+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661921+0000","last_change":"2024-09-13T17:15:11.661921+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661921+0000","last_undegraded":"2024-09-13T17:15:11.661921+0000","last_fullsized":"2024-09-13T17:15:11.661921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661120+0000","last_change":"2024-09-13T17:15:11.661120+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661120+0000","last_undegraded":"2024-09-13T17:15:11.661120+0000","last_fullsized":"2024-09-13T17:15:11.661120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662411+0000","last_change":"2024-09-13T17:15:11.662411+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662411+0000","last_undegraded":"2024-09-13T17:15:11.662411+0000","last_fullsized":"2024-09-13T17:15:11.662411+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662507+0000","last_change":"2024-09-13T17:15:11.662507+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662507+0000","last_undegraded":"2024-09-13T17:15:11.662507+0000","last_fullsized":"2024-09-13T17:15:11.662507+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661314+0000","last_change":"2024-09-13T17:15:11.661314+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661314+0000","last_undegraded":"2024-09-13T17:15:11.661314+0000","last_fullsized":"2024-09-13T17:15:11.661314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658137+0000","last_change":"2024-09-13T17:15:11.658137+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658137+0000","last_undegraded":"2024-09-13T17:15:11.658137+0000","last_fullsized":"2024-09-13T17:15:11.658137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.659130+0000","last_change":"2024-09-13T17:15:11.659130+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.659130+0000","last_undegraded":"2024-09-13T17:15:11.659130+0000","last_fullsized":"2024-09-13T17:15:11.659130+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662208+0000","last_change":"2024-09-13T17:15:11.662208+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662208+0000","last_undegraded":"2024-09-13T17:15:11.662208+0000","last_fullsized":"2024-09-13T17:15:11.662208+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T17:15:11.476721+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:15:11.476721+0000","last_peered":"2024-09-13T17:15:11.476721+0000","last_clean":"2024-09-13T17:15:11.476721+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:15:11.476721+0000","last_undegraded":"2024-09-13T17:15:11.476721+0000","last_fullsized":"2024-09-13T17:15:11.476721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.28699999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.372,"15min":0.372},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65500000000000003,"5min":0.752,"15min":0.752},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.88,"15min":0.88},"last":0.501},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.443,"15min":0.432},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.46300000000000002},"min":{"1min":0.35699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.034,"15min":1.034},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.43099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.67000000000000004,"5min":1.458,"15min":1.458},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.434,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52800000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54200000000000004,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.44},"min":{"1min":0.312,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.73799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":1.226,"15min":1.226},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.379,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.378,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.504},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.503,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48899999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.871,"15min":0.871},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77100000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":606208,"data_stored":263451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56200000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.53300000000000003,"5min":1.159,"15min":1.159},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52400000000000002,"5min":1.081,"15min":1.081},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.747,"5min":1.286,"15min":1.286},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80200000000000005,"5min":1.046,"15min":1.046},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.254,"15min":1.254},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56699999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.21299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.307}]},{"osd":4,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.998,"15min":0.998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.47099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-09-13T17:15:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2024-09-13T17:15:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-09-13T17:15:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-09-13T17:15:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-09-13T17:15:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662536+0000', 'last_change': '2024-09-13T17:15:11.662536+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662536+0000', 'last_undegraded': '2024-09-13T17:15:11.662536+0000', 'last_fullsized': '2024-09-13T17:15:11.662536+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661141+0000', 'last_change': '2024-09-13T17:15:11.661141+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661141+0000', 'last_undegraded': '2024-09-13T17:15:11.661141+0000', 'last_fullsized': '2024-09-13T17:15:11.661141+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661321+0000', 'last_change': '2024-09-13T17:15:11.661321+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661321+0000', 'last_undegraded': '2024-09-13T17:15:11.661321+0000', 'last_fullsized': '2024-09-13T17:15:11.661321+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.659155+0000', 'last_change': '2024-09-13T17:15:11.659155+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.659155+0000', 'last_undegraded': '2024-09-13T17:15:11.659155+0000', 'last_fullsized': '2024-09-13T17:15:11.659155+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662964+0000', 'last_change': '2024-09-13T17:15:11.662964+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662964+0000', 'last_undegraded': '2024-09-13T17:15:11.662964+0000', 'last_fullsized': '2024-09-13T17:15:11.662964+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.658196+0000', 'last_change': '2024-09-13T17:15:11.658196+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.658196+0000', 'last_undegraded': '2024-09-13T17:15:11.658196+0000', 'last_fullsized': '2024-09-13T17:15:11.658196+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661794+0000', 'last_change': '2024-09-13T17:15:11.661794+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661794+0000', 'last_undegraded': '2024-09-13T17:15:11.661794+0000', 'last_fullsized': '2024-09-13T17:15:11.661794+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-09-13T17:15:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662341+0000', 'last_change': '2024-09-13T17:15:11.662341+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662341+0000', 'last_undegraded': '2024-09-13T17:15:11.662341+0000', 'last_fullsized': '2024-09-13T17:15:11.662341+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661125+0000', 'last_change': '2024-09-13T17:15:11.661125+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661125+0000', 'last_undegraded': '2024-09-13T17:15:11.661125+0000', 'last_fullsized': '2024-09-13T17:15:11.661125+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-09-13T17:15:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.658220+0000', 'last_change': '2024-09-13T17:15:11.658220+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.658220+0000', 'last_undegraded': '2024-09-13T17:15:11.658220+0000', 'last_fullsized': '2024-09-13T17:15:11.658220+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661700+0000', 'last_change': '2024-09-13T17:15:11.661700+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661700+0000', 'last_undegraded': '2024-09-13T17:15:11.661700+0000', 'last_fullsized': '2024-09-13T17:15:11.661700+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661765+0000', 'last_change': '2024-09-13T17:15:11.661765+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661765+0000', 'last_undegraded': '2024-09-13T17:15:11.661765+0000', 'last_fullsized': '2024-09-13T17:15:11.661765+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-09-13T17:15:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662098+0000', 'last_change': '2024-09-13T17:15:11.662098+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662098+0000', 'last_undegraded': '2024-09-13T17:15:11.662098+0000', 'last_fullsized': '2024-09-13T17:15:11.662098+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662400+0000', 'last_change': '2024-09-13T17:15:11.662400+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662400+0000', 'last_undegraded': '2024-09-13T17:15:11.662400+0000', 'last_fullsized': '2024-09-13T17:15:11.662400+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661184+0000', 'last_change': '2024-09-13T17:15:11.661184+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661184+0000', 'last_undegraded': '2024-09-13T17:15:11.661184+0000', 'last_fullsized': '2024-09-13T17:15:11.661184+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:15:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661141+0000', 'last_change': '2024-09-13T17:15:11.661141+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661141+0000', 'last_undegraded': '2024-09-13T17:15:11.661141+0000', 'last_fullsized': '2024-09-13T17:15:11.661141+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662127+0000', 'last_change': '2024-09-13T17:15:11.662127+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662127+0000', 'last_undegraded': '2024-09-13T17:15:11.662127+0000', 'last_fullsized': '2024-09-13T17:15:11.662127+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-09-13T17:15:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.658087+0000', 'last_change': '2024-09-13T17:15:11.658087+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.658087+0000', 'last_undegraded': '2024-09-13T17:15:11.658087+0000', 'last_fullsized': '2024-09-13T17:15:11.658087+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662197+0000', 'last_change': '2024-09-13T17:15:11.662197+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662197+0000', 'last_undegraded': '2024-09-13T17:15:11.662197+0000', 'last_fullsized': '2024-09-13T17:15:11.662197+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661917+0000', 'last_change': '2024-09-13T17:15:11.661917+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661917+0000', 'last_undegraded': '2024-09-13T17:15:11.661917+0000', 'last_fullsized': '2024-09-13T17:15:11.661917+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661180+0000', 'last_change': '2024-09-13T17:15:11.661180+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661180+0000', 'last_undegraded': '2024-09-13T17:15:11.661180+0000', 'last_fullsized': '2024-09-13T17:15:11.661180+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-09-13T17:15:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662006+0000', 'last_change': '2024-09-13T17:15:11.662006+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662006+0000', 'last_undegraded': '2024-09-13T17:15:11.662006+0000', 'last_fullsized': '2024-09-13T17:15:11.662006+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662247+0000', 'last_change': '2024-09-13T17:15:11.662247+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662247+0000', 'last_undegraded': '2024-09-13T17:15:11.662247+0000', 'last_fullsized': '2024-09-13T17:15:11.662247+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.657837+0000', 'last_change': '2024-09-13T17:15:11.657837+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.657837+0000', 'last_undegraded': '2024-09-13T17:15:11.657837+0000', 'last_fullsized': '2024-09-13T17:15:11.657837+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-09-13T17:15:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661921+0000', 'last_change': '2024-09-13T17:15:11.661921+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661921+0000', 'last_undegraded': '2024-09-13T17:15:11.661921+0000', 'last_fullsized': '2024-09-13T17:15:11.661921+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661120+0000', 'last_change': '2024-09-13T17:15:11.661120+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661120+0000', 'last_undegraded': '2024-09-13T17:15:11.661120+0000', 'last_fullsized': '2024-09-13T17:15:11.661120+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-09-13T17:15:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662411+0000', 'last_change': '2024-09-13T17:15:11.662411+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662411+0000', 'last_undegraded': '2024-09-13T17:15:11.662411+0000', 'last_fullsized': '2024-09-13T17:15:11.662411+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662507+0000', 'last_change': '2024-09-13T17:15:11.662507+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662507+0000', 'last_undegraded': '2024-09-13T17:15:11.662507+0000', 'last_fullsized': '2024-09-13T17:15:11.662507+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.661314+0000', 'last_change': '2024-09-13T17:15:11.661314+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.661314+0000', 'last_undegraded': '2024-09-13T17:15:11.661314+0000', 'last_fullsized': '2024-09-13T17:15:11.661314+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-09-13T17:15:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.658137+0000', 'last_change': '2024-09-13T17:15:11.658137+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.658137+0000', 'last_undegraded': '2024-09-13T17:15:11.658137+0000', 'last_fullsized': '2024-09-13T17:15:11.658137+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.659130+0000', 'last_change': '2024-09-13T17:15:11.659130+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.659130+0000', 'last_undegraded': '2024-09-13T17:15:11.659130+0000', 'last_fullsized': '2024-09-13T17:15:11.659130+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:15:12.655781+0000', 'last_change': '2024-09-13T17:15:12.655781+0000', 'last_active': '2024-09-13T17:15:12.655781+0000', 'last_peered': '2024-09-13T17:15:12.655781+0000', 'last_clean': '2024-09-13T17:15:12.655781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:12.655781+0000', 'last_undegraded': '2024-09-13T17:15:12.655781+0000', 'last_fullsized': '2024-09-13T17:15:12.655781+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:12.655781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-09-13T17:15:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:15:11.662208+0000', 'last_change': '2024-09-13T17:15:11.662208+0000', 'last_active': '2024-09-13T17:15:11.650177+0000', 'last_peered': '2024-09-13T17:15:11.650177+0000', 'last_clean': '2024-09-13T17:15:11.650177+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:15:11.662208+0000', 'last_undegraded': '2024-09-13T17:15:11.662208+0000', 'last_fullsized': '2024-09-13T17:15:11.662208+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'last_clean_scrub_stamp': '2024-09-13T17:15:11.650177+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:15:16.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:15:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.826+0000 7fa13f44f640 1 Processor -- start 2024-09-13T17:15:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.826+0000 7fa13f44f640 1 -- start start 2024-09-13T17:15:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13f44f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 0x7fa1380b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13f44f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1380ae7b0 0x7fa13806a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13f44f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380b27f0 con 0x7fa1380ac110 2024-09-13T17:15:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13f44f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13806ed60 con 0x7fa1380ae7b0 2024-09-13T17:15:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13f44f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380b40d0 con 0x7fa138069e90 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13d9ec640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1380ac110 0x7fa13806dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41042/0 (socket says 172.21.15.5:41042) 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13d9ec640 1 -- 172.21.15.5:0/1144071614 learned_addr learned my addr 172.21.15.5:0/1144071614 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/1144071614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 0x7fa1380b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.827+0000 7fa13c9ea640 1 --2- 172.21.15.5:0/1144071614 >> v2:172.21.15.179:3300/0 conn(0x7fa1380ae7b0 0x7fa13806a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336637198 0 0) 0x7fa1380b27f0 con 0x7fa1380ac110 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa124003520 con 0x7fa1380ac110 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa13d1eb640 1 -- 172.21.15.5:0/1144071614 >> v2:172.21.15.179:3300/0 conn(0x7fa1380ae7b0 msgr2=0x7fa13806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/1144071614 >> v2:172.21.15.179:3300/0 conn(0x7fa1380ae7b0 0x7fa13806a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661631266 0 0) 0x7fa124003520 con 0x7fa1380ac110 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa13d1eb640 1 -- 172.21.15.5:0/1144071614 >> v1:172.21.15.5:6789/0 conn(0x7fa1380ac110 legacy=0x7fa13806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.828+0000 7fa13d1eb640 1 -- 172.21.15.5:0/1144071614 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380ae390 con 0x7fa138069e90 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/1144071614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 0x7fa1380b2130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1340097a0 tx=0x7fa13402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba72f0f4b6de73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1300019f0 con 0x7fa138069e90 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13402aba0 con 0x7fa138069e90 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa12ffff640 1 -- 172.21.15.5:0/1144071614 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa134032440 con 0x7fa138069e90 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 -- 172.21.15.5:0/1144071614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 msgr2=0x7fa1380b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 --2- 172.21.15.5:0/1144071614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 0x7fa1380b2130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1340097a0 tx=0x7fa13402a110 comp rx=0 tx=0).stop 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 -- 172.21.15.5:0/1144071614 shutdown_connections 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 --2- 172.21.15.5:0/1144071614 >> v2:172.21.15.179:3300/0 conn(0x7fa1380ae7b0 0x7fa13806a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 --2- 172.21.15.5:0/1144071614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa138069e90 0x7fa1380b2130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 -- 172.21.15.5:0/1144071614 >> 172.21.15.5:0/1144071614 conn(0x7fa1380b4650 msgr2=0x7fa1380b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.829+0000 7fa13f44f640 1 -- 172.21.15.5:0/1144071614 shutdown_connections 2024-09-13T17:15:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.830+0000 7fa13f44f640 1 -- 172.21.15.5:0/1144071614 wait complete. 2024-09-13T17:15:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 Processor -- start 2024-09-13T17:15:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 -- start start 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 0x7fa13815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1380ae7b0 0x7fa1380b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381e4990 con 0x7fa138069e90 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380ca9d0 con 0x7fa1380ac110 2024-09-13T17:15:16.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.831+0000 7fa13f44f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380ca130 con 0x7fa1380ae7b0 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 -- 172.21.15.5:0/523654703 learned_addr learned my addr 172.21.15.5:0/523654703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13c9ea640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 0x7fa13815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d9ec640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1380ae7b0 0x7fa1380b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 -- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1380ae7b0 msgr2=0x7fa1380b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1380ae7b0 0x7fa1380b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 -- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 msgr2=0x7fa13815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 0x7fa13815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 -- 172.21.15.5:0/523654703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134009400 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13c9ea640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 0x7fa13815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13d1eb640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa1340098c0 tx=0x7fa1340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13403c820 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13403c9a0 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1380ca410 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.832+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13403cd50 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.833+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13814e8e0 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.834+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1380672a0 con 0x7fa138069e90 2024-09-13T17:15:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.834+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa134039050 con 0x7fa138069e90 2024-09-13T17:15:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.834+0000 7fa12dffb640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.834+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa1340a9c60 con 0x7fa138069e90 2024-09-13T17:15:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.835+0000 7fa13c9ea640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.835+0000 7fa13c9ea640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 0x7fa11c06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa13815b1f0 tx=0x7fa128008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:16.839+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa134074d90 con 0x7fa138069e90 2024-09-13T17:15:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.073+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa1381e4760 con 0x7fa138069e90 2024-09-13T17:15:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.074+0000 7fa12dffb640 1 -- 172.21.15.5:0/523654703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7fa13404c610 con 0x7fa138069e90 2024-09-13T17:15:17.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:17.076 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":145,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247581,"num_in_osds":8,"osd_in_since":1726247573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":244097024,"bytes_avail":772850016256,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":21,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6102}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-13T17:15:03.283411+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 msgr2=0x7fa11c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 0x7fa11c06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa13815b1f0 tx=0x7fa128008040 comp rx=0 tx=0).stop 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 msgr2=0x7fa13814e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa1340098c0 tx=0x7fa1340046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 shutdown_connections 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1380ae7b0 0x7fa1380b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1380ac110 0x7fa13815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11c06ac00 0x7fa11c06d0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 --2- 172.21.15.5:0/523654703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa138069e90 0x7fa13814e3a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 >> 172.21.15.5:0/523654703 conn(0x7fa1380b4650 msgr2=0x7fa1380af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 shutdown_connections 2024-09-13T17:15:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.076+0000 7fa13f44f640 1 -- 172.21.15.5:0/523654703 wait complete. 2024-09-13T17:15:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:15:17.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:15:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 Processor -- start 2024-09-13T17:15:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 -- start start 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286815c810 0x7f28680cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28680d06d0 0x7f28680b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f28680b4b20 0x7f28680d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680b4fb0 con 0x7f28680d06d0 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680d1e80 con 0x7f28680b4b20 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.189+0000 7f286e4e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680d1750 con 0x7f286815c810 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28680d06d0 0x7f28680b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28680d06d0 0x7f28680b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54016/0 (socket says 172.21.15.5:54016) 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 -- 172.21.15.5:0/3596137506 learned_addr learned my addr 172.21.15.5:0/3596137506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f2867fff640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286815c810 0x7f28680cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f286ca82640 1 --2- 172.21.15.5:0/3596137506 >> v2:172.21.15.179:3300/0 conn(0x7f28680b4b20 0x7f28680d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 -- 172.21.15.5:0/3596137506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286815c810 msgr2=0x7f28680cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286815c810 0x7f28680cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 -- 172.21.15.5:0/3596137506 >> v2:172.21.15.179:3300/0 conn(0x7f28680b4b20 msgr2=0x7f28680d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 --2- 172.21.15.5:0/3596137506 >> v2:172.21.15.179:3300/0 conn(0x7f28680b4b20 0x7f28680d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.190+0000 7f28677fe640 1 -- 172.21.15.5:0/3596137506 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680d0bd0 con 0x7f28680d06d0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f28677fe640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680d06d0 0x7f28680b45e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f28680d37d0 tx=0x7f285c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2df2193c2b1e9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f2866ffd640 1 -- 172.21.15.5:0/3596137506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c032440 con 0x7f28680d06d0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f2866ffd640 1 -- 172.21.15.5:0/3596137506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0325a0 con 0x7f28680d06d0 2024-09-13T17:15:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f2866ffd640 1 -- 172.21.15.5:0/3596137506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c032930 con 0x7f28680d06d0 2024-09-13T17:15:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 -- 172.21.15.5:0/3596137506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680d06d0 msgr2=0x7f28680b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680d06d0 0x7f28680b45e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f28680d37d0 tx=0x7f285c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 -- 172.21.15.5:0/3596137506 shutdown_connections 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3596137506 >> v2:172.21.15.179:3300/0 conn(0x7f28680b4b20 0x7f28680d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680d06d0 0x7f28680b45e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3596137506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f286815c810 0x7f28680cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 -- 172.21.15.5:0/3596137506 >> 172.21.15.5:0/3596137506 conn(0x7f28680717a0 msgr2=0x7f2868071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 -- 172.21.15.5:0/3596137506 shutdown_connections 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.191+0000 7f286e4e5640 1 -- 172.21.15.5:0/3596137506 wait complete. 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.192+0000 7f286e4e5640 1 Processor -- start 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 -- start start 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 0x7f28680c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 0x7f28680c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680cca50 con 0x7f28680b4b20 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680c9cb0 con 0x7f286815c810 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.193+0000 7f286e4e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680c9f90 con 0x7f28680d06d0 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54018/0 (socket says 172.21.15.5:54018) 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 -- 172.21.15.5:0/3361818015 learned_addr learned my addr 172.21.15.5:0/3361818015 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f28677fe640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 0x7f28680c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f286ca82640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 0x7f28680c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 -- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 msgr2=0x7f28680c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 0x7f28680c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 -- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 msgr2=0x7f28680c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 0x7f28680c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 -- 172.21.15.5:0/3361818015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0094d0 con 0x7f28680b4b20 2024-09-13T17:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f28677fe640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 0x7f28680c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f286ca82640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 0x7f28680c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2867fff640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f285800d5f0 tx=0x7f285800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580125f0 con 0x7f28680b4b20 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858012750 con 0x7f28680b4b20 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28680ca270 con 0x7f28680b4b20 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858012b00 con 0x7f28680b4b20 2024-09-13T17:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.194+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286814bfa0 con 0x7f28680b4b20 2024-09-13T17:15:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.195+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28680672a0 con 0x7f28680b4b20 2024-09-13T17:15:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.196+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2858012c60 con 0x7f28680b4b20 2024-09-13T17:15:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.196+0000 7f2864ff9640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 0x7f285406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.197+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2858089980 con 0x7f28680b4b20 2024-09-13T17:15:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.197+0000 7f28677fe640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 0x7f285406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.197+0000 7f28677fe640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 0x7f285406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f285c034000 tx=0x7f285c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.201+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2858054a20 con 0x7f28680b4b20 2024-09-13T17:15:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.369+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28680cd940 con 0x7f285406ac00 2024-09-13T17:15:17.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.376+0000 7f2864ff9640 1 -- 172.21.15.5:0/3361818015 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285303 (secure 0 0 0) 0x7f28680cd940 con 0x7f285406ac00 2024-09-13T17:15:17.383 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:17.386 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 msgr2=0x7f285406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 0x7f285406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f285c034000 tx=0x7f285c02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 msgr2=0x7f28680a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f285800d5f0 tx=0x7f285800dab0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 shutdown_connections 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f286815c810 0x7f28680c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680d06d0 0x7f28680c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f285406ac00 0x7f285406d0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 --2- 172.21.15.5:0/3361818015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28680b4b20 0x7f28680a9140 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 >> 172.21.15.5:0/3361818015 conn(0x7f28680717a0 msgr2=0x7f2868073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 shutdown_connections 2024-09-13T17:15:17.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:17.380+0000 7f286e4e5640 1 -- 172.21.15.5:0/3361818015 wait complete. 2024-09-13T17:15:17.392 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-13T17:15:17.286591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238648,"kb_used_data":6064,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736072,"statfs":{"total":773094113280,"available":772849737728,"internally_reserved":0,"allocated":6209536,"data_stored":3368468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.630254"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038367+0000","last_change":"2024-09-13T17:15:13.036043+0000","last_active":"2024-09-13T17:15:14.038367+0000","last_peered":"2024-09-13T17:15:14.038367+0000","last_clean":"2024-09-13T17:15:14.038367+0000","last_became_active":"2024-09-13T17:15:13.035693+0000","last_became_peered":"2024-09-13T17:15:13.035693+0000","last_unstale":"2024-09-13T17:15:14.038367+0000","last_undegraded":"2024-09-13T17:15:14.038367+0000","last_fullsized":"2024-09-13T17:15:14.038367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:02.580795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473286+0000","last_change":"2024-09-13T17:15:13.042831+0000","last_active":"2024-09-13T17:15:14.473286+0000","last_peered":"2024-09-13T17:15:14.473286+0000","last_clean":"2024-09-13T17:15:14.473286+0000","last_became_active":"2024-09-13T17:15:13.041699+0000","last_became_peered":"2024-09-13T17:15:13.041699+0000","last_unstale":"2024-09-13T17:15:14.473286+0000","last_undegraded":"2024-09-13T17:15:14.473286+0000","last_fullsized":"2024-09-13T17:15:14.473286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:06.329371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038094+0000","last_change":"2024-09-13T17:15:13.040815+0000","last_active":"2024-09-13T17:15:14.038094+0000","last_peered":"2024-09-13T17:15:14.038094+0000","last_clean":"2024-09-13T17:15:14.038094+0000","last_became_active":"2024-09-13T17:15:13.040566+0000","last_became_peered":"2024-09-13T17:15:13.040566+0000","last_unstale":"2024-09-13T17:15:14.038094+0000","last_undegraded":"2024-09-13T17:15:14.038094+0000","last_fullsized":"2024-09-13T17:15:14.038094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:21.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473097+0000","last_change":"2024-09-13T17:15:13.048657+0000","last_active":"2024-09-13T17:15:14.473097+0000","last_peered":"2024-09-13T17:15:14.473097+0000","last_clean":"2024-09-13T17:15:14.473097+0000","last_became_active":"2024-09-13T17:15:13.048368+0000","last_became_peered":"2024-09-13T17:15:13.048368+0000","last_unstale":"2024-09-13T17:15:14.473097+0000","last_undegraded":"2024-09-13T17:15:14.473097+0000","last_fullsized":"2024-09-13T17:15:14.473097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:21.848607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038224+0000","last_change":"2024-09-13T17:15:13.045145+0000","last_active":"2024-09-13T17:15:14.038224+0000","last_peered":"2024-09-13T17:15:14.038224+0000","last_clean":"2024-09-13T17:15:14.038224+0000","last_became_active":"2024-09-13T17:15:13.044905+0000","last_became_peered":"2024-09-13T17:15:13.044905+0000","last_unstale":"2024-09-13T17:15:14.038224+0000","last_undegraded":"2024-09-13T17:15:14.038224+0000","last_fullsized":"2024-09-13T17:15:14.038224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:13.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.471473+0000","last_change":"2024-09-13T17:15:13.041526+0000","last_active":"2024-09-13T17:15:14.471473+0000","last_peered":"2024-09-13T17:15:14.471473+0000","last_clean":"2024-09-13T17:15:14.471473+0000","last_became_active":"2024-09-13T17:15:13.041299+0000","last_became_peered":"2024-09-13T17:15:13.041299+0000","last_unstale":"2024-09-13T17:15:14.471473+0000","last_undegraded":"2024-09-13T17:15:14.471473+0000","last_fullsized":"2024-09-13T17:15:14.471473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:42.729066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038065+0000","last_change":"2024-09-13T17:15:13.046022+0000","last_active":"2024-09-13T17:15:14.038065+0000","last_peered":"2024-09-13T17:15:14.038065+0000","last_clean":"2024-09-13T17:15:14.038065+0000","last_became_active":"2024-09-13T17:15:13.045548+0000","last_became_peered":"2024-09-13T17:15:13.045548+0000","last_unstale":"2024-09-13T17:15:14.038065+0000","last_undegraded":"2024-09-13T17:15:14.038065+0000","last_fullsized":"2024-09-13T17:15:14.038065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:39.208004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473261+0000","last_change":"2024-09-13T17:15:13.047084+0000","last_active":"2024-09-13T17:15:14.473261+0000","last_peered":"2024-09-13T17:15:14.473261+0000","last_clean":"2024-09-13T17:15:14.473261+0000","last_became_active":"2024-09-13T17:15:13.046777+0000","last_became_peered":"2024-09-13T17:15:13.046777+0000","last_unstale":"2024-09-13T17:15:14.473261+0000","last_undegraded":"2024-09-13T17:15:14.473261+0000","last_fullsized":"2024-09-13T17:15:14.473261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:39.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.037994+0000","last_change":"2024-09-13T17:15:13.039621+0000","last_active":"2024-09-13T17:15:14.037994+0000","last_peered":"2024-09-13T17:15:14.037994+0000","last_clean":"2024-09-13T17:15:14.037994+0000","last_became_active":"2024-09-13T17:15:13.039326+0000","last_became_peered":"2024-09-13T17:15:13.039326+0000","last_unstale":"2024-09-13T17:15:14.037994+0000","last_undegraded":"2024-09-13T17:15:14.037994+0000","last_fullsized":"2024-09-13T17:15:14.037994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:29.332575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473669+0000","last_change":"2024-09-13T17:15:13.041092+0000","last_active":"2024-09-13T17:15:14.473669+0000","last_peered":"2024-09-13T17:15:14.473669+0000","last_clean":"2024-09-13T17:15:14.473669+0000","last_became_active":"2024-09-13T17:15:13.040682+0000","last_became_peered":"2024-09-13T17:15:13.040682+0000","last_unstale":"2024-09-13T17:15:14.473669+0000","last_undegraded":"2024-09-13T17:15:14.473669+0000","last_fullsized":"2024-09-13T17:15:14.473669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:45.698748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473402+0000","last_change":"2024-09-13T17:15:13.043246+0000","last_active":"2024-09-13T17:15:14.473402+0000","last_peered":"2024-09-13T17:15:14.473402+0000","last_clean":"2024-09-13T17:15:14.473402+0000","last_became_active":"2024-09-13T17:15:13.042976+0000","last_became_peered":"2024-09-13T17:15:13.042976+0000","last_unstale":"2024-09-13T17:15:14.473402+0000","last_undegraded":"2024-09-13T17:15:14.473402+0000","last_fullsized":"2024-09-13T17:15:14.473402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:39.307925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056264+0000","last_change":"2024-09-13T17:15:13.048821+0000","last_active":"2024-09-13T17:15:14.056264+0000","last_peered":"2024-09-13T17:15:14.056264+0000","last_clean":"2024-09-13T17:15:14.056264+0000","last_became_active":"2024-09-13T17:15:13.048547+0000","last_became_peered":"2024-09-13T17:15:13.048547+0000","last_unstale":"2024-09-13T17:15:14.056264+0000","last_undegraded":"2024-09-13T17:15:14.056264+0000","last_fullsized":"2024-09-13T17:15:14.056264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:44.651517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056205+0000","last_change":"2024-09-13T17:15:13.041433+0000","last_active":"2024-09-13T17:15:14.056205+0000","last_peered":"2024-09-13T17:15:14.056205+0000","last_clean":"2024-09-13T17:15:14.056205+0000","last_became_active":"2024-09-13T17:15:13.041063+0000","last_became_peered":"2024-09-13T17:15:13.041063+0000","last_unstale":"2024-09-13T17:15:14.056205+0000","last_undegraded":"2024-09-13T17:15:14.056205+0000","last_fullsized":"2024-09-13T17:15:14.056205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.889051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.471311+0000","last_change":"2024-09-13T17:15:13.042262+0000","last_active":"2024-09-13T17:15:14.471311+0000","last_peered":"2024-09-13T17:15:14.471311+0000","last_clean":"2024-09-13T17:15:14.471311+0000","last_became_active":"2024-09-13T17:15:13.042028+0000","last_became_peered":"2024-09-13T17:15:13.042028+0000","last_unstale":"2024-09-13T17:15:14.471311+0000","last_undegraded":"2024-09-13T17:15:14.471311+0000","last_fullsized":"2024-09-13T17:15:14.471311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:24.132468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473044+0000","last_change":"2024-09-13T17:15:13.043058+0000","last_active":"2024-09-13T17:15:14.473044+0000","last_peered":"2024-09-13T17:15:14.473044+0000","last_clean":"2024-09-13T17:15:14.473044+0000","last_became_active":"2024-09-13T17:15:13.042785+0000","last_became_peered":"2024-09-13T17:15:13.042785+0000","last_unstale":"2024-09-13T17:15:14.473044+0000","last_undegraded":"2024-09-13T17:15:14.473044+0000","last_fullsized":"2024-09-13T17:15:14.473044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:26.128664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473670+0000","last_change":"2024-09-13T17:15:13.057984+0000","last_active":"2024-09-13T17:15:14.473670+0000","last_peered":"2024-09-13T17:15:14.473670+0000","last_clean":"2024-09-13T17:15:14.473670+0000","last_became_active":"2024-09-13T17:15:13.057729+0000","last_became_peered":"2024-09-13T17:15:13.057729+0000","last_unstale":"2024-09-13T17:15:14.473670+0000","last_undegraded":"2024-09-13T17:15:14.473670+0000","last_fullsized":"2024-09-13T17:15:14.473670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:14.404612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038269+0000","last_change":"2024-09-13T17:15:13.044258+0000","last_active":"2024-09-13T17:15:14.038269+0000","last_peered":"2024-09-13T17:15:14.038269+0000","last_clean":"2024-09-13T17:15:14.038269+0000","last_became_active":"2024-09-13T17:15:13.044005+0000","last_became_peered":"2024-09-13T17:15:13.044005+0000","last_unstale":"2024-09-13T17:15:14.038269+0000","last_undegraded":"2024-09-13T17:15:14.038269+0000","last_fullsized":"2024-09-13T17:15:14.038269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:11.896433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056251+0000","last_change":"2024-09-13T17:15:13.043917+0000","last_active":"2024-09-13T17:15:14.056251+0000","last_peered":"2024-09-13T17:15:14.056251+0000","last_clean":"2024-09-13T17:15:14.056251+0000","last_became_active":"2024-09-13T17:15:13.043524+0000","last_became_peered":"2024-09-13T17:15:13.043524+0000","last_unstale":"2024-09-13T17:15:14.056251+0000","last_undegraded":"2024-09-13T17:15:14.056251+0000","last_fullsized":"2024-09-13T17:15:14.056251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:38.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473247+0000","last_change":"2024-09-13T17:15:13.047672+0000","last_active":"2024-09-13T17:15:14.473247+0000","last_peered":"2024-09-13T17:15:14.473247+0000","last_clean":"2024-09-13T17:15:14.473247+0000","last_became_active":"2024-09-13T17:15:13.047439+0000","last_became_peered":"2024-09-13T17:15:13.047439+0000","last_unstale":"2024-09-13T17:15:14.473247+0000","last_undegraded":"2024-09-13T17:15:14.473247+0000","last_fullsized":"2024-09-13T17:15:14.473247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:52.072321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473178+0000","last_change":"2024-09-13T17:15:13.049478+0000","last_active":"2024-09-13T17:15:14.473178+0000","last_peered":"2024-09-13T17:15:14.473178+0000","last_clean":"2024-09-13T17:15:14.473178+0000","last_became_active":"2024-09-13T17:15:13.048172+0000","last_became_peered":"2024-09-13T17:15:13.048172+0000","last_unstale":"2024-09-13T17:15:14.473178+0000","last_undegraded":"2024-09-13T17:15:14.473178+0000","last_fullsized":"2024-09-13T17:15:14.473178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:13.835229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044116+0000","last_change":"2024-09-13T17:15:13.039079+0000","last_active":"2024-09-13T17:15:14.044116+0000","last_peered":"2024-09-13T17:15:14.044116+0000","last_clean":"2024-09-13T17:15:14.044116+0000","last_became_active":"2024-09-13T17:15:13.038761+0000","last_became_peered":"2024-09-13T17:15:13.038761+0000","last_unstale":"2024-09-13T17:15:14.044116+0000","last_undegraded":"2024-09-13T17:15:14.044116+0000","last_fullsized":"2024-09-13T17:15:14.044116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:23.532900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054123+0000","last_change":"2024-09-13T17:15:12.681207+0000","last_active":"2024-09-13T17:15:13.054123+0000","last_peered":"2024-09-13T17:15:13.054123+0000","last_clean":"2024-09-13T17:15:13.054123+0000","last_became_active":"2024-09-13T17:15:12.680779+0000","last_became_peered":"2024-09-13T17:15:12.680779+0000","last_unstale":"2024-09-13T17:15:13.054123+0000","last_undegraded":"2024-09-13T17:15:13.054123+0000","last_fullsized":"2024-09-13T17:15:13.054123+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043986+0000","last_change":"2024-09-13T17:15:13.040127+0000","last_active":"2024-09-13T17:15:14.043986+0000","last_peered":"2024-09-13T17:15:14.043986+0000","last_clean":"2024-09-13T17:15:14.043986+0000","last_became_active":"2024-09-13T17:15:13.039886+0000","last_became_peered":"2024-09-13T17:15:13.039886+0000","last_unstale":"2024-09-13T17:15:14.043986+0000","last_undegraded":"2024-09-13T17:15:14.043986+0000","last_fullsized":"2024-09-13T17:15:14.043986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:45.387525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.057869+0000","last_change":"2024-09-13T17:15:12.674127+0000","last_active":"2024-09-13T17:15:13.057869+0000","last_peered":"2024-09-13T17:15:13.057869+0000","last_clean":"2024-09-13T17:15:13.057869+0000","last_became_active":"2024-09-13T17:15:12.673864+0000","last_became_peered":"2024-09-13T17:15:12.673864+0000","last_unstale":"2024-09-13T17:15:13.057869+0000","last_undegraded":"2024-09-13T17:15:13.057869+0000","last_fullsized":"2024-09-13T17:15:13.057869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056159+0000","last_change":"2024-09-13T17:15:13.042211+0000","last_active":"2024-09-13T17:15:14.056159+0000","last_peered":"2024-09-13T17:15:14.056159+0000","last_clean":"2024-09-13T17:15:14.056159+0000","last_became_active":"2024-09-13T17:15:13.041959+0000","last_became_peered":"2024-09-13T17:15:13.041959+0000","last_unstale":"2024-09-13T17:15:14.056159+0000","last_undegraded":"2024-09-13T17:15:14.056159+0000","last_fullsized":"2024-09-13T17:15:14.056159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:23.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.057318+0000","last_change":"2024-09-13T17:15:12.675676+0000","last_active":"2024-09-13T17:15:13.057318+0000","last_peered":"2024-09-13T17:15:13.057318+0000","last_clean":"2024-09-13T17:15:13.057318+0000","last_became_active":"2024-09-13T17:15:12.675350+0000","last_became_peered":"2024-09-13T17:15:12.675350+0000","last_unstale":"2024-09-13T17:15:13.057318+0000","last_undegraded":"2024-09-13T17:15:13.057318+0000","last_fullsized":"2024-09-13T17:15:13.057318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.061126+0000","last_change":"2024-09-13T17:15:12.674423+0000","last_active":"2024-09-13T17:15:13.061126+0000","last_peered":"2024-09-13T17:15:13.061126+0000","last_clean":"2024-09-13T17:15:13.061126+0000","last_became_active":"2024-09-13T17:15:12.674179+0000","last_became_peered":"2024-09-13T17:15:12.674179+0000","last_unstale":"2024-09-13T17:15:13.061126+0000","last_undegraded":"2024-09-13T17:15:13.061126+0000","last_fullsized":"2024-09-13T17:15:13.061126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.055026+0000","last_change":"2024-09-13T17:15:12.681795+0000","last_active":"2024-09-13T17:15:13.055026+0000","last_peered":"2024-09-13T17:15:13.055026+0000","last_clean":"2024-09-13T17:15:13.055026+0000","last_became_active":"2024-09-13T17:15:12.681514+0000","last_became_peered":"2024-09-13T17:15:12.681514+0000","last_unstale":"2024-09-13T17:15:13.055026+0000","last_undegraded":"2024-09-13T17:15:13.055026+0000","last_fullsized":"2024-09-13T17:15:13.055026+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658196+0000","last_change":"2024-09-13T17:15:11.658196+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658196+0000","last_undegraded":"2024-09-13T17:15:11.658196+0000","last_fullsized":"2024-09-13T17:15:11.658196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037182+0000","last_change":"2024-09-13T17:15:12.678869+0000","last_active":"2024-09-13T17:15:13.037182+0000","last_peered":"2024-09-13T17:15:13.037182+0000","last_clean":"2024-09-13T17:15:13.037182+0000","last_became_active":"2024-09-13T17:15:12.678573+0000","last_became_peered":"2024-09-13T17:15:12.678573+0000","last_unstale":"2024-09-13T17:15:13.037182+0000","last_undegraded":"2024-09-13T17:15:13.037182+0000","last_fullsized":"2024-09-13T17:15:13.037182+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.033294+0000","last_change":"2024-09-13T17:15:12.676967+0000","last_active":"2024-09-13T17:15:13.033294+0000","last_peered":"2024-09-13T17:15:13.033294+0000","last_clean":"2024-09-13T17:15:13.033294+0000","last_became_active":"2024-09-13T17:15:12.676722+0000","last_became_peered":"2024-09-13T17:15:12.676722+0000","last_unstale":"2024-09-13T17:15:13.033294+0000","last_undegraded":"2024-09-13T17:15:13.033294+0000","last_fullsized":"2024-09-13T17:15:13.033294+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661125+0000","last_change":"2024-09-13T17:15:11.661125+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661125+0000","last_undegraded":"2024-09-13T17:15:11.661125+0000","last_fullsized":"2024-09-13T17:15:11.661125+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043823+0000","last_change":"2024-09-13T17:15:13.042779+0000","last_active":"2024-09-13T17:15:14.043823+0000","last_peered":"2024-09-13T17:15:14.043823+0000","last_clean":"2024-09-13T17:15:14.043823+0000","last_became_active":"2024-09-13T17:15:13.042441+0000","last_became_peered":"2024-09-13T17:15:13.042441+0000","last_unstale":"2024-09-13T17:15:14.043823+0000","last_undegraded":"2024-09-13T17:15:14.043823+0000","last_fullsized":"2024-09-13T17:15:14.043823+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:01.603913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658220+0000","last_change":"2024-09-13T17:15:11.658220+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658220+0000","last_undegraded":"2024-09-13T17:15:11.658220+0000","last_fullsized":"2024-09-13T17:15:11.658220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473301+0000","last_change":"2024-09-13T17:15:13.048324+0000","last_active":"2024-09-13T17:15:14.473301+0000","last_peered":"2024-09-13T17:15:14.473301+0000","last_clean":"2024-09-13T17:15:14.473301+0000","last_became_active":"2024-09-13T17:15:13.048071+0000","last_became_peered":"2024-09-13T17:15:13.048071+0000","last_unstale":"2024-09-13T17:15:14.473301+0000","last_undegraded":"2024-09-13T17:15:14.473301+0000","last_fullsized":"2024-09-13T17:15:14.473301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:13.998689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661700+0000","last_change":"2024-09-13T17:15:11.661700+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661700+0000","last_undegraded":"2024-09-13T17:15:11.661700+0000","last_fullsized":"2024-09-13T17:15:11.661700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661765+0000","last_change":"2024-09-13T17:15:11.661765+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661765+0000","last_undegraded":"2024-09-13T17:15:11.661765+0000","last_fullsized":"2024-09-13T17:15:11.661765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043868+0000","last_change":"2024-09-13T17:15:13.040730+0000","last_active":"2024-09-13T17:15:14.043868+0000","last_peered":"2024-09-13T17:15:14.043868+0000","last_clean":"2024-09-13T17:15:14.043868+0000","last_became_active":"2024-09-13T17:15:13.040453+0000","last_became_peered":"2024-09-13T17:15:13.040453+0000","last_unstale":"2024-09-13T17:15:14.043868+0000","last_undegraded":"2024-09-13T17:15:14.043868+0000","last_fullsized":"2024-09-13T17:15:14.043868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:24.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054607+0000","last_change":"2024-09-13T17:15:12.677892+0000","last_active":"2024-09-13T17:15:13.054607+0000","last_peered":"2024-09-13T17:15:13.054607+0000","last_clean":"2024-09-13T17:15:13.054607+0000","last_became_active":"2024-09-13T17:15:12.677448+0000","last_became_peered":"2024-09-13T17:15:12.677448+0000","last_unstale":"2024-09-13T17:15:13.054607+0000","last_undegraded":"2024-09-13T17:15:13.054607+0000","last_fullsized":"2024-09-13T17:15:13.054607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473424+0000","last_change":"2024-09-13T17:15:13.042742+0000","last_active":"2024-09-13T17:15:14.473424+0000","last_peered":"2024-09-13T17:15:14.473424+0000","last_clean":"2024-09-13T17:15:14.473424+0000","last_became_active":"2024-09-13T17:15:13.041979+0000","last_became_peered":"2024-09-13T17:15:13.041979+0000","last_unstale":"2024-09-13T17:15:14.473424+0000","last_undegraded":"2024-09-13T17:15:14.473424+0000","last_fullsized":"2024-09-13T17:15:14.473424+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:13.096852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037460+0000","last_change":"2024-09-13T17:15:12.677740+0000","last_active":"2024-09-13T17:15:13.037460+0000","last_peered":"2024-09-13T17:15:13.037460+0000","last_clean":"2024-09-13T17:15:13.037460+0000","last_became_active":"2024-09-13T17:15:12.677476+0000","last_became_peered":"2024-09-13T17:15:12.677476+0000","last_unstale":"2024-09-13T17:15:13.037460+0000","last_undegraded":"2024-09-13T17:15:13.037460+0000","last_fullsized":"2024-09-13T17:15:13.037460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661184+0000","last_change":"2024-09-13T17:15:11.661184+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661184+0000","last_undegraded":"2024-09-13T17:15:11.661184+0000","last_fullsized":"2024-09-13T17:15:11.661184+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473577+0000","last_change":"2024-09-13T17:15:13.040938+0000","last_active":"2024-09-13T17:15:14.473577+0000","last_peered":"2024-09-13T17:15:14.473577+0000","last_clean":"2024-09-13T17:15:14.473577+0000","last_became_active":"2024-09-13T17:15:13.040353+0000","last_became_peered":"2024-09-13T17:15:13.040353+0000","last_unstale":"2024-09-13T17:15:14.473577+0000","last_undegraded":"2024-09-13T17:15:14.473577+0000","last_fullsized":"2024-09-13T17:15:14.473577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:33.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661141+0000","last_change":"2024-09-13T17:15:11.661141+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661141+0000","last_undegraded":"2024-09-13T17:15:11.661141+0000","last_fullsized":"2024-09-13T17:15:11.661141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.060586+0000","last_change":"2024-09-13T17:15:12.681369+0000","last_active":"2024-09-13T17:15:13.060586+0000","last_peered":"2024-09-13T17:15:13.060586+0000","last_clean":"2024-09-13T17:15:13.060586+0000","last_became_active":"2024-09-13T17:15:12.681097+0000","last_became_peered":"2024-09-13T17:15:12.681097+0000","last_unstale":"2024-09-13T17:15:13.060586+0000","last_undegraded":"2024-09-13T17:15:13.060586+0000","last_fullsized":"2024-09-13T17:15:13.060586+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.037996+0000","last_change":"2024-09-13T17:15:13.045546+0000","last_active":"2024-09-13T17:15:14.037996+0000","last_peered":"2024-09-13T17:15:14.037996+0000","last_clean":"2024-09-13T17:15:14.037996+0000","last_became_active":"2024-09-13T17:15:13.045300+0000","last_became_peered":"2024-09-13T17:15:13.045300+0000","last_unstale":"2024-09-13T17:15:14.037996+0000","last_undegraded":"2024-09-13T17:15:14.037996+0000","last_fullsized":"2024-09-13T17:15:14.037996+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:45.387525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.051020+0000","last_change":"2024-09-13T17:15:12.673228+0000","last_active":"2024-09-13T17:15:13.051020+0000","last_peered":"2024-09-13T17:15:13.051020+0000","last_clean":"2024-09-13T17:15:13.051020+0000","last_became_active":"2024-09-13T17:15:12.672853+0000","last_became_peered":"2024-09-13T17:15:12.672853+0000","last_unstale":"2024-09-13T17:15:13.051020+0000","last_undegraded":"2024-09-13T17:15:13.051020+0000","last_fullsized":"2024-09-13T17:15:13.051020+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.052421+0000","last_change":"2024-09-13T17:15:12.679985+0000","last_active":"2024-09-13T17:15:13.052421+0000","last_peered":"2024-09-13T17:15:13.052421+0000","last_clean":"2024-09-13T17:15:13.052421+0000","last_became_active":"2024-09-13T17:15:12.679614+0000","last_became_peered":"2024-09-13T17:15:12.679614+0000","last_unstale":"2024-09-13T17:15:13.052421+0000","last_undegraded":"2024-09-13T17:15:13.052421+0000","last_fullsized":"2024-09-13T17:15:13.052421+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038097+0000","last_change":"2024-09-13T17:15:13.035958+0000","last_active":"2024-09-13T17:15:14.038097+0000","last_peered":"2024-09-13T17:15:14.038097+0000","last_clean":"2024-09-13T17:15:14.038097+0000","last_became_active":"2024-09-13T17:15:13.035601+0000","last_became_peered":"2024-09-13T17:15:13.035601+0000","last_unstale":"2024-09-13T17:15:14.038097+0000","last_undegraded":"2024-09-13T17:15:14.038097+0000","last_fullsized":"2024-09-13T17:15:14.038097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:48.285491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037455+0000","last_change":"2024-09-13T17:15:12.682388+0000","last_active":"2024-09-13T17:15:13.037455+0000","last_peered":"2024-09-13T17:15:13.037455+0000","last_clean":"2024-09-13T17:15:13.037455+0000","last_became_active":"2024-09-13T17:15:12.682176+0000","last_became_peered":"2024-09-13T17:15:12.682176+0000","last_unstale":"2024-09-13T17:15:13.037455+0000","last_undegraded":"2024-09-13T17:15:13.037455+0000","last_fullsized":"2024-09-13T17:15:13.037455+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044005+0000","last_change":"2024-09-13T17:15:13.043559+0000","last_active":"2024-09-13T17:15:14.044005+0000","last_peered":"2024-09-13T17:15:14.044005+0000","last_clean":"2024-09-13T17:15:14.044005+0000","last_became_active":"2024-09-13T17:15:13.043295+0000","last_became_peered":"2024-09-13T17:15:13.043295+0000","last_unstale":"2024-09-13T17:15:14.044005+0000","last_undegraded":"2024-09-13T17:15:14.044005+0000","last_fullsized":"2024-09-13T17:15:14.044005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:13.835229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.056954+0000","last_change":"2024-09-13T17:15:12.674523+0000","last_active":"2024-09-13T17:15:13.056954+0000","last_peered":"2024-09-13T17:15:13.056954+0000","last_clean":"2024-09-13T17:15:13.056954+0000","last_became_active":"2024-09-13T17:15:12.674253+0000","last_became_peered":"2024-09-13T17:15:12.674253+0000","last_unstale":"2024-09-13T17:15:13.056954+0000","last_undegraded":"2024-09-13T17:15:13.056954+0000","last_fullsized":"2024-09-13T17:15:13.056954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056182+0000","last_change":"2024-09-13T17:15:13.047756+0000","last_active":"2024-09-13T17:15:14.056182+0000","last_peered":"2024-09-13T17:15:14.056182+0000","last_clean":"2024-09-13T17:15:14.056182+0000","last_became_active":"2024-09-13T17:15:13.047484+0000","last_became_peered":"2024-09-13T17:15:13.047484+0000","last_unstale":"2024-09-13T17:15:14.056182+0000","last_undegraded":"2024-09-13T17:15:14.056182+0000","last_fullsized":"2024-09-13T17:15:14.056182+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:54.327022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662006+0000","last_change":"2024-09-13T17:15:11.662006+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662006+0000","last_undegraded":"2024-09-13T17:15:11.662006+0000","last_fullsized":"2024-09-13T17:15:11.662006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473482+0000","last_change":"2024-09-13T17:15:13.048780+0000","last_active":"2024-09-13T17:15:14.473482+0000","last_peered":"2024-09-13T17:15:14.473482+0000","last_clean":"2024-09-13T17:15:14.473482+0000","last_became_active":"2024-09-13T17:15:13.048518+0000","last_became_peered":"2024-09-13T17:15:13.048518+0000","last_unstale":"2024-09-13T17:15:14.473482+0000","last_undegraded":"2024-09-13T17:15:14.473482+0000","last_fullsized":"2024-09-13T17:15:14.473482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:11.303661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.035577+0000","last_change":"2024-09-13T17:15:12.678425+0000","last_active":"2024-09-13T17:15:13.035577+0000","last_peered":"2024-09-13T17:15:13.035577+0000","last_clean":"2024-09-13T17:15:13.035577+0000","last_became_active":"2024-09-13T17:15:12.678173+0000","last_became_peered":"2024-09-13T17:15:12.678173+0000","last_unstale":"2024-09-13T17:15:13.035577+0000","last_undegraded":"2024-09-13T17:15:13.035577+0000","last_fullsized":"2024-09-13T17:15:13.035577+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038429+0000","last_change":"2024-09-13T17:15:13.055819+0000","last_active":"2024-09-13T17:15:14.038429+0000","last_peered":"2024-09-13T17:15:14.038429+0000","last_clean":"2024-09-13T17:15:14.038429+0000","last_became_active":"2024-09-13T17:15:13.055552+0000","last_became_peered":"2024-09-13T17:15:13.055552+0000","last_unstale":"2024-09-13T17:15:14.038429+0000","last_undegraded":"2024-09-13T17:15:14.038429+0000","last_fullsized":"2024-09-13T17:15:14.038429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:01.146043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.030882+0000","last_change":"2024-09-13T17:15:12.670441+0000","last_active":"2024-09-13T17:15:13.030882+0000","last_peered":"2024-09-13T17:15:13.030882+0000","last_clean":"2024-09-13T17:15:13.030882+0000","last_became_active":"2024-09-13T17:15:12.670178+0000","last_became_peered":"2024-09-13T17:15:12.670178+0000","last_unstale":"2024-09-13T17:15:13.030882+0000","last_undegraded":"2024-09-13T17:15:13.030882+0000","last_fullsized":"2024-09-13T17:15:13.030882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043742+0000","last_change":"2024-09-13T17:15:13.038895+0000","last_active":"2024-09-13T17:15:14.043742+0000","last_peered":"2024-09-13T17:15:14.043742+0000","last_clean":"2024-09-13T17:15:14.043742+0000","last_became_active":"2024-09-13T17:15:13.038413+0000","last_became_peered":"2024-09-13T17:15:13.038413+0000","last_unstale":"2024-09-13T17:15:14.043742+0000","last_undegraded":"2024-09-13T17:15:14.043742+0000","last_fullsized":"2024-09-13T17:15:14.043742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:15.460810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054791+0000","last_change":"2024-09-13T17:15:12.679115+0000","last_active":"2024-09-13T17:15:13.054791+0000","last_peered":"2024-09-13T17:15:13.054791+0000","last_clean":"2024-09-13T17:15:13.054791+0000","last_became_active":"2024-09-13T17:15:12.678836+0000","last_became_peered":"2024-09-13T17:15:12.678836+0000","last_unstale":"2024-09-13T17:15:13.054791+0000","last_undegraded":"2024-09-13T17:15:13.054791+0000","last_fullsized":"2024-09-13T17:15:13.054791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038078+0000","last_change":"2024-09-13T17:15:13.037747+0000","last_active":"2024-09-13T17:15:14.038078+0000","last_peered":"2024-09-13T17:15:14.038078+0000","last_clean":"2024-09-13T17:15:14.038078+0000","last_became_active":"2024-09-13T17:15:13.037122+0000","last_became_peered":"2024-09-13T17:15:13.037122+0000","last_unstale":"2024-09-13T17:15:14.038078+0000","last_undegraded":"2024-09-13T17:15:14.038078+0000","last_fullsized":"2024-09-13T17:15:14.038078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:24.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661120+0000","last_change":"2024-09-13T17:15:11.661120+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661120+0000","last_undegraded":"2024-09-13T17:15:11.661120+0000","last_fullsized":"2024-09-13T17:15:11.661120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.038671+0000","last_change":"2024-09-13T17:15:12.682289+0000","last_active":"2024-09-13T17:15:13.038671+0000","last_peered":"2024-09-13T17:15:13.038671+0000","last_clean":"2024-09-13T17:15:13.038671+0000","last_became_active":"2024-09-13T17:15:12.681333+0000","last_became_peered":"2024-09-13T17:15:12.681333+0000","last_unstale":"2024-09-13T17:15:13.038671+0000","last_undegraded":"2024-09-13T17:15:13.038671+0000","last_fullsized":"2024-09-13T17:15:13.038671+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473250+0000","last_change":"2024-09-13T17:15:13.057986+0000","last_active":"2024-09-13T17:15:14.473250+0000","last_peered":"2024-09-13T17:15:14.473250+0000","last_clean":"2024-09-13T17:15:14.473250+0000","last_became_active":"2024-09-13T17:15:13.057770+0000","last_became_peered":"2024-09-13T17:15:13.057770+0000","last_unstale":"2024-09-13T17:15:14.473250+0000","last_undegraded":"2024-09-13T17:15:14.473250+0000","last_fullsized":"2024-09-13T17:15:14.473250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:48.626107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.662507+0000","last_change":"2024-09-13T17:15:11.662507+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.662507+0000","last_undegraded":"2024-09-13T17:15:11.662507+0000","last_fullsized":"2024-09-13T17:15:11.662507+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043811+0000","last_change":"2024-09-13T17:15:13.040185+0000","last_active":"2024-09-13T17:15:14.043811+0000","last_peered":"2024-09-13T17:15:14.043811+0000","last_clean":"2024-09-13T17:15:14.043811+0000","last_became_active":"2024-09-13T17:15:13.039917+0000","last_became_peered":"2024-09-13T17:15:13.039917+0000","last_unstale":"2024-09-13T17:15:14.043811+0000","last_undegraded":"2024-09-13T17:15:14.043811+0000","last_fullsized":"2024-09-13T17:15:14.043811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:11.896433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.661314+0000","last_change":"2024-09-13T17:15:11.661314+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.661314+0000","last_undegraded":"2024-09-13T17:15:11.661314+0000","last_fullsized":"2024-09-13T17:15:11.661314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473456+0000","last_change":"2024-09-13T17:15:13.048683+0000","last_active":"2024-09-13T17:15:14.473456+0000","last_peered":"2024-09-13T17:15:14.473456+0000","last_clean":"2024-09-13T17:15:14.473456+0000","last_became_active":"2024-09-13T17:15:13.048407+0000","last_became_peered":"2024-09-13T17:15:13.048407+0000","last_unstale":"2024-09-13T17:15:14.473456+0000","last_undegraded":"2024-09-13T17:15:14.473456+0000","last_fullsized":"2024-09-13T17:15:14.473456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:36.956138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-13T17:15:11.658137+0000","last_change":"2024-09-13T17:15:11.658137+0000","last_active":"2024-09-13T17:15:11.650177+0000","last_peered":"2024-09-13T17:15:11.650177+0000","last_clean":"2024-09-13T17:15:11.650177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:11.658137+0000","last_undegraded":"2024-09-13T17:15:11.658137+0000","last_fullsized":"2024-09-13T17:15:11.658137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:15:12.655781+0000","last_change":"2024-09-13T17:15:12.655781+0000","last_active":"2024-09-13T17:15:12.655781+0000","last_peered":"2024-09-13T17:15:12.655781+0000","last_clean":"2024-09-13T17:15:12.655781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:15:12.655781+0000","last_undegraded":"2024-09-13T17:15:12.655781+0000","last_fullsized":"2024-09-13T17:15:12.655781+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.030708+0000","last_change":"2024-09-13T17:15:12.680295+0000","last_active":"2024-09-13T17:15:13.030708+0000","last_peered":"2024-09-13T17:15:13.030708+0000","last_clean":"2024-09-13T17:15:13.030708+0000","last_became_active":"2024-09-13T17:15:12.680060+0000","last_became_peered":"2024-09-13T17:15:12.680060+0000","last_unstale":"2024-09-13T17:15:13.030708+0000","last_undegraded":"2024-09-13T17:15:13.030708+0000","last_fullsized":"2024-09-13T17:15:13.030708+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056037+0000","last_change":"2024-09-13T17:15:13.045450+0000","last_active":"2024-09-13T17:15:14.056037+0000","last_peered":"2024-09-13T17:15:14.056037+0000","last_clean":"2024-09-13T17:15:14.056037+0000","last_became_active":"2024-09-13T17:15:13.044693+0000","last_became_peered":"2024-09-13T17:15:13.044693+0000","last_unstale":"2024-09-13T17:15:14.056037+0000","last_undegraded":"2024-09-13T17:15:14.056037+0000","last_fullsized":"2024-09-13T17:15:14.056037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:35.153243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.039355+0000","last_change":"2024-09-13T17:15:12.683056+0000","last_active":"2024-09-13T17:15:13.039355+0000","last_peered":"2024-09-13T17:15:13.039355+0000","last_clean":"2024-09-13T17:15:13.039355+0000","last_became_active":"2024-09-13T17:15:12.682681+0000","last_became_peered":"2024-09-13T17:15:12.682681+0000","last_unstale":"2024-09-13T17:15:13.039355+0000","last_undegraded":"2024-09-13T17:15:13.039355+0000","last_fullsized":"2024-09-13T17:15:13.039355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T17:15:11.476721+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:15:11.476721+0000","last_peered":"2024-09-13T17:15:11.476721+0000","last_clean":"2024-09-13T17:15:11.476721+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:15:11.476721+0000","last_undegraded":"2024-09-13T17:15:11.476721+0000","last_fullsized":"2024-09-13T17:15:11.476721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":80,"acting":80,"num_store_stats":5},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1175552,"data_stored":842235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.28699999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":284413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.439}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.372,"15min":0.372},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.497},{"interface":"front","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65500000000000003,"5min":0.752,"15min":0.752},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.374}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":283761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.622}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.88,"15min":0.88},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.443,"15min":0.432},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.46300000000000002},"min":{"1min":0.35699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.034,"15min":1.034},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":593920,"data_stored":257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.43099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.67000000000000004,"5min":1.458,"15min":1.458},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.434,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52800000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54200000000000004,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.44},"min":{"1min":0.312,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.73799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":1.226,"15min":1.226},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":655360,"data_stored":285325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.379,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.378,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.503,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.373},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48899999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.627}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.871,"15min":0.871},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77100000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":283921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56200000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.53300000000000003,"5min":1.159,"15min":1.159},"last":0.433}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52400000000000002,"5min":1.081,"15min":1.081},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.499},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.747,"5min":1.286,"15min":1.286},"last":0.315}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80200000000000005,"5min":1.046,"15min":1.046},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.254,"15min":1.254},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1245184,"data_stored":874185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56699999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.377}]},{"osd":4,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:15:18.943 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-09-13T17:15:18.941+0000 7fdf0f5a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:15:20.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:15:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.512+0000 7f6d0bd1f640 1 Processor -- start 2024-09-13T17:15:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.513+0000 7f6d0bd1f640 1 -- start start 2024-09-13T17:15:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.513+0000 7f6d0bd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0415c810 0x7f6d040cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.513+0000 7f6d0bd1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040d1e80 con 0x7f6d040b4cf0 2024-09-13T17:15:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.513+0000 7f6d0bd1f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040d1750 con 0x7f6d040d06d0 2024-09-13T17:15:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.513+0000 7f6d0bd1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040d0bd0 con 0x7f6d0415c810 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0415c810 0x7f6d040cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0415c810 0x7f6d040cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54024/0 (socket says 172.21.15.5:54024) 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 -- 172.21.15.5:0/591634195 learned_addr learned my addr 172.21.15.5:0/591634195 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d0a2bc640 1 --1- 172.21.15.5:0/591634195 >> v1:172.21.15.5:6789/0 conn(0x7f6d040b4cf0 0x7f6d040b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41054/0 (socket says 172.21.15.5:41054) 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 -- 172.21.15.5:0/591634195 >> v1:172.21.15.179:6789/0 conn(0x7f6d040d06d0 legacy=0x7f6d040b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 -- 172.21.15.5:0/591634195 >> v1:172.21.15.5:6789/0 conn(0x7f6d040b4cf0 legacy=0x7f6d040b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.514+0000 7f6d09abb640 1 -- 172.21.15.5:0/591634195 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040d0eb0 con 0x7f6d0415c810 2024-09-13T17:15:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.515+0000 7f6d09abb640 1 --2- 172.21.15.5:0/591634195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0415c810 0x7f6d040cd780 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009870 tx=0x7f6d0002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e382c501b049a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.515+0000 7f6d08ab9640 1 -- 172.21.15.5:0/591634195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00032640 con 0x7f6d0415c810 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.515+0000 7f6d08ab9640 1 -- 172.21.15.5:0/591634195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000327a0 con 0x7f6d0415c810 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.515+0000 7f6d08ab9640 1 -- 172.21.15.5:0/591634195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00032b30 con 0x7f6d0415c810 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/591634195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0415c810 msgr2=0x7f6d040cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/591634195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0415c810 0x7f6d040cd780 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009870 tx=0x7f6d0002a300 comp rx=0 tx=0).stop 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/591634195 shutdown_connections 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/591634195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0415c810 0x7f6d040cd780 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/591634195 >> 172.21.15.5:0/591634195 conn(0x7f6d040717a0 msgr2=0x7f6d04071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/591634195 shutdown_connections 2024-09-13T17:15:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.516+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/591634195 wait complete. 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.517+0000 7f6d0bd1f640 1 Processor -- start 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.517+0000 7f6d0bd1f640 1 -- start start 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 0x7f6d0414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0415c810 0x7f6d040c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040cadf0 con 0x7f6d040b4cf0 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04159860 con 0x7f6d040d06d0 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0bd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040cb040 con 0x7f6d0415c810 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54038/0 (socket says 172.21.15.5:54038) 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 -- 172.21.15.5:0/3075452567 learned_addr learned my addr 172.21.15.5:0/3075452567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d092ba640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 0x7f6d0414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d0a2bc640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0415c810 0x7f6d040c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 -- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0415c810 msgr2=0x7f6d040c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0415c810 0x7f6d040c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 -- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 msgr2=0x7f6d0414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 0x7f6d0414c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 -- 172.21.15.5:0/3075452567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000094d0 con 0x7f6d040b4cf0 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d092ba640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 0x7f6d0414c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.518+0000 7f6d09abb640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.519+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00030b80 con 0x7f6d040b4cf0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.519+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00030d00 con 0x7f6d040b4cf0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.519+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040cb320 con 0x7f6d040b4cf0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.519+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0003d660 con 0x7f6d040b4cf0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.519+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0414cee0 con 0x7f6d040b4cf0 2024-09-13T17:15:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.520+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040672a0 con 0x7f6d040b4cf0 2024-09-13T17:15:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.520+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d00039040 con 0x7f6d040b4cf0 2024-09-13T17:15:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.521+0000 7f6cfa7fc640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 0x7f6ce806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.521+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6d000aa1b0 con 0x7f6d040b4cf0 2024-09-13T17:15:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.521+0000 7f6d092ba640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 0x7f6ce806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.522+0000 7f6d092ba640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 0x7f6ce806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d04156610 tx=0x7f6cf4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.525+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d00075250 con 0x7f6d040b4cf0 2024-09-13T17:15:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.694+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d040d1470 con 0x7f6ce806ac00 2024-09-13T17:15:20.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.702+0000 7f6cfa7fc640 1 -- 172.21.15.5:0/3075452567 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289267 (secure 0 0 0) 0x7f6cf4001cd0 con 0x7f6ce806ac00 2024-09-13T17:15:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:20.708 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 msgr2=0x7f6ce806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 0x7f6ce806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d04156610 tx=0x7f6cf4009040 comp rx=0 tx=0).stop 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 msgr2=0x7f6d04159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d000046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 shutdown_connections 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0415c810 0x7f6d040c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d040d06d0 0x7f6d0414c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ce806ac00 0x7f6ce806d0c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 --2- 172.21.15.5:0/3075452567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d040b4cf0 0x7f6d04159180 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.705+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 >> 172.21.15.5:0/3075452567 conn(0x7f6d040717a0 msgr2=0x7f6d0415d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.706+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 shutdown_connections 2024-09-13T17:15:20.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.706+0000 7f6d0bd1f640 1 -- 172.21.15.5:0/3075452567 wait complete. 2024-09-13T17:15:20.718 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-09-13T17:15:19.287081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238840,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735880,"statfs":{"total":773094113280,"available":772849541120,"internally_reserved":0,"allocated":6397952,"data_stored":3455548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.625191"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038367+0000","last_change":"2024-09-13T17:15:13.036043+0000","last_active":"2024-09-13T17:15:14.038367+0000","last_peered":"2024-09-13T17:15:14.038367+0000","last_clean":"2024-09-13T17:15:14.038367+0000","last_became_active":"2024-09-13T17:15:13.035693+0000","last_became_peered":"2024-09-13T17:15:13.035693+0000","last_unstale":"2024-09-13T17:15:14.038367+0000","last_undegraded":"2024-09-13T17:15:14.038367+0000","last_fullsized":"2024-09-13T17:15:14.038367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:02.580795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045275+0000","last_change":"2024-09-13T17:15:13.046232+0000","last_active":"2024-09-13T17:15:14.045275+0000","last_peered":"2024-09-13T17:15:14.045275+0000","last_clean":"2024-09-13T17:15:14.045275+0000","last_became_active":"2024-09-13T17:15:13.045727+0000","last_became_peered":"2024-09-13T17:15:13.045727+0000","last_unstale":"2024-09-13T17:15:14.045275+0000","last_undegraded":"2024-09-13T17:15:14.045275+0000","last_fullsized":"2024-09-13T17:15:14.045275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:23.200727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473286+0000","last_change":"2024-09-13T17:15:13.042831+0000","last_active":"2024-09-13T17:15:14.473286+0000","last_peered":"2024-09-13T17:15:14.473286+0000","last_clean":"2024-09-13T17:15:14.473286+0000","last_became_active":"2024-09-13T17:15:13.041699+0000","last_became_peered":"2024-09-13T17:15:13.041699+0000","last_unstale":"2024-09-13T17:15:14.473286+0000","last_undegraded":"2024-09-13T17:15:14.473286+0000","last_fullsized":"2024-09-13T17:15:14.473286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:06.329371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045214+0000","last_change":"2024-09-13T17:15:13.057747+0000","last_active":"2024-09-13T17:15:14.045214+0000","last_peered":"2024-09-13T17:15:14.045214+0000","last_clean":"2024-09-13T17:15:14.045214+0000","last_became_active":"2024-09-13T17:15:13.057433+0000","last_became_peered":"2024-09-13T17:15:13.057433+0000","last_unstale":"2024-09-13T17:15:14.045214+0000","last_undegraded":"2024-09-13T17:15:14.045214+0000","last_fullsized":"2024-09-13T17:15:14.045214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:37.591684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.399937+0000","last_change":"2024-09-13T17:15:13.042006+0000","last_active":"2024-09-13T17:15:14.399937+0000","last_peered":"2024-09-13T17:15:14.399937+0000","last_clean":"2024-09-13T17:15:14.399937+0000","last_became_active":"2024-09-13T17:15:13.041739+0000","last_became_peered":"2024-09-13T17:15:13.041739+0000","last_unstale":"2024-09-13T17:15:14.399937+0000","last_undegraded":"2024-09-13T17:15:14.399937+0000","last_fullsized":"2024-09-13T17:15:14.399937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:33.286425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038094+0000","last_change":"2024-09-13T17:15:13.040815+0000","last_active":"2024-09-13T17:15:14.038094+0000","last_peered":"2024-09-13T17:15:14.038094+0000","last_clean":"2024-09-13T17:15:14.038094+0000","last_became_active":"2024-09-13T17:15:13.040566+0000","last_became_peered":"2024-09-13T17:15:13.040566+0000","last_unstale":"2024-09-13T17:15:14.038094+0000","last_undegraded":"2024-09-13T17:15:14.038094+0000","last_fullsized":"2024-09-13T17:15:14.038094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:21.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473097+0000","last_change":"2024-09-13T17:15:13.048657+0000","last_active":"2024-09-13T17:15:14.473097+0000","last_peered":"2024-09-13T17:15:14.473097+0000","last_clean":"2024-09-13T17:15:14.473097+0000","last_became_active":"2024-09-13T17:15:13.048368+0000","last_became_peered":"2024-09-13T17:15:13.048368+0000","last_unstale":"2024-09-13T17:15:14.473097+0000","last_undegraded":"2024-09-13T17:15:14.473097+0000","last_fullsized":"2024-09-13T17:15:14.473097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:21.848607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165449+0000","last_change":"2024-09-13T17:15:13.057364+0000","last_active":"2024-09-13T17:15:14.165449+0000","last_peered":"2024-09-13T17:15:14.165449+0000","last_clean":"2024-09-13T17:15:14.165449+0000","last_became_active":"2024-09-13T17:15:13.057108+0000","last_became_peered":"2024-09-13T17:15:13.057108+0000","last_unstale":"2024-09-13T17:15:14.165449+0000","last_undegraded":"2024-09-13T17:15:14.165449+0000","last_fullsized":"2024-09-13T17:15:14.165449+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:13.998689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165831+0000","last_change":"2024-09-13T17:15:13.055631+0000","last_active":"2024-09-13T17:15:14.165831+0000","last_peered":"2024-09-13T17:15:14.165831+0000","last_clean":"2024-09-13T17:15:14.165831+0000","last_became_active":"2024-09-13T17:15:13.055391+0000","last_became_peered":"2024-09-13T17:15:13.055391+0000","last_unstale":"2024-09-13T17:15:14.165831+0000","last_undegraded":"2024-09-13T17:15:14.165831+0000","last_fullsized":"2024-09-13T17:15:14.165831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:39.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038224+0000","last_change":"2024-09-13T17:15:13.045145+0000","last_active":"2024-09-13T17:15:14.038224+0000","last_peered":"2024-09-13T17:15:14.038224+0000","last_clean":"2024-09-13T17:15:14.038224+0000","last_became_active":"2024-09-13T17:15:13.044905+0000","last_became_peered":"2024-09-13T17:15:13.044905+0000","last_unstale":"2024-09-13T17:15:14.038224+0000","last_undegraded":"2024-09-13T17:15:14.038224+0000","last_fullsized":"2024-09-13T17:15:14.038224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:13.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.471473+0000","last_change":"2024-09-13T17:15:13.041526+0000","last_active":"2024-09-13T17:15:14.471473+0000","last_peered":"2024-09-13T17:15:14.471473+0000","last_clean":"2024-09-13T17:15:14.471473+0000","last_became_active":"2024-09-13T17:15:13.041299+0000","last_became_peered":"2024-09-13T17:15:13.041299+0000","last_unstale":"2024-09-13T17:15:14.471473+0000","last_undegraded":"2024-09-13T17:15:14.471473+0000","last_fullsized":"2024-09-13T17:15:14.471473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:42.729066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165780+0000","last_change":"2024-09-13T17:15:13.049829+0000","last_active":"2024-09-13T17:15:14.165780+0000","last_peered":"2024-09-13T17:15:14.165780+0000","last_clean":"2024-09-13T17:15:14.165780+0000","last_became_active":"2024-09-13T17:15:13.049423+0000","last_became_peered":"2024-09-13T17:15:13.049423+0000","last_unstale":"2024-09-13T17:15:14.165780+0000","last_undegraded":"2024-09-13T17:15:14.165780+0000","last_fullsized":"2024-09-13T17:15:14.165780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:21.848607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038065+0000","last_change":"2024-09-13T17:15:13.046022+0000","last_active":"2024-09-13T17:15:14.038065+0000","last_peered":"2024-09-13T17:15:14.038065+0000","last_clean":"2024-09-13T17:15:14.038065+0000","last_became_active":"2024-09-13T17:15:13.045548+0000","last_became_peered":"2024-09-13T17:15:13.045548+0000","last_unstale":"2024-09-13T17:15:14.038065+0000","last_undegraded":"2024-09-13T17:15:14.038065+0000","last_fullsized":"2024-09-13T17:15:14.038065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:39.208004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473261+0000","last_change":"2024-09-13T17:15:13.047084+0000","last_active":"2024-09-13T17:15:14.473261+0000","last_peered":"2024-09-13T17:15:14.473261+0000","last_clean":"2024-09-13T17:15:14.473261+0000","last_became_active":"2024-09-13T17:15:13.046777+0000","last_became_peered":"2024-09-13T17:15:13.046777+0000","last_unstale":"2024-09-13T17:15:14.473261+0000","last_undegraded":"2024-09-13T17:15:14.473261+0000","last_fullsized":"2024-09-13T17:15:14.473261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:39.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044925+0000","last_change":"2024-09-13T17:15:13.041838+0000","last_active":"2024-09-13T17:15:14.044925+0000","last_peered":"2024-09-13T17:15:14.044925+0000","last_clean":"2024-09-13T17:15:14.044925+0000","last_became_active":"2024-09-13T17:15:13.041574+0000","last_became_peered":"2024-09-13T17:15:13.041574+0000","last_unstale":"2024-09-13T17:15:14.044925+0000","last_undegraded":"2024-09-13T17:15:14.044925+0000","last_fullsized":"2024-09-13T17:15:14.044925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:51.631250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.037994+0000","last_change":"2024-09-13T17:15:13.039621+0000","last_active":"2024-09-13T17:15:14.037994+0000","last_peered":"2024-09-13T17:15:14.037994+0000","last_clean":"2024-09-13T17:15:14.037994+0000","last_became_active":"2024-09-13T17:15:13.039326+0000","last_became_peered":"2024-09-13T17:15:13.039326+0000","last_unstale":"2024-09-13T17:15:14.037994+0000","last_undegraded":"2024-09-13T17:15:14.037994+0000","last_fullsized":"2024-09-13T17:15:14.037994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:29.332575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473669+0000","last_change":"2024-09-13T17:15:13.041092+0000","last_active":"2024-09-13T17:15:14.473669+0000","last_peered":"2024-09-13T17:15:14.473669+0000","last_clean":"2024-09-13T17:15:14.473669+0000","last_became_active":"2024-09-13T17:15:13.040682+0000","last_became_peered":"2024-09-13T17:15:13.040682+0000","last_unstale":"2024-09-13T17:15:14.473669+0000","last_undegraded":"2024-09-13T17:15:14.473669+0000","last_fullsized":"2024-09-13T17:15:14.473669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:45.698748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045296+0000","last_change":"2024-09-13T17:15:13.045223+0000","last_active":"2024-09-13T17:15:14.045296+0000","last_peered":"2024-09-13T17:15:14.045296+0000","last_clean":"2024-09-13T17:15:14.045296+0000","last_became_active":"2024-09-13T17:15:13.044962+0000","last_became_peered":"2024-09-13T17:15:13.044962+0000","last_unstale":"2024-09-13T17:15:14.045296+0000","last_undegraded":"2024-09-13T17:15:14.045296+0000","last_fullsized":"2024-09-13T17:15:14.045296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:11.753964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473402+0000","last_change":"2024-09-13T17:15:13.043246+0000","last_active":"2024-09-13T17:15:14.473402+0000","last_peered":"2024-09-13T17:15:14.473402+0000","last_clean":"2024-09-13T17:15:14.473402+0000","last_became_active":"2024-09-13T17:15:13.042976+0000","last_became_peered":"2024-09-13T17:15:13.042976+0000","last_unstale":"2024-09-13T17:15:14.473402+0000","last_undegraded":"2024-09-13T17:15:14.473402+0000","last_fullsized":"2024-09-13T17:15:14.473402+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:39.307925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056264+0000","last_change":"2024-09-13T17:15:13.048821+0000","last_active":"2024-09-13T17:15:14.056264+0000","last_peered":"2024-09-13T17:15:14.056264+0000","last_clean":"2024-09-13T17:15:14.056264+0000","last_became_active":"2024-09-13T17:15:13.048547+0000","last_became_peered":"2024-09-13T17:15:13.048547+0000","last_unstale":"2024-09-13T17:15:14.056264+0000","last_undegraded":"2024-09-13T17:15:14.056264+0000","last_fullsized":"2024-09-13T17:15:14.056264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:44.651517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056205+0000","last_change":"2024-09-13T17:15:13.041433+0000","last_active":"2024-09-13T17:15:14.056205+0000","last_peered":"2024-09-13T17:15:14.056205+0000","last_clean":"2024-09-13T17:15:14.056205+0000","last_became_active":"2024-09-13T17:15:13.041063+0000","last_became_peered":"2024-09-13T17:15:13.041063+0000","last_unstale":"2024-09-13T17:15:14.056205+0000","last_undegraded":"2024-09-13T17:15:14.056205+0000","last_fullsized":"2024-09-13T17:15:14.056205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.889051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165440+0000","last_change":"2024-09-13T17:15:13.056828+0000","last_active":"2024-09-13T17:15:14.165440+0000","last_peered":"2024-09-13T17:15:14.165440+0000","last_clean":"2024-09-13T17:15:14.165440+0000","last_became_active":"2024-09-13T17:15:13.056573+0000","last_became_peered":"2024-09-13T17:15:13.056573+0000","last_unstale":"2024-09-13T17:15:14.165440+0000","last_undegraded":"2024-09-13T17:15:14.165440+0000","last_fullsized":"2024-09-13T17:15:14.165440+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:11.303661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.471311+0000","last_change":"2024-09-13T17:15:13.042262+0000","last_active":"2024-09-13T17:15:14.471311+0000","last_peered":"2024-09-13T17:15:14.471311+0000","last_clean":"2024-09-13T17:15:14.471311+0000","last_became_active":"2024-09-13T17:15:13.042028+0000","last_became_peered":"2024-09-13T17:15:13.042028+0000","last_unstale":"2024-09-13T17:15:14.471311+0000","last_undegraded":"2024-09-13T17:15:14.471311+0000","last_fullsized":"2024-09-13T17:15:14.471311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:24.132468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473044+0000","last_change":"2024-09-13T17:15:13.043058+0000","last_active":"2024-09-13T17:15:14.473044+0000","last_peered":"2024-09-13T17:15:14.473044+0000","last_clean":"2024-09-13T17:15:14.473044+0000","last_became_active":"2024-09-13T17:15:13.042785+0000","last_became_peered":"2024-09-13T17:15:13.042785+0000","last_unstale":"2024-09-13T17:15:14.473044+0000","last_undegraded":"2024-09-13T17:15:14.473044+0000","last_fullsized":"2024-09-13T17:15:14.473044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:26.128664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473670+0000","last_change":"2024-09-13T17:15:13.057984+0000","last_active":"2024-09-13T17:15:14.473670+0000","last_peered":"2024-09-13T17:15:14.473670+0000","last_clean":"2024-09-13T17:15:14.473670+0000","last_became_active":"2024-09-13T17:15:13.057729+0000","last_became_peered":"2024-09-13T17:15:13.057729+0000","last_unstale":"2024-09-13T17:15:14.473670+0000","last_undegraded":"2024-09-13T17:15:14.473670+0000","last_fullsized":"2024-09-13T17:15:14.473670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:14.404612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165663+0000","last_change":"2024-09-13T17:15:13.044094+0000","last_active":"2024-09-13T17:15:14.165663+0000","last_peered":"2024-09-13T17:15:14.165663+0000","last_clean":"2024-09-13T17:15:14.165663+0000","last_became_active":"2024-09-13T17:15:13.043839+0000","last_became_peered":"2024-09-13T17:15:13.043839+0000","last_unstale":"2024-09-13T17:15:14.165663+0000","last_undegraded":"2024-09-13T17:15:14.165663+0000","last_fullsized":"2024-09-13T17:15:14.165663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:33.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038269+0000","last_change":"2024-09-13T17:15:13.044258+0000","last_active":"2024-09-13T17:15:14.038269+0000","last_peered":"2024-09-13T17:15:14.038269+0000","last_clean":"2024-09-13T17:15:14.038269+0000","last_became_active":"2024-09-13T17:15:13.044005+0000","last_became_peered":"2024-09-13T17:15:13.044005+0000","last_unstale":"2024-09-13T17:15:14.038269+0000","last_undegraded":"2024-09-13T17:15:14.038269+0000","last_fullsized":"2024-09-13T17:15:14.038269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:11.896433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056251+0000","last_change":"2024-09-13T17:15:13.043917+0000","last_active":"2024-09-13T17:15:14.056251+0000","last_peered":"2024-09-13T17:15:14.056251+0000","last_clean":"2024-09-13T17:15:14.056251+0000","last_became_active":"2024-09-13T17:15:13.043524+0000","last_became_peered":"2024-09-13T17:15:13.043524+0000","last_unstale":"2024-09-13T17:15:14.056251+0000","last_undegraded":"2024-09-13T17:15:14.056251+0000","last_fullsized":"2024-09-13T17:15:14.056251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:38.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473247+0000","last_change":"2024-09-13T17:15:13.047672+0000","last_active":"2024-09-13T17:15:14.473247+0000","last_peered":"2024-09-13T17:15:14.473247+0000","last_clean":"2024-09-13T17:15:14.473247+0000","last_became_active":"2024-09-13T17:15:13.047439+0000","last_became_peered":"2024-09-13T17:15:13.047439+0000","last_unstale":"2024-09-13T17:15:14.473247+0000","last_undegraded":"2024-09-13T17:15:14.473247+0000","last_fullsized":"2024-09-13T17:15:14.473247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:52.072321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045059+0000","last_change":"2024-09-13T17:15:13.039820+0000","last_active":"2024-09-13T17:15:14.045059+0000","last_peered":"2024-09-13T17:15:14.045059+0000","last_clean":"2024-09-13T17:15:14.045059+0000","last_became_active":"2024-09-13T17:15:13.039559+0000","last_became_peered":"2024-09-13T17:15:13.039559+0000","last_unstale":"2024-09-13T17:15:14.045059+0000","last_undegraded":"2024-09-13T17:15:14.045059+0000","last_fullsized":"2024-09-13T17:15:14.045059+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:36.505941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473178+0000","last_change":"2024-09-13T17:15:13.049478+0000","last_active":"2024-09-13T17:15:14.473178+0000","last_peered":"2024-09-13T17:15:14.473178+0000","last_clean":"2024-09-13T17:15:14.473178+0000","last_became_active":"2024-09-13T17:15:13.048172+0000","last_became_peered":"2024-09-13T17:15:13.048172+0000","last_unstale":"2024-09-13T17:15:14.473178+0000","last_undegraded":"2024-09-13T17:15:14.473178+0000","last_fullsized":"2024-09-13T17:15:14.473178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:13.835229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044116+0000","last_change":"2024-09-13T17:15:13.039079+0000","last_active":"2024-09-13T17:15:14.044116+0000","last_peered":"2024-09-13T17:15:14.044116+0000","last_clean":"2024-09-13T17:15:14.044116+0000","last_became_active":"2024-09-13T17:15:13.038761+0000","last_became_peered":"2024-09-13T17:15:13.038761+0000","last_unstale":"2024-09-13T17:15:14.044116+0000","last_undegraded":"2024-09-13T17:15:14.044116+0000","last_fullsized":"2024-09-13T17:15:14.044116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:23.532900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044738+0000","last_change":"2024-09-13T17:15:13.040177+0000","last_active":"2024-09-13T17:15:14.044738+0000","last_peered":"2024-09-13T17:15:14.044738+0000","last_clean":"2024-09-13T17:15:14.044738+0000","last_became_active":"2024-09-13T17:15:13.039929+0000","last_became_peered":"2024-09-13T17:15:13.039929+0000","last_unstale":"2024-09-13T17:15:14.044738+0000","last_undegraded":"2024-09-13T17:15:14.044738+0000","last_fullsized":"2024-09-13T17:15:14.044738+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:38.434286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054123+0000","last_change":"2024-09-13T17:15:12.681207+0000","last_active":"2024-09-13T17:15:13.054123+0000","last_peered":"2024-09-13T17:15:13.054123+0000","last_clean":"2024-09-13T17:15:13.054123+0000","last_became_active":"2024-09-13T17:15:12.680779+0000","last_became_peered":"2024-09-13T17:15:12.680779+0000","last_unstale":"2024-09-13T17:15:13.054123+0000","last_undegraded":"2024-09-13T17:15:13.054123+0000","last_fullsized":"2024-09-13T17:15:13.054123+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043986+0000","last_change":"2024-09-13T17:15:13.040127+0000","last_active":"2024-09-13T17:15:14.043986+0000","last_peered":"2024-09-13T17:15:14.043986+0000","last_clean":"2024-09-13T17:15:14.043986+0000","last_became_active":"2024-09-13T17:15:13.039886+0000","last_became_peered":"2024-09-13T17:15:13.039886+0000","last_unstale":"2024-09-13T17:15:14.043986+0000","last_undegraded":"2024-09-13T17:15:14.043986+0000","last_fullsized":"2024-09-13T17:15:14.043986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:45.387525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.057869+0000","last_change":"2024-09-13T17:15:12.674127+0000","last_active":"2024-09-13T17:15:13.057869+0000","last_peered":"2024-09-13T17:15:13.057869+0000","last_clean":"2024-09-13T17:15:13.057869+0000","last_became_active":"2024-09-13T17:15:12.673864+0000","last_became_peered":"2024-09-13T17:15:12.673864+0000","last_unstale":"2024-09-13T17:15:13.057869+0000","last_undegraded":"2024-09-13T17:15:13.057869+0000","last_fullsized":"2024-09-13T17:15:13.057869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:34.147639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056159+0000","last_change":"2024-09-13T17:15:13.042211+0000","last_active":"2024-09-13T17:15:14.056159+0000","last_peered":"2024-09-13T17:15:14.056159+0000","last_clean":"2024-09-13T17:15:14.056159+0000","last_became_active":"2024-09-13T17:15:13.041959+0000","last_became_peered":"2024-09-13T17:15:13.041959+0000","last_unstale":"2024-09-13T17:15:14.056159+0000","last_undegraded":"2024-09-13T17:15:14.056159+0000","last_fullsized":"2024-09-13T17:15:14.056159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:23.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.057318+0000","last_change":"2024-09-13T17:15:12.675676+0000","last_active":"2024-09-13T17:15:13.057318+0000","last_peered":"2024-09-13T17:15:13.057318+0000","last_clean":"2024-09-13T17:15:13.057318+0000","last_became_active":"2024-09-13T17:15:12.675350+0000","last_became_peered":"2024-09-13T17:15:12.675350+0000","last_unstale":"2024-09-13T17:15:13.057318+0000","last_undegraded":"2024-09-13T17:15:13.057318+0000","last_fullsized":"2024-09-13T17:15:13.057318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:00.883447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165581+0000","last_change":"2024-09-13T17:15:13.049076+0000","last_active":"2024-09-13T17:15:14.165581+0000","last_peered":"2024-09-13T17:15:14.165581+0000","last_clean":"2024-09-13T17:15:14.165581+0000","last_became_active":"2024-09-13T17:15:13.048814+0000","last_became_peered":"2024-09-13T17:15:13.048814+0000","last_unstale":"2024-09-13T17:15:14.165581+0000","last_undegraded":"2024-09-13T17:15:14.165581+0000","last_fullsized":"2024-09-13T17:15:14.165581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:36.956138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.061126+0000","last_change":"2024-09-13T17:15:12.674423+0000","last_active":"2024-09-13T17:15:13.061126+0000","last_peered":"2024-09-13T17:15:13.061126+0000","last_clean":"2024-09-13T17:15:13.061126+0000","last_became_active":"2024-09-13T17:15:12.674179+0000","last_became_peered":"2024-09-13T17:15:12.674179+0000","last_unstale":"2024-09-13T17:15:13.061126+0000","last_undegraded":"2024-09-13T17:15:13.061126+0000","last_fullsized":"2024-09-13T17:15:13.061126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.400026+0000","last_change":"2024-09-13T17:15:13.048485+0000","last_active":"2024-09-13T17:15:14.400026+0000","last_peered":"2024-09-13T17:15:14.400026+0000","last_clean":"2024-09-13T17:15:14.400026+0000","last_became_active":"2024-09-13T17:15:13.048222+0000","last_became_peered":"2024-09-13T17:15:13.048222+0000","last_unstale":"2024-09-13T17:15:14.400026+0000","last_undegraded":"2024-09-13T17:15:14.400026+0000","last_fullsized":"2024-09-13T17:15:14.400026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:48.285491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.055026+0000","last_change":"2024-09-13T17:15:12.681795+0000","last_active":"2024-09-13T17:15:13.055026+0000","last_peered":"2024-09-13T17:15:13.055026+0000","last_clean":"2024-09-13T17:15:13.055026+0000","last_became_active":"2024-09-13T17:15:12.681514+0000","last_became_peered":"2024-09-13T17:15:12.681514+0000","last_unstale":"2024-09-13T17:15:13.055026+0000","last_undegraded":"2024-09-13T17:15:13.055026+0000","last_fullsized":"2024-09-13T17:15:13.055026+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:50.625645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045155+0000","last_change":"2024-09-13T17:15:13.041532+0000","last_active":"2024-09-13T17:15:14.045155+0000","last_peered":"2024-09-13T17:15:14.045155+0000","last_clean":"2024-09-13T17:15:14.045155+0000","last_became_active":"2024-09-13T17:15:13.041276+0000","last_became_peered":"2024-09-13T17:15:13.041276+0000","last_unstale":"2024-09-13T17:15:14.045155+0000","last_undegraded":"2024-09-13T17:15:14.045155+0000","last_fullsized":"2024-09-13T17:15:14.045155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:07.195435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.050984+0000","last_change":"2024-09-13T17:15:12.679085+0000","last_active":"2024-09-13T17:15:13.050984+0000","last_peered":"2024-09-13T17:15:13.050984+0000","last_clean":"2024-09-13T17:15:13.050984+0000","last_became_active":"2024-09-13T17:15:12.678827+0000","last_became_peered":"2024-09-13T17:15:12.678827+0000","last_unstale":"2024-09-13T17:15:13.050984+0000","last_undegraded":"2024-09-13T17:15:13.050984+0000","last_fullsized":"2024-09-13T17:15:13.050984+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:37.428682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165755+0000","last_change":"2024-09-13T17:15:13.044118+0000","last_active":"2024-09-13T17:15:14.165755+0000","last_peered":"2024-09-13T17:15:14.165755+0000","last_clean":"2024-09-13T17:15:14.165755+0000","last_became_active":"2024-09-13T17:15:13.043866+0000","last_became_peered":"2024-09-13T17:15:13.043866+0000","last_unstale":"2024-09-13T17:15:14.165755+0000","last_undegraded":"2024-09-13T17:15:14.165755+0000","last_fullsized":"2024-09-13T17:15:14.165755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:14.404612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037182+0000","last_change":"2024-09-13T17:15:12.678869+0000","last_active":"2024-09-13T17:15:13.037182+0000","last_peered":"2024-09-13T17:15:13.037182+0000","last_clean":"2024-09-13T17:15:13.037182+0000","last_became_active":"2024-09-13T17:15:12.678573+0000","last_became_peered":"2024-09-13T17:15:12.678573+0000","last_unstale":"2024-09-13T17:15:13.037182+0000","last_undegraded":"2024-09-13T17:15:13.037182+0000","last_fullsized":"2024-09-13T17:15:13.037182+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.045277+0000","last_change":"2024-09-13T17:15:13.050044+0000","last_active":"2024-09-13T17:15:14.045277+0000","last_peered":"2024-09-13T17:15:14.045277+0000","last_clean":"2024-09-13T17:15:14.045277+0000","last_became_active":"2024-09-13T17:15:13.049768+0000","last_became_peered":"2024-09-13T17:15:13.049768+0000","last_unstale":"2024-09-13T17:15:14.045277+0000","last_undegraded":"2024-09-13T17:15:14.045277+0000","last_fullsized":"2024-09-13T17:15:14.045277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:57.539578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.033294+0000","last_change":"2024-09-13T17:15:12.676967+0000","last_active":"2024-09-13T17:15:13.033294+0000","last_peered":"2024-09-13T17:15:13.033294+0000","last_clean":"2024-09-13T17:15:13.033294+0000","last_became_active":"2024-09-13T17:15:12.676722+0000","last_became_peered":"2024-09-13T17:15:12.676722+0000","last_unstale":"2024-09-13T17:15:13.033294+0000","last_undegraded":"2024-09-13T17:15:13.033294+0000","last_fullsized":"2024-09-13T17:15:13.033294+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:32.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.399844+0000","last_change":"2024-09-13T17:15:13.057656+0000","last_active":"2024-09-13T17:15:14.399844+0000","last_peered":"2024-09-13T17:15:14.399844+0000","last_clean":"2024-09-13T17:15:14.399844+0000","last_became_active":"2024-09-13T17:15:13.057431+0000","last_became_peered":"2024-09-13T17:15:13.057431+0000","last_unstale":"2024-09-13T17:15:14.399844+0000","last_undegraded":"2024-09-13T17:15:14.399844+0000","last_fullsized":"2024-09-13T17:15:14.399844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:02.580795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.034759+0000","last_change":"2024-09-13T17:15:12.670383+0000","last_active":"2024-09-13T17:15:13.034759+0000","last_peered":"2024-09-13T17:15:13.034759+0000","last_clean":"2024-09-13T17:15:13.034759+0000","last_became_active":"2024-09-13T17:15:12.670132+0000","last_became_peered":"2024-09-13T17:15:12.670132+0000","last_unstale":"2024-09-13T17:15:13.034759+0000","last_undegraded":"2024-09-13T17:15:13.034759+0000","last_fullsized":"2024-09-13T17:15:13.034759+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:23.126864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043823+0000","last_change":"2024-09-13T17:15:13.042779+0000","last_active":"2024-09-13T17:15:14.043823+0000","last_peered":"2024-09-13T17:15:14.043823+0000","last_clean":"2024-09-13T17:15:14.043823+0000","last_became_active":"2024-09-13T17:15:13.042441+0000","last_became_peered":"2024-09-13T17:15:13.042441+0000","last_unstale":"2024-09-13T17:15:14.043823+0000","last_undegraded":"2024-09-13T17:15:14.043823+0000","last_fullsized":"2024-09-13T17:15:14.043823+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:01.603913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.035185+0000","last_change":"2024-09-13T17:15:12.678630+0000","last_active":"2024-09-13T17:15:13.035185+0000","last_peered":"2024-09-13T17:15:13.035185+0000","last_clean":"2024-09-13T17:15:13.035185+0000","last_became_active":"2024-09-13T17:15:12.678356+0000","last_became_peered":"2024-09-13T17:15:12.678356+0000","last_unstale":"2024-09-13T17:15:13.035185+0000","last_undegraded":"2024-09-13T17:15:13.035185+0000","last_fullsized":"2024-09-13T17:15:13.035185+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:43.645913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473301+0000","last_change":"2024-09-13T17:15:13.048324+0000","last_active":"2024-09-13T17:15:14.473301+0000","last_peered":"2024-09-13T17:15:14.473301+0000","last_clean":"2024-09-13T17:15:14.473301+0000","last_became_active":"2024-09-13T17:15:13.048071+0000","last_became_peered":"2024-09-13T17:15:13.048071+0000","last_unstale":"2024-09-13T17:15:14.473301+0000","last_undegraded":"2024-09-13T17:15:14.473301+0000","last_fullsized":"2024-09-13T17:15:14.473301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:13.998689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.052421+0000","last_change":"2024-09-13T17:15:12.679159+0000","last_active":"2024-09-13T17:15:13.052421+0000","last_peered":"2024-09-13T17:15:13.052421+0000","last_clean":"2024-09-13T17:15:13.052421+0000","last_became_active":"2024-09-13T17:15:12.678888+0000","last_became_peered":"2024-09-13T17:15:12.678888+0000","last_unstale":"2024-09-13T17:15:13.052421+0000","last_undegraded":"2024-09-13T17:15:13.052421+0000","last_fullsized":"2024-09-13T17:15:13.052421+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:10.663928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.399949+0000","last_change":"2024-09-13T17:15:13.042335+0000","last_active":"2024-09-13T17:15:14.399949+0000","last_peered":"2024-09-13T17:15:14.399949+0000","last_clean":"2024-09-13T17:15:14.399949+0000","last_became_active":"2024-09-13T17:15:13.042021+0000","last_became_peered":"2024-09-13T17:15:13.042021+0000","last_unstale":"2024-09-13T17:15:14.399949+0000","last_undegraded":"2024-09-13T17:15:14.399949+0000","last_fullsized":"2024-09-13T17:15:14.399949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:57.539578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.062256+0000","last_change":"2024-09-13T17:15:12.680815+0000","last_active":"2024-09-13T17:15:13.062256+0000","last_peered":"2024-09-13T17:15:13.062256+0000","last_clean":"2024-09-13T17:15:13.062256+0000","last_became_active":"2024-09-13T17:15:12.680560+0000","last_became_peered":"2024-09-13T17:15:12.680560+0000","last_unstale":"2024-09-13T17:15:13.062256+0000","last_undegraded":"2024-09-13T17:15:13.062256+0000","last_fullsized":"2024-09-13T17:15:13.062256+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:01.575191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043868+0000","last_change":"2024-09-13T17:15:13.040730+0000","last_active":"2024-09-13T17:15:14.043868+0000","last_peered":"2024-09-13T17:15:14.043868+0000","last_clean":"2024-09-13T17:15:14.043868+0000","last_became_active":"2024-09-13T17:15:13.040453+0000","last_became_peered":"2024-09-13T17:15:13.040453+0000","last_unstale":"2024-09-13T17:15:14.043868+0000","last_undegraded":"2024-09-13T17:15:14.043868+0000","last_fullsized":"2024-09-13T17:15:14.043868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:24.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054607+0000","last_change":"2024-09-13T17:15:12.677892+0000","last_active":"2024-09-13T17:15:13.054607+0000","last_peered":"2024-09-13T17:15:13.054607+0000","last_clean":"2024-09-13T17:15:13.054607+0000","last_became_active":"2024-09-13T17:15:12.677448+0000","last_became_peered":"2024-09-13T17:15:12.677448+0000","last_unstale":"2024-09-13T17:15:13.054607+0000","last_undegraded":"2024-09-13T17:15:13.054607+0000","last_fullsized":"2024-09-13T17:15:13.054607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:35.500337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473424+0000","last_change":"2024-09-13T17:15:13.042742+0000","last_active":"2024-09-13T17:15:14.473424+0000","last_peered":"2024-09-13T17:15:14.473424+0000","last_clean":"2024-09-13T17:15:14.473424+0000","last_became_active":"2024-09-13T17:15:13.041979+0000","last_became_peered":"2024-09-13T17:15:13.041979+0000","last_unstale":"2024-09-13T17:15:14.473424+0000","last_undegraded":"2024-09-13T17:15:14.473424+0000","last_fullsized":"2024-09-13T17:15:14.473424+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:13.096852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037460+0000","last_change":"2024-09-13T17:15:12.677740+0000","last_active":"2024-09-13T17:15:13.037460+0000","last_peered":"2024-09-13T17:15:13.037460+0000","last_clean":"2024-09-13T17:15:13.037460+0000","last_became_active":"2024-09-13T17:15:12.677476+0000","last_became_peered":"2024-09-13T17:15:12.677476+0000","last_unstale":"2024-09-13T17:15:13.037460+0000","last_undegraded":"2024-09-13T17:15:13.037460+0000","last_fullsized":"2024-09-13T17:15:13.037460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:23.546615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165719+0000","last_change":"2024-09-13T17:15:13.057446+0000","last_active":"2024-09-13T17:15:14.165719+0000","last_peered":"2024-09-13T17:15:14.165719+0000","last_clean":"2024-09-13T17:15:14.165719+0000","last_became_active":"2024-09-13T17:15:13.057160+0000","last_became_peered":"2024-09-13T17:15:13.057160+0000","last_unstale":"2024-09-13T17:15:14.165719+0000","last_undegraded":"2024-09-13T17:15:14.165719+0000","last_fullsized":"2024-09-13T17:15:14.165719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:48.626107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.036117+0000","last_change":"2024-09-13T17:15:12.674455+0000","last_active":"2024-09-13T17:15:13.036117+0000","last_peered":"2024-09-13T17:15:13.036117+0000","last_clean":"2024-09-13T17:15:13.036117+0000","last_became_active":"2024-09-13T17:15:12.674186+0000","last_became_peered":"2024-09-13T17:15:12.674186+0000","last_unstale":"2024-09-13T17:15:13.036117+0000","last_undegraded":"2024-09-13T17:15:13.036117+0000","last_fullsized":"2024-09-13T17:15:13.036117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:01.357656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473577+0000","last_change":"2024-09-13T17:15:13.040938+0000","last_active":"2024-09-13T17:15:14.473577+0000","last_peered":"2024-09-13T17:15:14.473577+0000","last_clean":"2024-09-13T17:15:14.473577+0000","last_became_active":"2024-09-13T17:15:13.040353+0000","last_became_peered":"2024-09-13T17:15:13.040353+0000","last_unstale":"2024-09-13T17:15:14.473577+0000","last_undegraded":"2024-09-13T17:15:14.473577+0000","last_fullsized":"2024-09-13T17:15:14.473577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:33.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.059336+0000","last_change":"2024-09-13T17:15:12.680398+0000","last_active":"2024-09-13T17:15:13.059336+0000","last_peered":"2024-09-13T17:15:13.059336+0000","last_clean":"2024-09-13T17:15:13.059336+0000","last_became_active":"2024-09-13T17:15:12.680131+0000","last_became_peered":"2024-09-13T17:15:12.680131+0000","last_unstale":"2024-09-13T17:15:13.059336+0000","last_undegraded":"2024-09-13T17:15:13.059336+0000","last_fullsized":"2024-09-13T17:15:13.059336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:38.202400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165438+0000","last_change":"2024-09-13T17:15:13.037486+0000","last_active":"2024-09-13T17:15:14.165438+0000","last_peered":"2024-09-13T17:15:14.165438+0000","last_clean":"2024-09-13T17:15:14.165438+0000","last_became_active":"2024-09-13T17:15:13.037228+0000","last_became_peered":"2024-09-13T17:15:13.037228+0000","last_unstale":"2024-09-13T17:15:14.165438+0000","last_undegraded":"2024-09-13T17:15:14.165438+0000","last_fullsized":"2024-09-13T17:15:14.165438+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:45.698748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.060586+0000","last_change":"2024-09-13T17:15:12.681369+0000","last_active":"2024-09-13T17:15:13.060586+0000","last_peered":"2024-09-13T17:15:13.060586+0000","last_clean":"2024-09-13T17:15:13.060586+0000","last_became_active":"2024-09-13T17:15:12.681097+0000","last_became_peered":"2024-09-13T17:15:12.681097+0000","last_unstale":"2024-09-13T17:15:13.060586+0000","last_undegraded":"2024-09-13T17:15:13.060586+0000","last_fullsized":"2024-09-13T17:15:13.060586+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:22.195123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.037996+0000","last_change":"2024-09-13T17:15:13.045546+0000","last_active":"2024-09-13T17:15:14.037996+0000","last_peered":"2024-09-13T17:15:14.037996+0000","last_clean":"2024-09-13T17:15:14.037996+0000","last_became_active":"2024-09-13T17:15:13.045300+0000","last_became_peered":"2024-09-13T17:15:13.045300+0000","last_unstale":"2024-09-13T17:15:14.037996+0000","last_undegraded":"2024-09-13T17:15:14.037996+0000","last_fullsized":"2024-09-13T17:15:14.037996+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:45.387525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.051020+0000","last_change":"2024-09-13T17:15:12.673228+0000","last_active":"2024-09-13T17:15:13.051020+0000","last_peered":"2024-09-13T17:15:13.051020+0000","last_clean":"2024-09-13T17:15:13.051020+0000","last_became_active":"2024-09-13T17:15:12.672853+0000","last_became_peered":"2024-09-13T17:15:12.672853+0000","last_unstale":"2024-09-13T17:15:13.051020+0000","last_undegraded":"2024-09-13T17:15:13.051020+0000","last_fullsized":"2024-09-13T17:15:13.051020+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.454707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.399880+0000","last_change":"2024-09-13T17:15:13.048881+0000","last_active":"2024-09-13T17:15:14.399880+0000","last_peered":"2024-09-13T17:15:14.399880+0000","last_clean":"2024-09-13T17:15:14.399880+0000","last_became_active":"2024-09-13T17:15:13.047899+0000","last_became_peered":"2024-09-13T17:15:13.047899+0000","last_unstale":"2024-09-13T17:15:14.399880+0000","last_undegraded":"2024-09-13T17:15:14.399880+0000","last_fullsized":"2024-09-13T17:15:14.399880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:21.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.052421+0000","last_change":"2024-09-13T17:15:12.679985+0000","last_active":"2024-09-13T17:15:13.052421+0000","last_peered":"2024-09-13T17:15:13.052421+0000","last_clean":"2024-09-13T17:15:13.052421+0000","last_became_active":"2024-09-13T17:15:12.679614+0000","last_became_peered":"2024-09-13T17:15:12.679614+0000","last_unstale":"2024-09-13T17:15:13.052421+0000","last_undegraded":"2024-09-13T17:15:13.052421+0000","last_fullsized":"2024-09-13T17:15:13.052421+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038097+0000","last_change":"2024-09-13T17:15:13.035958+0000","last_active":"2024-09-13T17:15:14.038097+0000","last_peered":"2024-09-13T17:15:14.038097+0000","last_clean":"2024-09-13T17:15:14.038097+0000","last_became_active":"2024-09-13T17:15:13.035601+0000","last_became_peered":"2024-09-13T17:15:13.035601+0000","last_unstale":"2024-09-13T17:15:14.038097+0000","last_undegraded":"2024-09-13T17:15:14.038097+0000","last_fullsized":"2024-09-13T17:15:14.038097+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:48.285491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.037455+0000","last_change":"2024-09-13T17:15:12.682388+0000","last_active":"2024-09-13T17:15:13.037455+0000","last_peered":"2024-09-13T17:15:13.037455+0000","last_clean":"2024-09-13T17:15:13.037455+0000","last_became_active":"2024-09-13T17:15:12.682176+0000","last_became_peered":"2024-09-13T17:15:12.682176+0000","last_unstale":"2024-09-13T17:15:13.037455+0000","last_undegraded":"2024-09-13T17:15:13.037455+0000","last_fullsized":"2024-09-13T17:15:13.037455+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.338605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.044005+0000","last_change":"2024-09-13T17:15:13.043559+0000","last_active":"2024-09-13T17:15:14.044005+0000","last_peered":"2024-09-13T17:15:14.044005+0000","last_clean":"2024-09-13T17:15:14.044005+0000","last_became_active":"2024-09-13T17:15:13.043295+0000","last_became_peered":"2024-09-13T17:15:13.043295+0000","last_unstale":"2024-09-13T17:15:14.044005+0000","last_undegraded":"2024-09-13T17:15:14.044005+0000","last_fullsized":"2024-09-13T17:15:14.044005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:13.835229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.056954+0000","last_change":"2024-09-13T17:15:12.674523+0000","last_active":"2024-09-13T17:15:13.056954+0000","last_peered":"2024-09-13T17:15:13.056954+0000","last_clean":"2024-09-13T17:15:13.056954+0000","last_became_active":"2024-09-13T17:15:12.674253+0000","last_became_peered":"2024-09-13T17:15:12.674253+0000","last_unstale":"2024-09-13T17:15:13.056954+0000","last_undegraded":"2024-09-13T17:15:13.056954+0000","last_fullsized":"2024-09-13T17:15:13.056954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:22.671020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056182+0000","last_change":"2024-09-13T17:15:13.047756+0000","last_active":"2024-09-13T17:15:14.056182+0000","last_peered":"2024-09-13T17:15:14.056182+0000","last_clean":"2024-09-13T17:15:14.056182+0000","last_became_active":"2024-09-13T17:15:13.047484+0000","last_became_peered":"2024-09-13T17:15:13.047484+0000","last_unstale":"2024-09-13T17:15:14.056182+0000","last_undegraded":"2024-09-13T17:15:14.056182+0000","last_fullsized":"2024-09-13T17:15:14.056182+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:54.327022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.033455+0000","last_change":"2024-09-13T17:15:12.680580+0000","last_active":"2024-09-13T17:15:13.033455+0000","last_peered":"2024-09-13T17:15:13.033455+0000","last_clean":"2024-09-13T17:15:13.033455+0000","last_became_active":"2024-09-13T17:15:12.680042+0000","last_became_peered":"2024-09-13T17:15:12.680042+0000","last_unstale":"2024-09-13T17:15:13.033455+0000","last_undegraded":"2024-09-13T17:15:13.033455+0000","last_fullsized":"2024-09-13T17:15:13.033455+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:00.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473482+0000","last_change":"2024-09-13T17:15:13.048780+0000","last_active":"2024-09-13T17:15:14.473482+0000","last_peered":"2024-09-13T17:15:14.473482+0000","last_clean":"2024-09-13T17:15:14.473482+0000","last_became_active":"2024-09-13T17:15:13.048518+0000","last_became_peered":"2024-09-13T17:15:13.048518+0000","last_unstale":"2024-09-13T17:15:14.473482+0000","last_undegraded":"2024-09-13T17:15:14.473482+0000","last_fullsized":"2024-09-13T17:15:14.473482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:11.303661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.035577+0000","last_change":"2024-09-13T17:15:12.678425+0000","last_active":"2024-09-13T17:15:13.035577+0000","last_peered":"2024-09-13T17:15:13.035577+0000","last_clean":"2024-09-13T17:15:13.035577+0000","last_became_active":"2024-09-13T17:15:12.678173+0000","last_became_peered":"2024-09-13T17:15:12.678173+0000","last_unstale":"2024-09-13T17:15:13.035577+0000","last_undegraded":"2024-09-13T17:15:13.035577+0000","last_fullsized":"2024-09-13T17:15:13.035577+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:36.586080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038429+0000","last_change":"2024-09-13T17:15:13.055819+0000","last_active":"2024-09-13T17:15:14.038429+0000","last_peered":"2024-09-13T17:15:14.038429+0000","last_clean":"2024-09-13T17:15:14.038429+0000","last_became_active":"2024-09-13T17:15:13.055552+0000","last_became_peered":"2024-09-13T17:15:13.055552+0000","last_unstale":"2024-09-13T17:15:14.038429+0000","last_undegraded":"2024-09-13T17:15:14.038429+0000","last_fullsized":"2024-09-13T17:15:14.038429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:01.146043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.030882+0000","last_change":"2024-09-13T17:15:12.670441+0000","last_active":"2024-09-13T17:15:13.030882+0000","last_peered":"2024-09-13T17:15:13.030882+0000","last_clean":"2024-09-13T17:15:13.030882+0000","last_became_active":"2024-09-13T17:15:12.670178+0000","last_became_peered":"2024-09-13T17:15:12.670178+0000","last_unstale":"2024-09-13T17:15:13.030882+0000","last_undegraded":"2024-09-13T17:15:13.030882+0000","last_fullsized":"2024-09-13T17:15:13.030882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:48.277406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043742+0000","last_change":"2024-09-13T17:15:13.038895+0000","last_active":"2024-09-13T17:15:14.043742+0000","last_peered":"2024-09-13T17:15:14.043742+0000","last_clean":"2024-09-13T17:15:14.043742+0000","last_became_active":"2024-09-13T17:15:13.038413+0000","last_became_peered":"2024-09-13T17:15:13.038413+0000","last_unstale":"2024-09-13T17:15:14.043742+0000","last_undegraded":"2024-09-13T17:15:14.043742+0000","last_fullsized":"2024-09-13T17:15:14.043742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:15.460810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.054791+0000","last_change":"2024-09-13T17:15:12.679115+0000","last_active":"2024-09-13T17:15:13.054791+0000","last_peered":"2024-09-13T17:15:13.054791+0000","last_clean":"2024-09-13T17:15:13.054791+0000","last_became_active":"2024-09-13T17:15:12.678836+0000","last_became_peered":"2024-09-13T17:15:12.678836+0000","last_unstale":"2024-09-13T17:15:13.054791+0000","last_undegraded":"2024-09-13T17:15:13.054791+0000","last_fullsized":"2024-09-13T17:15:13.054791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:27.705126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.038078+0000","last_change":"2024-09-13T17:15:13.037747+0000","last_active":"2024-09-13T17:15:14.038078+0000","last_peered":"2024-09-13T17:15:14.038078+0000","last_clean":"2024-09-13T17:15:14.038078+0000","last_became_active":"2024-09-13T17:15:13.037122+0000","last_became_peered":"2024-09-13T17:15:13.037122+0000","last_unstale":"2024-09-13T17:15:14.038078+0000","last_undegraded":"2024-09-13T17:15:14.038078+0000","last_fullsized":"2024-09-13T17:15:14.038078+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:24.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.035611+0000","last_change":"2024-09-13T17:15:12.675454+0000","last_active":"2024-09-13T17:15:13.035611+0000","last_peered":"2024-09-13T17:15:13.035611+0000","last_clean":"2024-09-13T17:15:13.035611+0000","last_became_active":"2024-09-13T17:15:12.675160+0000","last_became_peered":"2024-09-13T17:15:12.675160+0000","last_unstale":"2024-09-13T17:15:13.035611+0000","last_undegraded":"2024-09-13T17:15:13.035611+0000","last_fullsized":"2024-09-13T17:15:13.035611+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:41.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165577+0000","last_change":"2024-09-13T17:15:13.057449+0000","last_active":"2024-09-13T17:15:14.165577+0000","last_peered":"2024-09-13T17:15:14.165577+0000","last_clean":"2024-09-13T17:15:14.165577+0000","last_became_active":"2024-09-13T17:15:13.057205+0000","last_became_peered":"2024-09-13T17:15:13.057205+0000","last_unstale":"2024-09-13T17:15:14.165577+0000","last_undegraded":"2024-09-13T17:15:14.165577+0000","last_fullsized":"2024-09-13T17:15:14.165577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:52.072321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.038671+0000","last_change":"2024-09-13T17:15:12.682289+0000","last_active":"2024-09-13T17:15:13.038671+0000","last_peered":"2024-09-13T17:15:13.038671+0000","last_clean":"2024-09-13T17:15:13.038671+0000","last_became_active":"2024-09-13T17:15:12.681333+0000","last_became_peered":"2024-09-13T17:15:12.681333+0000","last_unstale":"2024-09-13T17:15:13.038671+0000","last_undegraded":"2024-09-13T17:15:13.038671+0000","last_fullsized":"2024-09-13T17:15:13.038671+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:56.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473250+0000","last_change":"2024-09-13T17:15:13.057986+0000","last_active":"2024-09-13T17:15:14.473250+0000","last_peered":"2024-09-13T17:15:14.473250+0000","last_clean":"2024-09-13T17:15:14.473250+0000","last_became_active":"2024-09-13T17:15:13.057770+0000","last_became_peered":"2024-09-13T17:15:13.057770+0000","last_unstale":"2024-09-13T17:15:14.473250+0000","last_undegraded":"2024-09-13T17:15:14.473250+0000","last_fullsized":"2024-09-13T17:15:14.473250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:48.626107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.032306+0000","last_change":"2024-09-13T17:15:12.680405+0000","last_active":"2024-09-13T17:15:13.032306+0000","last_peered":"2024-09-13T17:15:13.032306+0000","last_clean":"2024-09-13T17:15:13.032306+0000","last_became_active":"2024-09-13T17:15:12.680183+0000","last_became_peered":"2024-09-13T17:15:12.680183+0000","last_unstale":"2024-09-13T17:15:13.032306+0000","last_undegraded":"2024-09-13T17:15:13.032306+0000","last_fullsized":"2024-09-13T17:15:13.032306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:28.326971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.043811+0000","last_change":"2024-09-13T17:15:13.040185+0000","last_active":"2024-09-13T17:15:14.043811+0000","last_peered":"2024-09-13T17:15:14.043811+0000","last_clean":"2024-09-13T17:15:14.043811+0000","last_became_active":"2024-09-13T17:15:13.039917+0000","last_became_peered":"2024-09-13T17:15:13.039917+0000","last_unstale":"2024-09-13T17:15:14.043811+0000","last_undegraded":"2024-09-13T17:15:14.043811+0000","last_fullsized":"2024-09-13T17:15:14.043811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:11.896433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.033546+0000","last_change":"2024-09-13T17:15:12.682641+0000","last_active":"2024-09-13T17:15:13.033546+0000","last_peered":"2024-09-13T17:15:13.033546+0000","last_clean":"2024-09-13T17:15:13.033546+0000","last_became_active":"2024-09-13T17:15:12.682231+0000","last_became_peered":"2024-09-13T17:15:12.682231+0000","last_unstale":"2024-09-13T17:15:13.033546+0000","last_undegraded":"2024-09-13T17:15:13.033546+0000","last_fullsized":"2024-09-13T17:15:13.033546+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.522460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.473456+0000","last_change":"2024-09-13T17:15:13.048683+0000","last_active":"2024-09-13T17:15:14.473456+0000","last_peered":"2024-09-13T17:15:14.473456+0000","last_clean":"2024-09-13T17:15:14.473456+0000","last_became_active":"2024-09-13T17:15:13.048407+0000","last_became_peered":"2024-09-13T17:15:13.048407+0000","last_unstale":"2024-09-13T17:15:14.473456+0000","last_undegraded":"2024-09-13T17:15:14.473456+0000","last_fullsized":"2024-09-13T17:15:14.473456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:36.956138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.034067+0000","last_change":"2024-09-13T17:15:12.678552+0000","last_active":"2024-09-13T17:15:13.034067+0000","last_peered":"2024-09-13T17:15:13.034067+0000","last_clean":"2024-09-13T17:15:13.034067+0000","last_became_active":"2024-09-13T17:15:12.678280+0000","last_became_peered":"2024-09-13T17:15:12.678280+0000","last_unstale":"2024-09-13T17:15:13.034067+0000","last_undegraded":"2024-09-13T17:15:13.034067+0000","last_fullsized":"2024-09-13T17:15:13.034067+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:53.321418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.165830+0000","last_change":"2024-09-13T17:15:13.044658+0000","last_active":"2024-09-13T17:15:14.165830+0000","last_peered":"2024-09-13T17:15:14.165830+0000","last_clean":"2024-09-13T17:15:14.165830+0000","last_became_active":"2024-09-13T17:15:13.044419+0000","last_became_peered":"2024-09-13T17:15:13.044419+0000","last_unstale":"2024-09-13T17:15:14.165830+0000","last_undegraded":"2024-09-13T17:15:14.165830+0000","last_fullsized":"2024-09-13T17:15:14.165830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:22:13.096852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.030708+0000","last_change":"2024-09-13T17:15:12.680295+0000","last_active":"2024-09-13T17:15:13.030708+0000","last_peered":"2024-09-13T17:15:13.030708+0000","last_clean":"2024-09-13T17:15:13.030708+0000","last_became_active":"2024-09-13T17:15:12.680060+0000","last_became_peered":"2024-09-13T17:15:12.680060+0000","last_unstale":"2024-09-13T17:15:13.030708+0000","last_undegraded":"2024-09-13T17:15:13.030708+0000","last_fullsized":"2024-09-13T17:15:13.030708+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T17:15:14.056037+0000","last_change":"2024-09-13T17:15:13.045450+0000","last_active":"2024-09-13T17:15:14.056037+0000","last_peered":"2024-09-13T17:15:14.056037+0000","last_clean":"2024-09-13T17:15:14.056037+0000","last_became_active":"2024-09-13T17:15:13.044693+0000","last_became_peered":"2024-09-13T17:15:13.044693+0000","last_unstale":"2024-09-13T17:15:14.056037+0000","last_undegraded":"2024-09-13T17:15:14.056037+0000","last_fullsized":"2024-09-13T17:15:14.056037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:12.655781+0000","last_clean_scrub_stamp":"2024-09-13T17:15:12.655781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:35.153243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.039355+0000","last_change":"2024-09-13T17:15:12.683056+0000","last_active":"2024-09-13T17:15:13.039355+0000","last_peered":"2024-09-13T17:15:13.039355+0000","last_clean":"2024-09-13T17:15:13.039355+0000","last_became_active":"2024-09-13T17:15:12.682681+0000","last_became_peered":"2024-09-13T17:15:12.682681+0000","last_unstale":"2024-09-13T17:15:13.039355+0000","last_undegraded":"2024-09-13T17:15:13.039355+0000","last_fullsized":"2024-09-13T17:15:13.039355+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:15:11.650177+0000","last_clean_scrub_stamp":"2024-09-13T17:15:11.650177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:06.189831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T17:15:13.035098+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:15:13.035098+0000","last_peered":"2024-09-13T17:15:13.035098+0000","last_clean":"2024-09-13T17:15:13.035098+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:15:13.035098+0000","last_undegraded":"2024-09-13T17:15:13.035098+0000","last_fullsized":"2024-09-13T17:15:13.035098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":874253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.372},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.626}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":284413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63600000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.439}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56999999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.372,"15min":0.372},"max":{"1min":0.68100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.497},{"interface":"front","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65500000000000003,"5min":0.752,"15min":0.752},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.374}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69799999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":283761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.622}]},{"osd":1,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.88,"15min":0.88},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.443,"15min":0.432},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":284343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47299999999999998,"15min":0.46300000000000002},"min":{"1min":0.35699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.034,"15min":1.034},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.64700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56299999999999994,"15min":0.57599999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:15:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.628},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.62,"15min":0.63200000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":659456,"data_stored":285347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.43099999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39400000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.67000000000000004,"5min":1.458,"15min":1.458},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.434,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.52800000000000002,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.54200000000000004,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.433,"15min":0.44},"min":{"1min":0.312,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51900000000000002,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.73799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79100000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.443},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":1.226,"15min":1.226},"last":0.49299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":655360,"data_stored":285325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.379,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.378,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36799999999999999,"15min":0.36899999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.51600000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.503,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.373},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48899999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.627}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77600000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":0.871,"15min":0.871},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.625,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77100000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":283921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56200000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39700000000000002,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.53300000000000003,"5min":1.159,"15min":1.159},"last":0.433}]},{"osd":2,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.52400000000000002,"5min":1.081,"15min":1.081},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72999999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.499},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.747,"5min":1.286,"15min":1.286},"last":0.315}]},{"osd":4,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80200000000000005,"5min":1.046,"15min":1.046},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Sep 13 17:15:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.254,"15min":1.254},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1245184,"data_stored":874185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56699999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55900000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41199999999999998,"15min":0.41299999999999998},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.377}]},{"osd":4,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82099999999999995,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.434,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86499999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73699999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:15:20.723 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:15:20.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.865+0000 7feab7a8b640 1 Processor -- start 2024-09-13T17:15:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.865+0000 7feab7a8b640 1 -- start start 2024-09-13T17:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab7a8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab00abe60 0x7feab00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab7a8b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feab006da30 0x7feab006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab7a8b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00ad050 con 0x7feab01591e0 2024-09-13T17:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab7a8b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab006e420 con 0x7feab006da30 2024-09-13T17:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab7a8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00ac440 con 0x7feab00abe60 2024-09-13T17:15:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feab006da30 0x7feab006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feab006da30 0x7feab006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54040/0 (socket says 172.21.15.5:54040) 2024-09-13T17:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 -- 172.21.15.5:0/3817664502 learned_addr learned my addr 172.21.15.5:0/3817664502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab5026640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab00abe60 0x7feab00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 -- 172.21.15.5:0/3817664502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab00abe60 msgr2=0x7feab00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab00abe60 0x7feab00b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 -- 172.21.15.5:0/3817664502 >> v1:172.21.15.179:6789/0 conn(0x7feab01591e0 legacy=0x7feab00ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.866+0000 7feab6028640 1 -- 172.21.15.5:0/3817664502 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00ac720 con 0x7feab006da30 2024-09-13T17:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.867+0000 7feab6028640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab006da30 0x7feab006dee0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea3c61289b61d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.867+0000 7feab4825640 1 -- 172.21.15.5:0/3817664502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8031600 con 0x7feab006da30 2024-09-13T17:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.867+0000 7feab4825640 1 -- 172.21.15.5:0/3817664502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa802d050 con 0x7feab006da30 2024-09-13T17:15:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.867+0000 7feab4825640 1 -- 172.21.15.5:0/3817664502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8031980 con 0x7feab006da30 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 -- 172.21.15.5:0/3817664502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab006da30 msgr2=0x7feab006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab006da30 0x7feab006dee0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa802a710 comp rx=0 tx=0).stop 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 -- 172.21.15.5:0/3817664502 shutdown_connections 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab006da30 0x7feab006dee0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 --2- 172.21.15.5:0/3817664502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab00abe60 0x7feab00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 -- 172.21.15.5:0/3817664502 >> 172.21.15.5:0/3817664502 conn(0x7feab00ce130 msgr2=0x7feab00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 -- 172.21.15.5:0/3817664502 shutdown_connections 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.868+0000 7feab7a8b640 1 -- 172.21.15.5:0/3817664502 wait complete. 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.869+0000 7feab7a8b640 1 Processor -- start 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.869+0000 7feab7a8b640 1 -- start start 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab006da30 0x7feab014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab00abe60 0x7feab00ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab014f6e0 con 0x7feab01591e0 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab014ead0 con 0x7feab00abe60 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab7a8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab014edb0 con 0x7feab006da30 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54050/0 (socket says 172.21.15.5:54050) 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 -- 172.21.15.5:0/45974406 learned_addr learned my addr 172.21.15.5:0/45974406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab5827640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab006da30 0x7feab014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab5026640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab00abe60 0x7feab00ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 -- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab006da30 msgr2=0x7feab014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab006da30 0x7feab014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 -- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab00abe60 msgr2=0x7feab00ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab00abe60 0x7feab00ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.870+0000 7feab6028640 1 -- 172.21.15.5:0/45974406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8009b30 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feab6028640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa803b820 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa803b980 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa803bd30 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab014f090 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.871+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab014e6c0 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.872+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab00672a0 con 0x7feab01591e0 2024-09-13T17:15:20.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.872+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feaa8038050 con 0x7feab01591e0 2024-09-13T17:15:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.873+0000 7feaa67fc640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 0x7fea9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.873+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feaa80a9e40 con 0x7feab01591e0 2024-09-13T17:15:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.873+0000 7feab5827640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 0x7fea9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.874+0000 7feab5827640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 0x7fea9406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feaac000f60 tx=0x7feaac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:20.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:20.877+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feaa8074f80 con 0x7feab01591e0 2024-09-13T17:15:21.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.113+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7feab006dee0 con 0x7feab01591e0 2024-09-13T17:15:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.117+0000 7feaa67fc640 1 -- 172.21.15.5:0/45974406 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7feaa804b0e0 con 0x7feab01591e0 2024-09-13T17:15:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 msgr2=0x7fea9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 0x7fea9406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feaac000f60 tx=0x7feaac009040 comp rx=0 tx=0).stop 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 msgr2=0x7feab00aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009e50 tx=0x7feaa8004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 shutdown_connections 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fea9406ac00 0x7fea9406d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab01591e0 0x7feab00aec30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab00abe60 0x7feab00ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 --2- 172.21.15.5:0/45974406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab006da30 0x7feab014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 >> 172.21.15.5:0/45974406 conn(0x7feab00ce130 msgr2=0x7feab0164290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 shutdown_connections 2024-09-13T17:15:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.119+0000 7feab7a8b640 1 -- 172.21.15.5:0/45974406 wait complete. 2024-09-13T17:15:21.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:21.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.231+0000 7fd283e32640 1 Processor -- start 2024-09-13T17:15:21.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.231+0000 7fd283e32640 1 -- start start 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd283e32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd27c15d960 0x7fd27c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd283e32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 0x7fd27c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd283e32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c15cbc0 con 0x7fd27c15a180 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd283e32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0b1e30 con 0x7fd27c15d960 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd283e32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0ad1d0 con 0x7fd27c06ec60 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2813cd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd27c15d960 0x7fd27c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2813cd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd27c15d960 0x7fd27c070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54052/0 (socket says 172.21.15.5:54052) 2024-09-13T17:15:21.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2813cd640 1 -- 172.21.15.5:0/377636680 learned_addr learned my addr 172.21.15.5:0/377636680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2823cf640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 0x7fd27c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2813cd640 1 -- 172.21.15.5:0/377636680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 msgr2=0x7fd27c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.232+0000 7fd2813cd640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 0x7fd27c070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd2813cd640 1 -- 172.21.15.5:0/377636680 >> v1:172.21.15.179:6789/0 conn(0x7fd27c15a180 legacy=0x7fd27c0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd2813cd640 1 -- 172.21.15.5:0/377636680 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0b2020 con 0x7fd27c15d960 2024-09-13T17:15:21.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd2823cf640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 0x7fd27c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd2813cd640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c15d960 0x7fd27c070510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd270009870 tx=0x7fd27002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed9c0d998a41df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd280bcc640 1 -- 172.21.15.5:0/377636680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270032440 con 0x7fd27c15d960 2024-09-13T17:15:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.233+0000 7fd280bcc640 1 -- 172.21.15.5:0/377636680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2700325a0 con 0x7fd27c15d960 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd280bcc640 1 -- 172.21.15.5:0/377636680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270032930 con 0x7fd27c15d960 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 -- 172.21.15.5:0/377636680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c15d960 msgr2=0x7fd27c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c15d960 0x7fd27c070510 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd270009870 tx=0x7fd27002a270 comp rx=0 tx=0).stop 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 -- 172.21.15.5:0/377636680 shutdown_connections 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c06ec60 0x7fd27c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 --2- 172.21.15.5:0/377636680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c15d960 0x7fd27c070510 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 -- 172.21.15.5:0/377636680 >> 172.21.15.5:0/377636680 conn(0x7fd27c0b0420 msgr2=0x7fd27c0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 -- 172.21.15.5:0/377636680 shutdown_connections 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.234+0000 7fd283e32640 1 -- 172.21.15.5:0/377636680 wait complete. 2024-09-13T17:15:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.235+0000 7fd283e32640 1 Processor -- start 2024-09-13T17:15:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.235+0000 7fd283e32640 1 -- start start 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c15a180 0x7fd27c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 0x7fd27c06e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c153d00 con 0x7fd27c06ec60 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c06ea40 con 0x7fd27c15d960 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd283e32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0ce4a0 con 0x7fd27c15a180 2024-09-13T17:15:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 -- 172.21.15.5:0/448108009 learned_addr learned my addr 172.21.15.5:0/448108009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd2813cd640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c15a180 0x7fd27c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd2823cf640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 0x7fd27c06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 -- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c15a180 msgr2=0x7fd27c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c15a180 0x7fd27c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 -- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 msgr2=0x7fd27c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 0x7fd27c06e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd281bce640 1 -- 172.21.15.5:0/448108009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700094d0 con 0x7fd27c06ec60 2024-09-13T17:15:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.236+0000 7fd2823cf640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 0x7fd27c06e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd281bce640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c870 tx=0x7fd26c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c003b70 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c003cf0 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c153360 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00aa90 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.237+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c153920 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.238+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c0b1720 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.238+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd26c00abf0 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.239+0000 7fd27a7fc640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 0x7fd26806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.239+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd26c0892f0 con 0x7fd27c06ec60 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.239+0000 7fd2813cd640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 0x7fd26806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.240+0000 7fd2813cd640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 0x7fd26806d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd270034000 tx=0x7fd27002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.243+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd26c054420 con 0x7fd27c06ec60 2024-09-13T17:15:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.449+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd27c0caec0 con 0x7fd27c06ec60 2024-09-13T17:15:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.450+0000 7fd27a7fc640 1 -- 172.21.15.5:0/448108009 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fd26c057a40 con 0x7fd27c06ec60 2024-09-13T17:15:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:21.451 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:15.036494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6102},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:15:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 msgr2=0x7fd26806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 0x7fd26806d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd270034000 tx=0x7fd27002e000 comp rx=0 tx=0).stop 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 msgr2=0x7fd27c154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c870 tx=0x7fd26c00cd30 comp rx=0 tx=0).stop 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 shutdown_connections 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c15d960 0x7fd27c06e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd27c15a180 0x7fd27c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd26806ac00 0x7fd26806d0c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 --2- 172.21.15.5:0/448108009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd27c06ec60 0x7fd27c154120 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 >> 172.21.15.5:0/448108009 conn(0x7fd27c0b0420 msgr2=0x7fd27c0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 shutdown_connections 2024-09-13T17:15:21.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.452+0000 7fd283e32640 1 -- 172.21.15.5:0/448108009 wait complete. 2024-09-13T17:15:21.866 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:15:13.025097+0000', 'modified': '2024-09-13T17:15:15.036494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6102}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6102': {'gid': 6102, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/8976367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 8976367}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 8976367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:15:21.867 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:15:21.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:15:21.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.974+0000 7f276355e640 1 Processor -- start 2024-09-13T17:15:21.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.974+0000 7f276355e640 1 -- start start 2024-09-13T17:15:21.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f276355e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f276355e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f275c0b1ac0 0x7f275c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f276355e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c0b35f0 con 0x7f275c06ef60 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f276355e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c160020 con 0x7f275c0b1ac0 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f276355e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c156f50 con 0x7f275c06eb80 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f275c0b1ac0 0x7f275c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f275c0b1ac0 0x7f275c15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54082/0 (socket says 172.21.15.5:54082) 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 -- 172.21.15.5:0/2122684301 learned_addr learned my addr 172.21.15.5:0/2122684301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f27612fa640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 -- 172.21.15.5:0/2122684301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 msgr2=0x7f275c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c0b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 -- 172.21.15.5:0/2122684301 >> v1:172.21.15.179:6789/0 conn(0x7f275c06ef60 legacy=0x7f275c06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.975+0000 7f2760af9640 1 -- 172.21.15.5:0/2122684301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0b3f60 con 0x7f275c0b1ac0 2024-09-13T17:15:21.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.976+0000 7f2760af9640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c0b1ac0 0x7f275c15ca30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f274c009870 tx=0x7f274c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9bcc4e5295fdb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.976+0000 7f2753fff640 1 -- 172.21.15.5:0/2122684301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c032440 con 0x7f275c0b1ac0 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.976+0000 7f2753fff640 1 -- 172.21.15.5:0/2122684301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0325a0 con 0x7f275c0b1ac0 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.976+0000 7f2753fff640 1 -- 172.21.15.5:0/2122684301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c032930 con 0x7f275c0b1ac0 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 -- 172.21.15.5:0/2122684301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c0b1ac0 msgr2=0x7f275c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c0b1ac0 0x7f275c15ca30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f274c009870 tx=0x7f274c02a270 comp rx=0 tx=0).stop 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 -- 172.21.15.5:0/2122684301 shutdown_connections 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c0b1ac0 0x7f275c15ca30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 --2- 172.21.15.5:0/2122684301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c0b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 -- 172.21.15.5:0/2122684301 >> 172.21.15.5:0/2122684301 conn(0x7f275c070af0 msgr2=0x7f275c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 -- 172.21.15.5:0/2122684301 shutdown_connections 2024-09-13T17:15:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.977+0000 7f276355e640 1 -- 172.21.15.5:0/2122684301 wait complete. 2024-09-13T17:15:21.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.978+0000 7f276355e640 1 Processor -- start 2024-09-13T17:15:21.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.978+0000 7f276355e640 1 -- start start 2024-09-13T17:15:21.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275c0b1ac0 0x7f275c144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0cd990 con 0x7f275c06ef60 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0cc3b0 con 0x7f275c0b1ac0 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f276355e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0cc690 con 0x7f275c06eb80 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54098/0 (socket says 172.21.15.5:54098) 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 -- 172.21.15.5:0/3477614987 learned_addr learned my addr 172.21.15.5:0/3477614987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f27612fa640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2761afb640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275c0b1ac0 0x7f275c144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 -- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 msgr2=0x7f275c1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c1f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 -- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275c0b1ac0 msgr2=0x7f275c144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275c0b1ac0 0x7f275c144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.979+0000 7f2760af9640 1 -- 172.21.15.5:0/3477614987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0094d0 con 0x7f275c06ef60 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f2760af9640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f274c02a2b0 tx=0x7f274c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f2751ffb640 1 -- 172.21.15.5:0/3477614987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c032440 con 0x7f275c06ef60 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f2751ffb640 1 -- 172.21.15.5:0/3477614987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c030ba0 con 0x7f275c06ef60 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f2751ffb640 1 -- 172.21.15.5:0/3477614987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c03d440 con 0x7f275c06ef60 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0cc970 con 0x7f275c06ef60 2024-09-13T17:15:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.980+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c0ccf30 con 0x7f275c06ef60 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.982+0000 7f2751ffb640 1 -- 172.21.15.5:0/3477614987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f274c039040 con 0x7f275c06ef60 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.982+0000 7f2751ffb640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 0x7f274006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.982+0000 7f2751ffb640 1 -- 172.21.15.5:0/3477614987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f274c0a9f00 con 0x7f275c06ef60 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.982+0000 7f27612fa640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 0x7f274006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.983+0000 7f27612fa640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 0x7f274006d0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2758009b40 tx=0x7f2758009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.983+0000 7f276627e740 1 Processor -- start 2024-09-13T17:15:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.983+0000 7f276627e740 1 -- start start 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f79153480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f79150860 0x555f791a0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f790ad7c0 con 0x555f7917a550 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f790bcb70 con 0x555f791530a0 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f790ba300 con 0x555f79150860 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54108/0 (socket says 172.21.15.5:54108) 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 -- 172.21.15.5:0/3231425310 learned_addr learned my addr 172.21.15.5:0/3231425310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2760af9640 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f79150860 0x555f791a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f27612fa640 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f79153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 -- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f79150860 msgr2=0x555f791a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f79150860 0x555f791a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 -- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 msgr2=0x555f79153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f79153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 -- 172.21.15.5:0/3231425310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f790424b0 con 0x555f7917a550 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f2761afb640 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2754001d40 tx=0x7f2754001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12fcb750cf06159 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.984+0000 7f273effd640 1 -- 172.21.15.5:0/3231425310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754003b80 con 0x555f7917a550 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f273effd640 1 -- 172.21.15.5:0/3231425310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754003ce0 con 0x555f7917a550 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f273effd640 1 -- 172.21.15.5:0/3231425310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275400fb50 con 0x555f7917a550 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 -- 172.21.15.5:0/3231425310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 msgr2=0x555f791a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2754001d40 tx=0x7f2754001670 comp rx=0 tx=0).stop 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 -- 172.21.15.5:0/3231425310 shutdown_connections 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791a0ab0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f79150860 0x555f791a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 --2- 172.21.15.5:0/3231425310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f79153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 -- 172.21.15.5:0/3231425310 >> 172.21.15.5:0/3231425310 conn(0x555f7914f7d0 msgr2=0x555f79197c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 -- 172.21.15.5:0/3231425310 shutdown_connections 2024-09-13T17:15:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.985+0000 7f276627e740 1 -- 172.21.15.5:0/3231425310 wait complete. 2024-09-13T17:15:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.986+0000 7f276627e740 1 -- start start 2024-09-13T17:15:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.986+0000 7f276627e740 1 Processor -- start 2024-09-13T17:15:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7917e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f7914dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f790b5bf0 con 0x555f7917a550 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79074250 con 0x555f791530a0 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79073ef0 con 0x555f7914da20 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f276627e740 10 client.0 _ll_register_callbacks cb 0x555f790a6740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54114/0 (socket says 172.21.15.5:54114) 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 -- 172.21.15.5:0/2528995499 learned_addr learned my addr 172.21.15.5:0/2528995499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f27612fa640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7917e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2761afb640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f7914dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 -- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 msgr2=0x555f7914dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f7914dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 -- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 msgr2=0x555f7917e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7917e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 -- 172.21.15.5:0/2528995499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c0b35f0 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2760af9640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f274c080b20 tx=0x7f274c07cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f067e110a642982 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2737fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.987+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c077170 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f274c078200 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f78da93c0 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274c0783c0 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 10 client.6279 fetch_fsmap learned FSMap version 21 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x555f790b4270 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f78da93c0 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f274c04d020 con 0x555f7917a550 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 10 client.6279 fetch_fsmap finished waiting for FSMap version 21 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 10 client.6279 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 20 client.6279 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79165420 0x555f79166530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 4 client.6279 mds_command: new command op to 6102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 --> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f78dba6c0 con 0x555f79165420 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f27612fa640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79165420 0x555f79166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f27612fa640 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79165420 0x555f79166530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01491b06c823053 server_cookie=805bf54c291d5ce in_seq=0 out_seq=0 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.988+0000 7f2737fff640 10 client.6279 ms_handle_connect on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f2737fff640 1 -- 172.21.15.5:0/2528995499 <== mds.0 v2:172.21.15.5:6832/8976367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555f78dba6c0 con 0x555f79165420 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f2737fff640 10 client.6279 handle_command_reply: tid=0 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 client.6279 shutdown 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 msgr2=0x555f79195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f274c080b20 tx=0x7f274c07cb50 comp rx=0 tx=0).stop 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 shutdown_connections 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79165420 0x555f79166530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f7914dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f79195370 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f2737fff640 0 client.6279 ms_handle_reset on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 --2- 172.21.15.5:0/2528995499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7917e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 >> 172.21.15.5:0/2528995499 conn(0x555f79150860 msgr2=0x555f7919b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 shutdown_connections 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.989+0000 7f276627e740 1 -- 172.21.15.5:0/2528995499 wait complete. 2024-09-13T17:15:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:21.990+0000 7f276627e740 20 client.6279 trim_cache size 0 max 16384 2024-09-13T17:15:22.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 Processor -- start 2024-09-13T17:15:22.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 -- start start 2024-09-13T17:15:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f7914da20 0x555f79152320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7917a550 0x555f791b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79039460 con 0x555f791530a0 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f791519b0 con 0x555f7914da20 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.005+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79179770 con 0x555f7917a550 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54122/0 (socket says 172.21.15.5:54122) 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 -- 172.21.15.5:0/2734196199 learned_addr learned my addr 172.21.15.5:0/2734196199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f27612fa640 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f7914da20 0x555f79152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2761afb640 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7917a550 0x555f791b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 -- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7917a550 msgr2=0x555f791b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7917a550 0x555f791b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 -- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f7914da20 msgr2=0x555f79152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f7914da20 0x555f79152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 -- 172.21.15.5:0/2734196199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f790565f0 con 0x555f791530a0 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f2760af9640 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f274c075730 tx=0x7f274c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caa0b0d2cd02dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f273f7fe640 1 -- 172.21.15.5:0/2734196199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c074e80 con 0x555f791530a0 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f273f7fe640 1 -- 172.21.15.5:0/2734196199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c077170 con 0x555f791530a0 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.006+0000 7f273f7fe640 1 -- 172.21.15.5:0/2734196199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c080c60 con 0x555f791530a0 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- 172.21.15.5:0/2734196199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 msgr2=0x555f791b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f274c075730 tx=0x7f274c03f000 comp rx=0 tx=0).stop 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- 172.21.15.5:0/2734196199 shutdown_connections 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7917a550 0x555f791b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f791530a0 0x555f791b0510 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 --2- 172.21.15.5:0/2734196199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f7914da20 0x555f79152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- 172.21.15.5:0/2734196199 >> 172.21.15.5:0/2734196199 conn(0x555f79150860 msgr2=0x555f7917cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- 172.21.15.5:0/2734196199 shutdown_connections 2024-09-13T17:15:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- 172.21.15.5:0/2734196199 wait complete. 2024-09-13T17:15:22.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 -- start start 2024-09-13T17:15:22.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.007+0000 7f276627e740 1 Processor -- start 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f791781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7919ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79195cd0 con 0x555f7917a550 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79206940 con 0x555f791530a0 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79195ee0 con 0x555f7914da20 2024-09-13T17:15:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f276627e740 10 client.0 _ll_register_callbacks cb 0x7f2754001940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f2761afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f2761afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54136/0 (socket says 172.21.15.5:54136) 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f2761afb640 1 -- 172.21.15.5:0/4049685944 learned_addr learned my addr 172.21.15.5:0/4049685944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f27612fa640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f791781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.008+0000 7f2760af9640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7919ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 -- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 msgr2=0x555f791781c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f791781c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 -- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 msgr2=0x555f7919ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7919ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 -- 172.21.15.5:0/4049685944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f790b4270 con 0x555f7917a550 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2761afb640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f275400f660 tx=0x7f2754001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed36d09a1e9adff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754024070 con 0x555f7917a550 2024-09-13T17:15:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f275400fe20 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2754003ce0 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2754003b80 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 10 client.6285 fetch_fsmap learned FSMap version 21 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x555f7907bd00 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754003ce0 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 21) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2754012070 con 0x555f7917a550 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 10 client.6285 fetch_fsmap finished waiting for FSMap version 21 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 10 client.6285 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 20 client.6285 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79152320 0x555f79152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 4 client.6285 mds_command: new command op to 6102 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:15:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 --> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f78e0dd10 con 0x555f79152320 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.009+0000 7f27612fa640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79152320 0x555f79152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f2737fff640 10 client.6285 ms_handle_connect on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f27612fa640 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79152320 0x555f79152700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85141fafc40a4b47 server_cookie=953f1d94f06430b4 in_seq=0 out_seq=0 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f2737fff640 1 -- 172.21.15.5:0/4049685944 <== mds.0 v2:172.21.15.5:6832/8976367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555f78e0dd10 con 0x555f79152320 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f2737fff640 10 client.6285 handle_command_reply: tid=0 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 client.6285 shutdown 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 msgr2=0x555f791ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f275400f660 tx=0x7f2754001250 comp rx=0 tx=0).stop 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 shutdown_connections 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x555f79152320 0x555f79152700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f7917a550 0x555f791ff9e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f2737fff640 0 client.6285 ms_handle_reset on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f791530a0 0x555f7919ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 --2- 172.21.15.5:0/4049685944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555f7914da20 0x555f791781c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 >> 172.21.15.5:0/4049685944 conn(0x555f79150860 msgr2=0x555f7917cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 shutdown_connections 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 1 -- 172.21.15.5:0/4049685944 wait complete. 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.010+0000 7f276627e740 20 client.6285 trim_cache size 0 max 16384 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:22.018 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6102, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 8.9839863359999992, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 21, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 54, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 54, 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.39197199 2024-09-13T17:15:22.019 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 msgr2=0x7f274006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 0x7f274006d0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2758009b40 tx=0x7f2758009190 comp rx=0 tx=0).stop 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 msgr2=0x7f275c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f274c02a2b0 tx=0x7f274c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 shutdown_connections 2024-09-13T17:15:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f275c0b1ac0 0x7f275c144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f274006ac00 0x7f274006d0c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f275c06ef60 0x7f275c0cd450 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 --2- 172.21.15.5:0/3477614987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f275c06eb80 0x7f275c1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 >> 172.21.15.5:0/3477614987 conn(0x7f275c070af0 msgr2=0x7f275c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 shutdown_connections 2024-09-13T17:15:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.011+0000 7f276355e640 1 -- 172.21.15.5:0/3477614987 wait complete. 2024-09-13T17:15:22.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:15:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.125+0000 7fd763073640 1 Processor -- start 2024-09-13T17:15:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.125+0000 7fd763073640 1 -- start start 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd763073640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd75c06e090 0x7fd75c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd763073640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0ab9f0 con 0x7fd75c15a3e0 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd763073640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c06d410 con 0x7fd75c0ab5a0 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd763073640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c06e4d0 con 0x7fd75c06e090 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd760e0f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd75c15a3e0 0x7fd75c06c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41056/0 (socket says 172.21.15.5:41056) 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd760e0f640 1 -- 172.21.15.5:0/2761816293 learned_addr learned my addr 172.21.15.5:0/2761816293 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682800674 0 0) 0x7fd744001110 con 0x7fd75c15a3e0 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75bfff640 1 --2- 172.21.15.5:0/2761816293 >> v2:172.21.15.179:3300/0 conn(0x7fd75c06e090 0x7fd75c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd748003520 con 0x7fd75c15a3e0 2024-09-13T17:15:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1020993564 0 0) 0x7fd748003520 con 0x7fd75c15a3e0 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 >> v2:172.21.15.179:3300/0 conn(0x7fd75c06e090 msgr2=0x7fd75c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 --2- 172.21.15.5:0/2761816293 >> v2:172.21.15.179:3300/0 conn(0x7fd75c06e090 0x7fd75c0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 >> v1:172.21.15.179:6789/0 conn(0x7fd75c0ab5a0 legacy=0x7fd75c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c06cb70 con 0x7fd75c15a3e0 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd744001800 con 0x7fd75c15a3e0 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 >> v1:172.21.15.5:6789/0 conn(0x7fd75c15a3e0 legacy=0x7fd75c06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7480039c0 0x7fd748003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7480047c0 0x7fd748004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 0x7fd74800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74800c050 con 0x7fd748005180 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74800c1c0 con 0x7fd7480039c0 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.126+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74800c380 con 0x7fd7480047c0 2024-09-13T17:15:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 0x7fd74800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd760e0f640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7480039c0 0x7fd748003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd75bfff640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7480047c0 0x7fd748004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 -- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7480047c0 msgr2=0x7fd748004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7480047c0 0x7fd748004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 -- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7480039c0 msgr2=0x7fd748003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7480039c0 0x7fd748003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.127+0000 7fd761610640 1 -- 172.21.15.5:0/2761816293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748003520 con 0x7fd748005180 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd761610640 1 -- 172.21.15.5:0/2761816293 reap_dead start 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd761610640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 0x7fd74800b980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd754001750 tx=0x7fd7480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34037c64d1dca00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540052d0 con 0x7fd748005180 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754005470 con 0x7fd748005180 2024-09-13T17:15:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd75b7fe640 1 -- 172.21.15.5:0/2761816293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75402abe0 con 0x7fd748005180 2024-09-13T17:15:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd763073640 1 -- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 msgr2=0x7fd74800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd763073640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 0x7fd74800b980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd754001750 tx=0x7fd7480057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd763073640 1 -- 172.21.15.5:0/2761816293 shutdown_connections 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.128+0000 7fd763073640 1 --2- 172.21.15.5:0/2761816293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd748005180 0x7fd74800b980 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.129+0000 7fd763073640 1 -- 172.21.15.5:0/2761816293 >> 172.21.15.5:0/2761816293 conn(0x7fd75c0ce0d0 msgr2=0x7fd75c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.129+0000 7fd763073640 1 -- 172.21.15.5:0/2761816293 shutdown_connections 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.129+0000 7fd763073640 1 -- 172.21.15.5:0/2761816293 wait complete. 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.130+0000 7fd763073640 1 Processor -- start 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.130+0000 7fd763073640 1 -- start start 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748005180 0x7fd75c1e56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd75c1e5c20 0x7fd75c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c15d470 con 0x7fd75c15af10 2024-09-13T17:15:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1e60a0 con 0x7fd75c1e5c20 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd763073640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1e6360 con 0x7fd748005180 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54152/0 (socket says 172.21.15.5:54152) 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 -- 172.21.15.5:0/1297292193 learned_addr learned my addr 172.21.15.5:0/1297292193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd760e0f640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748005180 0x7fd75c1e56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd75bfff640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd75c1e5c20 0x7fd75c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 -- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748005180 msgr2=0x7fd75c1e56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748005180 0x7fd75c1e56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 -- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd75c1e5c20 msgr2=0x7fd75c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd75c1e5c20 0x7fd75c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 -- 172.21.15.5:0/1297292193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c14ad30 con 0x7fd75c15af10 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd761610640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd754005040 tx=0x7fd754001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.131+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754038070 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.132+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754007a30 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.132+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c14b010 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.132+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754004d80 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.132+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c1e6640 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.133+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c0672a0 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.133+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd754007030 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.133+0000 7fd7597fa640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 0x7fd73c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.133+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd7540a8690 con 0x7fd75c15af10 2024-09-13T17:15:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.134+0000 7fd760e0f640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 0x7fd73c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.134+0000 7fd760e0f640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 0x7fd73c06d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd744007fd0 tx=0x7fd744007970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.138+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd754073720 con 0x7fd75c15af10 2024-09-13T17:15:22.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.343+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd75c06c320 con 0x7fd75c15af10 2024-09-13T17:15:22.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.343+0000 7fd7597fa640 1 -- 172.21.15.5:0/1297292193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd754076d40 con 0x7fd75c15af10 2024-09-13T17:15:22.345 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:15:22.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 msgr2=0x7fd73c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 0x7fd73c06d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd744007fd0 tx=0x7fd744007970 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 msgr2=0x7fd75c15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd754005040 tx=0x7fd754001120 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 shutdown_connections 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd73c06ac00 0x7fd73c06d0c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd75c15af10 0x7fd75c15b3a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd75c1e5c20 0x7fd75c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 --2- 172.21.15.5:0/1297292193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd748005180 0x7fd75c1e56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 >> 172.21.15.5:0/1297292193 conn(0x7fd75c0ce0d0 msgr2=0x7fd75c0adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 shutdown_connections 2024-09-13T17:15:22.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:22.345+0000 7fd763073640 1 -- 172.21.15.5:0/1297292193 wait complete. 2024-09-13T17:15:22.357 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:15:22.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:22.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.359 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42608sec preferred_lft 42608sec 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:15:22.376 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:15:22.377 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:22.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.378 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:15:22.439 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:15:22.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.441 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:15:22.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:15:22.499 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:15:22.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:15:22.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:15:22.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:15:22.499 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:15:22.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.587 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:15:22.603 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:15:22.603 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:15:22.603 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:22.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:15:22.669 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:15:22.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:22.669 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:22.725 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:22.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:22.725 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:22.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:15:22.848 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:22.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:22.914 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:22.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:22.914 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:15:22.970 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:15:22.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:15:23.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:15:23.038 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:23.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:23.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:15:23.096+0000 7ff9948f7480 -1 init, newargv = 0x55b5dd7a3170 newargc=15 2024-09-13T17:15:23.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[57376]: starting ceph client 2024-09-13T17:15:23.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[57376]: starting fuse 2024-09-13T17:15:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:23.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:23.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:23.109 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:15:23.166 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:15:23.166 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:15:23.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:15:23.166 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:15:23.166 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:15:23.166 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:15:23.167 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:15:23.168 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:15:23.282 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.57376.asok 2024-09-13T17:15:23.468 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57376.asok 2024-09-13T17:15:23.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:23.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57376.asok status 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:15:23.606 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "57376", 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6294, 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6294 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:15:23.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3403128453 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3403128453 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.6294 192.168.0.1:0/3403128453", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/3403128453", 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 21, 2024-09-13T17:15:23.608 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 54, 2024-09-13T17:15:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:15:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:15:23.609 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:15:23.609 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:23.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:23.614 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:15:23.614 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:23.631 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:15:23.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:23.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:23.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:23.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:15:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.838+0000 7f40fd88e640 1 Processor -- start 2024-09-13T17:15:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.838+0000 7f40fd88e640 1 -- start start 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815a0d0 0x7f40f80cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f815eac0 0x7f40f80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40f80b2b60 0x7f40f806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80cd010 con 0x7f40f815eac0 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80cd2f0 con 0x7f40f80b2b60 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40fd88e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80b1b60 con 0x7f40f815a0d0 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f815eac0 0x7f40f80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f815eac0 0x7f40f80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51712/0 (socket says 172.21.15.5:51712) 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 -- 172.21.15.5:0/924883473 learned_addr learned my addr 172.21.15.5:0/924883473 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40f6ffd640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815a0d0 0x7f40f80cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40f77fe640 1 --2- 172.21.15.5:0/924883473 >> v2:172.21.15.179:3300/0 conn(0x7f40f80b2b60 0x7f40f806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 -- 172.21.15.5:0/924883473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815a0d0 msgr2=0x7f40f80cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815a0d0 0x7f40f80cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 -- 172.21.15.5:0/924883473 >> v2:172.21.15.179:3300/0 conn(0x7f40f80b2b60 msgr2=0x7f40f806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 --2- 172.21.15.5:0/924883473 >> v2:172.21.15.179:3300/0 conn(0x7f40f80b2b60 0x7f40f806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.839+0000 7f40effff640 1 -- 172.21.15.5:0/924883473 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80b1e40 con 0x7f40f815eac0 2024-09-13T17:15:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.840+0000 7f40effff640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f815eac0 0x7f40f80b2620 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f40f8071c30 tx=0x7f40e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1538d1ba37aa3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.840+0000 7f40f67fc640 1 -- 172.21.15.5:0/924883473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e002ae90 con 0x7f40f815eac0 2024-09-13T17:15:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.840+0000 7f40f67fc640 1 -- 172.21.15.5:0/924883473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0032440 con 0x7f40f815eac0 2024-09-13T17:15:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.840+0000 7f40f67fc640 1 -- 172.21.15.5:0/924883473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00327d0 con 0x7f40f815eac0 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 -- 172.21.15.5:0/924883473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f815eac0 msgr2=0x7f40f80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f815eac0 0x7f40f80b2620 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f40f8071c30 tx=0x7f40e002a140 comp rx=0 tx=0).stop 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 -- 172.21.15.5:0/924883473 shutdown_connections 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 --2- 172.21.15.5:0/924883473 >> v2:172.21.15.179:3300/0 conn(0x7f40f80b2b60 0x7f40f806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f815eac0 0x7f40f80b2620 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 --2- 172.21.15.5:0/924883473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815a0d0 0x7f40f80cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 -- 172.21.15.5:0/924883473 >> 172.21.15.5:0/924883473 conn(0x7f40f8070af0 msgr2=0x7f40f8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 -- 172.21.15.5:0/924883473 shutdown_connections 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.841+0000 7f40fd88e640 1 -- 172.21.15.5:0/924883473 wait complete. 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.842+0000 7f40fd88e640 1 Processor -- start 2024-09-13T17:15:23.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.842+0000 7f40fd88e640 1 -- start start 2024-09-13T17:15:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f815a0d0 0x7f40f80aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815eac0 0x7f40f80a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80a78f0 con 0x7f40f80b2b60 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80a7bd0 con 0x7f40f815a0d0 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40fd88e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80a7eb0 con 0x7f40f815eac0 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51724/0 (socket says 172.21.15.5:51724) 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 -- 172.21.15.5:0/2357541213 learned_addr learned my addr 172.21.15.5:0/2357541213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f77fe640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815eac0 0x7f40f80a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40effff640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f815a0d0 0x7f40f80aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 -- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815eac0 msgr2=0x7f40f80a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815eac0 0x7f40f80a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 -- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f815a0d0 msgr2=0x7f40f80aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f815a0d0 0x7f40f80aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.843+0000 7f40f6ffd640 1 -- 172.21.15.5:0/2357541213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094d0 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40f6ffd640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d800 tx=0x7f40e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800b6c0 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e800b820 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f80a8190 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800bbb0 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.844+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f8152590 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.845+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f80672e0 con 0x7f40f80b2b60 2024-09-13T17:15:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.845+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40e800bd10 con 0x7f40f80b2b60 2024-09-13T17:15:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.846+0000 7f40f4ff9640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.846+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f40e8089a40 con 0x7f40f80b2b60 2024-09-13T17:15:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.846+0000 7f40effff640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.847+0000 7f40effff640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40e0034000 tx=0x7f40e002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:23.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:23.850+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40e808be60 con 0x7f40f80b2b60 2024-09-13T17:15:24.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.056+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40f80cc730 con 0x7f40f80b2b60 2024-09-13T17:15:24.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.057+0000 7f40f4ff9640 1 -- 172.21.15.5:0/2357541213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40e8054ae0 con 0x7f40f80b2b60 2024-09-13T17:15:24.058 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 msgr2=0x7f40d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40e0034000 tx=0x7f40e002e000 comp rx=0 tx=0).stop 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 msgr2=0x7f40f8154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d800 tx=0x7f40e800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 shutdown_connections 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f815eac0 0x7f40f80a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f815a0d0 0x7f40f80aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:24.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:24.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 --2- 172.21.15.5:0/2357541213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f80b2b60 0x7f40f8154fb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:24.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 >> 172.21.15.5:0/2357541213 conn(0x7f40f8070af0 msgr2=0x7f40f8070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:24.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 shutdown_connections 2024-09-13T17:15:24.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:24.059+0000 7f40fd88e640 1 -- 172.21.15.5:0/2357541213 wait complete. 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:15:24.071 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:15:24.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.072 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:24.092 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:24.093 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:15:24.096 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42571sec preferred_lft 42571sec 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:24.097 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:15:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:15:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:24.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.098 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:15:24.160 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:15:24.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.162 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:15:24.220 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:15:24.220 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:15:24.221 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:15:24.221 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:15:24.221 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:15:24.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:15:24.221 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:15:24.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.312 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:15:24.328 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:15:24.328 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:15:24.328 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:15:24.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:15:24.393 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:15:24.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:24.394 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:24.449 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:15:24.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:24.450 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:24.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:15:24.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:24.572 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:24.636 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:24.637 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:24.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.638 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:15:24.693 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:15:24.694 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:15:24.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:15:24.761 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:24.761 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:24.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:15:24.815+0000 7fc66c527480 -1 init, newargv = 0x563a3844d0c0 newargc=15 2024-09-13T17:15:24.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[44480]: starting ceph client 2024-09-13T17:15:24.822 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[44480]: starting fuse 2024-09-13T17:15:24.828 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:24.829 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:24.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:24.830 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:15:24.885 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:15:24.885 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:15:24.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:15:24.885 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:15:24.886 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:15:24.887 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:15:24.998 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.44480.asok 2024-09-13T17:15:25.185 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44480.asok 2024-09-13T17:15:25.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:25.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44480.asok status 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:15:25.321 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "44480", 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 5980, 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 5980 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:25.322 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 81287936 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 81287936 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.5980 192.168.0.1:0/81287936", 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/81287936", 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 21, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 54, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:15:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:15:25.324 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:15:25.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:25.327 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:15:25.327 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:25.343 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:15:25.343 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:25.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:25.343 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:25.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-13T17:15:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.523+0000 7f36c4644640 1 Processor -- start 2024-09-13T17:15:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.524+0000 7f36c4644640 1 -- start start 2024-09-13T17:15:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c4644640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 0x7f36bc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c4644640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0ad050 con 0x7f36bc0abe60 2024-09-13T17:15:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c4644640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0ac440 con 0x7f36bc1591e0 2024-09-13T17:15:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c4644640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc06e400 con 0x7f36bc06da30 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c1bdf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f36bc0abe60 0x7f36bc0b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56996/0 (socket says 172.21.15.5:56996) 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c1bdf640 1 -- 172.21.15.5:0/1105029730 learned_addr learned my addr 172.21.15.5:0/1105029730 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c2be1640 1 --2- 172.21.15.5:0/1105029730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 0x7f36bc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785151365 0 0) 0x7f36bc0ad050 con 0x7f36bc0abe60 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a8003520 con 0x7f36bc0abe60 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913854580 0 0) 0x7f36bc0ac440 con 0x7f36bc1591e0 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36bc0ad050 con 0x7f36bc1591e0 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c2be1640 1 -- 172.21.15.5:0/1105029730 >> v1:172.21.15.179:6789/0 conn(0x7f36bc1591e0 legacy=0x7f36bc0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c2be1640 1 -- 172.21.15.5:0/1105029730 >> v1:172.21.15.5:6789/0 conn(0x7f36bc0abe60 legacy=0x7f36bc0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.525+0000 7f36c2be1640 1 -- 172.21.15.5:0/1105029730 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0ac720 con 0x7f36bc06da30 2024-09-13T17:15:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.526+0000 7f36c2be1640 1 --2- 172.21.15.5:0/1105029730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 0x7f36bc06dec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009dc0 tx=0x7f36b402eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f40d2803474fc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.526+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4030840 con 0x7f36bc06da30 2024-09-13T17:15:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.526+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b40309a0 con 0x7f36bc06da30 2024-09-13T17:15:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.526+0000 7f36c13de640 1 -- 172.21.15.5:0/1105029730 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4030d30 con 0x7f36bc06da30 2024-09-13T17:15:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 -- 172.21.15.5:0/1105029730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 msgr2=0x7f36bc06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 --2- 172.21.15.5:0/1105029730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 0x7f36bc06dec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009dc0 tx=0x7f36b402eae0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 -- 172.21.15.5:0/1105029730 shutdown_connections 2024-09-13T17:15:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 --2- 172.21.15.5:0/1105029730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc06da30 0x7f36bc06dec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 -- 172.21.15.5:0/1105029730 >> 172.21.15.5:0/1105029730 conn(0x7f36bc0ce130 msgr2=0x7f36bc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 -- 172.21.15.5:0/1105029730 shutdown_connections 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.527+0000 7f36c4644640 1 -- 172.21.15.5:0/1105029730 wait complete. 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.528+0000 7f36c4644640 1 Processor -- start 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.528+0000 7f36c4644640 1 -- start start 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36bc06da30 0x7f36bc1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc0abe60 0x7f36bc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc15aab0 con 0x7f36bc1591e0 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc14fbb0 con 0x7f36bc06da30 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c4644640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc1556e0 con 0x7f36bc0abe60 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c2be1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c2be1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51730/0 (socket says 172.21.15.5:51730) 2024-09-13T17:15:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c2be1640 1 -- 172.21.15.5:0/1322178531 learned_addr learned my addr 172.21.15.5:0/1322178531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.529+0000 7f36c23e0640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36bc06da30 0x7f36bc1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c1bdf640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc0abe60 0x7f36bc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 -- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc0abe60 msgr2=0x7f36bc15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc0abe60 0x7f36bc15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 -- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36bc06da30 msgr2=0x7f36bc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36bc06da30 0x7f36bc1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 -- 172.21.15.5:0/1322178531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009a70 con 0x7f36bc1591e0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c2be1640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009eb0 tx=0x7f36b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4031b80 con 0x7f36bc1591e0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4040040 con 0x7f36bc1591e0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b403a400 con 0x7f36bc1591e0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc15be40 con 0x7f36bc1591e0 2024-09-13T17:15:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.530+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc15c400 con 0x7f36bc1591e0 2024-09-13T17:15:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.531+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc0672a0 con 0x7f36bc1591e0 2024-09-13T17:15:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.532+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36b403a560 con 0x7f36bc1591e0 2024-09-13T17:15:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.533+0000 7f36b2ffd640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 0x7f36a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.533+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f36b40ae7a0 con 0x7f36bc1591e0 2024-09-13T17:15:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.533+0000 7f36c23e0640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 0x7f36a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.533+0000 7f36c23e0640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 0x7f36a006d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f36b80011e0 tx=0x7f36b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.537+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f36b4079980 con 0x7f36bc1591e0 2024-09-13T17:15:25.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.749+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f36bc06dec0 con 0x7f36bc1591e0 2024-09-13T17:15:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.890+0000 7f36b2ffd640 1 -- 172.21.15.5:0/1322178531 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v22) v1 ==== 105+0+0 (secure 0 0 0) 0x7f36b407cfa0 con 0x7f36bc1591e0 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 msgr2=0x7f36a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 0x7f36a006d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f36b80011e0 tx=0x7f36b8009040 comp rx=0 tx=0).stop 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 msgr2=0x7f36bc070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009eb0 tx=0x7f36b4004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 shutdown_connections 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f36a006ac00 0x7f36a006d0c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36bc1591e0 0x7f36bc070700 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36bc0abe60 0x7f36bc15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 --2- 172.21.15.5:0/1322178531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36bc06da30 0x7f36bc1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.893+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 >> 172.21.15.5:0/1322178531 conn(0x7f36bc0ce130 msgr2=0x7f36bc0af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.894+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 shutdown_connections 2024-09-13T17:15:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:25.894+0000 7f36c4644640 1 -- 172.21.15.5:0/1322178531 wait complete. 2024-09-13T17:15:25.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:26.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.010+0000 7f99d3080640 1 Processor -- start 2024-09-13T17:15:26.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.010+0000 7f99d3080640 1 -- start start 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99d3080640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99cc0b4cf0 0x7f99cc0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99d3080640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc0d06d0 0x7f99cc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99d3080640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0d1e80 con 0x7f99cc15c810 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99d3080640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc0d1750 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99d3080640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0d0bd0 con 0x7f99cc0d06d0 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99cbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99cc0b4cf0 0x7f99cc0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99cbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99cc0b4cf0 0x7f99cc0cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51732/0 (socket says 172.21.15.5:51732) 2024-09-13T17:15:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.011+0000 7f99cbfff640 1 -- 172.21.15.5:0/1717079513 learned_addr learned my addr 172.21.15.5:0/1717079513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99d161d640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc0d06d0 0x7f99cc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99cbfff640 1 -- 172.21.15.5:0/1717079513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc0d06d0 msgr2=0x7f99cc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99cbfff640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc0d06d0 0x7f99cc0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99cbfff640 1 -- 172.21.15.5:0/1717079513 >> v1:172.21.15.179:6789/0 conn(0x7f99cc15c810 legacy=0x7f99cc0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99cbfff640 1 -- 172.21.15.5:0/1717079513 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0d0eb0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.012+0000 7f99cbfff640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cd780 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da7f3c064494d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99cb7fe640 1 -- 172.21.15.5:0/1717079513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4032440 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99cb7fe640 1 -- 172.21.15.5:0/1717079513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40325a0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99cb7fe640 1 -- 172.21.15.5:0/1717079513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4032930 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 -- 172.21.15.5:0/1717079513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 msgr2=0x7f99cc0cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cd780 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b402a270 comp rx=0 tx=0).stop 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 -- 172.21.15.5:0/1717079513 shutdown_connections 2024-09-13T17:15:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc0d06d0 0x7f99cc0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 --2- 172.21.15.5:0/1717079513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cd780 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 -- 172.21.15.5:0/1717079513 >> 172.21.15.5:0/1717079513 conn(0x7f99cc0717a0 msgr2=0x7f99cc071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 -- 172.21.15.5:0/1717079513 shutdown_connections 2024-09-13T17:15:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.013+0000 7f99d3080640 1 -- 172.21.15.5:0/1717079513 wait complete. 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.014+0000 7f99d3080640 1 Processor -- start 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 -- start start 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99cc0d06d0 0x7f99cc0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc15c810 0x7f99cc0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1512a0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c6930 con 0x7f99cc0d06d0 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.015+0000 7f99d3080640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c6c10 con 0x7f99cc15c810 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51736/0 (socket says 172.21.15.5:51736) 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 -- 172.21.15.5:0/212176807 learned_addr learned my addr 172.21.15.5:0/212176807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99cbfff640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99cc0d06d0 0x7f99cc0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d161d640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc15c810 0x7f99cc0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 -- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc15c810 msgr2=0x7f99cc0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc15c810 0x7f99cc0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 -- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99cc0d06d0 msgr2=0x7f99cc0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99cc0d06d0 0x7f99cc0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 -- 172.21.15.5:0/212176807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40094d0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d0e1c640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c730 tx=0x7f99bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc003b70 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc003cf0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc0c6ef0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc003ea0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.016+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc0c74b0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.017+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc0672a0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.018+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99bc00aa90 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.018+0000 7f99c97fa640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 0x7f99ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.018+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99bc0890e0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.018+0000 7f99cbfff640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 0x7f99ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.019+0000 7f99cbfff640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 0x7f99ac06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f99b4034000 tx=0x7f99b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.022+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f99bc0542c0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.230+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99cc0b5a90 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.231+0000 7f99c97fa640 1 -- 172.21.15.5:0/212176807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f99bc0578e0 con 0x7f99cc0b4cf0 2024-09-13T17:15:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:26.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:25.888458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:creating","state_seq":1,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:15:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-09-13T17:15:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 msgr2=0x7f99ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 0x7f99ac06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f99b4034000 tx=0x7f99b402e000 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 msgr2=0x7f99cc0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c730 tx=0x7f99bc00cbf0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 shutdown_connections 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99cc15c810 0x7f99cc0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99cc0d06d0 0x7f99cc0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f99ac06ac00 0x7f99ac06d0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 --2- 172.21.15.5:0/212176807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99cc0b4cf0 0x7f99cc0cadd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 >> 172.21.15.5:0/212176807 conn(0x7f99cc0717a0 msgr2=0x7f99cc071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 shutdown_connections 2024-09-13T17:15:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:26.233+0000 7f99d3080640 1 -- 172.21.15.5:0/212176807 wait complete. 2024-09-13T17:15:26.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:15:13.025097+0000', 'modified': '2024-09-13T17:15:25.888458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6102, 'mds_1': 5839}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5839': {'gid': 5839, 'name': 'd', 'rank': 1, 'incarnation': 22, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.179:6835/2573493377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 2573493377}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 2573493377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6102': {'gid': 6102, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/8976367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 8976367}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 8976367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:15:26.649 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5839:up:creating 2024-09-13T17:15:27.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.764+0000 7f75e5765640 1 Processor -- start 2024-09-13T17:15:27.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.764+0000 7f75e5765640 1 -- start start 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75e5765640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75e006e1c0 0x7f75e00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75e5765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 0x7f75e00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75e5765640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b2390 con 0x7f75e0156f40 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75e5765640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e015a740 con 0x7f75e006e1c0 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75e5765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b1780 con 0x7f75e015a290 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75e006e1c0 0x7f75e00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75e006e1c0 0x7f75e00aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51744/0 (socket says 172.21.15.5:51744) 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75deffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75e0156f40 0x7f75e006dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57012/0 (socket says 172.21.15.5:57012) 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 -- 172.21.15.5:0/2920158083 learned_addr learned my addr 172.21.15.5:0/2920158083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75df7fe640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 0x7f75e00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 -- 172.21.15.5:0/2920158083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 msgr2=0x7f75e00b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 0x7f75e00b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 -- 172.21.15.5:0/2920158083 >> v1:172.21.15.5:6789/0 conn(0x7f75e0156f40 legacy=0x7f75e006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75ddffb640 1 -- 172.21.15.5:0/2920158083 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076836322 0 0) 0x7f75e00b2390 con 0x7f75e0156f40 2024-09-13T17:15:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75de7fc640 1 -- 172.21.15.5:0/2920158083 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00b1a60 con 0x7f75e006e1c0 2024-09-13T17:15:27.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.765+0000 7f75df7fe640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 0x7f75e00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.766+0000 7f75de7fc640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e006e1c0 0x7f75e00aced0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d55d30665f8d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.766+0000 7f75ddffb640 1 -- 172.21.15.5:0/2920158083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4032440 con 0x7f75e006e1c0 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.766+0000 7f75ddffb640 1 -- 172.21.15.5:0/2920158083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40325a0 con 0x7f75e006e1c0 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.766+0000 7f75ddffb640 1 -- 172.21.15.5:0/2920158083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4032930 con 0x7f75e006e1c0 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 -- 172.21.15.5:0/2920158083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e006e1c0 msgr2=0x7f75e00aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e006e1c0 0x7f75e00aced0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d402a270 comp rx=0 tx=0).stop 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 -- 172.21.15.5:0/2920158083 shutdown_connections 2024-09-13T17:15:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e015a290 0x7f75e00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 --2- 172.21.15.5:0/2920158083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e006e1c0 0x7f75e00aced0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 -- 172.21.15.5:0/2920158083 >> 172.21.15.5:0/2920158083 conn(0x7f75e00ce0d0 msgr2=0x7f75e00ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 -- 172.21.15.5:0/2920158083 shutdown_connections 2024-09-13T17:15:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.767+0000 7f75e5765640 1 -- 172.21.15.5:0/2920158083 wait complete. 2024-09-13T17:15:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.768+0000 7f75e5765640 1 Processor -- start 2024-09-13T17:15:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.768+0000 7f75e5765640 1 -- start start 2024-09-13T17:15:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 0x7f75e014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0156f40 0x7f75e0143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014f970 con 0x7f75e015a290 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014cd50 con 0x7f75e006e1c0 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75e5765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0143d90 con 0x7f75e0156f40 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51756/0 (socket says 172.21.15.5:51756) 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.769+0000 7f75df7fe640 1 -- 172.21.15.5:0/2406906131 learned_addr learned my addr 172.21.15.5:0/2406906131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75de7fc640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0156f40 0x7f75e0143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 -- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0156f40 msgr2=0x7f75e0143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0156f40 0x7f75e0143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 -- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 msgr2=0x7f75e014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75deffd640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 0x7f75e014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 0x7f75e014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 -- 172.21.15.5:0/2406906131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40094d0 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75deffd640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 0x7f75e014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75df7fe640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f75d800cef0 tx=0x7f75d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800d840 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800d9c0 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e014bcb0 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800dd70 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.770+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e014c270 con 0x7f75e015a290 2024-09-13T17:15:27.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.771+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e00672a0 con 0x7f75e015a290 2024-09-13T17:15:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.772+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75d801e3b0 con 0x7f75e015a290 2024-09-13T17:15:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.772+0000 7f75c77fe640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.772+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f75d8089f70 con 0x7f75e015a290 2024-09-13T17:15:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.773+0000 7f75deffd640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:27.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.773+0000 7f75deffd640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 0x7f75cc06d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000f60 tx=0x7f75d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:27.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.777+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75d80bd9c0 con 0x7f75e015a290 2024-09-13T17:15:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.981+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75e00ad5e0 con 0x7f75e015a290 2024-09-13T17:15:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.981+0000 7f75c77fe640 1 -- 172.21.15.5:0/2406906131 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f75d801a020 con 0x7f75e015a290 2024-09-13T17:15:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:27.983 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:26.889712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:15:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 23 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 msgr2=0x7f75cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 0x7f75cc06d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000f60 tx=0x7f75d0009040 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 msgr2=0x7f75e014b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f75d800cef0 tx=0x7f75d800a710 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 shutdown_connections 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e015a290 0x7f75e014b3d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e0156f40 0x7f75e0143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 --2- 172.21.15.5:0/2406906131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e006e1c0 0x7f75e014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 >> 172.21.15.5:0/2406906131 conn(0x7f75e00ce0d0 msgr2=0x7f75e0159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 shutdown_connections 2024-09-13T17:15:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:27.983+0000 7f75e5765640 1 -- 172.21.15.5:0/2406906131 wait complete. 2024-09-13T17:15:28.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:15:13.025097+0000', 'modified': '2024-09-13T17:15:26.889712+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6102, 'mds_1': 5839}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5839': {'gid': 5839, 'name': 'd', 'rank': 1, 'incarnation': 22, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6835/2573493377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 2573493377}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 2573493377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6102': {'gid': 6102, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/8976367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 8976367}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 8976367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:15:28.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-13T17:15:28.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T17:15:28.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.504+0000 7f7284376640 1 Processor -- start 2024-09-13T17:15:28.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.504+0000 7f7284376640 1 -- start start 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.505+0000 7f7284376640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 0x7f727c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.505+0000 7f7284376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.505+0000 7f7284376640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0b2390 con 0x7f727c156f40 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.505+0000 7f7284376640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c15a740 con 0x7f727c06e1c0 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.505+0000 7f7284376640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b1780 con 0x7f727c15a290 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55380/0 (socket says 172.21.15.5:55380) 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282112640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f727c156f40 0x7f727c06dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:49932/0 (socket says 172.21.15.5:49932) 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 -- 172.21.15.5:0/1622394196 learned_addr learned my addr 172.21.15.5:0/1622394196 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7281911640 1 --2- 172.21.15.5:0/1622394196 >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 0x7f727c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7281110640 1 -- 172.21.15.5:0/1622394196 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100966513 0 0) 0x7f727c0b2390 con 0x7f727c156f40 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 -- 172.21.15.5:0/1622394196 >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 msgr2=0x7f727c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 --2- 172.21.15.5:0/1622394196 >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 0x7f727c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 -- 172.21.15.5:0/1622394196 >> v1:172.21.15.179:6789/0 conn(0x7f727c156f40 legacy=0x7f727c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7282913640 1 -- 172.21.15.5:0/1622394196 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0b1a60 con 0x7f727c15a290 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.506+0000 7f7281911640 1 --2- 172.21.15.5:0/1622394196 >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 0x7f727c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.507+0000 7f7282913640 1 --2- 172.21.15.5:0/1622394196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f727400d150 tx=0x7f727402c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7886113771c674c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.507+0000 7f7281110640 1 -- 172.21.15.5:0/1622394196 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274009600 con 0x7f727c15a290 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.507+0000 7f7281110640 1 -- 172.21.15.5:0/1622394196 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274009760 con 0x7f727c15a290 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.507+0000 7f7281110640 1 -- 172.21.15.5:0/1622394196 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274009af0 con 0x7f727c15a290 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 -- 172.21.15.5:0/1622394196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 msgr2=0x7f727c0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 --2- 172.21.15.5:0/1622394196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f727400d150 tx=0x7f727402c930 comp rx=0 tx=0).stop 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 -- 172.21.15.5:0/1622394196 shutdown_connections 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 --2- 172.21.15.5:0/1622394196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c15a290 0x7f727c0b1080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 --2- 172.21.15.5:0/1622394196 >> v2:172.21.15.179:3300/0 conn(0x7f727c06e1c0 0x7f727c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 -- 172.21.15.5:0/1622394196 >> 172.21.15.5:0/1622394196 conn(0x7f727c0ce0d0 msgr2=0x7f727c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 -- 172.21.15.5:0/1622394196 shutdown_connections 2024-09-13T17:15:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.508+0000 7f7284376640 1 -- 172.21.15.5:0/1622394196 wait complete. 2024-09-13T17:15:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.509+0000 7f7284376640 1 Processor -- start 2024-09-13T17:15:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.509+0000 7f7284376640 1 -- start start 2024-09-13T17:15:28.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c06e1c0 0x7f727c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f727c15a290 0x7f727c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c097bd0 con 0x7f727c156f40 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c151440 con 0x7f727c15a290 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7284376640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c150730 con 0x7f727c06e1c0 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51770/0 (socket says 172.21.15.5:51770) 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 -- 172.21.15.5:0/1006708194 learned_addr learned my addr 172.21.15.5:0/1006708194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7282112640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c06e1c0 0x7f727c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7282913640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f727c15a290 0x7f727c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 -- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c06e1c0 msgr2=0x7f727c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c06e1c0 0x7f727c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 -- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f727c15a290 msgr2=0x7f727c1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f727c15a290 0x7f727c1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.510+0000 7f7281911640 1 -- 172.21.15.5:0/1006708194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c009400 con 0x7f727c156f40 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7281911640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ebe0 tx=0x7f726c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7272ffd640 1 -- 172.21.15.5:0/1006708194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c009760 con 0x7f727c156f40 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7272ffd640 1 -- 172.21.15.5:0/1006708194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00cc30 con 0x7f727c156f40 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727400bd40 con 0x7f727c156f40 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7272ffd640 1 -- 172.21.15.5:0/1006708194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00eee0 con 0x7f727c156f40 2024-09-13T17:15:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.511+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c1516b0 con 0x7f727c156f40 2024-09-13T17:15:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.512+0000 7f7272ffd640 1 -- 172.21.15.5:0/1006708194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f726c013470 con 0x7f727c156f40 2024-09-13T17:15:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.513+0000 7f7272ffd640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 0x7f726006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.513+0000 7f7272ffd640 1 -- 172.21.15.5:0/1006708194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f726c0897a0 con 0x7f727c156f40 2024-09-13T17:15:28.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.513+0000 7f7282112640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 0x7f726006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 Processor -- start 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7282112640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 0x7f726006d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7278000f60 tx=0x7f7278007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 -- start start 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fedf8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee45ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fed527c0 con 0x5640fedf5860 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fed61b70 con 0x5640fee1f550 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.514+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640fed5f300 con 0x5640fedf80a0 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51784/0 (socket says 172.21.15.5:51784) 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 -- 172.21.15.5:0/3558438551 learned_addr learned my addr 172.21.15.5:0/3558438551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7282913640 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee45ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7282112640 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fedf8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 -- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 msgr2=0x5640fedf8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fedf8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 -- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 msgr2=0x5640fee45ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee45ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 -- 172.21.15.5:0/3558438551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fece74b0 con 0x5640fedf5860 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f7281911640 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f726c0549d0 tx=0x7f726c057fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887a2fa5f9b9650 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f725ffff640 1 -- 172.21.15.5:0/3558438551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c056660 con 0x5640fedf5860 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f725ffff640 1 -- 172.21.15.5:0/3558438551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c0568c0 con 0x5640fedf5860 2024-09-13T17:15:28.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.515+0000 7f725ffff640 1 -- 172.21.15.5:0/3558438551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c060460 con 0x5640fedf5860 2024-09-13T17:15:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- 172.21.15.5:0/3558438551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 msgr2=0x5640fee45570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f726c0549d0 tx=0x7f726c057fb0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- 172.21.15.5:0/3558438551 shutdown_connections 2024-09-13T17:15:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee45ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf5860 0x5640fee45570 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 --2- 172.21.15.5:0/3558438551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fedf8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- 172.21.15.5:0/3558438551 >> 172.21.15.5:0/3558438551 conn(0x5640fedf47d0 msgr2=0x5640fee3cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- 172.21.15.5:0/3558438551 shutdown_connections 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- 172.21.15.5:0/3558438551 wait complete. 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.516+0000 7f7287095740 1 -- start start 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 Processor -- start 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fedf80a0 0x5640fee23030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee1d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fed5abf0 con 0x5640fee1f550 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fed19250 con 0x5640fedf80a0 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.517+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640fed18ef0 con 0x5640fee211d0 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7287095740 10 client.0 _ll_register_callbacks cb 0x5640fed4b740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51796/0 (socket says 172.21.15.5:51796) 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 -- 172.21.15.5:0/1230006078 learned_addr learned my addr 172.21.15.5:0/1230006078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7282112640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fedf80a0 0x5640fee23030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7282913640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee1d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 -- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 msgr2=0x5640fee1d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee1d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 -- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fedf80a0 msgr2=0x5640fee23030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fedf80a0 0x5640fee23030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 -- 172.21.15.5:0/1230006078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c1516b0 con 0x5640fee1f550 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7281911640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ca20 tx=0x7f726c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28132a7364825ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f725d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c060670 con 0x5640fee1f550 2024-09-13T17:15:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f726c054310 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640fea4e3c0 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726c0544f0 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7287095740 10 client.6333 fetch_fsmap learned FSMap version 23 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5640fed59270 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.518+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640fea4e3c0 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f726c011070 con 0x5640fee1f550 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 10 client.6333 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 10 client.6333 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 20 client.6333 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fee4ffa0 0x5640fee50380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 4 client.6333 mds_command: new command op to 5839 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 --> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640fea5f6c0 con 0x5640fee4ffa0 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.519+0000 7f7282112640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fee4ffa0 0x5640fee50380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f7282112640 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fee4ffa0 0x5640fee50380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bea682ff512d6d1b server_cookie=68cf6c7ff07c90c1 in_seq=0 out_seq=0 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f725d7fa640 10 client.6333 ms_handle_connect on v2:172.21.15.179:6834/2573493377 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f725d7fa640 1 -- 172.21.15.5:0/1230006078 <== mds.1 v2:172.21.15.179:6834/2573493377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5640fea5f6c0 con 0x5640fee4ffa0 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f725d7fa640 10 client.6333 handle_command_reply: tid=0 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f7287095740 1 client.6333 shutdown 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 msgr2=0x5640fee20c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.520+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ca20 tx=0x7f726c000bc0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 shutdown_connections 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fee4ffa0 0x5640fee50380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee1d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee1f550 0x5640fee20c90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 --2- 172.21.15.5:0/1230006078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fedf80a0 0x5640fee23030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f725d7fa640 0 client.6333 ms_handle_reset on v2:172.21.15.179:6834/2573493377 2024-09-13T17:15:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 >> 172.21.15.5:0/1230006078 conn(0x5640fedf5860 msgr2=0x5640fee40960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 shutdown_connections 2024-09-13T17:15:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 1 -- 172.21.15.5:0/1230006078 wait complete. 2024-09-13T17:15:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.521+0000 7f7287095740 20 client.6333 trim_cache size 0 max 16384 2024-09-13T17:15:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 Processor -- start 2024-09-13T17:15:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 -- start start 2024-09-13T17:15:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fee3ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fecde460 con 0x5640fee211d0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fee1b040 con 0x5640fee1f550 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640fee237c0 con 0x5640fedf80a0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7282913640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7282913640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51798/0 (socket says 172.21.15.5:51798) 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7282913640 1 -- 172.21.15.5:0/2294782294 learned_addr learned my addr 172.21.15.5:0/2294782294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7282112640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fee3ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.536+0000 7f7281911640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 -- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 msgr2=0x5640fee3ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fee3ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 -- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 msgr2=0x5640fee24090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee24090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 -- 172.21.15.5:0/2294782294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fecfb5f0 con 0x5640fee211d0 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282112640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fee3ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7281911640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7282913640 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f727400ba60 tx=0x7f7274031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378bf75cae0ad429 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7270e05640 1 -- 172.21.15.5:0/2294782294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274041040 con 0x5640fee211d0 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7270e05640 1 -- 172.21.15.5:0/2294782294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274042040 con 0x5640fee211d0 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7270e05640 1 -- 172.21.15.5:0/2294782294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274003bb0 con 0x5640fee211d0 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7287095740 1 -- 172.21.15.5:0/2294782294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 msgr2=0x5640fee565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.537+0000 7f7287095740 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f727400ba60 tx=0x7f7274031000 comp rx=0 tx=0).stop 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 -- 172.21.15.5:0/2294782294 shutdown_connections 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fee211d0 0x5640fee565a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640fee24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 --2- 172.21.15.5:0/2294782294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fedf80a0 0x5640fee3ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 -- 172.21.15.5:0/2294782294 >> 172.21.15.5:0/2294782294 conn(0x5640fedf5860 msgr2=0x5640fee23980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 -- 172.21.15.5:0/2294782294 shutdown_connections 2024-09-13T17:15:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 -- 172.21.15.5:0/2294782294 wait complete. 2024-09-13T17:15:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 -- start start 2024-09-13T17:15:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.538+0000 7f7287095740 1 Processor -- start 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640feeae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee41680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fee1e5b0 con 0x5640fedf80a0 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fee3d740 con 0x5640fee1f550 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640fee56970 con 0x5640fee211d0 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7287095740 10 client.0 _ll_register_callbacks cb 0x7f7278007bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7282112640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7282112640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51812/0 (socket says 172.21.15.5:51812) 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7282112640 1 -- 172.21.15.5:0/100615966 learned_addr learned my addr 172.21.15.5:0/100615966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7281911640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640feeae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.539+0000 7f7282913640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee41680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 -- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 msgr2=0x5640fee41680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee41680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 -- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 msgr2=0x5640feeae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640feeae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 -- 172.21.15.5:0/100615966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0b1a60 con 0x5640fedf80a0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7282112640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7278001d20 tx=0x7f7278012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45fa1c3736e82cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780133f0 con 0x5640fedf80a0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f727801b040 con 0x5640fedf80a0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f726c0568c0 con 0x5640fedf80a0 2024-09-13T17:15:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7278013550 con 0x5640fedf80a0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 10 client.6339 fetch_fsmap learned FSMap version 23 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5640fed20d00 con 0x5640fedf80a0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c0568c0 con 0x5640fedf80a0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f7278012070 con 0x5640fedf80a0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 10 client.6339 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 10 client.6339 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 20 client.6339 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fedf61f0 0x5640fedf65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 4 client.6339 mds_command: new command op to 5839 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.540+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 --> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640feab2d10 con 0x5640fedf61f0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7281911640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fedf61f0 0x5640fedf65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f725d7fa640 10 client.6339 ms_handle_connect on v2:172.21.15.179:6834/2573493377 2024-09-13T17:15:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7281911640 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fedf61f0 0x5640fedf65d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb3e28c50ed7f8e9 server_cookie=453620143410cf5f in_seq=0 out_seq=0 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f725d7fa640 1 -- 172.21.15.5:0/100615966 <== mds.1 v2:172.21.15.179:6834/2573493377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5640feab2d10 con 0x5640fedf61f0 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f725d7fa640 10 client.6339 handle_command_reply: tid=0 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 client.6339 shutdown 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 msgr2=0x5640fee19ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7278001d20 tx=0x7f7278012000 comp rx=0 tx=0).stop 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 shutdown_connections 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:6834/2573493377,v1:172.21.15.179:6835/2573493377] conn(0x5640fedf61f0 0x5640fedf65d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5640fee211d0 0x5640fee41680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5640fee1f550 0x5640feeae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.541+0000 7f7287095740 1 --2- 172.21.15.5:0/100615966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5640fedf80a0 0x5640fee19ae0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f725d7fa640 0 client.6339 ms_handle_reset on v2:172.21.15.179:6834/2573493377 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 >> 172.21.15.5:0/100615966 conn(0x5640fedf5860 msgr2=0x5640fee3ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 shutdown_connections 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7287095740 1 -- 172.21.15.5:0/100615966 wait complete. 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7287095740 20 client.6339 trim_cache size 0 max 16384 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5839, 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:15:28.549 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 2.6519024569999998, 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 23, 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 54, 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 54, 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19.912111315000001 2024-09-13T17:15:28.550 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 msgr2=0x7f726006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 0x7f726006d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7278000f60 tx=0x7f7278007d50 comp rx=0 tx=0).stop 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 msgr2=0x7f727c097690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ebe0 tx=0x7f726c00c520 comp rx=0 tx=0).stop 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 shutdown_connections 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f727c15a290 0x7f727c1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f726006ac00 0x7f726006d0c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f727c156f40 0x7f727c097690 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 --2- 172.21.15.5:0/1006708194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f727c06e1c0 0x7f727c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 >> 172.21.15.5:0/1006708194 conn(0x7f727c0ce0d0 msgr2=0x7f727c0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 shutdown_connections 2024-09-13T17:15:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.542+0000 7f7284376640 1 -- 172.21.15.5:0/1006708194 wait complete. 2024-09-13T17:15:28.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:15:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.656+0000 7f19f198a640 1 Processor -- start 2024-09-13T17:15:28.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.656+0000 7f19f198a640 1 -- start start 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19f198a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 0x7f19ec0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19f198a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 0x7f19ec0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19f198a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec06d410 con 0x7f19ec15a3e0 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19f198a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0aba50 con 0x7f19ec0ab5a0 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19f198a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec06e4d0 con 0x7f19ec06e090 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19eaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f19ec15a3e0 0x7f19ec06c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57020/0 (socket says 172.21.15.5:57020) 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19eaffd640 1 -- 172.21.15.5:0/2209582627 learned_addr learned my addr 172.21.15.5:0/2209582627 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/2209582627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 0x7f19ec0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/2209582627 >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 0x7f19ec0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19e9ffb640 1 -- 172.21.15.5:0/2209582627 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300748698 0 0) 0x7f19ec06d410 con 0x7f19ec15a3e0 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19e9ffb640 1 -- 172.21.15.5:0/2209582627 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d4003520 con 0x7f19ec15a3e0 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19ea7fc640 1 -- 172.21.15.5:0/2209582627 >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 msgr2=0x7f19ec0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/2209582627 >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 0x7f19ec0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19ea7fc640 1 -- 172.21.15.5:0/2209582627 >> v1:172.21.15.5:6789/0 conn(0x7f19ec15a3e0 legacy=0x7f19ec06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19ea7fc640 1 -- 172.21.15.5:0/2209582627 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec06cb70 con 0x7f19ec06e090 2024-09-13T17:15:28.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.657+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/2209582627 >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 0x7f19ec0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.658+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/2209582627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 0x7f19ec0ab060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19e00097a0 tx=0x7f19e002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a97cdfdbe61a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.658+0000 7f19e9ffb640 1 -- 172.21.15.5:0/2209582627 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032440 con 0x7f19ec06e090 2024-09-13T17:15:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.658+0000 7f19e9ffb640 1 -- 172.21.15.5:0/2209582627 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00325a0 con 0x7f19ec06e090 2024-09-13T17:15:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.658+0000 7f19e9ffb640 1 -- 172.21.15.5:0/2209582627 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032910 con 0x7f19ec06e090 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 -- 172.21.15.5:0/2209582627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 msgr2=0x7f19ec0ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 --2- 172.21.15.5:0/2209582627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 0x7f19ec0ab060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f19e00097a0 tx=0x7f19e002a180 comp rx=0 tx=0).stop 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 -- 172.21.15.5:0/2209582627 shutdown_connections 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 --2- 172.21.15.5:0/2209582627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec06e090 0x7f19ec0ab060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 --2- 172.21.15.5:0/2209582627 >> v2:172.21.15.179:3300/0 conn(0x7f19ec0ab5a0 0x7f19ec0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 -- 172.21.15.5:0/2209582627 >> 172.21.15.5:0/2209582627 conn(0x7f19ec0ce0d0 msgr2=0x7f19ec0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 -- 172.21.15.5:0/2209582627 shutdown_connections 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.659+0000 7f19f198a640 1 -- 172.21.15.5:0/2209582627 wait complete. 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.660+0000 7f19f198a640 1 Processor -- start 2024-09-13T17:15:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.660+0000 7f19f198a640 1 -- start start 2024-09-13T17:15:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19ec06e090 0x7f19ec1f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec0ab5a0 0x7f19ec1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1582c0 con 0x7f19ec15a3e0 2024-09-13T17:15:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1f5690 con 0x7f19ec06e090 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19f198a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1f58a0 con 0x7f19ec0ab5a0 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51816/0 (socket says 172.21.15.5:51816) 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19eb7fe640 1 -- 172.21.15.5:0/456143600 learned_addr learned my addr 172.21.15.5:0/456143600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19eaffd640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19ec06e090 0x7f19ec1f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.661+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec0ab5a0 0x7f19ec1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 -- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec0ab5a0 msgr2=0x7f19ec1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec0ab5a0 0x7f19ec1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 -- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19ec06e090 msgr2=0x7f19ec1f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19ec06e090 0x7f19ec1f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 -- 172.21.15.5:0/456143600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009a70 con 0x7f19ec15a3e0 2024-09-13T17:15:28.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f19e400efc0 tx=0x7f19e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19d3fff640 1 -- 172.21.15.5:0/456143600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4009d70 con 0x7f19ec15a3e0 2024-09-13T17:15:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19d3fff640 1 -- 172.21.15.5:0/456143600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400f040 con 0x7f19ec15a3e0 2024-09-13T17:15:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e0009400 con 0x7f19ec15a3e0 2024-09-13T17:15:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19d3fff640 1 -- 172.21.15.5:0/456143600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4003990 con 0x7f19ec15a3e0 2024-09-13T17:15:28.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.662+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec1f5e60 con 0x7f19ec15a3e0 2024-09-13T17:15:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.664+0000 7f19d3fff640 1 -- 172.21.15.5:0/456143600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19e40144a0 con 0x7f19ec15a3e0 2024-09-13T17:15:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.664+0000 7f19d3fff640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 0x7f19d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.664+0000 7f19d3fff640 1 -- 172.21.15.5:0/456143600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19e408a160 con 0x7f19ec15a3e0 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.664+0000 7f19eaffd640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 0x7f19d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.665+0000 7f19eaffd640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 0x7f19d806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005880 tx=0x7f19dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.665+0000 7f19f46b0740 1 Processor -- start 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.665+0000 7f19f46b0740 1 -- start start 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e7be480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e80bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e7187c0 con 0x56120e7bb860 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e727b70 con 0x56120e7be0a0 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120e725300 con 0x56120e7e5550 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51828/0 (socket says 172.21.15.5:51828) 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 -- 172.21.15.5:0/4114857681 learned_addr learned my addr 172.21.15.5:0/4114857681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19eaffd640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e7be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e80bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 -- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 msgr2=0x56120e80bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e80bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 -- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 msgr2=0x56120e7be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e7be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 -- 172.21.15.5:0/4114857681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56120e6ad4b0 con 0x56120e7bb860 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e80bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.666+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f19e00098c0 tx=0x7f19e002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5177d75bdfd9aec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19d17fa640 1 -- 172.21.15.5:0/4114857681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032910 con 0x56120e7bb860 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19d17fa640 1 -- 172.21.15.5:0/4114857681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0032a70 con 0x56120e7bb860 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19d17fa640 1 -- 172.21.15.5:0/4114857681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032e20 con 0x56120e7bb860 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 -- 172.21.15.5:0/4114857681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 msgr2=0x56120e80b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f19e00098c0 tx=0x7f19e002c000 comp rx=0 tx=0).stop 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 -- 172.21.15.5:0/4114857681 shutdown_connections 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e80bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7bb860 0x56120e80b570 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 --2- 172.21.15.5:0/4114857681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e7be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 -- 172.21.15.5:0/4114857681 >> 172.21.15.5:0/4114857681 conn(0x56120e7ba7d0 msgr2=0x56120e802c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 -- 172.21.15.5:0/4114857681 shutdown_connections 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.667+0000 7f19f46b0740 1 -- 172.21.15.5:0/4114857681 wait complete. 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.668+0000 7f19f46b0740 1 -- start start 2024-09-13T17:15:28.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.668+0000 7f19f46b0740 1 Processor -- start 2024-09-13T17:15:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e808110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7b8bb0 0x56120e808650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e720bf0 con 0x56120e7be0a0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e6df250 con 0x56120e7b8bb0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120e6deef0 con 0x56120e7e5550 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19f46b0740 10 client.0 _ll_register_callbacks cb 0x56120e711740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51832/0 (socket says 172.21.15.5:51832) 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 -- 172.21.15.5:0/3327472233 learned_addr learned my addr 172.21.15.5:0/3327472233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7b8bb0 0x56120e808650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e808110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 -- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 msgr2=0x56120e808110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e808110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 -- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7b8bb0 msgr2=0x56120e808650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7b8bb0 0x56120e808650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 -- 172.21.15.5:0/3327472233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec06cb70 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e808110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005e60 tx=0x7f19dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f43aab5ca28786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.669+0000 7f19ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc007560 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19dc0076c0 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56120e4143c0 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19dc013420 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 10 client.6351 fetch_fsmap learned FSMap version 23 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56120e71f270 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56120e4143c0 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f19dc013580 con 0x56120e7be0a0 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 10 client.6351 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:15:28.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 10 client.6351 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 20 client.6351 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e7e4650 0x56120e81fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 4 client.6351 mds_command: new command op to 6102 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 --> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56120e4256c0 con 0x56120e7e4650 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.670+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e7e4650 0x56120e81fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e7e4650 0x56120e81fbd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5097f8dd1048e38 server_cookie=4d4897fffcc545df in_seq=0 out_seq=0 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19ca7fc640 10 client.6351 ms_handle_connect on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3327472233 <== mds.0 v2:172.21.15.5:6832/8976367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56120e4256c0 con 0x56120e7e4650 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19ca7fc640 10 client.6351 handle_command_reply: tid=0 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 client.6351 shutdown 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 msgr2=0x56120e7b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005e60 tx=0x7f19dc000ed0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 shutdown_connections 2024-09-13T17:15:28.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e7e4650 0x56120e81fbd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7b8bb0 0x56120e808650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19ca7fc640 0 client.6351 ms_handle_reset on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e808110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3327472233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7be0a0 0x56120e7b8670 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 >> 172.21.15.5:0/3327472233 conn(0x56120e7bb860 msgr2=0x56120e806170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 shutdown_connections 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.671+0000 7f19f46b0740 1 -- 172.21.15.5:0/3327472233 wait complete. 2024-09-13T17:15:28.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.672+0000 7f19f46b0740 20 client.6351 trim_cache size 0 max 16384 2024-09-13T17:15:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.688+0000 7f19f46b0740 1 Processor -- start 2024-09-13T17:15:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.688+0000 7f19f46b0740 1 -- start start 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7be0a0 0x56120e7ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7e5550 0x56120e7ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e6a4460 con 0x56120e7b8bb0 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e7e3fd0 con 0x56120e7e5550 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120e824830 con 0x56120e7be0a0 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51836/0 (socket says 172.21.15.5:51836) 2024-09-13T17:15:28.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 -- 172.21.15.5:0/332727806 learned_addr learned my addr 172.21.15.5:0/332727806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 -- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7be0a0 msgr2=0x56120e7ff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7be0a0 0x56120e7ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 -- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7e5550 msgr2=0x56120e7ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7e5550 0x56120e7ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 -- 172.21.15.5:0/332727806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56120e6c15f0 con 0x56120e7b8bb0 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19eaffd640 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005ac0 tx=0x7f19dc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b013aaaef60d3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19d1ffb640 1 -- 172.21.15.5:0/332727806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc001350 con 0x56120e7b8bb0 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19d1ffb640 1 -- 172.21.15.5:0/332727806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00eb80 con 0x56120e7b8bb0 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.689+0000 7f19d1ffb640 1 -- 172.21.15.5:0/332727806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc001d20 con 0x56120e7b8bb0 2024-09-13T17:15:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 -- 172.21.15.5:0/332727806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 msgr2=0x56120e80aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005ac0 tx=0x7f19dc013000 comp rx=0 tx=0).stop 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 -- 172.21.15.5:0/332727806 shutdown_connections 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7e5550 0x56120e7ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7be0a0 0x56120e7ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 --2- 172.21.15.5:0/332727806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e80aee0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 -- 172.21.15.5:0/332727806 >> 172.21.15.5:0/332727806 conn(0x56120e7bb860 msgr2=0x56120e7b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 -- 172.21.15.5:0/332727806 shutdown_connections 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.690+0000 7f19f46b0740 1 -- 172.21.15.5:0/332727806 wait complete. 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.691+0000 7f19f46b0740 1 -- start start 2024-09-13T17:15:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.691+0000 7f19f46b0740 1 Processor -- start 2024-09-13T17:15:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e81f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e820f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e821b60 con 0x56120e7b8bb0 2024-09-13T17:15:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56120e86d0b0 con 0x56120e7be0a0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56120e86d4e0 con 0x56120e7e5550 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 10 client.0 _ll_register_callbacks cb 0x7f19e0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51840/0 (socket says 172.21.15.5:51840) 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 -- 172.21.15.5:0/3172696639 learned_addr learned my addr 172.21.15.5:0/3172696639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eb7fe640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e820f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e81f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 -- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 msgr2=0x56120e820f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e820f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 -- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 msgr2=0x56120e81f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e81f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 -- 172.21.15.5:0/3172696639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56120e71f270 con 0x56120e7b8bb0 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e81f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19eaffd640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f19dc015040 tx=0x7f19dc0010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8106e35ed25964b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc007770 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19dc013420 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.692+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19e0032a70 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19dc013600 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 10 client.6357 fetch_fsmap learned FSMap version 23 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56120e6e6d00 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0032a70 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 23) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f19dc013d20 con 0x56120e7b8bb0 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 10 client.6357 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 10 client.6357 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 20 client.6357 populate_metadata read hostname 'smithi005' 2024-09-13T17:15:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e81f720 0x56120e821450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 4 client.6357 mds_command: new command op to 6102 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 --> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56120e478d10 con 0x56120e81f720 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e81f720 0x56120e821450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ea7fc640 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e81f720 0x56120e821450 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9910e165623a8064 server_cookie=ec7d89d299d45310 in_seq=0 out_seq=0 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.693+0000 7f19ca7fc640 10 client.6357 ms_handle_connect on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19ca7fc640 1 -- 172.21.15.5:0/3172696639 <== mds.0 v2:172.21.15.5:6832/8976367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56120e478d10 con 0x56120e81f720 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19ca7fc640 10 client.6357 handle_command_reply: tid=0 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 client.6357 shutdown 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 msgr2=0x56120e86cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f19dc015040 tx=0x7f19dc0010a0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 shutdown_connections 2024-09-13T17:15:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:6832/8976367,v1:172.21.15.5:6834/8976367] conn(0x56120e81f720 0x56120e821450 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56120e7e5550 0x56120e820f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56120e7be0a0 0x56120e81f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19ca7fc640 0 client.6357 ms_handle_reset on v2:172.21.15.5:6832/8976367 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 --2- 172.21.15.5:0/3172696639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120e7b8bb0 0x56120e86cb70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 >> 172.21.15.5:0/3172696639 conn(0x56120e7bb860 msgr2=0x56120e7ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 shutdown_connections 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 1 -- 172.21.15.5:0/3172696639 wait complete. 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f46b0740 20 client.6357 trim_cache size 0 max 16384 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:15:28.702 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6102, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 15.667572155, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 23, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 54, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 54, 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 20.075559828999999 2024-09-13T17:15:28.703 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 msgr2=0x7f19d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 0x7f19d806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005880 tx=0x7f19dc009040 comp rx=0 tx=0).stop 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 msgr2=0x7f19ec1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f19e400efc0 tx=0x7f19e4009f90 comp rx=0 tx=0).stop 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 shutdown_connections 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f19d806ac00 0x7f19d806d0c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19ec15a3e0 0x7f19ec1552e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19ec0ab5a0 0x7f19ec1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 --2- 172.21.15.5:0/456143600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19ec06e090 0x7f19ec1f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 >> 172.21.15.5:0/456143600 conn(0x7f19ec0ce0d0 msgr2=0x7f19ec06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.694+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 shutdown_connections 2024-09-13T17:15:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:28.695+0000 7f19f198a640 1 -- 172.21.15.5:0/456143600 wait complete. 2024-09-13T17:15:28.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:28.706 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir {d0,d1} && touch {d0,d1}/file') 2024-09-13T17:15:28.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:28.735 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d0) 2024-09-13T17:15:28.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:28.795 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2024-09-13T17:15:28.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:28.943 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-09-13T17:15:28.942+0000 7fdf0f5a2640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T17:15:29.007 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"11","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T17:15:29.008 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T17:15:29.008 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:31.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:31.137 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"11","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T17:15:31.138 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T17:15:31.138 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:33.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:33.269 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"11","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T17:15:33.269 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T17:15:33.269 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:35.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:35.401 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":1},"nref":4}}] 2024-09-13T17:15:35.401 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d0", "pins": { "authpin": 1, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T17:15:35.402 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0)] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:37.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:37.531 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":1},"nref":4}}] 2024-09-13T17:15:37.532 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d0", "pins": { "authpin": 1, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T17:15:37.532 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0)] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:39.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T17:15:39.661 INFO:teuthology.orchestra.run.smithi005.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-13T17:15:39.662 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d0", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "5", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T17:15:39.662 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0), ('/d1', 1)] =?= [('/d0', 0), ('/d1', 1)] 2024-09-13T17:15:39.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:39.662 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f0) 2024-09-13T17:15:39.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:39.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f0) 2024-09-13T17:15:39.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:39.743 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f1) 2024-09-13T17:15:39.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:39.771 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f1) 2024-09-13T17:15:39.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-13T17:15:39.957 INFO:teuthology.orchestra.run.smithi005.stdout:[{"id":5980,"entity":{"name":{"type":"client","num":5980},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":81287936}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":5,"uptime":15.128710066,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":6.9127944152721108,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":5,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5980 192.168.0.1:0/81287936","completed_requests":[{"tid":6,"created_ino":"0x100000005e0"}],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"1","hostname":"smithi179","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44480","root":"/"}},{"id":6294,"entity":{"name":{"type":"client","num":6294},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3403128453}},"state":"open","num_leases":3,"num_caps":5,"request_load_avg":11,"uptime":16.847677123,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":2,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.573857028889904,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":12,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000003","length":500}],"inst":"client.6294 192.168.0.1:0/3403128453","completed_requests":[{"tid":12,"created_ino":"0x100000001f8"}],"prealloc_inos":[{"start":"0x10000000003","length":500},{"start":"0x100000001f9","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"0","hostname":"smithi005","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"57376","root":"/"}}] 2024-09-13T17:15:39.957 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44480", "root": "/" }, "completed_requests": [ { "created_ino": "0x100000005e0", "tid": 6 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 81287936, "type": "any" }, "name": { "num": 5980, "type": "client" } }, "id": 5980, "inst": "client.5980 192.168.0.1:0/81287936", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 5, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 6.912794415272111 }, "state": "open", "uptime": 15.128710066 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi005", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "57376", "root": "/" }, "completed_requests": [ { "created_ino": "0x100000001f8", "tid": 12 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000003" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3403128453, "type": "any" }, "name": { "num": 6294, "type": "client" } }, "id": 6294, "inst": "client.6294 192.168.0.1:0/3403128453", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 12, "num_caps": 5, "num_completed_flushes": 2, "num_completed_requests": 1, "num_leases": 3, "prealloc_inos": [ { "length": 500, "start": "0x10000000003" }, { "length": 999, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.573857028889904 }, "state": "open", "uptime": 16.847677123 } ] 2024-09-13T17:15:39.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-13T17:15:40.082 INFO:teuthology.orchestra.run.smithi179.stdout:[{"id":5980,"entity":{"name":{"type":"client","num":5980},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":81287936}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":3,"uptime":0.24299447699999999,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":4.9972674986878554,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5980 192.168.0.1:0/81287936","completed_requests":[{"tid":10,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"1","hostname":"smithi179","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44480","root":"/"}},{"id":6294,"entity":{"name":{"type":"client","num":6294},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3403128453}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":2,"uptime":0.71198381899999996,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":4.9953030830654024,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":12,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6294 192.168.0.1:0/3403128453","completed_requests":[{"tid":16,"created_ino":"0x20000000000"}],"prealloc_inos":[{"start":"0x20000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"0","hostname":"smithi005","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"57376","root":"/"}}] 2024-09-13T17:15:40.082 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44480", "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 10 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 81287936, "type": "any" }, "name": { "num": 5980, "type": "client" } }, "id": 5980, "inst": "client.5980 192.168.0.1:0/81287936", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 9, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 4.997267498687855 }, "state": "open", "uptime": 0.242994477 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi005", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "57376", "root": "/" }, "completed_requests": [ { "created_ino": "0x20000000000", "tid": 16 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3403128453, "type": "any" }, "name": { "num": 6294, "type": "client" } }, "id": 6294, "inst": "client.6294 192.168.0.1:0/3403128453", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 12, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x20000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 4.995303083065402 }, "state": "open", "uptime": 0.711983819 } ] 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:40.083 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:40.084 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:15:40.085 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:15:40.161 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.57376.asok 2024-09-13T17:15:40.348 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57376.asok 2024-09-13T17:15:40.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:40.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57376.asok mds_sessions 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6294, 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6294 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:15:40.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3403128453 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.6294 v1:192.168.0.1:0/3403128453", 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "v1:192.168.0.1:0/3403128453", 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions": [ 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": 0, 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addrs": { 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6832", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 8976367 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6834", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 8976367 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "seq": 11, 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_gen": 0, 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_ttl": "2024-09-13T17:16:24.099169+0000", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "last_cap_renew_request": "2024-09-13T17:15:24.099169+0000", 2024-09-13T17:15:40.487 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_renew_seq": 2, 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "num_caps": 5, 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "open" 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": 1, 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrs": { 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.179:6834", 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2573493377 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.179:6835", 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2573493377 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "seq": 1, 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_gen": 0, 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_ttl": "2024-09-13T17:16:39.365627+0000", 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "last_cap_renew_request": "2024-09-13T17:15:39.365627+0000", 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_renew_seq": 1, 2024-09-13T17:15:40.489 INFO:teuthology.orchestra.run.smithi005.stdout: "num_caps": 3, 2024-09-13T17:15:40.490 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "open" 2024-09-13T17:15:40.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:40.490 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-13T17:15:40.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24 2024-09-13T17:15:40.490 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:40.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session evict 6294 2024-09-13T17:15:41.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:15:41.398+0000 7ff979ffb640 -1 client.6294 I was blocklisted at osd epoch 55 2024-09-13T17:15:41.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:15:41.398+0000 7ff979ffb640 -1 client.6294 remove_session_caps still has dirty|flushing caps on 0x100000001f8.head(faked_ino=0 nref=5 ll_ref=1 cap_refs={} open={2=0} mode=100644 size=0/4194304 nlink=1 btime=2024-09-13T17:15:39.679031+0000 mtime=2024-09-13T17:15:39.679222+0000 ctime=2024-09-13T17:15:39.680577+0000 change_attr=1 caps=- dirty_caps=AxFx objectset[0x100000001f8 ts 0/0 objects 0 dirty_or_tx 0] parents=0x10000000000.head["f0"] 0x7ff97400f2c0) 2024-09-13T17:15:41.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:15:41.398+0000 7ff979ffb640 -1 client.6294 remove_session_caps still has dirty|flushing caps on 0x20000000000.head(faked_ino=0 nref=5 ll_ref=1 cap_refs={} open={2=0} mode=100644 size=0/4194304 nlink=1 btime=2024-09-13T17:15:39.739574+0000 mtime=2024-09-13T17:15:39.741221+0000 ctime=2024-09-13T17:15:39.742541+0000 change_attr=1 caps=- dirty_caps=AxFx objectset[0x20000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x10000000001.head["f0"] 0x7ff97400f890) 2024-09-13T17:15:41.416 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-13T17:15:41.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.528+0000 7ffa78668640 1 Processor -- start 2024-09-13T17:15:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.528+0000 7ffa78668640 1 -- start start 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa78668640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa7006d570 0x7ffa70165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa78668640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa70071570 con 0x7ffa7015a4a0 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa78668640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa700ce330 con 0x7ffa70070510 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa78668640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7015a880 con 0x7ffa7006d570 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa7006d570 0x7ffa70165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa7006d570 0x7ffa70165160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43560/0 (socket says 172.21.15.5:43560) 2024-09-13T17:15:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 -- 172.21.15.5:0/1476321996 learned_addr learned my addr 172.21.15.5:0/1476321996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 -- 172.21.15.5:0/1476321996 >> v1:172.21.15.179:6789/0 conn(0x7ffa70070510 legacy=0x7ffa7006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 -- 172.21.15.5:0/1476321996 >> v1:172.21.15.5:6789/0 conn(0x7ffa7015a4a0 legacy=0x7ffa7015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.529+0000 7ffa76c05640 1 -- 172.21.15.5:0/1476321996 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700709f0 con 0x7ffa7006d570 2024-09-13T17:15:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.530+0000 7ffa76c05640 1 --2- 172.21.15.5:0/1476321996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa7006d570 0x7ffa70165160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009e50 tx=0x7ffa6802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bb4ef9f7927f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.530+0000 7ffa75402640 1 -- 172.21.15.5:0/1476321996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68031600 con 0x7ffa7006d570 2024-09-13T17:15:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.530+0000 7ffa75402640 1 -- 172.21.15.5:0/1476321996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6802d050 con 0x7ffa7006d570 2024-09-13T17:15:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.530+0000 7ffa75402640 1 -- 172.21.15.5:0/1476321996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68031980 con 0x7ffa7006d570 2024-09-13T17:15:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 -- 172.21.15.5:0/1476321996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa7006d570 msgr2=0x7ffa70165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 --2- 172.21.15.5:0/1476321996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa7006d570 0x7ffa70165160 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009e50 tx=0x7ffa6802a780 comp rx=0 tx=0).stop 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 -- 172.21.15.5:0/1476321996 shutdown_connections 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 --2- 172.21.15.5:0/1476321996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa7006d570 0x7ffa70165160 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 -- 172.21.15.5:0/1476321996 >> 172.21.15.5:0/1476321996 conn(0x7ffa700b0420 msgr2=0x7ffa700b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 -- 172.21.15.5:0/1476321996 shutdown_connections 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.531+0000 7ffa78668640 1 -- 172.21.15.5:0/1476321996 wait complete. 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.532+0000 7ffa78668640 1 Processor -- start 2024-09-13T17:15:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.532+0000 7ffa78668640 1 -- start start 2024-09-13T17:15:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 0x7ffa70153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 0x7ffa70159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70153dc0 con 0x7ffa70070510 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7015d9a0 con 0x7ffa7015a4a0 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa78668640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70146c70 con 0x7ffa7006d570 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43574/0 (socket says 172.21.15.5:43574) 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 -- 172.21.15.5:0/2398985608 learned_addr learned my addr 172.21.15.5:0/2398985608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa76c05640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 0x7ffa70159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa76404640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 0x7ffa70153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 -- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 msgr2=0x7ffa70153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 0x7ffa70153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 -- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 msgr2=0x7ffa70159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 0x7ffa70159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa75c03640 1 -- 172.21.15.5:0/2398985608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009b30 con 0x7ffa70070510 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa76404640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 0x7ffa70153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.533+0000 7ffa76c05640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 0x7ffa70159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa75c03640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c430 tx=0x7ffa6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011790 con 0x7ffa70070510 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa600118f0 con 0x7ffa70070510 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa70146f50 con 0x7ffa70070510 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011ca0 con 0x7ffa70070510 2024-09-13T17:15:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.534+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa70147510 con 0x7ffa70070510 2024-09-13T17:15:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.535+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7006ce60 con 0x7ffa70070510 2024-09-13T17:15:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.535+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa6001c460 con 0x7ffa70070510 2024-09-13T17:15:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.536+0000 7ffa66ffd640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 0x7ffa5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.536+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7ffa600894a0 con 0x7ffa70070510 2024-09-13T17:15:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.536+0000 7ffa76404640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 0x7ffa5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.537+0000 7ffa76404640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 0x7ffa5406d0c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c007fd0 tx=0x7ffa6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.540+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffa60054480 con 0x7ffa70070510 2024-09-13T17:15:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.714+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa70073360 con 0x7ffa70070510 2024-09-13T17:15:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.715+0000 7ffa66ffd640 1 -- 172.21.15.5:0/2398985608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16798 (secure 0 0 0) 0x7ffa60057aa0 con 0x7ffa70070510 2024-09-13T17:15:41.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:41.717 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:41.358963+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 msgr2=0x7ffa5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 0x7ffa5406d0c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c007fd0 tx=0x7ffa6c009040 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 msgr2=0x7ffa7015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c430 tx=0x7ffa6000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 shutdown_connections 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7015a4a0 0x7ffa70159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa5406ac00 0x7ffa5406d0c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa70070510 0x7ffa7015d460 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 --2- 172.21.15.5:0/2398985608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa7006d570 0x7ffa70153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.717+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 >> 172.21.15.5:0/2398985608 conn(0x7ffa700b0420 msgr2=0x7ffa700afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.718+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 shutdown_connections 2024-09-13T17:15:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:41.718+0000 7ffa78668640 1 -- 172.21.15.5:0/2398985608 wait complete. 2024-09-13T17:15:41.730 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T17:15:42.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:15:42.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:15:51.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-13T17:15:51.862 INFO:teuthology.orchestra.run.smithi005.stdout:[{"id":5980,"entity":{"name":{"type":"client","num":5980},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":81287936}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":5,"uptime":27.032481939,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":7.7091475366232043,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":5,"last_trim_completed_flushes_tid":2,"delegated_inos":[],"inst":"client.5980 192.168.0.1:0/81287936","completed_requests":[{"tid":6,"created_ino":"0x100000005e0"}],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"1","hostname":"smithi179","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44480","root":"/"}}] 2024-09-13T17:15:51.862 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44480", "root": "/" }, "completed_requests": [ { "created_ino": "0x100000005e0", "tid": 6 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 81287936, "type": "any" }, "name": { "num": 5980, "type": "client" } }, "id": 5980, "inst": "client.5980 192.168.0.1:0/81287936", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 5, "num_caps": 3, "num_completed_flushes": 1, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 7.709147536623204 }, "state": "open", "uptime": 27.032481939 } ] 2024-09-13T17:15:51.863 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-13T17:15:51.990 INFO:teuthology.orchestra.run.smithi179.stdout:[{"id":5980,"entity":{"name":{"type":"client","num":5980},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":81287936}},"state":"open","num_leases":1,"num_caps":3,"request_load_avg":3,"uptime":12.151723837,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":5.8475128504323495,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":9,"last_trim_completed_flushes_tid":3,"delegated_inos":[],"inst":"client.5980 192.168.0.1:0/81287936","completed_requests":[{"tid":10,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"1","hostname":"smithi179","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44480","root":"/"}}] 2024-09-13T17:15:51.990 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44480", "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 10 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 81287936, "type": "any" }, "name": { "num": 5980, "type": "client" } }, "id": 5980, "inst": "client.5980 192.168.0.1:0/81287936", "last_trim_completed_flushes_tid": 3, "last_trim_completed_requests_tid": 9, "num_caps": 3, "num_completed_flushes": 1, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 5.8475128504323495 }, "state": "open", "uptime": 12.151723837 } ] 2024-09-13T17:15:51.990 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:15:51.991 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:15:51.991 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:52.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.150+0000 7fc81c473640 1 Processor -- start 2024-09-13T17:15:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.151+0000 7fc81c473640 1 -- start start 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.151+0000 7fc81c473640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc814156f40 0x7fc81415a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.151+0000 7fc81c473640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc81406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81c473640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8140b2390 con 0x7fc81406dff0 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81c473640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406e4a0 con 0x7fc814156f40 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81c473640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140b14c0 con 0x7fc8140b1080 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc814156f40 0x7fc81415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc814156f40 0x7fc81415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59482/0 (socket says 172.21.15.5:59482) 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 -- 172.21.15.5:0/2598118020 learned_addr learned my addr 172.21.15.5:0/2598118020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc819a0e640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc81406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 -- 172.21.15.5:0/2598118020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 msgr2=0x7fc81406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc81406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 -- 172.21.15.5:0/2598118020 >> v1:172.21.15.179:6789/0 conn(0x7fc81406dff0 legacy=0x7fc8140abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc81a20f640 1 -- 172.21.15.5:0/2598118020 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140b1780 con 0x7fc814156f40 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.152+0000 7fc819a0e640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc81406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81a20f640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc814156f40 0x7fc81415a290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc81000bb10 tx=0x7fc81002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47845d19e7e88779 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81920d640 1 -- 172.21.15.5:0/2598118020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810032820 con 0x7fc814156f40 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81920d640 1 -- 172.21.15.5:0/2598118020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81002e040 con 0x7fc814156f40 2024-09-13T17:15:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81920d640 1 -- 172.21.15.5:0/2598118020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810032ba0 con 0x7fc814156f40 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81c473640 1 -- 172.21.15.5:0/2598118020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc814156f40 msgr2=0x7fc81415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.153+0000 7fc81c473640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc814156f40 0x7fc81415a290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc81000bb10 tx=0x7fc81002c920 comp rx=0 tx=0).stop 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 -- 172.21.15.5:0/2598118020 shutdown_connections 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc81406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 --2- 172.21.15.5:0/2598118020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc814156f40 0x7fc81415a290 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 -- 172.21.15.5:0/2598118020 >> 172.21.15.5:0/2598118020 conn(0x7fc8140ce0d0 msgr2=0x7fc8140ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 -- 172.21.15.5:0/2598118020 shutdown_connections 2024-09-13T17:15:52.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.154+0000 7fc81c473640 1 -- 172.21.15.5:0/2598118020 wait complete. 2024-09-13T17:15:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.155+0000 7fc81c473640 1 Processor -- start 2024-09-13T17:15:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.155+0000 7fc81c473640 1 -- start start 2024-09-13T17:15:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.155+0000 7fc81c473640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.155+0000 7fc81c473640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc814156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.155+0000 7fc81c473640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc814156f40 0x7fc814156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81c473640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81409a410 con 0x7fc81406dff0 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81c473640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81409a6f0 con 0x7fc814156f40 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81c473640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81409a9d0 con 0x7fc8140b1080 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59490/0 (socket says 172.21.15.5:59490) 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 -- 172.21.15.5:0/2772751942 learned_addr learned my addr 172.21.15.5:0/2772751942 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc819a0e640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc814156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81aa10640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc814156f40 0x7fc814156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 -- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 msgr2=0x7fc814156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc814156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 -- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc814156f40 msgr2=0x7fc814156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc814156f40 0x7fc814156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 -- 172.21.15.5:0/2772751942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81000b770 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81a20f640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc81000b2c0 tx=0x7fc810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810032e90 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81003ba60 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81003be30 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81409acb0 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.156+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc814099fe0 con 0x7fc81406dff0 2024-09-13T17:15:52.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.157+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81409b1d0 con 0x7fc81406dff0 2024-09-13T17:15:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.158+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc81003a3b0 con 0x7fc81406dff0 2024-09-13T17:15:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.158+0000 7fc80affd640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 0x7fc7f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.159+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7fc8100ac6a0 con 0x7fc81406dff0 2024-09-13T17:15:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.159+0000 7fc819a0e640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 0x7fc7f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.159+0000 7fc819a0e640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 0x7fc7f806d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc81414a3d0 tx=0x7fc804008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.163+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc81409b1d0 con 0x7fc81406dff0 2024-09-13T17:15:52.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.334+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81409b1d0 con 0x7fc81406dff0 2024-09-13T17:15:52.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.335+0000 7fc80affd640 1 -- 172.21.15.5:0/2772751942 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16798 (secure 0 0 0) 0x7fc81409b1d0 con 0x7fc81406dff0 2024-09-13T17:15:52.338 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:52.338 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:41.358963+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 msgr2=0x7fc7f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 0x7fc7f806d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc81414a3d0 tx=0x7fc804008040 comp rx=0 tx=0).stop 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 msgr2=0x7fc814143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc81000b2c0 tx=0x7fc810004730 comp rx=0 tx=0).stop 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 shutdown_connections 2024-09-13T17:15:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc814156f40 0x7fc814156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8140b1080 0x7fc814156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc7f806ac00 0x7fc7f806d0c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 --2- 172.21.15.5:0/2772751942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc81406dff0 0x7fc814143ce0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 >> 172.21.15.5:0/2772751942 conn(0x7fc8140ce0d0 msgr2=0x7fc8140ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 shutdown_connections 2024-09-13T17:15:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.338+0000 7fc81c473640 1 -- 172.21.15.5:0/2772751942 wait complete. 2024-09-13T17:15:52.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:15:11.264640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:15:11.998886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:52.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.454+0000 7fec9f1ae640 1 Processor -- start 2024-09-13T17:15:52.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.454+0000 7fec9f1ae640 1 -- start start 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9f1ae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec98099110 0x7fec980cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9f1ae640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980704a0 con 0x7fec9815fd80 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9f1ae640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9806bd80 con 0x7fec980d0e30 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9f1ae640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9806cc10 con 0x7fec98099110 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec98099110 0x7fec980cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9cf4a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec9815fd80 0x7fec98098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34122/0 (socket says 172.21.15.5:34122) 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec9cf4a640 1 -- 172.21.15.5:0/625344643 learned_addr learned my addr 172.21.15.5:0/625344643 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec98099110 0x7fec980cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59506/0 (socket says 172.21.15.5:59506) 2024-09-13T17:15:52.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec97fff640 1 -- 172.21.15.5:0/625344643 >> v1:172.21.15.179:6789/0 conn(0x7fec980d0e30 legacy=0x7fec9806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec977fe640 1 -- 172.21.15.5:0/625344643 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313732940 0 0) 0x7fec980704a0 con 0x7fec9815fd80 2024-09-13T17:15:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec97fff640 1 -- 172.21.15.5:0/625344643 >> v1:172.21.15.5:6789/0 conn(0x7fec9815fd80 legacy=0x7fec98098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.455+0000 7fec97fff640 1 -- 172.21.15.5:0/625344643 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9806c210 con 0x7fec98099110 2024-09-13T17:15:52.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.456+0000 7fec97fff640 1 --2- 172.21.15.5:0/625344643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec98099110 0x7fec980cfd30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fec840097a0 tx=0x7fec8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263f1f4d5b441dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.456+0000 7fec977fe640 1 -- 172.21.15.5:0/625344643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84032440 con 0x7fec98099110 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.456+0000 7fec977fe640 1 -- 172.21.15.5:0/625344643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec840325a0 con 0x7fec98099110 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.456+0000 7fec977fe640 1 -- 172.21.15.5:0/625344643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84032930 con 0x7fec98099110 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 -- 172.21.15.5:0/625344643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec98099110 msgr2=0x7fec980cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/625344643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec98099110 0x7fec980cfd30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fec840097a0 tx=0x7fec8402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 -- 172.21.15.5:0/625344643 shutdown_connections 2024-09-13T17:15:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/625344643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec98099110 0x7fec980cfd30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 -- 172.21.15.5:0/625344643 >> 172.21.15.5:0/625344643 conn(0x7fec980d0310 msgr2=0x7fec980d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 -- 172.21.15.5:0/625344643 shutdown_connections 2024-09-13T17:15:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.457+0000 7fec9f1ae640 1 -- 172.21.15.5:0/625344643 wait complete. 2024-09-13T17:15:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.458+0000 7fec9f1ae640 1 Processor -- start 2024-09-13T17:15:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.458+0000 7fec9f1ae640 1 -- start start 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec98099110 0x7fec980ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9815fd80 0x7fec980c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec981f2f60 con 0x7fec980d0e30 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec981f22e0 con 0x7fec98099110 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9f1ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec981f25c0 con 0x7fec9815fd80 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59520/0 (socket says 172.21.15.5:59520) 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec97fff640 1 -- 172.21.15.5:0/3617812497 learned_addr learned my addr 172.21.15.5:0/3617812497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9cf4a640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec98099110 0x7fec980ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec9d74b640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9815fd80 0x7fec980c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec97fff640 1 -- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9815fd80 msgr2=0x7fec980c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.459+0000 7fec97fff640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9815fd80 0x7fec980c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec97fff640 1 -- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec98099110 msgr2=0x7fec980ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec97fff640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec98099110 0x7fec980ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec97fff640 1 -- 172.21.15.5:0/3617812497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009400 con 0x7fec980d0e30 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec97fff640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fec84000c00 tx=0x7fec840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84004230 con 0x7fec980d0e30 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec84004390 con 0x7fec980d0e30 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec981f28a0 con 0x7fec980d0e30 2024-09-13T17:15:52.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84030ac0 con 0x7fec980d0e30 2024-09-13T17:15:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.460+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec980b4650 con 0x7fec980d0e30 2024-09-13T17:15:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.461+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec981f30a0 con 0x7fec980d0e30 2024-09-13T17:15:52.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.462+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec84039050 con 0x7fec980d0e30 2024-09-13T17:15:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.462+0000 7fec957fa640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 0x7fec7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.462+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7fec840a9f20 con 0x7fec980d0e30 2024-09-13T17:15:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.462+0000 7fec9cf4a640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 0x7fec7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.463+0000 7fec9cf4a640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 0x7fec7c06d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007f70 tx=0x7fec8c007f00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.466+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec981f30a0 con 0x7fec980d0e30 2024-09-13T17:15:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.635+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec981f30a0 con 0x7fec980d0e30 2024-09-13T17:15:52.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.635+0000 7fec957fa640 1 -- 172.21.15.5:0/3617812497 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec981f30a0 con 0x7fec980d0e30 2024-09-13T17:15:52.638 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 msgr2=0x7fec7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 0x7fec7c06d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fec8c007f70 tx=0x7fec8c007f00 comp rx=0 tx=0).stop 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 msgr2=0x7fec980ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fec84000c00 tx=0x7fec840046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 shutdown_connections 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9815fd80 0x7fec980c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec7c06ac00 0x7fec7c06d0c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec980d0e30 0x7fec980ae770 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 --2- 172.21.15.5:0/3617812497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec98099110 0x7fec980ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 >> 172.21.15.5:0/3617812497 conn(0x7fec980d0310 msgr2=0x7fec980ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 shutdown_connections 2024-09-13T17:15:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.637+0000 7fec9f1ae640 1 -- 172.21.15.5:0/3617812497 wait complete. 2024-09-13T17:15:52.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:15:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 Processor -- start 2024-09-13T17:15:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 -- start start 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 0x7f80b80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80b81645e0 0x7f80b81669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b80cf980 con 0x7f80b815c6e0 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80ce570 con 0x7f80b81645e0 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.754+0000 7f80bd33e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80d0630 con 0x7f80b80cf000 2024-09-13T17:15:52.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80b815c6e0 0x7f80b80cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34126/0 (socket says 172.21.15.5:34126) 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b6ffd640 1 -- 172.21.15.5:0/289310987 learned_addr learned my addr 172.21.15.5:0/289310987 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b67fc640 1 --2- 172.21.15.5:0/289310987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 0x7f80b80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b77fe640 1 --2- 172.21.15.5:0/289310987 >> v2:172.21.15.179:3300/0 conn(0x7f80b81645e0 0x7f80b81669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101921392 0 0) 0x7f80b80cf980 con 0x7f80b815c6e0 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a0003520 con 0x7f80b815c6e0 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b67fc640 1 -- 172.21.15.5:0/289310987 >> v2:172.21.15.179:3300/0 conn(0x7f80b81645e0 msgr2=0x7f80b81669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b67fc640 1 --2- 172.21.15.5:0/289310987 >> v2:172.21.15.179:3300/0 conn(0x7f80b81645e0 0x7f80b81669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b67fc640 1 -- 172.21.15.5:0/289310987 >> v1:172.21.15.5:6789/0 conn(0x7f80b815c6e0 legacy=0x7f80b80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248803967 0 0) 0x7f80a0003520 con 0x7f80b815c6e0 2024-09-13T17:15:52.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.755+0000 7f80b67fc640 1 -- 172.21.15.5:0/289310987 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80d0910 con 0x7f80b80cf000 2024-09-13T17:15:52.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.756+0000 7f80b67fc640 1 --2- 172.21.15.5:0/289310987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 0x7f80b80cf440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0097a0 tx=0x7f80ac02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59a4a8852bfda5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.756+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8001670 con 0x7f80b80cf000 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.756+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac02aba0 con 0x7f80b80cf000 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.756+0000 7f80b5ffb640 1 -- 172.21.15.5:0/289310987 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac032440 con 0x7f80b80cf000 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 -- 172.21.15.5:0/289310987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 msgr2=0x7f80b80cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 --2- 172.21.15.5:0/289310987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 0x7f80b80cf440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0097a0 tx=0x7f80ac02a110 comp rx=0 tx=0).stop 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 -- 172.21.15.5:0/289310987 shutdown_connections 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 --2- 172.21.15.5:0/289310987 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80cf000 0x7f80b80cf440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 --2- 172.21.15.5:0/289310987 >> v2:172.21.15.179:3300/0 conn(0x7f80b81645e0 0x7f80b81669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 -- 172.21.15.5:0/289310987 >> 172.21.15.5:0/289310987 conn(0x7f80b8089f90 msgr2=0x7f80b80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 -- 172.21.15.5:0/289310987 shutdown_connections 2024-09-13T17:15:52.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.757+0000 7f80bd33e640 1 -- 172.21.15.5:0/289310987 wait complete. 2024-09-13T17:15:52.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.758+0000 7f80bd33e640 1 Processor -- start 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.758+0000 7f80bd33e640 1 -- start start 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80cf000 0x7f80b815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81645e0 0x7f80b815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80b7610 con 0x7f80b815c6e0 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b815bc10 con 0x7f80b80cf000 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80bd33e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80b7860 con 0x7f80b81645e0 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59524/0 (socket says 172.21.15.5:59524) 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 -- 172.21.15.5:0/246587194 learned_addr learned my addr 172.21.15.5:0/246587194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b6ffd640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80cf000 0x7f80b815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b77fe640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81645e0 0x7f80b815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 -- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81645e0 msgr2=0x7f80b815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81645e0 0x7f80b815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 -- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80cf000 msgr2=0x7f80b815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80cf000 0x7f80b815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 -- 172.21.15.5:0/246587194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009400 con 0x7f80b815c6e0 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.759+0000 7f80b67fc640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80ac02a700 tx=0x7f80ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.760+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0038a0 con 0x7f80b815c6e0 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.760+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac003a00 con 0x7f80b815c6e0 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.760+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80b7b40 con 0x7f80b815c6e0 2024-09-13T17:15:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.760+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003d90 con 0x7f80b815c6e0 2024-09-13T17:15:52.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.760+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80b8100 con 0x7f80b815c6e0 2024-09-13T17:15:52.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.761+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b80672e0 con 0x7f80b815c6e0 2024-09-13T17:15:52.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.761+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f80ac032440 con 0x7f80b815c6e0 2024-09-13T17:15:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.762+0000 7f809f7fe640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 0x7f80a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.762+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f80ac0a9bf0 con 0x7f80b815c6e0 2024-09-13T17:15:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.762+0000 7f80b6ffd640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 0x7f80a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.762+0000 7f80b6ffd640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 0x7f80a406d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005880 tx=0x7f80a8001d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.766+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f80ac074d10 con 0x7f80b815c6e0 2024-09-13T17:15:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.935+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80b80c96a0 con 0x7f80b815c6e0 2024-09-13T17:15:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.936+0000 7f809f7fe640 1 -- 172.21.15.5:0/246587194 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80ac078330 con 0x7f80b815c6e0 2024-09-13T17:15:52.938 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:15:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 msgr2=0x7f80a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 0x7f80a406d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005880 tx=0x7f80a8001d80 comp rx=0 tx=0).stop 2024-09-13T17:15:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 msgr2=0x7f80b815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80ac02a700 tx=0x7f80ac0046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 shutdown_connections 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81645e0 0x7f80b815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f80a406ac00 0x7f80a406d0c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b815c6e0 0x7f80b815eea0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 --2- 172.21.15.5:0/246587194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80cf000 0x7f80b815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 >> 172.21.15.5:0/246587194 conn(0x7f80b8089f90 msgr2=0x7f80b80cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 shutdown_connections 2024-09-13T17:15:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:52.938+0000 7f80bd33e640 1 -- 172.21.15.5:0/246587194 wait complete. 2024-09-13T17:15:52.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:15:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.055+0000 7f5013ac9640 1 Processor -- start 2024-09-13T17:15:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.056+0000 7f5013ac9640 1 -- start start 2024-09-13T17:15:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5013ac9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f500c15c6e0 0x7f500c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5013ac9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f500c0cf000 0x7f500c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5013ac9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0cf980 con 0x7f500c1602c0 2024-09-13T17:15:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5013ac9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0d0630 con 0x7f500c0cf000 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5013ac9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0d0910 con 0x7f500c15c6e0 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f500c0cf000 0x7f500c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f500c0cf000 0x7f500c0cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59534/0 (socket says 172.21.15.5:59534) 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 -- 172.21.15.5:0/275051655 learned_addr learned my addr 172.21.15.5:0/275051655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011865640 1 --2- 172.21.15.5:0/275051655 >> v2:172.21.15.179:3300/0 conn(0x7f500c15c6e0 0x7f500c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 -- 172.21.15.5:0/275051655 >> v2:172.21.15.179:3300/0 conn(0x7f500c15c6e0 msgr2=0x7f500c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 --2- 172.21.15.5:0/275051655 >> v2:172.21.15.179:3300/0 conn(0x7f500c15c6e0 0x7f500c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 -- 172.21.15.5:0/275051655 >> v1:172.21.15.179:6789/0 conn(0x7f500c1602c0 legacy=0x7f500c160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.057+0000 7f5011064640 1 -- 172.21.15.5:0/275051655 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0d0bf0 con 0x7f500c0cf000 2024-09-13T17:15:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.058+0000 7f5011064640 1 --2- 172.21.15.5:0/275051655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c0cf440 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f500c0b51b0 tx=0x7f4ffc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca87a6337545c59f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.058+0000 7f5010863640 1 -- 172.21.15.5:0/275051655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc032440 con 0x7f500c0cf000 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.058+0000 7f5010863640 1 -- 172.21.15.5:0/275051655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0325a0 con 0x7f500c0cf000 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.058+0000 7f5010863640 1 -- 172.21.15.5:0/275051655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc032930 con 0x7f500c0cf000 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 -- 172.21.15.5:0/275051655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 msgr2=0x7f500c0cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 --2- 172.21.15.5:0/275051655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c0cf440 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f500c0b51b0 tx=0x7f4ffc02a270 comp rx=0 tx=0).stop 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 -- 172.21.15.5:0/275051655 shutdown_connections 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 --2- 172.21.15.5:0/275051655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c0cf440 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 --2- 172.21.15.5:0/275051655 >> v2:172.21.15.179:3300/0 conn(0x7f500c15c6e0 0x7f500c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 -- 172.21.15.5:0/275051655 >> 172.21.15.5:0/275051655 conn(0x7f500c089f90 msgr2=0x7f500c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 -- 172.21.15.5:0/275051655 shutdown_connections 2024-09-13T17:15:53.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.059+0000 7f5013ac9640 1 -- 172.21.15.5:0/275051655 wait complete. 2024-09-13T17:15:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.060+0000 7f5013ac9640 1 Processor -- start 2024-09-13T17:15:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.060+0000 7f5013ac9640 1 -- start start 2024-09-13T17:15:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c15c6e0 0x7f500c0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c1602c0 0x7f500c1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b5980 con 0x7f500c0cf000 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b6450 con 0x7f500c15c6e0 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b5bb0 con 0x7f500c1602c0 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59550/0 (socket says 172.21.15.5:59550) 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 -- 172.21.15.5:0/3427607732 learned_addr learned my addr 172.21.15.5:0/3427607732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011064640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c15c6e0 0x7f500c0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5012066640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c1602c0 0x7f500c1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 -- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c1602c0 msgr2=0x7f500c1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c1602c0 0x7f500c1f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 -- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c15c6e0 msgr2=0x7f500c0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c15c6e0 0x7f500c0b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 -- 172.21.15.5:0/3427607732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0094d0 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5011865640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f500800e9b0 tx=0x7f500800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008009670 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500800c9a0 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.061+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c0b5e90 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.062+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500800cd50 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.062+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c0b6e50 con 0x7f500c0cf000 2024-09-13T17:15:53.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.062+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c0672e0 con 0x7f500c0cf000 2024-09-13T17:15:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.063+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5008013470 con 0x7f500c0cf000 2024-09-13T17:15:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.063+0000 7f50027fc640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.063+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f50080896b0 con 0x7f500c0cf000 2024-09-13T17:15:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.064+0000 7f5011064640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.064+0000 7f5011064640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc034000 tx=0x7f4ffc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.068+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50080547d0 con 0x7f500c0cf000 2024-09-13T17:15:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.238+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f500c0d01c0 con 0x7f500c0cf000 2024-09-13T17:15:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.238+0000 7f50027fc640 1 -- 172.21.15.5:0/3427607732 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5008057df0 con 0x7f500c0cf000 2024-09-13T17:15:53.241 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:15:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 msgr2=0x7f4ff006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc034000 tx=0x7f4ffc02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 msgr2=0x7f500c150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f500800e9b0 tx=0x7f500800ee70 comp rx=0 tx=0).stop 2024-09-13T17:15:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 shutdown_connections 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f500c1602c0 0x7f500c1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f500c15c6e0 0x7f500c0b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ff006ac00 0x7f4ff006d0c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 --2- 172.21.15.5:0/3427607732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f500c0cf000 0x7f500c150ae0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 >> 172.21.15.5:0/3427607732 conn(0x7f500c089f90 msgr2=0x7f500c0730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 shutdown_connections 2024-09-13T17:15:53.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.241+0000 7f5013ac9640 1 -- 172.21.15.5:0/3427607732 wait complete. 2024-09-13T17:15:53.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:15:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.354+0000 7f649cb25640 1 Processor -- start 2024-09-13T17:15:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.354+0000 7f649cb25640 1 -- start start 2024-09-13T17:15:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f649cb25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f649806eaf0 0x7f64980b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f649cb25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f649806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f649cb25640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980b35f0 con 0x7f64980b1ac0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f649cb25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649815d140 con 0x7f649806eaf0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f649cb25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6498160020 con 0x7f649806eed0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f6495d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f64980b1ac0 0x7f649815ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34130/0 (socket says 172.21.15.5:34130) 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.355+0000 7f6495d9b640 1 -- 172.21.15.5:0/24444247 learned_addr learned my addr 172.21.15.5:0/24444247 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649659c640 1 --2- 172.21.15.5:0/24444247 >> v2:172.21.15.179:3300/0 conn(0x7f649806eaf0 0x7f64980b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f6496d9d640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f649806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252904612 0 0) 0x7f64980b35f0 con 0x7f64980b1ac0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484003520 con 0x7f64980b1ac0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039990766 0 0) 0x7f6484003520 con 0x7f64980b1ac0 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 msgr2=0x7f649806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f649806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 >> v2:172.21.15.179:3300/0 conn(0x7f649806eaf0 msgr2=0x7f64980b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 --2- 172.21.15.5:0/24444247 >> v2:172.21.15.179:3300/0 conn(0x7f649806eaf0 0x7f64980b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498156f50 con 0x7f64980b1ac0 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f6480001670 con 0x7f64980b1ac0 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 >> v1:172.21.15.5:6789/0 conn(0x7f64980b1ac0 legacy=0x7f649815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6484003970 0x7f6484003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64840047c0 0x7f6484004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f6484005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6498160020 con 0x7f64840047c0 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648400b980 con 0x7f6484003970 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648400bac0 con 0x7f649806eed0 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f6495d9b640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64840047c0 0x7f6484004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f649659c640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6484003970 0x7f6484003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.356+0000 7f6496d9d640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f6484005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 -- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 msgr2=0x7f6484005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649806eed0 0x7f6484005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 -- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6484003970 msgr2=0x7f6484003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6484003970 0x7f6484003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 -- 172.21.15.5:0/24444247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484003520 con 0x7f64840047c0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f6495d9b640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64840047c0 0x7f6484004c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f64980b1ed0 tx=0x7f64840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401462e474808a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005ad0 con 0x7f64840047c0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648002d070 con 0x7f64840047c0 2024-09-13T17:15:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.357+0000 7f649559a640 1 -- 172.21.15.5:0/24444247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005e70 con 0x7f64840047c0 2024-09-13T17:15:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 -- 172.21.15.5:0/24444247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64840047c0 msgr2=0x7f6484004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 --2- 172.21.15.5:0/24444247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64840047c0 0x7f6484004c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f64980b1ed0 tx=0x7f64840057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f6496d9d640 1 -- 172.21.15.5:0/24444247 reap_dead start 2024-09-13T17:15:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 -- 172.21.15.5:0/24444247 shutdown_connections 2024-09-13T17:15:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 -- 172.21.15.5:0/24444247 >> 172.21.15.5:0/24444247 conn(0x7f6498070af0 msgr2=0x7f6498070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 -- 172.21.15.5:0/24444247 shutdown_connections 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.358+0000 7f649cb25640 1 -- 172.21.15.5:0/24444247 wait complete. 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.359+0000 7f649cb25640 1 Processor -- start 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 -- start start 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64840047c0 0x7f64981f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649815a350 0x7f649815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649815ad20 con 0x7f64980cc2f0 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980cca90 con 0x7f649815a350 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f649cb25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980ccd70 con 0x7f64840047c0 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59558/0 (socket says 172.21.15.5:59558) 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.360+0000 7f6495d9b640 1 -- 172.21.15.5:0/3332412435 learned_addr learned my addr 172.21.15.5:0/3332412435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6496d9d640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649815a350 0x7f649815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f649659c640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64840047c0 0x7f64981f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 -- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64840047c0 msgr2=0x7f64981f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64840047c0 0x7f64981f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 -- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649815a350 msgr2=0x7f649815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649815a350 0x7f649815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 -- 172.21.15.5:0/3332412435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980cd050 con 0x7f64980cc2f0 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f6495d9b640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6480001930 tx=0x7f6480000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005c80 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480005e00 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800072b0 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64980cd330 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.361+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64980cc770 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.362+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64980672e0 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.363+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f648002f030 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.363+0000 7f648effd640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 0x7f647806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.363+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f64800a8ce0 con 0x7f64980cc2f0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.363+0000 7f649659c640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 0x7f647806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.364+0000 7f649659c640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 0x7f647806d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6498157d10 tx=0x7f6490009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.367+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6480073e90 con 0x7f64980cc2f0 2024-09-13T17:15:53.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.548+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6498156f50 con 0x7f64980cc2f0 2024-09-13T17:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.549+0000 7f648effd640 1 -- 172.21.15.5:0/3332412435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v55) v1 ==== 80+0+57 (secure 0 0 0) 0x7f6498156f50 con 0x7f64980cc2f0 2024-09-13T17:15:53.551 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.1:0/3403128453 2024-09-13T18:15:40.602047+0000 2024-09-13T17:15:53.551 INFO:teuthology.orchestra.run.smithi005.stderr:listed 1 entries 2024-09-13T17:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 msgr2=0x7f647806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 0x7f647806d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6498157d10 tx=0x7f6490009190 comp rx=0 tx=0).stop 2024-09-13T17:15:53.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 msgr2=0x7f64981595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6480001930 tx=0x7f6480000fe0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 shutdown_connections 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f649815a350 0x7f649815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f647806ac00 0x7f647806d0c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980cc2f0 0x7f64981595c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 --2- 172.21.15.5:0/3332412435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64840047c0 0x7f64981f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 >> 172.21.15.5:0/3332412435 conn(0x7f6498070af0 msgr2=0x7f649815cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 shutdown_connections 2024-09-13T17:15:53.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.551+0000 7f649cb25640 1 -- 172.21.15.5:0/3332412435 wait complete. 2024-09-13T17:15:53.564 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2024-09-13T17:15:53.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:53.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:53.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:15:53.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:53.592 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:15:53.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:15:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.788+0000 7ffb5160d640 1 Processor -- start 2024-09-13T17:15:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.788+0000 7ffb5160d640 1 -- start start 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb5160d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb4c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb5160d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c0b2390 con 0x7ffb4c156f40 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb5160d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c0b1780 con 0x7ffb4c06e1c0 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb5160d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0b1a60 con 0x7ffb4c0aced0 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb4affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb4c156f40 0x7ffb4c06dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47472/0 (socket says 172.21.15.5:47472) 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb4affd640 1 -- 172.21.15.5:0/164820777 learned_addr learned my addr 172.21.15.5:0/164820777 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309157318 0 0) 0x7ffb4c0b2390 con 0x7ffb4c156f40 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb34003520 con 0x7ffb4c156f40 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.789+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb4c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149042760 0 0) 0x7ffb34003520 con 0x7ffb4c156f40 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 msgr2=0x7ffb4c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb4c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 >> v1:172.21.15.179:6789/0 conn(0x7ffb4c06e1c0 legacy=0x7ffb4c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0b1d40 con 0x7ffb4c156f40 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ffb3c001670 con 0x7ffb4c156f40 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 >> v1:172.21.15.5:6789/0 conn(0x7ffb4c156f40 legacy=0x7ffb4c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb340039a0 0x7ffb34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb34004d00 0x7ffb34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0b1a60 con 0x7ffb34004d00 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3400bb10 con 0x7ffb340039a0 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3400bca0 con 0x7ffb4c0aced0 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb34004d00 0x7ffb34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4affd640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb340039a0 0x7ffb34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4a7fc640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 -- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 msgr2=0x7ffb340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb4c0aced0 0x7ffb340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 -- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb340039a0 msgr2=0x7ffb34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb340039a0 0x7ffb34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.790+0000 7ffb4b7fe640 1 -- 172.21.15.5:0/164820777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34003520 con 0x7ffb34004d00 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb34004d00 0x7ffb34005180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007390 tx=0x7ffb340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef7c6875e41f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4402e620 con 0x7ffb34004d00 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4402e780 con 0x7ffb34004d00 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb49ffb640 1 -- 172.21.15.5:0/164820777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4402eb10 con 0x7ffb34004d00 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb5160d640 1 -- 172.21.15.5:0/164820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb34004d00 msgr2=0x7ffb34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb5160d640 1 --2- 172.21.15.5:0/164820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb34004d00 0x7ffb34005180 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007390 tx=0x7ffb340057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.791+0000 7ffb4b7fe640 1 -- 172.21.15.5:0/164820777 reap_dead start 2024-09-13T17:15:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.792+0000 7ffb5160d640 1 -- 172.21.15.5:0/164820777 shutdown_connections 2024-09-13T17:15:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.792+0000 7ffb5160d640 1 -- 172.21.15.5:0/164820777 >> 172.21.15.5:0/164820777 conn(0x7ffb4c0ce0d0 msgr2=0x7ffb4c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.792+0000 7ffb5160d640 1 -- 172.21.15.5:0/164820777 shutdown_connections 2024-09-13T17:15:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.792+0000 7ffb5160d640 1 -- 172.21.15.5:0/164820777 wait complete. 2024-09-13T17:15:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.793+0000 7ffb5160d640 1 Processor -- start 2024-09-13T17:15:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.793+0000 7ffb5160d640 1 -- start start 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34004d00 0x7ffb4c1f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c14ec70 0x7ffb4c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1f0ef0 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c14e200 con 0x7ffb4c14ec70 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1511d0 con 0x7ffb34004d00 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60654/0 (socket says 172.21.15.5:60654) 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 -- 172.21.15.5:0/3765542790 learned_addr learned my addr 172.21.15.5:0/3765542790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4b7fe640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c14ec70 0x7ffb4c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4affd640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34004d00 0x7ffb4c1f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 -- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34004d00 msgr2=0x7ffb4c1f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34004d00 0x7ffb4c1f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 -- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c14ec70 msgr2=0x7ffb4c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c14ec70 0x7ffb4c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 -- 172.21.15.5:0/3765542790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c14e910 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb4a7fc640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000f820 tx=0x7ffb4000fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40001360 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400050d0 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c150c10 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.794+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40005480 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.795+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c14da80 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.795+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c067620 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.796+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb4000d650 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.796+0000 7ffb337fe640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 0x7ffb3806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.797+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7ffb40089250 con 0x7ffb4c14e3c0 2024-09-13T17:15:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.797+0000 7ffb4affd640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 0x7ffb3806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.797+0000 7ffb4affd640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 0x7ffb3806d0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c159340 tx=0x7ffb3c001170 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:53.801+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffb40054220 con 0x7ffb4c14e3c0 2024-09-13T17:15:54.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.007+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb4c0672a0 con 0x7ffb4c14e3c0 2024-09-13T17:15:54.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.007+0000 7ffb337fe640 1 -- 172.21.15.5:0/3765542790 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb40057840 con 0x7ffb4c14e3c0 2024-09-13T17:15:54.010 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:15:54.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 msgr2=0x7ffb3806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 0x7ffb3806d0f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c159340 tx=0x7ffb3c001170 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 msgr2=0x7ffb4c14d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000f820 tx=0x7ffb4000fc20 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 shutdown_connections 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c14ec70 0x7ffb4c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffb3806ac30 0x7ffb3806d0f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb4c14e3c0 0x7ffb4c14d540 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 --2- 172.21.15.5:0/3765542790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb34004d00 0x7ffb4c1f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 >> 172.21.15.5:0/3765542790 conn(0x7ffb4c0ce0d0 msgr2=0x7ffb4c09a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 shutdown_connections 2024-09-13T17:15:54.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:54.009+0000 7ffb5160d640 1 -- 172.21.15.5:0/3765542790 wait complete. 2024-09-13T17:15:54.022 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:15:54.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:15:54.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:15:54.023 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:54.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.023 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:54.040 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:54.041 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:15:54.042 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:15:54.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.043 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:15:54.104 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:15:54.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.105 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:15:54.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.163 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:15:54.164 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:15:54.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:15:54.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:15:54.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:15:54.164 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:15:54.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.252 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:15:54.268 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:15:54.268 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:15:54.268 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:54.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:15:54.335 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:15:54.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:54.335 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:54.391 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:15:54.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:15:54.392 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:54.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:15:54.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:54.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:54.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:54.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.581 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:15:54.638 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:15:54.638 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:15:54.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:15:54.706 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:15:54.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:15:54.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:15:54.761+0000 7feee6fd4480 -1 init, newargv = 0x55a418bb6170 newargc=15 2024-09-13T17:15:54.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[58720]: starting ceph client 2024-09-13T17:15:54.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[58720]: starting fuse 2024-09-13T17:15:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:15:54.774 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:15:54.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:54.774 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:15:54.831 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:15:54.832 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:15:54.832 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:15:54.833 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:15:54.834 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:15:54.834 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:15:54.834 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:15:54.947 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.58720.asok 2024-09-13T17:15:55.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58720.asok 2024-09-13T17:15:55.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:55.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58720.asok status 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:15:55.272 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "58720", 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6414, 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6414 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:55.273 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2400092482 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2400092482 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.6414 192.168.0.1:0/2400092482", 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2400092482", 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 24, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 55, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:15:55.274 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:15:55.275 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:15:55.275 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:15:55.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:55.280 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:15:55.281 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:55.297 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:15:55.298 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:55.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:55.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:55.364 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:15:55.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:15:55.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:15:55.498 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:15:55.499 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:15:55.499 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:55.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.655+0000 7f004e0a3640 1 Processor -- start 2024-09-13T17:15:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.655+0000 7f004e0a3640 1 -- start start 2024-09-13T17:15:55.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f004e0a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0048159290 0x7f0048159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f004e0a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0048071190 0x7f004806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f004e0a3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00480b1580 con 0x7f0048159bb0 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f004e0a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480b2ad0 con 0x7f0048159290 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f004e0a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480b1ec0 con 0x7f0048071190 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f00477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0048159290 0x7f0048159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f00477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0048159290 0x7f0048159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60658/0 (socket says 172.21.15.5:60658) 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f00477fe640 1 -- 172.21.15.5:0/1907229930 learned_addr learned my addr 172.21.15.5:0/1907229930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.656+0000 7f0047fff640 1 --2- 172.21.15.5:0/1907229930 >> v2:172.21.15.179:3300/0 conn(0x7f0048071190 0x7f004806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.657+0000 7f00477fe640 1 -- 172.21.15.5:0/1907229930 >> v2:172.21.15.179:3300/0 conn(0x7f0048071190 msgr2=0x7f004806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.657+0000 7f00477fe640 1 --2- 172.21.15.5:0/1907229930 >> v2:172.21.15.179:3300/0 conn(0x7f0048071190 0x7f004806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.657+0000 7f00477fe640 1 -- 172.21.15.5:0/1907229930 >> v1:172.21.15.179:6789/0 conn(0x7f0048159bb0 legacy=0x7f0048070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.657+0000 7f00477fe640 1 -- 172.21.15.5:0/1907229930 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480b21a0 con 0x7f0048159290 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.657+0000 7f00477fe640 1 --2- 172.21.15.5:0/1907229930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048159290 0x7f0048159670 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f00480adc90 tx=0x7f003802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6ba0d208694ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f00467fc640 1 -- 172.21.15.5:0/1907229930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038032440 con 0x7f0048159290 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f00467fc640 1 -- 172.21.15.5:0/1907229930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380325a0 con 0x7f0048159290 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f00467fc640 1 -- 172.21.15.5:0/1907229930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038032930 con 0x7f0048159290 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 -- 172.21.15.5:0/1907229930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048159290 msgr2=0x7f0048159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 --2- 172.21.15.5:0/1907229930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048159290 0x7f0048159670 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f00480adc90 tx=0x7f003802a270 comp rx=0 tx=0).stop 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 -- 172.21.15.5:0/1907229930 shutdown_connections 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 --2- 172.21.15.5:0/1907229930 >> v2:172.21.15.179:3300/0 conn(0x7f0048071190 0x7f004806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 --2- 172.21.15.5:0/1907229930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048159290 0x7f0048159670 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 -- 172.21.15.5:0/1907229930 >> 172.21.15.5:0/1907229930 conn(0x7f00480ce0d0 msgr2=0x7f00480ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 -- 172.21.15.5:0/1907229930 shutdown_connections 2024-09-13T17:15:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.658+0000 7f004e0a3640 1 -- 172.21.15.5:0/1907229930 wait complete. 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.659+0000 7f004e0a3640 1 Processor -- start 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 -- start start 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0048159290 0x7f00480ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0048159bb0 0x7f00480ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480cd050 con 0x7f0048071190 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480cd330 con 0x7f0048159bb0 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f004e0a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480ac450 con 0x7f0048159290 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f00477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f00477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60666/0 (socket says 172.21.15.5:60666) 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f00477fe640 1 -- 172.21.15.5:0/2532283004 learned_addr learned my addr 172.21.15.5:0/2532283004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:55.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.660+0000 7f0047fff640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0048159bb0 0x7f00480ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f0046ffd640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0048159290 0x7f00480ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 -- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0048159290 msgr2=0x7f00480ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0048159290 0x7f00480ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 -- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0048159bb0 msgr2=0x7f00480ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0048159bb0 0x7f00480ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 -- 172.21.15.5:0/2532283004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380094d0 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f00477fe640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f003802a2b0 tx=0x7f00380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038032440 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038030ba0 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480b30e0 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003803d440 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.661+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00480cda60 con 0x7f0048071190 2024-09-13T17:15:55.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.662+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0048067280 con 0x7f0048071190 2024-09-13T17:15:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.663+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0038039040 con 0x7f0048071190 2024-09-13T17:15:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.663+0000 7f002ffff640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 0x7f003406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.663+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f00380a9f50 con 0x7f0048071190 2024-09-13T17:15:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.663+0000 7f0046ffd640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 0x7f003406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.664+0000 7f0046ffd640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 0x7f003406d0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00480ca520 tx=0x7f003c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.668+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0038075070 con 0x7f0048071190 2024-09-13T17:15:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.842+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00480b1970 con 0x7f0048071190 2024-09-13T17:15:55.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.843+0000 7f002ffff640 1 -- 172.21.15.5:0/2532283004 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16798 (secure 0 0 0) 0x7f0038037090 con 0x7f0048071190 2024-09-13T17:15:55.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:55.845 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:41.358963+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 msgr2=0x7f003406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 0x7f003406d0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00480ca520 tx=0x7f003c009040 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 msgr2=0x7f00480af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f003802a2b0 tx=0x7f00380046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 shutdown_connections 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0048159bb0 0x7f00480ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0048159290 0x7f00480ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f003406ac00 0x7f003406d0c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 --2- 172.21.15.5:0/2532283004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0048071190 0x7f00480af3d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 >> 172.21.15.5:0/2532283004 conn(0x7f00480ce0d0 msgr2=0x7f0048152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 shutdown_connections 2024-09-13T17:15:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.845+0000 7f004e0a3640 1 -- 172.21.15.5:0/2532283004 wait complete. 2024-09-13T17:15:55.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:15:11.264640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:15:11.998886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:55.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.963+0000 7fb6f5583640 1 Processor -- start 2024-09-13T17:15:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.963+0000 7fb6f5583640 1 -- start start 2024-09-13T17:15:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6f5583640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6f01591e0 0x7fb6f00abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6f5583640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f00ad050 con 0x7fb6f00ad4e0 2024-09-13T17:15:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6f5583640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f00ac440 con 0x7fb6f006da30 2024-09-13T17:15:55.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6f5583640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f00ac720 con 0x7fb6f01591e0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6eeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6f01591e0 0x7fb6f00abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6e7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6f00ad4e0 0x7fb6f00b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47474/0 (socket says 172.21.15.5:47474) 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6e7fff640 1 -- 172.21.15.5:0/1210744884 learned_addr learned my addr 172.21.15.5:0/1210744884 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6eeffd640 1 -- 172.21.15.5:0/1210744884 >> v1:172.21.15.179:6789/0 conn(0x7fb6f006da30 legacy=0x7fb6f00700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6eeffd640 1 -- 172.21.15.5:0/1210744884 >> v1:172.21.15.5:6789/0 conn(0x7fb6f00ad4e0 legacy=0x7fb6f00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6ee7fc640 1 -- 172.21.15.5:0/1210744884 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405057281 0 0) 0x7fb6f00ad050 con 0x7fb6f00ad4e0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.964+0000 7fb6eeffd640 1 -- 172.21.15.5:0/1210744884 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00aca00 con 0x7fb6f01591e0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.965+0000 7fb6eeffd640 1 --2- 172.21.15.5:0/1210744884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f01591e0 0x7fb6f00abe60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097a0 tx=0x7fb6e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab623592cc1196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.965+0000 7fb6ee7fc640 1 -- 172.21.15.5:0/1210744884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0032440 con 0x7fb6f01591e0 2024-09-13T17:15:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.965+0000 7fb6ee7fc640 1 -- 172.21.15.5:0/1210744884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00325a0 con 0x7fb6f01591e0 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.965+0000 7fb6ee7fc640 1 -- 172.21.15.5:0/1210744884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0032930 con 0x7fb6f01591e0 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 -- 172.21.15.5:0/1210744884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f01591e0 msgr2=0x7fb6f00abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 --2- 172.21.15.5:0/1210744884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f01591e0 0x7fb6f00abe60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097a0 tx=0x7fb6e002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 -- 172.21.15.5:0/1210744884 shutdown_connections 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 --2- 172.21.15.5:0/1210744884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f01591e0 0x7fb6f00abe60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 -- 172.21.15.5:0/1210744884 >> 172.21.15.5:0/1210744884 conn(0x7fb6f00ce130 msgr2=0x7fb6f00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 -- 172.21.15.5:0/1210744884 shutdown_connections 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.966+0000 7fb6f5583640 1 -- 172.21.15.5:0/1210744884 wait complete. 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.967+0000 7fb6f5583640 1 Processor -- start 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.967+0000 7fb6f5583640 1 -- start start 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 0x7fb6f0152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 0x7fb6f0098a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01557b0 con 0x7fb6f006da30 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0155a90 con 0x7fb6f00ad4e0 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6f5583640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0155d70 con 0x7fb6f01591e0 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60672/0 (socket says 172.21.15.5:60672) 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 -- 172.21.15.5:0/3138108352 learned_addr learned my addr 172.21.15.5:0/3138108352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6e7fff640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 0x7fb6f0152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6ef7fe640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 0x7fb6f0098a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 -- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 msgr2=0x7fb6f0098a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 0x7fb6f0098a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 -- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 msgr2=0x7fb6f0152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 0x7fb6f0152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:55.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 -- 172.21.15.5:0/3138108352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e0009400 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6e7fff640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 0x7fb6f0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6ef7fe640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 0x7fb6f0098a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6eeffd640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0000c00 tx=0x7fb6e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.968+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0030b80 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.969+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0030ce0 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.969+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f0156050 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.969+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e003b640 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.969+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f009abd0 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.970+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f009ae80 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.970+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb6e0039040 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.971+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 0x7fb6d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.971+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7fb6e00a9d50 con 0x7fb6f006da30 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.971+0000 7fb6e7fff640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 0x7fb6d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:55.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.971+0000 7fb6e7fff640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 0x7fb6d006d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00cd310 tx=0x7fb6d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:55.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:55.975+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb6e00ad030 con 0x7fb6f006da30 2024-09-13T17:15:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.145+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6f00672a0 con 0x7fb6f006da30 2024-09-13T17:15:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.146+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3138108352 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6e00370a0 con 0x7fb6f006da30 2024-09-13T17:15:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 msgr2=0x7fb6d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 0x7fb6d006d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00cd310 tx=0x7fb6d8009040 comp rx=0 tx=0).stop 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 msgr2=0x7fb6f0153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0000c00 tx=0x7fb6e00046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 shutdown_connections 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6f01591e0 0x7fb6f0098a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6f00ad4e0 0x7fb6f0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb6d006ac00 0x7fb6d006d0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 --2- 172.21.15.5:0/3138108352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6f006da30 0x7fb6f0153e40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 >> 172.21.15.5:0/3138108352 conn(0x7fb6f00ce130 msgr2=0x7fb6f006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 shutdown_connections 2024-09-13T17:15:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.148+0000 7fb6f5583640 1 -- 172.21.15.5:0/3138108352 wait complete. 2024-09-13T17:15:56.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:15:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.263+0000 7f15b4101640 1 Processor -- start 2024-09-13T17:15:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.263+0000 7f15b4101640 1 -- start start 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b4101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 0x7f15ac0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b4101640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15ac0d0e30 0x7f15ac06e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b4101640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0704a0 con 0x7f15ac15fd80 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b4101640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac06cc10 con 0x7f15ac0d0e30 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b4101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0d12c0 con 0x7f15ac099110 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b1e9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15ac15fd80 0x7f15ac098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47478/0 (socket says 172.21.15.5:47478) 2024-09-13T17:15:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b1e9d640 1 -- 172.21.15.5:0/252174992 learned_addr learned my addr 172.21.15.5:0/252174992 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b169c640 1 --2- 172.21.15.5:0/252174992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 0x7f15ac0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.264+0000 7f15b269e640 1 --2- 172.21.15.5:0/252174992 >> v2:172.21.15.179:3300/0 conn(0x7f15ac0d0e30 0x7f15ac06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524972039 0 0) 0x7f15ac0704a0 con 0x7f15ac15fd80 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1598003520 con 0x7f15ac15fd80 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b169c640 1 -- 172.21.15.5:0/252174992 >> v2:172.21.15.179:3300/0 conn(0x7f15ac0d0e30 msgr2=0x7f15ac06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b169c640 1 --2- 172.21.15.5:0/252174992 >> v2:172.21.15.179:3300/0 conn(0x7f15ac0d0e30 0x7f15ac06e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1173535875 0 0) 0x7f1598003520 con 0x7f15ac15fd80 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b169c640 1 -- 172.21.15.5:0/252174992 >> v1:172.21.15.5:6789/0 conn(0x7f15ac15fd80 legacy=0x7f15ac098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.265+0000 7f15b169c640 1 -- 172.21.15.5:0/252174992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac06bd80 con 0x7f15ac099110 2024-09-13T17:15:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b169c640 1 --2- 172.21.15.5:0/252174992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 0x7f15ac0cfd30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097a0 tx=0x7f159c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f9e653291c636d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8001670 con 0x7f15ac099110 2024-09-13T17:15:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c02ab10 con 0x7f15ac099110 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b0e9b640 1 -- 172.21.15.5:0/252174992 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c02aea0 con 0x7f15ac099110 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 -- 172.21.15.5:0/252174992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 msgr2=0x7f15ac0cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 --2- 172.21.15.5:0/252174992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 0x7f15ac0cfd30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097a0 tx=0x7f159c02a080 comp rx=0 tx=0).stop 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 -- 172.21.15.5:0/252174992 shutdown_connections 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 --2- 172.21.15.5:0/252174992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac099110 0x7f15ac0cfd30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 --2- 172.21.15.5:0/252174992 >> v2:172.21.15.179:3300/0 conn(0x7f15ac0d0e30 0x7f15ac06e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.266+0000 7f15b4101640 1 -- 172.21.15.5:0/252174992 >> 172.21.15.5:0/252174992 conn(0x7f15ac0d0310 msgr2=0x7f15ac0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.267+0000 7f15b4101640 1 -- 172.21.15.5:0/252174992 shutdown_connections 2024-09-13T17:15:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.267+0000 7f15b4101640 1 -- 172.21.15.5:0/252174992 wait complete. 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.268+0000 7f15b4101640 1 Processor -- start 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.268+0000 7f15b4101640 1 -- start start 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac0d0e30 0x7f15ac0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15ac15fd80 0x7f15ac0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0ad1e0 con 0x7f15ac099110 2024-09-13T17:15:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0ad480 con 0x7f15ac15fd80 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0aeec0 con 0x7f15ac0d0e30 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60674/0 (socket says 172.21.15.5:60674) 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 -- 172.21.15.5:0/2795300691 learned_addr learned my addr 172.21.15.5:0/2795300691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b269e640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15ac15fd80 0x7f15ac0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b169c640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac0d0e30 0x7f15ac0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 -- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac0d0e30 msgr2=0x7f15ac0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac0d0e30 0x7f15ac0c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 -- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15ac15fd80 msgr2=0x7f15ac0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15ac15fd80 0x7f15ac0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 -- 172.21.15.5:0/2795300691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009400 con 0x7f15ac099110 2024-09-13T17:15:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b1e9d640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f15a80011e0 tx=0x7f15a800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8005ad0 con 0x7f15ac099110 2024-09-13T17:15:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8005c50 con 0x7f15ac099110 2024-09-13T17:15:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0af1a0 con 0x7f15ac099110 2024-09-13T17:15:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.269+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8007070 con 0x7f15ac099110 2024-09-13T17:15:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.270+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac09b240 con 0x7f15ac099110 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.270+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0aed20 con 0x7f15ac099110 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.271+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15a80071d0 con 0x7f15ac099110 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.271+0000 7f15a27fc640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 0x7f159006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.271+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6072+0+0 (secure 0 0 0) 0x7f15a8088c30 con 0x7f15ac099110 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.272+0000 7f15b169c640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 0x7f159006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.272+0000 7f15b169c640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 0x7f159006d0f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097a0 tx=0x7f159c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.275+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f15ac0aed20 con 0x7f15ac099110 2024-09-13T17:15:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.452+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15ac06c1f0 con 0x7f15ac099110 2024-09-13T17:15:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.452+0000 7f15a27fc640 1 -- 172.21.15.5:0/2795300691 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15ac06c1f0 con 0x7f15ac099110 2024-09-13T17:15:56.455 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.454+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 msgr2=0x7f159006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 0x7f159006d0f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097a0 tx=0x7f159c02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 msgr2=0x7f15ac09ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f15a80011e0 tx=0x7f15a800cc00 comp rx=0 tx=0).stop 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 shutdown_connections 2024-09-13T17:15:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15ac15fd80 0x7f15ac0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15ac0d0e30 0x7f15ac0c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f159006ac30 0x7f159006d0f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 --2- 172.21.15.5:0/2795300691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac099110 0x7f15ac09ad00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 >> 172.21.15.5:0/2795300691 conn(0x7f15ac0d0310 msgr2=0x7f15ac0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 shutdown_connections 2024-09-13T17:15:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.455+0000 7f15b4101640 1 -- 172.21.15.5:0/2795300691 wait complete. 2024-09-13T17:15:56.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:15:56.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.570+0000 7f18af6f0640 1 Processor -- start 2024-09-13T17:15:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.570+0000 7f18af6f0640 1 -- start start 2024-09-13T17:15:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18af6f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18af6f0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80b35f0 con 0x7f18a806eaf0 2024-09-13T17:15:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18af6f0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a8156f50 con 0x7f18a80b1ac0 2024-09-13T17:15:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18af6f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815d140 con 0x7f18a806eed0 2024-09-13T17:15:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18ad48c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18a806eaf0 0x7f18a80b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47482/0 (socket says 172.21.15.5:47482) 2024-09-13T17:15:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.571+0000 7f18ad48c640 1 -- 172.21.15.5:0/286616900 learned_addr learned my addr 172.21.15.5:0/286616900 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f18adc8d640 1 --2- 172.21.15.5:0/286616900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891140039 0 0) 0x7f18a80b35f0 con 0x7f18a806eaf0 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1894003520 con 0x7f18a806eaf0 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f18adc8d640 1 -- 172.21.15.5:0/286616900 >> v1:172.21.15.179:6789/0 conn(0x7f18a80b1ac0 legacy=0x7f18a815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330321543 0 0) 0x7f1898001110 con 0x7f18a80b1ac0 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f18adc8d640 1 -- 172.21.15.5:0/286616900 >> v1:172.21.15.5:6789/0 conn(0x7f18a806eaf0 legacy=0x7f18a80b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.572+0000 7f18adc8d640 1 -- 172.21.15.5:0/286616900 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80b1fa0 con 0x7f18a806eed0 2024-09-13T17:15:56.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.573+0000 7f18adc8d640 1 --2- 172.21.15.5:0/286616900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a806aea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dc0 tx=0x7f18a002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec46fb989f478814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.573+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0007740 con 0x7f18a806eed0 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.573+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a002d050 con 0x7f18a806eed0 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.573+0000 7f189ffff640 1 -- 172.21.15.5:0/286616900 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0007ac0 con 0x7f18a806eed0 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 -- 172.21.15.5:0/286616900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 msgr2=0x7f18a806aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 --2- 172.21.15.5:0/286616900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a806aea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dc0 tx=0x7f18a002a6d0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 -- 172.21.15.5:0/286616900 shutdown_connections 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 --2- 172.21.15.5:0/286616900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a806aea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 -- 172.21.15.5:0/286616900 >> 172.21.15.5:0/286616900 conn(0x7f18a8070af0 msgr2=0x7f18a8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 -- 172.21.15.5:0/286616900 shutdown_connections 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.574+0000 7f18af6f0640 1 -- 172.21.15.5:0/286616900 wait complete. 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.575+0000 7f18af6f0640 1 Processor -- start 2024-09-13T17:15:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.575+0000 7f18af6f0640 1 -- start start 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a806eaf0 0x7f18a81570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a80af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8151860 con 0x7f18a80b1ac0 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81576d0 con 0x7f18a806eaf0 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18af6f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81420c0 con 0x7f18a806eed0 2024-09-13T17:15:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60686/0 (socket says 172.21.15.5:60686) 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 -- 172.21.15.5:0/2680429898 learned_addr learned my addr 172.21.15.5:0/2680429898 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18ad48c640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a806eaf0 0x7f18a81570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18acc8b640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a80af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 -- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 msgr2=0x7f18a80af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a80af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 -- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a806eaf0 msgr2=0x7f18a81570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a806eaf0 0x7f18a81570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 -- 172.21.15.5:0/2680429898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0009a70 con 0x7f18a80b1ac0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.576+0000 7f18adc8d640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dc0 tx=0x7f18a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.577+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a003c8f0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.577+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a003ca50 con 0x7f18a80b1ac0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.577+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a003cde0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.577+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a81423a0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.577+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8141cd0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.578+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80672e0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.578+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18a0031400 con 0x7f18a80b1ac0 2024-09-13T17:15:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.579+0000 7f189dffb640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 0x7f188c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.579+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f18a00aad30 con 0x7f18a80b1ac0 2024-09-13T17:15:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.579+0000 7f18ad48c640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 0x7f188c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.579+0000 7f18ad48c640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 0x7f188c06d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18a4005880 tx=0x7f18a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.583+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18a0075d70 con 0x7f18a80b1ac0 2024-09-13T17:15:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.753+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18a81428c0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.754+0000 7f189dffb640 1 -- 172.21.15.5:0/2680429898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18a81428c0 con 0x7f18a80b1ac0 2024-09-13T17:15:56.756 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 msgr2=0x7f188c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 0x7f188c06d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18a4005880 tx=0x7f18a4009040 comp rx=0 tx=0).stop 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 msgr2=0x7f18a8142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dc0 tx=0x7f18a0004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 shutdown_connections 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f188c06ac00 0x7f188c06d0c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a80b1ac0 0x7f18a8142ba0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a806eed0 0x7f18a80af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 --2- 172.21.15.5:0/2680429898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a806eaf0 0x7f18a81570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 >> 172.21.15.5:0/2680429898 conn(0x7f18a8070af0 msgr2=0x7f18a8070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 shutdown_connections 2024-09-13T17:15:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.756+0000 7f18af6f0640 1 -- 172.21.15.5:0/2680429898 wait complete. 2024-09-13T17:15:56.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:15:56.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.869+0000 7faa0f576640 1 Processor -- start 2024-09-13T17:15:56.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.869+0000 7faa0f576640 1 -- start start 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0f576640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa080aced0 0x7faa0815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0f576640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080b2390 con 0x7faa08156f40 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0f576640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080b1780 con 0x7faa0806e1c0 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0f576640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa080ad340 con 0x7faa080aced0 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0d312640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa08156f40 0x7faa0806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47492/0 (socket says 172.21.15.5:47492) 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0d312640 1 -- 172.21.15.5:0/3167559372 learned_addr learned my addr 172.21.15.5:0/3167559372 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7faa0db13640 1 --2- 172.21.15.5:0/3167559372 >> v2:172.21.15.179:3300/0 conn(0x7faa080aced0 0x7faa0815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.870+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793702026 0 0) 0x7faa080b2390 con 0x7faa08156f40 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.871+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f4003520 con 0x7faa08156f40 2024-09-13T17:15:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.871+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296812315 0 0) 0x7fa9f4003520 con 0x7faa08156f40 2024-09-13T17:15:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.871+0000 7faa0db13640 1 -- 172.21.15.5:0/3167559372 >> v1:172.21.15.179:6789/0 conn(0x7faa0806e1c0 legacy=0x7faa08160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.871+0000 7faa0db13640 1 -- 172.21.15.5:0/3167559372 >> v1:172.21.15.5:6789/0 conn(0x7faa08156f40 legacy=0x7faa0806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.871+0000 7faa0db13640 1 -- 172.21.15.5:0/3167559372 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080b1a60 con 0x7faa080aced0 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0db13640 1 --2- 172.21.15.5:0/3167559372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa080aced0 0x7faa0815a290 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171c521a2c33a485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04001670 con 0x7faa080aced0 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0002d050 con 0x7faa080aced0 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7fa9fffff640 1 -- 172.21.15.5:0/3167559372 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00007740 con 0x7faa080aced0 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 -- 172.21.15.5:0/3167559372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa080aced0 msgr2=0x7faa0815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 --2- 172.21.15.5:0/3167559372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa080aced0 0x7faa0815a290 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0002a680 comp rx=0 tx=0).stop 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 -- 172.21.15.5:0/3167559372 shutdown_connections 2024-09-13T17:15:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 --2- 172.21.15.5:0/3167559372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa080aced0 0x7faa0815a290 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 -- 172.21.15.5:0/3167559372 >> 172.21.15.5:0/3167559372 conn(0x7faa080ce0d0 msgr2=0x7faa080ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.872+0000 7faa0f576640 1 -- 172.21.15.5:0/3167559372 shutdown_connections 2024-09-13T17:15:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.873+0000 7faa0f576640 1 -- 172.21.15.5:0/3167559372 wait complete. 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.874+0000 7faa0f576640 1 Processor -- start 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.874+0000 7faa0f576640 1 -- start start 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.874+0000 7faa0f576640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa080aced0 0x7faa08142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa08156f40 0x7faa08153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0814e700 con 0x7faa0806e1c0 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa081521e0 con 0x7faa08156f40 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa08150910 con 0x7faa080aced0 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60692/0 (socket says 172.21.15.5:60692) 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 -- 172.21.15.5:0/2360140438 learned_addr learned my addr 172.21.15.5:0/2360140438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0cb11640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa080aced0 0x7faa08142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0db13640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa08156f40 0x7faa08153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 -- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa080aced0 msgr2=0x7faa08142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa080aced0 0x7faa08142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 -- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa08156f40 msgr2=0x7faa08153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa08156f40 0x7faa08153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 -- 172.21.15.5:0/2360140438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009a70 con 0x7faa0806e1c0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0d312640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7faa04007fd0 tx=0x7faa0400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04005ce0 con 0x7faa0806e1c0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0814ffe0 con 0x7faa0806e1c0 2024-09-13T17:15:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa04005e40 con 0x7faa0806e1c0 2024-09-13T17:15:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.875+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04007270 con 0x7faa0806e1c0 2024-09-13T17:15:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.876+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa081505a0 con 0x7faa0806e1c0 2024-09-13T17:15:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.876+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa080672a0 con 0x7faa0806e1c0 2024-09-13T17:15:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.877+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa040073d0 con 0x7faa0806e1c0 2024-09-13T17:15:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.877+0000 7fa9fdffb640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 0x7fa9ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.878+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6130+0+0 (secure 0 0 0) 0x7faa04088a70 con 0x7faa0806e1c0 2024-09-13T17:15:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.878+0000 7faa0cb11640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 0x7fa9ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.878+0000 7faa0cb11640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 0x7fa9ec06d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faa0814ef40 tx=0x7fa9f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:56.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:56.882+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faa0408ae60 con 0x7faa0806e1c0 2024-09-13T17:15:57.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.062+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faa0815a290 con 0x7faa0806e1c0 2024-09-13T17:15:57.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.063+0000 7fa9fdffb640 1 -- 172.21.15.5:0/2360140438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v56) v1 ==== 80+0+57 (secure 0 0 0) 0x7faa040575d0 con 0x7faa0806e1c0 2024-09-13T17:15:57.065 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.1:0/3403128453 2024-09-13T18:15:40.602047+0000 2024-09-13T17:15:57.065 INFO:teuthology.orchestra.run.smithi005.stderr:listed 1 entries 2024-09-13T17:15:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 msgr2=0x7fa9ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 0x7fa9ec06d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faa0814ef40 tx=0x7fa9f8009040 comp rx=0 tx=0).stop 2024-09-13T17:15:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 msgr2=0x7faa08151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7faa04007fd0 tx=0x7faa0400c9b0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 shutdown_connections 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa08156f40 0x7faa08153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa080aced0 0x7faa08142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa9ec06ac00 0x7fa9ec06d0c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 --2- 172.21.15.5:0/2360140438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa0806e1c0 0x7faa08151ae0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 >> 172.21.15.5:0/2360140438 conn(0x7faa080ce0d0 msgr2=0x7faa080cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 shutdown_connections 2024-09-13T17:15:57.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.065+0000 7faa0f576640 1 -- 172.21.15.5:0/2360140438 wait complete. 2024-09-13T17:15:57.077 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:15:57.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:57.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:15:57.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[58720]: fuse finished with error 0 and tester_r 0 2024-09-13T17:15:57.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:15:57.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:57.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:15:57.160 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:15:57.160 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:57.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.299+0000 7f8052fe2640 1 Processor -- start 2024-09-13T17:15:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.299+0000 7f8052fe2640 1 -- start start 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f8052fe2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f804c160a50 0x7f804c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f8052fe2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c0b1ac0 con 0x7f804c0ae320 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f8052fe2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c160ea0 con 0x7f804c0adf40 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f8052fe2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c15d210 con 0x7f804c160a50 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f804bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f804c0ae320 0x7f804c0b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47504/0 (socket says 172.21.15.5:47504) 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f804bfff640 1 -- 172.21.15.5:0/3910523395 learned_addr learned my addr 172.21.15.5:0/3910523395 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f805157f640 1 --2- 172.21.15.5:0/3910523395 >> v2:172.21.15.179:3300/0 conn(0x7f804c160a50 0x7f804c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.300+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465819013 0 0) 0x7f804c0b1ac0 con 0x7f804c0ae320 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.301+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8038003520 con 0x7f804c0ae320 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.301+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1550870861 0 0) 0x7f8038003520 con 0x7f804c0ae320 2024-09-13T17:15:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.301+0000 7f805157f640 1 -- 172.21.15.5:0/3910523395 >> v1:172.21.15.179:6789/0 conn(0x7f804c0adf40 legacy=0x7f804c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.301+0000 7f805157f640 1 -- 172.21.15.5:0/3910523395 >> v1:172.21.15.5:6789/0 conn(0x7f804c0ae320 legacy=0x7f804c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.301+0000 7f805157f640 1 -- 172.21.15.5:0/3910523395 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c15d4f0 con 0x7f804c160a50 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f805157f640 1 --2- 172.21.15.5:0/3910523395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c06df70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80440097a0 tx=0x7f804402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13250dccfec6398c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340019f0 con 0x7f804c160a50 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804402ac50 con 0x7f804c160a50 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f804b7fe640 1 -- 172.21.15.5:0/3910523395 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044032440 con 0x7f804c160a50 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 -- 172.21.15.5:0/3910523395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 msgr2=0x7f804c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 --2- 172.21.15.5:0/3910523395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c06df70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80440097a0 tx=0x7f804402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 -- 172.21.15.5:0/3910523395 shutdown_connections 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 --2- 172.21.15.5:0/3910523395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c06df70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 -- 172.21.15.5:0/3910523395 >> 172.21.15.5:0/3910523395 conn(0x7f804c070af0 msgr2=0x7f804c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 -- 172.21.15.5:0/3910523395 shutdown_connections 2024-09-13T17:15:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.302+0000 7f8052fe2640 1 -- 172.21.15.5:0/3910523395 wait complete. 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.304+0000 7f8052fe2640 1 Processor -- start 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.304+0000 7f8052fe2640 1 -- start start 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.304+0000 7f8052fe2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.304+0000 7f8052fe2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f804c0ae320 0x7f804c1f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c15aa90 con 0x7f804c0adf40 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0c4a00 con 0x7f804c160a50 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c15a160 con 0x7f804c0ae320 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60700/0 (socket says 172.21.15.5:60700) 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 -- 172.21.15.5:0/1686521156 learned_addr learned my addr 172.21.15.5:0/1686521156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f805157f640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 -- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f804c0ae320 msgr2=0x7f804c1f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f804c0ae320 0x7f804c1f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 -- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 msgr2=0x7f804c0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 -- 172.21.15.5:0/1686521156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044009400 con 0x7f804c0adf40 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f805157f640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8050d7e640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c450 tx=0x7f803c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0052d0 con 0x7f804c0adf40 2024-09-13T17:15:57.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c005430 con 0x7f804c0adf40 2024-09-13T17:15:57.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c15a440 con 0x7f804c0adf40 2024-09-13T17:15:57.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c012870 con 0x7f804c0adf40 2024-09-13T17:15:57.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.305+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c14b700 con 0x7f804c0adf40 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.306+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c0672e0 con 0x7f804c0adf40 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.307+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f803c0129d0 con 0x7f804c0adf40 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.307+0000 7f80497fa640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 0x7f802c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.307+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f803c088fe0 con 0x7f804c0adf40 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.308+0000 7f804bfff640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 0x7f802c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.308+0000 7f804bfff640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 0x7f802c06d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8034002230 tx=0x7f8034002120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.311+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f803c0bc9c0 con 0x7f804c0adf40 2024-09-13T17:15:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.485+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f804c06df70 con 0x7f804c0adf40 2024-09-13T17:15:57.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.487+0000 7f80497fa640 1 -- 172.21.15.5:0/1686521156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f803c0540a0 con 0x7f804c0adf40 2024-09-13T17:15:57.489 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:57.489 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:57.393375+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.27","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.488+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 msgr2=0x7f802c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.488+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 0x7f802c06d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8034002230 tx=0x7f8034002120 comp rx=0 tx=0).stop 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.488+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 msgr2=0x7f804c14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.488+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c450 tx=0x7f803c00c910 comp rx=0 tx=0).stop 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 shutdown_connections 2024-09-13T17:15:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f804c160a50 0x7f804c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f804c0ae320 0x7f804c1f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f802c06ac00 0x7f802c06d0c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 --2- 172.21.15.5:0/1686521156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804c0adf40 0x7f804c14ae90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 >> 172.21.15.5:0/1686521156 conn(0x7f804c070af0 msgr2=0x7f804c0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 shutdown_connections 2024-09-13T17:15:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.489+0000 7f8052fe2640 1 -- 172.21.15.5:0/1686521156 wait complete. 2024-09-13T17:15:57.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:15:11.264640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:15:11.998886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:57.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:57.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.604+0000 7f75a068e640 1 Processor -- start 2024-09-13T17:15:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.604+0000 7f75a068e640 1 -- start start 2024-09-13T17:15:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f75a068e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75980cf000 0x7f75980cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f75a068e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75981645e0 0x7f75981669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f75a068e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980cf980 con 0x7f759815c6e0 2024-09-13T17:15:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f75a068e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980ce570 con 0x7f75980cf000 2024-09-13T17:15:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f75a068e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980d0630 con 0x7f75981645e0 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.605+0000 7f759e42a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f759815c6e0 0x7f75980cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47518/0 (socket says 172.21.15.5:47518) 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759e42a640 1 -- 172.21.15.5:0/2356218870 learned_addr learned my addr 172.21.15.5:0/2356218870 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759dc29640 1 --2- 172.21.15.5:0/2356218870 >> v2:172.21.15.5:3300/0 conn(0x7f75980cf000 0x7f75980cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759ec2b640 1 --2- 172.21.15.5:0/2356218870 >> v2:172.21.15.179:3300/0 conn(0x7f75981645e0 0x7f75981669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759d428640 1 -- 172.21.15.5:0/2356218870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362644287 0 0) 0x7f75980cf980 con 0x7f759815c6e0 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759d428640 1 -- 172.21.15.5:0/2356218870 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7580003520 con 0x7f759815c6e0 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759dc29640 1 -- 172.21.15.5:0/2356218870 >> v2:172.21.15.179:3300/0 conn(0x7f75981645e0 msgr2=0x7f75981669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759dc29640 1 --2- 172.21.15.5:0/2356218870 >> v2:172.21.15.179:3300/0 conn(0x7f75981645e0 0x7f75981669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759dc29640 1 -- 172.21.15.5:0/2356218870 >> v1:172.21.15.5:6789/0 conn(0x7f759815c6e0 legacy=0x7f75980cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.606+0000 7f759dc29640 1 -- 172.21.15.5:0/2356218870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980d0910 con 0x7f75980cf000 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f759dc29640 1 --2- 172.21.15.5:0/2356218870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980cf440 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f75980d0140 tx=0x7f758c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a087f01277274d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f759d428640 1 -- 172.21.15.5:0/2356218870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c032440 con 0x7f75980cf000 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f759d428640 1 -- 172.21.15.5:0/2356218870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0325a0 con 0x7f75980cf000 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f759d428640 1 -- 172.21.15.5:0/2356218870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c032930 con 0x7f75980cf000 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 -- 172.21.15.5:0/2356218870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 msgr2=0x7f75980cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 --2- 172.21.15.5:0/2356218870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980cf440 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f75980d0140 tx=0x7f758c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 -- 172.21.15.5:0/2356218870 shutdown_connections 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 --2- 172.21.15.5:0/2356218870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980cf440 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 --2- 172.21.15.5:0/2356218870 >> v2:172.21.15.179:3300/0 conn(0x7f75981645e0 0x7f75981669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.607+0000 7f75a068e640 1 -- 172.21.15.5:0/2356218870 >> 172.21.15.5:0/2356218870 conn(0x7f7598089f90 msgr2=0x7f75980d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.608+0000 7f75a068e640 1 -- 172.21.15.5:0/2356218870 shutdown_connections 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.608+0000 7f75a068e640 1 -- 172.21.15.5:0/2356218870 wait complete. 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 Processor -- start 2024-09-13T17:15:57.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 -- start start 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f759815c6e0 0x7f75980c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75981645e0 0x7f7598157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980c9760 con 0x7f75980cf000 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980b6a70 con 0x7f75981645e0 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.609+0000 7f75a068e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75980b6d50 con 0x7f759815c6e0 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60710/0 (socket says 172.21.15.5:60710) 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 -- 172.21.15.5:0/4105386713 learned_addr learned my addr 172.21.15.5:0/4105386713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 -- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f759815c6e0 msgr2=0x7f75980c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f759815c6e0 0x7f75980c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759ec2b640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75981645e0 0x7f7598157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 -- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75981645e0 msgr2=0x7f7598157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75981645e0 0x7f7598157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 -- 172.21.15.5:0/4105386713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009400 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f759e42a640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f758800cbc0 tx=0x7f758800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800ad40 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588012400 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800aea0 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75980b7030 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.610+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980b7310 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.611+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75980672e0 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.612+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7588007070 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.612+0000 7f7596ffd640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 0x7f758406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.612+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7588089480 con 0x7f75980cf000 2024-09-13T17:15:57.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.613+0000 7f759dc29640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 0x7f758406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.613+0000 7f759dc29640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 0x7f758406d0c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.616+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7588054560 con 0x7f75980cf000 2024-09-13T17:15:57.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.785+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f759815cac0 con 0x7f75980cf000 2024-09-13T17:15:57.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.786+0000 7f7596ffd640 1 -- 172.21.15.5:0/4105386713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7588057b80 con 0x7f75980cf000 2024-09-13T17:15:57.788 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 msgr2=0x7f758406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 0x7f758406d0c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02c000 comp rx=0 tx=0).stop 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 msgr2=0x7f75980b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f758800cbc0 tx=0x7f758800a430 comp rx=0 tx=0).stop 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 shutdown_connections 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75981645e0 0x7f7598157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f759815c6e0 0x7f75980c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f758406ac00 0x7f758406d0c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 --2- 172.21.15.5:0/4105386713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75980cf000 0x7f75980b6490 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.787+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 >> 172.21.15.5:0/4105386713 conn(0x7f7598089f90 msgr2=0x7f75980cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.788+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 shutdown_connections 2024-09-13T17:15:57.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.788+0000 7f75a068e640 1 -- 172.21.15.5:0/4105386713 wait complete. 2024-09-13T17:15:57.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:15:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.902+0000 7fe30bb45640 1 Processor -- start 2024-09-13T17:15:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.902+0000 7fe30bb45640 1 -- start start 2024-09-13T17:15:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe30bb45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe30415c6e0 0x7fe3040cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe30bb45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3040cf440 0x7fe3041609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe30bb45640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040d0630 con 0x7fe3040cf000 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe30bb45640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040d0910 con 0x7fe30415c6e0 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe30bb45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040d0bf0 con 0x7fe3040cf440 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe3098e1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe30415c6e0 0x7fe3040cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe3098e1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe30415c6e0 0x7fe3040cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60712/0 (socket says 172.21.15.5:60712) 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe3090e0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe3040cf000 0x7fe3041602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47522/0 (socket says 172.21.15.5:47522) 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.903+0000 7fe3098e1640 1 -- 172.21.15.5:0/2052998824 learned_addr learned my addr 172.21.15.5:0/2052998824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe30a0e2640 1 --2- 172.21.15.5:0/2052998824 >> v2:172.21.15.179:3300/0 conn(0x7fe3040cf440 0x7fe3041609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3098e1640 1 -- 172.21.15.5:0/2052998824 >> v2:172.21.15.179:3300/0 conn(0x7fe3040cf440 msgr2=0x7fe3041609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:57.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3098e1640 1 --2- 172.21.15.5:0/2052998824 >> v2:172.21.15.179:3300/0 conn(0x7fe3040cf440 0x7fe3041609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3098e1640 1 -- 172.21.15.5:0/2052998824 >> v1:172.21.15.5:6789/0 conn(0x7fe3040cf000 legacy=0x7fe3041602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3088df640 1 -- 172.21.15.5:0/2052998824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040832763 0 0) 0x7fe3040d0630 con 0x7fe3040cf000 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3098e1640 1 -- 172.21.15.5:0/2052998824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040d0ed0 con 0x7fe30415c6e0 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.904+0000 7fe3098e1640 1 --2- 172.21.15.5:0/2052998824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe30415c6e0 0x7fe3040cde60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe3040d0140 tx=0x7fe30002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2129e80a07dad635 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe3088df640 1 -- 172.21.15.5:0/2052998824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300031600 con 0x7fe30415c6e0 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe3088df640 1 -- 172.21.15.5:0/2052998824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30002d050 con 0x7fe30415c6e0 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe3088df640 1 -- 172.21.15.5:0/2052998824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300031980 con 0x7fe30415c6e0 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 -- 172.21.15.5:0/2052998824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe30415c6e0 msgr2=0x7fe3040cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 --2- 172.21.15.5:0/2052998824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe30415c6e0 0x7fe3040cde60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe3040d0140 tx=0x7fe30002a730 comp rx=0 tx=0).stop 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 -- 172.21.15.5:0/2052998824 shutdown_connections 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 --2- 172.21.15.5:0/2052998824 >> v2:172.21.15.179:3300/0 conn(0x7fe3040cf440 0x7fe3041609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 --2- 172.21.15.5:0/2052998824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe30415c6e0 0x7fe3040cde60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 -- 172.21.15.5:0/2052998824 >> 172.21.15.5:0/2052998824 conn(0x7fe304089f90 msgr2=0x7fe3040d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 -- 172.21.15.5:0/2052998824 shutdown_connections 2024-09-13T17:15:57.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.905+0000 7fe30bb45640 1 -- 172.21.15.5:0/2052998824 wait complete. 2024-09-13T17:15:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.906+0000 7fe30bb45640 1 Processor -- start 2024-09-13T17:15:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 -- start start 2024-09-13T17:15:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3040cf440 0x7fe3040b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe30415c6e0 0x7fe3040b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b3c90 con 0x7fe3040cf000 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040c6120 con 0x7fe3040cf440 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe30bb45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040c6400 con 0x7fe30415c6e0 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe3098e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe3098e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60724/0 (socket says 172.21.15.5:60724) 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe3098e1640 1 -- 172.21.15.5:0/3404420988 learned_addr learned my addr 172.21.15.5:0/3404420988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.907+0000 7fe3090e0640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3040cf440 0x7fe3040b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe30a0e2640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe30415c6e0 0x7fe3040b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 -- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe30415c6e0 msgr2=0x7fe3040b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe30415c6e0 0x7fe3040b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 -- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3040cf440 msgr2=0x7fe3040b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:57.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3040cf440 0x7fe3040b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 -- 172.21.15.5:0/3404420988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009b30 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe3098e1640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe300000f80 tx=0x7fe300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30003d860 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30003d9c0 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040c66e0 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30003dd70 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.908+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3040c6ca0 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.909+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3040672e0 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.910+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe30003b400 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.910+0000 7fe2fa7fc640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 0x7fe2e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.910+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fe3000aa2a0 con 0x7fe3040cf000 2024-09-13T17:15:57.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.910+0000 7fe3090e0640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 0x7fe2e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:57.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.911+0000 7fe3090e0640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 0x7fe2e806d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b3e90 tx=0x7fe2f4007b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:57.914+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe300075360 con 0x7fe3040cf000 2024-09-13T17:15:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.083+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3040c6ec0 con 0x7fe3040cf000 2024-09-13T17:15:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.083+0000 7fe2fa7fc640 1 -- 172.21.15.5:0/3404420988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe300009510 con 0x7fe3040cf000 2024-09-13T17:15:58.086 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:15:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 msgr2=0x7fe2e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 0x7fe2e806d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b3e90 tx=0x7fe2f4007b50 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 msgr2=0x7fe30415bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe300000f80 tx=0x7fe300004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 shutdown_connections 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe30415c6e0 0x7fe3040b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3040cf440 0x7fe3040b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe2e806ac00 0x7fe2e806d0c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 --2- 172.21.15.5:0/3404420988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3040cf000 0x7fe30415bd40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.085+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 >> 172.21.15.5:0/3404420988 conn(0x7fe304089f90 msgr2=0x7fe3040b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.086+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 shutdown_connections 2024-09-13T17:15:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.086+0000 7fe30bb45640 1 -- 172.21.15.5:0/3404420988 wait complete. 2024-09-13T17:15:58.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:15:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.201+0000 7fa67073a640 1 Processor -- start 2024-09-13T17:15:58.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.201+0000 7fa67073a640 1 -- start start 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa67073a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6680abe60 0x7fa6680b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa67073a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa66806da30 0x7fa66806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa67073a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6680ad050 con 0x7fa6681591e0 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa67073a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66806e400 con 0x7fa6680abe60 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa67073a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6680ac440 con 0x7fa66806da30 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa66dcd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6680abe60 0x7fa6680b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa66dcd5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6680abe60 0x7fa6680b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60734/0 (socket says 172.21.15.5:60734) 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.202+0000 7fa66dcd5640 1 -- 172.21.15.5:0/3340878715 learned_addr learned my addr 172.21.15.5:0/3340878715 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66ecd7640 1 --2- 172.21.15.5:0/3340878715 >> v2:172.21.15.179:3300/0 conn(0x7fa66806da30 0x7fa66806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66dcd5640 1 -- 172.21.15.5:0/3340878715 >> v2:172.21.15.179:3300/0 conn(0x7fa66806da30 msgr2=0x7fa66806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:58.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/3340878715 >> v2:172.21.15.179:3300/0 conn(0x7fa66806da30 0x7fa66806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66dcd5640 1 -- 172.21.15.5:0/3340878715 >> v1:172.21.15.179:6789/0 conn(0x7fa6681591e0 legacy=0x7fa6680ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:58.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66dcd5640 1 -- 172.21.15.5:0/3340878715 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6680ac720 con 0x7fa6680abe60 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/3340878715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6680abe60 0x7fa6680b1b30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa66806c850 tx=0x7fa65c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0277dd060d0be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.203+0000 7fa66d4d4640 1 -- 172.21.15.5:0/3340878715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c032440 con 0x7fa6680abe60 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa66d4d4640 1 -- 172.21.15.5:0/3340878715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c0325a0 con 0x7fa6680abe60 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa66d4d4640 1 -- 172.21.15.5:0/3340878715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c032930 con 0x7fa6680abe60 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 -- 172.21.15.5:0/3340878715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6680abe60 msgr2=0x7fa6680b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 --2- 172.21.15.5:0/3340878715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6680abe60 0x7fa6680b1b30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa66806c850 tx=0x7fa65c02a230 comp rx=0 tx=0).stop 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 -- 172.21.15.5:0/3340878715 shutdown_connections 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 --2- 172.21.15.5:0/3340878715 >> v2:172.21.15.179:3300/0 conn(0x7fa66806da30 0x7fa66806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 --2- 172.21.15.5:0/3340878715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6680abe60 0x7fa6680b1b30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 -- 172.21.15.5:0/3340878715 >> 172.21.15.5:0/3340878715 conn(0x7fa6680ce130 msgr2=0x7fa6680ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 -- 172.21.15.5:0/3340878715 shutdown_connections 2024-09-13T17:15:58.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.204+0000 7fa67073a640 1 -- 172.21.15.5:0/3340878715 wait complete. 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.205+0000 7fa67073a640 1 Processor -- start 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.205+0000 7fa67073a640 1 -- start start 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 0x7fa66815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 0x7fa66814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa668165b80 con 0x7fa66806da30 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa668164f90 con 0x7fa6680abe60 2024-09-13T17:15:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa67073a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6681651e0 con 0x7fa6681591e0 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60742/0 (socket says 172.21.15.5:60742) 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 -- 172.21.15.5:0/1230221086 learned_addr learned my addr 172.21.15.5:0/1230221086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66ecd7640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 0x7fa66814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 0x7fa66815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 -- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 msgr2=0x7fa66814ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 0x7fa66814ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 -- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 msgr2=0x7fa66815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 0x7fa66815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66e4d6640 1 -- 172.21.15.5:0/1230221086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0094d0 con 0x7fa66806da30 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66ecd7640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 0x7fa66814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.206+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 0x7fa66815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa66e4d6640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa65800ba50 tx=0x7fa65800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65800cbe0 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65800cd80 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658014680 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6681654c0 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.207+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6680af400 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.208+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6680672a0 con 0x7fa66806da30 2024-09-13T17:15:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.208+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa6580147e0 con 0x7fa66806da30 2024-09-13T17:15:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.209+0000 7fa666ffd640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 0x7fa65406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.209+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fa6580891b0 con 0x7fa66806da30 2024-09-13T17:15:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.209+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 0x7fa65406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.209+0000 7fa66dcd5640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 0x7fa65406d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa65c034000 tx=0x7fa65c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.213+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa658054300 con 0x7fa66806da30 2024-09-13T17:15:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.381+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6680af400 con 0x7fa66806da30 2024-09-13T17:15:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.382+0000 7fa666ffd640 1 -- 172.21.15.5:0/1230221086 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6680af400 con 0x7fa66806da30 2024-09-13T17:15:58.384 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:15:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 msgr2=0x7fa65406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 0x7fa65406d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa65c034000 tx=0x7fa65c02e000 comp rx=0 tx=0).stop 2024-09-13T17:15:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 msgr2=0x7fa6680aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa65800ba50 tx=0x7fa65800bf10 comp rx=0 tx=0).stop 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 shutdown_connections 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6681591e0 0x7fa66814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6680abe60 0x7fa66815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa65406ac00 0x7fa65406d0c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 --2- 172.21.15.5:0/1230221086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66806da30 0x7fa6680aece0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 >> 172.21.15.5:0/1230221086 conn(0x7fa6680ce130 msgr2=0x7fa668071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 shutdown_connections 2024-09-13T17:15:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.384+0000 7fa67073a640 1 -- 172.21.15.5:0/1230221086 wait complete. 2024-09-13T17:15:58.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.497+0000 7f68440e9640 1 Processor -- start 2024-09-13T17:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.497+0000 7f68440e9640 1 -- start start 2024-09-13T17:15:58.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.498+0000 7f68440e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f683c156f40 0x7f683c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.498+0000 7f68440e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.498+0000 7f68440e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683c0b2390 con 0x7f683c06dff0 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.498+0000 7f68440e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c06e4a0 con 0x7f683c156f40 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.498+0000 7f68440e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0b14c0 con 0x7f683c0b1080 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841684640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841e85640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f683c156f40 0x7f683c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841684640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:49664/0 (socket says 172.21.15.5:49664) 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6842686640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f683c06dff0 0x7f683c0abec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:39990/0 (socket says 172.21.15.5:39990) 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841684640 1 -- 172.21.15.5:0/1280992276 learned_addr learned my addr 172.21.15.5:0/1280992276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841e85640 1 -- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 msgr2=0x7f683c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841e85640 1 --2- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c06dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841e85640 1 -- 172.21.15.5:0/1280992276 >> v1:172.21.15.179:6789/0 conn(0x7f683c06dff0 legacy=0x7f683c0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.499+0000 7f6841e85640 1 -- 172.21.15.5:0/1280992276 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c0b1780 con 0x7f683c156f40 2024-09-13T17:15:58.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.500+0000 7f6841e85640 1 --2- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c15a290 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68380097a0 tx=0x7f683802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72154dade1215e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.500+0000 7f6840e83640 1 -- 172.21.15.5:0/1280992276 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838032440 con 0x7f683c156f40 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.500+0000 7f6840e83640 1 -- 172.21.15.5:0/1280992276 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68380325a0 con 0x7f683c156f40 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.500+0000 7f6840e83640 1 -- 172.21.15.5:0/1280992276 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838032930 con 0x7f683c156f40 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 -- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 msgr2=0x7f683c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 --2- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c15a290 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f68380097a0 tx=0x7f683802a180 comp rx=0 tx=0).stop 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 -- 172.21.15.5:0/1280992276 shutdown_connections 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 --2- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c06dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 --2- 172.21.15.5:0/1280992276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c15a290 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 -- 172.21.15.5:0/1280992276 >> 172.21.15.5:0/1280992276 conn(0x7f683c0ce0d0 msgr2=0x7f683c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 -- 172.21.15.5:0/1280992276 shutdown_connections 2024-09-13T17:15:58.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.501+0000 7f68440e9640 1 -- 172.21.15.5:0/1280992276 wait complete. 2024-09-13T17:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.502+0000 7f68440e9640 1 Processor -- start 2024-09-13T17:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.502+0000 7f68440e9640 1 -- start start 2024-09-13T17:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c150c70 con 0x7f683c06dff0 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0cb550 con 0x7f683c156f40 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f68440e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0cb7a0 con 0x7f683c0b1080 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60758/0 (socket says 172.21.15.5:60758) 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 -- 172.21.15.5:0/2042464119 learned_addr learned my addr 172.21.15.5:0/2042464119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841684640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6842686640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 -- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 msgr2=0x7f683c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 -- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 msgr2=0x7f683c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 -- 172.21.15.5:0/2042464119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009400 con 0x7f683c06dff0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.503+0000 7f6841e85640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6838000c00 tx=0x7f68380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.504+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838030b80 con 0x7f683c06dff0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.504+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838032e90 con 0x7f683c06dff0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.504+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c0cba80 con 0x7f683c06dff0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.504+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838006e10 con 0x7f683c06dff0 2024-09-13T17:15:58.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.504+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c0cc040 con 0x7f683c06dff0 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.505+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c0672a0 con 0x7f683c06dff0 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.505+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6838039040 con 0x7f683c06dff0 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.505+0000 7f68327fc640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 0x7f682006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.506+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f68380a9bb0 con 0x7f683c06dff0 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.506+0000 7f6841684640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 0x7f682006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:58.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.506+0000 7f6841684640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 0x7f682006d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f683c1f2330 tx=0x7f682c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:58.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.510+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6838074d20 con 0x7f683c06dff0 2024-09-13T17:15:58.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.691+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f683c06dab0 con 0x7f683c06dff0 2024-09-13T17:15:58.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.691+0000 7f68327fc640 1 -- 172.21.15.5:0/2042464119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v57) v1 ==== 80+0+57 (secure 0 0 0) 0x7f6838037020 con 0x7f683c06dff0 2024-09-13T17:15:58.693 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.1:0/3403128453 2024-09-13T18:15:40.602047+0000 2024-09-13T17:15:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:listed 1 entries 2024-09-13T17:15:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 msgr2=0x7f682006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 0x7f682006d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f683c1f2330 tx=0x7f682c009240 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 msgr2=0x7f683c153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6838000c00 tx=0x7f68380046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 shutdown_connections 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683c156f40 0x7f683c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f683c0b1080 0x7f683c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f682006ac00 0x7f682006d0c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 --2- 172.21.15.5:0/2042464119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c06dff0 0x7f683c153c80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 >> 172.21.15.5:0/2042464119 conn(0x7f683c0ce0d0 msgr2=0x7f683c158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 shutdown_connections 2024-09-13T17:15:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:58.693+0000 7f68440e9640 1 -- 172.21.15.5:0/2042464119 wait complete. 2024-09-13T17:15:58.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:15:58.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:58.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:15:58.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[44480]: fuse finished with error 0 and tester_r 0 2024-09-13T17:15:58.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:15:58.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:58.737 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:15:58.853 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:15:58.854 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:58.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:15:58.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:15:58.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:58.871 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:15:58.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:15:58.928 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:15:58.928 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:15:58.928 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:15:58.946 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:15:58.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:15:58.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:15:58.947 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:15:59.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:15:59.004 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:15:59.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.103+0000 7f033f6a3640 1 Processor -- start 2024-09-13T17:15:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.103+0000 7f033f6a3640 1 -- start start 2024-09-13T17:15:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033f6a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0338156f40 0x7f033815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033f6a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03380b1080 0x7f033806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033f6a3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380b2390 con 0x7f033806dff0 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033f6a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033806e440 con 0x7f03380b1080 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033f6a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03380b14c0 con 0x7f0338156f40 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03380b1080 0x7f033806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03380b1080 0x7f033806dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60760/0 (socket says 172.21.15.5:60760) 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 -- 172.21.15.5:0/3987510036 learned_addr learned my addr 172.21.15.5:0/3987510036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033d43f640 1 --2- 172.21.15.5:0/3987510036 >> v2:172.21.15.179:3300/0 conn(0x7f0338156f40 0x7f033815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 -- 172.21.15.5:0/3987510036 >> v2:172.21.15.179:3300/0 conn(0x7f0338156f40 msgr2=0x7f033815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 --2- 172.21.15.5:0/3987510036 >> v2:172.21.15.179:3300/0 conn(0x7f0338156f40 0x7f033815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.104+0000 7f033cc3e640 1 -- 172.21.15.5:0/3987510036 >> v1:172.21.15.179:6789/0 conn(0x7f033806dff0 legacy=0x7f03380abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.105+0000 7f033cc3e640 1 -- 172.21.15.5:0/3987510036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380b1780 con 0x7f03380b1080 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.105+0000 7f033cc3e640 1 --2- 172.21.15.5:0/3987510036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f033806dab0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f033806aea0 tx=0x7f032802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b42e6a23d5c4080 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.105+0000 7f032ffff640 1 -- 172.21.15.5:0/3987510036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328032440 con 0x7f03380b1080 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.105+0000 7f032ffff640 1 -- 172.21.15.5:0/3987510036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03280325a0 con 0x7f03380b1080 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.105+0000 7f032ffff640 1 -- 172.21.15.5:0/3987510036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328032930 con 0x7f03380b1080 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 -- 172.21.15.5:0/3987510036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 msgr2=0x7f033806dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 --2- 172.21.15.5:0/3987510036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f033806dab0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f033806aea0 tx=0x7f032802a270 comp rx=0 tx=0).stop 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 -- 172.21.15.5:0/3987510036 shutdown_connections 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 --2- 172.21.15.5:0/3987510036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f033806dab0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 --2- 172.21.15.5:0/3987510036 >> v2:172.21.15.179:3300/0 conn(0x7f0338156f40 0x7f033815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 -- 172.21.15.5:0/3987510036 >> 172.21.15.5:0/3987510036 conn(0x7f03380ce0d0 msgr2=0x7f03380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 -- 172.21.15.5:0/3987510036 shutdown_connections 2024-09-13T17:15:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.106+0000 7f033f6a3640 1 -- 172.21.15.5:0/3987510036 wait complete. 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.107+0000 7f033f6a3640 1 Processor -- start 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.107+0000 7f033f6a3640 1 -- start start 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033806dff0 0x7f033809a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0338156f40 0x7f03381f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cd190 con 0x7f03380b1080 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cceb0 con 0x7f033806dff0 2024-09-13T17:15:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033f6a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033813d040 con 0x7f0338156f40 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60764/0 (socket says 172.21.15.5:60764) 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 -- 172.21.15.5:0/469163519 learned_addr learned my addr 172.21.15.5:0/469163519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033dc40640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0338156f40 0x7f03381f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033d43f640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033806dff0 0x7f033809a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 -- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0338156f40 msgr2=0x7f03381f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0338156f40 0x7f03381f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 -- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033806dff0 msgr2=0x7f033809a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033806dff0 0x7f033809a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.108+0000 7f033cc3e640 1 -- 172.21.15.5:0/469163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03280094d0 con 0x7f03380b1080 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f033cc3e640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f032802a2b0 tx=0x7f03280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328032440 con 0x7f03380b1080 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328030ba0 con 0x7f03380b1080 2024-09-13T17:15:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033813d320 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032803d440 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.109+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03381512d0 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.110+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033813cea0 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.110+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0328039040 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.111+0000 7f032dffb640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 0x7f031c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.111+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f03280aa070 con 0x7f03380b1080 2024-09-13T17:15:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.111+0000 7f033d43f640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 0x7f031c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.111+0000 7f033d43f640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 0x7f031c06d0c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.115+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f033813cea0 con 0x7f03380b1080 2024-09-13T17:15:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.320+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f033813d840 con 0x7f03380b1080 2024-09-13T17:15:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.321+0000 7f032dffb640 1 -- 172.21.15.5:0/469163519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f033813d840 con 0x7f03380b1080 2024-09-13T17:15:59.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:59.324 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:39.352320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:15:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-13T17:15:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 msgr2=0x7f031c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 0x7f031c06d0c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-09-13T17:15:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 msgr2=0x7f03381f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f032802a2b0 tx=0x7f03280046c0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 shutdown_connections 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0338156f40 0x7f03381f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f031c06ac00 0x7f031c06d0c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03380b1080 0x7f03381f3e40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 --2- 172.21.15.5:0/469163519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033806dff0 0x7f033809a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 >> 172.21.15.5:0/469163519 conn(0x7f03380ce0d0 msgr2=0x7f0338158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 shutdown_connections 2024-09-13T17:15:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.323+0000 7f033f6a3640 1 -- 172.21.15.5:0/469163519 wait complete. 2024-09-13T17:15:59.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:15:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.437+0000 7f0a949c3640 1 Processor -- start 2024-09-13T17:15:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.437+0000 7f0a949c3640 1 -- start start 2024-09-13T17:15:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a949c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a949c3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a9006c320 0x7f0a900ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a949c3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9006d410 con 0x7f0a900ab5a0 2024-09-13T17:15:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a949c3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a900aba50 con 0x7f0a9006c320 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a949c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9006cb70 con 0x7f0a9015a3e0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a8ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a900ab5a0 0x7f0a9015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47538/0 (socket says 172.21.15.5:47538) 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.438+0000 7f0a8ed9d640 1 -- 172.21.15.5:0/2937690388 learned_addr learned my addr 172.21.15.5:0/2937690388 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360170530 0 0) 0x7f0a9006d410 con 0x7f0a900ab5a0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a78003520 con 0x7f0a900ab5a0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8dd9b640 1 --2- 172.21.15.5:0/2937690388 >> v2:172.21.15.179:3300/0 conn(0x7f0a9006c320 0x7f0a900ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207926092 0 0) 0x7f0a78003520 con 0x7f0a900ab5a0 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 msgr2=0x7f0a9006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a9006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 >> v2:172.21.15.179:3300/0 conn(0x7f0a9006c320 msgr2=0x7f0a900ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 --2- 172.21.15.5:0/2937690388 >> v2:172.21.15.179:3300/0 conn(0x7f0a9006c320 0x7f0a900ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9006ce50 con 0x7f0a900ab5a0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0a880019f0 con 0x7f0a900ab5a0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 >> v1:172.21.15.5:6789/0 conn(0x7f0a900ab5a0 legacy=0x7f0a9015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a78004d00 0x7f0a78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900aba50 con 0x7f0a78003970 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9006cb70 con 0x7f0a78004d00 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7800b980 con 0x7f0a9015a3e0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8dd9b640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8ed9d640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a78004d00 0x7f0a78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 msgr2=0x7f0a780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9015a3e0 0x7f0a780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a78004d00 msgr2=0x7f0a78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a78004d00 0x7f0a78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2937690388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78003520 con 0x7f0a78003970 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.439+0000 7f0a8ed9d640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a78004d00 0x7f0a78005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.440+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009ac0 tx=0x7f0a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f2c1b9ef519cca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.440+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80031400 con 0x7f0a78003970 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.440+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8002d050 con 0x7f0a78003970 2024-09-13T17:15:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.440+0000 7f0a8d59a640 1 -- 172.21.15.5:0/2937690388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80031780 con 0x7f0a78003970 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 -- 172.21.15.5:0/2937690388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 msgr2=0x7f0a78003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2937690388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a78003d90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009ac0 tx=0x7f0a780057f0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a8ed9d640 1 -- 172.21.15.5:0/2937690388 reap_dead start 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 -- 172.21.15.5:0/2937690388 shutdown_connections 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 -- 172.21.15.5:0/2937690388 >> 172.21.15.5:0/2937690388 conn(0x7f0a900ce0d0 msgr2=0x7f0a900ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 -- 172.21.15.5:0/2937690388 shutdown_connections 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.441+0000 7f0a949c3640 1 -- 172.21.15.5:0/2937690388 wait complete. 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.442+0000 7f0a949c3640 1 Processor -- start 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 -- start start 2024-09-13T17:15:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a90071760 0x7f0a9014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9014b210 0x7f0a9014c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90071340 con 0x7f0a78003970 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900706c0 con 0x7f0a90071760 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a949c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900709a0 con 0x7f0a9014b210 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60782/0 (socket says 172.21.15.5:60782) 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.443+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2338930956 learned_addr learned my addr 172.21.15.5:0/2338930956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8dd9b640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a90071760 0x7f0a9014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8ed9d640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9014b210 0x7f0a9014c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9014b210 msgr2=0x7f0a9014c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9014b210 0x7f0a9014c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a90071760 msgr2=0x7f0a9014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a90071760 0x7f0a9014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 -- 172.21.15.5:0/2338930956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a90070c80 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a8e59c640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0a80034040 tx=0x7f0a80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80003bd0 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80003d50 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90070f60 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80044650 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.444+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9014b690 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.445+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a900715b0 con 0x7f0a78003970 2024-09-13T17:15:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.446+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0a80038070 con 0x7f0a78003970 2024-09-13T17:15:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.446+0000 7f0a7effd640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 0x7f0a7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.446+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f0a800a95e0 con 0x7f0a78003970 2024-09-13T17:15:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.446+0000 7f0a8dd9b640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 0x7f0a7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.447+0000 7f0a8dd9b640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 0x7f0a7006d0c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a90071c80 tx=0x7f0a84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.450+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0a800746c0 con 0x7f0a78003970 2024-09-13T17:15:59.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.621+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a9014b8e0 con 0x7f0a78003970 2024-09-13T17:15:59.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.623+0000 7f0a7effd640 1 -- 172.21.15.5:0/2338930956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f0a80077ce0 con 0x7f0a78003970 2024-09-13T17:15:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:15:59.625 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:57.393375+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.27","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.624+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 msgr2=0x7f0a7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.624+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 0x7f0a7006d0c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0a90071c80 tx=0x7f0a84008040 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.624+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 msgr2=0x7f0a900700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.624+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0a80034040 tx=0x7f0a80004730 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 shutdown_connections 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9014b210 0x7f0a9014c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a90071760 0x7f0a9014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a7006ac00 0x7f0a7006d0c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 --2- 172.21.15.5:0/2338930956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a78003970 0x7f0a900700e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 >> 172.21.15.5:0/2338930956 conn(0x7f0a900ce0d0 msgr2=0x7f0a900b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 shutdown_connections 2024-09-13T17:15:59.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.625+0000 7f0a949c3640 1 -- 172.21.15.5:0/2338930956 wait complete. 2024-09-13T17:15:59.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:15:11.264640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:15:11.998886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:15:59.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:15:59.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.740+0000 7f6ea8508640 1 Processor -- start 2024-09-13T17:15:59.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.740+0000 7f6ea8508640 1 -- start start 2024-09-13T17:15:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea8508640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 0x7f6ea00cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea8508640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ea01645e0 0x7f6ea01669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea8508640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00cf980 con 0x7f6ea015c6e0 2024-09-13T17:15:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea8508640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00ce570 con 0x7f6ea01645e0 2024-09-13T17:15:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea8508640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00d0630 con 0x7f6ea00cf000 2024-09-13T17:15:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea62a4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ea015c6e0 0x7f6ea00cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47548/0 (socket says 172.21.15.5:47548) 2024-09-13T17:15:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.741+0000 7f6ea62a4640 1 -- 172.21.15.5:0/2817597812 learned_addr learned my addr 172.21.15.5:0/2817597812 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:15:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea5aa3640 1 --2- 172.21.15.5:0/2817597812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 0x7f6ea00cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea6aa5640 1 --2- 172.21.15.5:0/2817597812 >> v2:172.21.15.179:3300/0 conn(0x7f6ea01645e0 0x7f6ea01669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea52a2640 1 -- 172.21.15.5:0/2817597812 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110039414 0 0) 0x7f6ea00cf980 con 0x7f6ea015c6e0 2024-09-13T17:15:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea52a2640 1 -- 172.21.15.5:0/2817597812 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e88003520 con 0x7f6ea015c6e0 2024-09-13T17:15:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea5aa3640 1 -- 172.21.15.5:0/2817597812 >> v2:172.21.15.179:3300/0 conn(0x7f6ea01645e0 msgr2=0x7f6ea01669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea5aa3640 1 --2- 172.21.15.5:0/2817597812 >> v2:172.21.15.179:3300/0 conn(0x7f6ea01645e0 0x7f6ea01669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea5aa3640 1 -- 172.21.15.5:0/2817597812 >> v1:172.21.15.5:6789/0 conn(0x7f6ea015c6e0 legacy=0x7f6ea00cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.742+0000 7f6ea5aa3640 1 -- 172.21.15.5:0/2817597812 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00d0910 con 0x7f6ea00cf000 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea5aa3640 1 --2- 172.21.15.5:0/2817597812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 0x7f6ea00cf440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e940097a0 tx=0x7f6e9402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c9daf4c36668d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea52a2640 1 -- 172.21.15.5:0/2817597812 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94032440 con 0x7f6ea00cf000 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea52a2640 1 -- 172.21.15.5:0/2817597812 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940325a0 con 0x7f6ea00cf000 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea52a2640 1 -- 172.21.15.5:0/2817597812 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94032910 con 0x7f6ea00cf000 2024-09-13T17:15:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea8508640 1 -- 172.21.15.5:0/2817597812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 msgr2=0x7f6ea00cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.743+0000 7f6ea8508640 1 --2- 172.21.15.5:0/2817597812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 0x7f6ea00cf440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e940097a0 tx=0x7f6e9402a180 comp rx=0 tx=0).stop 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 -- 172.21.15.5:0/2817597812 shutdown_connections 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 --2- 172.21.15.5:0/2817597812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00cf000 0x7f6ea00cf440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 --2- 172.21.15.5:0/2817597812 >> v2:172.21.15.179:3300/0 conn(0x7f6ea01645e0 0x7f6ea01669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 -- 172.21.15.5:0/2817597812 >> 172.21.15.5:0/2817597812 conn(0x7f6ea0089f90 msgr2=0x7f6ea00d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 -- 172.21.15.5:0/2817597812 shutdown_connections 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.744+0000 7f6ea8508640 1 -- 172.21.15.5:0/2817597812 wait complete. 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.745+0000 7f6ea8508640 1 Processor -- start 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.745+0000 7f6ea8508640 1 -- start start 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea00cf000 0x7f6ea0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea015c6e0 0x7f6ea01563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01613b0 con 0x7f6ea01645e0 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0156190 con 0x7f6ea00cf000 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b8130 con 0x7f6ea015c6e0 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60796/0 (socket says 172.21.15.5:60796) 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 -- 172.21.15.5:0/516732058 learned_addr learned my addr 172.21.15.5:0/516732058 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:15:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 -- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea015c6e0 msgr2=0x7f6ea01563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea015c6e0 0x7f6ea01563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 -- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea00cf000 msgr2=0x7f6ea0155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea00cf000 0x7f6ea0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 -- 172.21.15.5:0/516732058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94009400 con 0x7f6ea01645e0 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea6aa5640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000efc0 tx=0x7f6e9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90009e60 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000f040 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea00b3330 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900146a0 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.746+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea00b38f0 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.747+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea00672e0 con 0x7f6ea01645e0 2024-09-13T17:15:59.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.748+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e90014800 con 0x7f6ea01645e0 2024-09-13T17:15:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.748+0000 7f6e9effd640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.748+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f6e9008a2f0 con 0x7f6ea01645e0 2024-09-13T17:15:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.748+0000 7f6ea62a4640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.749+0000 7f6ea62a4640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6e98000f60 tx=0x7f6e980078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:59.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.752+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6e900553b0 con 0x7f6ea01645e0 2024-09-13T17:15:59.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.925+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ea00b3ae0 con 0x7f6ea01645e0 2024-09-13T17:15:59.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.925+0000 7f6e9effd640 1 -- 172.21.15.5:0/516732058 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e900589d0 con 0x7f6ea01645e0 2024-09-13T17:15:59.928 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 msgr2=0x7f6e8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6e98000f60 tx=0x7f6e980078f0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 msgr2=0x7f6ea0156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000efc0 tx=0x7f6e9000c490 comp rx=0 tx=0).stop 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 shutdown_connections 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ea01645e0 0x7f6ea0156920 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea015c6e0 0x7f6ea01563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 --2- 172.21.15.5:0/516732058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea00cf000 0x7f6ea0155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 >> 172.21.15.5:0/516732058 conn(0x7f6ea0089f90 msgr2=0x7f6ea00b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 shutdown_connections 2024-09-13T17:15:59.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:15:59.928+0000 7f6ea8508640 1 -- 172.21.15.5:0/516732058 wait complete. 2024-09-13T17:15:59.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.043+0000 7f305ed1f640 1 Processor -- start 2024-09-13T17:16:00.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.043+0000 7f305ed1f640 1 -- start start 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305ed1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30580abe60 0x7f30580b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305ed1f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 0x7f305806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305ed1f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580ad050 con 0x7f30581591e0 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305ed1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305806e400 con 0x7f30580abe60 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305ed1f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580ac440 con 0x7f305806da30 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30580abe60 0x7f30580b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30580abe60 0x7f30580b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60808/0 (socket says 172.21.15.5:60808) 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 -- 172.21.15.5:0/3831792396 learned_addr learned my addr 172.21.15.5:0/3831792396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305d2bc640 1 --2- 172.21.15.5:0/3831792396 >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 0x7f305806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 -- 172.21.15.5:0/3831792396 >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 msgr2=0x7f305806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 --2- 172.21.15.5:0/3831792396 >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 0x7f305806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 -- 172.21.15.5:0/3831792396 >> v1:172.21.15.179:6789/0 conn(0x7f30581591e0 legacy=0x7f30580ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f3057fff640 1 -- 172.21.15.5:0/3831792396 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580ac720 con 0x7f30580abe60 2024-09-13T17:16:00.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.044+0000 7f305d2bc640 1 --2- 172.21.15.5:0/3831792396 >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 0x7f305806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.045+0000 7f3057fff640 1 --2- 172.21.15.5:0/3831792396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580abe60 0x7f30580b1b30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f305806c850 tx=0x7f304002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27c148af664cba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.045+0000 7f30577fe640 1 -- 172.21.15.5:0/3831792396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040032440 con 0x7f30580abe60 2024-09-13T17:16:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.045+0000 7f30577fe640 1 -- 172.21.15.5:0/3831792396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30400325a0 con 0x7f30580abe60 2024-09-13T17:16:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.045+0000 7f30577fe640 1 -- 172.21.15.5:0/3831792396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040032930 con 0x7f30580abe60 2024-09-13T17:16:00.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 -- 172.21.15.5:0/3831792396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580abe60 msgr2=0x7f30580b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 --2- 172.21.15.5:0/3831792396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580abe60 0x7f30580b1b30 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f305806c850 tx=0x7f304002a230 comp rx=0 tx=0).stop 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 -- 172.21.15.5:0/3831792396 shutdown_connections 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 --2- 172.21.15.5:0/3831792396 >> v2:172.21.15.179:3300/0 conn(0x7f305806da30 0x7f305806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 --2- 172.21.15.5:0/3831792396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580abe60 0x7f30580b1b30 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 -- 172.21.15.5:0/3831792396 >> 172.21.15.5:0/3831792396 conn(0x7f30580ce130 msgr2=0x7f30580ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 -- 172.21.15.5:0/3831792396 shutdown_connections 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.046+0000 7f305ed1f640 1 -- 172.21.15.5:0/3831792396 wait complete. 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.047+0000 7f305ed1f640 1 Processor -- start 2024-09-13T17:16:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.047+0000 7f305ed1f640 1 -- start start 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806da30 0x7f305814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30580abe60 0x7f305814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058156aa0 con 0x7f30581591e0 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305815dd70 con 0x7f305806da30 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305ed1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305814e850 con 0x7f30580abe60 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305d2bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305d2bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60824/0 (socket says 172.21.15.5:60824) 2024-09-13T17:16:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305d2bc640 1 -- 172.21.15.5:0/48979357 learned_addr learned my addr 172.21.15.5:0/48979357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f3057fff640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30580abe60 0x7f305814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.048+0000 7f305cabb640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806da30 0x7f305814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 -- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30580abe60 msgr2=0x7f305814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30580abe60 0x7f305814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 -- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806da30 msgr2=0x7f305814d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806da30 0x7f305814d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 -- 172.21.15.5:0/48979357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094d0 con 0x7f30581591e0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305d2bc640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f305000c7f0 tx=0x7f305000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050007820 con 0x7f30581591e0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050007980 con 0x7f30581591e0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3058156d60 con 0x7f30581591e0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050007d70 con 0x7f30581591e0 2024-09-13T17:16:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.049+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305814dfb0 con 0x7f30581591e0 2024-09-13T17:16:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.050+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3058156ef0 con 0x7f30581591e0 2024-09-13T17:16:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.051+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f30500113f0 con 0x7f30581591e0 2024-09-13T17:16:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.051+0000 7f30557fa640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 0x7f303806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.051+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3050089780 con 0x7f30581591e0 2024-09-13T17:16:00.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.051+0000 7f305cabb640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 0x7f303806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.052+0000 7f305cabb640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 0x7f303806d0f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f304800b450 tx=0x7f304800d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.055+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3050054860 con 0x7f30581591e0 2024-09-13T17:16:00.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.226+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30580672a0 con 0x7f30581591e0 2024-09-13T17:16:00.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.226+0000 7f30557fa640 1 -- 172.21.15.5:0/48979357 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3050057e80 con 0x7f30581591e0 2024-09-13T17:16:00.228 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:00.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 msgr2=0x7f303806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 0x7f303806d0f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f304800b450 tx=0x7f304800d040 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 msgr2=0x7f3058151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f305000c7f0 tx=0x7f305000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 shutdown_connections 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303806ac30 0x7f303806d0f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30581591e0 0x7f3058151df0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30580abe60 0x7f305814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 --2- 172.21.15.5:0/48979357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806da30 0x7f305814d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 >> 172.21.15.5:0/48979357 conn(0x7f30580ce130 msgr2=0x7f30580ad4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 shutdown_connections 2024-09-13T17:16:00.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.228+0000 7f305ed1f640 1 -- 172.21.15.5:0/48979357 wait complete. 2024-09-13T17:16:00.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.343+0000 7ffab9de2640 1 Processor -- start 2024-09-13T17:16:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.343+0000 7ffab9de2640 1 -- start start 2024-09-13T17:16:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab9de2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffab4152fa0 0x7ffab4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab9de2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffab41598a0 0x7ffab40b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab9de2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab4153380 con 0x7ffab40b20e0 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab9de2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b24f0 con 0x7ffab4152fa0 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab9de2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab4070f10 con 0x7ffab41598a0 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffab4152fa0 0x7ffab4071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffab4152fa0 0x7ffab4071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60830/0 (socket says 172.21.15.5:60830) 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 -- 172.21.15.5:0/3842249712 learned_addr learned my addr 172.21.15.5:0/3842249712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab2ffd640 1 --2- 172.21.15.5:0/3842249712 >> v2:172.21.15.179:3300/0 conn(0x7ffab41598a0 0x7ffab40b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 -- 172.21.15.5:0/3842249712 >> v2:172.21.15.179:3300/0 conn(0x7ffab41598a0 msgr2=0x7ffab40b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 --2- 172.21.15.5:0/3842249712 >> v2:172.21.15.179:3300/0 conn(0x7ffab41598a0 0x7ffab40b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 -- 172.21.15.5:0/3842249712 >> v1:172.21.15.179:6789/0 conn(0x7ffab40b20e0 legacy=0x7ffab406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.344+0000 7ffab37fe640 1 -- 172.21.15.5:0/3842249712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40711f0 con 0x7ffab4152fa0 2024-09-13T17:16:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.345+0000 7ffab37fe640 1 --2- 172.21.15.5:0/3842249712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab4152fa0 0x7ffab4071fb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffab406e5a0 tx=0x7ffaa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16354ed3b2c1695 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.345+0000 7ffab27fc640 1 -- 172.21.15.5:0/3842249712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4032440 con 0x7ffab4152fa0 2024-09-13T17:16:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.345+0000 7ffab27fc640 1 -- 172.21.15.5:0/3842249712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa40325a0 con 0x7ffab4152fa0 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.345+0000 7ffab27fc640 1 -- 172.21.15.5:0/3842249712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4032930 con 0x7ffab4152fa0 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 -- 172.21.15.5:0/3842249712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab4152fa0 msgr2=0x7ffab4071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 --2- 172.21.15.5:0/3842249712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab4152fa0 0x7ffab4071fb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffab406e5a0 tx=0x7ffaa402a270 comp rx=0 tx=0).stop 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 -- 172.21.15.5:0/3842249712 shutdown_connections 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 --2- 172.21.15.5:0/3842249712 >> v2:172.21.15.179:3300/0 conn(0x7ffab41598a0 0x7ffab40b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 --2- 172.21.15.5:0/3842249712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab4152fa0 0x7ffab4071fb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 -- 172.21.15.5:0/3842249712 >> 172.21.15.5:0/3842249712 conn(0x7ffab40ce130 msgr2=0x7ffab40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 -- 172.21.15.5:0/3842249712 shutdown_connections 2024-09-13T17:16:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.346+0000 7ffab9de2640 1 -- 172.21.15.5:0/3842249712 wait complete. 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.347+0000 7ffab9de2640 1 Processor -- start 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.347+0000 7ffab9de2640 1 -- start start 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 0x7ffab4158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab41598a0 0x7ffab4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415b5a0 con 0x7ffab40b20e0 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40ce840 con 0x7ffab4152fa0 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab9de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415a920 con 0x7ffab41598a0 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60836/0 (socket says 172.21.15.5:60836) 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 -- 172.21.15.5:0/813625436 learned_addr learned my addr 172.21.15.5:0/813625436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab3fff640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab41598a0 0x7ffab4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab2ffd640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 0x7ffab4158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 -- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab41598a0 msgr2=0x7ffab4149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab41598a0 0x7ffab4149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 -- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 msgr2=0x7ffab4158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 0x7ffab4158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 -- 172.21.15.5:0/813625436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40094d0 con 0x7ffab40b20e0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab2ffd640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 0x7ffab4158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.348+0000 7ffab37fe640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffaa402a2b0 tx=0x7ffaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.349+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4032440 con 0x7ffab40b20e0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.349+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4030ba0 con 0x7ffab40b20e0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.349+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa403d440 con 0x7ffab40b20e0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.349+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab415ac00 con 0x7ffab40b20e0 2024-09-13T17:16:00.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.349+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab415b1c0 con 0x7ffab40b20e0 2024-09-13T17:16:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.350+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab40672a0 con 0x7ffab40b20e0 2024-09-13T17:16:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.350+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffaa4039040 con 0x7ffab40b20e0 2024-09-13T17:16:00.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.351+0000 7ffa9bfff640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 0x7ffaa006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.351+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ffaa40a9fb0 con 0x7ffab40b20e0 2024-09-13T17:16:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.351+0000 7ffab2ffd640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 0x7ffaa006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.352+0000 7ffab2ffd640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 0x7ffaa006d0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8006fd0 tx=0x7ffaa8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.355+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffaa40dd9c0 con 0x7ffab40b20e0 2024-09-13T17:16:00.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.527+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffab415b350 con 0x7ffab40b20e0 2024-09-13T17:16:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.528+0000 7ffa9bfff640 1 -- 172.21.15.5:0/813625436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffaa40410a0 con 0x7ffab40b20e0 2024-09-13T17:16:00.530 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 msgr2=0x7ffaa006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 0x7ffaa006d0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8006fd0 tx=0x7ffaa8008040 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 msgr2=0x7ffab415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffaa402a2b0 tx=0x7ffaa40046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 shutdown_connections 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffab41598a0 0x7ffab4149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab4152fa0 0x7ffab4158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa006ac30 0x7ffaa006d0f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 --2- 172.21.15.5:0/813625436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab40b20e0 0x7ffab415a340 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 >> 172.21.15.5:0/813625436 conn(0x7ffab40ce130 msgr2=0x7ffab414e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 shutdown_connections 2024-09-13T17:16:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.530+0000 7ffab9de2640 1 -- 172.21.15.5:0/813625436 wait complete. 2024-09-13T17:16:00.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:00.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.644+0000 7f2330406640 1 Processor -- start 2024-09-13T17:16:00.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.644+0000 7f2330406640 1 -- start start 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.645+0000 7f2330406640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 0x7f232815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.645+0000 7f2330406640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f232806e1c0 0x7f23280aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.645+0000 7f2330406640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23280b2390 con 0x7f23280b1080 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.645+0000 7f2330406640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280b14c0 con 0x7f232806e1c0 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.645+0000 7f2330406640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280b1780 con 0x7f2328156f40 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f232806e1c0 0x7f23280aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f232806e1c0 0x7f23280aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60850/0 (socket says 172.21.15.5:60850) 2024-09-13T17:16:00.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 -- 172.21.15.5:0/1510902347 learned_addr learned my addr 172.21.15.5:0/1510902347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e1a2640 1 --2- 172.21.15.5:0/1510902347 >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 0x7f232815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 -- 172.21.15.5:0/1510902347 >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 msgr2=0x7f232815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 --2- 172.21.15.5:0/1510902347 >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 0x7f232815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 -- 172.21.15.5:0/1510902347 >> v1:172.21.15.179:6789/0 conn(0x7f23280b1080 legacy=0x7f232806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e9a3640 1 -- 172.21.15.5:0/1510902347 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280b1a60 con 0x7f232806e1c0 2024-09-13T17:16:00.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.646+0000 7f232e1a2640 1 --2- 172.21.15.5:0/1510902347 >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 0x7f232815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f232e9a3640 1 --2- 172.21.15.5:0/1510902347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f23280aced0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f232806aea0 tx=0x7f232002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0ac5c17c52a3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f232d1a0640 1 -- 172.21.15.5:0/1510902347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320031600 con 0x7f232806e1c0 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f232d1a0640 1 -- 172.21.15.5:0/1510902347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232002d050 con 0x7f232806e1c0 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f232d1a0640 1 -- 172.21.15.5:0/1510902347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320031980 con 0x7f232806e1c0 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 -- 172.21.15.5:0/1510902347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 msgr2=0x7f23280aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 --2- 172.21.15.5:0/1510902347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f23280aced0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f232806aea0 tx=0x7f232002a6f0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 -- 172.21.15.5:0/1510902347 shutdown_connections 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 --2- 172.21.15.5:0/1510902347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f23280aced0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 --2- 172.21.15.5:0/1510902347 >> v2:172.21.15.179:3300/0 conn(0x7f2328156f40 0x7f232815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.647+0000 7f2330406640 1 -- 172.21.15.5:0/1510902347 >> 172.21.15.5:0/1510902347 conn(0x7f23280ce0d0 msgr2=0x7f23280ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.648+0000 7f2330406640 1 -- 172.21.15.5:0/1510902347 shutdown_connections 2024-09-13T17:16:00.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.648+0000 7f2330406640 1 -- 172.21.15.5:0/1510902347 wait complete. 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 Processor -- start 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 -- start start 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23280b1080 0x7f2328070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2328156f40 0x7f23280ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328142dd0 con 0x7f232806e1c0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23281430b0 con 0x7f23280b1080 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.649+0000 7f2330406640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2328143390 con 0x7f2328156f40 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60854/0 (socket says 172.21.15.5:60854) 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 -- 172.21.15.5:0/807640816 learned_addr learned my addr 172.21.15.5:0/807640816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e9a3640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2328156f40 0x7f23280ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232d9a1640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23280b1080 0x7f2328070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 -- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2328156f40 msgr2=0x7f23280ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2328156f40 0x7f23280ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 -- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23280b1080 msgr2=0x7f2328070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23280b1080 0x7f2328070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 -- 172.21.15.5:0/807640816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320009b30 con 0x7f232806e1c0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f232e1a2640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f232400c7f0 tx=0x7f232400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324007820 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324007980 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328143670 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324007cf0 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.650+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2328070f80 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.651+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23280cc1b0 con 0x7f232806e1c0 2024-09-13T17:16:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.652+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f23240113f0 con 0x7f232806e1c0 2024-09-13T17:16:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.652+0000 7f231effd640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 0x7f230c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.652+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f2324089770 con 0x7f232806e1c0 2024-09-13T17:16:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.652+0000 7f232d9a1640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 0x7f230c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.653+0000 7f232d9a1640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 0x7f230c06d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23281f5cc0 tx=0x7f2318009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.656+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f23280cc1b0 con 0x7f232806e1c0 2024-09-13T17:16:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.863+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23280cc1b0 con 0x7f232806e1c0 2024-09-13T17:16:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.863+0000 7f231effd640 1 -- 172.21.15.5:0/807640816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f23280cc1b0 con 0x7f232806e1c0 2024-09-13T17:16:00.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:00.866 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:39.352320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:16:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-13T17:16:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 msgr2=0x7f230c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 0x7f230c06d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23281f5cc0 tx=0x7f2318009040 comp rx=0 tx=0).stop 2024-09-13T17:16:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 msgr2=0x7f2328142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f232400c7f0 tx=0x7f232400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 shutdown_connections 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2328156f40 0x7f23280ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23280b1080 0x7f2328070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f230c06ac00 0x7f230c06d0c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 --2- 172.21.15.5:0/807640816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f232806e1c0 0x7f2328142780 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 >> 172.21.15.5:0/807640816 conn(0x7f23280ce0d0 msgr2=0x7f232806c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 shutdown_connections 2024-09-13T17:16:00.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.865+0000 7f2330406640 1 -- 172.21.15.5:0/807640816 wait complete. 2024-09-13T17:16:00.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.977+0000 7f6f64ef7640 1 Processor -- start 2024-09-13T17:16:00.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.977+0000 7f6f64ef7640 1 -- start start 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f64ef7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f6015a180 0x7f6f600b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f64ef7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f6015d960 0x7f6f60070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f64ef7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f600ad1d0 con 0x7f6f6006ec60 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f64ef7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6015cbc0 con 0x7f6f6015d960 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f64ef7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f600b2020 con 0x7f6f6015a180 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f5dd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f6015d960 0x7f6f60070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f5ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f6006ec60 0x7f6f601601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47558/0 (socket says 172.21.15.5:47558) 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f5ed9d640 1 -- 172.21.15.5:0/1851613234 learned_addr learned my addr 172.21.15.5:0/1851613234 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.978+0000 7f6f5e59c640 1 --2- 172.21.15.5:0/1851613234 >> v2:172.21.15.179:3300/0 conn(0x7f6f6015a180 0x7f6f600b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5dd9b640 1 -- 172.21.15.5:0/1851613234 >> v2:172.21.15.179:3300/0 conn(0x7f6f6015a180 msgr2=0x7f6f600b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5dd9b640 1 --2- 172.21.15.5:0/1851613234 >> v2:172.21.15.179:3300/0 conn(0x7f6f6015a180 0x7f6f600b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5dd9b640 1 -- 172.21.15.5:0/1851613234 >> v1:172.21.15.5:6789/0 conn(0x7f6f6006ec60 legacy=0x7f6f601601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5dd9b640 1 -- 172.21.15.5:0/1851613234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6015ce80 con 0x7f6f6015d960 2024-09-13T17:16:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5d59a640 1 -- 172.21.15.5:0/1851613234 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436183152 0 0) 0x7f6f600ad1d0 con 0x7f6f6006ec60 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5dd9b640 1 --2- 172.21.15.5:0/1851613234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6015d960 0x7f6f60070510 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6f6006b920 tx=0x7f6f4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8219e6d2dc9cc157 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5d59a640 1 -- 172.21.15.5:0/1851613234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4802ae60 con 0x7f6f6015d960 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.979+0000 7f6f5d59a640 1 -- 172.21.15.5:0/1851613234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f48032440 con 0x7f6f6015d960 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f5d59a640 1 -- 172.21.15.5:0/1851613234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480327d0 con 0x7f6f6015d960 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 -- 172.21.15.5:0/1851613234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6015d960 msgr2=0x7f6f60070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/1851613234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6015d960 0x7f6f60070510 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6f6006b920 tx=0x7f6f4802a110 comp rx=0 tx=0).stop 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 -- 172.21.15.5:0/1851613234 shutdown_connections 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/1851613234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6015d960 0x7f6f60070510 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/1851613234 >> v2:172.21.15.179:3300/0 conn(0x7f6f6015a180 0x7f6f600b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 -- 172.21.15.5:0/1851613234 >> 172.21.15.5:0/1851613234 conn(0x7f6f600b0420 msgr2=0x7f6f600b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 -- 172.21.15.5:0/1851613234 shutdown_connections 2024-09-13T17:16:00.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.980+0000 7f6f64ef7640 1 -- 172.21.15.5:0/1851613234 wait complete. 2024-09-13T17:16:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.981+0000 7f6f64ef7640 1 Processor -- start 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.981+0000 7f6f64ef7640 1 -- start start 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6015a180 0x7f6f6015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6015d960 0x7f6f6015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60154de0 con 0x7f6f6006ec60 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601545b0 con 0x7f6f6015a180 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f64ef7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60152920 con 0x7f6f6015d960 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f5e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f5e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60870/0 (socket says 172.21.15.5:60870) 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f5e59c640 1 -- 172.21.15.5:0/3604944182 learned_addr learned my addr 172.21.15.5:0/3604944182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f5dd9b640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6015a180 0x7f6f6015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.982+0000 7f6f5ed9d640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6015d960 0x7f6f6015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 -- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6015d960 msgr2=0x7f6f6015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6015d960 0x7f6f6015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 -- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6015a180 msgr2=0x7f6f6015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6015a180 0x7f6f6015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 -- 172.21.15.5:0/3604944182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009400 con 0x7f6f6006ec60 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f5e59c640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007ef0 tx=0x7f6f5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50014620 con 0x7f6f6006ec60 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50014780 con 0x7f6f6006ec60 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50014b30 con 0x7f6f6006ec60 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f60152c00 con 0x7f6f6006ec60 2024-09-13T17:16:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.983+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f60155200 con 0x7f6f6006ec60 2024-09-13T17:16:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.984+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60155050 con 0x7f6f6006ec60 2024-09-13T17:16:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.984+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f50014c90 con 0x7f6f6006ec60 2024-09-13T17:16:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.985+0000 7f6f56ffd640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 0x7f6f4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.985+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f6f50089ec0 con 0x7f6f6006ec60 2024-09-13T17:16:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.985+0000 7f6f5dd9b640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 0x7f6f4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.986+0000 7f6f5dd9b640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 0x7f6f4006d0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034000 tx=0x7f6f4802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:00.989+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f50054e70 con 0x7f6f6006ec60 2024-09-13T17:16:01.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.162+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6015a560 con 0x7f6f6006ec60 2024-09-13T17:16:01.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.163+0000 7f6f56ffd640 1 -- 172.21.15.5:0/3604944182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f6f50058490 con 0x7f6f6006ec60 2024-09-13T17:16:01.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:01.168 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:57.393375+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.27","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 msgr2=0x7f6f4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 0x7f6f4006d0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034000 tx=0x7f6f4802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 msgr2=0x7f6f6014efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007ef0 tx=0x7f6f5000e4b0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 shutdown_connections 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f6015d960 0x7f6f6015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f6015a180 0x7f6f6015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f4006ac00 0x7f6f4006d0c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 --2- 172.21.15.5:0/3604944182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6006ec60 0x7f6f6014efd0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 >> 172.21.15.5:0/3604944182 conn(0x7f6f600b0420 msgr2=0x7f6f60070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 shutdown_connections 2024-09-13T17:16:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.165+0000 7f6f64ef7640 1 -- 172.21.15.5:0/3604944182 wait complete. 2024-09-13T17:16:01.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:16:01.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.278+0000 7f7d912c9640 1 Processor -- start 2024-09-13T17:16:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.278+0000 7f7d912c9640 1 -- start start 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d912c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c159290 0x7f7d8c159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d912c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d8c159bb0 0x7f7d8c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d912c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0b1580 con 0x7f7d8c0b1970 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d912c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0b2ad0 con 0x7f7d8c159290 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d912c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c06d9b0 con 0x7f7d8c159bb0 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c159290 0x7f7d8c159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c159290 0x7f7d8c159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60874/0 (socket says 172.21.15.5:60874) 2024-09-13T17:16:01.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7d8c0b1970 0x7f7d8c15c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47570/0 (socket says 172.21.15.5:47570) 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 -- 172.21.15.5:0/2236872923 learned_addr learned my addr 172.21.15.5:0/2236872923 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d83fff640 1 --2- 172.21.15.5:0/2236872923 >> v2:172.21.15.179:3300/0 conn(0x7f7d8c159bb0 0x7f7d8c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 -- 172.21.15.5:0/2236872923 >> v2:172.21.15.179:3300/0 conn(0x7f7d8c159bb0 msgr2=0x7f7d8c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 --2- 172.21.15.5:0/2236872923 >> v2:172.21.15.179:3300/0 conn(0x7f7d8c159bb0 0x7f7d8c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 -- 172.21.15.5:0/2236872923 >> v1:172.21.15.5:6789/0 conn(0x7f7d8c0b1970 legacy=0x7f7d8c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8a7fc640 1 -- 172.21.15.5:0/2236872923 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187300485 0 0) 0x7f7d8c0b1580 con 0x7f7d8c0b1970 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.279+0000 7f7d8affd640 1 -- 172.21.15.5:0/2236872923 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0b1ec0 con 0x7f7d8c159290 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.280+0000 7f7d8affd640 1 --2- 172.21.15.5:0/2236872923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c159290 0x7f7d8c159670 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b0e20 tx=0x7f7d7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b4ca365dbcb139 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.280+0000 7f7d8a7fc640 1 -- 172.21.15.5:0/2236872923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032440 con 0x7f7d8c159290 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.280+0000 7f7d8a7fc640 1 -- 172.21.15.5:0/2236872923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0325a0 con 0x7f7d8c159290 2024-09-13T17:16:01.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.280+0000 7f7d8a7fc640 1 -- 172.21.15.5:0/2236872923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032930 con 0x7f7d8c159290 2024-09-13T17:16:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 -- 172.21.15.5:0/2236872923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c159290 msgr2=0x7f7d8c159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 --2- 172.21.15.5:0/2236872923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c159290 0x7f7d8c159670 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b0e20 tx=0x7f7d7c02a270 comp rx=0 tx=0).stop 2024-09-13T17:16:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 -- 172.21.15.5:0/2236872923 shutdown_connections 2024-09-13T17:16:01.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 --2- 172.21.15.5:0/2236872923 >> v2:172.21.15.179:3300/0 conn(0x7f7d8c159bb0 0x7f7d8c070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 --2- 172.21.15.5:0/2236872923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c159290 0x7f7d8c159670 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 -- 172.21.15.5:0/2236872923 >> 172.21.15.5:0/2236872923 conn(0x7f7d8c0ce0d0 msgr2=0x7f7d8c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 -- 172.21.15.5:0/2236872923 shutdown_connections 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.281+0000 7f7d912c9640 1 -- 172.21.15.5:0/2236872923 wait complete. 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.282+0000 7f7d912c9640 1 Processor -- start 2024-09-13T17:16:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.282+0000 7f7d912c9640 1 -- start start 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d8c159290 0x7f7d8c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d8c159bb0 0x7f7d8c145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0cadc0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0cb0a0 con 0x7f7d8c159bb0 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d912c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0cb380 con 0x7f7d8c159290 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60882/0 (socket says 172.21.15.5:60882) 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 -- 172.21.15.5:0/1650028319 learned_addr learned my addr 172.21.15.5:0/1650028319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:01.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d83fff640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d8c159290 0x7f7d8c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8b7fe640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d8c159bb0 0x7f7d8c145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 -- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d8c159290 msgr2=0x7f7d8c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d8c159290 0x7f7d8c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 -- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d8c159bb0 msgr2=0x7f7d8c145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d8c159bb0 0x7f7d8c145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 -- 172.21.15.5:0/1650028319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0094d0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.283+0000 7f7d8affd640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c02a2b0 tx=0x7f7d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.284+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032440 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.284+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c030ba0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.284+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c03d440 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.284+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0cb660 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.284+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c149600 con 0x7f7d8c0b1970 2024-09-13T17:16:01.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.285+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c149790 con 0x7f7d8c0b1970 2024-09-13T17:16:01.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.285+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d7c039040 con 0x7f7d8c0b1970 2024-09-13T17:16:01.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.285+0000 7f7d837fe640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 0x7f7d6c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.286+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7d7c0aa0a0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.286+0000 7f7d83fff640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 0x7f7d6c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.286+0000 7f7d83fff640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 0x7f7d6c06d0f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06cd90 tx=0x7f7d74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.290+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7d7c0750c0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.496+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8c0672a0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.497+0000 7f7d837fe640 1 -- 172.21.15.5:0/1650028319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f7d7c0786e0 con 0x7f7d8c0b1970 2024-09-13T17:16:01.499 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:01.499 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:39.352320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:16:01.500 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-13T17:16:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 msgr2=0x7f7d6c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 0x7f7d6c06d0f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06cd90 tx=0x7f7d74008040 comp rx=0 tx=0).stop 2024-09-13T17:16:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 msgr2=0x7f7d8c148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c02a2b0 tx=0x7f7d7c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 shutdown_connections 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d8c159bb0 0x7f7d8c145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d8c159290 0x7f7d8c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d6c06ac30 0x7f7d6c06d0f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 --2- 172.21.15.5:0/1650028319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1970 0x7f7d8c148fc0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 >> 172.21.15.5:0/1650028319 conn(0x7f7d8c0ce0d0 msgr2=0x7f7d8c0af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 shutdown_connections 2024-09-13T17:16:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.499+0000 7f7d912c9640 1 -- 172.21.15.5:0/1650028319 wait complete. 2024-09-13T17:16:01.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:01.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.612+0000 7fd658419640 1 Processor -- start 2024-09-13T17:16:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.612+0000 7fd658419640 1 -- start start 2024-09-13T17:16:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd658419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd6500aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd658419640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500b2390 con 0x7fd65015a290 2024-09-13T17:16:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd658419640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500b1780 con 0x7fd650156f40 2024-09-13T17:16:01.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd658419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015a740 con 0x7fd65006e1c0 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd6569b6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd65015a290 0x7fd650162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47576/0 (socket says 172.21.15.5:47576) 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd6569b6640 1 -- 172.21.15.5:0/2317498853 learned_addr learned my addr 172.21.15.5:0/2317498853 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd6559b4640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd6500aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883603058 0 0) 0x7fd6500b2390 con 0x7fd65015a290 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.613+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd63c005730 con 0x7fd65015a290 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860065757 0 0) 0x7fd6500b1780 con 0x7fd650156f40 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6500b2390 con 0x7fd650156f40 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1915737034 0 0) 0x7fd63c005730 con 0x7fd65015a290 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 msgr2=0x7fd6500aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd6500aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 >> v1:172.21.15.179:6789/0 conn(0x7fd650156f40 legacy=0x7fd65006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500b1a60 con 0x7fd65015a290 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd6480019f0 con 0x7fd65015a290 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 >> v1:172.21.15.5:6789/0 conn(0x7fd65015a290 legacy=0x7fd650162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd63c005d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c0062a0 0x7fd63c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c006f10 0x7fd63c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015a740 con 0x7fd63c006f10 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c00dc70 con 0x7fd63c0062a0 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c00de30 con 0x7fd65006e1c0 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c006f10 0x7fd63c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6561b5640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd63c005d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6559b4640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c0062a0 0x7fd63c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 -- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 msgr2=0x7fd63c005d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd65006e1c0 0x7fd63c005d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 -- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c0062a0 msgr2=0x7fd63c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c0062a0 0x7fd63c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.614+0000 7fd6569b6640 1 -- 172.21.15.5:0/2317498853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c005730 con 0x7fd63c006f10 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.615+0000 7fd6569b6640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c006f10 0x7fd63c007390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd64800a7a0 tx=0x7fd63c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa9ba29cf551435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.615+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64802b9a0 con 0x7fd63c006f10 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.615+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64802bb20 con 0x7fd63c006f10 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.615+0000 7fd6551b3640 1 -- 172.21.15.5:0/2317498853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648034470 con 0x7fd63c006f10 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 -- 172.21.15.5:0/2317498853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c006f10 msgr2=0x7fd63c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 --2- 172.21.15.5:0/2317498853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c006f10 0x7fd63c007390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd64800a7a0 tx=0x7fd63c007a00 comp rx=0 tx=0).stop 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd6569b6640 1 -- 172.21.15.5:0/2317498853 reap_dead start 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 -- 172.21.15.5:0/2317498853 shutdown_connections 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 -- 172.21.15.5:0/2317498853 >> 172.21.15.5:0/2317498853 conn(0x7fd6500ce0d0 msgr2=0x7fd6500ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 -- 172.21.15.5:0/2317498853 shutdown_connections 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.616+0000 7fd658419640 1 -- 172.21.15.5:0/2317498853 wait complete. 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.617+0000 7fd658419640 1 Processor -- start 2024-09-13T17:16:01.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.617+0000 7fd658419640 1 -- start start 2024-09-13T17:16:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c006f10 0x7fd650150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd650153ff0 0x7fd650151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650155130 con 0x7fd650152280 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500979c0 con 0x7fd63c006f10 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd658419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd650152c40 con 0x7fd650153ff0 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60894/0 (socket says 172.21.15.5:60894) 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 -- 172.21.15.5:0/469112850 learned_addr learned my addr 172.21.15.5:0/469112850 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6561b5640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c006f10 0x7fd650150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6559b4640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd650153ff0 0x7fd650151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 -- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd650153ff0 msgr2=0x7fd650151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd650153ff0 0x7fd650151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 -- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c006f10 msgr2=0x7fd650150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c006f10 0x7fd650150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.618+0000 7fd6569b6640 1 -- 172.21.15.5:0/469112850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd650154890 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd6569b6640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd64800a7a0 tx=0x7fd648001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648038070 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64802b9b0 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd650154b70 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480348b0 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.619+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65014cfe0 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.620+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65014ce40 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.620+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd648031070 con 0x7fd650152280 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.621+0000 7fd646ffd640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 0x7fd63406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.621+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fd64803b040 con 0x7fd650152280 2024-09-13T17:16:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.621+0000 7fd6561b5640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 0x7fd63406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.621+0000 7fd6561b5640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 0x7fd63406d0c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd6501f1ab0 tx=0x7fd64c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.625+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd65014ce40 con 0x7fd650152280 2024-09-13T17:16:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.830+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd65014ce40 con 0x7fd650152280 2024-09-13T17:16:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.831+0000 7fd646ffd640 1 -- 172.21.15.5:0/469112850 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fd65014ce40 con 0x7fd650152280 2024-09-13T17:16:01.833 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:01.833 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:15:13.025097+0000","modified":"2024-09-13T17:15:39.352320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6102,"mds_1":5839},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5839":{"gid":5839,"name":"d","rank":1,"incarnation":22,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6835/2573493377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2573493377},{"type":"v1","addr":"172.21.15.179:6835","nonce":2573493377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6102":{"gid":6102,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/8976367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":8976367},{"type":"v1","addr":"172.21.15.5:6834","nonce":8976367}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:16:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-13T17:16:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 msgr2=0x7fd63406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 0x7fd63406d0c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd6501f1ab0 tx=0x7fd64c009040 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 msgr2=0x7fd650152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd64800a7a0 tx=0x7fd648001d00 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 shutdown_connections 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd63406ac00 0x7fd63406d0c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd650152280 0x7fd650152700 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd650153ff0 0x7fd650151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 --2- 172.21.15.5:0/469112850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c006f10 0x7fd650150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 >> 172.21.15.5:0/469112850 conn(0x7fd6500ce0d0 msgr2=0x7fd65015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 shutdown_connections 2024-09-13T17:16:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.833+0000 7fd658419640 1 -- 172.21.15.5:0/469112850 wait complete. 2024-09-13T17:16:01.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:01.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.946+0000 7f872c745640 1 Processor -- start 2024-09-13T17:16:01.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.946+0000 7f872c745640 1 -- start start 2024-09-13T17:16:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872c745640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87240ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872c745640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406d410 con 0x7f872415a3e0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872c745640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406cb70 con 0x7f87240ab5a0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872c745640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240aba50 con 0x7f872406e090 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872a4e1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f872415a3e0 0x7f872406c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47588/0 (socket says 172.21.15.5:47588) 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f872a4e1640 1 -- 172.21.15.5:0/4202585654 learned_addr learned my addr 172.21.15.5:0/4202585654 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f8729ce0640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87240ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730884121 0 0) 0x7f872406d410 con 0x7f872415a3e0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8710003520 con 0x7f872415a3e0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1575639395 0 0) 0x7f8710003520 con 0x7f872415a3e0 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 msgr2=0x7f87240ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87240ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 >> v1:172.21.15.179:6789/0 conn(0x7f87240ab5a0 legacy=0x7f87240b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872406ce50 con 0x7f872415a3e0 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8720001670 con 0x7f872415a3e0 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 >> v1:172.21.15.5:6789/0 conn(0x7f872415a3e0 legacy=0x7f872406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8710003ee0 0x7f87100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710004d00 0x7f8710005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240aba50 con 0x7f8710003ee0 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871000b9e0 con 0x7f8710004d00 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.947+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871000bba0 con 0x7f872406e090 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8710003ee0 0x7f87100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f872a4e1640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f872ace2640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710004d00 0x7f8710005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 -- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 msgr2=0x7f87100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f872406e090 0x7f87100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 -- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710004d00 msgr2=0x7f8710005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710004d00 0x7f8710005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 -- 172.21.15.5:0/4202585654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710003520 con 0x7f8710003ee0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.948+0000 7f8729ce0640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8710003ee0 0x7f87100047c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8714009a90 tx=0x7f87100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934c8982bea1c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714031400 con 0x7f8710003ee0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871402d050 con 0x7f8710003ee0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f87294df640 1 -- 172.21.15.5:0/4202585654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140317a0 con 0x7f8710003ee0 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 -- 172.21.15.5:0/4202585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8710003ee0 msgr2=0x7f87100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 --2- 172.21.15.5:0/4202585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8710003ee0 0x7f87100047c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8714009a90 tx=0x7f87100057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872ace2640 1 -- 172.21.15.5:0/4202585654 reap_dead start 2024-09-13T17:16:01.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 -- 172.21.15.5:0/4202585654 shutdown_connections 2024-09-13T17:16:01.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 -- 172.21.15.5:0/4202585654 >> 172.21.15.5:0/4202585654 conn(0x7f87240ce0d0 msgr2=0x7f87240ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:01.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 -- 172.21.15.5:0/4202585654 shutdown_connections 2024-09-13T17:16:01.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.949+0000 7f872c745640 1 -- 172.21.15.5:0/4202585654 wait complete. 2024-09-13T17:16:01.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.950+0000 7f872c745640 1 Processor -- start 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 -- start start 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 0x7f872415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8724144120 0x7f87241445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872415d150 con 0x7f872414e430 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240989f0 con 0x7f8710003ee0 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f872c745640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872415cb90 con 0x7f8724144120 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f8729ce0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f8729ce0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60920/0 (socket says 172.21.15.5:60920) 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.951+0000 7f8729ce0640 1 -- 172.21.15.5:0/2261749703 learned_addr learned my addr 172.21.15.5:0/2261749703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f872ace2640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8724144120 0x7f87241445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f872a4e1640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 0x7f872415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 -- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8724144120 msgr2=0x7f87241445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8724144120 0x7f87241445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 -- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 msgr2=0x7f872415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 0x7f872415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 -- 172.21.15.5:0/2261749703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872415ce70 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f872a4e1640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 0x7f872415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f8729ce0640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8714034040 tx=0x7f8714004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714031ea0 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871403a810 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8724098680 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871403abc0 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.952+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872415c940 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.953+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87240672a0 con 0x7f872414e430 2024-09-13T17:16:01.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.953+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8714038040 con 0x7f872414e430 2024-09-13T17:16:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.954+0000 7f871affd640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 0x7f870806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.954+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f87140a9510 con 0x7f872414e430 2024-09-13T17:16:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.954+0000 7f872a4e1640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 0x7f870806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.955+0000 7f872a4e1640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 0x7f870806d0f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:01.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:01.958+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8714074680 con 0x7f872414e430 2024-09-13T17:16:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.128+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872406cb70 con 0x7f872414e430 2024-09-13T17:16:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.129+0000 7f871affd640 1 -- 172.21.15.5:0/2261749703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16894 (secure 0 0 0) 0x7f8714077ca0 con 0x7f872414e430 2024-09-13T17:16:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:02.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:15:57.393375+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:15:11.264640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T17:15:11.998886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.27","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 msgr2=0x7f870806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 0x7f870806d0f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720009040 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 msgr2=0x7f8724143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8714034040 tx=0x7f8714004730 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 shutdown_connections 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8724144120 0x7f87241445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f870806ac30 0x7f870806d0f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f872414e430 0x7f8724143be0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 --2- 172.21.15.5:0/2261749703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8710003ee0 0x7f872415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 >> 172.21.15.5:0/2261749703 conn(0x7f87240ce0d0 msgr2=0x7f87240b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 shutdown_connections 2024-09-13T17:16:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.131+0000 7f872c745640 1 -- 172.21.15.5:0/2261749703 wait complete. 2024-09-13T17:16:02.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:16:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.244+0000 7f5a6f7e9640 1 Processor -- start 2024-09-13T17:16:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.245+0000 7f5a6f7e9640 1 -- start start 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6f7e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a6806ef60 0x7f5a6806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6f7e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680b35f0 con 0x7f5a680b1ac0 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6f7e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a68156f50 con 0x7f5a6806eb80 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6f7e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6815d140 con 0x7f5a6806ef60 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6cd84640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a680b1ac0 0x7f5a6815ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47602/0 (socket says 172.21.15.5:47602) 2024-09-13T17:16:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6cd84640 1 -- 172.21.15.5:0/2124088073 learned_addr learned my addr 172.21.15.5:0/2124088073 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6dd86640 1 --2- 172.21.15.5:0/2124088073 >> v2:172.21.15.179:3300/0 conn(0x7f5a6806ef60 0x7f5a6806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613212279 0 0) 0x7f5a680b35f0 con 0x7f5a680b1ac0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a54003520 con 0x7f5a680b1ac0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752505902 0 0) 0x7f5a54003520 con 0x7f5a680b1ac0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 >> v2:172.21.15.179:3300/0 conn(0x7f5a6806ef60 msgr2=0x7f5a6806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 --2- 172.21.15.5:0/2124088073 >> v2:172.21.15.179:3300/0 conn(0x7f5a6806ef60 0x7f5a6806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 >> v1:172.21.15.179:6789/0 conn(0x7f5a6806eb80 legacy=0x7f5a680b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680b1fa0 con 0x7f5a680b1ac0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f5a58001670 con 0x7f5a680b1ac0 2024-09-13T17:16:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 >> v1:172.21.15.5:6789/0 conn(0x7f5a680b1ac0 legacy=0x7f5a6815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 0x7f5a54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54005180 0x7f5a5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400bff0 con 0x7f5a54003970 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c160 con 0x7f5a54005180 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c320 con 0x7f5a540047c0 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.246+0000 7f5a6d585640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 0x7f5a54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6cd84640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6dd86640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54005180 0x7f5a5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 -- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a540047c0 msgr2=0x7f5a54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 -- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54005180 msgr2=0x7f5a5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a54005180 0x7f5a5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 -- 172.21.15.5:0/2124088073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54003520 con 0x7f5a54003970 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6dd86640 1 -- 172.21.15.5:0/2124088073 reap_dead start 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.247+0000 7f5a6d585640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 0x7f5a54003d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5a640015b0 tx=0x7f5a540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e466f848cc0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640052d0 con 0x7f5a54003970 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64005430 con 0x7f5a54003970 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a5ffff640 1 -- 172.21.15.5:0/2124088073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6402aa30 con 0x7f5a54003970 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 msgr2=0x7f5a54003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 0x7f5a54003d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5a640015b0 tx=0x7f5a540057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/2124088073 shutdown_connections 2024-09-13T17:16:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/2124088073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a54003970 0x7f5a54003d90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/2124088073 >> 172.21.15.5:0/2124088073 conn(0x7f5a68070af0 msgr2=0x7f5a68070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/2124088073 shutdown_connections 2024-09-13T17:16:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.248+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/2124088073 wait complete. 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.249+0000 7f5a6f7e9640 1 Processor -- start 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 -- start start 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a54003970 0x7f5a6814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 0x7f5a680cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680ce3b0 con 0x7f5a6806a9b0 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6806b370 con 0x7f5a680cd6f0 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6f7e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68150640 con 0x7f5a54003970 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6cd84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6cd84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60928/0 (socket says 172.21.15.5:60928) 2024-09-13T17:16:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.250+0000 7f5a6cd84640 1 -- 172.21.15.5:0/555299796 learned_addr learned my addr 172.21.15.5:0/555299796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6d585640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a54003970 0x7f5a6814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6dd86640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 0x7f5a680cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 -- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a54003970 msgr2=0x7f5a6814f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a54003970 0x7f5a6814f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 -- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 msgr2=0x7f5a680cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 0x7f5a680cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 -- 172.21.15.5:0/555299796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68150920 con 0x7f5a6806a9b0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6dd86640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 0x7f5a680cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6cd84640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007290 tx=0x7f5a58007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58001650 con 0x7f5a6806a9b0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800f9c0 con 0x7f5a6806a9b0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a68150c00 con 0x7f5a6806a9b0 2024-09-13T17:16:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800fd50 con 0x7f5a6806a9b0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.251+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680ce0b0 con 0x7f5a6806a9b0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.252+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680672e0 con 0x7f5a6806a9b0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.253+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a5801d460 con 0x7f5a6806a9b0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.253+0000 7f5a5dffb640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.253+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f5a58089620 con 0x7f5a6806a9b0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.253+0000 7f5a6d585640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.254+0000 7f5a6d585640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5a64032000 tx=0x7f5a6402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.257+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a58054650 con 0x7f5a6806a9b0 2024-09-13T17:16:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.465+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5a68151120 con 0x7f5a6806a9b0 2024-09-13T17:16:02.467 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:16:02.465+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:16:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.472+0000 7f5a5dffb640 1 -- 172.21.15.5:0/555299796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5a68151120 con 0x7f5a6806a9b0 2024-09-13T17:16:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 msgr2=0x7f5a4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5a64032000 tx=0x7f5a6402e000 comp rx=0 tx=0).stop 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 msgr2=0x7f5a6806ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007290 tx=0x7f5a58007750 comp rx=0 tx=0).stop 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 shutdown_connections 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a680cd6f0 0x7f5a680cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5a4c06ac00 0x7f5a4c06d0c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a6806a9b0 0x7f5a6806ae30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 --2- 172.21.15.5:0/555299796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a54003970 0x7f5a6814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.474+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 >> 172.21.15.5:0/555299796 conn(0x7f5a68070af0 msgr2=0x7f5a680ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.475+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 shutdown_connections 2024-09-13T17:16:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.475+0000 7f5a6f7e9640 1 -- 172.21.15.5:0/555299796 wait complete. 2024-09-13T17:16:02.479 INFO:tasks.ceph.mds.c.smithi005.stderr: -8008> 2024-09-13T17:15:18.941+0000 7fdf0f5a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:16:02.482 INFO:tasks.ceph.mds.c.smithi005.stderr: -5569> 2024-09-13T17:15:28.942+0000 7fdf0f5a2640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T17:16:02.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:16:02.508 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:16:02.514 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:16:02.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.592+0000 7fbf4fa72640 1 Processor -- start 2024-09-13T17:16:02.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.592+0000 7fbf4fa72640 1 -- start start 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4fa72640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf480abe60 0x7fbf480b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4fa72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf4806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4fa72640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480ad050 con 0x7fbf481591e0 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4fa72640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4806e400 con 0x7fbf480abe60 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4fa72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480ac440 con 0x7fbf4806da30 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf480abe60 0x7fbf480b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf480abe60 0x7fbf480b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60960/0 (socket says 172.21.15.5:60960) 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 -- 172.21.15.5:0/3824572615 learned_addr learned my addr 172.21.15.5:0/3824572615 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4e00f640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf4806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 -- 172.21.15.5:0/3824572615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 msgr2=0x7fbf4806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf4806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4d00d640 1 -- 172.21.15.5:0/3824572615 >> v1:172.21.15.5:6789/0 conn(0x7fbf481591e0 legacy=0x7fbf480ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4d00d640 1 -- 172.21.15.5:0/3824572615 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480ac720 con 0x7fbf480abe60 2024-09-13T17:16:02.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.593+0000 7fbf4c80c640 1 -- 172.21.15.5:0/3824572615 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171266799 0 0) 0x7fbf480ad050 con 0x7fbf481591e0 2024-09-13T17:16:02.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4e00f640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf4806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4d00d640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf480b1b30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800bb10 tx=0x7fbf3802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfc37e8f187d784 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4c80c640 1 -- 172.21.15.5:0/3824572615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38032820 con 0x7fbf480abe60 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4c80c640 1 -- 172.21.15.5:0/3824572615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3802e040 con 0x7fbf480abe60 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.594+0000 7fbf4c80c640 1 -- 172.21.15.5:0/3824572615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38032ba0 con 0x7fbf480abe60 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 -- 172.21.15.5:0/3824572615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 msgr2=0x7fbf480b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf480b1b30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800bb10 tx=0x7fbf3802c920 comp rx=0 tx=0).stop 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 -- 172.21.15.5:0/3824572615 shutdown_connections 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf4806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/3824572615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf480b1b30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 -- 172.21.15.5:0/3824572615 >> 172.21.15.5:0/3824572615 conn(0x7fbf480ce130 msgr2=0x7fbf480ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 -- 172.21.15.5:0/3824572615 shutdown_connections 2024-09-13T17:16:02.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.595+0000 7fbf4fa72640 1 -- 172.21.15.5:0/3824572615 wait complete. 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.596+0000 7fbf4fa72640 1 Processor -- start 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.596+0000 7fbf4fa72640 1 -- start start 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf48146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf481591e0 0x7fbf481502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814e4f0 con 0x7fbf480abe60 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4815b2b0 con 0x7fbf481591e0 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4fa72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48156000 con 0x7fbf4806da30 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60972/0 (socket says 172.21.15.5:60972) 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 -- 172.21.15.5:0/825229247 learned_addr learned my addr 172.21.15.5:0/825229247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4e00f640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf481591e0 0x7fbf481502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d80e640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf48146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 -- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 msgr2=0x7fbf48146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf48146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 -- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf481591e0 msgr2=0x7fbf481502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf481591e0 0x7fbf481502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d00d640 1 -- 172.21.15.5:0/825229247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3800b770 con 0x7fbf480abe60 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.597+0000 7fbf4d80e640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf48146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf4d00d640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbf38035040 tx=0x7fbf38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3803abf0 con 0x7fbf480abe60 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3803f070 con 0x7fbf480abe60 2024-09-13T17:16:02.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4815acf0 con 0x7fbf480abe60 2024-09-13T17:16:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004030 con 0x7fbf480abe60 2024-09-13T17:16:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.598+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4814e110 con 0x7fbf480abe60 2024-09-13T17:16:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.599+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4814df70 con 0x7fbf480abe60 2024-09-13T17:16:02.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.600+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf38004190 con 0x7fbf480abe60 2024-09-13T17:16:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.600+0000 7fbf3e7fc640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.600+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6302+0+0 (secure 0 0 0) 0x7fbf380aa940 con 0x7fbf480abe60 2024-09-13T17:16:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.600+0000 7fbf4d80e640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.601+0000 7fbf4d80e640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbf44000f60 tx=0x7fbf44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:02.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.603+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf380759b0 con 0x7fbf480abe60 2024-09-13T17:16:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:02.808+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf4814df70 con 0x7fbf480abe60 2024-09-13T17:16:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.479+0000 7fbf3e7fc640 1 -- 172.21.15.5:0/825229247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf4814df70 con 0x7fbf480abe60 2024-09-13T17:16:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 msgr2=0x7fbf2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbf44000f60 tx=0x7fbf44009040 comp rx=0 tx=0).stop 2024-09-13T17:16:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 msgr2=0x7fbf4815a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:03.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbf38035040 tx=0x7fbf38004730 comp rx=0 tx=0).stop 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 shutdown_connections 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf481591e0 0x7fbf481502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf2c06ac00 0x7fbf2c06d0c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf480abe60 0x7fbf4815a270 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 --2- 172.21.15.5:0/825229247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf4806da30 0x7fbf48146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 >> 172.21.15.5:0/825229247 conn(0x7fbf480ce130 msgr2=0x7fbf480af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 shutdown_connections 2024-09-13T17:16:03.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.482+0000 7fbf4fa72640 1 -- 172.21.15.5:0/825229247 wait complete. 2024-09-13T17:16:03.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:16:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.648+0000 7f317e853640 1 Processor -- start 2024-09-13T17:16:03.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.648+0000 7f317e853640 1 -- start start 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f317815a3b0 0x7f3178099410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f317815a790 0x7f31780cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 0x7f31780ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780b1c50 con 0x7f317815a790 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780999f0 con 0x7f317815a3b0 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317e853640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780b31b0 con 0x7f31780ce3d0 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f317815a790 0x7f31780cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f317815a790 0x7f31780cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35826/0 (socket says 172.21.15.5:35826) 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 -- 172.21.15.5:0/1969758947 learned_addr learned my addr 172.21.15.5:0/1969758947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317cdf0640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 0x7f31780ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f3177fff640 1 --2- 172.21.15.5:0/1969758947 >> v2:172.21.15.179:3300/0 conn(0x7f317815a3b0 0x7f3178099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 -- 172.21.15.5:0/1969758947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 msgr2=0x7f31780ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 0x7f31780ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 -- 172.21.15.5:0/1969758947 >> v2:172.21.15.179:3300/0 conn(0x7f317815a3b0 msgr2=0x7f3178099410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 --2- 172.21.15.5:0/1969758947 >> v2:172.21.15.179:3300/0 conn(0x7f317815a3b0 0x7f3178099410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f31777fe640 1 -- 172.21.15.5:0/1969758947 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780b3490 con 0x7f317815a790 2024-09-13T17:16:03.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.649+0000 7f317cdf0640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 0x7f31780ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.650+0000 7f31777fe640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780cde90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3178071820 tx=0x7f316c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9708aec31c7aba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.650+0000 7f3176ffd640 1 -- 172.21.15.5:0/1969758947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c032440 con 0x7f317815a790 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.650+0000 7f3176ffd640 1 -- 172.21.15.5:0/1969758947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c0325a0 con 0x7f317815a790 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.650+0000 7f3176ffd640 1 -- 172.21.15.5:0/1969758947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c032930 con 0x7f317815a790 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 -- 172.21.15.5:0/1969758947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 msgr2=0x7f31780cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780cde90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3178071820 tx=0x7f316c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 -- 172.21.15.5:0/1969758947 shutdown_connections 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31780ce3d0 0x7f31780ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 --2- 172.21.15.5:0/1969758947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780cde90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 --2- 172.21.15.5:0/1969758947 >> v2:172.21.15.179:3300/0 conn(0x7f317815a3b0 0x7f3178099410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 -- 172.21.15.5:0/1969758947 >> 172.21.15.5:0/1969758947 conn(0x7f31780b1db0 msgr2=0x7f31780b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 -- 172.21.15.5:0/1969758947 shutdown_connections 2024-09-13T17:16:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.651+0000 7f317e853640 1 -- 172.21.15.5:0/1969758947 wait complete. 2024-09-13T17:16:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.652+0000 7f317e853640 1 Processor -- start 2024-09-13T17:16:03.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.652+0000 7f317e853640 1 -- start start 2024-09-13T17:16:03.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780ce3d0 0x7f3178154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815a3b0 0x7f31780aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780adbb0 con 0x7f317815a790 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780ade50 con 0x7f31780ce3d0 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317e853640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780ae130 con 0x7f317815a3b0 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317cdf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317cdf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35830/0 (socket says 172.21.15.5:35830) 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f317cdf0640 1 -- 172.21.15.5:0/3211688442 learned_addr learned my addr 172.21.15.5:0/3211688442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.653+0000 7f3177fff640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780ce3d0 0x7f3178154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f31777fe640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815a3b0 0x7f31780aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 -- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815a3b0 msgr2=0x7f31780aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815a3b0 0x7f31780aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 -- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780ce3d0 msgr2=0x7f3178154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780ce3d0 0x7f3178154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 -- 172.21.15.5:0/3211688442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0094d0 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317cdf0640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3170009fa0 tx=0x7f317000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170003b90 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000f040 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780ae410 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170004030 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.654+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3178154da0 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.655+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31780672e0 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.655+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3170004190 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.656+0000 7f3174ff9640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 0x7f316406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.656+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6302+0+0 (secure 0 0 0) 0x7f31700898e0 con 0x7f317815a790 2024-09-13T17:16:03.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.656+0000 7f3177fff640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 0x7f316406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:03.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.657+0000 7f3177fff640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 0x7f316406d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3168006fd0 tx=0x7f3168008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:03.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.660+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3170054900 con 0x7f317815a790 2024-09-13T17:16:03.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:03.832+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31780ae930 con 0x7f317815a790 2024-09-13T17:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.481+0000 7f3174ff9640 1 -- 172.21.15.5:0/3211688442 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31780ae930 con 0x7f317815a790 2024-09-13T17:16:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 msgr2=0x7f316406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 0x7f316406d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3168006fd0 tx=0x7f3168008040 comp rx=0 tx=0).stop 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 msgr2=0x7f31780c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3170009fa0 tx=0x7f317000d560 comp rx=0 tx=0).stop 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 shutdown_connections 2024-09-13T17:16:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f316406ac00 0x7f316406d0c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317815a790 0x7f31780c98c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815a3b0 0x7f31780aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 --2- 172.21.15.5:0/3211688442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780ce3d0 0x7f3178154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 >> 172.21.15.5:0/3211688442 conn(0x7f31780b1db0 msgr2=0x7f31780b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 shutdown_connections 2024-09-13T17:16:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.486+0000 7f317e853640 1 -- 172.21.15.5:0/3211688442 wait complete. 2024-09-13T17:16:04.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:16:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.611+0000 7fec06aa3640 1 Processor -- start 2024-09-13T17:16:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.611+0000 7fec06aa3640 1 -- start start 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7fec06aa3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7fec0006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7fec06aa3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0006e070 con 0x7fec000ab060 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7fec06aa3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0015b540 con 0x7fec0015b000 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7fec06aa3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0015b820 con 0x7fec00151290 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febfffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec000ab060 0x7fec0015a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47922/0 (socket says 172.21.15.5:47922) 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febfffff640 1 -- 172.21.15.5:0/916155666 learned_addr learned my addr 172.21.15.5:0/916155666 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7fec0483f640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7fec0006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187511885 0 0) 0x7fec0006e070 con 0x7fec000ab060 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf0003520 con 0x7fec000ab060 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095710134 0 0) 0x7fec0015b540 con 0x7fec0015b000 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec0006e070 con 0x7fec0015b000 2024-09-13T17:16:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707893202 0 0) 0x7febf0003520 con 0x7fec000ab060 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 msgr2=0x7fec0006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7fec0006ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 >> v1:172.21.15.179:6789/0 conn(0x7fec0015b000 legacy=0x7fec000b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0006c350 con 0x7fec000ab060 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.612+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7febec001670 con 0x7fec000ab060 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 >> v1:172.21.15.5:6789/0 conn(0x7fec000ab060 legacy=0x7fec0015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7febf0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7febf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf0004d00 0x7febf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0015b820 con 0x7febf0003b30 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf000ba30 con 0x7febf0004d00 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf000bbf0 con 0x7fec00151290 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7febf0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7febfffff640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7febf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec05040640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf0004d00 0x7febf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 -- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 msgr2=0x7febf00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00151290 0x7febf00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 -- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf0004d00 msgr2=0x7febf0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf0004d00 0x7febf0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.613+0000 7fec0483f640 1 -- 172.21.15.5:0/916155666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0003520 con 0x7febf0003b30 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7fec0483f640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7febf0003f30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ac0 tx=0x7febf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2794dc209de7a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4031400 con 0x7febf0003b30 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf402d050 con 0x7febf0003b30 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7febff7fe640 1 -- 172.21.15.5:0/916155666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4031780 con 0x7febf0003b30 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7fec06aa3640 1 -- 172.21.15.5:0/916155666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 msgr2=0x7febf0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7fec06aa3640 1 --2- 172.21.15.5:0/916155666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7febf0003f30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ac0 tx=0x7febf00057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7fec05040640 1 -- 172.21.15.5:0/916155666 reap_dead start 2024-09-13T17:16:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.614+0000 7fec06aa3640 1 -- 172.21.15.5:0/916155666 shutdown_connections 2024-09-13T17:16:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.615+0000 7fec06aa3640 1 -- 172.21.15.5:0/916155666 >> 172.21.15.5:0/916155666 conn(0x7fec000ce0f0 msgr2=0x7fec000ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.615+0000 7fec06aa3640 1 -- 172.21.15.5:0/916155666 shutdown_connections 2024-09-13T17:16:04.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.615+0000 7fec06aa3640 1 -- 172.21.15.5:0/916155666 wait complete. 2024-09-13T17:16:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.616+0000 7fec06aa3640 1 Processor -- start 2024-09-13T17:16:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.616+0000 7fec06aa3640 1 -- start start 2024-09-13T17:16:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 0x7fec0014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec00148c50 0x7fec001490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001f2810 con 0x7febf0003b30 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec00070850 con 0x7fec00148c50 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00070b30 con 0x7fec00070070 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35846/0 (socket says 172.21.15.5:35846) 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 -- 172.21.15.5:0/1406823663 learned_addr learned my addr 172.21.15.5:0/1406823663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7febfffff640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 0x7fec0014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec05040640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec00148c50 0x7fec001490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 -- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 msgr2=0x7fec0014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 0x7fec0014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 -- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec00148c50 msgr2=0x7fec001490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec00148c50 0x7fec001490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 -- 172.21.15.5:0/1406823663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00070e10 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7febfffff640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 0x7fec0014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec0483f640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ac0 tx=0x7febf4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4003b90 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4003cf0 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4044650 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.617+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec000710f0 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.618+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0014ec80 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.618+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0014ee70 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.619+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febf4038070 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.620+0000 7febfd7fa640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 0x7febe406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.620+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5864+0+0 (secure 0 0 0) 0x7febf40a9890 con 0x7febf0003b30 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.620+0000 7febfffff640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 0x7febe406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.620+0000 7febfffff640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 0x7febe406d0f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec00071e60 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.624+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7febf4074b10 con 0x7febf0003b30 2024-09-13T17:16:04.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:04.800+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec000672a0 con 0x7febf0003b30 2024-09-13T17:16:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.487+0000 7febfd7fa640 1 -- 172.21.15.5:0/1406823663 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7febf40360d0 con 0x7febf0003b30 2024-09-13T17:16:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 msgr2=0x7febe406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 0x7febe406d0f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec00071e60 tx=0x7febec009040 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 msgr2=0x7fec00157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ac0 tx=0x7febf4004730 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 shutdown_connections 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec00148c50 0x7fec001490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec00070070 0x7fec0014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7febe406ac30 0x7febe406d0f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 --2- 172.21.15.5:0/1406823663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febf0003b30 0x7fec00157bc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.491+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 >> 172.21.15.5:0/1406823663 conn(0x7fec000ce0f0 msgr2=0x7fec000cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.492+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 shutdown_connections 2024-09-13T17:16:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.492+0000 7fec06aa3640 1 -- 172.21.15.5:0/1406823663 wait complete. 2024-09-13T17:16:05.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:16:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.615+0000 7fc145bfb640 1 Processor -- start 2024-09-13T17:16:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.615+0000 7fc145bfb640 1 -- start start 2024-09-13T17:16:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc145bfb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 0x7fc1400b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc145bfb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 0x7fc14006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc145bfb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400ad050 con 0x7fc1401591e0 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc145bfb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14006e400 con 0x7fc1400abe60 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc145bfb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400ac440 con 0x7fc14006da30 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1401591e0 0x7fc1400ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47926/0 (socket says 172.21.15.5:47926) 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13f7fe640 1 -- 172.21.15.5:0/3195498202 learned_addr learned my addr 172.21.15.5:0/3195498202 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13ffff640 1 --2- 172.21.15.5:0/3195498202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 0x7fc14006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13effd640 1 --2- 172.21.15.5:0/3195498202 >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 0x7fc1400b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13e7fc640 1 -- 172.21.15.5:0/3195498202 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154874174 0 0) 0x7fc1400ad050 con 0x7fc1401591e0 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13e7fc640 1 -- 172.21.15.5:0/3195498202 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc128003520 con 0x7fc1401591e0 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13ffff640 1 -- 172.21.15.5:0/3195498202 >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 msgr2=0x7fc1400b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13ffff640 1 --2- 172.21.15.5:0/3195498202 >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 0x7fc1400b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13ffff640 1 -- 172.21.15.5:0/3195498202 >> v1:172.21.15.5:6789/0 conn(0x7fc1401591e0 legacy=0x7fc1400ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13ffff640 1 -- 172.21.15.5:0/3195498202 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400ac720 con 0x7fc14006da30 2024-09-13T17:16:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.616+0000 7fc13effd640 1 --2- 172.21.15.5:0/3195498202 >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 0x7fc1400b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.617+0000 7fc13ffff640 1 --2- 172.21.15.5:0/3195498202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 0x7fc14006dec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc138009d90 tx=0x7fc13802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf037b6c9f63304 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc13e7fc640 1 -- 172.21.15.5:0/3195498202 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007740 con 0x7fc14006da30 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc13e7fc640 1 -- 172.21.15.5:0/3195498202 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13802d050 con 0x7fc14006da30 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc13e7fc640 1 -- 172.21.15.5:0/3195498202 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007ac0 con 0x7fc14006da30 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 -- 172.21.15.5:0/3195498202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 msgr2=0x7fc14006dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3195498202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 0x7fc14006dec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc138009d90 tx=0x7fc13802a660 comp rx=0 tx=0).stop 2024-09-13T17:16:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 -- 172.21.15.5:0/3195498202 shutdown_connections 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3195498202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc14006da30 0x7fc14006dec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3195498202 >> v2:172.21.15.179:3300/0 conn(0x7fc1400abe60 0x7fc1400b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 -- 172.21.15.5:0/3195498202 >> 172.21.15.5:0/3195498202 conn(0x7fc1400ce130 msgr2=0x7fc1400ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 -- 172.21.15.5:0/3195498202 shutdown_connections 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.618+0000 7fc145bfb640 1 -- 172.21.15.5:0/3195498202 wait complete. 2024-09-13T17:16:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.619+0000 7fc145bfb640 1 Processor -- start 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.619+0000 7fc145bfb640 1 -- start start 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400abe60 0x7fc1401598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401591e0 0x7fc140145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140159e00 con 0x7fc14006da30 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14009a570 con 0x7fc1401591e0 2024-09-13T17:16:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc145bfb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14009a850 con 0x7fc1400abe60 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc13f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc13f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35856/0 (socket says 172.21.15.5:35856) 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc13f7fe640 1 -- 172.21.15.5:0/3067885496 learned_addr learned my addr 172.21.15.5:0/3067885496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc13effd640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400abe60 0x7fc1401598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.620+0000 7fc13ffff640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401591e0 0x7fc140145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 -- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400abe60 msgr2=0x7fc1401598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400abe60 0x7fc1401598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 -- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401591e0 msgr2=0x7fc140145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401591e0 0x7fc140145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 -- 172.21.15.5:0/3067885496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134009400 con 0x7fc14006da30 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc13f7fe640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c410 tx=0x7fc13000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130005ce0 con 0x7fc14006da30 2024-09-13T17:16:05.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130005e40 con 0x7fc14006da30 2024-09-13T17:16:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc138009a70 con 0x7fc14006da30 2024-09-13T17:16:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300072f0 con 0x7fc14006da30 2024-09-13T17:16:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.621+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14009ae10 con 0x7fc14006da30 2024-09-13T17:16:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.622+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1400672a0 con 0x7fc14006da30 2024-09-13T17:16:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.623+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc130007450 con 0x7fc14006da30 2024-09-13T17:16:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.623+0000 7fc127fff640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 0x7fc12c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.623+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fc130088850 con 0x7fc14006da30 2024-09-13T17:16:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.623+0000 7fc13effd640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 0x7fc12c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.624+0000 7fc13effd640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 0x7fc12c06d0f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc140158160 tx=0x7fc134009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.627+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc130053c60 con 0x7fc14006da30 2024-09-13T17:16:05.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.800+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1400ce9c0 con 0x7fc14006da30 2024-09-13T17:16:05.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.804+0000 7fc127fff640 1 -- 172.21.15.5:0/3067885496 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc130057280 con 0x7fc14006da30 2024-09-13T17:16:05.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 msgr2=0x7fc12c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 0x7fc12c06d0f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc140158160 tx=0x7fc134009190 comp rx=0 tx=0).stop 2024-09-13T17:16:05.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 msgr2=0x7fc1400b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c410 tx=0x7fc13000c8d0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 shutdown_connections 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1401591e0 0x7fc140145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1400abe60 0x7fc1401598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc12c06ac30 0x7fc12c06d0f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 --2- 172.21.15.5:0/3067885496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc14006da30 0x7fc1400b2eb0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 >> 172.21.15.5:0/3067885496 conn(0x7fc1400ce130 msgr2=0x7fc14014d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 shutdown_connections 2024-09-13T17:16:05.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.806+0000 7fc145bfb640 1 -- 172.21.15.5:0/3067885496 wait complete. 2024-09-13T17:16:05.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-13T17:16:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.918+0000 7fa61465a640 1 Processor -- start 2024-09-13T17:16:05.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.918+0000 7fa61465a640 1 -- start start 2024-09-13T17:16:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c15a3e0 0x7fa60c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 0x7fa60c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa60c0ab5a0 0x7fa60c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0aba50 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c06d410 con 0x7fa60c06c320 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa61465a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06cb70 con 0x7fa60c15a3e0 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa60c0ab5a0 0x7fa60c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa60c0ab5a0 0x7fa60c15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35860/0 (socket says 172.21.15.5:35860) 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 -- 172.21.15.5:0/2966217409 learned_addr learned my addr 172.21.15.5:0/2966217409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa6123f6640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c15a3e0 0x7fa60c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa611bf5640 1 --2- 172.21.15.5:0/2966217409 >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 0x7fa60c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 -- 172.21.15.5:0/2966217409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c15a3e0 msgr2=0x7fa60c06e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c15a3e0 0x7fa60c06e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 -- 172.21.15.5:0/2966217409 >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 msgr2=0x7fa60c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 --2- 172.21.15.5:0/2966217409 >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 0x7fa60c0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa612bf7640 1 -- 172.21.15.5:0/2966217409 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c06ce50 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.919+0000 7fa611bf5640 1 --2- 172.21.15.5:0/2966217409 >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 0x7fa60c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.920+0000 7fa612bf7640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c0ab5a0 0x7fa60c15de00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa60c06bc80 tx=0x7fa60402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb3df6d1554b4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.920+0000 7fa6113f4640 1 -- 172.21.15.5:0/2966217409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604031600 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.920+0000 7fa6113f4640 1 -- 172.21.15.5:0/2966217409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60402d050 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.920+0000 7fa6113f4640 1 -- 172.21.15.5:0/2966217409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604031980 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 -- 172.21.15.5:0/2966217409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c0ab5a0 msgr2=0x7fa60c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c0ab5a0 0x7fa60c15de00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa60c06bc80 tx=0x7fa60402a6a0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 -- 172.21.15.5:0/2966217409 shutdown_connections 2024-09-13T17:16:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c0ab5a0 0x7fa60c15de00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 --2- 172.21.15.5:0/2966217409 >> v2:172.21.15.179:3300/0 conn(0x7fa60c06c320 0x7fa60c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 --2- 172.21.15.5:0/2966217409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c15a3e0 0x7fa60c06e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 -- 172.21.15.5:0/2966217409 >> 172.21.15.5:0/2966217409 conn(0x7fa60c0ce0d0 msgr2=0x7fa60c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 -- 172.21.15.5:0/2966217409 shutdown_connections 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.921+0000 7fa61465a640 1 -- 172.21.15.5:0/2966217409 wait complete. 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.922+0000 7fa61465a640 1 Processor -- start 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.922+0000 7fa61465a640 1 -- start start 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c0ab5a0 0x7fa60c09aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 0x7fa60c09afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09b650 con 0x7fa60c06c320 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09b930 con 0x7fa60c15a3e0 2024-09-13T17:16:05.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa61465a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09bc10 con 0x7fa60c0ab5a0 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35868/0 (socket says 172.21.15.5:35868) 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 -- 172.21.15.5:0/3782031563 learned_addr learned my addr 172.21.15.5:0/3782031563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa611bf5640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c0ab5a0 0x7fa60c09aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa612bf7640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 0x7fa60c09afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 -- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c0ab5a0 msgr2=0x7fa60c09aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c0ab5a0 0x7fa60c09aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 -- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 msgr2=0x7fa60c09afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 0x7fa60c09afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 -- 172.21.15.5:0/3782031563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009b30 con 0x7fa60c06c320 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa612bf7640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 0x7fa60c09afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.923+0000 7fa6123f6640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e870 tx=0x7fa60800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.924+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6080094f0 con 0x7fa60c06c320 2024-09-13T17:16:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.924+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800c940 con 0x7fa60c06c320 2024-09-13T17:16:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.924+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800ccf0 con 0x7fa60c06c320 2024-09-13T17:16:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.924+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c09bef0 con 0x7fa60c06c320 2024-09-13T17:16:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.924+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c153db0 con 0x7fa60c06c320 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.925+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c0672a0 con 0x7fa60c06c320 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.925+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa608013470 con 0x7fa60c06c320 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.926+0000 7fa602ffd640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.926+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fa608089270 con 0x7fa60c06c320 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.926+0000 7fa611bf5640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.926+0000 7fa611bf5640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 0x7fa5f006d0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc006fd0 tx=0x7fa5fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:05.930+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa608054620 con 0x7fa60c06c320 2024-09-13T17:16:06.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.167+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7fa60c0ab060 con 0x7fa60c06c320 2024-09-13T17:16:06.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.487+0000 7fa602ffd640 1 -- 172.21.15.5:0/3782031563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v173) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa608057c40 con 0x7fa60c06c320 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 msgr2=0x7fa5f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 0x7fa5f006d0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc006fd0 tx=0x7fa5fc008040 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 msgr2=0x7fa60c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e870 tx=0x7fa60800ed30 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 shutdown_connections 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa60c15a3e0 0x7fa60c09afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa60c0ab5a0 0x7fa60c09aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa5f006ac00 0x7fa5f006d0c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 --2- 172.21.15.5:0/3782031563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa60c06c320 0x7fa60c0b1940 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 >> 172.21.15.5:0/3782031563 conn(0x7fa60c0ce0d0 msgr2=0x7fa60c154c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 shutdown_connections 2024-09-13T17:16:06.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.489+0000 7fa61465a640 1 -- 172.21.15.5:0/3782031563 wait complete. 2024-09-13T17:16:06.503 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... ok 2024-09-13T17:16:06.503 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:16:06.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.605+0000 7fb97f012640 1 Processor -- start 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.605+0000 7fb97f012640 1 -- start start 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97f012640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb97806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97f012640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97806c320 0x7fb9780ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97f012640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97806d410 con 0x7fb9780ab5a0 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97f012640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9780aba50 con 0x7fb97806c320 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97f012640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97806cb70 con 0x7fb97815a3e0 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97806c320 0x7fb9780ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97806c320 0x7fb9780ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35874/0 (socket says 172.21.15.5:35874) 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 -- 172.21.15.5:0/1246781621 learned_addr learned my addr 172.21.15.5:0/1246781621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb97cdae640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb97806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 -- 172.21.15.5:0/1246781621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 msgr2=0x7fb97806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb97806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 -- 172.21.15.5:0/1246781621 >> v1:172.21.15.179:6789/0 conn(0x7fb9780ab5a0 legacy=0x7fb97815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.606+0000 7fb977fff640 1 -- 172.21.15.5:0/1246781621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97806ce50 con 0x7fb97806c320 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.607+0000 7fb977fff640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780ab060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb964009870 tx=0x7fb96402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e79eb7b1308b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.607+0000 7fb9777fe640 1 -- 172.21.15.5:0/1246781621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964032440 con 0x7fb97806c320 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.607+0000 7fb9777fe640 1 -- 172.21.15.5:0/1246781621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9640325a0 con 0x7fb97806c320 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.607+0000 7fb9777fe640 1 -- 172.21.15.5:0/1246781621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964032930 con 0x7fb97806c320 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 -- 172.21.15.5:0/1246781621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 msgr2=0x7fb9780ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780ab060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb964009870 tx=0x7fb96402a270 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 -- 172.21.15.5:0/1246781621 shutdown_connections 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780ab060 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 --2- 172.21.15.5:0/1246781621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb97806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 -- 172.21.15.5:0/1246781621 >> 172.21.15.5:0/1246781621 conn(0x7fb9780ce0d0 msgr2=0x7fb9780ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 -- 172.21.15.5:0/1246781621 shutdown_connections 2024-09-13T17:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.608+0000 7fb97f012640 1 -- 172.21.15.5:0/1246781621 wait complete. 2024-09-13T17:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.609+0000 7fb97f012640 1 Processor -- start 2024-09-13T17:16:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.609+0000 7fb97f012640 1 -- start start 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9780ab5a0 0x7fb978071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb9780b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978155960 con 0x7fb97806c320 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978098170 con 0x7fb9780ab5a0 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97f012640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978098450 con 0x7fb97815a3e0 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35888/0 (socket says 172.21.15.5:35888) 2024-09-13T17:16:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 -- 172.21.15.5:0/3622687852 learned_addr learned my addr 172.21.15.5:0/3622687852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb977fff640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9780ab5a0 0x7fb978071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97d5af640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb9780b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 -- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 msgr2=0x7fb9780b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb9780b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 -- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9780ab5a0 msgr2=0x7fb978071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9780ab5a0 0x7fb978071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 -- 172.21.15.5:0/3622687852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640094d0 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.610+0000 7fb97cdae640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00e870 tx=0x7fb96c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.611+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0094f0 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.611+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00c940 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.611+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb978098730 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.611+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00ccf0 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.611+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb978098cf0 con 0x7fb97806c320 2024-09-13T17:16:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.612+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978067280 con 0x7fb97806c320 2024-09-13T17:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.612+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb96c013470 con 0x7fb97806c320 2024-09-13T17:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.613+0000 7fb9757fa640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 0x7fb95c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.613+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fb96c089250 con 0x7fb97806c320 2024-09-13T17:16:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.613+0000 7fb977fff640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 0x7fb95c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.613+0000 7fb977fff640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 0x7fb95c06d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb964034000 tx=0x7fb96402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.617+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb96c054620 con 0x7fb97806c320 2024-09-13T17:16:06.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.786+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9780ab060 con 0x7fb97806c320 2024-09-13T17:16:06.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.787+0000 7fb9757fa640 1 -- 172.21.15.5:0/3622687852 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13340 (secure 0 0 0) 0x7fb96c057c40 con 0x7fb97806c320 2024-09-13T17:16:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:06.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:05.481114+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6832/8976367":"2024-09-14T17:16:02.467065+0000","172.21.15.5:6834/8976367":"2024-09-14T17:16:02.467065+0000","172.21.15.179:6835/2573493377":"2024-09-14T17:16:02.467054+0000","172.21.15.179:6834/2573493377":"2024-09-14T17:16:02.467054+0000","192.168.0.1:0/3403128453":"2024-09-13T18:15:40.602047+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:06.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 msgr2=0x7fb95c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 0x7fb95c06d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb964034000 tx=0x7fb96402e000 comp rx=0 tx=0).stop 2024-09-13T17:16:06.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 msgr2=0x7fb9780994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00e870 tx=0x7fb96c00ed30 comp rx=0 tx=0).stop 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 shutdown_connections 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb97815a3e0 0x7fb9780b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9780ab5a0 0x7fb978071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb95c06ac00 0x7fb95c06d0c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 --2- 172.21.15.5:0/3622687852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97806c320 0x7fb9780994f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 >> 172.21.15.5:0/3622687852 conn(0x7fb9780ce0d0 msgr2=0x7fb9780abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 shutdown_connections 2024-09-13T17:16:06.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.789+0000 7fb97f012640 1 -- 172.21.15.5:0/3622687852 wait complete. 2024-09-13T17:16:06.802 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:06.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.905+0000 7fabecfa0640 1 Processor -- start 2024-09-13T17:16:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.905+0000 7fabecfa0640 1 -- start start 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabecfa0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabe815c450 0x7fabe80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabecfa0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe80d0fa0 0x7fabe80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabecfa0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80d01f0 con 0x7fabe80ceb30 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabecfa0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80cf4c0 con 0x7fabe815c450 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabecfa0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80cce70 con 0x7fabe80d0fa0 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabe815c450 0x7fabe80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabe815c450 0x7fabe80cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35902/0 (socket says 172.21.15.5:35902) 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe77fe640 1 -- 172.21.15.5:0/976258025 learned_addr learned my addr 172.21.15.5:0/976258025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe6ffd640 1 --1- 172.21.15.5:0/976258025 >> v1:172.21.15.5:6789/0 conn(0x7fabe80ceb30 0x7fabe80d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47936/0 (socket says 172.21.15.5:47936) 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe7fff640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe80d0fa0 0x7fabe80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe77fe640 1 -- 172.21.15.5:0/976258025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe80d0fa0 msgr2=0x7fabe80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.906+0000 7fabe77fe640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe80d0fa0 0x7fabe80cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe77fe640 1 -- 172.21.15.5:0/976258025 >> v1:172.21.15.5:6789/0 conn(0x7fabe80ceb30 legacy=0x7fabe80d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe67fc640 1 -- 172.21.15.5:0/976258025 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891053632 0 0) 0x7fabe80d01f0 con 0x7fabe80ceb30 2024-09-13T17:16:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe77fe640 1 -- 172.21.15.5:0/976258025 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80cf6d0 con 0x7fabe815c450 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe77fe640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe815c450 0x7fabe80cdbd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009870 tx=0x7fabd802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460fcb8b55ba45a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe67fc640 1 -- 172.21.15.5:0/976258025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8032440 con 0x7fabe815c450 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe67fc640 1 -- 172.21.15.5:0/976258025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80325a0 con 0x7fabe815c450 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.907+0000 7fabe67fc640 1 -- 172.21.15.5:0/976258025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8032930 con 0x7fabe815c450 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 -- 172.21.15.5:0/976258025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe815c450 msgr2=0x7fabe80cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe815c450 0x7fabe80cdbd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009870 tx=0x7fabd802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 -- 172.21.15.5:0/976258025 shutdown_connections 2024-09-13T17:16:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe80d0fa0 0x7fabe80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 --2- 172.21.15.5:0/976258025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe815c450 0x7fabe80cdbd0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 -- 172.21.15.5:0/976258025 >> 172.21.15.5:0/976258025 conn(0x7fabe809b660 msgr2=0x7fabe80d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 -- 172.21.15.5:0/976258025 shutdown_connections 2024-09-13T17:16:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.908+0000 7fabecfa0640 1 -- 172.21.15.5:0/976258025 wait complete. 2024-09-13T17:16:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.909+0000 7fabecfa0640 1 Processor -- start 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.909+0000 7fabecfa0640 1 -- start start 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe80ceb30 0x7fabe80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 0x7fabe814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814acd0 con 0x7fabe80d0fa0 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c6890 con 0x7fabe80ceb30 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabecfa0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c6b70 con 0x7fabe815c450 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabe6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabe6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35908/0 (socket says 172.21.15.5:35908) 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.910+0000 7fabe6ffd640 1 -- 172.21.15.5:0/30926259 learned_addr learned my addr 172.21.15.5:0/30926259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe77fe640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe80ceb30 0x7fabe80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe7fff640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 0x7fabe814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 -- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 msgr2=0x7fabe814a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 0x7fabe814a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 -- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe80ceb30 msgr2=0x7fabe80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe80ceb30 0x7fabe80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 -- 172.21.15.5:0/30926259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80094d0 con 0x7fabe80d0fa0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe7fff640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 0x7fabe814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabe6ffd640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c430 tx=0x7fabdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0074e0 con 0x7fabe80d0fa0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc007660 con 0x7fabe80d0fa0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe80c6e50 con 0x7fabe80d0fa0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc004a20 con 0x7fabe80d0fa0 2024-09-13T17:16:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.911+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80c7410 con 0x7fabe80d0fa0 2024-09-13T17:16:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.912+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe80c7630 con 0x7fabe80d0fa0 2024-09-13T17:16:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.913+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabdc004b80 con 0x7fabe80d0fa0 2024-09-13T17:16:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.913+0000 7fabcffff640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 0x7fabd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.913+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fabdc088f70 con 0x7fabe80d0fa0 2024-09-13T17:16:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.914+0000 7fabe77fe640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 0x7fabd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.914+0000 7fabe77fe640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 0x7fabd406d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fabd8034000 tx=0x7fabd802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:06.918+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabdc0bc9c0 con 0x7fabe80d0fa0 2024-09-13T17:16:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.088+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabe80d0dc0 con 0x7fabe80d0fa0 2024-09-13T17:16:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.088+0000 7fabcffff640 1 -- 172.21.15.5:0/30926259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabdc054320 con 0x7fabe80d0fa0 2024-09-13T17:16:07.091 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 msgr2=0x7fabd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 0x7fabd406d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fabd8034000 tx=0x7fabd802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 msgr2=0x7fabe814a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c430 tx=0x7fabdc00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 shutdown_connections 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabe815c450 0x7fabe814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd406ac00 0x7fabd406d0c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe80d0fa0 0x7fabe814a250 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 --2- 172.21.15.5:0/30926259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabe80ceb30 0x7fabe80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 >> 172.21.15.5:0/30926259 conn(0x7fabe809b660 msgr2=0x7fabe806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 shutdown_connections 2024-09-13T17:16:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.091+0000 7fabecfa0640 1 -- 172.21.15.5:0/30926259 wait complete. 2024-09-13T17:16:07.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-13T17:16:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.204+0000 7f111b11f640 1 Processor -- start 2024-09-13T17:16:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 -- start start 2024-09-13T17:16:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 0x7f11140cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11140d06d0 0x7f11140b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140d1e80 con 0x7f111415c810 2024-09-13T17:16:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11140d1750 con 0x7f11140d06d0 2024-09-13T17:16:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f111b11f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140d0bd0 con 0x7f11140b4cf0 2024-09-13T17:16:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.205+0000 7f11196bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11140d06d0 0x7f11140b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11140d06d0 0x7f11140b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35924/0 (socket says 172.21.15.5:35924) 2024-09-13T17:16:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 -- 172.21.15.5:0/1191069279 learned_addr learned my addr 172.21.15.5:0/1191069279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f1113fff640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 0x7f11140cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 -- 172.21.15.5:0/1191069279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 msgr2=0x7f11140cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 0x7f11140cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 -- 172.21.15.5:0/1191069279 >> v1:172.21.15.179:6789/0 conn(0x7f111415c810 legacy=0x7f11140b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f11196bc640 1 -- 172.21.15.5:0/1191069279 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140d0eb0 con 0x7f11140d06d0 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.206+0000 7f1113fff640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 0x7f11140cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f11196bc640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d06d0 0x7f11140b5a90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e50 tx=0x7f110c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245ef5ee1b4c8967 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f11137fe640 1 -- 172.21.15.5:0/1191069279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c031600 con 0x7f11140d06d0 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f11137fe640 1 -- 172.21.15.5:0/1191069279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c02d050 con 0x7f11140d06d0 2024-09-13T17:16:07.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f11137fe640 1 -- 172.21.15.5:0/1191069279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c031980 con 0x7f11140d06d0 2024-09-13T17:16:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 -- 172.21.15.5:0/1191069279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d06d0 msgr2=0x7f11140b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d06d0 0x7f11140b5a90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f110c009e50 tx=0x7f110c02a710 comp rx=0 tx=0).stop 2024-09-13T17:16:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 -- 172.21.15.5:0/1191069279 shutdown_connections 2024-09-13T17:16:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140d06d0 0x7f11140b5a90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 --2- 172.21.15.5:0/1191069279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b4cf0 0x7f11140cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 -- 172.21.15.5:0/1191069279 >> 172.21.15.5:0/1191069279 conn(0x7f11140717a0 msgr2=0x7f1114071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 -- 172.21.15.5:0/1191069279 shutdown_connections 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.207+0000 7f111b11f640 1 -- 172.21.15.5:0/1191069279 wait complete. 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.208+0000 7f111b11f640 1 Processor -- start 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 -- start start 2024-09-13T17:16:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 0x7f111415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415c810 0x7f111415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114158ae0 con 0x7f11140b4cf0 2024-09-13T17:16:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114158dc0 con 0x7f111415c810 2024-09-13T17:16:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f111b11f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11141590a0 con 0x7f11140d06d0 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.209+0000 7f1118ebb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35936/0 (socket says 172.21.15.5:35936) 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 -- 172.21.15.5:0/1202151901 learned_addr learned my addr 172.21.15.5:0/1202151901 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f11196bc640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415c810 0x7f111415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1113fff640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 0x7f111415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 -- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 msgr2=0x7f111415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 0x7f111415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 -- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415c810 msgr2=0x7f111415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415c810 0x7f111415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 -- 172.21.15.5:0/1202151901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009b30 con 0x7f11140b4cf0 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1113fff640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 0x7f111415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f1118ebb640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f110400c400 tx=0x7f110400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040052d0 con 0x7f11140b4cf0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104005430 con 0x7f11140b4cf0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104003830 con 0x7f11140b4cf0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114159380 con 0x7f11140b4cf0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.210+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11140b3c50 con 0x7f11140b4cf0 2024-09-13T17:16:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.211+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11140672a0 con 0x7f11140b4cf0 2024-09-13T17:16:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.212+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1104003990 con 0x7f11140b4cf0 2024-09-13T17:16:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.212+0000 7f11117fa640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.212+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7f1104088640 con 0x7f11140b4cf0 2024-09-13T17:16:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.212+0000 7f1113fff640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.213+0000 7f1113fff640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f11140c9050 tx=0x7f10fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.216+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1104053aa0 con 0x7f11140b4cf0 2024-09-13T17:16:07.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.456+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f111408a4c0 con 0x7f11140b4cf0 2024-09-13T17:16:07.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.491+0000 7f11117fa640 1 -- 172.21.15.5:0/1202151901 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v174) v1 ==== 145+0+0 (secure 0 0 0) 0x7f111408a4c0 con 0x7f11140b4cf0 2024-09-13T17:16:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 msgr2=0x7f10f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f11140c9050 tx=0x7f10fc008040 comp rx=0 tx=0).stop 2024-09-13T17:16:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 msgr2=0x7f11140b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f110400c400 tx=0x7f110400c8c0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 shutdown_connections 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415c810 0x7f111415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140d06d0 0x7f111415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 --2- 172.21.15.5:0/1202151901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b4cf0 0x7f11140b3710 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 >> 172.21.15.5:0/1202151901 conn(0x7f11140717a0 msgr2=0x7f1114071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 shutdown_connections 2024-09-13T17:16:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.494+0000 7f111b11f640 1 -- 172.21.15.5:0/1202151901 wait complete. 2024-09-13T17:16:07.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:16:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.609+0000 7fabc0cc9640 1 Processor -- start 2024-09-13T17:16:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.609+0000 7fabc0cc9640 1 -- start start 2024-09-13T17:16:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.610+0000 7fabc0cc9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabbc099110 0x7fabbc0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.610+0000 7fabc0cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.610+0000 7fabc0cc9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc0704a0 con 0x7fabbc15fd80 2024-09-13T17:16:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.610+0000 7fabc0cc9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc06cc10 con 0x7fabbc099110 2024-09-13T17:16:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.610+0000 7fabc0cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0d12e0 con 0x7fabbc0d0e30 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabbc099110 0x7fabbc0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabbad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabbc099110 0x7fabbc0cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38886/0 (socket says 172.21.15.5:38886) 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabbad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:47542/0 (socket says 172.21.15.5:47542) 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabba59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fabbc15fd80 0x7fabbc098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:59524/0 (socket says 172.21.15.5:59524) 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 -- 172.21.15.5:0/3185251087 learned_addr learned my addr 172.21.15.5:0/3185251087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 -- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 msgr2=0x7fabbc06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 -- 172.21.15.5:0/3185251087 >> v1:172.21.15.179:6789/0 conn(0x7fabbc15fd80 legacy=0x7fabbc098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabb9d9b640 1 -- 172.21.15.5:0/3185251087 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc06bd80 con 0x7fabbc099110 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.611+0000 7fabbad9d640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.612+0000 7fabb9d9b640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc0cfd30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c07c03371993df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.612+0000 7fabb959a640 1 -- 172.21.15.5:0/3185251087 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4032440 con 0x7fabbc099110 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.612+0000 7fabb959a640 1 -- 172.21.15.5:0/3185251087 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba40325a0 con 0x7fabbc099110 2024-09-13T17:16:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.612+0000 7fabb959a640 1 -- 172.21.15.5:0/3185251087 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4032930 con 0x7fabbc099110 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 -- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 msgr2=0x7fabbc0cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc0cfd30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 -- 172.21.15.5:0/3185251087 shutdown_connections 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc06e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/3185251087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc0cfd30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 -- 172.21.15.5:0/3185251087 >> 172.21.15.5:0/3185251087 conn(0x7fabbc0d0310 msgr2=0x7fabbc0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 -- 172.21.15.5:0/3185251087 shutdown_connections 2024-09-13T17:16:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.613+0000 7fabc0cc9640 1 -- 172.21.15.5:0/3185251087 wait complete. 2024-09-13T17:16:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.614+0000 7fabc0cc9640 1 Processor -- start 2024-09-13T17:16:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.614+0000 7fabc0cc9640 1 -- start start 2024-09-13T17:16:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0ae850 con 0x7fabbc15fd80 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0ad9a0 con 0x7fabbc099110 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabc0cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0adc40 con 0x7fabbc0d0e30 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35950/0 (socket says 172.21.15.5:35950) 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 -- 172.21.15.5:0/1283977997 learned_addr learned my addr 172.21.15.5:0/1283977997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabba59c640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabb9d9b640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 -- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 msgr2=0x7fabbc0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 -- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 msgr2=0x7fabbc149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabbad9d640 1 -- 172.21.15.5:0/1283977997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009400 con 0x7fabbc15fd80 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.615+0000 7fabba59c640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabbad9d640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fabb400e930 tx=0x7fabb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4009700 con 0x7fabbc15fd80 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400ca00 con 0x7fabbc15fd80 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40094d0 con 0x7fabbc15fd80 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400cd90 con 0x7fabbc15fd80 2024-09-13T17:16:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.616+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0ae200 con 0x7fabbc15fd80 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.617+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc06f9f0 con 0x7fabbc15fd80 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.617+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabb4013470 con 0x7fabbc15fd80 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.618+0000 7fabb2ffd640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 0x7fab9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.618+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fabb4089220 con 0x7fabbc15fd80 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.618+0000 7fabba59c640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 0x7fab9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.619+0000 7fabba59c640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 0x7fab9c06d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac0016d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.622+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabb40545a0 con 0x7fabbc15fd80 2024-09-13T17:16:07.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.793+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fabbc0cfa60 con 0x7fabbc15fd80 2024-09-13T17:16:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.796+0000 7fabb2ffd640 1 -- 172.21.15.5:0/1283977997 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabb4057bc0 con 0x7fabbc15fd80 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.798+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 msgr2=0x7fab9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.798+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 0x7fab9c06d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabac007fd0 tx=0x7fabac0016d0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 msgr2=0x7fabbc1465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fabb400e930 tx=0x7fabb400edf0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 shutdown_connections 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fab9c06ac00 0x7fab9c06d0c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabbc15fd80 0x7fabbc1465e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabbc0d0e30 0x7fabbc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 --2- 172.21.15.5:0/1283977997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc099110 0x7fabbc149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 >> 172.21.15.5:0/1283977997 conn(0x7fabbc0d0310 msgr2=0x7fabbc098a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 shutdown_connections 2024-09-13T17:16:07.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:07.799+0000 7fabc0cc9640 1 -- 172.21.15.5:0/1283977997 wait complete. 2024-09-13T17:16:07.812 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:16:07.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:16:07.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:16:07.895 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:16:07.895 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:16:07.896 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:07.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:16:07.913 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:07.913 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:07.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:16:07.955 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:16:07.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:07.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:16:07.972 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:07.972 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:08.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:16:08.013 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:16:08.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 Processor -- start 2024-09-13T17:16:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 -- start start 2024-09-13T17:16:08.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc140cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc140b4cf0 0x7fdc140b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140d1e80 con 0x7fdc140d06d0 2024-09-13T17:16:08.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140d1750 con 0x7fdc140b4cf0 2024-09-13T17:16:08.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.113+0000 7fdc1ad65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140d0bd0 con 0x7fdc1415c810 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc140b4cf0 0x7fdc140b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc140b4cf0 0x7fdc140b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35962/0 (socket says 172.21.15.5:35962) 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 -- 172.21.15.5:0/2300045142 learned_addr learned my addr 172.21.15.5:0/2300045142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc18b01640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc140cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 -- 172.21.15.5:0/2300045142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 msgr2=0x7fdc140cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc140cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 -- 172.21.15.5:0/2300045142 >> v1:172.21.15.179:6789/0 conn(0x7fdc140d06d0 legacy=0x7fdc140b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc19302640 1 -- 172.21.15.5:0/2300045142 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140d0eb0 con 0x7fdc140b4cf0 2024-09-13T17:16:08.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.114+0000 7fdc18b01640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc140cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc19302640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140b4cf0 0x7fdc140b5a90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009e50 tx=0x7fdc0c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca31262798d8010 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc137fe640 1 -- 172.21.15.5:0/2300045142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c02aea0 con 0x7fdc140b4cf0 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc137fe640 1 -- 172.21.15.5:0/2300045142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c02d050 con 0x7fdc140b4cf0 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc137fe640 1 -- 172.21.15.5:0/2300045142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c031820 con 0x7fdc140b4cf0 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 -- 172.21.15.5:0/2300045142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140b4cf0 msgr2=0x7fdc140b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140b4cf0 0x7fdc140b5a90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009e50 tx=0x7fdc0c02a6c0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 -- 172.21.15.5:0/2300045142 shutdown_connections 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140b4cf0 0x7fdc140b5a90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/2300045142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc140cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 -- 172.21.15.5:0/2300045142 >> 172.21.15.5:0/2300045142 conn(0x7fdc140717a0 msgr2=0x7fdc14071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 -- 172.21.15.5:0/2300045142 shutdown_connections 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.115+0000 7fdc1ad65640 1 -- 172.21.15.5:0/2300045142 wait complete. 2024-09-13T17:16:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.117+0000 7fdc1ad65640 1 Processor -- start 2024-09-13T17:16:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.117+0000 7fdc1ad65640 1 -- start start 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.117+0000 7fdc1ad65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc140b4cf0 0x7fdc141f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc14159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c8230 con 0x7fdc140d06d0 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f28c0 con 0x7fdc140b4cf0 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c7620 con 0x7fdc1415c810 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35970/0 (socket says 172.21.15.5:35970) 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 -- 172.21.15.5:0/1649007911 learned_addr learned my addr 172.21.15.5:0/1649007911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc19302640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc14159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc18b01640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc140b4cf0 0x7fdc141f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 -- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 msgr2=0x7fdc14159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc14159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 -- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc140b4cf0 msgr2=0x7fdc141f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc140b4cf0 0x7fdc141f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 -- 172.21.15.5:0/1649007911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c009b30 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc19302640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc14159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc13fff640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c430 tx=0x7fdc0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00011790 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc000118f0 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc140c7900 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00011ce0 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.118+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140c7ec0 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.119+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140c83e0 con 0x7fdc140d06d0 2024-09-13T17:16:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.120+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc0001c460 con 0x7fdc140d06d0 2024-09-13T17:16:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.120+0000 7fdc117fa640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 0x7fdbf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.120+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5392+0+0 (secure 0 0 0) 0x7fdc00089160 con 0x7fdc140d06d0 2024-09-13T17:16:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.121+0000 7fdc18b01640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 0x7fdbf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.121+0000 7fdc18b01640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 0x7fdbf806d0c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800aac0 tx=0x7fdc08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.125+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc140c83e0 con 0x7fdc140d06d0 2024-09-13T17:16:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.329+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc140672a0 con 0x7fdc140d06d0 2024-09-13T17:16:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.330+0000 7fdc117fa640 1 -- 172.21.15.5:0/1649007911 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fdc000543f0 con 0x7fdc140d06d0 2024-09-13T17:16:08.332 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:08.332 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1408650679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1408650679},{"type":"v1","addr":"172.21.15.5:6835","nonce":1408650679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2414556664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2414556664},{"type":"v1","addr":"172.21.15.179:6837","nonce":2414556664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/71481158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":71481158},{"type":"v1","addr":"172.21.15.179:6835","nonce":71481158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6567,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3903636990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3903636990},{"type":"v1","addr":"172.21.15.5:6834","nonce":3903636990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-09-13T17:16:08.332 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2024-09-13T17:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 msgr2=0x7fdbf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 0x7fdbf806d0c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800aac0 tx=0x7fdc08008040 comp rx=0 tx=0).stop 2024-09-13T17:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 msgr2=0x7fdc14155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c430 tx=0x7fdc0000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 shutdown_connections 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc1415c810 0x7fdc14159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdbf806ac00 0x7fdbf806d0c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc140d06d0 0x7fdc14155950 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 --2- 172.21.15.5:0/1649007911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc140b4cf0 0x7fdc141f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 >> 172.21.15.5:0/1649007911 conn(0x7fdc140717a0 msgr2=0x7fdc140ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 shutdown_connections 2024-09-13T17:16:08.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.332+0000 7fdc1ad65640 1 -- 172.21.15.5:0/1649007911 wait complete. 2024-09-13T17:16:08.345 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:16:08.346 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:16:08.346 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:16:08.346 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:08.346 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:16:08.346 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:16:08.347 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:16:08.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:08.347 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:16:08.347 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:16:08.347 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:16:08.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:08.347 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:16:08.347 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:16:08.348 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:16:08.348 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:08.355 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:16:08.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:16:08.356 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:16:08.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:16:08.360 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:16:08.360 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:16:08.361 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:16:08.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:16:08.398 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:16:08.399 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:08.399 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:16:08.399 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:08.402 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:16:08.402 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:08.403 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:16:08.403 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:08.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:16:08.475 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:16:08.475 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:16:08.485 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:16:08.488 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:16:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.510+0000 7f8d2dce9640 1 Processor -- start 2024-09-13T17:16:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 -- start start 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d2815c810 0x7f8d280cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280d06d0 0x7f8d280b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d280b4b20 0x7f8d280d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d280b4fb0 con 0x7f8d280b4b20 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d280d1e80 con 0x7f8d2815c810 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.511+0000 7f8d2dce9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280d1750 con 0x7f8d280d06d0 2024-09-13T17:16:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d280b4b20 0x7f8d280d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d280b4b20 0x7f8d280d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35996/0 (socket says 172.21.15.5:35996) 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 -- 172.21.15.5:0/1309551622 learned_addr learned my addr 172.21.15.5:0/1309551622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d1ffff640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280d06d0 0x7f8d280b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d277fe640 1 --2- 172.21.15.5:0/1309551622 >> v2:172.21.15.179:3300/0 conn(0x7f8d2815c810 0x7f8d280cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 -- 172.21.15.5:0/1309551622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280d06d0 msgr2=0x7f8d280b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280d06d0 0x7f8d280b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 -- 172.21.15.5:0/1309551622 >> v2:172.21.15.179:3300/0 conn(0x7f8d2815c810 msgr2=0x7f8d280cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 --2- 172.21.15.5:0/1309551622 >> v2:172.21.15.179:3300/0 conn(0x7f8d2815c810 0x7f8d280cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.512+0000 7f8d27fff640 1 -- 172.21.15.5:0/1309551622 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d280d0bd0 con 0x7f8d280b4b20 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d27fff640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280b4b20 0x7f8d280d26b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8d28072540 tx=0x7f8d2002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8510a233f9fe304 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d26ffd640 1 -- 172.21.15.5:0/1309551622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031600 con 0x7f8d280b4b20 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d26ffd640 1 -- 172.21.15.5:0/1309551622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2002d050 con 0x7f8d280b4b20 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d26ffd640 1 -- 172.21.15.5:0/1309551622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031980 con 0x7f8d280b4b20 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 -- 172.21.15.5:0/1309551622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280b4b20 msgr2=0x7f8d280d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280b4b20 0x7f8d280d26b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8d28072540 tx=0x7f8d2002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 -- 172.21.15.5:0/1309551622 shutdown_connections 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280b4b20 0x7f8d280d26b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/1309551622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280d06d0 0x7f8d280b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/1309551622 >> v2:172.21.15.179:3300/0 conn(0x7f8d2815c810 0x7f8d280cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.513+0000 7f8d2dce9640 1 -- 172.21.15.5:0/1309551622 >> 172.21.15.5:0/1309551622 conn(0x7f8d280717a0 msgr2=0x7f8d28071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.514+0000 7f8d2dce9640 1 -- 172.21.15.5:0/1309551622 shutdown_connections 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.514+0000 7f8d2dce9640 1 -- 172.21.15.5:0/1309551622 wait complete. 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.515+0000 7f8d2dce9640 1 Processor -- start 2024-09-13T17:16:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.515+0000 7f8d2dce9640 1 -- start start 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.515+0000 7f8d2dce9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280b4b20 0x7f8d28145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.515+0000 7f8d2dce9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d2dce9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2815c810 0x7f8d28152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d2dce9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280ccbc0 con 0x7f8d280d06d0 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d2dce9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28153350 con 0x7f8d2815c810 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d2dce9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28146040 con 0x7f8d280b4b20 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36006/0 (socket says 172.21.15.5:36006) 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 -- 172.21.15.5:0/950957226 learned_addr learned my addr 172.21.15.5:0/950957226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d277fe640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280b4b20 0x7f8d28145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d27fff640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2815c810 0x7f8d28152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 -- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280b4b20 msgr2=0x7f8d28145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280b4b20 0x7f8d28145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 -- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2815c810 msgr2=0x7f8d28152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2815c810 0x7f8d28152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 -- 172.21.15.5:0/950957226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009b30 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.516+0000 7f8d1ffff640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000e890 tx=0x7f8d1000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.518+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1000c940 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.518+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d28146320 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.518+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d281468e0 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.519+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1000caa0 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.519+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1000ce10 con 0x7f8d280d06d0 2024-09-13T17:16:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.520+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d280672a0 con 0x7f8d280d06d0 2024-09-13T17:16:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.520+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d10013470 con 0x7f8d280d06d0 2024-09-13T17:16:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.521+0000 7f8d24ff9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 0x7f8d0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.521+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5392+0+0 (secure 0 0 0) 0x7f8d100896f0 con 0x7f8d280d06d0 2024-09-13T17:16:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.521+0000 7f8d277fe640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 0x7f8d0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.522+0000 7f8d277fe640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 0x7f8d0806d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009aa0 tx=0x7f8d18009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:08.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.525+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d10054a40 con 0x7f8d280d06d0 2024-09-13T17:16:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:08.707+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8d28152da0 con 0x7f8d280d06d0 2024-09-13T17:16:09.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.531+0000 7f8d24ff9640 1 -- 172.21.15.5:0/950957226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d10058060 con 0x7f8d280d06d0 2024-09-13T17:16:09.534 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:16:09.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 msgr2=0x7f8d0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 0x7f8d0806d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009aa0 tx=0x7f8d18009190 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 msgr2=0x7f8d280cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000e890 tx=0x7f8d1000ed50 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 shutdown_connections 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d2815c810 0x7f8d28152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8d0806ac00 0x7f8d0806d0c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d280d06d0 0x7f8d280cc680 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 --2- 172.21.15.5:0/950957226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d280b4b20 0x7f8d28145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 >> 172.21.15.5:0/950957226 conn(0x7f8d280717a0 msgr2=0x7f8d28071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 shutdown_connections 2024-09-13T17:16:09.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.534+0000 7f8d2dce9640 1 -- 172.21.15.5:0/950957226 wait complete. 2024-09-13T17:16:09.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:16:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.656+0000 7f41c6a41640 1 Processor -- start 2024-09-13T17:16:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.656+0000 7f41c6a41640 1 -- start start 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41c6a41640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c006a5a0 0x7f41c00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41c6a41640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41c6a41640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00ac650 con 0x7f41c0143740 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41c6a41640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c0144100 con 0x7f41c006a5a0 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41c6a41640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0143b20 con 0x7f41c015aaa0 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.657+0000 7f41b7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c006a5a0 0x7f41c00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41c4fde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41bffff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f41c0143740 0x7f41c0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:59566/0 (socket says 172.21.15.5:59566) 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41bffff640 1 -- 172.21.15.5:0/778007050 learned_addr learned my addr 172.21.15.5:0/778007050 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41b7fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c006a5a0 0x7f41c00ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:38964/0 (socket says 172.21.15.5:38964) 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41b7fff640 1 -- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 msgr2=0x7f41c00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41b7fff640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41b7fff640 1 -- 172.21.15.5:0/778007050 >> v1:172.21.15.179:6789/0 conn(0x7f41c0143740 legacy=0x7f41c0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41b7fff640 1 -- 172.21.15.5:0/778007050 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00b2130 con 0x7f41c006a5a0 2024-09-13T17:16:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.658+0000 7f41c4fde640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.659+0000 7f41b7fff640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c006a5a0 0x7f41c00ae580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41a80097a0 tx=0x7f41a802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=409a8136bcc9861e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.659+0000 7f41bf7fe640 1 -- 172.21.15.5:0/778007050 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8032440 con 0x7f41c006a5a0 2024-09-13T17:16:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.659+0000 7f41bf7fe640 1 -- 172.21.15.5:0/778007050 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a80325a0 con 0x7f41c006a5a0 2024-09-13T17:16:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.659+0000 7f41bf7fe640 1 -- 172.21.15.5:0/778007050 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8032930 con 0x7f41c006a5a0 2024-09-13T17:16:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 -- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c006a5a0 msgr2=0x7f41c00ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c006a5a0 0x7f41c00ae580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41a80097a0 tx=0x7f41a802a210 comp rx=0 tx=0).stop 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 -- 172.21.15.5:0/778007050 shutdown_connections 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 --2- 172.21.15.5:0/778007050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c006a5a0 0x7f41c00ae580 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 -- 172.21.15.5:0/778007050 >> 172.21.15.5:0/778007050 conn(0x7f41c00b4650 msgr2=0x7f41c00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 -- 172.21.15.5:0/778007050 shutdown_connections 2024-09-13T17:16:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.660+0000 7f41c6a41640 1 -- 172.21.15.5:0/778007050 wait complete. 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.661+0000 7f41c6a41640 1 Processor -- start 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.661+0000 7f41c6a41640 1 -- start start 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 0x7f41c0141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c009b560 con 0x7f41c006a5a0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0099430 con 0x7f41c0143740 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c6a41640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0099710 con 0x7f41c015aaa0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36018/0 (socket says 172.21.15.5:36018) 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 -- 172.21.15.5:0/111358252 learned_addr learned my addr 172.21.15.5:0/111358252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41b7fff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 0x7f41c0141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c4fde640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 -- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 msgr2=0x7f41c00c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 -- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 msgr2=0x7f41c0141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 0x7f41c0141080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 -- 172.21.15.5:0/111358252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8009a70 con 0x7f41c006a5a0 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41b7fff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 0x7f41c0141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41c4fde640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.662+0000 7f41bffff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c450 tx=0x7f41b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.663+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0005ce0 con 0x7f41c006a5a0 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.663+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b0005e40 con 0x7f41c006a5a0 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.663+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a8009400 con 0x7f41c006a5a0 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.663+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00072b0 con 0x7f41c006a5a0 2024-09-13T17:16:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.663+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c009b1a0 con 0x7f41c006a5a0 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.664+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c0099290 con 0x7f41c006a5a0 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.664+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41b0007410 con 0x7f41c006a5a0 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.665+0000 7f41bd7fa640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 0x7f41a006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.665+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f41b0088420 con 0x7f41c006a5a0 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.665+0000 7f41b7fff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 0x7f41a006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.665+0000 7f41b7fff640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 0x7f41a006d0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f41a8034000 tx=0x7f41a802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.669+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41c0099290 con 0x7f41c006a5a0 2024-09-13T17:16:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.906+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f41c0099c30 con 0x7f41c006a5a0 2024-09-13T17:16:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.906+0000 7f41bd7fa640 1 -- 172.21.15.5:0/111358252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f41c0099c30 con 0x7f41c006a5a0 2024-09-13T17:16:09.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:09.908 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.909 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:16:09.911 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.912 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.913 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:16:09.914 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.915 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:16:09.916 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:16:09.917 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:16:09.918 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:16:09.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:16:09.921 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:16:09.922 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:16:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 msgr2=0x7f41a006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 0x7f41a006d0f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f41a8034000 tx=0x7f41a802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 msgr2=0x7f41c009ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c450 tx=0x7f41b000c910 comp rx=0 tx=0).stop 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 shutdown_connections 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c015aaa0 0x7f41c00c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c0143740 0x7f41c0141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41a006ac30 0x7f41a006d0f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 --2- 172.21.15.5:0/111358252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c006a5a0 0x7f41c009ac60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 >> 172.21.15.5:0/111358252 conn(0x7f41c00b4650 msgr2=0x7f41c0069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 shutdown_connections 2024-09-13T17:16:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:09.908+0000 7f41c6a41640 1 -- 172.21.15.5:0/111358252 wait complete. 2024-09-13T17:16:09.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.024+0000 7f26fa11f640 1 Processor -- start 2024-09-13T17:16:10.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.024+0000 7f26fa11f640 1 -- start start 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26fa11f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26f406e090 0x7f26f40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26fa11f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26f40ab5a0 0x7f26f40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26fa11f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40ab9f0 con 0x7f26f415a3e0 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26fa11f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f406e4d0 con 0x7f26f406e090 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26fa11f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f406d410 con 0x7f26f40ab5a0 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26f406e090 0x7f26f40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26f406e090 0x7f26f40ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36032/0 (socket says 172.21.15.5:36032) 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 -- 172.21.15.5:0/3822814440 learned_addr learned my addr 172.21.15.5:0/3822814440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f3fff640 1 --2- 172.21.15.5:0/3822814440 >> v2:172.21.15.179:3300/0 conn(0x7f26f40ab5a0 0x7f26f40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 -- 172.21.15.5:0/3822814440 >> v2:172.21.15.179:3300/0 conn(0x7f26f40ab5a0 msgr2=0x7f26f40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 --2- 172.21.15.5:0/3822814440 >> v2:172.21.15.179:3300/0 conn(0x7f26f40ab5a0 0x7f26f40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 -- 172.21.15.5:0/3822814440 >> v1:172.21.15.179:6789/0 conn(0x7f26f415a3e0 legacy=0x7f26f406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.025+0000 7f26f2ffd640 1 -- 172.21.15.5:0/3822814440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f406cb70 con 0x7f26f406e090 2024-09-13T17:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.026+0000 7f26f2ffd640 1 --2- 172.21.15.5:0/3822814440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f406e090 0x7f26f40ab060 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26f406b990 tx=0x7f26e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0365a20bffb160 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.026+0000 7f26f27fc640 1 -- 172.21.15.5:0/3822814440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8032440 con 0x7f26f406e090 2024-09-13T17:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.026+0000 7f26f27fc640 1 -- 172.21.15.5:0/3822814440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e80325a0 con 0x7f26f406e090 2024-09-13T17:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.026+0000 7f26f27fc640 1 -- 172.21.15.5:0/3822814440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8032930 con 0x7f26f406e090 2024-09-13T17:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 -- 172.21.15.5:0/3822814440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f406e090 msgr2=0x7f26f40ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 --2- 172.21.15.5:0/3822814440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f406e090 0x7f26f40ab060 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26f406b990 tx=0x7f26e802a230 comp rx=0 tx=0).stop 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 -- 172.21.15.5:0/3822814440 shutdown_connections 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 --2- 172.21.15.5:0/3822814440 >> v2:172.21.15.179:3300/0 conn(0x7f26f40ab5a0 0x7f26f40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 --2- 172.21.15.5:0/3822814440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f406e090 0x7f26f40ab060 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 -- 172.21.15.5:0/3822814440 >> 172.21.15.5:0/3822814440 conn(0x7f26f40ce0d0 msgr2=0x7f26f40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 -- 172.21.15.5:0/3822814440 shutdown_connections 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.027+0000 7f26fa11f640 1 -- 172.21.15.5:0/3822814440 wait complete. 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.028+0000 7f26fa11f640 1 Processor -- start 2024-09-13T17:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.028+0000 7f26fa11f640 1 -- start start 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 0x7f26f4149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 0x7f26f41e6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f414a400 con 0x7f26f415a3e0 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f41e6b70 con 0x7f26f406e090 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26fa11f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f415c910 con 0x7f26f40ab5a0 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36038/0 (socket says 172.21.15.5:36038) 2024-09-13T17:16:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 -- 172.21.15.5:0/1300525184 learned_addr learned my addr 172.21.15.5:0/1300525184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f2ffd640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 0x7f26f41e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f37fe640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 0x7f26f4149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 -- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 msgr2=0x7f26f41e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 0x7f26f41e6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 -- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 msgr2=0x7f26f4149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 0x7f26f4149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f3fff640 1 -- 172.21.15.5:0/1300525184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80094d0 con 0x7f26f415a3e0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f37fe640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 0x7f26f4149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.029+0000 7f26f2ffd640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 0x7f26f41e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26f3fff640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00cd70 tx=0x7f26ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec003b90 con 0x7f26f415a3e0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec003cf0 con 0x7f26f415a3e0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f415cbf0 con 0x7f26f415a3e0 2024-09-13T17:16:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec004240 con 0x7f26f415a3e0 2024-09-13T17:16:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.030+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f4151050 con 0x7f26f415a3e0 2024-09-13T17:16:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.031+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f415d110 con 0x7f26f415a3e0 2024-09-13T17:16:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.031+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26ec0043a0 con 0x7f26f415a3e0 2024-09-13T17:16:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.032+0000 7f26dbfff640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 0x7f26e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.032+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f26ec012070 con 0x7f26f415a3e0 2024-09-13T17:16:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.032+0000 7f26f37fe640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 0x7f26e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.033+0000 7f26f37fe640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 0x7f26e006d0c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26f40cd970 tx=0x7f26e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.036+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26ec054fa0 con 0x7f26f415a3e0 2024-09-13T17:16:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.207+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26f4150eb0 con 0x7f26f415a3e0 2024-09-13T17:16:10.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.208+0000 7f26dbfff640 1 -- 172.21.15.5:0/1300525184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+13026 (secure 0 0 0) 0x7f26f4150eb0 con 0x7f26f415a3e0 2024-09-13T17:16:10.210 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:10.210 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:09.529822+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 msgr2=0x7f26e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 0x7f26e006d0c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26f40cd970 tx=0x7f26e4008040 comp rx=0 tx=0).stop 2024-09-13T17:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 msgr2=0x7f26f415ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00cd70 tx=0x7f26ec00a660 comp rx=0 tx=0).stop 2024-09-13T17:16:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 shutdown_connections 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f26e006ac00 0x7f26e006d0c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f415a3e0 0x7f26f415ba40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26f40ab5a0 0x7f26f41e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 --2- 172.21.15.5:0/1300525184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26f406e090 0x7f26f4149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 >> 172.21.15.5:0/1300525184 conn(0x7f26f40ce0d0 msgr2=0x7f26f415db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 shutdown_connections 2024-09-13T17:16:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.210+0000 7f26fa11f640 1 -- 172.21.15.5:0/1300525184 wait complete. 2024-09-13T17:16:10.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:10.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:10.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.326+0000 7f38b1f3e640 1 Processor -- start 2024-09-13T17:16:10.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.326+0000 7f38b1f3e640 1 -- start start 2024-09-13T17:16:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38b1f3e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38ac157e20 0x7f38ac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38b1f3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 0x7f38ac06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38b1f3e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac06c520 con 0x7f38ac06c090 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38b1f3e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac15b900 con 0x7f38ac157e20 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38b1f3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac06db00 con 0x7f38ac0ad720 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38ab7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f38ac157e20 0x7f38ac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38abfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 0x7f38ac06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38aaffd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f38ac06c090 0x7f38ac0ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:59580/0 (socket says 172.21.15.5:59580) 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38aaffd640 1 -- 172.21.15.5:0/2967573747 learned_addr learned my addr 172.21.15.5:0/2967573747 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38aa7fc640 1 -- 172.21.15.5:0/2967573747 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244715540 0 0) 0x7f38ac06c520 con 0x7f38ac06c090 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38aa7fc640 1 -- 172.21.15.5:0/2967573747 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3894003520 con 0x7f38ac06c090 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38ab7fe640 1 -- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 msgr2=0x7f38ac06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38ab7fe640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 0x7f38ac06d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38ab7fe640 1 -- 172.21.15.5:0/2967573747 >> v1:172.21.15.179:6789/0 conn(0x7f38ac06c090 legacy=0x7f38ac0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38ab7fe640 1 -- 172.21.15.5:0/2967573747 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac06c800 con 0x7f38ac157e20 2024-09-13T17:16:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.327+0000 7f38abfff640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 0x7f38ac06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.328+0000 7f38ab7fe640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac15b3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f389c0097a0 tx=0x7f389c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd6d806f0a96aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.328+0000 7f38aa7fc640 1 -- 172.21.15.5:0/2967573747 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c032440 con 0x7f38ac157e20 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.328+0000 7f38aa7fc640 1 -- 172.21.15.5:0/2967573747 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c0325a0 con 0x7f38ac157e20 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.328+0000 7f38aa7fc640 1 -- 172.21.15.5:0/2967573747 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c032930 con 0x7f38ac157e20 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 -- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 msgr2=0x7f38ac15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac15b3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f389c0097a0 tx=0x7f389c02a180 comp rx=0 tx=0).stop 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 -- 172.21.15.5:0/2967573747 shutdown_connections 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac0ad720 0x7f38ac06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/2967573747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac15b3c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 -- 172.21.15.5:0/2967573747 >> 172.21.15.5:0/2967573747 conn(0x7f38ac0ce130 msgr2=0x7f38ac0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 -- 172.21.15.5:0/2967573747 shutdown_connections 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.329+0000 7f38b1f3e640 1 -- 172.21.15.5:0/2967573747 wait complete. 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.330+0000 7f38b1f3e640 1 Processor -- start 2024-09-13T17:16:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.330+0000 7f38b1f3e640 1 -- start start 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac14e9a0 0x7f38ac153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac151e20 con 0x7f38ac0ad720 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac152100 con 0x7f38ac157e20 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38b1f3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac1523e0 con 0x7f38ac14e9a0 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36040/0 (socket says 172.21.15.5:36040) 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38ab7fe640 1 -- 172.21.15.5:0/1419449129 learned_addr learned my addr 172.21.15.5:0/1419449129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38abfff640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac14e9a0 0x7f38ac153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.331+0000 7f38aaffd640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 -- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac14e9a0 msgr2=0x7f38ac153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac14e9a0 0x7f38ac153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 -- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 msgr2=0x7f38ac1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 -- 172.21.15.5:0/1419449129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009a70 con 0x7f38ac0ad720 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38ab7fe640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f389c0098c0 tx=0x7f389c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c03e920 con 0x7f38ac0ad720 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c03eaa0 con 0x7f38ac0ad720 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c009400 con 0x7f38ac0ad720 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c03ee50 con 0x7f38ac0ad720 2024-09-13T17:16:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.332+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac1529a0 con 0x7f38ac0ad720 2024-09-13T17:16:10.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.333+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac0672a0 con 0x7f38ac0ad720 2024-09-13T17:16:10.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.334+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f389c03c400 con 0x7f38ac0ad720 2024-09-13T17:16:10.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.334+0000 7f3893fff640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 0x7f389806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.334+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f389c0a9ff0 con 0x7f38ac0ad720 2024-09-13T17:16:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.334+0000 7f38aaffd640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 0x7f389806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.335+0000 7f38aaffd640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 0x7f389806d0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f38ac1e46e0 tx=0x7f38a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.338+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f389c075470 con 0x7f38ac0ad720 2024-09-13T17:16:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.508+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38ac157680 con 0x7f38ac0ad720 2024-09-13T17:16:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.508+0000 7f3893fff640 1 -- 172.21.15.5:0/1419449129 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f389c078a90 con 0x7f38ac0ad720 2024-09-13T17:16:10.511 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 msgr2=0x7f389806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 0x7f389806d0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f38ac1e46e0 tx=0x7f38a0009040 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 msgr2=0x7f38ac097220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f389c0098c0 tx=0x7f389c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 shutdown_connections 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38ac14e9a0 0x7f38ac153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38ac157e20 0x7f38ac1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f389806ac00 0x7f389806d0c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 --2- 172.21.15.5:0/1419449129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38ac0ad720 0x7f38ac097220 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 >> 172.21.15.5:0/1419449129 conn(0x7f38ac0ce130 msgr2=0x7f38ac15d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 shutdown_connections 2024-09-13T17:16:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.510+0000 7f38b1f3e640 1 -- 172.21.15.5:0/1419449129 wait complete. 2024-09-13T17:16:10.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:16:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.622+0000 7f5fa63e9640 1 Processor -- start 2024-09-13T17:16:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.622+0000 7f5fa63e9640 1 -- start start 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5fa015c810 0x7f5fa00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fa00d06d0 0x7f5fa00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa00d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00b4f70 con 0x7f5fa00d06d0 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00d1e80 con 0x7f5fa015c810 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa63e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00d1750 con 0x7f5fa00b4b20 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fa00d06d0 0x7f5fa00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fa00d06d0 0x7f5fa00b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36050/0 (socket says 172.21.15.5:36050) 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 -- 172.21.15.5:0/3751420017 learned_addr learned my addr 172.21.15.5:0/3751420017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5fa4986640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa00d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9ffff640 1 --2- 172.21.15.5:0/3751420017 >> v2:172.21.15.179:3300/0 conn(0x7f5fa015c810 0x7f5fa00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 -- 172.21.15.5:0/3751420017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 msgr2=0x7f5fa00d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa00d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 -- 172.21.15.5:0/3751420017 >> v2:172.21.15.179:3300/0 conn(0x7f5fa015c810 msgr2=0x7f5fa00cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 --2- 172.21.15.5:0/3751420017 >> v2:172.21.15.179:3300/0 conn(0x7f5fa015c810 0x7f5fa00cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.623+0000 7f5f9f7fe640 1 -- 172.21.15.5:0/3751420017 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00d0bd0 con 0x7f5fa00d06d0 2024-09-13T17:16:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.624+0000 7f5f9f7fe640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa00d06d0 0x7f5fa00b45e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0072540 tx=0x7f5f9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef439c5ac29c91c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.624+0000 7f5f9effd640 1 -- 172.21.15.5:0/3751420017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94032440 con 0x7f5fa00d06d0 2024-09-13T17:16:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.624+0000 7f5f9effd640 1 -- 172.21.15.5:0/3751420017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f940325a0 con 0x7f5fa00d06d0 2024-09-13T17:16:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.624+0000 7f5f9effd640 1 -- 172.21.15.5:0/3751420017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94032930 con 0x7f5fa00d06d0 2024-09-13T17:16:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 -- 172.21.15.5:0/3751420017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa00d06d0 msgr2=0x7f5fa00b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa00d06d0 0x7f5fa00b45e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0072540 tx=0x7f5f9402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 -- 172.21.15.5:0/3751420017 shutdown_connections 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa00d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/3751420017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa00d06d0 0x7f5fa00b45e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/3751420017 >> v2:172.21.15.179:3300/0 conn(0x7f5fa015c810 0x7f5fa00cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 -- 172.21.15.5:0/3751420017 >> 172.21.15.5:0/3751420017 conn(0x7f5fa00717a0 msgr2=0x7f5fa0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 -- 172.21.15.5:0/3751420017 shutdown_connections 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.625+0000 7f5fa63e9640 1 -- 172.21.15.5:0/3751420017 wait complete. 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.626+0000 7f5fa63e9640 1 Processor -- start 2024-09-13T17:16:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.626+0000 7f5fa63e9640 1 -- start start 2024-09-13T17:16:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa01f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa00d06d0 0x7f5fa014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014cc20 con 0x7f5fa015c810 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00c9380 con 0x7f5fa00d06d0 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa63e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa01f6510 con 0x7f5fa00b4b20 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa4986640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa4986640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36064/0 (socket says 172.21.15.5:36064) 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5fa4986640 1 -- 172.21.15.5:0/1169298132 learned_addr learned my addr 172.21.15.5:0/1169298132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5f9ffff640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa01f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.627+0000 7f5f9f7fe640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa00d06d0 0x7f5fa014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 -- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 msgr2=0x7f5fa01f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa01f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 -- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa00d06d0 msgr2=0x7f5fa014f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa00d06d0 0x7f5fa014f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 -- 172.21.15.5:0/1169298132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940094d0 con 0x7f5fa015c810 2024-09-13T17:16:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa4986640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5f98007e60 tx=0x7f5f9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98014620 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9800ee90 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa01f5c70 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980149e0 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.628+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa01f6230 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.629+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa014cd60 con 0x7f5fa015c810 2024-09-13T17:16:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.629+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f98014b40 con 0x7f5fa015c810 2024-09-13T17:16:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.630+0000 7f5f9cff9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.630+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5f980899a0 con 0x7f5fa015c810 2024-09-13T17:16:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.630+0000 7f5f9ffff640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.630+0000 7f5f9ffff640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5f900079a0 tx=0x7f5f90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.634+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5fa014cd60 con 0x7f5fa015c810 2024-09-13T17:16:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.807+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5fa014cd60 con 0x7f5fa015c810 2024-09-13T17:16:10.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.807+0000 7f5f9cff9640 1 -- 172.21.15.5:0/1169298132 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5fa014cd60 con 0x7f5fa015c810 2024-09-13T17:16:10.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:10.809 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:16:10.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:16:10.810 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:16:10.810 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:16:10.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:10.810 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:16:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 msgr2=0x7f5f8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5f900079a0 tx=0x7f5f90008040 comp rx=0 tx=0).stop 2024-09-13T17:16:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 msgr2=0x7f5fa00c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5f98007e60 tx=0x7f5f9800e4b0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 shutdown_connections 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fa015c810 0x7f5fa00c8e40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa00d06d0 0x7f5fa014f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 --2- 172.21.15.5:0/1169298132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa00b4b20 0x7f5fa01f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 >> 172.21.15.5:0/1169298132 conn(0x7f5fa00717a0 msgr2=0x7f5fa0071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 shutdown_connections 2024-09-13T17:16:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.809+0000 7f5fa63e9640 1 -- 172.21.15.5:0/1169298132 wait complete. 2024-09-13T17:16:10.822 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:16:10.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:16:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.926+0000 7f645828b640 1 Processor -- start 2024-09-13T17:16:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.926+0000 7f645828b640 1 -- start start 2024-09-13T17:16:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f645828b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 0x7f645006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f645828b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645006e070 con 0x7f645015b000 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f645828b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645015b540 con 0x7f64500ab060 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f645828b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645015b820 con 0x7f6450151290 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456828640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f645015b000 0x7f64500b1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47954/0 (socket says 172.21.15.5:47954) 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456828640 1 -- 172.21.15.5:0/3698419282 learned_addr learned my addr 172.21.15.5:0/3698419282 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456027640 1 --2- 172.21.15.5:0/3698419282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 0x7f645006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813098064 0 0) 0x7f645006e070 con 0x7f645015b000 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f643c003520 con 0x7f645015b000 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566071769 0 0) 0x7f645015b540 con 0x7f64500ab060 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f645006e070 con 0x7f64500ab060 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3205701229 0 0) 0x7f643c003520 con 0x7f645015b000 2024-09-13T17:16:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456027640 1 -- 172.21.15.5:0/3698419282 >> v1:172.21.15.179:6789/0 conn(0x7f64500ab060 legacy=0x7f645015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456027640 1 -- 172.21.15.5:0/3698419282 >> v1:172.21.15.5:6789/0 conn(0x7f645015b000 legacy=0x7f64500b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.927+0000 7f6456027640 1 -- 172.21.15.5:0/3698419282 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645006c350 con 0x7f6450151290 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.928+0000 7f6456027640 1 --2- 172.21.15.5:0/3698419282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 0x7f645006ce30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097d0 tx=0x7f644c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e4c02b2e78e6db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.928+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480019f0 con 0x7f6450151290 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c02ac30 con 0x7f6450151290 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f6455025640 1 -- 172.21.15.5:0/3698419282 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c032440 con 0x7f6450151290 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 -- 172.21.15.5:0/3698419282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 msgr2=0x7f645006ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 --2- 172.21.15.5:0/3698419282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 0x7f645006ce30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097d0 tx=0x7f644c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 -- 172.21.15.5:0/3698419282 shutdown_connections 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 --2- 172.21.15.5:0/3698419282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6450151290 0x7f645006ce30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 -- 172.21.15.5:0/3698419282 >> 172.21.15.5:0/3698419282 conn(0x7f64500ce0f0 msgr2=0x7f64500ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 -- 172.21.15.5:0/3698419282 shutdown_connections 2024-09-13T17:16:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.929+0000 7f645828b640 1 -- 172.21.15.5:0/3698419282 wait complete. 2024-09-13T17:16:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.930+0000 7f645828b640 1 Processor -- start 2024-09-13T17:16:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.930+0000 7f645828b640 1 -- start start 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 0x7f6450151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 0x7f6450153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64501554c0 con 0x7f6450151290 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450149b20 con 0x7f64500ab060 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f645828b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64500712d0 con 0x7f645015b000 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f6455826640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f6455826640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36074/0 (socket says 172.21.15.5:36074) 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f6455826640 1 -- 172.21.15.5:0/210986620 learned_addr learned my addr 172.21.15.5:0/210986620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f6456828640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 0x7f6450153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.931+0000 7f6456027640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 0x7f6450151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 -- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 msgr2=0x7f6450153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 0x7f6450153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 -- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 msgr2=0x7f6450151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 0x7f6450151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 -- 172.21.15.5:0/210986620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c009400 con 0x7f6450151290 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6456828640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 0x7f6450153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6456027640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 0x7f6450151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6455826640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f644000c450 tx=0x7f644000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400052d0 con 0x7f6450151290 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440005430 con 0x7f6450151290 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64500715b0 con 0x7f6450151290 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012870 con 0x7f6450151290 2024-09-13T17:16:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.932+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450071b70 con 0x7f6450151290 2024-09-13T17:16:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.933+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64500672a0 con 0x7f6450151290 2024-09-13T17:16:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.934+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64400129d0 con 0x7f6450151290 2024-09-13T17:16:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.934+0000 7f6446ffd640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 0x7f643406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.934+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6440088cd0 con 0x7f6450151290 2024-09-13T17:16:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.934+0000 7f6456027640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 0x7f643406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.935+0000 7f6456027640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 0x7f643406d0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f644c034000 tx=0x7f644c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:10.939+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6440054180 con 0x7f6450151290 2024-09-13T17:16:11.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.110+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6450071d30 con 0x7f6450151290 2024-09-13T17:16:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.538+0000 7f6446ffd640 1 -- 172.21.15.5:0/210986620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) v1 ==== 138+0+0 (secure 0 0 0) 0x7f64400577a0 con 0x7f6450151290 2024-09-13T17:16:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 msgr2=0x7f643406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 0x7f643406d0c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f644c034000 tx=0x7f644c02e000 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 msgr2=0x7f6450070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f644000c450 tx=0x7f644000c910 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 shutdown_connections 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f645015b000 0x7f6450153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f643406ac00 0x7f643406d0c0 secure :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f644c034000 tx=0x7f644c02e000 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6450151290 0x7f6450070a80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 --2- 172.21.15.5:0/210986620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64500ab060 0x7f6450151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.541+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 >> 172.21.15.5:0/210986620 conn(0x7f64500ce0f0 msgr2=0x7f64500af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.542+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 shutdown_connections 2024-09-13T17:16:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.542+0000 7f645828b640 1 -- 172.21.15.5:0/210986620 wait complete. 2024-09-13T17:16:11.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.664+0000 7fd957501640 1 Processor -- start 2024-09-13T17:16:11.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 -- start start 2024-09-13T17:16:11.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9500cf000 0x7fd9500cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd9501669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500cf980 con 0x7fd95015c6e0 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500ce570 con 0x7fd9500cf000 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.665+0000 7fd957501640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500d0630 con 0x7fd9501645e0 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd95529d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd95015c6e0 0x7fd9500cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47960/0 (socket says 172.21.15.5:47960) 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd95529d640 1 -- 172.21.15.5:0/1867967774 learned_addr learned my addr 172.21.15.5:0/1867967774 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447237285 0 0) 0x7fd9500cf980 con 0x7fd95015c6e0 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd954a9c640 1 --2- 172.21.15.5:0/1867967774 >> v2:172.21.15.179:3300/0 conn(0x7fd9500cf000 0x7fd9500cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd938003520 con 0x7fd95015c6e0 2024-09-13T17:16:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd955a9e640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd9501669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934779184 0 0) 0x7fd938003520 con 0x7fd95015c6e0 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 msgr2=0x7fd9501669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd9501669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 >> v2:172.21.15.179:3300/0 conn(0x7fd9500cf000 msgr2=0x7fd9500cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 --2- 172.21.15.5:0/1867967774 >> v2:172.21.15.179:3300/0 conn(0x7fd9500cf000 0x7fd9500cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500d0910 con 0x7fd95015c6e0 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd9400019f0 con 0x7fd95015c6e0 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 >> v1:172.21.15.5:6789/0 conn(0x7fd95015c6e0 legacy=0x7fd9500cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd938003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd938003ef0 0x7fd9380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938004d00 0x7fd938005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500ce570 con 0x7fd938003ef0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500d0630 con 0x7fd938004d00 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93800b980 con 0x7fd9501645e0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd954a9c640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd938003ef0 0x7fd9380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd95529d640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd938003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.666+0000 7fd955a9e640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938004d00 0x7fd938005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 -- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 msgr2=0x7fd938003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9501645e0 0x7fd938003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 -- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938004d00 msgr2=0x7fd938005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938004d00 0x7fd938005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 -- 172.21.15.5:0/1867967774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938003520 con 0x7fd938003ef0 2024-09-13T17:16:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd955a9e640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938004d00 0x7fd938005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.667+0000 7fd954a9c640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd938003ef0 0x7fd9380047c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd944009ac0 tx=0x7fd9380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2e376b89b95f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944031400 con 0x7fd938003ef0 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94402d050 con 0x7fd938003ef0 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd94ffff640 1 -- 172.21.15.5:0/1867967774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944031780 con 0x7fd938003ef0 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 -- 172.21.15.5:0/1867967774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd938003ef0 msgr2=0x7fd9380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 --2- 172.21.15.5:0/1867967774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd938003ef0 0x7fd9380047c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd944009ac0 tx=0x7fd9380057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd955a9e640 1 -- 172.21.15.5:0/1867967774 reap_dead start 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 -- 172.21.15.5:0/1867967774 shutdown_connections 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 -- 172.21.15.5:0/1867967774 >> 172.21.15.5:0/1867967774 conn(0x7fd950089f90 msgr2=0x7fd9500d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 -- 172.21.15.5:0/1867967774 shutdown_connections 2024-09-13T17:16:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.668+0000 7fd957501640 1 -- 172.21.15.5:0/1867967774 wait complete. 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.669+0000 7fd957501640 1 Processor -- start 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.669+0000 7fd957501640 1 -- start start 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd938003ef0 0x7fd950155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd950163720 0x7fd950160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950157410 con 0x7fd9501632a0 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950157c10 con 0x7fd950163720 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd957501640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd950156800 con 0x7fd938003ef0 2024-09-13T17:16:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36082/0 (socket says 172.21.15.5:36082) 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 -- 172.21.15.5:0/835648549 learned_addr learned my addr 172.21.15.5:0/835648549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 -- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd938003ef0 msgr2=0x7fd950155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd938003ef0 0x7fd950155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 -- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd950163720 msgr2=0x7fd950160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.670+0000 7fd954a9c640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd950163720 0x7fd950160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd954a9c640 1 -- 172.21.15.5:0/835648549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950156ae0 con 0x7fd9501632a0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd954a9c640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd94402aaf0 tx=0x7fd944004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944003bd0 con 0x7fd9501632a0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944003d30 con 0x7fd9501632a0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd950156dc0 con 0x7fd9501632a0 2024-09-13T17:16:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944003ea0 con 0x7fd9501632a0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.671+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950156490 con 0x7fd9501632a0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.672+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500672e0 con 0x7fd9501632a0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.673+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd944038070 con 0x7fd9501632a0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.673+0000 7fd94dffb640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 0x7fd93c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.673+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fd9440a9360 con 0x7fd9501632a0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.674+0000 7fd95529d640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 0x7fd93c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.674+0000 7fd95529d640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 0x7fd93c06d0f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd9400013d0 tx=0x7fd940001360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.678+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9440745f0 con 0x7fd9501632a0 2024-09-13T17:16:11.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:11.850+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd950157550 con 0x7fd9501632a0 2024-09-13T17:16:12.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:16:12.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:16:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.546+0000 7fd94dffb640 1 -- 172.21.15.5:0/835648549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd950157550 con 0x7fd9501632a0 2024-09-13T17:16:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:16:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.557+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 msgr2=0x7fd93c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.557+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 0x7fd93c06d0f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd9400013d0 tx=0x7fd940001360 comp rx=0 tx=0).stop 2024-09-13T17:16:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.557+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 msgr2=0x7fd950160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.557+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd94402aaf0 tx=0x7fd944004730 comp rx=0 tx=0).stop 2024-09-13T17:16:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.558+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 shutdown_connections 2024-09-13T17:16:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.558+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd950163720 0x7fd950160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.558+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd93c06ac30 0x7fd93c06d0f0 secure :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd9400013d0 tx=0x7fd940001360 comp rx=0 tx=0).stop 2024-09-13T17:16:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.558+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9501632a0 0x7fd950160250 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.558+0000 7fd957501640 1 --2- 172.21.15.5:0/835648549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd938003ef0 0x7fd950155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.559+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 >> 172.21.15.5:0/835648549 conn(0x7fd950089f90 msgr2=0x7fd9500b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.559+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 shutdown_connections 2024-09-13T17:16:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.560+0000 7fd957501640 1 -- 172.21.15.5:0/835648549 wait complete. 2024-09-13T17:16:12.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:16:12.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.752+0000 7f14bcd1f640 1 Processor -- start 2024-09-13T17:16:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.752+0000 7f14bcd1f640 1 -- start start 2024-09-13T17:16:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b815c6e0 0x7f14b80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14b80cf000 0x7f14b80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14b81602c0 0x7f14b8160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80cf980 con 0x7f14b81602c0 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80d0630 con 0x7f14b80cf000 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14bcd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80d0910 con 0x7f14b815c6e0 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.753+0000 7f14b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14b81602c0 0x7f14b8160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14b81602c0 0x7f14b8160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36092/0 (socket says 172.21.15.5:36092) 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 -- 172.21.15.5:0/2134926958 learned_addr learned my addr 172.21.15.5:0/2134926958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b5d9b640 1 --2- 172.21.15.5:0/2134926958 >> v2:172.21.15.179:3300/0 conn(0x7f14b80cf000 0x7f14b80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b659c640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b815c6e0 0x7f14b80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 -- 172.21.15.5:0/2134926958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b815c6e0 msgr2=0x7f14b80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b815c6e0 0x7f14b80cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 -- 172.21.15.5:0/2134926958 >> v2:172.21.15.179:3300/0 conn(0x7f14b80cf000 msgr2=0x7f14b80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 --2- 172.21.15.5:0/2134926958 >> v2:172.21.15.179:3300/0 conn(0x7f14b80cf000 0x7f14b80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.754+0000 7f14b6d9d640 1 -- 172.21.15.5:0/2134926958 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80d0bf0 con 0x7f14b81602c0 2024-09-13T17:16:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14b6d9d640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b81602c0 0x7f14b8160770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f14b808c140 tx=0x7f14b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d931c1153e57ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14b559a640 1 -- 172.21.15.5:0/2134926958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0032440 con 0x7f14b81602c0 2024-09-13T17:16:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14b559a640 1 -- 172.21.15.5:0/2134926958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b00325a0 con 0x7f14b81602c0 2024-09-13T17:16:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14b559a640 1 -- 172.21.15.5:0/2134926958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0032930 con 0x7f14b81602c0 2024-09-13T17:16:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 -- 172.21.15.5:0/2134926958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b81602c0 msgr2=0x7f14b8160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b81602c0 0x7f14b8160770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f14b808c140 tx=0x7f14b002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 -- 172.21.15.5:0/2134926958 shutdown_connections 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b81602c0 0x7f14b8160770 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/2134926958 >> v2:172.21.15.179:3300/0 conn(0x7f14b80cf000 0x7f14b80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/2134926958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b815c6e0 0x7f14b80cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 -- 172.21.15.5:0/2134926958 >> 172.21.15.5:0/2134926958 conn(0x7f14b8089f90 msgr2=0x7f14b80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 -- 172.21.15.5:0/2134926958 shutdown_connections 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.755+0000 7f14bcd1f640 1 -- 172.21.15.5:0/2134926958 wait complete. 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.757+0000 7f14bcd1f640 1 Processor -- start 2024-09-13T17:16:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.757+0000 7f14bcd1f640 1 -- start start 2024-09-13T17:16:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14b815c6e0 0x7f14b80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b81602c0 0x7f14b815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815d9f0 con 0x7f14b80cf000 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81593e0 con 0x7f14b815c6e0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b815f100 con 0x7f14b81602c0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36102/0 (socket says 172.21.15.5:36102) 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 -- 172.21.15.5:0/1445718023 learned_addr learned my addr 172.21.15.5:0/1445718023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b5d9b640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14b815c6e0 0x7f14b80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b6d9d640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b81602c0 0x7f14b815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 -- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b81602c0 msgr2=0x7f14b815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b81602c0 0x7f14b815cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 -- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14b815c6e0 msgr2=0x7f14b80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14b815c6e0 0x7f14b80c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 -- 172.21.15.5:0/1445718023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00094d0 con 0x7f14b80cf000 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14b659c640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f14a800ce10 tx=0x7f14a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8003b90 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a8003cf0 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b815f3e0 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8003ea0 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.758+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b815f9a0 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.759+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b80672e0 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.760+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14a8004240 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.760+0000 7f14aeffd640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.760+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f14a8012070 con 0x7f14b80cf000 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.760+0000 7f14b5d9b640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:12.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.761+0000 7f14b5d9b640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 0x7f149806d0c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.765+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f14a8054ea0 con 0x7f14b80cf000 2024-09-13T17:16:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.970+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f14b80d01c0 con 0x7f14b80cf000 2024-09-13T17:16:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 9 and data pool 10 2024-09-13T17:16:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.975+0000 7f14aeffd640 1 -- 172.21.15.5:0/1445718023 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f14a80584c0 con 0x7f14b80cf000 2024-09-13T17:16:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.979+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 msgr2=0x7f149806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.979+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 0x7f149806d0c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0008040 comp rx=0 tx=0).stop 2024-09-13T17:16:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.979+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 msgr2=0x7f14b8158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.979+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f14a800ce10 tx=0x7f14a800a660 comp rx=0 tx=0).stop 2024-09-13T17:16:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 shutdown_connections 2024-09-13T17:16:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14b81602c0 0x7f14b815cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14b815c6e0 0x7f14b80c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f149806ac00 0x7f149806d0c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 --2- 172.21.15.5:0/1445718023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b80cf000 0x7f14b8158ea0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.986+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 >> 172.21.15.5:0/1445718023 conn(0x7f14b8089f90 msgr2=0x7f14b80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.989+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 shutdown_connections 2024-09-13T17:16:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:12.989+0000 7f14bcd1f640 1 -- 172.21.15.5:0/1445718023 wait complete. 2024-09-13T17:16:13.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.108+0000 7f4c2a227640 1 Processor -- start 2024-09-13T17:16:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.108+0000 7f4c2a227640 1 -- start start 2024-09-13T17:16:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c2a227640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 0x7f4c2406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c2a227640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c240b32e0 0x7f4c240acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c2a227640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c241597a0 con 0x7f4c240b26e0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c2a227640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240ac870 con 0x7f4c240b32e0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c2a227640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2406e610 con 0x7f4c241593c0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c22ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4c240b26e0 0x7f4c240b2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47972/0 (socket says 172.21.15.5:47972) 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c22ffd640 1 -- 172.21.15.5:0/2227687261 learned_addr learned my addr 172.21.15.5:0/2227687261 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c23fff640 1 --2- 172.21.15.5:0/2227687261 >> v2:172.21.15.179:3300/0 conn(0x7f4c240b32e0 0x7f4c240acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c237fe640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 0x7f4c2406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c227fc640 1 -- 172.21.15.5:0/2227687261 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408245756 0 0) 0x7f4c241597a0 con 0x7f4c240b26e0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c227fc640 1 -- 172.21.15.5:0/2227687261 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c0c003520 con 0x7f4c240b26e0 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c23fff640 1 -- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 msgr2=0x7f4c2406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c23fff640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 0x7f4c2406dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c23fff640 1 -- 172.21.15.5:0/2227687261 >> v1:172.21.15.5:6789/0 conn(0x7f4c240b26e0 legacy=0x7f4c240b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c23fff640 1 -- 172.21.15.5:0/2227687261 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2406e8f0 con 0x7f4c240b32e0 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.109+0000 7f4c237fe640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 0x7f4c2406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.110+0000 7f4c23fff640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c240b32e0 0x7f4c240acd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009d90 tx=0x7f4c1c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeee2086eb7d3ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.110+0000 7f4c227fc640 1 -- 172.21.15.5:0/2227687261 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c031600 con 0x7f4c240b32e0 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.110+0000 7f4c227fc640 1 -- 172.21.15.5:0/2227687261 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c02d050 con 0x7f4c240b32e0 2024-09-13T17:16:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.110+0000 7f4c227fc640 1 -- 172.21.15.5:0/2227687261 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c031960 con 0x7f4c240b32e0 2024-09-13T17:16:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 -- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c240b32e0 msgr2=0x7f4c240acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c240b32e0 0x7f4c240acd30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009d90 tx=0x7f4c1c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 -- 172.21.15.5:0/2227687261 shutdown_connections 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c240b32e0 0x7f4c240acd30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2227687261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c241593c0 0x7f4c2406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 -- 172.21.15.5:0/2227687261 >> 172.21.15.5:0/2227687261 conn(0x7f4c240b4650 msgr2=0x7f4c240b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 -- 172.21.15.5:0/2227687261 shutdown_connections 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.111+0000 7f4c2a227640 1 -- 172.21.15.5:0/2227687261 wait complete. 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.112+0000 7f4c2a227640 1 Processor -- start 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.112+0000 7f4c2a227640 1 -- start start 2024-09-13T17:16:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c240b32e0 0x7f4c2409c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c241593c0 0x7f4c2415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2409b3a0 con 0x7f4c240b26e0 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2409d4b0 con 0x7f4c241593c0 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c2a227640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2409ad20 con 0x7f4c240b32e0 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36116/0 (socket says 172.21.15.5:36116) 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 -- 172.21.15.5:0/2713552279 learned_addr learned my addr 172.21.15.5:0/2713552279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 -- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c240b32e0 msgr2=0x7f4c2409c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c240b32e0 0x7f4c2409c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 -- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c241593c0 msgr2=0x7f4c2415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c241593c0 0x7f4c2415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.113+0000 7f4c237fe640 1 -- 172.21.15.5:0/2713552279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009400 con 0x7f4c240b26e0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c237fe640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400ebe0 tx=0x7f4c1400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14009760 con 0x7f4c240b26e0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1400cc30 con 0x7f4c240b26e0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c009a70 con 0x7f4c240b26e0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400eee0 con 0x7f4c240b26e0 2024-09-13T17:16:13.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.114+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2409d1d0 con 0x7f4c240b26e0 2024-09-13T17:16:13.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.115+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c24066fd0 con 0x7f4c240b26e0 2024-09-13T17:16:13.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.115+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4c14013470 con 0x7f4c240b26e0 2024-09-13T17:16:13.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.116+0000 7f4c0bfff640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 0x7f4c1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.116+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c14089800 con 0x7f4c240b26e0 2024-09-13T17:16:13.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.116+0000 7f4c22ffd640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 0x7f4c1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.117+0000 7f4c22ffd640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 0x7f4c1006d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000f60 tx=0x7f4c180078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.120+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4c14054890 con 0x7f4c240b26e0 2024-09-13T17:16:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.294+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c240672a0 con 0x7f4c240b26e0 2024-09-13T17:16:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.295+0000 7f4c0bfff640 1 -- 172.21.15.5:0/2713552279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f4c14057eb0 con 0x7f4c240b26e0 2024-09-13T17:16:13.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:13.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:12.971239+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 msgr2=0x7f4c1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 0x7f4c1006d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000f60 tx=0x7f4c180078f0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 msgr2=0x7f4c2409b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400ebe0 tx=0x7f4c1400c520 comp rx=0 tx=0).stop 2024-09-13T17:16:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 shutdown_connections 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c241593c0 0x7f4c2415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c240b32e0 0x7f4c2409c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c1006ac00 0x7f4c1006d0c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 --2- 172.21.15.5:0/2713552279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c240b26e0 0x7f4c2409b7c0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 >> 172.21.15.5:0/2713552279 conn(0x7f4c240b4650 msgr2=0x7f4c240acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 shutdown_connections 2024-09-13T17:16:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.297+0000 7f4c2a227640 1 -- 172.21.15.5:0/2713552279 wait complete. 2024-09-13T17:16:13.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:13.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.409+0000 7f2a99301640 1 Processor -- start 2024-09-13T17:16:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.409+0000 7f2a99301640 1 -- start start 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.410+0000 7f2a99301640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a940ccdc0 0x7f2a940cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.410+0000 7f2a99301640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940701d0 con 0x7f2a940cd8b0 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.410+0000 7f2a99301640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a940cfc70 con 0x7f2a9406e420 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.410+0000 7f2a99301640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940704b0 con 0x7f2a940ccdc0 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a92ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a940ccdc0 0x7f2a940cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a937fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a940cd8b0 0x7f2a940b32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44826/0 (socket says 172.21.15.5:44826) 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a937fe640 1 -- 172.21.15.5:0/1247098051 learned_addr learned my addr 172.21.15.5:0/1247098051 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a92ffd640 1 -- 172.21.15.5:0/1247098051 >> v1:172.21.15.179:6789/0 conn(0x7f2a9406e420 legacy=0x7f2a940cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a92ffd640 1 -- 172.21.15.5:0/1247098051 >> v1:172.21.15.5:6789/0 conn(0x7f2a940cd8b0 legacy=0x7f2a940b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a92ffd640 1 -- 172.21.15.5:0/1247098051 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940cff50 con 0x7f2a940ccdc0 2024-09-13T17:16:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.411+0000 7f2a91ffb640 1 -- 172.21.15.5:0/1247098051 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529465832 0 0) 0x7f2a940701d0 con 0x7f2a940cd8b0 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a92ffd640 1 --2- 172.21.15.5:0/1247098051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940ccdc0 0x7f2a940cf060 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009d90 tx=0x7f2a8402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111316c1b429eb99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a91ffb640 1 -- 172.21.15.5:0/1247098051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84007740 con 0x7f2a940ccdc0 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a91ffb640 1 -- 172.21.15.5:0/1247098051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8402d050 con 0x7f2a940ccdc0 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a91ffb640 1 -- 172.21.15.5:0/1247098051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84007ac0 con 0x7f2a940ccdc0 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 -- 172.21.15.5:0/1247098051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940ccdc0 msgr2=0x7f2a940cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 --2- 172.21.15.5:0/1247098051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940ccdc0 0x7f2a940cf060 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009d90 tx=0x7f2a8402a730 comp rx=0 tx=0).stop 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 -- 172.21.15.5:0/1247098051 shutdown_connections 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 --2- 172.21.15.5:0/1247098051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940ccdc0 0x7f2a940cf060 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 -- 172.21.15.5:0/1247098051 >> 172.21.15.5:0/1247098051 conn(0x7f2a940b1fa0 msgr2=0x7f2a940b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 -- 172.21.15.5:0/1247098051 shutdown_connections 2024-09-13T17:16:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.412+0000 7f2a99301640 1 -- 172.21.15.5:0/1247098051 wait complete. 2024-09-13T17:16:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.414+0000 7f2a99301640 1 Processor -- start 2024-09-13T17:16:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.414+0000 7f2a99301640 1 -- start start 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.414+0000 7f2a99301640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a9406e420 0x7f2a941e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.414+0000 7f2a99301640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a940ccdc0 0x7f2a941457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a941573f0 con 0x7f2a940cd8b0 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94145ce0 con 0x7f2a940ccdc0 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a941e32f0 con 0x7f2a9406e420 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58650/0 (socket says 172.21.15.5:58650) 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 -- 172.21.15.5:0/2937407621 learned_addr learned my addr 172.21.15.5:0/2937407621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a927fc640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a940ccdc0 0x7f2a941457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a92ffd640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a9406e420 0x7f2a941e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 -- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a9406e420 msgr2=0x7f2a941e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a9406e420 0x7f2a941e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 -- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a940ccdc0 msgr2=0x7f2a941457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a940ccdc0 0x7f2a941457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 -- 172.21.15.5:0/2937407621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84009a70 con 0x7f2a940cd8b0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a937fe640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0074e0 con 0x7f2a940cd8b0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c007660 con 0x7f2a940cd8b0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a941e5a60 con 0x7f2a940cd8b0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c004a20 con 0x7f2a940cd8b0 2024-09-13T17:16:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.415+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9406bd30 con 0x7f2a940cd8b0 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.417+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9406bf50 con 0x7f2a940cd8b0 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.417+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a8c004b80 con 0x7f2a940cd8b0 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.417+0000 7f2a8b7fe640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 0x7f2a7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.418+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a8c0888e0 con 0x7f2a940cd8b0 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.418+0000 7f2a92ffd640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 0x7f2a7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.418+0000 7f2a92ffd640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 0x7f2a7406d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2a84034000 tx=0x7f2a8402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.422+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a8c053b80 con 0x7f2a940cd8b0 2024-09-13T17:16:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.594+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a941e5e00 con 0x7f2a940cd8b0 2024-09-13T17:16:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.595+0000 7f2a8b7fe640 1 -- 172.21.15.5:0/2937407621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f2a8c018020 con 0x7f2a940cd8b0 2024-09-13T17:16:13.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:13.596 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:12.971239+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 msgr2=0x7f2a7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 0x7f2a7406d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2a84034000 tx=0x7f2a8402f000 comp rx=0 tx=0).stop 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 msgr2=0x7f2a9406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).stop 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 shutdown_connections 2024-09-13T17:16:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a7406ac00 0x7f2a7406d0c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a940cd8b0 0x7f2a9406c250 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a940ccdc0 0x7f2a941457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 --2- 172.21.15.5:0/2937407621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a9406e420 0x7f2a941e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 >> 172.21.15.5:0/2937407621 conn(0x7f2a940b1fa0 msgr2=0x7f2a94099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 shutdown_connections 2024-09-13T17:16:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.597+0000 7f2a99301640 1 -- 172.21.15.5:0/2937407621 wait complete. 2024-09-13T17:16:13.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:16:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.712+0000 7f966a75e640 1 Processor -- start 2024-09-13T17:16:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.712+0000 7f966a75e640 1 -- start start 2024-09-13T17:16:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f966a75e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f966415e930 0x7f96640cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f966a75e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96640ccc70 con 0x7f966406aea0 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f966a75e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96640b1ff0 con 0x7f966415a060 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f966a75e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966415eda0 con 0x7f966415e930 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f965bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f966415e930 0x7f96640cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f9668cfb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f966406aea0 0x7f966415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44830/0 (socket says 172.21.15.5:44830) 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f9668cfb640 1 -- 172.21.15.5:0/1390777444 learned_addr learned my addr 172.21.15.5:0/1390777444 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.713+0000 7f965bfff640 1 -- 172.21.15.5:0/1390777444 >> v1:172.21.15.179:6789/0 conn(0x7f966415a060 legacy=0x7f96640b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f965bfff640 1 -- 172.21.15.5:0/1390777444 >> v1:172.21.15.5:6789/0 conn(0x7f966406aea0 legacy=0x7f966415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f96637fe640 1 -- 172.21.15.5:0/1390777444 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072202906 0 0) 0x7f965c001490 con 0x7f966406aea0 2024-09-13T17:16:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f965bfff640 1 -- 172.21.15.5:0/1390777444 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640cd470 con 0x7f966415e930 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f965bfff640 1 --2- 172.21.15.5:0/1390777444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415e930 0x7f96640cc730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097d0 tx=0x7f964c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bffd62be293e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f96637fe640 1 -- 172.21.15.5:0/1390777444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c02ae90 con 0x7f966415e930 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f96637fe640 1 -- 172.21.15.5:0/1390777444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c032440 con 0x7f966415e930 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.714+0000 7f96637fe640 1 -- 172.21.15.5:0/1390777444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c0327d0 con 0x7f966415e930 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 -- 172.21.15.5:0/1390777444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415e930 msgr2=0x7f96640cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 --2- 172.21.15.5:0/1390777444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415e930 0x7f96640cc730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097d0 tx=0x7f964c02a180 comp rx=0 tx=0).stop 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 -- 172.21.15.5:0/1390777444 shutdown_connections 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 --2- 172.21.15.5:0/1390777444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966415e930 0x7f96640cc730 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 -- 172.21.15.5:0/1390777444 >> 172.21.15.5:0/1390777444 conn(0x7f9664070af0 msgr2=0x7f9664070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 -- 172.21.15.5:0/1390777444 shutdown_connections 2024-09-13T17:16:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.715+0000 7f966a75e640 1 -- 172.21.15.5:0/1390777444 wait complete. 2024-09-13T17:16:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.716+0000 7f966a75e640 1 Processor -- start 2024-09-13T17:16:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.716+0000 7f966a75e640 1 -- start start 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966415a060 0x7f96641524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f966415e930 0x7f9664158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96641596b0 con 0x7f966406aea0 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96640a8090 con 0x7f966415e930 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f966a75e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664158a30 con 0x7f966415a060 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58680/0 (socket says 172.21.15.5:58680) 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 -- 172.21.15.5:0/3977860409 learned_addr learned my addr 172.21.15.5:0/3977860409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 -- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966415a060 msgr2=0x7f96641524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966415a060 0x7f96641524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 -- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f966415e930 msgr2=0x7f9664158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9668cfb640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f966415e930 0x7f9664158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.717+0000 7f9663fff640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f966415e930 0x7f9664158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f9663fff640 1 -- 172.21.15.5:0/3977860409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c009400 con 0x7f966406aea0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f9663fff640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f965400c410 tx=0x7f965400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96540035f0 con 0x7f966406aea0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654003750 con 0x7f966406aea0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664158d10 con 0x7f966406aea0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654003b40 con 0x7f966406aea0 2024-09-13T17:16:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.718+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96641592d0 con 0x7f966406aea0 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.719+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96640672e0 con 0x7f966406aea0 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.719+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9654003ca0 con 0x7f966406aea0 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.720+0000 7f96617fa640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 0x7f964406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.720+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9654088b00 con 0x7f966406aea0 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.720+0000 7f965bfff640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 0x7f964406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.721+0000 7f965bfff640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 0x7f964406d0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.724+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9654053c30 con 0x7f966406aea0 2024-09-13T17:16:13.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.930+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f96640cc730 con 0x7f966406aea0 2024-09-13T17:16:13.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.979+0000 7f96617fa640 1 -- 172.21.15.5:0/3977860409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9654017020 con 0x7f966406aea0 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 msgr2=0x7f964406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 0x7f964406d0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c02c000 comp rx=0 tx=0).stop 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 msgr2=0x7f96640a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f965400c410 tx=0x7f965400c8d0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 shutdown_connections 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f966415e930 0x7f9664158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f966415a060 0x7f96641524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f964406ac00 0x7f964406d0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 --2- 172.21.15.5:0/3977860409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f966406aea0 0x7f96640a8c00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.981+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 >> 172.21.15.5:0/3977860409 conn(0x7f9664070af0 msgr2=0x7f966415d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.982+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 shutdown_connections 2024-09-13T17:16:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:13.982+0000 7f966a75e640 1 -- 172.21.15.5:0/3977860409 wait complete. 2024-09-13T17:16:13.993 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:16:13.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:16:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.096+0000 7f553435e640 1 Processor -- start 2024-09-13T17:16:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.096+0000 7f553435e640 1 -- start start 2024-09-13T17:16:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f552c15c6e0 0x7f552c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c0cf000 0x7f552c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f552c1602c0 0x7f552c160750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0cf980 con 0x7f552c1602c0 2024-09-13T17:16:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0d0630 con 0x7f552c15c6e0 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.097+0000 7f553435e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0d0910 con 0x7f552c0cf000 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f552c1602c0 0x7f552c160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f552c1602c0 0x7f552c160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58692/0 (socket says 172.21.15.5:58692) 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 -- 172.21.15.5:0/774337239 learned_addr learned my addr 172.21.15.5:0/774337239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55318f9640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c0cf000 0x7f552c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55320fa640 1 --2- 172.21.15.5:0/774337239 >> v2:172.21.15.179:3300/0 conn(0x7f552c15c6e0 0x7f552c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 -- 172.21.15.5:0/774337239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c0cf000 msgr2=0x7f552c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c0cf000 0x7f552c0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 -- 172.21.15.5:0/774337239 >> v2:172.21.15.179:3300/0 conn(0x7f552c15c6e0 msgr2=0x7f552c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 --2- 172.21.15.5:0/774337239 >> v2:172.21.15.179:3300/0 conn(0x7f552c15c6e0 0x7f552c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.098+0000 7f55328fb640 1 -- 172.21.15.5:0/774337239 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0d0bf0 con 0x7f552c1602c0 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f55328fb640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c160750 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f552c0b51b0 tx=0x7f552402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed141c7fd28ca43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f55310f8640 1 -- 172.21.15.5:0/774337239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524031600 con 0x7f552c1602c0 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f55310f8640 1 -- 172.21.15.5:0/774337239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552402d050 con 0x7f552c1602c0 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f55310f8640 1 -- 172.21.15.5:0/774337239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524031980 con 0x7f552c1602c0 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 -- 172.21.15.5:0/774337239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 msgr2=0x7f552c160750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c160750 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f552c0b51b0 tx=0x7f552402a6a0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 -- 172.21.15.5:0/774337239 shutdown_connections 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c160750 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 --2- 172.21.15.5:0/774337239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c0cf000 0x7f552c0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 --2- 172.21.15.5:0/774337239 >> v2:172.21.15.179:3300/0 conn(0x7f552c15c6e0 0x7f552c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.099+0000 7f553435e640 1 -- 172.21.15.5:0/774337239 >> 172.21.15.5:0/774337239 conn(0x7f552c089f90 msgr2=0x7f552c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.100+0000 7f553435e640 1 -- 172.21.15.5:0/774337239 shutdown_connections 2024-09-13T17:16:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.100+0000 7f553435e640 1 -- 172.21.15.5:0/774337239 wait complete. 2024-09-13T17:16:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 Processor -- start 2024-09-13T17:16:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 -- start start 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f552c0cf000 0x7f552c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c15c6e0 0x7f552c0b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0b4ed0 con 0x7f552c1602c0 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0c6a90 con 0x7f552c0cf000 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.101+0000 7f553435e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c06c970 con 0x7f552c15c6e0 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58694/0 (socket says 172.21.15.5:58694) 2024-09-13T17:16:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 -- 172.21.15.5:0/872209570 learned_addr learned my addr 172.21.15.5:0/872209570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55318f9640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c15c6e0 0x7f552c0b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55320fa640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f552c0cf000 0x7f552c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 -- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c15c6e0 msgr2=0x7f552c0b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c15c6e0 0x7f552c0b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 -- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f552c0cf000 msgr2=0x7f552c158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f552c0cf000 0x7f552c158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 -- 172.21.15.5:0/872209570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009b30 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f55328fb640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5524034040 tx=0x7f5524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552403d860 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552403d9e0 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c0c6160 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552403dd90 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.102+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c0c6720 con 0x7f552c1602c0 2024-09-13T17:16:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.103+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c0672e0 con 0x7f552c1602c0 2024-09-13T17:16:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.104+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f552403b400 con 0x7f552c1602c0 2024-09-13T17:16:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.104+0000 7f5522ffd640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 0x7f551006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.105+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f55240aa4a0 con 0x7f552c1602c0 2024-09-13T17:16:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.105+0000 7f55320fa640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 0x7f551006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.105+0000 7f55320fa640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 0x7f551006d0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5528006fd0 tx=0x7f5528008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.109+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55240754a0 con 0x7f552c1602c0 2024-09-13T17:16:14.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.315+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f552c0c6c20 con 0x7f552c1602c0 2024-09-13T17:16:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.980+0000 7f5522ffd640 1 -- 172.21.15.5:0/872209570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5524009510 con 0x7f552c1602c0 2024-09-13T17:16:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 msgr2=0x7f551006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 0x7f551006d0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5528006fd0 tx=0x7f5528008040 comp rx=0 tx=0).stop 2024-09-13T17:16:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 msgr2=0x7f552c0b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5524034040 tx=0x7f5524004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 shutdown_connections 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f551006ac30 0x7f551006d0f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f552c1602c0 0x7f552c0b6f70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f552c15c6e0 0x7f552c0b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 --2- 172.21.15.5:0/872209570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f552c0cf000 0x7f552c158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 >> 172.21.15.5:0/872209570 conn(0x7f552c089f90 msgr2=0x7f552c0730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 shutdown_connections 2024-09-13T17:16:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:14.983+0000 7f553435e640 1 -- 172.21.15.5:0/872209570 wait complete. 2024-09-13T17:16:14.997 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:16:14.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.105+0000 7f5be6c12640 1 Processor -- start 2024-09-13T17:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.105+0000 7f5be6c12640 1 -- start start 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be6c12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be015ff70 0x7f5be00b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be6c12640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5be00b15b0 0x7f5be00cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be6c12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00b0be0 con 0x7f5be015fb90 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be6c12640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00affd0 con 0x7f5be00b15b0 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be6c12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00b02b0 con 0x7f5be015ff70 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be51af640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5be00b15b0 0x7f5be00cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be49ae640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5be015fb90 0x7f5be00b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44834/0 (socket says 172.21.15.5:44834) 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be49ae640 1 -- 172.21.15.5:0/2328772720 learned_addr learned my addr 172.21.15.5:0/2328772720 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5bdffff640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be015ff70 0x7f5be00b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be51af640 1 -- 172.21.15.5:0/2328772720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be015ff70 msgr2=0x7f5be00b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be51af640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be015ff70 0x7f5be00b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be51af640 1 -- 172.21.15.5:0/2328772720 >> v1:172.21.15.5:6789/0 conn(0x7f5be015fb90 legacy=0x7f5be00b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.106+0000 7f5be51af640 1 -- 172.21.15.5:0/2328772720 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00b0590 con 0x7f5be00b15b0 2024-09-13T17:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.107+0000 7f5be51af640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be00b15b0 0x7f5be00cd1e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009d90 tx=0x7f5bd802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5705376f52e17497 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.107+0000 7f5bdf7fe640 1 -- 172.21.15.5:0/2328772720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8007740 con 0x7f5be00b15b0 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.107+0000 7f5bdf7fe640 1 -- 172.21.15.5:0/2328772720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd802d050 con 0x7f5be00b15b0 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.107+0000 7f5bdf7fe640 1 -- 172.21.15.5:0/2328772720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8007ac0 con 0x7f5be00b15b0 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 -- 172.21.15.5:0/2328772720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be00b15b0 msgr2=0x7f5be00cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be00b15b0 0x7f5be00cd1e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009d90 tx=0x7f5bd802a660 comp rx=0 tx=0).stop 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 -- 172.21.15.5:0/2328772720 shutdown_connections 2024-09-13T17:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be00b15b0 0x7f5be00cd1e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 --2- 172.21.15.5:0/2328772720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be015ff70 0x7f5be00b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 -- 172.21.15.5:0/2328772720 >> 172.21.15.5:0/2328772720 conn(0x7f5be0089f90 msgr2=0x7f5be00d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 -- 172.21.15.5:0/2328772720 shutdown_connections 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.108+0000 7f5be6c12640 1 -- 172.21.15.5:0/2328772720 wait complete. 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.109+0000 7f5be6c12640 1 Processor -- start 2024-09-13T17:16:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.109+0000 7f5be6c12640 1 -- start start 2024-09-13T17:16:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be00b15b0 0x7f5be00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 0x7f5be00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00ca9c0 con 0x7f5be015fb90 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be01f2040 con 0x7f5be015ff70 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be6c12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00b1d40 con 0x7f5be00b15b0 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58702/0 (socket says 172.21.15.5:58702) 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 -- 172.21.15.5:0/1137497613 learned_addr learned my addr 172.21.15.5:0/1137497613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be49ae640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be00b15b0 0x7f5be00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be51af640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 0x7f5be00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 -- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be00b15b0 msgr2=0x7f5be00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be00b15b0 0x7f5be00b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 -- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 msgr2=0x7f5be00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 0x7f5be00b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5bdffff640 1 -- 172.21.15.5:0/1137497613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009a70 con 0x7f5be015fb90 2024-09-13T17:16:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.110+0000 7f5be51af640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 0x7f5be00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5bdffff640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d830 tx=0x7f5bcc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc005990 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc005b10 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00b1fe0 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc009640 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.111+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be00b25a0 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.112+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be00b1290 con 0x7f5be015fb90 2024-09-13T17:16:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.112+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5bcc0099b0 con 0x7f5be015fb90 2024-09-13T17:16:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.113+0000 7f5bdd7fa640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 0x7f5bc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.113+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5bcc089760 con 0x7f5be015fb90 2024-09-13T17:16:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.113+0000 7f5be49ae640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 0x7f5bc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.114+0000 7f5be49ae640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 0x7f5bc406d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005880 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.117+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5bcc0547f0 con 0x7f5be015fb90 2024-09-13T17:16:15.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.322+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be00cd1c0 con 0x7f5be015fb90 2024-09-13T17:16:15.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.323+0000 7f5bdd7fa640 1 -- 172.21.15.5:0/1137497613 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f5bcc057e10 con 0x7f5be015fb90 2024-09-13T17:16:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:15.324 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:16:15.325 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:16:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 msgr2=0x7f5bc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 0x7f5bc406d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005880 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2024-09-13T17:16:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 msgr2=0x7f5be00b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d830 tx=0x7f5bcc00dcf0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 shutdown_connections 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5be015ff70 0x7f5be00b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5bc406ac00 0x7f5bc406d0c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5be015fb90 0x7f5be00b45a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 --2- 172.21.15.5:0/1137497613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5be00b15b0 0x7f5be00b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 >> 172.21.15.5:0/1137497613 conn(0x7f5be0089f90 msgr2=0x7f5be00cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 shutdown_connections 2024-09-13T17:16:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.325+0000 7f5be6c12640 1 -- 172.21.15.5:0/1137497613 wait complete. 2024-09-13T17:16:15.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.437+0000 7f613f29c640 1 Processor -- start 2024-09-13T17:16:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.437+0000 7f613f29c640 1 -- start start 2024-09-13T17:16:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613f29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f61380aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613f29c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f613815a290 0x7f61380b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613f29c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61380b2390 con 0x7f6138156f40 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613f29c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613815a740 con 0x7f613815a290 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613f29c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380b1780 con 0x7f613806e1c0 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613d038640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6138156f40 0x7f613806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44848/0 (socket says 172.21.15.5:44848) 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.438+0000 7f613d038640 1 -- 172.21.15.5:0/536421957 learned_addr learned my addr 172.21.15.5:0/536421957 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613c837640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f61380aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577937390 0 0) 0x7f61380b2390 con 0x7f6138156f40 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d839640 1 --2- 172.21.15.5:0/536421957 >> v2:172.21.15.179:3300/0 conn(0x7f613815a290 0x7f61380b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6124003520 con 0x7f6138156f40 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326711873 0 0) 0x7f6124003520 con 0x7f6138156f40 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 msgr2=0x7f61380aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f61380aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 >> v2:172.21.15.179:3300/0 conn(0x7f613815a290 msgr2=0x7f61380b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 --2- 172.21.15.5:0/536421957 >> v2:172.21.15.179:3300/0 conn(0x7f613815a290 0x7f61380b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380b1a60 con 0x7f6138156f40 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f61340019f0 con 0x7f6138156f40 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 >> v1:172.21.15.5:6789/0 conn(0x7f6138156f40 legacy=0x7f613806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f6124003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61240047c0 0x7f6124004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f6124005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613815a740 con 0x7f6124003970 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380b1780 con 0x7f61240047c0 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612400b980 con 0x7f613806e1c0 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f6124003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613c837640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61240047c0 0x7f6124004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d839640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f6124005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 -- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 msgr2=0x7f6124005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613806e1c0 0x7f6124005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 -- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61240047c0 msgr2=0x7f6124004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61240047c0 0x7f6124004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.439+0000 7f613d038640 1 -- 172.21.15.5:0/536421957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124003520 con 0x7f6124003970 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.440+0000 7f613d038640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f6124003d90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f613400a440 tx=0x7f61240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dff3e2f88b574f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.440+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402dc90 con 0x7f6124003970 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.440+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613402ddf0 con 0x7f6124003970 2024-09-13T17:16:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.440+0000 7f612ffff640 1 -- 172.21.15.5:0/536421957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340366b0 con 0x7f6124003970 2024-09-13T17:16:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 -- 172.21.15.5:0/536421957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 msgr2=0x7f6124003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 --2- 172.21.15.5:0/536421957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f6124003d90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f613400a440 tx=0x7f61240057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613d839640 1 -- 172.21.15.5:0/536421957 reap_dead start 2024-09-13T17:16:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 -- 172.21.15.5:0/536421957 shutdown_connections 2024-09-13T17:16:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 -- 172.21.15.5:0/536421957 >> 172.21.15.5:0/536421957 conn(0x7f61380ce0d0 msgr2=0x7f61380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 -- 172.21.15.5:0/536421957 shutdown_connections 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.441+0000 7f613f29c640 1 -- 172.21.15.5:0/536421957 wait complete. 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.442+0000 7f613f29c640 1 Processor -- start 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.442+0000 7f613f29c640 1 -- start start 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613814c9b0 0x7f613814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6138159310 0x7f6138159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61381516d0 con 0x7f6124003970 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138159cd0 con 0x7f6138159310 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613f29c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613814dfb0 con 0x7f613814c9b0 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58714/0 (socket says 172.21.15.5:58714) 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 -- 172.21.15.5:0/2352400922 learned_addr learned my addr 172.21.15.5:0/2352400922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d839640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6138159310 0x7f6138159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613c837640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613814c9b0 0x7f613814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 -- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613814c9b0 msgr2=0x7f613814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613814c9b0 0x7f613814ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 -- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6138159310 msgr2=0x7f6138159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6138159310 0x7f6138159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.443+0000 7f613d038640 1 -- 172.21.15.5:0/2352400922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613814d430 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f613d038640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f613402d740 tx=0x7f6134001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613403c070 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134001fd0 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613814d710 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134036470 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.444+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613814dcd0 con 0x7f6124003970 2024-09-13T17:16:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.445+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61380672a0 con 0x7f6124003970 2024-09-13T17:16:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.445+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6134033070 con 0x7f6124003970 2024-09-13T17:16:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.446+0000 7f612dffb640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 0x7f611c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.446+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61340a97b0 con 0x7f6124003970 2024-09-13T17:16:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.446+0000 7f613c837640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 0x7f611c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.447+0000 7f613c837640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 0x7f611c06d0c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f613806b9b0 tx=0x7f6128009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.450+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6134074920 con 0x7f6124003970 2024-09-13T17:16:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.626+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61380b1080 con 0x7f6124003970 2024-09-13T17:16:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.627+0000 7f612dffb640 1 -- 172.21.15.5:0/2352400922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f6134077f40 con 0x7f6124003970 2024-09-13T17:16:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:15.629 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 msgr2=0x7f611c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 0x7f611c06d0c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f613806b9b0 tx=0x7f6128009190 comp rx=0 tx=0).stop 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 msgr2=0x7f613814c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f613402d740 tx=0x7f6134001d80 comp rx=0 tx=0).stop 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 shutdown_connections 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6138159310 0x7f6138159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f613814c9b0 0x7f613814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f611c06ac00 0x7f611c06d0c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 --2- 172.21.15.5:0/2352400922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6124003970 0x7f613814c420 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 >> 172.21.15.5:0/2352400922 conn(0x7f61380ce0d0 msgr2=0x7f613806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 shutdown_connections 2024-09-13T17:16:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.630+0000 7f613f29c640 1 -- 172.21.15.5:0/2352400922 wait complete. 2024-09-13T17:16:15.642 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:16:15.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:16:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.742+0000 7f819415a640 1 Processor -- start 2024-09-13T17:16:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.743+0000 7f819415a640 1 -- start start 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.743+0000 7f819415a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f818c15c810 0x7f818c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.743+0000 7f819415a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0d1e80 con 0x7f818c0b4cf0 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.743+0000 7f819415a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0d1750 con 0x7f818c0d06d0 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.743+0000 7f819415a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0d0bd0 con 0x7f818c15c810 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f81926f7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f818c0b4cf0 0x7f818c0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44850/0 (socket says 172.21.15.5:44850) 2024-09-13T17:16:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f81926f7640 1 -- 172.21.15.5:0/396075279 learned_addr learned my addr 172.21.15.5:0/396075279 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616730569 0 0) 0x7f818c0d1e80 con 0x7f818c0b4cf0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8191ef6640 1 --2- 172.21.15.5:0/396075279 >> v2:172.21.15.179:3300/0 conn(0x7f818c15c810 0x7f818c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8174003520 con 0x7f818c0b4cf0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3103396924 0 0) 0x7f8174003520 con 0x7f818c0b4cf0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 >> v2:172.21.15.179:3300/0 conn(0x7f818c15c810 msgr2=0x7f818c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 --2- 172.21.15.5:0/396075279 >> v2:172.21.15.179:3300/0 conn(0x7f818c15c810 0x7f818c0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 >> v1:172.21.15.179:6789/0 conn(0x7f818c0d06d0 legacy=0x7f818c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0d0eb0 con 0x7f818c0b4cf0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8184001670 con 0x7f818c0b4cf0 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 >> v1:172.21.15.5:6789/0 conn(0x7f818c0b4cf0 legacy=0x7f818c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174003970 0x7f8174003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81740047c0 0x7f8174004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 0x7f817400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0d0bd0 con 0x7f8174005180 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817400c020 con 0x7f8174003970 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817400c1e0 con 0x7f81740047c0 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f81926f7640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 0x7f817400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f8191ef6640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174003970 0x7f8174003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.744+0000 7f81916f5640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81740047c0 0x7f8174004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 -- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81740047c0 msgr2=0x7f8174004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81740047c0 0x7f8174004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 -- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174003970 msgr2=0x7f8174003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8174003970 0x7f8174003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 -- 172.21.15.5:0/396075279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174003520 con 0x7f8174005180 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81916f5640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81740047c0 0x7f8174004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 -- 172.21.15.5:0/396075279 reap_dead start 2024-09-13T17:16:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f81926f7640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 0x7f817400b980 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f818400c240 tx=0x7f81740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25db87e7c801698c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818402e070 con 0x7f8174005180 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840058d0 con 0x7f8174005180 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.745+0000 7f8190ef4640 1 -- 172.21.15.5:0/396075279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184005c60 con 0x7f8174005180 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 -- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 msgr2=0x7f817400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 0x7f817400b980 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f818400c240 tx=0x7f81740057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 -- 172.21.15.5:0/396075279 shutdown_connections 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 --2- 172.21.15.5:0/396075279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8174005180 0x7f817400b980 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 -- 172.21.15.5:0/396075279 >> 172.21.15.5:0/396075279 conn(0x7f818c0717a0 msgr2=0x7f818c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 -- 172.21.15.5:0/396075279 shutdown_connections 2024-09-13T17:16:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.746+0000 7f819415a640 1 -- 172.21.15.5:0/396075279 wait complete. 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.747+0000 7f819415a640 1 Processor -- start 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.747+0000 7f819415a640 1 -- start start 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 0x7f818c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c156710 0x7f818c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c157bc0 con 0x7f818c1562b0 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c157280 con 0x7f818c156710 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f819415a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c156cc0 con 0x7f8174005180 2024-09-13T17:16:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58722/0 (socket says 172.21.15.5:58722) 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 -- 172.21.15.5:0/447912698 learned_addr learned my addr 172.21.15.5:0/447912698 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f8191ef6640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 0x7f818c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81926f7640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c156710 0x7f818c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 -- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 msgr2=0x7f818c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 0x7f818c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 -- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c156710 msgr2=0x7f818c159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c156710 0x7f818c159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f81916f5640 1 -- 172.21.15.5:0/447912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c156fa0 con 0x7f818c1562b0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.748+0000 7f8191ef6640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 0x7f818c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f81916f5640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8180007810 tx=0x7f818000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800052e0 con 0x7f818c1562b0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180005440 con 0x7f818c1562b0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c1577e0 con 0x7f818c1562b0 2024-09-13T17:16:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180003830 con 0x7f818c1562b0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.749+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c0a9300 con 0x7f818c1562b0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.750+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c157640 con 0x7f818c1562b0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.750+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8180003990 con 0x7f818c1562b0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.751+0000 7f818a7fc640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 0x7f817806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.751+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8180088bc0 con 0x7f818c1562b0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.751+0000 7f8191ef6640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 0x7f817806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.751+0000 7f8191ef6640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 0x7f817806d0f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f817c007520 tx=0x7f817c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.755+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f818c157640 con 0x7f818c1562b0 2024-09-13T17:16:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.922+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f818c0d1470 con 0x7f817806ac30 2024-09-13T17:16:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.930+0000 7f818a7fc640 1 -- 172.21.15.5:0/447912698 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278383 (secure 0 0 0) 0x7f817c00f040 con 0x7f817806ac30 2024-09-13T17:16:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.932+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 msgr2=0x7f817806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 0x7f817806d0f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f817c007520 tx=0x7f817c00b040 comp rx=0 tx=0).stop 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 msgr2=0x7f818c159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8180007810 tx=0x7f818000e910 comp rx=0 tx=0).stop 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 shutdown_connections 2024-09-13T17:16:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c156710 0x7f818c159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f817806ac30 0x7f817806d0f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1562b0 0x7f818c159ab0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 --2- 172.21.15.5:0/447912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8174005180 0x7f818c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 >> 172.21.15.5:0/447912698 conn(0x7f818c0717a0 msgr2=0x7f818c0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 shutdown_connections 2024-09-13T17:16:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:15.933+0000 7f819415a640 1 -- 172.21.15.5:0/447912698 wait complete. 2024-09-13T17:16:15.945 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T17:16:15.299944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239948,"kb_used_data":7364,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734772,"statfs":{"total":773094113280,"available":772848406528,"internally_reserved":0,"allocated":7540736,"data_stored":4011053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000939"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542369+0000","last_change":"2024-09-13T17:16:11.542369+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542369+0000","last_undegraded":"2024-09-13T17:16:11.542369+0000","last_fullsized":"2024-09-13T17:16:11.542369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541191+0000","last_change":"2024-09-13T17:16:11.541191+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541191+0000","last_undegraded":"2024-09-13T17:16:11.541191+0000","last_fullsized":"2024-09-13T17:16:11.541191+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541172+0000","last_change":"2024-09-13T17:16:11.541172+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541172+0000","last_undegraded":"2024-09-13T17:16:11.541172+0000","last_fullsized":"2024-09-13T17:16:11.541172+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540628+0000","last_change":"2024-09-13T17:16:11.540628+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540628+0000","last_undegraded":"2024-09-13T17:16:11.540628+0000","last_fullsized":"2024-09-13T17:16:11.540628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546591+0000","last_change":"2024-09-13T17:16:11.546591+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546591+0000","last_undegraded":"2024-09-13T17:16:11.546591+0000","last_fullsized":"2024-09-13T17:16:11.546591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546704+0000","last_change":"2024-09-13T17:16:11.546704+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546704+0000","last_undegraded":"2024-09-13T17:16:11.546704+0000","last_fullsized":"2024-09-13T17:16:11.546704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546987+0000","last_change":"2024-09-13T17:16:11.546987+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546987+0000","last_undegraded":"2024-09-13T17:16:11.546987+0000","last_fullsized":"2024-09-13T17:16:11.546987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543461+0000","last_change":"2024-09-13T17:16:11.543461+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543461+0000","last_undegraded":"2024-09-13T17:16:11.543461+0000","last_fullsized":"2024-09-13T17:16:11.543461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544910+0000","last_change":"2024-09-13T17:16:11.544910+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544910+0000","last_undegraded":"2024-09-13T17:16:11.544910+0000","last_fullsized":"2024-09-13T17:16:11.544910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541922+0000","last_change":"2024-09-13T17:16:11.541922+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541922+0000","last_undegraded":"2024-09-13T17:16:11.541922+0000","last_fullsized":"2024-09-13T17:16:11.541922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545915+0000","last_change":"2024-09-13T17:16:11.545915+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545915+0000","last_undegraded":"2024-09-13T17:16:11.545915+0000","last_fullsized":"2024-09-13T17:16:11.545915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542849+0000","last_change":"2024-09-13T17:16:11.542849+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542849+0000","last_undegraded":"2024-09-13T17:16:11.542849+0000","last_fullsized":"2024-09-13T17:16:11.542849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544976+0000","last_change":"2024-09-13T17:16:11.544976+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544976+0000","last_undegraded":"2024-09-13T17:16:11.544976+0000","last_fullsized":"2024-09-13T17:16:11.544976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543266+0000","last_change":"2024-09-13T17:16:11.543266+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543266+0000","last_undegraded":"2024-09-13T17:16:11.543266+0000","last_fullsized":"2024-09-13T17:16:11.543266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544569+0000","last_change":"2024-09-13T17:16:11.544569+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544569+0000","last_undegraded":"2024-09-13T17:16:11.544569+0000","last_fullsized":"2024-09-13T17:16:11.544569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541895+0000","last_change":"2024-09-13T17:16:11.541895+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541895+0000","last_undegraded":"2024-09-13T17:16:11.541895+0000","last_fullsized":"2024-09-13T17:16:11.541895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544255+0000","last_change":"2024-09-13T17:16:11.544255+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544255+0000","last_undegraded":"2024-09-13T17:16:11.544255+0000","last_fullsized":"2024-09-13T17:16:11.544255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545259+0000","last_change":"2024-09-13T17:16:11.545259+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545259+0000","last_undegraded":"2024-09-13T17:16:11.545259+0000","last_fullsized":"2024-09-13T17:16:11.545259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545410+0000","last_change":"2024-09-13T17:16:11.545410+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545410+0000","last_undegraded":"2024-09-13T17:16:11.545410+0000","last_fullsized":"2024-09-13T17:16:11.545410+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546180+0000","last_change":"2024-09-13T17:16:11.546180+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546180+0000","last_undegraded":"2024-09-13T17:16:11.546180+0000","last_fullsized":"2024-09-13T17:16:11.546180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541862+0000","last_change":"2024-09-13T17:16:11.541862+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541862+0000","last_undegraded":"2024-09-13T17:16:11.541862+0000","last_fullsized":"2024-09-13T17:16:11.541862+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542153+0000","last_change":"2024-09-13T17:16:11.542153+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542153+0000","last_undegraded":"2024-09-13T17:16:11.542153+0000","last_fullsized":"2024-09-13T17:16:11.542153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541810+0000","last_change":"2024-09-13T17:16:11.541810+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541810+0000","last_undegraded":"2024-09-13T17:16:11.541810+0000","last_fullsized":"2024-09-13T17:16:11.541810+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540722+0000","last_change":"2024-09-13T17:16:11.540722+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540722+0000","last_undegraded":"2024-09-13T17:16:11.540722+0000","last_fullsized":"2024-09-13T17:16:11.540722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542314+0000","last_change":"2024-09-13T17:16:11.542314+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542314+0000","last_undegraded":"2024-09-13T17:16:11.542314+0000","last_fullsized":"2024-09-13T17:16:11.542314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544455+0000","last_change":"2024-09-13T17:16:11.544455+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544455+0000","last_undegraded":"2024-09-13T17:16:11.544455+0000","last_fullsized":"2024-09-13T17:16:11.544455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546164+0000","last_change":"2024-09-13T17:16:11.546164+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546164+0000","last_undegraded":"2024-09-13T17:16:11.546164+0000","last_fullsized":"2024-09-13T17:16:11.546164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546145+0000","last_change":"2024-09-13T17:16:11.546145+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546145+0000","last_undegraded":"2024-09-13T17:16:11.546145+0000","last_fullsized":"2024-09-13T17:16:11.546145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542366+0000","last_change":"2024-09-13T17:16:11.542366+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542366+0000","last_undegraded":"2024-09-13T17:16:11.542366+0000","last_fullsized":"2024-09-13T17:16:11.542366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546126+0000","last_change":"2024-09-13T17:16:11.546126+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546126+0000","last_undegraded":"2024-09-13T17:16:11.546126+0000","last_fullsized":"2024-09-13T17:16:11.546126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T17:16:10.412132+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:16:10.412132+0000","last_peered":"2024-09-13T17:16:10.412132+0000","last_clean":"2024-09-13T17:16:10.412132+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:16:10.412132+0000","last_undegraded":"2024-09-13T17:16:10.412132+0000","last_fullsized":"2024-09-13T17:16:10.412132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67300000000000004,"5min":0.755,"15min":0.755},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.752},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.505}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67000000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.63},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71299999999999997,"5min":1.173,"15min":1.173},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61899999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.085,"15min":1.085},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.74299999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81999999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86299999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49299999999999999,"15min":0.46899999999999997},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":1.034,"15min":1.034},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68100000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.48599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53800000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50700000000000001,"5min":1.458,"15min":1.458},"last":0.374},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56000000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":1.226,"15min":1.226},"last":0.55800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31888,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":786432,"data_stored":349954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.318,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53000000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.42799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.317}]},{"osd":3,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61899999999999999,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.871,"15min":0.871},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81000000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.61099999999999999,"5min":1.159,"15min":1.159},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.251},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":1.081,"15min":1.081},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64000000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":1.286,"15min":1.286},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.046,"15min":1.046},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93999999999999995,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.628}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.254,"15min":1.254},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.49299999999999999,"15min":0.41699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":14.106999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.51300000000000001,"15min":0.443},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.606999999999999,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.442},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.262,"5min":14.262,"15min":14.262},"last":0.373},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71099999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.998,"15min":0.998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.04,"5min":4.04,"15min":4.04},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.518000000000001,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.879,"15min":0.879},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:16:15.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:16:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.085+0000 7fe687053640 1 Processor -- start 2024-09-13T17:16:16.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.085+0000 7fe687053640 1 -- start start 2024-09-13T17:16:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe687053640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe6800b1ac0 0x7fe68015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe687053640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe68006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe687053640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6800b35f0 con 0x7fe68006eb80 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe687053640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe680160020 con 0x7fe6800b1ac0 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe687053640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe680156f50 con 0x7fe68006ef60 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe684def640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe68006eb80 0x7fe6800b3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44864/0 (socket says 172.21.15.5:44864) 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe684def640 1 -- 172.21.15.5:0/1566090976 learned_addr learned my addr 172.21.15.5:0/1566090976 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1566090976 >> v2:172.21.15.179:3300/0 conn(0x7fe6800b1ac0 0x7fe68015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.086+0000 7fe6855f0640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe68006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263300422 0 0) 0x7fe6800b35f0 con 0x7fe68006eb80 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c003520 con 0x7fe68006eb80 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057156138 0 0) 0x7fe66c003520 con 0x7fe68006eb80 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 msgr2=0x7fe68006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe68006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 >> v2:172.21.15.179:3300/0 conn(0x7fe6800b1ac0 msgr2=0x7fe68015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1566090976 >> v2:172.21.15.179:3300/0 conn(0x7fe6800b1ac0 0x7fe68015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800b1fa0 con 0x7fe68006eb80 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe670001670 con 0x7fe68006eb80 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 >> v1:172.21.15.5:6789/0 conn(0x7fe68006eb80 legacy=0x7fe6800b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe66c003970 0x7fe66c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0047c0 0x7fe66c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe66c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680160020 con 0x7fe66c0047c0 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680156f50 con 0x7fe66c003970 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c00b980 con 0x7fe68006ef60 2024-09-13T17:16:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0047c0 0x7fe66c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe684def640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe66c003970 0x7fe66c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe6855f0640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe66c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 -- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 msgr2=0x7fe66c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe68006ef60 0x7fe66c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 -- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe66c003970 msgr2=0x7fe66c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe66c003970 0x7fe66c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.087+0000 7fe67ffff640 1 -- 172.21.15.5:0/1566090976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c003520 con 0x7fe66c0047c0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.088+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0047c0 0x7fe66c004c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe668009fc0 tx=0x7fe66c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9117d825a4820bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.088+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668031670 con 0x7fe66c0047c0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.088+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800f040 con 0x7fe66c0047c0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.088+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1566090976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668031a10 con 0x7fe66c0047c0 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 -- 172.21.15.5:0/1566090976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0047c0 msgr2=0x7fe66c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 --2- 172.21.15.5:0/1566090976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0047c0 0x7fe66c004c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe668009fc0 tx=0x7fe66c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe6855f0640 1 -- 172.21.15.5:0/1566090976 reap_dead start 2024-09-13T17:16:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 -- 172.21.15.5:0/1566090976 shutdown_connections 2024-09-13T17:16:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 -- 172.21.15.5:0/1566090976 >> 172.21.15.5:0/1566090976 conn(0x7fe680070af0 msgr2=0x7fe680070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 -- 172.21.15.5:0/1566090976 shutdown_connections 2024-09-13T17:16:16.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.089+0000 7fe687053640 1 -- 172.21.15.5:0/1566090976 wait complete. 2024-09-13T17:16:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.090+0000 7fe687053640 1 Processor -- start 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.090+0000 7fe687053640 1 -- start start 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe66c0047c0 0x7fe6800cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68014bd50 0x7fe68015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68014f060 con 0x7fe6800cce50 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800cc100 con 0x7fe68014bd50 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe687053640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800cc370 con 0x7fe66c0047c0 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe67ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe67ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58750/0 (socket says 172.21.15.5:58750) 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe67ffff640 1 -- 172.21.15.5:0/1469619412 learned_addr learned my addr 172.21.15.5:0/1469619412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe684def640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe66c0047c0 0x7fe6800cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe6855f0640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68014bd50 0x7fe68015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe67ffff640 1 -- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe66c0047c0 msgr2=0x7fe6800cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.091+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe66c0047c0 0x7fe6800cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67ffff640 1 -- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68014bd50 msgr2=0x7fe68015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68014bd50 0x7fe68015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67ffff640 1 -- 172.21.15.5:0/1469619412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800cc650 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e230 tx=0x7fe668009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668003b90 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668040070 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6800cc930 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668004020 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.092+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68014c200 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.093+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6800672e0 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.093+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe668042030 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.094+0000 7fe67d7fa640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 0x7fe66006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.094+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe6680aa810 con 0x7fe6800cce50 2024-09-13T17:16:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.094+0000 7fe684def640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 0x7fe66006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.095+0000 7fe684def640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 0x7fe66006d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe6700015d0 tx=0x7fe6700078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.098+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe6680758c0 con 0x7fe6800cce50 2024-09-13T17:16:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.270+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6800b2840 con 0x7fe66006ac30 2024-09-13T17:16:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.278+0000 7fe67d7fa640 1 -- 172.21.15.5:0/1469619412 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278383 (secure 0 0 0) 0x7fe670007780 con 0x7fe66006ac30 2024-09-13T17:16:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:16.283 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:16:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 msgr2=0x7fe66006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 0x7fe66006d0f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe6700015d0 tx=0x7fe6700078f0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 msgr2=0x7fe68014eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e230 tx=0x7fe668009750 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 shutdown_connections 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe68014bd50 0x7fe68015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe66006ac30 0x7fe66006d0f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6800cce50 0x7fe68014eb20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 --2- 172.21.15.5:0/1469619412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe66c0047c0 0x7fe6800cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 >> 172.21.15.5:0/1469619412 conn(0x7fe680070af0 msgr2=0x7fe6800aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 shutdown_connections 2024-09-13T17:16:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.281+0000 7fe687053640 1 -- 172.21.15.5:0/1469619412 wait complete. 2024-09-13T17:16:16.293 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T17:16:15.299944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239948,"kb_used_data":7364,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734772,"statfs":{"total":773094113280,"available":772848406528,"internally_reserved":0,"allocated":7540736,"data_stored":4011053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000939"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542369+0000","last_change":"2024-09-13T17:16:11.542369+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542369+0000","last_undegraded":"2024-09-13T17:16:11.542369+0000","last_fullsized":"2024-09-13T17:16:11.542369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541191+0000","last_change":"2024-09-13T17:16:11.541191+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541191+0000","last_undegraded":"2024-09-13T17:16:11.541191+0000","last_fullsized":"2024-09-13T17:16:11.541191+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541172+0000","last_change":"2024-09-13T17:16:11.541172+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541172+0000","last_undegraded":"2024-09-13T17:16:11.541172+0000","last_fullsized":"2024-09-13T17:16:11.541172+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540628+0000","last_change":"2024-09-13T17:16:11.540628+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540628+0000","last_undegraded":"2024-09-13T17:16:11.540628+0000","last_fullsized":"2024-09-13T17:16:11.540628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546591+0000","last_change":"2024-09-13T17:16:11.546591+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546591+0000","last_undegraded":"2024-09-13T17:16:11.546591+0000","last_fullsized":"2024-09-13T17:16:11.546591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546704+0000","last_change":"2024-09-13T17:16:11.546704+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546704+0000","last_undegraded":"2024-09-13T17:16:11.546704+0000","last_fullsized":"2024-09-13T17:16:11.546704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546987+0000","last_change":"2024-09-13T17:16:11.546987+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546987+0000","last_undegraded":"2024-09-13T17:16:11.546987+0000","last_fullsized":"2024-09-13T17:16:11.546987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543461+0000","last_change":"2024-09-13T17:16:11.543461+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543461+0000","last_undegraded":"2024-09-13T17:16:11.543461+0000","last_fullsized":"2024-09-13T17:16:11.543461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544910+0000","last_change":"2024-09-13T17:16:11.544910+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544910+0000","last_undegraded":"2024-09-13T17:16:11.544910+0000","last_fullsized":"2024-09-13T17:16:11.544910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541922+0000","last_change":"2024-09-13T17:16:11.541922+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541922+0000","last_undegraded":"2024-09-13T17:16:11.541922+0000","last_fullsized":"2024-09-13T17:16:11.541922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545915+0000","last_change":"2024-09-13T17:16:11.545915+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545915+0000","last_undegraded":"2024-09-13T17:16:11.545915+0000","last_fullsized":"2024-09-13T17:16:11.545915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542849+0000","last_change":"2024-09-13T17:16:11.542849+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542849+0000","last_undegraded":"2024-09-13T17:16:11.542849+0000","last_fullsized":"2024-09-13T17:16:11.542849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544976+0000","last_change":"2024-09-13T17:16:11.544976+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544976+0000","last_undegraded":"2024-09-13T17:16:11.544976+0000","last_fullsized":"2024-09-13T17:16:11.544976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543266+0000","last_change":"2024-09-13T17:16:11.543266+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543266+0000","last_undegraded":"2024-09-13T17:16:11.543266+0000","last_fullsized":"2024-09-13T17:16:11.543266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544569+0000","last_change":"2024-09-13T17:16:11.544569+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544569+0000","last_undegraded":"2024-09-13T17:16:11.544569+0000","last_fullsized":"2024-09-13T17:16:11.544569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541895+0000","last_change":"2024-09-13T17:16:11.541895+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541895+0000","last_undegraded":"2024-09-13T17:16:11.541895+0000","last_fullsized":"2024-09-13T17:16:11.541895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544255+0000","last_change":"2024-09-13T17:16:11.544255+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544255+0000","last_undegraded":"2024-09-13T17:16:11.544255+0000","last_fullsized":"2024-09-13T17:16:11.544255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545259+0000","last_change":"2024-09-13T17:16:11.545259+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545259+0000","last_undegraded":"2024-09-13T17:16:11.545259+0000","last_fullsized":"2024-09-13T17:16:11.545259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545410+0000","last_change":"2024-09-13T17:16:11.545410+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545410+0000","last_undegraded":"2024-09-13T17:16:11.545410+0000","last_fullsized":"2024-09-13T17:16:11.545410+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546180+0000","last_change":"2024-09-13T17:16:11.546180+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546180+0000","last_undegraded":"2024-09-13T17:16:11.546180+0000","last_fullsized":"2024-09-13T17:16:11.546180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541862+0000","last_change":"2024-09-13T17:16:11.541862+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541862+0000","last_undegraded":"2024-09-13T17:16:11.541862+0000","last_fullsized":"2024-09-13T17:16:11.541862+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542153+0000","last_change":"2024-09-13T17:16:11.542153+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542153+0000","last_undegraded":"2024-09-13T17:16:11.542153+0000","last_fullsized":"2024-09-13T17:16:11.542153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541810+0000","last_change":"2024-09-13T17:16:11.541810+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541810+0000","last_undegraded":"2024-09-13T17:16:11.541810+0000","last_fullsized":"2024-09-13T17:16:11.541810+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540722+0000","last_change":"2024-09-13T17:16:11.540722+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540722+0000","last_undegraded":"2024-09-13T17:16:11.540722+0000","last_fullsized":"2024-09-13T17:16:11.540722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542314+0000","last_change":"2024-09-13T17:16:11.542314+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542314+0000","last_undegraded":"2024-09-13T17:16:11.542314+0000","last_fullsized":"2024-09-13T17:16:11.542314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544455+0000","last_change":"2024-09-13T17:16:11.544455+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544455+0000","last_undegraded":"2024-09-13T17:16:11.544455+0000","last_fullsized":"2024-09-13T17:16:11.544455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546164+0000","last_change":"2024-09-13T17:16:11.546164+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546164+0000","last_undegraded":"2024-09-13T17:16:11.546164+0000","last_fullsized":"2024-09-13T17:16:11.546164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546145+0000","last_change":"2024-09-13T17:16:11.546145+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546145+0000","last_undegraded":"2024-09-13T17:16:11.546145+0000","last_fullsized":"2024-09-13T17:16:11.546145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542366+0000","last_change":"2024-09-13T17:16:11.542366+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542366+0000","last_undegraded":"2024-09-13T17:16:11.542366+0000","last_fullsized":"2024-09-13T17:16:11.542366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546126+0000","last_change":"2024-09-13T17:16:11.546126+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546126+0000","last_undegraded":"2024-09-13T17:16:11.546126+0000","last_fullsized":"2024-09-13T17:16:11.546126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T17:16:10.412132+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:16:10.412132+0000","last_peered":"2024-09-13T17:16:10.412132+0000","last_clean":"2024-09-13T17:16:10.412132+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:16:10.412132+0000","last_undegraded":"2024-09-13T17:16:10.412132+0000","last_fullsized":"2024-09-13T17:16:10.412132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67300000000000004,"5min":0.755,"15min":0.755},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.752},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.505}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67000000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.63},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71299999999999997,"5min":1.173,"15min":1.173},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61899999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.085,"15min":1.085},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.74299999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81999999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86299999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49299999999999999,"15min":0.46899999999999997},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":1.034,"15min":1.034},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68100000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.48599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53800000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50700000000000001,"5min":1.458,"15min":1.458},"last":0.374},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56000000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":1.226,"15min":1.226},"last":0.55800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31888,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":786432,"data_stored":349954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.318,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53000000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.42799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.317}]},{"osd":3,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61899999999999999,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.871,"15min":0.871},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81000000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.61099999999999999,"5min":1.159,"15min":1.159},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.251},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":1.081,"15min":1.081},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64000000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":1.286,"15min":1.286},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.046,"15min":1.046},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93999999999999995,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.628}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.254,"15min":1.254},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.49299999999999999,"15min":0.41699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":14.106999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.51300000000000001,"15min":0.443},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.606999999999999,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.442},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.262,"5min":14.262,"15min":14.262},"last":0.373},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71099999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.998,"15min":0.998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.04,"5min":4.04,"15min":4.04},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.518000000000001,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.879,"15min":0.879},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:16:16.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:16:16.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.434+0000 7fa4c924f640 1 Processor -- start 2024-09-13T17:16:16.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.434+0000 7fa4c924f640 1 -- start start 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c924f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c40b27c0 0x7fa4c406c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c924f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4c415d4a0 0x7fa4c406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c924f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40710c0 con 0x7fa4c4071ea0 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c924f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c415d9a0 con 0x7fa4c415d4a0 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c924f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4071550 con 0x7fa4c40b27c0 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4c415d4a0 0x7fa4c406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4c415d4a0 0x7fa4c406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58762/0 (socket says 172.21.15.5:58762) 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 -- 172.21.15.5:0/4187931134 learned_addr learned my addr 172.21.15.5:0/4187931134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4c2d9d640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c40b27c0 0x7fa4c406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 -- 172.21.15.5:0/4187931134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c40b27c0 msgr2=0x7fa4c406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c40b27c0 0x7fa4c406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 -- 172.21.15.5:0/4187931134 >> v1:172.21.15.179:6789/0 conn(0x7fa4c4071ea0 legacy=0x7fa4c4152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.435+0000 7fa4bbfff640 1 -- 172.21.15.5:0/4187931134 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40b2ba0 con 0x7fa4c415d4a0 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.436+0000 7fa4bbfff640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c415d4a0 0x7fa4c406c650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009870 tx=0x7fa4ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370856622c9e1bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.436+0000 7fa4c259c640 1 -- 172.21.15.5:0/4187931134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac032440 con 0x7fa4c415d4a0 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.436+0000 7fa4c259c640 1 -- 172.21.15.5:0/4187931134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac0325a0 con 0x7fa4c415d4a0 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.436+0000 7fa4c259c640 1 -- 172.21.15.5:0/4187931134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac032930 con 0x7fa4c415d4a0 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 -- 172.21.15.5:0/4187931134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c415d4a0 msgr2=0x7fa4c406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c415d4a0 0x7fa4c406c650 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009870 tx=0x7fa4ac02a270 comp rx=0 tx=0).stop 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 -- 172.21.15.5:0/4187931134 shutdown_connections 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c415d4a0 0x7fa4c406c650 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 --2- 172.21.15.5:0/4187931134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c40b27c0 0x7fa4c406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 -- 172.21.15.5:0/4187931134 >> 172.21.15.5:0/4187931134 conn(0x7fa4c40ce0d0 msgr2=0x7fa4c40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 -- 172.21.15.5:0/4187931134 shutdown_connections 2024-09-13T17:16:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.437+0000 7fa4c924f640 1 -- 172.21.15.5:0/4187931134 wait complete. 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.438+0000 7fa4c924f640 1 Processor -- start 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.438+0000 7fa4c924f640 1 -- start start 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c4071ea0 0x7fa4c41f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c415d4a0 0x7fa4c40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c415ba50 con 0x7fa4c40b27c0 2024-09-13T17:16:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4089f90 con 0x7fa4c415d4a0 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c924f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41f3160 con 0x7fa4c4071ea0 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58770/0 (socket says 172.21.15.5:58770) 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4bbfff640 1 -- 172.21.15.5:0/2531912887 learned_addr learned my addr 172.21.15.5:0/2531912887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c2d9d640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c4071ea0 0x7fa4c41f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.439+0000 7fa4c359e640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c415d4a0 0x7fa4c40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 -- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c4071ea0 msgr2=0x7fa4c41f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c4071ea0 0x7fa4c41f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 -- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c415d4a0 msgr2=0x7fa4c40b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c415d4a0 0x7fa4c40b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 -- 172.21.15.5:0/2531912887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0094d0 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bbfff640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac000c00 tx=0x7fa4ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac032440 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac030980 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c408a1e0 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac030d30 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.440+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c408a7a0 con 0x7fa4c40b27c0 2024-09-13T17:16:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.441+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4070460 con 0x7fa4c40b27c0 2024-09-13T17:16:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.441+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4ac039040 con 0x7fa4c40b27c0 2024-09-13T17:16:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.442+0000 7fa4bb7fe640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 0x7fa4a406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.442+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa4ac0a9bf0 con 0x7fa4c40b27c0 2024-09-13T17:16:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.442+0000 7fa4c2d9d640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 0x7fa4a406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.443+0000 7fa4c2d9d640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 0x7fa4a406d0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009b40 tx=0x7fa4b4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.446+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa4ac074dd0 con 0x7fa4c40b27c0 2024-09-13T17:16:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.613+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4c4070d50 con 0x7fa4a406ac30 2024-09-13T17:16:16.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.620+0000 7fa4bb7fe640 1 -- 172.21.15.5:0/2531912887 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278383 (secure 0 0 0) 0x7fa4b4011a60 con 0x7fa4a406ac30 2024-09-13T17:16:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:16.626 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:16:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 msgr2=0x7fa4a406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 0x7fa4a406d0f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009b40 tx=0x7fa4b4009190 comp rx=0 tx=0).stop 2024-09-13T17:16:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 msgr2=0x7fa4c415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac000c00 tx=0x7fa4ac0046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 shutdown_connections 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c415d4a0 0x7fa4c40b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa4a406ac30 0x7fa4a406d0f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c40b27c0 0x7fa4c415b510 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 --2- 172.21.15.5:0/2531912887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c4071ea0 0x7fa4c41f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 >> 172.21.15.5:0/2531912887 conn(0x7fa4c40ce0d0 msgr2=0x7fa4c40ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 shutdown_connections 2024-09-13T17:16:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.623+0000 7fa4c924f640 1 -- 172.21.15.5:0/2531912887 wait complete. 2024-09-13T17:16:16.635 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T17:16:15.299944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239948,"kb_used_data":7364,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734772,"statfs":{"total":773094113280,"available":772848406528,"internally_reserved":0,"allocated":7540736,"data_stored":4011053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000939"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542369+0000","last_change":"2024-09-13T17:16:11.542369+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542369+0000","last_undegraded":"2024-09-13T17:16:11.542369+0000","last_fullsized":"2024-09-13T17:16:11.542369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541191+0000","last_change":"2024-09-13T17:16:11.541191+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541191+0000","last_undegraded":"2024-09-13T17:16:11.541191+0000","last_fullsized":"2024-09-13T17:16:11.541191+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541172+0000","last_change":"2024-09-13T17:16:11.541172+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541172+0000","last_undegraded":"2024-09-13T17:16:11.541172+0000","last_fullsized":"2024-09-13T17:16:11.541172+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540628+0000","last_change":"2024-09-13T17:16:11.540628+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540628+0000","last_undegraded":"2024-09-13T17:16:11.540628+0000","last_fullsized":"2024-09-13T17:16:11.540628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546591+0000","last_change":"2024-09-13T17:16:11.546591+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546591+0000","last_undegraded":"2024-09-13T17:16:11.546591+0000","last_fullsized":"2024-09-13T17:16:11.546591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546704+0000","last_change":"2024-09-13T17:16:11.546704+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546704+0000","last_undegraded":"2024-09-13T17:16:11.546704+0000","last_fullsized":"2024-09-13T17:16:11.546704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546987+0000","last_change":"2024-09-13T17:16:11.546987+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546987+0000","last_undegraded":"2024-09-13T17:16:11.546987+0000","last_fullsized":"2024-09-13T17:16:11.546987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543461+0000","last_change":"2024-09-13T17:16:11.543461+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543461+0000","last_undegraded":"2024-09-13T17:16:11.543461+0000","last_fullsized":"2024-09-13T17:16:11.543461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544910+0000","last_change":"2024-09-13T17:16:11.544910+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544910+0000","last_undegraded":"2024-09-13T17:16:11.544910+0000","last_fullsized":"2024-09-13T17:16:11.544910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541922+0000","last_change":"2024-09-13T17:16:11.541922+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541922+0000","last_undegraded":"2024-09-13T17:16:11.541922+0000","last_fullsized":"2024-09-13T17:16:11.541922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545915+0000","last_change":"2024-09-13T17:16:11.545915+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545915+0000","last_undegraded":"2024-09-13T17:16:11.545915+0000","last_fullsized":"2024-09-13T17:16:11.545915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542849+0000","last_change":"2024-09-13T17:16:11.542849+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542849+0000","last_undegraded":"2024-09-13T17:16:11.542849+0000","last_fullsized":"2024-09-13T17:16:11.542849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544976+0000","last_change":"2024-09-13T17:16:11.544976+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544976+0000","last_undegraded":"2024-09-13T17:16:11.544976+0000","last_fullsized":"2024-09-13T17:16:11.544976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.543266+0000","last_change":"2024-09-13T17:16:11.543266+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.543266+0000","last_undegraded":"2024-09-13T17:16:11.543266+0000","last_fullsized":"2024-09-13T17:16:11.543266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544569+0000","last_change":"2024-09-13T17:16:11.544569+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544569+0000","last_undegraded":"2024-09-13T17:16:11.544569+0000","last_fullsized":"2024-09-13T17:16:11.544569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541895+0000","last_change":"2024-09-13T17:16:11.541895+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541895+0000","last_undegraded":"2024-09-13T17:16:11.541895+0000","last_fullsized":"2024-09-13T17:16:11.541895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544255+0000","last_change":"2024-09-13T17:16:11.544255+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544255+0000","last_undegraded":"2024-09-13T17:16:11.544255+0000","last_fullsized":"2024-09-13T17:16:11.544255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545259+0000","last_change":"2024-09-13T17:16:11.545259+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545259+0000","last_undegraded":"2024-09-13T17:16:11.545259+0000","last_fullsized":"2024-09-13T17:16:11.545259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.545410+0000","last_change":"2024-09-13T17:16:11.545410+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.545410+0000","last_undegraded":"2024-09-13T17:16:11.545410+0000","last_fullsized":"2024-09-13T17:16:11.545410+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546180+0000","last_change":"2024-09-13T17:16:11.546180+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546180+0000","last_undegraded":"2024-09-13T17:16:11.546180+0000","last_fullsized":"2024-09-13T17:16:11.546180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541862+0000","last_change":"2024-09-13T17:16:11.541862+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541862+0000","last_undegraded":"2024-09-13T17:16:11.541862+0000","last_fullsized":"2024-09-13T17:16:11.541862+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540514+0000","last_change":"2024-09-13T17:16:11.540514+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540514+0000","last_undegraded":"2024-09-13T17:16:11.540514+0000","last_fullsized":"2024-09-13T17:16:11.540514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542153+0000","last_change":"2024-09-13T17:16:11.542153+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542153+0000","last_undegraded":"2024-09-13T17:16:11.542153+0000","last_fullsized":"2024-09-13T17:16:11.542153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.541810+0000","last_change":"2024-09-13T17:16:11.541810+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.541810+0000","last_undegraded":"2024-09-13T17:16:11.541810+0000","last_fullsized":"2024-09-13T17:16:11.541810+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.540722+0000","last_change":"2024-09-13T17:16:11.540722+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.540722+0000","last_undegraded":"2024-09-13T17:16:11.540722+0000","last_fullsized":"2024-09-13T17:16:11.540722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542314+0000","last_change":"2024-09-13T17:16:11.542314+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542314+0000","last_undegraded":"2024-09-13T17:16:11.542314+0000","last_fullsized":"2024-09-13T17:16:11.542314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.544455+0000","last_change":"2024-09-13T17:16:11.544455+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.544455+0000","last_undegraded":"2024-09-13T17:16:11.544455+0000","last_fullsized":"2024-09-13T17:16:11.544455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546164+0000","last_change":"2024-09-13T17:16:11.546164+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546164+0000","last_undegraded":"2024-09-13T17:16:11.546164+0000","last_fullsized":"2024-09-13T17:16:11.546164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546145+0000","last_change":"2024-09-13T17:16:11.546145+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546145+0000","last_undegraded":"2024-09-13T17:16:11.546145+0000","last_fullsized":"2024-09-13T17:16:11.546145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.542366+0000","last_change":"2024-09-13T17:16:11.542366+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.542366+0000","last_undegraded":"2024-09-13T17:16:11.542366+0000","last_fullsized":"2024-09-13T17:16:11.542366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T17:16:12.538332+0000","last_change":"2024-09-13T17:16:12.538332+0000","last_active":"2024-09-13T17:16:12.538332+0000","last_peered":"2024-09-13T17:16:12.538332+0000","last_clean":"2024-09-13T17:16:12.538332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:12.538332+0000","last_undegraded":"2024-09-13T17:16:12.538332+0000","last_fullsized":"2024-09-13T17:16:12.538332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-13T17:16:11.546126+0000","last_change":"2024-09-13T17:16:11.546126+0000","last_active":"2024-09-13T17:16:11.532893+0000","last_peered":"2024-09-13T17:16:11.532893+0000","last_clean":"2024-09-13T17:16:11.532893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:16:11.546126+0000","last_undegraded":"2024-09-13T17:16:11.546126+0000","last_fullsized":"2024-09-13T17:16:11.546126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T17:16:10.412132+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:16:10.412132+0000","last_peered":"2024-09-13T17:16:10.412132+0000","last_clean":"2024-09-13T17:16:10.412132+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:16:10.412132+0000","last_undegraded":"2024-09-13T17:16:10.412132+0000","last_fullsized":"2024-09-13T17:16:10.412132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67300000000000004,"5min":0.755,"15min":0.755},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.752},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.67300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.505}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67000000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.63},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71299999999999997,"5min":1.173,"15min":1.173},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61899999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.085,"15min":1.085},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.74299999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81999999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86299999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49299999999999999,"15min":0.46899999999999997},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":1.034,"15min":1.034},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68100000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.48599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53800000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50700000000000001,"5min":1.458,"15min":1.458},"last":0.374},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56000000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":1.226,"15min":1.226},"last":0.55800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31888,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":786432,"data_stored":349954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.318,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53000000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.42799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.317}]},{"osd":3,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61899999999999999,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.871,"15min":0.871},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81000000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":356091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.61099999999999999,"5min":1.159,"15min":1.159},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.251},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":1.081,"15min":1.081},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64000000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":1.286,"15min":1.286},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.046,"15min":1.046},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93999999999999995,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.628}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.254,"15min":1.254},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1380352,"data_stored":940322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.49299999999999999,"15min":0.41699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":14.106999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.51300000000000001,"15min":0.443},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.606999999999999,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.442},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.262,"5min":14.262,"15min":14.262},"last":0.373},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71099999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.998,"15min":0.998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.04,"5min":4.04,"15min":4.04},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.518000000000001,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.879,"15min":0.879},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:16:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2024-09-13T17:16:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2024-09-13T17:16:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2024-09-13T17:16:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2024-09-13T17:16:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-09-13T17:16:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.542369+0000', 'last_change': '2024-09-13T17:16:11.542369+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.542369+0000', 'last_undegraded': '2024-09-13T17:16:11.542369+0000', 'last_fullsized': '2024-09-13T17:16:11.542369+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541191+0000', 'last_change': '2024-09-13T17:16:11.541191+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541191+0000', 'last_undegraded': '2024-09-13T17:16:11.541191+0000', 'last_fullsized': '2024-09-13T17:16:11.541191+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541172+0000', 'last_change': '2024-09-13T17:16:11.541172+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541172+0000', 'last_undegraded': '2024-09-13T17:16:11.541172+0000', 'last_fullsized': '2024-09-13T17:16:11.541172+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2024-09-13T17:16:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.540628+0000', 'last_change': '2024-09-13T17:16:11.540628+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.540628+0000', 'last_undegraded': '2024-09-13T17:16:11.540628+0000', 'last_fullsized': '2024-09-13T17:16:11.540628+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546591+0000', 'last_change': '2024-09-13T17:16:11.546591+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546591+0000', 'last_undegraded': '2024-09-13T17:16:11.546591+0000', 'last_fullsized': '2024-09-13T17:16:11.546591+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546704+0000', 'last_change': '2024-09-13T17:16:11.546704+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546704+0000', 'last_undegraded': '2024-09-13T17:16:11.546704+0000', 'last_fullsized': '2024-09-13T17:16:11.546704+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2024-09-13T17:16:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546987+0000', 'last_change': '2024-09-13T17:16:11.546987+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546987+0000', 'last_undegraded': '2024-09-13T17:16:11.546987+0000', 'last_fullsized': '2024-09-13T17:16:11.546987+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.543461+0000', 'last_change': '2024-09-13T17:16:11.543461+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.543461+0000', 'last_undegraded': '2024-09-13T17:16:11.543461+0000', 'last_fullsized': '2024-09-13T17:16:11.543461+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-09-13T17:16:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.544910+0000', 'last_change': '2024-09-13T17:16:11.544910+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.544910+0000', 'last_undegraded': '2024-09-13T17:16:11.544910+0000', 'last_fullsized': '2024-09-13T17:16:11.544910+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541922+0000', 'last_change': '2024-09-13T17:16:11.541922+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541922+0000', 'last_undegraded': '2024-09-13T17:16:11.541922+0000', 'last_fullsized': '2024-09-13T17:16:11.541922+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.545915+0000', 'last_change': '2024-09-13T17:16:11.545915+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.545915+0000', 'last_undegraded': '2024-09-13T17:16:11.545915+0000', 'last_fullsized': '2024-09-13T17:16:11.545915+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-09-13T17:16:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.542849+0000', 'last_change': '2024-09-13T17:16:11.542849+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.542849+0000', 'last_undegraded': '2024-09-13T17:16:11.542849+0000', 'last_fullsized': '2024-09-13T17:16:11.542849+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.544976+0000', 'last_change': '2024-09-13T17:16:11.544976+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.544976+0000', 'last_undegraded': '2024-09-13T17:16:11.544976+0000', 'last_fullsized': '2024-09-13T17:16:11.544976+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.543266+0000', 'last_change': '2024-09-13T17:16:11.543266+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.543266+0000', 'last_undegraded': '2024-09-13T17:16:11.543266+0000', 'last_fullsized': '2024-09-13T17:16:11.543266+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.544569+0000', 'last_change': '2024-09-13T17:16:11.544569+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.544569+0000', 'last_undegraded': '2024-09-13T17:16:11.544569+0000', 'last_fullsized': '2024-09-13T17:16:11.544569+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541895+0000', 'last_change': '2024-09-13T17:16:11.541895+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541895+0000', 'last_undegraded': '2024-09-13T17:16:11.541895+0000', 'last_fullsized': '2024-09-13T17:16:11.541895+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.544255+0000', 'last_change': '2024-09-13T17:16:11.544255+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.544255+0000', 'last_undegraded': '2024-09-13T17:16:11.544255+0000', 'last_fullsized': '2024-09-13T17:16:11.544255+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2024-09-13T17:16:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.545259+0000', 'last_change': '2024-09-13T17:16:11.545259+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.545259+0000', 'last_undegraded': '2024-09-13T17:16:11.545259+0000', 'last_fullsized': '2024-09-13T17:16:11.545259+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.545410+0000', 'last_change': '2024-09-13T17:16:11.545410+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.545410+0000', 'last_undegraded': '2024-09-13T17:16:11.545410+0000', 'last_fullsized': '2024-09-13T17:16:11.545410+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546180+0000', 'last_change': '2024-09-13T17:16:11.546180+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546180+0000', 'last_undegraded': '2024-09-13T17:16:11.546180+0000', 'last_fullsized': '2024-09-13T17:16:11.546180+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.540514+0000', 'last_change': '2024-09-13T17:16:11.540514+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.540514+0000', 'last_undegraded': '2024-09-13T17:16:11.540514+0000', 'last_fullsized': '2024-09-13T17:16:11.540514+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541862+0000', 'last_change': '2024-09-13T17:16:11.541862+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541862+0000', 'last_undegraded': '2024-09-13T17:16:11.541862+0000', 'last_fullsized': '2024-09-13T17:16:11.541862+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-09-13T17:16:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.540514+0000', 'last_change': '2024-09-13T17:16:11.540514+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.540514+0000', 'last_undegraded': '2024-09-13T17:16:11.540514+0000', 'last_fullsized': '2024-09-13T17:16:11.540514+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.542153+0000', 'last_change': '2024-09-13T17:16:11.542153+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.542153+0000', 'last_undegraded': '2024-09-13T17:16:11.542153+0000', 'last_fullsized': '2024-09-13T17:16:11.542153+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.541810+0000', 'last_change': '2024-09-13T17:16:11.541810+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.541810+0000', 'last_undegraded': '2024-09-13T17:16:11.541810+0000', 'last_fullsized': '2024-09-13T17:16:11.541810+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-09-13T17:16:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.540722+0000', 'last_change': '2024-09-13T17:16:11.540722+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.540722+0000', 'last_undegraded': '2024-09-13T17:16:11.540722+0000', 'last_fullsized': '2024-09-13T17:16:11.540722+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.542314+0000', 'last_change': '2024-09-13T17:16:11.542314+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.542314+0000', 'last_undegraded': '2024-09-13T17:16:11.542314+0000', 'last_fullsized': '2024-09-13T17:16:11.542314+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.544455+0000', 'last_change': '2024-09-13T17:16:11.544455+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.544455+0000', 'last_undegraded': '2024-09-13T17:16:11.544455+0000', 'last_fullsized': '2024-09-13T17:16:11.544455+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2024-09-13T17:16:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546164+0000', 'last_change': '2024-09-13T17:16:11.546164+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546164+0000', 'last_undegraded': '2024-09-13T17:16:11.546164+0000', 'last_fullsized': '2024-09-13T17:16:11.546164+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546145+0000', 'last_change': '2024-09-13T17:16:11.546145+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546145+0000', 'last_undegraded': '2024-09-13T17:16:11.546145+0000', 'last_fullsized': '2024-09-13T17:16:11.546145+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.542366+0000', 'last_change': '2024-09-13T17:16:11.542366+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.542366+0000', 'last_undegraded': '2024-09-13T17:16:11.542366+0000', 'last_fullsized': '2024-09-13T17:16:11.542366+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2024-09-13T17:16:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T17:16:12.538332+0000', 'last_change': '2024-09-13T17:16:12.538332+0000', 'last_active': '2024-09-13T17:16:12.538332+0000', 'last_peered': '2024-09-13T17:16:12.538332+0000', 'last_clean': '2024-09-13T17:16:12.538332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:12.538332+0000', 'last_undegraded': '2024-09-13T17:16:12.538332+0000', 'last_fullsized': '2024-09-13T17:16:12.538332+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:12.538332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T17:16:16.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-09-13T17:16:16.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:16:11.546126+0000', 'last_change': '2024-09-13T17:16:11.546126+0000', 'last_active': '2024-09-13T17:16:11.532893+0000', 'last_peered': '2024-09-13T17:16:11.532893+0000', 'last_clean': '2024-09-13T17:16:11.532893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:16:11.546126+0000', 'last_undegraded': '2024-09-13T17:16:11.546126+0000', 'last_fullsized': '2024-09-13T17:16:11.546126+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'last_clean_scrub_stamp': '2024-09-13T17:16:11.532893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:16:16.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:16:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.820+0000 7fccb3708640 1 Processor -- start 2024-09-13T17:16:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.820+0000 7fccb3708640 1 -- start start 2024-09-13T17:16:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb3708640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb3708640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fccac0ad720 0x7fccac06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb3708640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac06c520 con 0x7fccac06c090 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb3708640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac15b900 con 0x7fccac0ad720 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb3708640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac06db00 con 0x7fccac157e20 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb14a4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb1ca5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fccac0ad720 0x7fccac06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb0ca3640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fccac06c090 0x7fccac0ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:34358/0 (socket says 172.21.15.5:34358) 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.821+0000 7fccb0ca3640 1 -- 172.21.15.5:0/1913435140 learned_addr learned my addr 172.21.15.5:0/1913435140 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fccb14a4640 1 -- 172.21.15.5:0/1913435140 >> v2:172.21.15.179:3300/0 conn(0x7fccac0ad720 msgr2=0x7fccac06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fccb14a4640 1 --2- 172.21.15.5:0/1913435140 >> v2:172.21.15.179:3300/0 conn(0x7fccac0ad720 0x7fccac06d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fccb14a4640 1 -- 172.21.15.5:0/1913435140 >> v1:172.21.15.179:6789/0 conn(0x7fccac06c090 legacy=0x7fccac0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fccb14a4640 1 -- 172.21.15.5:0/1913435140 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac06c800 con 0x7fccac157e20 2024-09-13T17:16:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fcc9ffff640 1 -- 172.21.15.5:0/1913435140 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983058067 0 0) 0x7fccac06c520 con 0x7fccac06c090 2024-09-13T17:16:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fccb14a4640 1 --2- 172.21.15.5:0/1913435140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac15b3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcca80097a0 tx=0x7fcca802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e1b2eeefcfca53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.822+0000 7fcc9ffff640 1 -- 172.21.15.5:0/1913435140 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8032440 con 0x7fccac157e20 2024-09-13T17:16:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fcc9ffff640 1 -- 172.21.15.5:0/1913435140 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80325a0 con 0x7fccac157e20 2024-09-13T17:16:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fcc9ffff640 1 -- 172.21.15.5:0/1913435140 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8032930 con 0x7fccac157e20 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 -- 172.21.15.5:0/1913435140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 msgr2=0x7fccac15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 --2- 172.21.15.5:0/1913435140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac15b3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcca80097a0 tx=0x7fcca802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 -- 172.21.15.5:0/1913435140 shutdown_connections 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 --2- 172.21.15.5:0/1913435140 >> v2:172.21.15.179:3300/0 conn(0x7fccac0ad720 0x7fccac06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 --2- 172.21.15.5:0/1913435140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac15b3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 -- 172.21.15.5:0/1913435140 >> 172.21.15.5:0/1913435140 conn(0x7fccac0ce130 msgr2=0x7fccac0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 -- 172.21.15.5:0/1913435140 shutdown_connections 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.823+0000 7fccb3708640 1 -- 172.21.15.5:0/1913435140 wait complete. 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.824+0000 7fccb3708640 1 Processor -- start 2024-09-13T17:16:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.824+0000 7fccb3708640 1 -- start start 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac1f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 0x7fccac1f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac070b10 con 0x7fccac0ad720 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac073430 con 0x7fccac070370 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb3708640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0708c0 con 0x7fccac157e20 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb14a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb14a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58776/0 (socket says 172.21.15.5:58776) 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.825+0000 7fccb14a4640 1 -- 172.21.15.5:0/662635775 learned_addr learned my addr 172.21.15.5:0/662635775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb0ca3640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac1f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb1ca5640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 0x7fccac1f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 -- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 msgr2=0x7fccac1f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac1f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 -- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 msgr2=0x7fccac1f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 0x7fccac1f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 -- 172.21.15.5:0/662635775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8009400 con 0x7fccac0ad720 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb1ca5640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 0x7fccac1f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb14a4640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcca8000c00 tx=0x7fcca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8032440 con 0x7fccac0ad720 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca8004250 con 0x7fccac0ad720 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac153c50 con 0x7fccac0ad720 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8006dd0 con 0x7fccac0ad720 2024-09-13T17:16:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.826+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac071a90 con 0x7fccac0ad720 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.827+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac0672a0 con 0x7fccac0ad720 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.828+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcca8039050 con 0x7fccac0ad720 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.828+0000 7fcc9dffb640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 0x7fcc9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.828+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcca80a9d90 con 0x7fccac0ad720 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.829+0000 7fccb0ca3640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 0x7fcc9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.829+0000 7fccb0ca3640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 0x7fcc9006d0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcca0007fd0 tx=0x7fcca0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:16.833+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcca8074e30 con 0x7fccac0ad720 2024-09-13T17:16:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.073+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fccac0ad500 con 0x7fccac0ad720 2024-09-13T17:16:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.073+0000 7fcc9dffb640 1 -- 172.21.15.5:0/662635775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1398 (secure 0 0 0) 0x7fcca804b080 con 0x7fccac0ad720 2024-09-13T17:16:17.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:17.075 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":205,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247581,"num_in_osds":8,"osd_in_since":1726247573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":245706752,"bytes_avail":772848406528,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6639}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-13T17:16:03.297176+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:16:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 msgr2=0x7fcc9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 0x7fcc9006d0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcca0007fd0 tx=0x7fcca0009040 comp rx=0 tx=0).stop 2024-09-13T17:16:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 msgr2=0x7fccac071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcca8000c00 tx=0x7fcca80046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 shutdown_connections 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccac070370 0x7fccac1f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccac157e20 0x7fccac1f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fcc9006ac30 0x7fcc9006d0f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 --2- 172.21.15.5:0/662635775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccac0ad720 0x7fccac071080 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 >> 172.21.15.5:0/662635775 conn(0x7fccac0ce130 msgr2=0x7fccac069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 shutdown_connections 2024-09-13T17:16:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.075+0000 7fccb3708640 1 -- 172.21.15.5:0/662635775 wait complete. 2024-09-13T17:16:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:16:17.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:16:17.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.187+0000 7f67e669c640 1 Processor -- start 2024-09-13T17:16:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.187+0000 7f67e669c640 1 -- start start 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e0156f40 0x7f67e015a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67e00b1080 0x7f67e006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e006dff0 0x7f67e00abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e006e480 con 0x7f67e0156f40 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e00b2390 con 0x7f67e00b1080 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e669c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00b14c0 con 0x7f67e006dff0 2024-09-13T17:16:17.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e0156f40 0x7f67e015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f67e0156f40 0x7f67e015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58790/0 (socket says 172.21.15.5:58790) 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 -- 172.21.15.5:0/1238275440 learned_addr learned my addr 172.21.15.5:0/1238275440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67df7fe640 1 --2- 172.21.15.5:0/1238275440 >> v2:172.21.15.179:3300/0 conn(0x7f67e00b1080 0x7f67e006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67e4c39640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e006dff0 0x7f67e00abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 -- 172.21.15.5:0/1238275440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e006dff0 msgr2=0x7f67e00abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e006dff0 0x7f67e00abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 -- 172.21.15.5:0/1238275440 >> v2:172.21.15.179:3300/0 conn(0x7f67e00b1080 msgr2=0x7f67e006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 --2- 172.21.15.5:0/1238275440 >> v2:172.21.15.179:3300/0 conn(0x7f67e00b1080 0x7f67e006dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.188+0000 7f67dffff640 1 -- 172.21.15.5:0/1238275440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00b1780 con 0x7f67e0156f40 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.189+0000 7f67dffff640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e0156f40 0x7f67e015a290 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f67e0072120 tx=0x7f67d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31680614835c593 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.189+0000 7f67deffd640 1 -- 172.21.15.5:0/1238275440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0032440 con 0x7f67e0156f40 2024-09-13T17:16:17.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.189+0000 7f67deffd640 1 -- 172.21.15.5:0/1238275440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d00325a0 con 0x7f67e0156f40 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.189+0000 7f67deffd640 1 -- 172.21.15.5:0/1238275440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0032930 con 0x7f67e0156f40 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 -- 172.21.15.5:0/1238275440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e0156f40 msgr2=0x7f67e015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e0156f40 0x7f67e015a290 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f67e0072120 tx=0x7f67d002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 -- 172.21.15.5:0/1238275440 shutdown_connections 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e006dff0 0x7f67e00abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 --2- 172.21.15.5:0/1238275440 >> v2:172.21.15.179:3300/0 conn(0x7f67e00b1080 0x7f67e006dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 --2- 172.21.15.5:0/1238275440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e0156f40 0x7f67e015a290 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 -- 172.21.15.5:0/1238275440 >> 172.21.15.5:0/1238275440 conn(0x7f67e00ce0d0 msgr2=0x7f67e00ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 -- 172.21.15.5:0/1238275440 shutdown_connections 2024-09-13T17:16:17.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.190+0000 7f67e669c640 1 -- 172.21.15.5:0/1238275440 wait complete. 2024-09-13T17:16:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.191+0000 7f67e669c640 1 Processor -- start 2024-09-13T17:16:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.191+0000 7f67e669c640 1 -- start start 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e00b1080 0x7f67e0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e0156f40 0x7f67e014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e0154800 con 0x7f67e006dff0 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e0153bf0 con 0x7f67e00b1080 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e669c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e0153ed0 con 0x7f67e0156f40 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58802/0 (socket says 172.21.15.5:58802) 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 -- 172.21.15.5:0/3002534803 learned_addr learned my addr 172.21.15.5:0/3002534803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67df7fe640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e00b1080 0x7f67e0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67e4c39640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e0156f40 0x7f67e014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 -- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e0156f40 msgr2=0x7f67e014e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e0156f40 0x7f67e014e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 -- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e00b1080 msgr2=0x7f67e0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e00b1080 0x7f67e0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.192+0000 7f67dffff640 1 -- 172.21.15.5:0/3002534803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00094d0 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67dffff640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f67d002a220 tx=0x7f67d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0032440 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0030ba0 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d003d440 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e01541b0 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.193+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e0151e90 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.194+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e00672a0 con 0x7f67e006dff0 2024-09-13T17:16:17.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.194+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f67d0039040 con 0x7f67e006dff0 2024-09-13T17:16:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.195+0000 7f67dcff9640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 0x7f67cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.195+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f67d00aa050 con 0x7f67e006dff0 2024-09-13T17:16:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.195+0000 7f67df7fe640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 0x7f67cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.196+0000 7f67df7fe640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 0x7f67cc06d0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67e01434d0 tx=0x7f67d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.199+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f67d00750f0 con 0x7f67e006dff0 2024-09-13T17:16:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.367+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67e00b2020 con 0x7f67cc06ac00 2024-09-13T17:16:17.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.374+0000 7f67dcff9640 1 -- 172.21.15.5:0/3002534803 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289302 (secure 0 0 0) 0x7f67d400b200 con 0x7f67cc06ac00 2024-09-13T17:16:17.379 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:16:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 msgr2=0x7f67cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 0x7f67cc06d0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67e01434d0 tx=0x7f67d4008040 comp rx=0 tx=0).stop 2024-09-13T17:16:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 msgr2=0x7f67e0142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f67d002a220 tx=0x7f67d00046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 shutdown_connections 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e0156f40 0x7f67e014e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e00b1080 0x7f67e0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f67cc06ac00 0x7f67cc06d0c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 --2- 172.21.15.5:0/3002534803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e006dff0 0x7f67e0142f90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 >> 172.21.15.5:0/3002534803 conn(0x7f67e00ce0d0 msgr2=0x7f67e00cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 shutdown_connections 2024-09-13T17:16:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:17.378+0000 7f67e669c640 1 -- 172.21.15.5:0/3002534803 wait complete. 2024-09-13T17:16:17.390 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-13T17:16:17.300354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240320,"kb_used_data":7752,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734400,"statfs":{"total":773094113280,"available":772848025600,"internally_reserved":0,"allocated":7938048,"data_stored":4196604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.760790"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085050+0000","last_change":"2024-09-13T17:16:12.996472+0000","last_active":"2024-09-13T17:16:15.085050+0000","last_peered":"2024-09-13T17:16:15.085050+0000","last_clean":"2024-09-13T17:16:15.085050+0000","last_became_active":"2024-09-13T17:16:12.996228+0000","last_became_peered":"2024-09-13T17:16:12.996228+0000","last_unstale":"2024-09-13T17:16:15.085050+0000","last_undegraded":"2024-09-13T17:16:15.085050+0000","last_fullsized":"2024-09-13T17:16:15.085050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084877+0000","last_change":"2024-09-13T17:16:12.990947+0000","last_active":"2024-09-13T17:16:15.084877+0000","last_peered":"2024-09-13T17:16:15.084877+0000","last_clean":"2024-09-13T17:16:15.084877+0000","last_became_active":"2024-09-13T17:16:12.990707+0000","last_became_peered":"2024-09-13T17:16:12.990707+0000","last_unstale":"2024-09-13T17:16:15.084877+0000","last_undegraded":"2024-09-13T17:16:15.084877+0000","last_fullsized":"2024-09-13T17:16:15.084877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984790+0000","last_change":"2024-09-13T17:16:12.992135+0000","last_active":"2024-09-13T17:16:13.984790+0000","last_peered":"2024-09-13T17:16:13.984790+0000","last_clean":"2024-09-13T17:16:13.984790+0000","last_became_active":"2024-09-13T17:16:12.991770+0000","last_became_peered":"2024-09-13T17:16:12.991770+0000","last_unstale":"2024-09-13T17:16:13.984790+0000","last_undegraded":"2024-09-13T17:16:13.984790+0000","last_fullsized":"2024-09-13T17:16:13.984790+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:12.161469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982609+0000","last_change":"2024-09-13T17:16:12.995607+0000","last_active":"2024-09-13T17:16:13.982609+0000","last_peered":"2024-09-13T17:16:13.982609+0000","last_clean":"2024-09-13T17:16:13.982609+0000","last_became_active":"2024-09-13T17:16:12.994001+0000","last_became_peered":"2024-09-13T17:16:12.994001+0000","last_unstale":"2024-09-13T17:16:13.982609+0000","last_undegraded":"2024-09-13T17:16:13.982609+0000","last_fullsized":"2024-09-13T17:16:13.982609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:04.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365854+0000","last_change":"2024-09-13T17:16:12.999914+0000","last_active":"2024-09-13T17:16:14.365854+0000","last_peered":"2024-09-13T17:16:14.365854+0000","last_clean":"2024-09-13T17:16:14.365854+0000","last_became_active":"2024-09-13T17:16:12.999546+0000","last_became_peered":"2024-09-13T17:16:12.999546+0000","last_unstale":"2024-09-13T17:16:14.365854+0000","last_undegraded":"2024-09-13T17:16:14.365854+0000","last_fullsized":"2024-09-13T17:16:14.365854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.280692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085242+0000","last_change":"2024-09-13T17:16:12.987843+0000","last_active":"2024-09-13T17:16:15.085242+0000","last_peered":"2024-09-13T17:16:15.085242+0000","last_clean":"2024-09-13T17:16:15.085242+0000","last_became_active":"2024-09-13T17:16:12.987575+0000","last_became_peered":"2024-09-13T17:16:12.987575+0000","last_unstale":"2024-09-13T17:16:15.085242+0000","last_undegraded":"2024-09-13T17:16:15.085242+0000","last_fullsized":"2024-09-13T17:16:15.085242+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:49.128142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979972+0000","last_change":"2024-09-13T17:16:12.987578+0000","last_active":"2024-09-13T17:16:13.979972+0000","last_peered":"2024-09-13T17:16:13.979972+0000","last_clean":"2024-09-13T17:16:13.979972+0000","last_became_active":"2024-09-13T17:16:12.987316+0000","last_became_peered":"2024-09-13T17:16:12.987316+0000","last_unstale":"2024-09-13T17:16:13.979972+0000","last_undegraded":"2024-09-13T17:16:13.979972+0000","last_fullsized":"2024-09-13T17:16:13.979972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981958+0000","last_change":"2024-09-13T17:16:12.986227+0000","last_active":"2024-09-13T17:16:13.981958+0000","last_peered":"2024-09-13T17:16:13.981958+0000","last_clean":"2024-09-13T17:16:13.981958+0000","last_became_active":"2024-09-13T17:16:12.985953+0000","last_became_peered":"2024-09-13T17:16:12.985953+0000","last_unstale":"2024-09-13T17:16:13.981958+0000","last_undegraded":"2024-09-13T17:16:13.981958+0000","last_fullsized":"2024-09-13T17:16:13.981958+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:49.414955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984832+0000","last_change":"2024-09-13T17:16:12.987994+0000","last_active":"2024-09-13T17:16:13.984832+0000","last_peered":"2024-09-13T17:16:13.984832+0000","last_clean":"2024-09-13T17:16:13.984832+0000","last_became_active":"2024-09-13T17:16:12.987736+0000","last_became_peered":"2024-09-13T17:16:12.987736+0000","last_unstale":"2024-09-13T17:16:13.984832+0000","last_undegraded":"2024-09-13T17:16:13.984832+0000","last_fullsized":"2024-09-13T17:16:13.984832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:22.405009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984657+0000","last_change":"2024-09-13T17:16:12.989808+0000","last_active":"2024-09-13T17:16:13.984657+0000","last_peered":"2024-09-13T17:16:13.984657+0000","last_clean":"2024-09-13T17:16:13.984657+0000","last_became_active":"2024-09-13T17:16:12.989530+0000","last_became_peered":"2024-09-13T17:16:12.989530+0000","last_unstale":"2024-09-13T17:16:13.984657+0000","last_undegraded":"2024-09-13T17:16:13.984657+0000","last_fullsized":"2024-09-13T17:16:13.984657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:10.905248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982405+0000","last_change":"2024-09-13T17:16:12.999768+0000","last_active":"2024-09-13T17:16:13.982405+0000","last_peered":"2024-09-13T17:16:13.982405+0000","last_clean":"2024-09-13T17:16:13.982405+0000","last_became_active":"2024-09-13T17:16:12.999490+0000","last_became_peered":"2024-09-13T17:16:12.999490+0000","last_unstale":"2024-09-13T17:16:13.982405+0000","last_undegraded":"2024-09-13T17:16:13.982405+0000","last_fullsized":"2024-09-13T17:16:13.982405+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:29.534667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981739+0000","last_change":"2024-09-13T17:16:12.985805+0000","last_active":"2024-09-13T17:16:13.981739+0000","last_peered":"2024-09-13T17:16:13.981739+0000","last_clean":"2024-09-13T17:16:13.981739+0000","last_became_active":"2024-09-13T17:16:12.985207+0000","last_became_peered":"2024-09-13T17:16:12.985207+0000","last_unstale":"2024-09-13T17:16:13.981739+0000","last_undegraded":"2024-09-13T17:16:13.981739+0000","last_fullsized":"2024-09-13T17:16:13.981739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:19.826982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981787+0000","last_change":"2024-09-13T17:16:12.992768+0000","last_active":"2024-09-13T17:16:13.981787+0000","last_peered":"2024-09-13T17:16:13.981787+0000","last_clean":"2024-09-13T17:16:13.981787+0000","last_became_active":"2024-09-13T17:16:12.991803+0000","last_became_peered":"2024-09-13T17:16:12.991803+0000","last_unstale":"2024-09-13T17:16:13.981787+0000","last_undegraded":"2024-09-13T17:16:13.981787+0000","last_fullsized":"2024-09-13T17:16:13.981787+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:01.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984596+0000","last_change":"2024-09-13T17:16:12.990004+0000","last_active":"2024-09-13T17:16:13.984596+0000","last_peered":"2024-09-13T17:16:13.984596+0000","last_clean":"2024-09-13T17:16:13.984596+0000","last_became_active":"2024-09-13T17:16:12.989737+0000","last_became_peered":"2024-09-13T17:16:12.989737+0000","last_unstale":"2024-09-13T17:16:13.984596+0000","last_undegraded":"2024-09-13T17:16:13.984596+0000","last_fullsized":"2024-09-13T17:16:13.984596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:26.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984446+0000","last_change":"2024-09-13T17:16:12.991427+0000","last_active":"2024-09-13T17:16:13.984446+0000","last_peered":"2024-09-13T17:16:13.984446+0000","last_clean":"2024-09-13T17:16:13.984446+0000","last_became_active":"2024-09-13T17:16:12.991082+0000","last_became_peered":"2024-09-13T17:16:12.991082+0000","last_unstale":"2024-09-13T17:16:13.984446+0000","last_undegraded":"2024-09-13T17:16:13.984446+0000","last_fullsized":"2024-09-13T17:16:13.984446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979959+0000","last_change":"2024-09-13T17:16:12.983578+0000","last_active":"2024-09-13T17:16:13.979959+0000","last_peered":"2024-09-13T17:16:13.979959+0000","last_clean":"2024-09-13T17:16:13.979959+0000","last_became_active":"2024-09-13T17:16:12.983342+0000","last_became_peered":"2024-09-13T17:16:12.983342+0000","last_unstale":"2024-09-13T17:16:13.979959+0000","last_undegraded":"2024-09-13T17:16:13.979959+0000","last_fullsized":"2024-09-13T17:16:13.979959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:15.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085149+0000","last_change":"2024-09-13T17:16:12.998310+0000","last_active":"2024-09-13T17:16:15.085149+0000","last_peered":"2024-09-13T17:16:15.085149+0000","last_clean":"2024-09-13T17:16:15.085149+0000","last_became_active":"2024-09-13T17:16:12.998034+0000","last_became_peered":"2024-09-13T17:16:12.998034+0000","last_unstale":"2024-09-13T17:16:15.085149+0000","last_undegraded":"2024-09-13T17:16:15.085149+0000","last_fullsized":"2024-09-13T17:16:15.085149+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:03.607391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982658+0000","last_change":"2024-09-13T17:16:12.995427+0000","last_active":"2024-09-13T17:16:13.982658+0000","last_peered":"2024-09-13T17:16:13.982658+0000","last_clean":"2024-09-13T17:16:13.982658+0000","last_became_active":"2024-09-13T17:16:12.993299+0000","last_became_peered":"2024-09-13T17:16:12.993299+0000","last_unstale":"2024-09-13T17:16:13.982658+0000","last_undegraded":"2024-09-13T17:16:13.982658+0000","last_fullsized":"2024-09-13T17:16:13.982658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:12.687029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366001+0000","last_change":"2024-09-13T17:16:12.988550+0000","last_active":"2024-09-13T17:16:14.366001+0000","last_peered":"2024-09-13T17:16:14.366001+0000","last_clean":"2024-09-13T17:16:14.366001+0000","last_became_active":"2024-09-13T17:16:12.988271+0000","last_became_peered":"2024-09-13T17:16:12.988271+0000","last_unstale":"2024-09-13T17:16:14.366001+0000","last_undegraded":"2024-09-13T17:16:14.366001+0000","last_fullsized":"2024-09-13T17:16:14.366001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:16.556363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372091+0000","last_change":"2024-09-13T17:16:12.999691+0000","last_active":"2024-09-13T17:16:14.372091+0000","last_peered":"2024-09-13T17:16:14.372091+0000","last_clean":"2024-09-13T17:16:14.372091+0000","last_became_active":"2024-09-13T17:16:12.999415+0000","last_became_peered":"2024-09-13T17:16:12.999415+0000","last_unstale":"2024-09-13T17:16:14.372091+0000","last_undegraded":"2024-09-13T17:16:14.372091+0000","last_fullsized":"2024-09-13T17:16:14.372091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:17.790250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982192+0000","last_change":"2024-09-13T17:16:12.986678+0000","last_active":"2024-09-13T17:16:13.982192+0000","last_peered":"2024-09-13T17:16:13.982192+0000","last_clean":"2024-09-13T17:16:13.982192+0000","last_became_active":"2024-09-13T17:16:12.986436+0000","last_became_peered":"2024-09-13T17:16:12.986436+0000","last_unstale":"2024-09-13T17:16:13.982192+0000","last_undegraded":"2024-09-13T17:16:13.982192+0000","last_fullsized":"2024-09-13T17:16:13.982192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:46.373530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372033+0000","last_change":"2024-09-13T17:16:12.986296+0000","last_active":"2024-09-13T17:16:14.372033+0000","last_peered":"2024-09-13T17:16:14.372033+0000","last_clean":"2024-09-13T17:16:14.372033+0000","last_became_active":"2024-09-13T17:16:12.986030+0000","last_became_peered":"2024-09-13T17:16:12.986030+0000","last_unstale":"2024-09-13T17:16:14.372033+0000","last_undegraded":"2024-09-13T17:16:14.372033+0000","last_fullsized":"2024-09-13T17:16:14.372033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.358303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.371959+0000","last_change":"2024-09-13T17:16:12.986311+0000","last_active":"2024-09-13T17:16:14.371959+0000","last_peered":"2024-09-13T17:16:14.371959+0000","last_clean":"2024-09-13T17:16:14.371959+0000","last_became_active":"2024-09-13T17:16:12.986048+0000","last_became_peered":"2024-09-13T17:16:12.986048+0000","last_unstale":"2024-09-13T17:16:14.371959+0000","last_undegraded":"2024-09-13T17:16:14.371959+0000","last_fullsized":"2024-09-13T17:16:14.371959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:23.217853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984567+0000","last_change":"2024-09-13T17:16:12.990548+0000","last_active":"2024-09-13T17:16:13.984567+0000","last_peered":"2024-09-13T17:16:13.984567+0000","last_clean":"2024-09-13T17:16:13.984567+0000","last_became_active":"2024-09-13T17:16:12.990309+0000","last_became_peered":"2024-09-13T17:16:12.990309+0000","last_unstale":"2024-09-13T17:16:13.984567+0000","last_undegraded":"2024-09-13T17:16:13.984567+0000","last_fullsized":"2024-09-13T17:16:13.984567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.101697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981972+0000","last_change":"2024-09-13T17:16:12.982360+0000","last_active":"2024-09-13T17:16:13.981972+0000","last_peered":"2024-09-13T17:16:13.981972+0000","last_clean":"2024-09-13T17:16:13.981972+0000","last_became_active":"2024-09-13T17:16:12.982119+0000","last_became_peered":"2024-09-13T17:16:12.982119+0000","last_unstale":"2024-09-13T17:16:13.981972+0000","last_undegraded":"2024-09-13T17:16:13.981972+0000","last_fullsized":"2024-09-13T17:16:13.981972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981702+0000","last_change":"2024-09-13T17:16:12.982974+0000","last_active":"2024-09-13T17:16:13.981702+0000","last_peered":"2024-09-13T17:16:13.981702+0000","last_clean":"2024-09-13T17:16:13.981702+0000","last_became_active":"2024-09-13T17:16:12.982706+0000","last_became_peered":"2024-09-13T17:16:12.982706+0000","last_unstale":"2024-09-13T17:16:13.981702+0000","last_undegraded":"2024-09-13T17:16:13.981702+0000","last_fullsized":"2024-09-13T17:16:13.981702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:53.938624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982771+0000","last_change":"2024-09-13T17:16:12.987226+0000","last_active":"2024-09-13T17:16:13.982771+0000","last_peered":"2024-09-13T17:16:13.982771+0000","last_clean":"2024-09-13T17:16:13.982771+0000","last_became_active":"2024-09-13T17:16:12.986907+0000","last_became_peered":"2024-09-13T17:16:12.986907+0000","last_unstale":"2024-09-13T17:16:13.982771+0000","last_undegraded":"2024-09-13T17:16:13.982771+0000","last_fullsized":"2024-09-13T17:16:13.982771+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:33.431487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084959+0000","last_change":"2024-09-13T17:16:12.997573+0000","last_active":"2024-09-13T17:16:15.084959+0000","last_peered":"2024-09-13T17:16:15.084959+0000","last_clean":"2024-09-13T17:16:15.084959+0000","last_became_active":"2024-09-13T17:16:12.997329+0000","last_became_peered":"2024-09-13T17:16:12.997329+0000","last_unstale":"2024-09-13T17:16:15.084959+0000","last_undegraded":"2024-09-13T17:16:15.084959+0000","last_fullsized":"2024-09-13T17:16:15.084959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:01.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984565+0000","last_change":"2024-09-13T17:16:12.989147+0000","last_active":"2024-09-13T17:16:13.984565+0000","last_peered":"2024-09-13T17:16:13.984565+0000","last_clean":"2024-09-13T17:16:13.984565+0000","last_became_active":"2024-09-13T17:16:12.988760+0000","last_became_peered":"2024-09-13T17:16:12.988760+0000","last_unstale":"2024-09-13T17:16:13.984565+0000","last_undegraded":"2024-09-13T17:16:13.984565+0000","last_fullsized":"2024-09-13T17:16:13.984565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:48.672452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981755+0000","last_change":"2024-09-13T17:16:12.985639+0000","last_active":"2024-09-13T17:16:13.981755+0000","last_peered":"2024-09-13T17:16:13.981755+0000","last_clean":"2024-09-13T17:16:13.981755+0000","last_became_active":"2024-09-13T17:16:12.985354+0000","last_became_peered":"2024-09-13T17:16:12.985354+0000","last_unstale":"2024-09-13T17:16:13.981755+0000","last_undegraded":"2024-09-13T17:16:13.981755+0000","last_fullsized":"2024-09-13T17:16:13.981755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:03.607391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982625+0000","last_change":"2024-09-13T17:16:12.987449+0000","last_active":"2024-09-13T17:16:13.982625+0000","last_peered":"2024-09-13T17:16:13.982625+0000","last_clean":"2024-09-13T17:16:13.982625+0000","last_became_active":"2024-09-13T17:16:12.987132+0000","last_became_peered":"2024-09-13T17:16:12.987132+0000","last_unstale":"2024-09-13T17:16:13.982625+0000","last_undegraded":"2024-09-13T17:16:13.982625+0000","last_fullsized":"2024-09-13T17:16:13.982625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:16.556363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084504+0000","last_change":"2024-09-13T17:16:12.989736+0000","last_active":"2024-09-13T17:16:15.084504+0000","last_peered":"2024-09-13T17:16:15.084504+0000","last_clean":"2024-09-13T17:16:15.084504+0000","last_became_active":"2024-09-13T17:16:12.989482+0000","last_became_peered":"2024-09-13T17:16:12.989482+0000","last_unstale":"2024-09-13T17:16:15.084504+0000","last_undegraded":"2024-09-13T17:16:15.084504+0000","last_fullsized":"2024-09-13T17:16:15.084504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.358303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365985+0000","last_change":"2024-09-13T17:16:12.992623+0000","last_active":"2024-09-13T17:16:14.365985+0000","last_peered":"2024-09-13T17:16:14.365985+0000","last_clean":"2024-09-13T17:16:14.365985+0000","last_became_active":"2024-09-13T17:16:12.992334+0000","last_became_peered":"2024-09-13T17:16:12.992334+0000","last_unstale":"2024-09-13T17:16:14.365985+0000","last_undegraded":"2024-09-13T17:16:14.365985+0000","last_fullsized":"2024-09-13T17:16:14.365985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:22.405009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"68'4","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.998888+0000","last_change":"2024-09-13T17:16:12.567752+0000","last_active":"2024-09-13T17:16:12.998888+0000","last_peered":"2024-09-13T17:16:12.998888+0000","last_clean":"2024-09-13T17:16:12.998888+0000","last_became_active":"2024-09-13T17:16:12.567216+0000","last_became_peered":"2024-09-13T17:16:12.567216+0000","last_unstale":"2024-09-13T17:16:12.998888+0000","last_undegraded":"2024-09-13T17:16:12.998888+0000","last_fullsized":"2024-09-13T17:16:12.998888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982855+0000","last_change":"2024-09-13T17:16:13.002034+0000","last_active":"2024-09-13T17:16:13.982855+0000","last_peered":"2024-09-13T17:16:13.982855+0000","last_clean":"2024-09-13T17:16:13.982855+0000","last_became_active":"2024-09-13T17:16:13.001742+0000","last_became_peered":"2024-09-13T17:16:13.001742+0000","last_unstale":"2024-09-13T17:16:13.982855+0000","last_undegraded":"2024-09-13T17:16:13.982855+0000","last_fullsized":"2024-09-13T17:16:13.982855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:11.768473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.995522+0000","last_change":"2024-09-13T17:16:12.565170+0000","last_active":"2024-09-13T17:16:12.995522+0000","last_peered":"2024-09-13T17:16:12.995522+0000","last_clean":"2024-09-13T17:16:12.995522+0000","last_became_active":"2024-09-13T17:16:12.564863+0000","last_became_peered":"2024-09-13T17:16:12.564863+0000","last_unstale":"2024-09-13T17:16:12.995522+0000","last_undegraded":"2024-09-13T17:16:12.995522+0000","last_fullsized":"2024-09-13T17:16:12.995522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085406+0000","last_change":"2024-09-13T17:16:12.989786+0000","last_active":"2024-09-13T17:16:15.085406+0000","last_peered":"2024-09-13T17:16:15.085406+0000","last_clean":"2024-09-13T17:16:15.085406+0000","last_became_active":"2024-09-13T17:16:12.989529+0000","last_became_peered":"2024-09-13T17:16:12.989529+0000","last_unstale":"2024-09-13T17:16:15.085406+0000","last_undegraded":"2024-09-13T17:16:15.085406+0000","last_fullsized":"2024-09-13T17:16:15.085406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:00.832082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.997060+0000","last_change":"2024-09-13T17:16:12.555192+0000","last_active":"2024-09-13T17:16:12.997060+0000","last_peered":"2024-09-13T17:16:12.997060+0000","last_clean":"2024-09-13T17:16:12.997060+0000","last_became_active":"2024-09-13T17:16:12.554910+0000","last_became_peered":"2024-09-13T17:16:12.554910+0000","last_unstale":"2024-09-13T17:16:12.997060+0000","last_undegraded":"2024-09-13T17:16:12.997060+0000","last_fullsized":"2024-09-13T17:16:12.997060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984817+0000","last_change":"2024-09-13T17:16:12.993630+0000","last_active":"2024-09-13T17:16:13.984817+0000","last_peered":"2024-09-13T17:16:13.984817+0000","last_clean":"2024-09-13T17:16:13.984817+0000","last_became_active":"2024-09-13T17:16:12.993125+0000","last_became_peered":"2024-09-13T17:16:12.993125+0000","last_unstale":"2024-09-13T17:16:13.984817+0000","last_undegraded":"2024-09-13T17:16:13.984817+0000","last_fullsized":"2024-09-13T17:16:13.984817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.992812+0000","last_change":"2024-09-13T17:16:12.556707+0000","last_active":"2024-09-13T17:16:12.992812+0000","last_peered":"2024-09-13T17:16:12.992812+0000","last_clean":"2024-09-13T17:16:12.992812+0000","last_became_active":"2024-09-13T17:16:12.556386+0000","last_became_peered":"2024-09-13T17:16:12.556386+0000","last_unstale":"2024-09-13T17:16:12.992812+0000","last_undegraded":"2024-09-13T17:16:12.992812+0000","last_fullsized":"2024-09-13T17:16:12.992812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979959+0000","last_change":"2024-09-13T17:16:12.984854+0000","last_active":"2024-09-13T17:16:13.979959+0000","last_peered":"2024-09-13T17:16:13.979959+0000","last_clean":"2024-09-13T17:16:13.979959+0000","last_became_active":"2024-09-13T17:16:12.984603+0000","last_became_peered":"2024-09-13T17:16:12.984603+0000","last_unstale":"2024-09-13T17:16:13.979959+0000","last_undegraded":"2024-09-13T17:16:13.979959+0000","last_fullsized":"2024-09-13T17:16:13.979959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:43.236728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.989746+0000","last_change":"2024-09-13T17:16:12.558443+0000","last_active":"2024-09-13T17:16:12.989746+0000","last_peered":"2024-09-13T17:16:12.989746+0000","last_clean":"2024-09-13T17:16:12.989746+0000","last_became_active":"2024-09-13T17:16:12.558122+0000","last_became_peered":"2024-09-13T17:16:12.558122+0000","last_unstale":"2024-09-13T17:16:12.989746+0000","last_undegraded":"2024-09-13T17:16:12.989746+0000","last_fullsized":"2024-09-13T17:16:12.989746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084644+0000","last_change":"2024-09-13T17:16:12.998925+0000","last_active":"2024-09-13T17:16:15.084644+0000","last_peered":"2024-09-13T17:16:15.084644+0000","last_clean":"2024-09-13T17:16:15.084644+0000","last_became_active":"2024-09-13T17:16:12.998580+0000","last_became_peered":"2024-09-13T17:16:12.998580+0000","last_unstale":"2024-09-13T17:16:15.084644+0000","last_undegraded":"2024-09-13T17:16:15.084644+0000","last_fullsized":"2024-09-13T17:16:15.084644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:41.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.985766+0000","last_change":"2024-09-13T17:16:12.560370+0000","last_active":"2024-09-13T17:16:12.985766+0000","last_peered":"2024-09-13T17:16:12.985766+0000","last_clean":"2024-09-13T17:16:12.985766+0000","last_became_active":"2024-09-13T17:16:12.560074+0000","last_became_peered":"2024-09-13T17:16:12.560074+0000","last_unstale":"2024-09-13T17:16:12.985766+0000","last_undegraded":"2024-09-13T17:16:12.985766+0000","last_fullsized":"2024-09-13T17:16:12.985766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365768+0000","last_change":"2024-09-13T17:16:12.999010+0000","last_active":"2024-09-13T17:16:14.365768+0000","last_peered":"2024-09-13T17:16:14.365768+0000","last_clean":"2024-09-13T17:16:14.365768+0000","last_became_active":"2024-09-13T17:16:12.998782+0000","last_became_peered":"2024-09-13T17:16:12.998782+0000","last_unstale":"2024-09-13T17:16:14.365768+0000","last_undegraded":"2024-09-13T17:16:14.365768+0000","last_fullsized":"2024-09-13T17:16:14.365768+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:12.687029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978474+0000","last_change":"2024-09-13T17:16:12.561174+0000","last_active":"2024-09-13T17:16:12.978474+0000","last_peered":"2024-09-13T17:16:12.978474+0000","last_clean":"2024-09-13T17:16:12.978474+0000","last_became_active":"2024-09-13T17:16:12.560889+0000","last_became_peered":"2024-09-13T17:16:12.560889+0000","last_unstale":"2024-09-13T17:16:12.978474+0000","last_undegraded":"2024-09-13T17:16:12.978474+0000","last_fullsized":"2024-09-13T17:16:12.978474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372169+0000","last_change":"2024-09-13T17:16:12.987989+0000","last_active":"2024-09-13T17:16:14.372169+0000","last_peered":"2024-09-13T17:16:14.372169+0000","last_clean":"2024-09-13T17:16:14.372169+0000","last_became_active":"2024-09-13T17:16:12.987739+0000","last_became_peered":"2024-09-13T17:16:12.987739+0000","last_unstale":"2024-09-13T17:16:14.372169+0000","last_undegraded":"2024-09-13T17:16:14.372169+0000","last_fullsized":"2024-09-13T17:16:14.372169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:49.128142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.986065+0000","last_change":"2024-09-13T17:16:12.564452+0000","last_active":"2024-09-13T17:16:12.986065+0000","last_peered":"2024-09-13T17:16:12.986065+0000","last_clean":"2024-09-13T17:16:12.986065+0000","last_became_active":"2024-09-13T17:16:12.564176+0000","last_became_peered":"2024-09-13T17:16:12.564176+0000","last_unstale":"2024-09-13T17:16:12.986065+0000","last_undegraded":"2024-09-13T17:16:12.986065+0000","last_fullsized":"2024-09-13T17:16:12.986065+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085060+0000","last_change":"2024-09-13T17:16:12.988478+0000","last_active":"2024-09-13T17:16:15.085060+0000","last_peered":"2024-09-13T17:16:15.085060+0000","last_clean":"2024-09-13T17:16:15.085060+0000","last_became_active":"2024-09-13T17:16:12.988140+0000","last_became_peered":"2024-09-13T17:16:12.988140+0000","last_unstale":"2024-09-13T17:16:15.085060+0000","last_undegraded":"2024-09-13T17:16:15.085060+0000","last_fullsized":"2024-09-13T17:16:15.085060+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:48.672452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979348+0000","last_change":"2024-09-13T17:16:12.569646+0000","last_active":"2024-09-13T17:16:12.979348+0000","last_peered":"2024-09-13T17:16:12.979348+0000","last_clean":"2024-09-13T17:16:12.979348+0000","last_became_active":"2024-09-13T17:16:12.569382+0000","last_became_peered":"2024-09-13T17:16:12.569382+0000","last_unstale":"2024-09-13T17:16:12.979348+0000","last_undegraded":"2024-09-13T17:16:12.979348+0000","last_fullsized":"2024-09-13T17:16:12.979348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372185+0000","last_change":"2024-09-13T17:16:12.993642+0000","last_active":"2024-09-13T17:16:14.372185+0000","last_peered":"2024-09-13T17:16:14.372185+0000","last_clean":"2024-09-13T17:16:14.372185+0000","last_became_active":"2024-09-13T17:16:12.993320+0000","last_became_peered":"2024-09-13T17:16:12.993320+0000","last_unstale":"2024-09-13T17:16:14.372185+0000","last_undegraded":"2024-09-13T17:16:14.372185+0000","last_fullsized":"2024-09-13T17:16:14.372185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:56.897116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.985592+0000","last_change":"2024-09-13T17:16:12.566862+0000","last_active":"2024-09-13T17:16:12.985592+0000","last_peered":"2024-09-13T17:16:12.985592+0000","last_clean":"2024-09-13T17:16:12.985592+0000","last_became_active":"2024-09-13T17:16:12.566304+0000","last_became_peered":"2024-09-13T17:16:12.566304+0000","last_unstale":"2024-09-13T17:16:12.985592+0000","last_undegraded":"2024-09-13T17:16:12.985592+0000","last_fullsized":"2024-09-13T17:16:12.985592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366067+0000","last_change":"2024-09-13T17:16:12.997086+0000","last_active":"2024-09-13T17:16:14.366067+0000","last_peered":"2024-09-13T17:16:14.366067+0000","last_clean":"2024-09-13T17:16:14.366067+0000","last_became_active":"2024-09-13T17:16:12.996794+0000","last_became_peered":"2024-09-13T17:16:12.996794+0000","last_unstale":"2024-09-13T17:16:14.366067+0000","last_undegraded":"2024-09-13T17:16:14.366067+0000","last_fullsized":"2024-09-13T17:16:14.366067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:16.583438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"68'3","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.004319+0000","last_change":"2024-09-13T17:16:12.569602+0000","last_active":"2024-09-13T17:16:13.004319+0000","last_peered":"2024-09-13T17:16:13.004319+0000","last_clean":"2024-09-13T17:16:13.004319+0000","last_became_active":"2024-09-13T17:16:12.569354+0000","last_became_peered":"2024-09-13T17:16:12.569354+0000","last_unstale":"2024-09-13T17:16:13.004319+0000","last_undegraded":"2024-09-13T17:16:13.004319+0000","last_fullsized":"2024-09-13T17:16:13.004319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982778+0000","last_change":"2024-09-13T17:16:12.988003+0000","last_active":"2024-09-13T17:16:13.982778+0000","last_peered":"2024-09-13T17:16:13.982778+0000","last_clean":"2024-09-13T17:16:13.982778+0000","last_became_active":"2024-09-13T17:16:12.987692+0000","last_became_peered":"2024-09-13T17:16:12.987692+0000","last_unstale":"2024-09-13T17:16:13.982778+0000","last_undegraded":"2024-09-13T17:16:13.982778+0000","last_fullsized":"2024-09-13T17:16:13.982778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:11.247859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"68'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006447+0000","last_change":"2024-09-13T17:16:12.557830+0000","last_active":"2024-09-13T17:16:13.006447+0000","last_peered":"2024-09-13T17:16:13.006447+0000","last_clean":"2024-09-13T17:16:13.006447+0000","last_became_active":"2024-09-13T17:16:12.557515+0000","last_became_peered":"2024-09-13T17:16:12.557515+0000","last_unstale":"2024-09-13T17:16:13.006447+0000","last_undegraded":"2024-09-13T17:16:13.006447+0000","last_fullsized":"2024-09-13T17:16:13.006447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982764+0000","last_change":"2024-09-13T17:16:12.987574+0000","last_active":"2024-09-13T17:16:13.982764+0000","last_peered":"2024-09-13T17:16:13.982764+0000","last_clean":"2024-09-13T17:16:13.982764+0000","last_became_active":"2024-09-13T17:16:12.987154+0000","last_became_peered":"2024-09-13T17:16:12.987154+0000","last_unstale":"2024-09-13T17:16:13.982764+0000","last_undegraded":"2024-09-13T17:16:13.982764+0000","last_fullsized":"2024-09-13T17:16:13.982764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:50.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006589+0000","last_change":"2024-09-13T17:16:12.563290+0000","last_active":"2024-09-13T17:16:13.006589+0000","last_peered":"2024-09-13T17:16:13.006589+0000","last_clean":"2024-09-13T17:16:13.006589+0000","last_became_active":"2024-09-13T17:16:12.562968+0000","last_became_peered":"2024-09-13T17:16:12.562968+0000","last_unstale":"2024-09-13T17:16:13.006589+0000","last_undegraded":"2024-09-13T17:16:13.006589+0000","last_fullsized":"2024-09-13T17:16:13.006589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981568+0000","last_change":"2024-09-13T17:16:12.990005+0000","last_active":"2024-09-13T17:16:13.981568+0000","last_peered":"2024-09-13T17:16:13.981568+0000","last_clean":"2024-09-13T17:16:13.981568+0000","last_became_active":"2024-09-13T17:16:12.989763+0000","last_became_peered":"2024-09-13T17:16:12.989763+0000","last_unstale":"2024-09-13T17:16:13.981568+0000","last_undegraded":"2024-09-13T17:16:13.981568+0000","last_fullsized":"2024-09-13T17:16:13.981568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:10.905248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.977882+0000","last_change":"2024-09-13T17:16:12.565523+0000","last_active":"2024-09-13T17:16:12.977882+0000","last_peered":"2024-09-13T17:16:12.977882+0000","last_clean":"2024-09-13T17:16:12.977882+0000","last_became_active":"2024-09-13T17:16:12.565270+0000","last_became_peered":"2024-09-13T17:16:12.565270+0000","last_unstale":"2024-09-13T17:16:12.977882+0000","last_undegraded":"2024-09-13T17:16:12.977882+0000","last_fullsized":"2024-09-13T17:16:12.977882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365730+0000","last_change":"2024-09-13T17:16:12.995252+0000","last_active":"2024-09-13T17:16:14.365730+0000","last_peered":"2024-09-13T17:16:14.365730+0000","last_clean":"2024-09-13T17:16:14.365730+0000","last_became_active":"2024-09-13T17:16:12.994924+0000","last_became_peered":"2024-09-13T17:16:12.994924+0000","last_unstale":"2024-09-13T17:16:14.365730+0000","last_undegraded":"2024-09-13T17:16:14.365730+0000","last_fullsized":"2024-09-13T17:16:14.365730+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:11.768473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979316+0000","last_change":"2024-09-13T17:16:12.566019+0000","last_active":"2024-09-13T17:16:12.979316+0000","last_peered":"2024-09-13T17:16:12.979316+0000","last_clean":"2024-09-13T17:16:12.979316+0000","last_became_active":"2024-09-13T17:16:12.564582+0000","last_became_peered":"2024-09-13T17:16:12.564582+0000","last_unstale":"2024-09-13T17:16:12.979316+0000","last_undegraded":"2024-09-13T17:16:12.979316+0000","last_fullsized":"2024-09-13T17:16:12.979316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084905+0000","last_change":"2024-09-13T17:16:12.992743+0000","last_active":"2024-09-13T17:16:15.084905+0000","last_peered":"2024-09-13T17:16:15.084905+0000","last_clean":"2024-09-13T17:16:15.084905+0000","last_became_active":"2024-09-13T17:16:12.992479+0000","last_became_peered":"2024-09-13T17:16:12.992479+0000","last_unstale":"2024-09-13T17:16:15.084905+0000","last_undegraded":"2024-09-13T17:16:15.084905+0000","last_fullsized":"2024-09-13T17:16:15.084905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:53.938624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"68'8","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.002455+0000","last_change":"2024-09-13T17:16:12.563244+0000","last_active":"2024-09-13T17:16:13.002455+0000","last_peered":"2024-09-13T17:16:13.002455+0000","last_clean":"2024-09-13T17:16:13.002455+0000","last_became_active":"2024-09-13T17:16:12.562971+0000","last_became_peered":"2024-09-13T17:16:12.562971+0000","last_unstale":"2024-09-13T17:16:13.002455+0000","last_undegraded":"2024-09-13T17:16:13.002455+0000","last_fullsized":"2024-09-13T17:16:13.002455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984776+0000","last_change":"2024-09-13T17:16:12.994175+0000","last_active":"2024-09-13T17:16:13.984776+0000","last_peered":"2024-09-13T17:16:13.984776+0000","last_clean":"2024-09-13T17:16:13.984776+0000","last_became_active":"2024-09-13T17:16:12.993915+0000","last_became_peered":"2024-09-13T17:16:12.993915+0000","last_unstale":"2024-09-13T17:16:13.984776+0000","last_undegraded":"2024-09-13T17:16:13.984776+0000","last_fullsized":"2024-09-13T17:16:13.984776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.005366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.996142+0000","last_change":"2024-09-13T17:16:12.565555+0000","last_active":"2024-09-13T17:16:12.996142+0000","last_peered":"2024-09-13T17:16:12.996142+0000","last_clean":"2024-09-13T17:16:12.996142+0000","last_became_active":"2024-09-13T17:16:12.565240+0000","last_became_peered":"2024-09-13T17:16:12.565240+0000","last_unstale":"2024-09-13T17:16:12.996142+0000","last_undegraded":"2024-09-13T17:16:12.996142+0000","last_fullsized":"2024-09-13T17:16:12.996142+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365980+0000","last_change":"2024-09-13T17:16:12.999809+0000","last_active":"2024-09-13T17:16:14.365980+0000","last_peered":"2024-09-13T17:16:14.365980+0000","last_clean":"2024-09-13T17:16:14.365980+0000","last_became_active":"2024-09-13T17:16:12.999522+0000","last_became_peered":"2024-09-13T17:16:12.999522+0000","last_unstale":"2024-09-13T17:16:14.365980+0000","last_undegraded":"2024-09-13T17:16:14.365980+0000","last_fullsized":"2024-09-13T17:16:14.365980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:50.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006943+0000","last_change":"2024-09-13T17:16:12.566114+0000","last_active":"2024-09-13T17:16:13.006943+0000","last_peered":"2024-09-13T17:16:13.006943+0000","last_clean":"2024-09-13T17:16:13.006943+0000","last_became_active":"2024-09-13T17:16:12.565839+0000","last_became_peered":"2024-09-13T17:16:12.565839+0000","last_unstale":"2024-09-13T17:16:13.006943+0000","last_undegraded":"2024-09-13T17:16:13.006943+0000","last_fullsized":"2024-09-13T17:16:13.006943+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982546+0000","last_change":"2024-09-13T17:16:13.002175+0000","last_active":"2024-09-13T17:16:13.982546+0000","last_peered":"2024-09-13T17:16:13.982546+0000","last_clean":"2024-09-13T17:16:13.982546+0000","last_became_active":"2024-09-13T17:16:13.001894+0000","last_became_peered":"2024-09-13T17:16:13.001894+0000","last_unstale":"2024-09-13T17:16:13.982546+0000","last_undegraded":"2024-09-13T17:16:13.982546+0000","last_fullsized":"2024-09-13T17:16:13.982546+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.280692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.004370+0000","last_change":"2024-09-13T17:16:12.569646+0000","last_active":"2024-09-13T17:16:13.004370+0000","last_peered":"2024-09-13T17:16:13.004370+0000","last_clean":"2024-09-13T17:16:13.004370+0000","last_became_active":"2024-09-13T17:16:12.569385+0000","last_became_peered":"2024-09-13T17:16:12.569385+0000","last_unstale":"2024-09-13T17:16:13.004370+0000","last_undegraded":"2024-09-13T17:16:13.004370+0000","last_fullsized":"2024-09-13T17:16:13.004370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366076+0000","last_change":"2024-09-13T17:16:12.997765+0000","last_active":"2024-09-13T17:16:14.366076+0000","last_peered":"2024-09-13T17:16:14.366076+0000","last_clean":"2024-09-13T17:16:14.366076+0000","last_became_active":"2024-09-13T17:16:12.997503+0000","last_became_peered":"2024-09-13T17:16:12.997503+0000","last_unstale":"2024-09-13T17:16:14.366076+0000","last_undegraded":"2024-09-13T17:16:14.366076+0000","last_fullsized":"2024-09-13T17:16:14.366076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:04.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978604+0000","last_change":"2024-09-13T17:16:12.563400+0000","last_active":"2024-09-13T17:16:12.978604+0000","last_peered":"2024-09-13T17:16:12.978604+0000","last_clean":"2024-09-13T17:16:12.978604+0000","last_became_active":"2024-09-13T17:16:12.563151+0000","last_became_peered":"2024-09-13T17:16:12.563151+0000","last_unstale":"2024-09-13T17:16:12.978604+0000","last_undegraded":"2024-09-13T17:16:12.978604+0000","last_fullsized":"2024-09-13T17:16:12.978604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084574+0000","last_change":"2024-09-13T17:16:12.989293+0000","last_active":"2024-09-13T17:16:15.084574+0000","last_peered":"2024-09-13T17:16:15.084574+0000","last_clean":"2024-09-13T17:16:15.084574+0000","last_became_active":"2024-09-13T17:16:12.989025+0000","last_became_peered":"2024-09-13T17:16:12.989025+0000","last_unstale":"2024-09-13T17:16:15.084574+0000","last_undegraded":"2024-09-13T17:16:15.084574+0000","last_fullsized":"2024-09-13T17:16:15.084574+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:23.217853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.000081+0000","last_change":"2024-09-13T17:16:12.561853+0000","last_active":"2024-09-13T17:16:13.000081+0000","last_peered":"2024-09-13T17:16:13.000081+0000","last_clean":"2024-09-13T17:16:13.000081+0000","last_became_active":"2024-09-13T17:16:12.561559+0000","last_became_peered":"2024-09-13T17:16:12.561559+0000","last_unstale":"2024-09-13T17:16:13.000081+0000","last_undegraded":"2024-09-13T17:16:13.000081+0000","last_fullsized":"2024-09-13T17:16:13.000081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981604+0000","last_change":"2024-09-13T17:16:12.981987+0000","last_active":"2024-09-13T17:16:13.981604+0000","last_peered":"2024-09-13T17:16:13.981604+0000","last_clean":"2024-09-13T17:16:13.981604+0000","last_became_active":"2024-09-13T17:16:12.981701+0000","last_became_peered":"2024-09-13T17:16:12.981701+0000","last_unstale":"2024-09-13T17:16:13.981604+0000","last_undegraded":"2024-09-13T17:16:13.981604+0000","last_fullsized":"2024-09-13T17:16:13.981604+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:41.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978447+0000","last_change":"2024-09-13T17:16:12.564890+0000","last_active":"2024-09-13T17:16:12.978447+0000","last_peered":"2024-09-13T17:16:12.978447+0000","last_clean":"2024-09-13T17:16:12.978447+0000","last_became_active":"2024-09-13T17:16:12.564610+0000","last_became_peered":"2024-09-13T17:16:12.564610+0000","last_unstale":"2024-09-13T17:16:12.978447+0000","last_undegraded":"2024-09-13T17:16:12.978447+0000","last_fullsized":"2024-09-13T17:16:12.978447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365904+0000","last_change":"2024-09-13T17:16:12.998969+0000","last_active":"2024-09-13T17:16:14.365904+0000","last_peered":"2024-09-13T17:16:14.365904+0000","last_clean":"2024-09-13T17:16:14.365904+0000","last_became_active":"2024-09-13T17:16:12.998726+0000","last_became_peered":"2024-09-13T17:16:12.998726+0000","last_unstale":"2024-09-13T17:16:14.365904+0000","last_undegraded":"2024-09-13T17:16:14.365904+0000","last_fullsized":"2024-09-13T17:16:14.365904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:21.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.981199+0000","last_change":"2024-09-13T17:16:12.565910+0000","last_active":"2024-09-13T17:16:12.981199+0000","last_peered":"2024-09-13T17:16:12.981199+0000","last_clean":"2024-09-13T17:16:12.981199+0000","last_became_active":"2024-09-13T17:16:12.565547+0000","last_became_peered":"2024-09-13T17:16:12.565547+0000","last_unstale":"2024-09-13T17:16:12.981199+0000","last_undegraded":"2024-09-13T17:16:12.981199+0000","last_fullsized":"2024-09-13T17:16:12.981199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085173+0000","last_change":"2024-09-13T17:16:12.995218+0000","last_active":"2024-09-13T17:16:15.085173+0000","last_peered":"2024-09-13T17:16:15.085173+0000","last_clean":"2024-09-13T17:16:15.085173+0000","last_became_active":"2024-09-13T17:16:12.994977+0000","last_became_peered":"2024-09-13T17:16:12.994977+0000","last_unstale":"2024-09-13T17:16:15.085173+0000","last_undegraded":"2024-09-13T17:16:15.085173+0000","last_fullsized":"2024-09-13T17:16:15.085173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:19.532610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.997777+0000","last_change":"2024-09-13T17:16:12.562565+0000","last_active":"2024-09-13T17:16:12.997777+0000","last_peered":"2024-09-13T17:16:12.997777+0000","last_clean":"2024-09-13T17:16:12.997777+0000","last_became_active":"2024-09-13T17:16:12.562245+0000","last_became_peered":"2024-09-13T17:16:12.562245+0000","last_unstale":"2024-09-13T17:16:12.997777+0000","last_undegraded":"2024-09-13T17:16:12.997777+0000","last_fullsized":"2024-09-13T17:16:12.997777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.980192+0000","last_change":"2024-09-13T17:16:12.991881+0000","last_active":"2024-09-13T17:16:13.980192+0000","last_peered":"2024-09-13T17:16:13.980192+0000","last_clean":"2024-09-13T17:16:13.980192+0000","last_became_active":"2024-09-13T17:16:12.991624+0000","last_became_peered":"2024-09-13T17:16:12.991624+0000","last_unstale":"2024-09-13T17:16:13.980192+0000","last_undegraded":"2024-09-13T17:16:13.980192+0000","last_fullsized":"2024-09-13T17:16:13.980192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:00.403510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980032+0000","last_change":"2024-09-13T17:16:12.557454+0000","last_active":"2024-09-13T17:16:12.980032+0000","last_peered":"2024-09-13T17:16:12.980032+0000","last_clean":"2024-09-13T17:16:12.980032+0000","last_became_active":"2024-09-13T17:16:12.557147+0000","last_became_peered":"2024-09-13T17:16:12.557147+0000","last_unstale":"2024-09-13T17:16:12.980032+0000","last_undegraded":"2024-09-13T17:16:12.980032+0000","last_fullsized":"2024-09-13T17:16:12.980032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982033+0000","last_change":"2024-09-13T17:16:12.990771+0000","last_active":"2024-09-13T17:16:13.982033+0000","last_peered":"2024-09-13T17:16:13.982033+0000","last_clean":"2024-09-13T17:16:13.982033+0000","last_became_active":"2024-09-13T17:16:12.990371+0000","last_became_peered":"2024-09-13T17:16:12.990371+0000","last_unstale":"2024-09-13T17:16:13.982033+0000","last_undegraded":"2024-09-13T17:16:13.982033+0000","last_fullsized":"2024-09-13T17:16:13.982033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.981439+0000","last_change":"2024-09-13T17:16:12.555152+0000","last_active":"2024-09-13T17:16:12.981439+0000","last_peered":"2024-09-13T17:16:12.981439+0000","last_clean":"2024-09-13T17:16:12.981439+0000","last_became_active":"2024-09-13T17:16:12.554856+0000","last_became_peered":"2024-09-13T17:16:12.554856+0000","last_unstale":"2024-09-13T17:16:12.981439+0000","last_undegraded":"2024-09-13T17:16:12.981439+0000","last_fullsized":"2024-09-13T17:16:12.981439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366111+0000","last_change":"2024-09-13T17:16:12.996387+0000","last_active":"2024-09-13T17:16:14.366111+0000","last_peered":"2024-09-13T17:16:14.366111+0000","last_clean":"2024-09-13T17:16:14.366111+0000","last_became_active":"2024-09-13T17:16:12.995896+0000","last_became_peered":"2024-09-13T17:16:12.995896+0000","last_unstale":"2024-09-13T17:16:14.366111+0000","last_undegraded":"2024-09-13T17:16:14.366111+0000","last_fullsized":"2024-09-13T17:16:14.366111+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:29.534667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980839+0000","last_change":"2024-09-13T17:16:12.558836+0000","last_active":"2024-09-13T17:16:12.980839+0000","last_peered":"2024-09-13T17:16:12.980839+0000","last_clean":"2024-09-13T17:16:12.980839+0000","last_became_active":"2024-09-13T17:16:12.558561+0000","last_became_peered":"2024-09-13T17:16:12.558561+0000","last_unstale":"2024-09-13T17:16:12.980839+0000","last_undegraded":"2024-09-13T17:16:12.980839+0000","last_fullsized":"2024-09-13T17:16:12.980839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365736+0000","last_change":"2024-09-13T17:16:12.995074+0000","last_active":"2024-09-13T17:16:14.365736+0000","last_peered":"2024-09-13T17:16:14.365736+0000","last_clean":"2024-09-13T17:16:14.365736+0000","last_became_active":"2024-09-13T17:16:12.994702+0000","last_became_peered":"2024-09-13T17:16:12.994702+0000","last_unstale":"2024-09-13T17:16:14.365736+0000","last_undegraded":"2024-09-13T17:16:14.365736+0000","last_fullsized":"2024-09-13T17:16:14.365736+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.005366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978272+0000","last_change":"2024-09-13T17:16:12.564455+0000","last_active":"2024-09-13T17:16:12.978272+0000","last_peered":"2024-09-13T17:16:12.978272+0000","last_clean":"2024-09-13T17:16:12.978272+0000","last_became_active":"2024-09-13T17:16:12.564131+0000","last_became_peered":"2024-09-13T17:16:12.564131+0000","last_unstale":"2024-09-13T17:16:12.978272+0000","last_undegraded":"2024-09-13T17:16:12.978272+0000","last_fullsized":"2024-09-13T17:16:12.978272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982510+0000","last_change":"2024-09-13T17:16:12.991192+0000","last_active":"2024-09-13T17:16:13.982510+0000","last_peered":"2024-09-13T17:16:13.982510+0000","last_clean":"2024-09-13T17:16:13.982510+0000","last_became_active":"2024-09-13T17:16:12.990958+0000","last_became_peered":"2024-09-13T17:16:12.990958+0000","last_unstale":"2024-09-13T17:16:13.982510+0000","last_undegraded":"2024-09-13T17:16:13.982510+0000","last_fullsized":"2024-09-13T17:16:13.982510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:21.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979005+0000","last_change":"2024-09-13T17:16:12.566149+0000","last_active":"2024-09-13T17:16:12.979005+0000","last_peered":"2024-09-13T17:16:12.979005+0000","last_clean":"2024-09-13T17:16:12.979005+0000","last_became_active":"2024-09-13T17:16:12.565903+0000","last_became_peered":"2024-09-13T17:16:12.565903+0000","last_unstale":"2024-09-13T17:16:12.979005+0000","last_undegraded":"2024-09-13T17:16:12.979005+0000","last_fullsized":"2024-09-13T17:16:12.979005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084886+0000","last_change":"2024-09-13T17:16:12.998245+0000","last_active":"2024-09-13T17:16:15.084886+0000","last_peered":"2024-09-13T17:16:15.084886+0000","last_clean":"2024-09-13T17:16:15.084886+0000","last_became_active":"2024-09-13T17:16:12.998009+0000","last_became_peered":"2024-09-13T17:16:12.998009+0000","last_unstale":"2024-09-13T17:16:15.084886+0000","last_undegraded":"2024-09-13T17:16:15.084886+0000","last_fullsized":"2024-09-13T17:16:15.084886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:19.826982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978453+0000","last_change":"2024-09-13T17:16:12.560644+0000","last_active":"2024-09-13T17:16:12.978453+0000","last_peered":"2024-09-13T17:16:12.978453+0000","last_clean":"2024-09-13T17:16:12.978453+0000","last_became_active":"2024-09-13T17:16:12.560348+0000","last_became_peered":"2024-09-13T17:16:12.560348+0000","last_unstale":"2024-09-13T17:16:12.978453+0000","last_undegraded":"2024-09-13T17:16:12.978453+0000","last_fullsized":"2024-09-13T17:16:12.978453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979989+0000","last_change":"2024-09-13T17:16:12.992512+0000","last_active":"2024-09-13T17:16:13.979989+0000","last_peered":"2024-09-13T17:16:13.979989+0000","last_clean":"2024-09-13T17:16:13.979989+0000","last_became_active":"2024-09-13T17:16:12.992258+0000","last_became_peered":"2024-09-13T17:16:12.992258+0000","last_unstale":"2024-09-13T17:16:13.979989+0000","last_undegraded":"2024-09-13T17:16:13.979989+0000","last_fullsized":"2024-09-13T17:16:13.979989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:17.873931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980695+0000","last_change":"2024-09-13T17:16:12.565175+0000","last_active":"2024-09-13T17:16:12.980695+0000","last_peered":"2024-09-13T17:16:12.980695+0000","last_clean":"2024-09-13T17:16:12.980695+0000","last_became_active":"2024-09-13T17:16:12.564885+0000","last_became_peered":"2024-09-13T17:16:12.564885+0000","last_unstale":"2024-09-13T17:16:12.980695+0000","last_undegraded":"2024-09-13T17:16:12.980695+0000","last_fullsized":"2024-09-13T17:16:12.980695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365856+0000","last_change":"2024-09-13T17:16:12.995174+0000","last_active":"2024-09-13T17:16:14.365856+0000","last_peered":"2024-09-13T17:16:14.365856+0000","last_clean":"2024-09-13T17:16:14.365856+0000","last_became_active":"2024-09-13T17:16:12.994860+0000","last_became_peered":"2024-09-13T17:16:12.994860+0000","last_unstale":"2024-09-13T17:16:14.365856+0000","last_undegraded":"2024-09-13T17:16:14.365856+0000","last_fullsized":"2024-09-13T17:16:14.365856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.101697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978090+0000","last_change":"2024-09-13T17:16:12.558429+0000","last_active":"2024-09-13T17:16:12.978090+0000","last_peered":"2024-09-13T17:16:12.978090+0000","last_clean":"2024-09-13T17:16:12.978090+0000","last_became_active":"2024-09-13T17:16:12.558080+0000","last_became_peered":"2024-09-13T17:16:12.558080+0000","last_unstale":"2024-09-13T17:16:12.978090+0000","last_undegraded":"2024-09-13T17:16:12.978090+0000","last_fullsized":"2024-09-13T17:16:12.978090+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.977248+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:16:12.977248+0000","last_peered":"2024-09-13T17:16:12.977248+0000","last_clean":"2024-09-13T17:16:12.977248+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:16:12.977248+0000","last_undegraded":"2024-09-13T17:16:12.977248+0000","last_fullsized":"2024-09-13T17:16:12.977248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1445888,"data_stored":967537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67300000000000004,"5min":0.755,"15min":0.755},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.752},"last":0.37},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":376427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.623},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":376415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67000000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.88,"15min":0.88},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71299999999999997,"5min":1.173,"15min":1.173},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61899999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.33400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.085,"15min":1.085},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.74299999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.35499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81999999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86299999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":377957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49299999999999999,"15min":0.46899999999999997},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":1.034,"15min":1.034},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68100000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.48599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":835584,"data_stored":376393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53800000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.22}]},{"osd":1,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50700000000000001,"5min":1.458,"15min":1.458},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56000000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.435},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":1.226,"15min":1.226},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":835584,"data_stored":376393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.318,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53000000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.42799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61899999999999999,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.871,"15min":0.871},"last":0.499}]},{"osd":7,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81000000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":864256,"data_stored":378721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.61099999999999999,"5min":1.159,"15min":1.159},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":1.081,"15min":1.081},"last":0.28599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64000000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":1.286,"15min":1.286},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.046,"15min":1.046},"last":0.375}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93999999999999995,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.254,"15min":1.254},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1429504,"data_stored":966761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.49299999999999999,"15min":0.41699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":14.106999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.51300000000000001,"15min":0.443},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.606999999999999,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.262,"5min":14.262,"15min":14.262},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71099999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.998,"15min":0.998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.04,"5min":4.04,"15min":4.04},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.518000000000001,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.879,"15min":0.879},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:16:18.804 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-09-13T17:16:18.802+0000 7f0f7ee9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:16:20.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:16:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.510+0000 7f8679345640 1 Processor -- start 2024-09-13T17:16:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.510+0000 7f8679345640 1 -- start start 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f8679345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867415c810 0x7f86740cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f8679345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86740b4cf0 0x7f86740b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f8679345640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86740d1e80 con 0x7f86740d06d0 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f8679345640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86740d1750 con 0x7f86740b4cf0 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f8679345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740d0bd0 con 0x7f867415c810 2024-09-13T17:16:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f86737fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86740b4cf0 0x7f86740b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f86737fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86740b4cf0 0x7f86740b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58812/0 (socket says 172.21.15.5:58812) 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.511+0000 7f86737fe640 1 -- 172.21.15.5:0/252882632 learned_addr learned my addr 172.21.15.5:0/252882632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f8672ffd640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867415c810 0x7f86740cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f86737fe640 1 -- 172.21.15.5:0/252882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867415c810 msgr2=0x7f86740cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f86737fe640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867415c810 0x7f86740cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f86737fe640 1 -- 172.21.15.5:0/252882632 >> v1:172.21.15.179:6789/0 conn(0x7f86740d06d0 legacy=0x7f86740b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f86737fe640 1 -- 172.21.15.5:0/252882632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740d0eb0 con 0x7f86740b4cf0 2024-09-13T17:16:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.512+0000 7f86737fe640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86740b4cf0 0x7f86740b5a90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f866c009e50 tx=0x7f866c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c0c717079c0e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8671ffb640 1 -- 172.21.15.5:0/252882632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c02aea0 con 0x7f86740b4cf0 2024-09-13T17:16:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8671ffb640 1 -- 172.21.15.5:0/252882632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c02d050 con 0x7f86740b4cf0 2024-09-13T17:16:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8671ffb640 1 -- 172.21.15.5:0/252882632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c031820 con 0x7f86740b4cf0 2024-09-13T17:16:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 -- 172.21.15.5:0/252882632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86740b4cf0 msgr2=0x7f86740b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86740b4cf0 0x7f86740b5a90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f866c009e50 tx=0x7f866c02a6c0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 -- 172.21.15.5:0/252882632 shutdown_connections 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86740b4cf0 0x7f86740b5a90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 --2- 172.21.15.5:0/252882632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f867415c810 0x7f86740cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 -- 172.21.15.5:0/252882632 >> 172.21.15.5:0/252882632 conn(0x7f86740717a0 msgr2=0x7f8674071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 -- 172.21.15.5:0/252882632 shutdown_connections 2024-09-13T17:16:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.513+0000 7f8679345640 1 -- 172.21.15.5:0/252882632 wait complete. 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 Processor -- start 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 -- start start 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86740b4cf0 0x7f8674159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86740d06d0 0x7f8674154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740cb130 con 0x7f867415c810 2024-09-13T17:16:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8674155ac0 con 0x7f86740d06d0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.515+0000 7f8679345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ca840 con 0x7f86740b4cf0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58828/0 (socket says 172.21.15.5:58828) 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 -- 172.21.15.5:0/1678080011 learned_addr learned my addr 172.21.15.5:0/1678080011 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f8672ffd640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86740b4cf0 0x7f8674159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86727fc640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86740d06d0 0x7f8674154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 -- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86740b4cf0 msgr2=0x7f8674159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86740b4cf0 0x7f8674159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 -- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86740d06d0 msgr2=0x7f8674154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86740d06d0 0x7f8674154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 -- 172.21.15.5:0/1678080011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c009b30 con 0x7f867415c810 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f86737fe640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f866c009e50 tx=0x7f866c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c03d860 con 0x7f867415c810 2024-09-13T17:16:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c03d9e0 con 0x7f867415c810 2024-09-13T17:16:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86740caae0 con 0x7f867415c810 2024-09-13T17:16:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.516+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c03dd90 con 0x7f867415c810 2024-09-13T17:16:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.517+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8674157520 con 0x7f867415c810 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.518+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86740cb2e0 con 0x7f867415c810 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.518+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f866c03b400 con 0x7f867415c810 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.518+0000 7f865b7fe640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 0x7f866006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.519+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f866c0aa160 con 0x7f867415c810 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.519+0000 7f8672ffd640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 0x7f866006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.519+0000 7f8672ffd640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 0x7f866006d0c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86741f55c0 tx=0x7f8664008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.523+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f86740cb2e0 con 0x7f867415c810 2024-09-13T17:16:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.694+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86740b7b10 con 0x7f866006ac00 2024-09-13T17:16:20.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.701+0000 7f865b7fe640 1 -- 172.21.15.5:0/1678080011 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289302 (secure 0 0 0) 0x7f86740b7b10 con 0x7f866006ac00 2024-09-13T17:16:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:20.707 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 msgr2=0x7f866006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 0x7f866006d0c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86741f55c0 tx=0x7f8664008040 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 msgr2=0x7f86740d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f866c009e50 tx=0x7f866c004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 shutdown_connections 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f866006ac00 0x7f866006d0c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867415c810 0x7f86740d26b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86740d06d0 0x7f8674154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 --2- 172.21.15.5:0/1678080011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86740b4cf0 0x7f8674159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 >> 172.21.15.5:0/1678080011 conn(0x7f86740717a0 msgr2=0x7f86740ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:20.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 shutdown_connections 2024-09-13T17:16:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.705+0000 7f8679345640 1 -- 172.21.15.5:0/1678080011 wait complete. 2024-09-13T17:16:20.717 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-13T17:16:19.300799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240320,"kb_used_data":7752,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754734400,"statfs":{"total":773094113280,"available":772848025600,"internally_reserved":0,"allocated":7938048,"data_stored":4196604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.755509"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085050+0000","last_change":"2024-09-13T17:16:12.996472+0000","last_active":"2024-09-13T17:16:15.085050+0000","last_peered":"2024-09-13T17:16:15.085050+0000","last_clean":"2024-09-13T17:16:15.085050+0000","last_became_active":"2024-09-13T17:16:12.996228+0000","last_became_peered":"2024-09-13T17:16:12.996228+0000","last_unstale":"2024-09-13T17:16:15.085050+0000","last_undegraded":"2024-09-13T17:16:15.085050+0000","last_fullsized":"2024-09-13T17:16:15.085050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084877+0000","last_change":"2024-09-13T17:16:12.990947+0000","last_active":"2024-09-13T17:16:15.084877+0000","last_peered":"2024-09-13T17:16:15.084877+0000","last_clean":"2024-09-13T17:16:15.084877+0000","last_became_active":"2024-09-13T17:16:12.990707+0000","last_became_peered":"2024-09-13T17:16:12.990707+0000","last_unstale":"2024-09-13T17:16:15.084877+0000","last_undegraded":"2024-09-13T17:16:15.084877+0000","last_fullsized":"2024-09-13T17:16:15.084877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984790+0000","last_change":"2024-09-13T17:16:12.992135+0000","last_active":"2024-09-13T17:16:13.984790+0000","last_peered":"2024-09-13T17:16:13.984790+0000","last_clean":"2024-09-13T17:16:13.984790+0000","last_became_active":"2024-09-13T17:16:12.991770+0000","last_became_peered":"2024-09-13T17:16:12.991770+0000","last_unstale":"2024-09-13T17:16:13.984790+0000","last_undegraded":"2024-09-13T17:16:13.984790+0000","last_fullsized":"2024-09-13T17:16:13.984790+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:12.161469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982609+0000","last_change":"2024-09-13T17:16:12.995607+0000","last_active":"2024-09-13T17:16:13.982609+0000","last_peered":"2024-09-13T17:16:13.982609+0000","last_clean":"2024-09-13T17:16:13.982609+0000","last_became_active":"2024-09-13T17:16:12.994001+0000","last_became_peered":"2024-09-13T17:16:12.994001+0000","last_unstale":"2024-09-13T17:16:13.982609+0000","last_undegraded":"2024-09-13T17:16:13.982609+0000","last_fullsized":"2024-09-13T17:16:13.982609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:04.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365854+0000","last_change":"2024-09-13T17:16:12.999914+0000","last_active":"2024-09-13T17:16:14.365854+0000","last_peered":"2024-09-13T17:16:14.365854+0000","last_clean":"2024-09-13T17:16:14.365854+0000","last_became_active":"2024-09-13T17:16:12.999546+0000","last_became_peered":"2024-09-13T17:16:12.999546+0000","last_unstale":"2024-09-13T17:16:14.365854+0000","last_undegraded":"2024-09-13T17:16:14.365854+0000","last_fullsized":"2024-09-13T17:16:14.365854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.280692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085242+0000","last_change":"2024-09-13T17:16:12.987843+0000","last_active":"2024-09-13T17:16:15.085242+0000","last_peered":"2024-09-13T17:16:15.085242+0000","last_clean":"2024-09-13T17:16:15.085242+0000","last_became_active":"2024-09-13T17:16:12.987575+0000","last_became_peered":"2024-09-13T17:16:12.987575+0000","last_unstale":"2024-09-13T17:16:15.085242+0000","last_undegraded":"2024-09-13T17:16:15.085242+0000","last_fullsized":"2024-09-13T17:16:15.085242+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:49.128142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979972+0000","last_change":"2024-09-13T17:16:12.987578+0000","last_active":"2024-09-13T17:16:13.979972+0000","last_peered":"2024-09-13T17:16:13.979972+0000","last_clean":"2024-09-13T17:16:13.979972+0000","last_became_active":"2024-09-13T17:16:12.987316+0000","last_became_peered":"2024-09-13T17:16:12.987316+0000","last_unstale":"2024-09-13T17:16:13.979972+0000","last_undegraded":"2024-09-13T17:16:13.979972+0000","last_fullsized":"2024-09-13T17:16:13.979972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:07.723367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981958+0000","last_change":"2024-09-13T17:16:12.986227+0000","last_active":"2024-09-13T17:16:13.981958+0000","last_peered":"2024-09-13T17:16:13.981958+0000","last_clean":"2024-09-13T17:16:13.981958+0000","last_became_active":"2024-09-13T17:16:12.985953+0000","last_became_peered":"2024-09-13T17:16:12.985953+0000","last_unstale":"2024-09-13T17:16:13.981958+0000","last_undegraded":"2024-09-13T17:16:13.981958+0000","last_fullsized":"2024-09-13T17:16:13.981958+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:49.414955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984832+0000","last_change":"2024-09-13T17:16:12.987994+0000","last_active":"2024-09-13T17:16:13.984832+0000","last_peered":"2024-09-13T17:16:13.984832+0000","last_clean":"2024-09-13T17:16:13.984832+0000","last_became_active":"2024-09-13T17:16:12.987736+0000","last_became_peered":"2024-09-13T17:16:12.987736+0000","last_unstale":"2024-09-13T17:16:13.984832+0000","last_undegraded":"2024-09-13T17:16:13.984832+0000","last_fullsized":"2024-09-13T17:16:13.984832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:22.405009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984657+0000","last_change":"2024-09-13T17:16:12.989808+0000","last_active":"2024-09-13T17:16:13.984657+0000","last_peered":"2024-09-13T17:16:13.984657+0000","last_clean":"2024-09-13T17:16:13.984657+0000","last_became_active":"2024-09-13T17:16:12.989530+0000","last_became_peered":"2024-09-13T17:16:12.989530+0000","last_unstale":"2024-09-13T17:16:13.984657+0000","last_undegraded":"2024-09-13T17:16:13.984657+0000","last_fullsized":"2024-09-13T17:16:13.984657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:10.905248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982405+0000","last_change":"2024-09-13T17:16:12.999768+0000","last_active":"2024-09-13T17:16:13.982405+0000","last_peered":"2024-09-13T17:16:13.982405+0000","last_clean":"2024-09-13T17:16:13.982405+0000","last_became_active":"2024-09-13T17:16:12.999490+0000","last_became_peered":"2024-09-13T17:16:12.999490+0000","last_unstale":"2024-09-13T17:16:13.982405+0000","last_undegraded":"2024-09-13T17:16:13.982405+0000","last_fullsized":"2024-09-13T17:16:13.982405+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:29.534667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981739+0000","last_change":"2024-09-13T17:16:12.985805+0000","last_active":"2024-09-13T17:16:13.981739+0000","last_peered":"2024-09-13T17:16:13.981739+0000","last_clean":"2024-09-13T17:16:13.981739+0000","last_became_active":"2024-09-13T17:16:12.985207+0000","last_became_peered":"2024-09-13T17:16:12.985207+0000","last_unstale":"2024-09-13T17:16:13.981739+0000","last_undegraded":"2024-09-13T17:16:13.981739+0000","last_fullsized":"2024-09-13T17:16:13.981739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:19.826982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981787+0000","last_change":"2024-09-13T17:16:12.992768+0000","last_active":"2024-09-13T17:16:13.981787+0000","last_peered":"2024-09-13T17:16:13.981787+0000","last_clean":"2024-09-13T17:16:13.981787+0000","last_became_active":"2024-09-13T17:16:12.991803+0000","last_became_peered":"2024-09-13T17:16:12.991803+0000","last_unstale":"2024-09-13T17:16:13.981787+0000","last_undegraded":"2024-09-13T17:16:13.981787+0000","last_fullsized":"2024-09-13T17:16:13.981787+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:01.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984596+0000","last_change":"2024-09-13T17:16:12.990004+0000","last_active":"2024-09-13T17:16:13.984596+0000","last_peered":"2024-09-13T17:16:13.984596+0000","last_clean":"2024-09-13T17:16:13.984596+0000","last_became_active":"2024-09-13T17:16:12.989737+0000","last_became_peered":"2024-09-13T17:16:12.989737+0000","last_unstale":"2024-09-13T17:16:13.984596+0000","last_undegraded":"2024-09-13T17:16:13.984596+0000","last_fullsized":"2024-09-13T17:16:13.984596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:26.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984446+0000","last_change":"2024-09-13T17:16:12.991427+0000","last_active":"2024-09-13T17:16:13.984446+0000","last_peered":"2024-09-13T17:16:13.984446+0000","last_clean":"2024-09-13T17:16:13.984446+0000","last_became_active":"2024-09-13T17:16:12.991082+0000","last_became_peered":"2024-09-13T17:16:12.991082+0000","last_unstale":"2024-09-13T17:16:13.984446+0000","last_undegraded":"2024-09-13T17:16:13.984446+0000","last_fullsized":"2024-09-13T17:16:13.984446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979959+0000","last_change":"2024-09-13T17:16:12.983578+0000","last_active":"2024-09-13T17:16:13.979959+0000","last_peered":"2024-09-13T17:16:13.979959+0000","last_clean":"2024-09-13T17:16:13.979959+0000","last_became_active":"2024-09-13T17:16:12.983342+0000","last_became_peered":"2024-09-13T17:16:12.983342+0000","last_unstale":"2024-09-13T17:16:13.979959+0000","last_undegraded":"2024-09-13T17:16:13.979959+0000","last_fullsized":"2024-09-13T17:16:13.979959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:15.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085149+0000","last_change":"2024-09-13T17:16:12.998310+0000","last_active":"2024-09-13T17:16:15.085149+0000","last_peered":"2024-09-13T17:16:15.085149+0000","last_clean":"2024-09-13T17:16:15.085149+0000","last_became_active":"2024-09-13T17:16:12.998034+0000","last_became_peered":"2024-09-13T17:16:12.998034+0000","last_unstale":"2024-09-13T17:16:15.085149+0000","last_undegraded":"2024-09-13T17:16:15.085149+0000","last_fullsized":"2024-09-13T17:16:15.085149+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:03.607391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982658+0000","last_change":"2024-09-13T17:16:12.995427+0000","last_active":"2024-09-13T17:16:13.982658+0000","last_peered":"2024-09-13T17:16:13.982658+0000","last_clean":"2024-09-13T17:16:13.982658+0000","last_became_active":"2024-09-13T17:16:12.993299+0000","last_became_peered":"2024-09-13T17:16:12.993299+0000","last_unstale":"2024-09-13T17:16:13.982658+0000","last_undegraded":"2024-09-13T17:16:13.982658+0000","last_fullsized":"2024-09-13T17:16:13.982658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:12.687029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366001+0000","last_change":"2024-09-13T17:16:12.988550+0000","last_active":"2024-09-13T17:16:14.366001+0000","last_peered":"2024-09-13T17:16:14.366001+0000","last_clean":"2024-09-13T17:16:14.366001+0000","last_became_active":"2024-09-13T17:16:12.988271+0000","last_became_peered":"2024-09-13T17:16:12.988271+0000","last_unstale":"2024-09-13T17:16:14.366001+0000","last_undegraded":"2024-09-13T17:16:14.366001+0000","last_fullsized":"2024-09-13T17:16:14.366001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:16.556363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372091+0000","last_change":"2024-09-13T17:16:12.999691+0000","last_active":"2024-09-13T17:16:14.372091+0000","last_peered":"2024-09-13T17:16:14.372091+0000","last_clean":"2024-09-13T17:16:14.372091+0000","last_became_active":"2024-09-13T17:16:12.999415+0000","last_became_peered":"2024-09-13T17:16:12.999415+0000","last_unstale":"2024-09-13T17:16:14.372091+0000","last_undegraded":"2024-09-13T17:16:14.372091+0000","last_fullsized":"2024-09-13T17:16:14.372091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:17.790250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982192+0000","last_change":"2024-09-13T17:16:12.986678+0000","last_active":"2024-09-13T17:16:13.982192+0000","last_peered":"2024-09-13T17:16:13.982192+0000","last_clean":"2024-09-13T17:16:13.982192+0000","last_became_active":"2024-09-13T17:16:12.986436+0000","last_became_peered":"2024-09-13T17:16:12.986436+0000","last_unstale":"2024-09-13T17:16:13.982192+0000","last_undegraded":"2024-09-13T17:16:13.982192+0000","last_fullsized":"2024-09-13T17:16:13.982192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:46.373530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372033+0000","last_change":"2024-09-13T17:16:12.986296+0000","last_active":"2024-09-13T17:16:14.372033+0000","last_peered":"2024-09-13T17:16:14.372033+0000","last_clean":"2024-09-13T17:16:14.372033+0000","last_became_active":"2024-09-13T17:16:12.986030+0000","last_became_peered":"2024-09-13T17:16:12.986030+0000","last_unstale":"2024-09-13T17:16:14.372033+0000","last_undegraded":"2024-09-13T17:16:14.372033+0000","last_fullsized":"2024-09-13T17:16:14.372033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.358303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.371959+0000","last_change":"2024-09-13T17:16:12.986311+0000","last_active":"2024-09-13T17:16:14.371959+0000","last_peered":"2024-09-13T17:16:14.371959+0000","last_clean":"2024-09-13T17:16:14.371959+0000","last_became_active":"2024-09-13T17:16:12.986048+0000","last_became_peered":"2024-09-13T17:16:12.986048+0000","last_unstale":"2024-09-13T17:16:14.371959+0000","last_undegraded":"2024-09-13T17:16:14.371959+0000","last_fullsized":"2024-09-13T17:16:14.371959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:23.217853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984567+0000","last_change":"2024-09-13T17:16:12.990548+0000","last_active":"2024-09-13T17:16:13.984567+0000","last_peered":"2024-09-13T17:16:13.984567+0000","last_clean":"2024-09-13T17:16:13.984567+0000","last_became_active":"2024-09-13T17:16:12.990309+0000","last_became_peered":"2024-09-13T17:16:12.990309+0000","last_unstale":"2024-09-13T17:16:13.984567+0000","last_undegraded":"2024-09-13T17:16:13.984567+0000","last_fullsized":"2024-09-13T17:16:13.984567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.101697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981972+0000","last_change":"2024-09-13T17:16:12.982360+0000","last_active":"2024-09-13T17:16:13.981972+0000","last_peered":"2024-09-13T17:16:13.981972+0000","last_clean":"2024-09-13T17:16:13.981972+0000","last_became_active":"2024-09-13T17:16:12.982119+0000","last_became_peered":"2024-09-13T17:16:12.982119+0000","last_unstale":"2024-09-13T17:16:13.981972+0000","last_undegraded":"2024-09-13T17:16:13.981972+0000","last_fullsized":"2024-09-13T17:16:13.981972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:17.926736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981702+0000","last_change":"2024-09-13T17:16:12.982974+0000","last_active":"2024-09-13T17:16:13.981702+0000","last_peered":"2024-09-13T17:16:13.981702+0000","last_clean":"2024-09-13T17:16:13.981702+0000","last_became_active":"2024-09-13T17:16:12.982706+0000","last_became_peered":"2024-09-13T17:16:12.982706+0000","last_unstale":"2024-09-13T17:16:13.981702+0000","last_undegraded":"2024-09-13T17:16:13.981702+0000","last_fullsized":"2024-09-13T17:16:13.981702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:53.938624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982771+0000","last_change":"2024-09-13T17:16:12.987226+0000","last_active":"2024-09-13T17:16:13.982771+0000","last_peered":"2024-09-13T17:16:13.982771+0000","last_clean":"2024-09-13T17:16:13.982771+0000","last_became_active":"2024-09-13T17:16:12.986907+0000","last_became_peered":"2024-09-13T17:16:12.986907+0000","last_unstale":"2024-09-13T17:16:13.982771+0000","last_undegraded":"2024-09-13T17:16:13.982771+0000","last_fullsized":"2024-09-13T17:16:13.982771+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:33.431487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084959+0000","last_change":"2024-09-13T17:16:12.997573+0000","last_active":"2024-09-13T17:16:15.084959+0000","last_peered":"2024-09-13T17:16:15.084959+0000","last_clean":"2024-09-13T17:16:15.084959+0000","last_became_active":"2024-09-13T17:16:12.997329+0000","last_became_peered":"2024-09-13T17:16:12.997329+0000","last_unstale":"2024-09-13T17:16:15.084959+0000","last_undegraded":"2024-09-13T17:16:15.084959+0000","last_fullsized":"2024-09-13T17:16:15.084959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:01.143074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984565+0000","last_change":"2024-09-13T17:16:12.989147+0000","last_active":"2024-09-13T17:16:13.984565+0000","last_peered":"2024-09-13T17:16:13.984565+0000","last_clean":"2024-09-13T17:16:13.984565+0000","last_became_active":"2024-09-13T17:16:12.988760+0000","last_became_peered":"2024-09-13T17:16:12.988760+0000","last_unstale":"2024-09-13T17:16:13.984565+0000","last_undegraded":"2024-09-13T17:16:13.984565+0000","last_fullsized":"2024-09-13T17:16:13.984565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:48.672452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981755+0000","last_change":"2024-09-13T17:16:12.985639+0000","last_active":"2024-09-13T17:16:13.981755+0000","last_peered":"2024-09-13T17:16:13.981755+0000","last_clean":"2024-09-13T17:16:13.981755+0000","last_became_active":"2024-09-13T17:16:12.985354+0000","last_became_peered":"2024-09-13T17:16:12.985354+0000","last_unstale":"2024-09-13T17:16:13.981755+0000","last_undegraded":"2024-09-13T17:16:13.981755+0000","last_fullsized":"2024-09-13T17:16:13.981755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:03.607391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982625+0000","last_change":"2024-09-13T17:16:12.987449+0000","last_active":"2024-09-13T17:16:13.982625+0000","last_peered":"2024-09-13T17:16:13.982625+0000","last_clean":"2024-09-13T17:16:13.982625+0000","last_became_active":"2024-09-13T17:16:12.987132+0000","last_became_peered":"2024-09-13T17:16:12.987132+0000","last_unstale":"2024-09-13T17:16:13.982625+0000","last_undegraded":"2024-09-13T17:16:13.982625+0000","last_fullsized":"2024-09-13T17:16:13.982625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:16.556363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084504+0000","last_change":"2024-09-13T17:16:12.989736+0000","last_active":"2024-09-13T17:16:15.084504+0000","last_peered":"2024-09-13T17:16:15.084504+0000","last_clean":"2024-09-13T17:16:15.084504+0000","last_became_active":"2024-09-13T17:16:12.989482+0000","last_became_peered":"2024-09-13T17:16:12.989482+0000","last_unstale":"2024-09-13T17:16:15.084504+0000","last_undegraded":"2024-09-13T17:16:15.084504+0000","last_fullsized":"2024-09-13T17:16:15.084504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:48.358303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365985+0000","last_change":"2024-09-13T17:16:12.992623+0000","last_active":"2024-09-13T17:16:14.365985+0000","last_peered":"2024-09-13T17:16:14.365985+0000","last_clean":"2024-09-13T17:16:14.365985+0000","last_became_active":"2024-09-13T17:16:12.992334+0000","last_became_peered":"2024-09-13T17:16:12.992334+0000","last_unstale":"2024-09-13T17:16:14.365985+0000","last_undegraded":"2024-09-13T17:16:14.365985+0000","last_fullsized":"2024-09-13T17:16:14.365985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:22.405009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"68'4","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.998888+0000","last_change":"2024-09-13T17:16:12.567752+0000","last_active":"2024-09-13T17:16:12.998888+0000","last_peered":"2024-09-13T17:16:12.998888+0000","last_clean":"2024-09-13T17:16:12.998888+0000","last_became_active":"2024-09-13T17:16:12.567216+0000","last_became_peered":"2024-09-13T17:16:12.567216+0000","last_unstale":"2024-09-13T17:16:12.998888+0000","last_undegraded":"2024-09-13T17:16:12.998888+0000","last_fullsized":"2024-09-13T17:16:12.998888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:28.529228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982855+0000","last_change":"2024-09-13T17:16:13.002034+0000","last_active":"2024-09-13T17:16:13.982855+0000","last_peered":"2024-09-13T17:16:13.982855+0000","last_clean":"2024-09-13T17:16:13.982855+0000","last_became_active":"2024-09-13T17:16:13.001742+0000","last_became_peered":"2024-09-13T17:16:13.001742+0000","last_unstale":"2024-09-13T17:16:13.982855+0000","last_undegraded":"2024-09-13T17:16:13.982855+0000","last_fullsized":"2024-09-13T17:16:13.982855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:11.768473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.995522+0000","last_change":"2024-09-13T17:16:12.565170+0000","last_active":"2024-09-13T17:16:12.995522+0000","last_peered":"2024-09-13T17:16:12.995522+0000","last_clean":"2024-09-13T17:16:12.995522+0000","last_became_active":"2024-09-13T17:16:12.564863+0000","last_became_peered":"2024-09-13T17:16:12.564863+0000","last_unstale":"2024-09-13T17:16:12.995522+0000","last_undegraded":"2024-09-13T17:16:12.995522+0000","last_fullsized":"2024-09-13T17:16:12.995522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:45.368091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085406+0000","last_change":"2024-09-13T17:16:12.989786+0000","last_active":"2024-09-13T17:16:15.085406+0000","last_peered":"2024-09-13T17:16:15.085406+0000","last_clean":"2024-09-13T17:16:15.085406+0000","last_became_active":"2024-09-13T17:16:12.989529+0000","last_became_peered":"2024-09-13T17:16:12.989529+0000","last_unstale":"2024-09-13T17:16:15.085406+0000","last_undegraded":"2024-09-13T17:16:15.085406+0000","last_fullsized":"2024-09-13T17:16:15.085406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:00.832082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.997060+0000","last_change":"2024-09-13T17:16:12.555192+0000","last_active":"2024-09-13T17:16:12.997060+0000","last_peered":"2024-09-13T17:16:12.997060+0000","last_clean":"2024-09-13T17:16:12.997060+0000","last_became_active":"2024-09-13T17:16:12.554910+0000","last_became_peered":"2024-09-13T17:16:12.554910+0000","last_unstale":"2024-09-13T17:16:12.997060+0000","last_undegraded":"2024-09-13T17:16:12.997060+0000","last_fullsized":"2024-09-13T17:16:12.997060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984817+0000","last_change":"2024-09-13T17:16:12.993630+0000","last_active":"2024-09-13T17:16:13.984817+0000","last_peered":"2024-09-13T17:16:13.984817+0000","last_clean":"2024-09-13T17:16:13.984817+0000","last_became_active":"2024-09-13T17:16:12.993125+0000","last_became_peered":"2024-09-13T17:16:12.993125+0000","last_unstale":"2024-09-13T17:16:13.984817+0000","last_undegraded":"2024-09-13T17:16:13.984817+0000","last_fullsized":"2024-09-13T17:16:13.984817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.992812+0000","last_change":"2024-09-13T17:16:12.556707+0000","last_active":"2024-09-13T17:16:12.992812+0000","last_peered":"2024-09-13T17:16:12.992812+0000","last_clean":"2024-09-13T17:16:12.992812+0000","last_became_active":"2024-09-13T17:16:12.556386+0000","last_became_peered":"2024-09-13T17:16:12.556386+0000","last_unstale":"2024-09-13T17:16:12.992812+0000","last_undegraded":"2024-09-13T17:16:12.992812+0000","last_fullsized":"2024-09-13T17:16:12.992812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979959+0000","last_change":"2024-09-13T17:16:12.984854+0000","last_active":"2024-09-13T17:16:13.979959+0000","last_peered":"2024-09-13T17:16:13.979959+0000","last_clean":"2024-09-13T17:16:13.979959+0000","last_became_active":"2024-09-13T17:16:12.984603+0000","last_became_peered":"2024-09-13T17:16:12.984603+0000","last_unstale":"2024-09-13T17:16:13.979959+0000","last_undegraded":"2024-09-13T17:16:13.979959+0000","last_fullsized":"2024-09-13T17:16:13.979959+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:43.236728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.989746+0000","last_change":"2024-09-13T17:16:12.558443+0000","last_active":"2024-09-13T17:16:12.989746+0000","last_peered":"2024-09-13T17:16:12.989746+0000","last_clean":"2024-09-13T17:16:12.989746+0000","last_became_active":"2024-09-13T17:16:12.558122+0000","last_became_peered":"2024-09-13T17:16:12.558122+0000","last_unstale":"2024-09-13T17:16:12.989746+0000","last_undegraded":"2024-09-13T17:16:12.989746+0000","last_fullsized":"2024-09-13T17:16:12.989746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084644+0000","last_change":"2024-09-13T17:16:12.998925+0000","last_active":"2024-09-13T17:16:15.084644+0000","last_peered":"2024-09-13T17:16:15.084644+0000","last_clean":"2024-09-13T17:16:15.084644+0000","last_became_active":"2024-09-13T17:16:12.998580+0000","last_became_peered":"2024-09-13T17:16:12.998580+0000","last_unstale":"2024-09-13T17:16:15.084644+0000","last_undegraded":"2024-09-13T17:16:15.084644+0000","last_fullsized":"2024-09-13T17:16:15.084644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:41.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.985766+0000","last_change":"2024-09-13T17:16:12.560370+0000","last_active":"2024-09-13T17:16:12.985766+0000","last_peered":"2024-09-13T17:16:12.985766+0000","last_clean":"2024-09-13T17:16:12.985766+0000","last_became_active":"2024-09-13T17:16:12.560074+0000","last_became_peered":"2024-09-13T17:16:12.560074+0000","last_unstale":"2024-09-13T17:16:12.985766+0000","last_undegraded":"2024-09-13T17:16:12.985766+0000","last_fullsized":"2024-09-13T17:16:12.985766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365768+0000","last_change":"2024-09-13T17:16:12.999010+0000","last_active":"2024-09-13T17:16:14.365768+0000","last_peered":"2024-09-13T17:16:14.365768+0000","last_clean":"2024-09-13T17:16:14.365768+0000","last_became_active":"2024-09-13T17:16:12.998782+0000","last_became_peered":"2024-09-13T17:16:12.998782+0000","last_unstale":"2024-09-13T17:16:14.365768+0000","last_undegraded":"2024-09-13T17:16:14.365768+0000","last_fullsized":"2024-09-13T17:16:14.365768+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:12.687029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978474+0000","last_change":"2024-09-13T17:16:12.561174+0000","last_active":"2024-09-13T17:16:12.978474+0000","last_peered":"2024-09-13T17:16:12.978474+0000","last_clean":"2024-09-13T17:16:12.978474+0000","last_became_active":"2024-09-13T17:16:12.560889+0000","last_became_peered":"2024-09-13T17:16:12.560889+0000","last_unstale":"2024-09-13T17:16:12.978474+0000","last_undegraded":"2024-09-13T17:16:12.978474+0000","last_fullsized":"2024-09-13T17:16:12.978474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:18.821543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372169+0000","last_change":"2024-09-13T17:16:12.987989+0000","last_active":"2024-09-13T17:16:14.372169+0000","last_peered":"2024-09-13T17:16:14.372169+0000","last_clean":"2024-09-13T17:16:14.372169+0000","last_became_active":"2024-09-13T17:16:12.987739+0000","last_became_peered":"2024-09-13T17:16:12.987739+0000","last_unstale":"2024-09-13T17:16:14.372169+0000","last_undegraded":"2024-09-13T17:16:14.372169+0000","last_fullsized":"2024-09-13T17:16:14.372169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:49.128142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.986065+0000","last_change":"2024-09-13T17:16:12.564452+0000","last_active":"2024-09-13T17:16:12.986065+0000","last_peered":"2024-09-13T17:16:12.986065+0000","last_clean":"2024-09-13T17:16:12.986065+0000","last_became_active":"2024-09-13T17:16:12.564176+0000","last_became_peered":"2024-09-13T17:16:12.564176+0000","last_unstale":"2024-09-13T17:16:12.986065+0000","last_undegraded":"2024-09-13T17:16:12.986065+0000","last_fullsized":"2024-09-13T17:16:12.986065+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085060+0000","last_change":"2024-09-13T17:16:12.988478+0000","last_active":"2024-09-13T17:16:15.085060+0000","last_peered":"2024-09-13T17:16:15.085060+0000","last_clean":"2024-09-13T17:16:15.085060+0000","last_became_active":"2024-09-13T17:16:12.988140+0000","last_became_peered":"2024-09-13T17:16:12.988140+0000","last_unstale":"2024-09-13T17:16:15.085060+0000","last_undegraded":"2024-09-13T17:16:15.085060+0000","last_fullsized":"2024-09-13T17:16:15.085060+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:48.672452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979348+0000","last_change":"2024-09-13T17:16:12.569646+0000","last_active":"2024-09-13T17:16:12.979348+0000","last_peered":"2024-09-13T17:16:12.979348+0000","last_clean":"2024-09-13T17:16:12.979348+0000","last_became_active":"2024-09-13T17:16:12.569382+0000","last_became_peered":"2024-09-13T17:16:12.569382+0000","last_unstale":"2024-09-13T17:16:12.979348+0000","last_undegraded":"2024-09-13T17:16:12.979348+0000","last_fullsized":"2024-09-13T17:16:12.979348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.201680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.372185+0000","last_change":"2024-09-13T17:16:12.993642+0000","last_active":"2024-09-13T17:16:14.372185+0000","last_peered":"2024-09-13T17:16:14.372185+0000","last_clean":"2024-09-13T17:16:14.372185+0000","last_became_active":"2024-09-13T17:16:12.993320+0000","last_became_peered":"2024-09-13T17:16:12.993320+0000","last_unstale":"2024-09-13T17:16:14.372185+0000","last_undegraded":"2024-09-13T17:16:14.372185+0000","last_fullsized":"2024-09-13T17:16:14.372185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:56.897116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.985592+0000","last_change":"2024-09-13T17:16:12.566862+0000","last_active":"2024-09-13T17:16:12.985592+0000","last_peered":"2024-09-13T17:16:12.985592+0000","last_clean":"2024-09-13T17:16:12.985592+0000","last_became_active":"2024-09-13T17:16:12.566304+0000","last_became_peered":"2024-09-13T17:16:12.566304+0000","last_unstale":"2024-09-13T17:16:12.985592+0000","last_undegraded":"2024-09-13T17:16:12.985592+0000","last_fullsized":"2024-09-13T17:16:12.985592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:17.298160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366067+0000","last_change":"2024-09-13T17:16:12.997086+0000","last_active":"2024-09-13T17:16:14.366067+0000","last_peered":"2024-09-13T17:16:14.366067+0000","last_clean":"2024-09-13T17:16:14.366067+0000","last_became_active":"2024-09-13T17:16:12.996794+0000","last_became_peered":"2024-09-13T17:16:12.996794+0000","last_unstale":"2024-09-13T17:16:14.366067+0000","last_undegraded":"2024-09-13T17:16:14.366067+0000","last_fullsized":"2024-09-13T17:16:14.366067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:16.583438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"68'3","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.004319+0000","last_change":"2024-09-13T17:16:12.569602+0000","last_active":"2024-09-13T17:16:13.004319+0000","last_peered":"2024-09-13T17:16:13.004319+0000","last_clean":"2024-09-13T17:16:13.004319+0000","last_became_active":"2024-09-13T17:16:12.569354+0000","last_became_peered":"2024-09-13T17:16:12.569354+0000","last_unstale":"2024-09-13T17:16:13.004319+0000","last_undegraded":"2024-09-13T17:16:13.004319+0000","last_fullsized":"2024-09-13T17:16:13.004319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:10.242420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982778+0000","last_change":"2024-09-13T17:16:12.988003+0000","last_active":"2024-09-13T17:16:13.982778+0000","last_peered":"2024-09-13T17:16:13.982778+0000","last_clean":"2024-09-13T17:16:13.982778+0000","last_became_active":"2024-09-13T17:16:12.987692+0000","last_became_peered":"2024-09-13T17:16:12.987692+0000","last_unstale":"2024-09-13T17:16:13.982778+0000","last_undegraded":"2024-09-13T17:16:13.982778+0000","last_fullsized":"2024-09-13T17:16:13.982778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:11.247859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"68'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006447+0000","last_change":"2024-09-13T17:16:12.557830+0000","last_active":"2024-09-13T17:16:13.006447+0000","last_peered":"2024-09-13T17:16:13.006447+0000","last_clean":"2024-09-13T17:16:13.006447+0000","last_became_active":"2024-09-13T17:16:12.557515+0000","last_became_peered":"2024-09-13T17:16:12.557515+0000","last_unstale":"2024-09-13T17:16:13.006447+0000","last_undegraded":"2024-09-13T17:16:13.006447+0000","last_fullsized":"2024-09-13T17:16:13.006447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982764+0000","last_change":"2024-09-13T17:16:12.987574+0000","last_active":"2024-09-13T17:16:13.982764+0000","last_peered":"2024-09-13T17:16:13.982764+0000","last_clean":"2024-09-13T17:16:13.982764+0000","last_became_active":"2024-09-13T17:16:12.987154+0000","last_became_peered":"2024-09-13T17:16:12.987154+0000","last_unstale":"2024-09-13T17:16:13.982764+0000","last_undegraded":"2024-09-13T17:16:13.982764+0000","last_fullsized":"2024-09-13T17:16:13.982764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:50.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006589+0000","last_change":"2024-09-13T17:16:12.563290+0000","last_active":"2024-09-13T17:16:13.006589+0000","last_peered":"2024-09-13T17:16:13.006589+0000","last_clean":"2024-09-13T17:16:13.006589+0000","last_became_active":"2024-09-13T17:16:12.562968+0000","last_became_peered":"2024-09-13T17:16:12.562968+0000","last_unstale":"2024-09-13T17:16:13.006589+0000","last_undegraded":"2024-09-13T17:16:13.006589+0000","last_fullsized":"2024-09-13T17:16:13.006589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:19.498189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981568+0000","last_change":"2024-09-13T17:16:12.990005+0000","last_active":"2024-09-13T17:16:13.981568+0000","last_peered":"2024-09-13T17:16:13.981568+0000","last_clean":"2024-09-13T17:16:13.981568+0000","last_became_active":"2024-09-13T17:16:12.989763+0000","last_became_peered":"2024-09-13T17:16:12.989763+0000","last_unstale":"2024-09-13T17:16:13.981568+0000","last_undegraded":"2024-09-13T17:16:13.981568+0000","last_fullsized":"2024-09-13T17:16:13.981568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:10.905248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.977882+0000","last_change":"2024-09-13T17:16:12.565523+0000","last_active":"2024-09-13T17:16:12.977882+0000","last_peered":"2024-09-13T17:16:12.977882+0000","last_clean":"2024-09-13T17:16:12.977882+0000","last_became_active":"2024-09-13T17:16:12.565270+0000","last_became_peered":"2024-09-13T17:16:12.565270+0000","last_unstale":"2024-09-13T17:16:12.977882+0000","last_undegraded":"2024-09-13T17:16:12.977882+0000","last_fullsized":"2024-09-13T17:16:12.977882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:32.426048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365730+0000","last_change":"2024-09-13T17:16:12.995252+0000","last_active":"2024-09-13T17:16:14.365730+0000","last_peered":"2024-09-13T17:16:14.365730+0000","last_clean":"2024-09-13T17:16:14.365730+0000","last_became_active":"2024-09-13T17:16:12.994924+0000","last_became_peered":"2024-09-13T17:16:12.994924+0000","last_unstale":"2024-09-13T17:16:14.365730+0000","last_undegraded":"2024-09-13T17:16:14.365730+0000","last_fullsized":"2024-09-13T17:16:14.365730+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:11.768473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979316+0000","last_change":"2024-09-13T17:16:12.566019+0000","last_active":"2024-09-13T17:16:12.979316+0000","last_peered":"2024-09-13T17:16:12.979316+0000","last_clean":"2024-09-13T17:16:12.979316+0000","last_became_active":"2024-09-13T17:16:12.564582+0000","last_became_peered":"2024-09-13T17:16:12.564582+0000","last_unstale":"2024-09-13T17:16:12.979316+0000","last_undegraded":"2024-09-13T17:16:12.979316+0000","last_fullsized":"2024-09-13T17:16:12.979316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084905+0000","last_change":"2024-09-13T17:16:12.992743+0000","last_active":"2024-09-13T17:16:15.084905+0000","last_peered":"2024-09-13T17:16:15.084905+0000","last_clean":"2024-09-13T17:16:15.084905+0000","last_became_active":"2024-09-13T17:16:12.992479+0000","last_became_peered":"2024-09-13T17:16:12.992479+0000","last_unstale":"2024-09-13T17:16:15.084905+0000","last_undegraded":"2024-09-13T17:16:15.084905+0000","last_fullsized":"2024-09-13T17:16:15.084905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:53.938624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"68'8","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.002455+0000","last_change":"2024-09-13T17:16:12.563244+0000","last_active":"2024-09-13T17:16:13.002455+0000","last_peered":"2024-09-13T17:16:13.002455+0000","last_clean":"2024-09-13T17:16:13.002455+0000","last_became_active":"2024-09-13T17:16:12.562971+0000","last_became_peered":"2024-09-13T17:16:12.562971+0000","last_unstale":"2024-09-13T17:16:13.002455+0000","last_undegraded":"2024-09-13T17:16:13.002455+0000","last_fullsized":"2024-09-13T17:16:13.002455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:01.770720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.984776+0000","last_change":"2024-09-13T17:16:12.994175+0000","last_active":"2024-09-13T17:16:13.984776+0000","last_peered":"2024-09-13T17:16:13.984776+0000","last_clean":"2024-09-13T17:16:13.984776+0000","last_became_active":"2024-09-13T17:16:12.993915+0000","last_became_peered":"2024-09-13T17:16:12.993915+0000","last_unstale":"2024-09-13T17:16:13.984776+0000","last_undegraded":"2024-09-13T17:16:13.984776+0000","last_fullsized":"2024-09-13T17:16:13.984776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.005366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.996142+0000","last_change":"2024-09-13T17:16:12.565555+0000","last_active":"2024-09-13T17:16:12.996142+0000","last_peered":"2024-09-13T17:16:12.996142+0000","last_clean":"2024-09-13T17:16:12.996142+0000","last_became_active":"2024-09-13T17:16:12.565240+0000","last_became_peered":"2024-09-13T17:16:12.565240+0000","last_unstale":"2024-09-13T17:16:12.996142+0000","last_undegraded":"2024-09-13T17:16:12.996142+0000","last_fullsized":"2024-09-13T17:16:12.996142+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365980+0000","last_change":"2024-09-13T17:16:12.999809+0000","last_active":"2024-09-13T17:16:14.365980+0000","last_peered":"2024-09-13T17:16:14.365980+0000","last_clean":"2024-09-13T17:16:14.365980+0000","last_became_active":"2024-09-13T17:16:12.999522+0000","last_became_peered":"2024-09-13T17:16:12.999522+0000","last_unstale":"2024-09-13T17:16:14.365980+0000","last_undegraded":"2024-09-13T17:16:14.365980+0000","last_fullsized":"2024-09-13T17:16:14.365980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:50.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.006943+0000","last_change":"2024-09-13T17:16:12.566114+0000","last_active":"2024-09-13T17:16:13.006943+0000","last_peered":"2024-09-13T17:16:13.006943+0000","last_clean":"2024-09-13T17:16:13.006943+0000","last_became_active":"2024-09-13T17:16:12.565839+0000","last_became_peered":"2024-09-13T17:16:12.565839+0000","last_unstale":"2024-09-13T17:16:13.006943+0000","last_undegraded":"2024-09-13T17:16:13.006943+0000","last_fullsized":"2024-09-13T17:16:13.006943+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:38.079422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982546+0000","last_change":"2024-09-13T17:16:13.002175+0000","last_active":"2024-09-13T17:16:13.982546+0000","last_peered":"2024-09-13T17:16:13.982546+0000","last_clean":"2024-09-13T17:16:13.982546+0000","last_became_active":"2024-09-13T17:16:13.001894+0000","last_became_peered":"2024-09-13T17:16:13.001894+0000","last_unstale":"2024-09-13T17:16:13.982546+0000","last_undegraded":"2024-09-13T17:16:13.982546+0000","last_fullsized":"2024-09-13T17:16:13.982546+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.280692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"68'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.004370+0000","last_change":"2024-09-13T17:16:12.569646+0000","last_active":"2024-09-13T17:16:13.004370+0000","last_peered":"2024-09-13T17:16:13.004370+0000","last_clean":"2024-09-13T17:16:13.004370+0000","last_became_active":"2024-09-13T17:16:12.569385+0000","last_became_peered":"2024-09-13T17:16:12.569385+0000","last_unstale":"2024-09-13T17:16:13.004370+0000","last_undegraded":"2024-09-13T17:16:13.004370+0000","last_fullsized":"2024-09-13T17:16:13.004370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:25.164928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366076+0000","last_change":"2024-09-13T17:16:12.997765+0000","last_active":"2024-09-13T17:16:14.366076+0000","last_peered":"2024-09-13T17:16:14.366076+0000","last_clean":"2024-09-13T17:16:14.366076+0000","last_became_active":"2024-09-13T17:16:12.997503+0000","last_became_peered":"2024-09-13T17:16:12.997503+0000","last_unstale":"2024-09-13T17:16:14.366076+0000","last_undegraded":"2024-09-13T17:16:14.366076+0000","last_fullsized":"2024-09-13T17:16:14.366076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:04.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978604+0000","last_change":"2024-09-13T17:16:12.563400+0000","last_active":"2024-09-13T17:16:12.978604+0000","last_peered":"2024-09-13T17:16:12.978604+0000","last_clean":"2024-09-13T17:16:12.978604+0000","last_became_active":"2024-09-13T17:16:12.563151+0000","last_became_peered":"2024-09-13T17:16:12.563151+0000","last_unstale":"2024-09-13T17:16:12.978604+0000","last_undegraded":"2024-09-13T17:16:12.978604+0000","last_fullsized":"2024-09-13T17:16:12.978604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:09.899809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084574+0000","last_change":"2024-09-13T17:16:12.989293+0000","last_active":"2024-09-13T17:16:15.084574+0000","last_peered":"2024-09-13T17:16:15.084574+0000","last_clean":"2024-09-13T17:16:15.084574+0000","last_became_active":"2024-09-13T17:16:12.989025+0000","last_became_peered":"2024-09-13T17:16:12.989025+0000","last_unstale":"2024-09-13T17:16:15.084574+0000","last_undegraded":"2024-09-13T17:16:15.084574+0000","last_fullsized":"2024-09-13T17:16:15.084574+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:23.217853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.000081+0000","last_change":"2024-09-13T17:16:12.561853+0000","last_active":"2024-09-13T17:16:13.000081+0000","last_peered":"2024-09-13T17:16:13.000081+0000","last_clean":"2024-09-13T17:16:13.000081+0000","last_became_active":"2024-09-13T17:16:12.561559+0000","last_became_peered":"2024-09-13T17:16:12.561559+0000","last_unstale":"2024-09-13T17:16:13.000081+0000","last_undegraded":"2024-09-13T17:16:13.000081+0000","last_fullsized":"2024-09-13T17:16:13.000081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:02.601952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.981604+0000","last_change":"2024-09-13T17:16:12.981987+0000","last_active":"2024-09-13T17:16:13.981604+0000","last_peered":"2024-09-13T17:16:13.981604+0000","last_clean":"2024-09-13T17:16:13.981604+0000","last_became_active":"2024-09-13T17:16:12.981701+0000","last_became_peered":"2024-09-13T17:16:12.981701+0000","last_unstale":"2024-09-13T17:16:13.981604+0000","last_undegraded":"2024-09-13T17:16:13.981604+0000","last_fullsized":"2024-09-13T17:16:13.981604+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:41.449660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978447+0000","last_change":"2024-09-13T17:16:12.564890+0000","last_active":"2024-09-13T17:16:12.978447+0000","last_peered":"2024-09-13T17:16:12.978447+0000","last_clean":"2024-09-13T17:16:12.978447+0000","last_became_active":"2024-09-13T17:16:12.564610+0000","last_became_peered":"2024-09-13T17:16:12.564610+0000","last_unstale":"2024-09-13T17:16:12.978447+0000","last_undegraded":"2024-09-13T17:16:12.978447+0000","last_fullsized":"2024-09-13T17:16:12.978447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:27.685746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365904+0000","last_change":"2024-09-13T17:16:12.998969+0000","last_active":"2024-09-13T17:16:14.365904+0000","last_peered":"2024-09-13T17:16:14.365904+0000","last_clean":"2024-09-13T17:16:14.365904+0000","last_became_active":"2024-09-13T17:16:12.998726+0000","last_became_peered":"2024-09-13T17:16:12.998726+0000","last_unstale":"2024-09-13T17:16:14.365904+0000","last_undegraded":"2024-09-13T17:16:14.365904+0000","last_fullsized":"2024-09-13T17:16:14.365904+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:21.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.981199+0000","last_change":"2024-09-13T17:16:12.565910+0000","last_active":"2024-09-13T17:16:12.981199+0000","last_peered":"2024-09-13T17:16:12.981199+0000","last_clean":"2024-09-13T17:16:12.981199+0000","last_became_active":"2024-09-13T17:16:12.565547+0000","last_became_peered":"2024-09-13T17:16:12.565547+0000","last_unstale":"2024-09-13T17:16:12.981199+0000","last_undegraded":"2024-09-13T17:16:12.981199+0000","last_fullsized":"2024-09-13T17:16:12.981199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:48.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.085173+0000","last_change":"2024-09-13T17:16:12.995218+0000","last_active":"2024-09-13T17:16:15.085173+0000","last_peered":"2024-09-13T17:16:15.085173+0000","last_clean":"2024-09-13T17:16:15.085173+0000","last_became_active":"2024-09-13T17:16:12.994977+0000","last_became_peered":"2024-09-13T17:16:12.994977+0000","last_unstale":"2024-09-13T17:16:15.085173+0000","last_undegraded":"2024-09-13T17:16:15.085173+0000","last_fullsized":"2024-09-13T17:16:15.085173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:19.532610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"68'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.997777+0000","last_change":"2024-09-13T17:16:12.562565+0000","last_active":"2024-09-13T17:16:12.997777+0000","last_peered":"2024-09-13T17:16:12.997777+0000","last_clean":"2024-09-13T17:16:12.997777+0000","last_became_active":"2024-09-13T17:16:12.562245+0000","last_became_peered":"2024-09-13T17:16:12.562245+0000","last_unstale":"2024-09-13T17:16:12.997777+0000","last_undegraded":"2024-09-13T17:16:12.997777+0000","last_fullsized":"2024-09-13T17:16:12.997777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:13.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.980192+0000","last_change":"2024-09-13T17:16:12.991881+0000","last_active":"2024-09-13T17:16:13.980192+0000","last_peered":"2024-09-13T17:16:13.980192+0000","last_clean":"2024-09-13T17:16:13.980192+0000","last_became_active":"2024-09-13T17:16:12.991624+0000","last_became_peered":"2024-09-13T17:16:12.991624+0000","last_unstale":"2024-09-13T17:16:13.980192+0000","last_undegraded":"2024-09-13T17:16:13.980192+0000","last_fullsized":"2024-09-13T17:16:13.980192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:00.403510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980032+0000","last_change":"2024-09-13T17:16:12.557454+0000","last_active":"2024-09-13T17:16:12.980032+0000","last_peered":"2024-09-13T17:16:12.980032+0000","last_clean":"2024-09-13T17:16:12.980032+0000","last_became_active":"2024-09-13T17:16:12.557147+0000","last_became_peered":"2024-09-13T17:16:12.557147+0000","last_unstale":"2024-09-13T17:16:12.980032+0000","last_undegraded":"2024-09-13T17:16:12.980032+0000","last_fullsized":"2024-09-13T17:16:12.980032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:15.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982033+0000","last_change":"2024-09-13T17:16:12.990771+0000","last_active":"2024-09-13T17:16:13.982033+0000","last_peered":"2024-09-13T17:16:13.982033+0000","last_clean":"2024-09-13T17:16:13.982033+0000","last_became_active":"2024-09-13T17:16:12.990371+0000","last_became_peered":"2024-09-13T17:16:12.990371+0000","last_unstale":"2024-09-13T17:16:13.982033+0000","last_undegraded":"2024-09-13T17:16:13.982033+0000","last_fullsized":"2024-09-13T17:16:13.982033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:04.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.981439+0000","last_change":"2024-09-13T17:16:12.555152+0000","last_active":"2024-09-13T17:16:12.981439+0000","last_peered":"2024-09-13T17:16:12.981439+0000","last_clean":"2024-09-13T17:16:12.981439+0000","last_became_active":"2024-09-13T17:16:12.554856+0000","last_became_peered":"2024-09-13T17:16:12.554856+0000","last_unstale":"2024-09-13T17:16:12.981439+0000","last_undegraded":"2024-09-13T17:16:12.981439+0000","last_fullsized":"2024-09-13T17:16:12.981439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.366111+0000","last_change":"2024-09-13T17:16:12.996387+0000","last_active":"2024-09-13T17:16:14.366111+0000","last_peered":"2024-09-13T17:16:14.366111+0000","last_clean":"2024-09-13T17:16:14.366111+0000","last_became_active":"2024-09-13T17:16:12.995896+0000","last_became_peered":"2024-09-13T17:16:12.995896+0000","last_unstale":"2024-09-13T17:16:14.366111+0000","last_undegraded":"2024-09-13T17:16:14.366111+0000","last_fullsized":"2024-09-13T17:16:14.366111+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:29.534667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980839+0000","last_change":"2024-09-13T17:16:12.558836+0000","last_active":"2024-09-13T17:16:12.980839+0000","last_peered":"2024-09-13T17:16:12.980839+0000","last_clean":"2024-09-13T17:16:12.980839+0000","last_became_active":"2024-09-13T17:16:12.558561+0000","last_became_peered":"2024-09-13T17:16:12.558561+0000","last_unstale":"2024-09-13T17:16:12.980839+0000","last_undegraded":"2024-09-13T17:16:12.980839+0000","last_fullsized":"2024-09-13T17:16:12.980839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:10.763034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365736+0000","last_change":"2024-09-13T17:16:12.995074+0000","last_active":"2024-09-13T17:16:14.365736+0000","last_peered":"2024-09-13T17:16:14.365736+0000","last_clean":"2024-09-13T17:16:14.365736+0000","last_became_active":"2024-09-13T17:16:12.994702+0000","last_became_peered":"2024-09-13T17:16:12.994702+0000","last_unstale":"2024-09-13T17:16:14.365736+0000","last_undegraded":"2024-09-13T17:16:14.365736+0000","last_fullsized":"2024-09-13T17:16:14.365736+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:01.005366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978272+0000","last_change":"2024-09-13T17:16:12.564455+0000","last_active":"2024-09-13T17:16:12.978272+0000","last_peered":"2024-09-13T17:16:12.978272+0000","last_clean":"2024-09-13T17:16:12.978272+0000","last_became_active":"2024-09-13T17:16:12.564131+0000","last_became_peered":"2024-09-13T17:16:12.564131+0000","last_unstale":"2024-09-13T17:16:12.978272+0000","last_undegraded":"2024-09-13T17:16:12.978272+0000","last_fullsized":"2024-09-13T17:16:12.978272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:01.727652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.982510+0000","last_change":"2024-09-13T17:16:12.991192+0000","last_active":"2024-09-13T17:16:13.982510+0000","last_peered":"2024-09-13T17:16:13.982510+0000","last_clean":"2024-09-13T17:16:13.982510+0000","last_became_active":"2024-09-13T17:16:12.990958+0000","last_became_peered":"2024-09-13T17:16:12.990958+0000","last_unstale":"2024-09-13T17:16:13.982510+0000","last_undegraded":"2024-09-13T17:16:13.982510+0000","last_fullsized":"2024-09-13T17:16:13.982510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:21.343190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.979005+0000","last_change":"2024-09-13T17:16:12.566149+0000","last_active":"2024-09-13T17:16:12.979005+0000","last_peered":"2024-09-13T17:16:12.979005+0000","last_clean":"2024-09-13T17:16:12.979005+0000","last_became_active":"2024-09-13T17:16:12.565903+0000","last_became_peered":"2024-09-13T17:16:12.565903+0000","last_unstale":"2024-09-13T17:16:12.979005+0000","last_undegraded":"2024-09-13T17:16:12.979005+0000","last_fullsized":"2024-09-13T17:16:12.979005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:16.921297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:15.084886+0000","last_change":"2024-09-13T17:16:12.998245+0000","last_active":"2024-09-13T17:16:15.084886+0000","last_peered":"2024-09-13T17:16:15.084886+0000","last_clean":"2024-09-13T17:16:15.084886+0000","last_became_active":"2024-09-13T17:16:12.998009+0000","last_became_peered":"2024-09-13T17:16:12.998009+0000","last_unstale":"2024-09-13T17:16:15.084886+0000","last_undegraded":"2024-09-13T17:16:15.084886+0000","last_fullsized":"2024-09-13T17:16:15.084886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:19.826982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978453+0000","last_change":"2024-09-13T17:16:12.560644+0000","last_active":"2024-09-13T17:16:12.978453+0000","last_peered":"2024-09-13T17:16:12.978453+0000","last_clean":"2024-09-13T17:16:12.978453+0000","last_became_active":"2024-09-13T17:16:12.560348+0000","last_became_peered":"2024-09-13T17:16:12.560348+0000","last_unstale":"2024-09-13T17:16:12.978453+0000","last_undegraded":"2024-09-13T17:16:12.978453+0000","last_fullsized":"2024-09-13T17:16:12.978453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:40.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:13.979989+0000","last_change":"2024-09-13T17:16:12.992512+0000","last_active":"2024-09-13T17:16:13.979989+0000","last_peered":"2024-09-13T17:16:13.979989+0000","last_clean":"2024-09-13T17:16:13.979989+0000","last_became_active":"2024-09-13T17:16:12.992258+0000","last_became_peered":"2024-09-13T17:16:12.992258+0000","last_unstale":"2024-09-13T17:16:13.979989+0000","last_undegraded":"2024-09-13T17:16:13.979989+0000","last_fullsized":"2024-09-13T17:16:13.979989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:17.873931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.980695+0000","last_change":"2024-09-13T17:16:12.565175+0000","last_active":"2024-09-13T17:16:12.980695+0000","last_peered":"2024-09-13T17:16:12.980695+0000","last_clean":"2024-09-13T17:16:12.980695+0000","last_became_active":"2024-09-13T17:16:12.564885+0000","last_became_peered":"2024-09-13T17:16:12.564885+0000","last_unstale":"2024-09-13T17:16:12.980695+0000","last_undegraded":"2024-09-13T17:16:12.980695+0000","last_fullsized":"2024-09-13T17:16:12.980695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:49.147123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T17:16:14.365856+0000","last_change":"2024-09-13T17:16:12.995174+0000","last_active":"2024-09-13T17:16:14.365856+0000","last_peered":"2024-09-13T17:16:14.365856+0000","last_clean":"2024-09-13T17:16:14.365856+0000","last_became_active":"2024-09-13T17:16:12.994860+0000","last_became_peered":"2024-09-13T17:16:12.994860+0000","last_unstale":"2024-09-13T17:16:14.365856+0000","last_undegraded":"2024-09-13T17:16:14.365856+0000","last_fullsized":"2024-09-13T17:16:14.365856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:12.538332+0000","last_clean_scrub_stamp":"2024-09-13T17:16:12.538332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.101697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.978090+0000","last_change":"2024-09-13T17:16:12.558429+0000","last_active":"2024-09-13T17:16:12.978090+0000","last_peered":"2024-09-13T17:16:12.978090+0000","last_clean":"2024-09-13T17:16:12.978090+0000","last_became_active":"2024-09-13T17:16:12.558080+0000","last_became_peered":"2024-09-13T17:16:12.558080+0000","last_unstale":"2024-09-13T17:16:12.978090+0000","last_undegraded":"2024-09-13T17:16:12.978090+0000","last_fullsized":"2024-09-13T17:16:12.978090+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:16:11.532893+0000","last_clean_scrub_stamp":"2024-09-13T17:16:11.532893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:52.933185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-13T17:16:12.977248+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:16:12.977248+0000","last_peered":"2024-09-13T17:16:12.977248+0000","last_clean":"2024-09-13T17:16:12.977248+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:16:12.977248+0000","last_undegraded":"2024-09-13T17:16:12.977248+0000","last_fullsized":"2024-09-13T17:16:12.977248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1445888,"data_stored":967537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72099999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.51200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72399999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67300000000000004,"5min":0.755,"15min":0.755},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.26400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.752},"last":0.37},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.498,"15min":0.505},"min":{"1min":0.28699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.54900000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.372,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":376427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.45200000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.623},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.495,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":376415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.82199999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67000000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84499999999999997,"5min":0.88,"15min":0.88},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.71299999999999997,"5min":1.173,"15min":1.173},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61899999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.33400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":1.085,"15min":1.085},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.74299999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.35499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81999999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86299999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":377957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49299999999999999,"15min":0.46899999999999997},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77000000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":1.034,"15min":1.034},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68100000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.48599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73499999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.497}]},{"osd":5,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.253,"15min":0.253},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":835584,"data_stored":376393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53800000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.22}]},{"osd":1,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50700000000000001,"5min":1.458,"15min":1.458},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56000000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40899999999999997,"15min":0.41899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81999999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.48799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.435},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":1.226,"15min":1.226},"last":0.48399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":835584,"data_stored":376393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.318,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.40699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53000000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.42799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56299999999999994,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73099999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76000000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.76200000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61899999999999999,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71199999999999997,"5min":0.871,"15min":0.871},"last":0.499}]},{"osd":7,"last update":"Fri Sep 13 17:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81000000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":864256,"data_stored":378721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.61099999999999999,"5min":1.159,"15min":1.159},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61299999999999999,"5min":1.081,"15min":1.081},"last":0.28599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.441},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64000000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65100000000000002,"5min":1.286,"15min":1.286},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78200000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.45900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":1.046,"15min":1.046},"last":0.375}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93999999999999995,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.62},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88200000000000001,"5min":1.254,"15min":1.254},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1429504,"data_stored":966761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.49299999999999999,"15min":0.41699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":14.106999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.51300000000000001,"15min":0.443},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.606999999999999,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.38},"min":{"1min":0.25800000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":14.262,"5min":14.262,"15min":14.262},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":12.574999999999999,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.44400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71099999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":3.956,"5min":3.956,"15min":3.956},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.998,"15min":0.998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.04,"5min":4.04,"15min":4.04},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.518000000000001,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.879,"15min":0.879},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:16:20.722 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:16:20.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:16:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.865+0000 7f98795fb640 1 Processor -- start 2024-09-13T17:16:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98795fb640 1 -- start start 2024-09-13T17:16:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98795fb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f987415c6e0 0x7f98740cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98795fb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98741610e0 con 0x7f98740cf440 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98795fb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740d0630 con 0x7f98740cf000 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98795fb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98740d0910 con 0x7f987415c6e0 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98737fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f98740cf440 0x7f98741609d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44880/0 (socket says 172.21.15.5:44880) 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.866+0000 7f98737fe640 1 -- 172.21.15.5:0/3455164866 learned_addr learned my addr 172.21.15.5:0/3455164866 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3455164866 >> v2:172.21.15.179:3300/0 conn(0x7f987415c6e0 0x7f98740cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852079875 0 0) 0x7f98741610e0 con 0x7f98740cf440 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9860003520 con 0x7f98740cf440 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701231377 0 0) 0x7f9860003520 con 0x7f98740cf440 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 >> v2:172.21.15.179:3300/0 conn(0x7f987415c6e0 msgr2=0x7f98740cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 --2- 172.21.15.5:0/3455164866 >> v2:172.21.15.179:3300/0 conn(0x7f987415c6e0 0x7f98740cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 >> v1:172.21.15.179:6789/0 conn(0x7f98740cf000 legacy=0x7f98741602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740d0bf0 con 0x7f98740cf440 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f9864001670 con 0x7f98740cf440 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 >> v1:172.21.15.5:6789/0 conn(0x7f98740cf440 legacy=0x7f98741609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f9860003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98600047c0 0x7f9860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9860005180 0x7f986000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98740d0910 con 0x7f9860003970 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986000c020 con 0x7f9860005180 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986000c1e0 con 0x7f98600047c0 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f9860003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f98737fe640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9860005180 0x7f986000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.867+0000 7f98727fc640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98600047c0 0x7f9860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 -- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98600047c0 msgr2=0x7f9860004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98600047c0 0x7f9860004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 -- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9860005180 msgr2=0x7f986000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9860005180 0x7f986000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 -- 172.21.15.5:0/3455164866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860003520 con 0x7f9860003970 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f98737fe640 1 -- 172.21.15.5:0/3455164866 reap_dead start 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f9860003d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f986c009fc0 tx=0x7f98600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3b0464f250cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c031640 con 0x7f9860003970 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c02d070 con 0x7f9860003970 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.868+0000 7f9871ffb640 1 -- 172.21.15.5:0/3455164866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0319e0 con 0x7f9860003970 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 -- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 msgr2=0x7f9860003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f9860003d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f986c009fc0 tx=0x7f98600057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 -- 172.21.15.5:0/3455164866 shutdown_connections 2024-09-13T17:16:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 --2- 172.21.15.5:0/3455164866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f9860003d90 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 -- 172.21.15.5:0/3455164866 >> 172.21.15.5:0/3455164866 conn(0x7f9874089f90 msgr2=0x7f98740d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 -- 172.21.15.5:0/3455164866 shutdown_connections 2024-09-13T17:16:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.869+0000 7f98795fb640 1 -- 172.21.15.5:0/3455164866 wait complete. 2024-09-13T17:16:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.870+0000 7f98795fb640 1 Processor -- start 2024-09-13T17:16:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.870+0000 7f98795fb640 1 -- start start 2024-09-13T17:16:20.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987415cdc0 0x7f98740cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98740cb1a0 0x7f98740b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98740cc0c0 con 0x7f9860003970 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987415eaa0 con 0x7f987415cdc0 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98795fb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98740cb630 con 0x7f98740cb1a0 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f9872ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f9872ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58840/0 (socket says 172.21.15.5:58840) 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f9872ffd640 1 -- 172.21.15.5:0/3171423123 learned_addr learned my addr 172.21.15.5:0/3171423123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98727fc640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987415cdc0 0x7f98740cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.871+0000 7f98737fe640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98740cb1a0 0x7f98740b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 -- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98740cb1a0 msgr2=0x7f98740b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98740cb1a0 0x7f98740b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 -- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987415cdc0 msgr2=0x7f98740cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987415cdc0 0x7f98740cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 -- 172.21.15.5:0/3171423123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740cb820 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f9872ffd640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f986c000f80 tx=0x7f986c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c003990 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c040070 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c003d10 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98740cbb00 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.872+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98741f2c70 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.873+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98740672e0 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.874+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f986c042030 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.874+0000 7f986b7fe640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 0x7f985406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.874+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f986c0aa5f0 con 0x7f9860003970 2024-09-13T17:16:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.874+0000 7f98727fc640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 0x7f985406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.875+0000 7f98727fc640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 0x7f985406d0c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f987415a810 tx=0x7f985c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:20.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:20.878+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f986c075730 con 0x7f9860003970 2024-09-13T17:16:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.121+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f987415e800 con 0x7f9860003970 2024-09-13T17:16:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.124+0000 7f986b7fe640 1 -- 172.21.15.5:0/3171423123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f987415e800 con 0x7f9860003970 2024-09-13T17:16:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 msgr2=0x7f985406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 0x7f985406d0c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f987415a810 tx=0x7f985c009040 comp rx=0 tx=0).stop 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 msgr2=0x7f98741528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f986c000f80 tx=0x7f986c009750 comp rx=0 tx=0).stop 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 shutdown_connections 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98740cb1a0 0x7f98740b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f987415cdc0 0x7f98740cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f985406ac00 0x7f985406d0c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 --2- 172.21.15.5:0/3171423123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9860003970 0x7f98741528f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 >> 172.21.15.5:0/3171423123 conn(0x7f9874089f90 msgr2=0x7f987406aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 shutdown_connections 2024-09-13T17:16:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.127+0000 7f98795fb640 1 -- 172.21.15.5:0/3171423123 wait complete. 2024-09-13T17:16:21.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.239+0000 7ff4bf64f640 1 Processor -- start 2024-09-13T17:16:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 -- start start 2024-09-13T17:16:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b806e090 0x7ff4b80ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 0x7ff4b80b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80ab9f0 con 0x7ff4b815a3e0 2024-09-13T17:16:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b806e4d0 con 0x7ff4b806e090 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.240+0000 7ff4bf64f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b806d410 con 0x7ff4b80ab5a0 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b806e090 0x7ff4b80ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bd3eb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4b815a3e0 0x7ff4b806c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44892/0 (socket says 172.21.15.5:44892) 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4b806e090 0x7ff4b80ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58850/0 (socket says 172.21.15.5:58850) 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bd3eb640 1 -- 172.21.15.5:0/2864429815 learned_addr learned my addr 172.21.15.5:0/2864429815 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bdbec640 1 --2- 172.21.15.5:0/2864429815 >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 0x7ff4b80b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 -- 172.21.15.5:0/2864429815 >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 msgr2=0x7ff4b80b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 --2- 172.21.15.5:0/2864429815 >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 0x7ff4b80b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 -- 172.21.15.5:0/2864429815 >> v1:172.21.15.5:6789/0 conn(0x7ff4b815a3e0 legacy=0x7ff4b806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4affff640 1 -- 172.21.15.5:0/2864429815 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063148787 0 0) 0x7ff4b4001110 con 0x7ff4b815a3e0 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bcbea640 1 -- 172.21.15.5:0/2864429815 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b806cb70 con 0x7ff4b806e090 2024-09-13T17:16:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.241+0000 7ff4bdbec640 1 --2- 172.21.15.5:0/2864429815 >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 0x7ff4b80b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bcbea640 1 --2- 172.21.15.5:0/2864429815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b806e090 0x7ff4b80ab060 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806b990 tx=0x7ff4a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753db146f58e5407 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4affff640 1 -- 172.21.15.5:0/2864429815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8032440 con 0x7ff4b806e090 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4affff640 1 -- 172.21.15.5:0/2864429815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80325a0 con 0x7ff4b806e090 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4affff640 1 -- 172.21.15.5:0/2864429815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8032930 con 0x7ff4b806e090 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2864429815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b806e090 msgr2=0x7ff4b80ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2864429815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b806e090 0x7ff4b80ab060 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806b990 tx=0x7ff4a802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2864429815 shutdown_connections 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2864429815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b806e090 0x7ff4b80ab060 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2864429815 >> v2:172.21.15.179:3300/0 conn(0x7ff4b80ab5a0 0x7ff4b80b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.242+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2864429815 >> 172.21.15.5:0/2864429815 conn(0x7ff4b80ce0d0 msgr2=0x7ff4b80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.243+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2864429815 shutdown_connections 2024-09-13T17:16:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.243+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2864429815 wait complete. 2024-09-13T17:16:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.244+0000 7ff4bf64f640 1 Processor -- start 2024-09-13T17:16:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.244+0000 7ff4bf64f640 1 -- start start 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.244+0000 7ff4bf64f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4b806e090 0x7ff4b81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4b80ab5a0 0x7ff4b81e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80706e0 con 0x7ff4b815a3e0 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81552e0 con 0x7ff4b80ab5a0 2024-09-13T17:16:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8155530 con 0x7ff4b806e090 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58860/0 (socket says 172.21.15.5:58860) 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 -- 172.21.15.5:0/2626999231 learned_addr learned my addr 172.21.15.5:0/2626999231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bd3eb640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4b806e090 0x7ff4b81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bcbea640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4b80ab5a0 0x7ff4b81e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 -- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4b806e090 msgr2=0x7ff4b81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4b806e090 0x7ff4b81481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 -- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4b80ab5a0 msgr2=0x7ff4b81e50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4b80ab5a0 0x7ff4b81e50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 -- 172.21.15.5:0/2626999231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009400 con 0x7ff4b815a3e0 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bdbec640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cef0 tx=0x7ff4b000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000d840 con 0x7ff4b815a3e0 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000d9c0 con 0x7ff4b815a3e0 2024-09-13T17:16:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b8155810 con 0x7ff4b815a3e0 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.245+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000dd70 con 0x7ff4b815a3e0 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.246+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8155dd0 con 0x7ff4b815a3e0 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.247+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8070820 con 0x7ff4b815a3e0 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.247+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4b001e3b0 con 0x7ff4b815a3e0 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.247+0000 7ff4adffb640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 0x7ff49c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.247+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4b0089e30 con 0x7ff4b815a3e0 2024-09-13T17:16:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.248+0000 7ff4bd3eb640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 0x7ff49c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.248+0000 7ff4bd3eb640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 0x7ff49c06d0c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007fd0 tx=0x7ff4b4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.252+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4b8070820 con 0x7ff4b815a3e0 2024-09-13T17:16:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.457+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b8070820 con 0x7ff4b815a3e0 2024-09-13T17:16:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.457+0000 7ff4adffb640 1 -- 172.21.15.5:0/2626999231 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7ff4b8070820 con 0x7ff4b815a3e0 2024-09-13T17:16:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:21.459 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:16:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 msgr2=0x7ff49c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 0x7ff49c06d0c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007fd0 tx=0x7ff4b4007de0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 msgr2=0x7ff4b814c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cef0 tx=0x7ff4b000a710 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 shutdown_connections 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff49c06ac00 0x7ff49c06d0c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4b815a3e0 0x7ff4b814c3d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4b80ab5a0 0x7ff4b81e50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 --2- 172.21.15.5:0/2626999231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4b806e090 0x7ff4b81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 >> 172.21.15.5:0/2626999231 conn(0x7ff4b80ce0d0 msgr2=0x7ff4b8156830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 shutdown_connections 2024-09-13T17:16:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.459+0000 7ff4bf64f640 1 -- 172.21.15.5:0/2626999231 wait complete. 2024-09-13T17:16:21.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:16:12.971543+0000', 'modified': '2024-09-13T17:16:14.978457+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6639}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6639': {'gid': 6639, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1809726047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 1809726047}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1809726047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:16:21.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:16:21.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:16:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.981+0000 7fc0d9061640 1 Processor -- start 2024-09-13T17:16:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.981+0000 7fc0d9061640 1 -- start start 2024-09-13T17:16:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d9061640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0d415c810 0x7fc0d40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d9061640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d40d1e80 con 0x7fc0d40d06d0 2024-09-13T17:16:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d9061640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d40d1750 con 0x7fc0d40b4cf0 2024-09-13T17:16:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d9061640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d40d0bd0 con 0x7fc0d415c810 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0d40d06d0 0x7fc0d40b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44896/0 (socket says 172.21.15.5:44896) 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.982+0000 7fc0d259c640 1 -- 172.21.15.5:0/2326772948 learned_addr learned my addr 172.21.15.5:0/2326772948 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> v2:172.21.15.179:3300/0 conn(0x7fc0d415c810 0x7fc0d40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639657741 0 0) 0x7fc0d40d1e80 con 0x7fc0d40d06d0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c0003520 con 0x7fc0d40d06d0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933465060 0 0) 0x7fc0d40d1750 con 0x7fc0d40b4cf0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d40d1e80 con 0x7fc0d40b4cf0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1904764536 0 0) 0x7fc0c0003520 con 0x7fc0d40d06d0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 >> v2:172.21.15.179:3300/0 conn(0x7fc0d415c810 msgr2=0x7fc0d40cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 --2- 172.21.15.5:0/2326772948 >> v2:172.21.15.179:3300/0 conn(0x7fc0d415c810 0x7fc0d40cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 >> v1:172.21.15.179:6789/0 conn(0x7fc0d40b4cf0 legacy=0x7fc0d40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d40d0eb0 con 0x7fc0d40d06d0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fc0bc001670 con 0x7fc0d40d06d0 2024-09-13T17:16:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 >> v1:172.21.15.5:6789/0 conn(0x7fc0d40d06d0 legacy=0x7fc0d40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 0x7fc0c0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0c00047c0 0x7fc0c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0005180 0x7fc0c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40d0bd0 con 0x7fc0c0003b00 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c000c000 con 0x7fc0c0005180 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c000c1c0 con 0x7fc0c00047c0 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> v2:172.21.15.179:3300/0 conn(0x7fc0d415c810 0x7fc0d40cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 0x7fc0c0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0005180 0x7fc0c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0c00047c0 0x7fc0c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0c00047c0 msgr2=0x7fc0c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0c00047c0 0x7fc0c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0005180 msgr2=0x7fc0c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0005180 0x7fc0c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2326772948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c0003520 con 0x7fc0c0003b00 2024-09-13T17:16:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.983+0000 7fc0d359e640 1 -- 172.21.15.5:0/2326772948 reap_dead start 2024-09-13T17:16:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.984+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 0x7fc0c0003f00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400e350 tx=0x7fc0c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6611e2a92829b0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.984+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4003b90 con 0x7fc0c0003b00 2024-09-13T17:16:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.984+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400f040 con 0x7fc0c0003b00 2024-09-13T17:16:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.984+0000 7fc0d1d9b640 1 -- 172.21.15.5:0/2326772948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4004020 con 0x7fc0c0003b00 2024-09-13T17:16:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 -- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 msgr2=0x7fc0c0003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 0x7fc0c0003f00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400e350 tx=0x7fc0c00057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 -- 172.21.15.5:0/2326772948 shutdown_connections 2024-09-13T17:16:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 --2- 172.21.15.5:0/2326772948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c0003b00 0x7fc0c0003f00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 -- 172.21.15.5:0/2326772948 >> 172.21.15.5:0/2326772948 conn(0x7fc0d40717a0 msgr2=0x7fc0d4071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 -- 172.21.15.5:0/2326772948 shutdown_connections 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.985+0000 7fc0d9061640 1 -- 172.21.15.5:0/2326772948 wait complete. 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.986+0000 7fc0d9061640 1 Processor -- start 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 -- start start 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0003b00 0x7fc0d40c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40cae60 0x7fc0d41f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40c6770 con 0x7fc0d40c7a20 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40c7590 con 0x7fc0c0003b00 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d9061640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40c6980 con 0x7fc0d40cae60 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58874/0 (socket says 172.21.15.5:58874) 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d359e640 1 -- 172.21.15.5:0/3825551704 learned_addr learned my addr 172.21.15.5:0/3825551704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0003b00 0x7fc0d40c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.987+0000 7fc0d259c640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40cae60 0x7fc0d41f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 -- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40cae60 msgr2=0x7fc0d41f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40cae60 0x7fc0d41f1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 -- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0003b00 msgr2=0x7fc0d40c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0003b00 0x7fc0d40c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 -- 172.21.15.5:0/3825551704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d40c6c60 con 0x7fc0d40c7a20 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d359e640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ccd00 tx=0x7fc0cc00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0cb7fe640 1 -- 172.21.15.5:0/3825551704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc005030 con 0x7fc0d40c7a20 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0cb7fe640 1 -- 172.21.15.5:0/3825551704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc005190 con 0x7fc0d40c7a20 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40c6f40 con 0x7fc0d40c7a20 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0cb7fe640 1 -- 172.21.15.5:0/3825551704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc0067d0 con 0x7fc0d40c7a20 2024-09-13T17:16:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.988+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d41f1c80 con 0x7fc0d40c7a20 2024-09-13T17:16:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.990+0000 7fc0cb7fe640 1 -- 172.21.15.5:0/3825551704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc0cc006930 con 0x7fc0d40c7a20 2024-09-13T17:16:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.990+0000 7fc0cb7fe640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 0x7fc0b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.990+0000 7fc0cb7fe640 1 -- 172.21.15.5:0/3825551704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0cc0886c0 con 0x7fc0d40c7a20 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.990+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 0x7fc0b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.991+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 0x7fc0b406d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4034000 tx=0x7fc0c402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.991+0000 7fc0dbe61740 1 Processor -- start 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.991+0000 7fc0dbe61740 1 -- start start 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5645845290a0 0x564584529480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584526860 0x564584576570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645844837c0 con 0x564584550550 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564584492b70 con 0x564584526860 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564584490300 con 0x5645845290a0 2024-09-13T17:16:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58888/0 (socket says 172.21.15.5:58888) 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 -- 172.21.15.5:0/2163805902 learned_addr learned my addr 172.21.15.5:0/2163805902 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584526860 0x564584576570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5645845290a0 0x564584529480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 -- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5645845290a0 msgr2=0x564584529480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5645845290a0 0x564584529480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 -- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584526860 msgr2=0x564584576570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584526860 0x564584576570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.992+0000 7fc0d359e640 1 -- 172.21.15.5:0/2163805902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645844184b0 con 0x564584550550 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc086ae0 tx=0x7fc0cc056ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ef5be3c7374aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0c8ff9640 1 -- 172.21.15.5:0/2163805902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc05b120 con 0x564584550550 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0c8ff9640 1 -- 172.21.15.5:0/2163805902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc05f8a0 con 0x564584550550 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0c8ff9640 1 -- 172.21.15.5:0/2163805902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc053c70 con 0x564584550550 2024-09-13T17:16:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2163805902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 msgr2=0x564584576ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc086ae0 tx=0x7fc0cc056ec0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2163805902 shutdown_connections 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564584550550 0x564584576ab0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584526860 0x564584576570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.993+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2163805902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5645845290a0 0x564584529480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.994+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2163805902 >> 172.21.15.5:0/2163805902 conn(0x5645845257d0 msgr2=0x56458456dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.994+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2163805902 shutdown_connections 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.994+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2163805902 wait complete. 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.994+0000 7fc0dbe61740 1 -- start start 2024-09-13T17:16:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.994+0000 7fc0dbe61740 1 Processor -- start 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x564584523480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x5645845239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56458448bbf0 con 0x5645845290a0 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56458444a250 con 0x564584550550 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x564584449ef0 con 0x56458454ff70 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0dbe61740 10 client.0 _ll_register_callbacks cb 0x56458447c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58902/0 (socket says 172.21.15.5:58902) 2024-09-13T17:16:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2656467011 learned_addr learned my addr 172.21.15.5:0/2656467011 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x5645845239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x564584523480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 msgr2=0x5645845239c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x5645845239c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 msgr2=0x564584523480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x564584523480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2656467011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d41f1c80 con 0x5645845290a0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.995+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x564584523480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.996+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc0c402b040 tx=0x7fc0c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc26bf3b57121b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.996+0000 7fc0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c404b050 con 0x5645845290a0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56458417f3c0 con 0x5645845290a0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0c4044610 con 0x5645845290a0 2024-09-13T17:16:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0c400e040 con 0x5645845290a0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 10 client.6792 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x56458448a270 con 0x5645845290a0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56458417f3c0 con 0x5645845290a0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc0c40447d0 con 0x5645845290a0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 10 client.6792 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 10 client.6792 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 20 client.6792 populate_metadata read hostname 'smithi005' 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x56458454e990 0x56458454ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 4 client.6792 mds_command: new command op to 6639 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.997+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 --> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645841906c0 con 0x56458454e990 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x56458454e990 0x56458454ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0b1ffb640 10 client.6792 ms_handle_connect on v2:172.21.15.5:6833/1809726047 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x56458454e990 0x56458454ed70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d67d4fa39ffd1c43 server_cookie=aba9ec9b9334b4b9 in_seq=0 out_seq=0 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/2656467011 <== mds.0 v2:172.21.15.5:6833/1809726047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5645841906c0 con 0x56458454e990 2024-09-13T17:16:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0b1ffb640 10 client.6792 handle_command_reply: tid=0 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.998+0000 7fc0dbe61740 1 client.6792 shutdown 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 msgr2=0x56458454dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc0c402b040 tx=0x7fc0c4004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 shutdown_connections 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x5645845239c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x56458454e990 0x56458454ed70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x564584523480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2656467011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454dc40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0b1ffb640 0 client.6792 ms_handle_reset on v2:172.21.15.5:6833/1809726047 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 >> 172.21.15.5:0/2656467011 conn(0x564584526860 msgr2=0x56458456bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 shutdown_connections 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2656467011 wait complete. 2024-09-13T17:16:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:21.999+0000 7fc0dbe61740 20 client.6792 trim_cache size 0 max 16384 2024-09-13T17:16:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.014+0000 7fc0dbe61740 1 Processor -- start 2024-09-13T17:16:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.014+0000 7fc0dbe61740 1 -- start start 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.014+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.014+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56458454ff70 0x56458456b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564584550550 0x564584522330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56458440f460 con 0x5645845290a0 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56458456fdc0 con 0x56458454ff70 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56458456d810 con 0x564584550550 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58908/0 (socket says 172.21.15.5:58908) 2024-09-13T17:16:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2654120640 learned_addr learned my addr 172.21.15.5:0/2654120640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d259c640 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56458454ff70 0x56458456b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d359e640 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564584550550 0x564584522330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564584550550 msgr2=0x564584522330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564584550550 0x564584522330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56458454ff70 msgr2=0x56458456b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56458454ff70 0x56458456b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/2654120640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56458442c5f0 con 0x5645845290a0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4004a60 tx=0x7fc0c403a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3574dc3fc07d24a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0c97fa640 1 -- 172.21.15.5:0/2654120640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c404b070 con 0x5645845290a0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0c97fa640 1 -- 172.21.15.5:0/2654120640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c404c040 con 0x5645845290a0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.015+0000 7fc0c97fa640 1 -- 172.21.15.5:0/2654120640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400e040 con 0x5645845290a0 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2654120640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 msgr2=0x56458454ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4004a60 tx=0x7fc0c403a050 comp rx=0 tx=0).stop 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2654120640 shutdown_connections 2024-09-13T17:16:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564584550550 0x564584522330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56458454ff70 0x56458456b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/2654120640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x56458454ee20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2654120640 >> 172.21.15.5:0/2654120640 conn(0x564584526860 msgr2=0x564584571140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2654120640 shutdown_connections 2024-09-13T17:16:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- 172.21.15.5:0/2654120640 wait complete. 2024-09-13T17:16:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 -- start start 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.016+0000 7fc0dbe61740 1 Processor -- start 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x564584526d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x5645845272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564584523620 con 0x5645845290a0 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56458456f0c0 con 0x564584550550 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645845d7870 con 0x56458454ff70 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0dbe61740 10 client.0 _ll_register_callbacks cb 0x7fc0bc001b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58924/0 (socket says 172.21.15.5:58924) 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/1713811916 learned_addr learned my addr 172.21.15.5:0/1713811916 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.017+0000 7fc0d259c640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x564584526d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d359e640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x5645845272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 msgr2=0x564584526d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x564584526d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 msgr2=0x5645845272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x5645845272b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 -- 172.21.15.5:0/1713811916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56458448a270 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d259c640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x564584526d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0d2d9d640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc0c402b040 tx=0x7fc0c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261ffcb763915c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400e040 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0c40448c0 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0cc05f8a0 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0c402b090 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 10 client.6798 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x564584451d00 con 0x5645845290a0 2024-09-13T17:16:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc05f8a0 con 0x5645845290a0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc0c4038820 con 0x5645845290a0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 10 client.6798 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 10 client.6798 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 20 client.6798 populate_metadata read hostname 'smithi005' 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x5645845223c0 0x5645845227a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 4 client.6798 mds_command: new command op to 6639 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.018+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 --> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5645841e3d10 con 0x5645845223c0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0d259c640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x5645845223c0 0x5645845227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0d259c640 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x5645845223c0 0x5645845227a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=543005fce8f4127 server_cookie=a86ca05745759819 in_seq=0 out_seq=0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0b1ffb640 10 client.6798 ms_handle_connect on v2:172.21.15.5:6833/1809726047 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0b1ffb640 1 -- 172.21.15.5:0/1713811916 <== mds.0 v2:172.21.15.5:6833/1809726047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5645841e3d10 con 0x5645845223c0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0b1ffb640 10 client.6798 handle_command_reply: tid=0 2024-09-13T17:16:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 client.6798 shutdown 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 msgr2=0x5645845d7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc0c402b040 tx=0x7fc0c4004ab0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 shutdown_connections 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:6833/1809726047,v1:172.21.15.5:6835/1809726047] conn(0x5645845223c0 0x5645845227a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564584550550 0x5645845272b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0b1ffb640 0 client.6798 ms_handle_reset on v2:172.21.15.5:6833/1809726047 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56458454ff70 0x564584526d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 --2- 172.21.15.5:0/1713811916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645845290a0 0x5645845d7330 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 >> 172.21.15.5:0/1713811916 conn(0x564584526860 msgr2=0x564584571140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 shutdown_connections 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 1 -- 172.21.15.5:0/1713811916 wait complete. 2024-09-13T17:16:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.019+0000 7fc0dbe61740 20 client.6798 trim_cache size 0 max 16384 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6639, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.0466120340000007, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 30, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 69, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 69, 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.543148539000001 2024-09-13T17:16:22.027 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:16:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 msgr2=0x7fc0b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 0x7fc0b406d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4034000 tx=0x7fc0c402f000 comp rx=0 tx=0).stop 2024-09-13T17:16:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 msgr2=0x7fc0d40c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ccd00 tx=0x7fc0cc00fc00 comp rx=0 tx=0).stop 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 shutdown_connections 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc0b406ac00 0x7fc0b406d0c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0d40c7a20 0x7fc0d40c83d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0d40cae60 0x7fc0d41f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 --2- 172.21.15.5:0/3825551704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0c0003b00 0x7fc0d40c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 >> 172.21.15.5:0/3825551704 conn(0x7fc0d40717a0 msgr2=0x7fc0d4071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 shutdown_connections 2024-09-13T17:16:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.020+0000 7fc0d9061640 1 -- 172.21.15.5:0/3825551704 wait complete. 2024-09-13T17:16:22.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:16:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.132+0000 7f15e7dff640 1 Processor -- start 2024-09-13T17:16:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.132+0000 7f15e7dff640 1 -- start start 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e7dff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e00b4cf0 0x7f15e00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e7dff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15e00d06d0 0x7f15e00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e7dff640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00d1e80 con 0x7f15e015c810 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e7dff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e00d1750 con 0x7f15e00d06d0 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e7dff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00d0bd0 con 0x7f15e00b4cf0 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e639c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15e00d06d0 0x7f15e00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e5b9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15e015c810 0x7f15e00b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44906/0 (socket says 172.21.15.5:44906) 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.133+0000 7f15e5b9b640 1 -- 172.21.15.5:0/1764253899 learned_addr learned my addr 172.21.15.5:0/1764253899 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e539a640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e00b4cf0 0x7f15e00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e639c640 1 -- 172.21.15.5:0/1764253899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e00b4cf0 msgr2=0x7f15e00cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e639c640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e00b4cf0 0x7f15e00cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e639c640 1 -- 172.21.15.5:0/1764253899 >> v1:172.21.15.5:6789/0 conn(0x7f15e015c810 legacy=0x7f15e00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e639c640 1 -- 172.21.15.5:0/1764253899 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00d0eb0 con 0x7f15e00d06d0 2024-09-13T17:16:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e4b99640 1 -- 172.21.15.5:0/1764253899 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987593495 0 0) 0x7f15e00d1e80 con 0x7f15e015c810 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.134+0000 7f15e639c640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e00b5a90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f15d80097a0 tx=0x7f15d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d87dd6e0f96f3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e4b99640 1 -- 172.21.15.5:0/1764253899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8032440 con 0x7f15e00d06d0 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e4b99640 1 -- 172.21.15.5:0/1764253899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80325a0 con 0x7f15e00d06d0 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e4b99640 1 -- 172.21.15.5:0/1764253899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8032930 con 0x7f15e00d06d0 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 -- 172.21.15.5:0/1764253899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 msgr2=0x7f15e00b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e00b5a90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f15d80097a0 tx=0x7f15d802a180 comp rx=0 tx=0).stop 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 -- 172.21.15.5:0/1764253899 shutdown_connections 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e00b5a90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 --2- 172.21.15.5:0/1764253899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e00b4cf0 0x7f15e00cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 -- 172.21.15.5:0/1764253899 >> 172.21.15.5:0/1764253899 conn(0x7f15e00717a0 msgr2=0x7f15e0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 -- 172.21.15.5:0/1764253899 shutdown_connections 2024-09-13T17:16:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.135+0000 7f15e7dff640 1 -- 172.21.15.5:0/1764253899 wait complete. 2024-09-13T17:16:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.136+0000 7f15e7dff640 1 Processor -- start 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.136+0000 7f15e7dff640 1 -- start start 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 0x7f15e01f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e015c810 0x7f15e0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e0159a70 con 0x7f15e00d06d0 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00caf60 con 0x7f15e00b4cf0 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e7dff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e01f23f0 con 0x7f15e015c810 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e539a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e539a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58956/0 (socket says 172.21.15.5:58956) 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e539a640 1 -- 172.21.15.5:0/974224807 learned_addr learned my addr 172.21.15.5:0/974224807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e639c640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e015c810 0x7f15e0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.137+0000 7f15e5b9b640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 0x7f15e01f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 -- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e015c810 msgr2=0x7f15e0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e015c810 0x7f15e0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 -- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 msgr2=0x7f15e01f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 0x7f15e01f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 -- 172.21.15.5:0/974224807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8009400 con 0x7f15e00d06d0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e5b9b640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 0x7f15e01f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e539a640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f15d400d800 tx=0x7f15d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400b6c0 con 0x7f15e00d06d0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400b820 con 0x7f15e00d06d0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e01f26d0 con 0x7f15e00d06d0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400bbb0 con 0x7f15e00d06d0 2024-09-13T17:16:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.138+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e01f2c90 con 0x7f15e00d06d0 2024-09-13T17:16:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.139+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00672a0 con 0x7f15e00d06d0 2024-09-13T17:16:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.139+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15d400bd10 con 0x7f15e00d06d0 2024-09-13T17:16:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.140+0000 7f15de7fc640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 0x7f15cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.140+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15d40899d0 con 0x7f15e00d06d0 2024-09-13T17:16:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.140+0000 7f15e5b9b640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 0x7f15cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.141+0000 7f15e5b9b640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 0x7f15cc06d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15d0007fd0 tx=0x7f15d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.144+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f15d4054a70 con 0x7f15e00d06d0 2024-09-13T17:16:22.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.349+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15e00b5a90 con 0x7f15e00d06d0 2024-09-13T17:16:22.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.350+0000 7f15de7fc640 1 -- 172.21.15.5:0/974224807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f15d4058090 con 0x7f15e00d06d0 2024-09-13T17:16:22.351 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.351+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 msgr2=0x7f15cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.351+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 0x7f15cc06d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15d0007fd0 tx=0x7f15d0009040 comp rx=0 tx=0).stop 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.351+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 msgr2=0x7f15e0152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.351+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f15d400d800 tx=0x7f15d400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 shutdown_connections 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e015c810 0x7f15e0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15cc06ac00 0x7f15cc06d0c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00d06d0 0x7f15e0152e70 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 --2- 172.21.15.5:0/974224807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e00b4cf0 0x7f15e01f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 >> 172.21.15.5:0/974224807 conn(0x7f15e00717a0 msgr2=0x7f15e015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 shutdown_connections 2024-09-13T17:16:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:22.352+0000 7f15e7dff640 1 -- 172.21.15.5:0/974224807 wait complete. 2024-09-13T17:16:22.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:16:22.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:16:22.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:16:22.363 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:16:22.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:22.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:16:22.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:16:22.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:16:22.364 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:16:22.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.364 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:16:22.380 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:16:22.381 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42548sec preferred_lft 42548sec 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.382 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:22.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.383 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:16:22.445 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:16:22.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.447 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:16:22.503 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:16:22.504 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:16:22.504 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:16:22.504 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:16:22.504 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:16:22.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.504 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:16:22.505 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:16:22.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:16:22.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:16:22.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:16:22.505 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:16:22.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.593 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:16:22.608 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:16:22.609 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:16:22.609 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:16:22.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:16:22.675 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:16:22.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:22.675 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:22.731 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:16:22.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:22.732 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:22.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:16:22.854 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:22.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:22.920 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:22.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:22.920 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:16:22.977 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:16:22.977 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:16:23.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:16:23.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:23.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:23.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:16:23.102+0000 7f6d2ffb9480 -1 init, newargv = 0x5602d72486b0 newargc=15 2024-09-13T17:16:23.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[61715]: starting ceph client 2024-09-13T17:16:23.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[61715]: starting fuse 2024-09-13T17:16:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:23.115 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:23.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:23.115 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:16:23.172 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:16:23.172 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:16:23.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:16:23.172 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:16:23.173 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:16:23.174 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:16:23.288 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.61715.asok 2024-09-13T17:16:23.475 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61715.asok 2024-09-13T17:16:23.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:23.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61715.asok status 2024-09-13T17:16:23.611 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "61715", 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6813, 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:16:23.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 6813 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2357296356 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2357296356 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:16:23.613 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.6813 192.168.0.1:0/2357296356", 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2357296356", 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 30, 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 69, 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:16:23.614 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:16:23.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:23.620 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:16:23.620 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:23.637 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:16:23.637 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:23.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:23.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:23.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.845+0000 7f06056aa640 1 Processor -- start 2024-09-13T17:16:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.845+0000 7f06056aa640 1 -- start start 2024-09-13T17:16:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f06056aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f060006e090 0x7f06000ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f06056aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06000ab5a0 0x7f06000b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f06056aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000ab9f0 con 0x7f060015a3e0 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f06056aa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060006e4d0 con 0x7f06000ab5a0 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f06056aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060006d410 con 0x7f060006e090 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06000ab5a0 0x7f06000b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06000ab5a0 0x7f06000b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47502/0 (socket says 172.21.15.5:47502) 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 -- 172.21.15.5:0/2857407924 learned_addr learned my addr 172.21.15.5:0/2857407924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05fe7fc640 1 --2- 172.21.15.5:0/2857407924 >> v2:172.21.15.179:3300/0 conn(0x7f060006e090 0x7f06000ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 -- 172.21.15.5:0/2857407924 >> v2:172.21.15.179:3300/0 conn(0x7f060006e090 msgr2=0x7f06000ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 --2- 172.21.15.5:0/2857407924 >> v2:172.21.15.179:3300/0 conn(0x7f060006e090 0x7f06000ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 -- 172.21.15.5:0/2857407924 >> v1:172.21.15.179:6789/0 conn(0x7f060015a3e0 legacy=0x7f060006c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.846+0000 7f05ff7fe640 1 -- 172.21.15.5:0/2857407924 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060006cb70 con 0x7f06000ab5a0 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.847+0000 7f05ff7fe640 1 --2- 172.21.15.5:0/2857407924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06000ab5a0 0x7f06000b1640 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f06000b3190 tx=0x7f05f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b47d2198361023 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.847+0000 7f05fdffb640 1 -- 172.21.15.5:0/2857407924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8031600 con 0x7f06000ab5a0 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.847+0000 7f05fdffb640 1 -- 172.21.15.5:0/2857407924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f802d050 con 0x7f06000ab5a0 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.847+0000 7f05fdffb640 1 -- 172.21.15.5:0/2857407924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8031980 con 0x7f06000ab5a0 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 -- 172.21.15.5:0/2857407924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06000ab5a0 msgr2=0x7f06000b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 --2- 172.21.15.5:0/2857407924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06000ab5a0 0x7f06000b1640 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f06000b3190 tx=0x7f05f802a730 comp rx=0 tx=0).stop 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 -- 172.21.15.5:0/2857407924 shutdown_connections 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 --2- 172.21.15.5:0/2857407924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06000ab5a0 0x7f06000b1640 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 --2- 172.21.15.5:0/2857407924 >> v2:172.21.15.179:3300/0 conn(0x7f060006e090 0x7f06000ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 -- 172.21.15.5:0/2857407924 >> 172.21.15.5:0/2857407924 conn(0x7f06000ce0d0 msgr2=0x7f06000ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 -- 172.21.15.5:0/2857407924 shutdown_connections 2024-09-13T17:16:23.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.848+0000 7f06056aa640 1 -- 172.21.15.5:0/2857407924 wait complete. 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.849+0000 7f06056aa640 1 Processor -- start 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.849+0000 7f06056aa640 1 -- start start 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06000ab5a0 0x7f060015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f060015a3e0 0x7f060015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600149b70 con 0x7f060006e090 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600071880 con 0x7f060015a3e0 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f06056aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600070c00 con 0x7f06000ab5a0 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47508/0 (socket says 172.21.15.5:47508) 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 -- 172.21.15.5:0/1696179330 learned_addr learned my addr 172.21.15.5:0/1696179330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05fe7fc640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06000ab5a0 0x7f060015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05ff7fe640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f060015a3e0 0x7f060015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 -- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06000ab5a0 msgr2=0x7f060015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06000ab5a0 0x7f060015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 -- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f060015a3e0 msgr2=0x7f060015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f060015a3e0 0x7f060015b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 -- 172.21.15.5:0/1696179330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8009b30 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.850+0000 7f05feffd640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c400 tx=0x7f05f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.851+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00052d0 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.851+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0005430 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.851+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0600070ee0 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.851+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0003830 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.851+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06000714a0 con 0x7f060006e090 2024-09-13T17:16:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.852+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06000719c0 con 0x7f060006e090 2024-09-13T17:16:23.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.852+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05f0003990 con 0x7f060006e090 2024-09-13T17:16:23.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.853+0000 7f05e77fe640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 0x7f05ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:23.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.853+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f05f00887d0 con 0x7f060006e090 2024-09-13T17:16:23.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.853+0000 7f05fe7fc640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 0x7f05ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.853+0000 7f05fe7fc640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 0x7f05ec06d0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0600071c80 tx=0x7f05f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:23.857+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06000719c0 con 0x7f060006e090 2024-09-13T17:16:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.063+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06000ab9f0 con 0x7f060006e090 2024-09-13T17:16:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.063+0000 7f05e77fe640 1 -- 172.21.15.5:0/1696179330 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f06000ab9f0 con 0x7f060006e090 2024-09-13T17:16:24.065 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:16:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 msgr2=0x7f05ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 0x7f05ec06d0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0600071c80 tx=0x7f05f4008040 comp rx=0 tx=0).stop 2024-09-13T17:16:24.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 msgr2=0x7f060015ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c400 tx=0x7f05f000c8c0 comp rx=0 tx=0).stop 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 shutdown_connections 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f060015a3e0 0x7f060015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06000ab5a0 0x7f060015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f05ec06ac30 0x7f05ec06d0f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 --2- 172.21.15.5:0/1696179330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060006e090 0x7f060015ac10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 >> 172.21.15.5:0/1696179330 conn(0x7f06000ce0d0 msgr2=0x7f06000acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 shutdown_connections 2024-09-13T17:16:24.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:24.065+0000 7f06056aa640 1 -- 172.21.15.5:0/1696179330 wait complete. 2024-09-13T17:16:24.077 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:16:24.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:16:24.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:16:24.077 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:16:24.077 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:24.078 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:16:24.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:16:24.078 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:16:24.078 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:24.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.078 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:16:24.098 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42511sec preferred_lft 42511sec 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:24.099 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:16:24.100 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:24.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.101 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:16:24.166 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:16:24.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.168 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:16:24.226 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:16:24.226 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:16:24.226 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:16:24.226 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:16:24.226 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:16:24.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:16:24.227 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:16:24.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.321 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:16:24.337 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:16:24.337 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:16:24.337 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:24.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.337 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:16:24.402 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:16:24.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:24.403 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:24.458 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:24.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:24.459 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:24.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:24.579 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:24.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:24.643 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:24.644 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:24.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.645 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:24.700 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:16:24.701 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:16:24.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:24.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:24.768 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:24.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:16:24.821+0000 7f555680c480 -1 init, newargv = 0x55feeaaa2100 newargc=15 2024-09-13T17:16:24.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45242]: starting ceph client 2024-09-13T17:16:24.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45242]: starting fuse 2024-09-13T17:16:24.835 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:24.836 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:24.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:24.837 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:24.892 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:16:24.893 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:16:24.893 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:16:24.894 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:16:24.895 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:24.895 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:16:24.895 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:16:25.006 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.45242.asok 2024-09-13T17:16:25.192 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45242.asok 2024-09-13T17:16:25.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:25.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45242.asok status 2024-09-13T17:16:25.325 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "45242", 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 5909, 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:16:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 5909 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 2770696128 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 2770696128 2024-09-13T17:16:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.5909 192.168.0.1:0/2770696128", 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/2770696128", 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 30, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 69, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:16:25.328 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:16:25.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:25.334 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:16:25.334 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:25.349 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:16:25.349 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:25.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:25.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:25.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:25.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo) 2024-09-13T17:16:25.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:25.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir foo/bar) 2024-09-13T17:16:25.501 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:16:25.502 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:25.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.709+0000 7f8e88cd7640 1 Processor -- start 2024-09-13T17:16:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.709+0000 7f8e88cd7640 1 -- start start 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e88cd7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8e84151240 0x7f8e8415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e88cd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e840b2a40 0x7f8e840700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e88cd7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e840b2230 con 0x7f8e84070620 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e88cd7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8415aaa0 con 0x7f8e84151240 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e88cd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8415ed90 con 0x7f8e840b2a40 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e8259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8e84151240 0x7f8e8415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e82d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8e84070620 0x7f8e8415aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57688/0 (socket says 172.21.15.5:57688) 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e82d9d640 1 -- 172.21.15.5:0/4043165700 learned_addr learned my addr 172.21.15.5:0/4043165700 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.710+0000 7f8e81d9b640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e840b2a40 0x7f8e840700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8259c640 1 -- 172.21.15.5:0/4043165700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e840b2a40 msgr2=0x7f8e840700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8259c640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e840b2a40 0x7f8e840700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8259c640 1 -- 172.21.15.5:0/4043165700 >> v1:172.21.15.5:6789/0 conn(0x7f8e84070620 legacy=0x7f8e8415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8159a640 1 -- 172.21.15.5:0/4043165700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419938404 0 0) 0x7f8e840b2230 con 0x7f8e84070620 2024-09-13T17:16:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8259c640 1 -- 172.21.15.5:0/4043165700 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8415e4f0 con 0x7f8e84151240 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8259c640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e8415de80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009d90 tx=0x7f8e7402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111f0c77d65b55e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.711+0000 7f8e8159a640 1 -- 172.21.15.5:0/4043165700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74031600 con 0x7f8e84151240 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e8159a640 1 -- 172.21.15.5:0/4043165700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7402d050 con 0x7f8e84151240 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e8159a640 1 -- 172.21.15.5:0/4043165700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74031980 con 0x7f8e84151240 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 -- 172.21.15.5:0/4043165700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 msgr2=0x7f8e8415de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e8415de80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009d90 tx=0x7f8e7402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 -- 172.21.15.5:0/4043165700 shutdown_connections 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e840b2a40 0x7f8e840700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/4043165700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e8415de80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 -- 172.21.15.5:0/4043165700 >> 172.21.15.5:0/4043165700 conn(0x7f8e840b0000 msgr2=0x7f8e840b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 -- 172.21.15.5:0/4043165700 shutdown_connections 2024-09-13T17:16:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.712+0000 7f8e88cd7640 1 -- 172.21.15.5:0/4043165700 wait complete. 2024-09-13T17:16:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 Processor -- start 2024-09-13T17:16:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 -- start start 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e84070620 0x7f8e84146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e840b2a40 0x7f8e840ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840afba0 con 0x7f8e84151240 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84146a90 con 0x7f8e840b2a40 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e88cd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84151ae0 con 0x7f8e84070620 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e82d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.714+0000 7f8e82d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47526/0 (socket says 172.21.15.5:47526) 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 -- 172.21.15.5:0/364194091 learned_addr learned my addr 172.21.15.5:0/364194091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e8259c640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e84070620 0x7f8e84146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e81d9b640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e840b2a40 0x7f8e840ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 -- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e84070620 msgr2=0x7f8e84146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e84070620 0x7f8e84146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 -- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e840b2a40 msgr2=0x7f8e840ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e840b2a40 0x7f8e840ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 -- 172.21.15.5:0/364194091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74009a70 con 0x7f8e84151240 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e82d9d640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c440 tx=0x7f8e7c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0074e0 con 0x7f8e84151240 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c007640 con 0x7f8e84151240 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84151dc0 con 0x7f8e84151240 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c004a20 con 0x7f8e84151240 2024-09-13T17:16:25.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.715+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84152380 con 0x7f8e84151240 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.716+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e841525a0 con 0x7f8e84151240 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.717+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e7c004b80 con 0x7f8e84151240 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.717+0000 7f8e7affd640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.717+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e7c0890c0 con 0x7f8e84151240 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.717+0000 7f8e8259c640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:25.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.718+0000 7f8e8259c640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 0x7f8e6406d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8e74034000 tx=0x7f8e7402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:25.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.721+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8e7c054210 con 0x7f8e84151240 2024-09-13T17:16:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.893+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e840672a0 con 0x7f8e84151240 2024-09-13T17:16:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.894+0000 7f8e7affd640 1 -- 172.21.15.5:0/364194091 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f8e7c001060 con 0x7f8e84151240 2024-09-13T17:16:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:25.895 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 msgr2=0x7f8e6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 0x7f8e6406d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8e74034000 tx=0x7f8e7402f000 comp rx=0 tx=0).stop 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 msgr2=0x7f8e840aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c440 tx=0x7f8e7c00c900 comp rx=0 tx=0).stop 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 shutdown_connections 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e6406ac00 0x7f8e6406d0c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e84151240 0x7f8e840aed50 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e840b2a40 0x7f8e840ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 --2- 172.21.15.5:0/364194091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e84070620 0x7f8e84146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 >> 172.21.15.5:0/364194091 conn(0x7f8e840b0000 msgr2=0x7f8e840cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 shutdown_connections 2024-09-13T17:16:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:25.896+0000 7f8e88cd7640 1 -- 172.21.15.5:0/364194091 wait complete. 2024-09-13T17:16:25.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:25.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.012+0000 7feac56e9640 1 Processor -- start 2024-09-13T17:16:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.012+0000 7feac56e9640 1 -- start start 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.012+0000 7feac56e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac0071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.012+0000 7feac56e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feac01598a0 0x7feac00b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feac56e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac0153380 con 0x7feac00b20e0 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feac56e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00b2530 con 0x7feac01598a0 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feac56e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac0070f10 con 0x7feac0152fa0 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feac01598a0 0x7feac00b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feac01598a0 0x7feac00b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47536/0 (socket says 172.21.15.5:47536) 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 -- 172.21.15.5:0/2053507071 learned_addr learned my addr 172.21.15.5:0/2053507071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabeffd640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac0071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 -- 172.21.15.5:0/2053507071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 msgr2=0x7feac0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac0071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 -- 172.21.15.5:0/2053507071 >> v1:172.21.15.179:6789/0 conn(0x7feac00b20e0 legacy=0x7feac006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.013+0000 7feabe7fc640 1 -- 172.21.15.5:0/2053507071 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00711f0 con 0x7feac01598a0 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feabe7fc640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac00b1ba0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7feab4009870 tx=0x7feab402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b10350d7dfe0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feabdffb640 1 -- 172.21.15.5:0/2053507071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4032440 con 0x7feac01598a0 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feabdffb640 1 -- 172.21.15.5:0/2053507071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40325a0 con 0x7feac01598a0 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feabdffb640 1 -- 172.21.15.5:0/2053507071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4032930 con 0x7feac01598a0 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 -- 172.21.15.5:0/2053507071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 msgr2=0x7feac00b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac00b1ba0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7feab4009870 tx=0x7feab402a270 comp rx=0 tx=0).stop 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 -- 172.21.15.5:0/2053507071 shutdown_connections 2024-09-13T17:16:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac00b1ba0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 --2- 172.21.15.5:0/2053507071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac0071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.014+0000 7feac56e9640 1 -- 172.21.15.5:0/2053507071 >> 172.21.15.5:0/2053507071 conn(0x7feac00ce130 msgr2=0x7feac00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.015+0000 7feac56e9640 1 -- 172.21.15.5:0/2053507071 shutdown_connections 2024-09-13T17:16:26.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.015+0000 7feac56e9640 1 -- 172.21.15.5:0/2053507071 wait complete. 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.016+0000 7feac56e9640 1 Processor -- start 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.016+0000 7feac56e9640 1 -- start start 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b20e0 0x7feac009ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac015ac20 con 0x7feac01598a0 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac015a010 con 0x7feac00b20e0 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac015a2f0 con 0x7feac0152fa0 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabeffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b20e0 0x7feac009ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47544/0 (socket says 172.21.15.5:47544) 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 -- 172.21.15.5:0/3604882323 learned_addr learned my addr 172.21.15.5:0/3604882323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabe7fc640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 -- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 msgr2=0x7feac014dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac014dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 -- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b20e0 msgr2=0x7feac009ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b20e0 0x7feac009ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 -- 172.21.15.5:0/3604882323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40094d0 con 0x7feac01598a0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feabf7fe640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7feab800c7a0 tx=0x7feab800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8003b70 con 0x7feac01598a0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab8003cf0 con 0x7feac01598a0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac015a5d0 con 0x7feac01598a0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8003ea0 con 0x7feac01598a0 2024-09-13T17:16:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.017+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac009b2a0 con 0x7feac01598a0 2024-09-13T17:16:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.018+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00672a0 con 0x7feac01598a0 2024-09-13T17:16:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.019+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feab800aa90 con 0x7feac01598a0 2024-09-13T17:16:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.019+0000 7feaa77fe640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.019+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feab80891c0 con 0x7feac01598a0 2024-09-13T17:16:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.019+0000 7feabeffd640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.020+0000 7feabeffd640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 0x7feaac06d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feab0009b40 tx=0x7feab0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.024+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feab8054310 con 0x7feac01598a0 2024-09-13T17:16:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.196+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feac009b430 con 0x7feac01598a0 2024-09-13T17:16:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.197+0000 7feaa77fe640 1 -- 172.21.15.5:0/3604882323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7feab8057930 con 0x7feac01598a0 2024-09-13T17:16:26.198 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 msgr2=0x7feaac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 0x7feaac06d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feab0009b40 tx=0x7feab0009190 comp rx=0 tx=0).stop 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 msgr2=0x7feac014e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7feab800c7a0 tx=0x7feab800cc60 comp rx=0 tx=0).stop 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 shutdown_connections 2024-09-13T17:16:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac01598a0 0x7feac014e170 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac0152fa0 0x7feac014dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 --2- 172.21.15.5:0/3604882323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b20e0 0x7feac009ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 >> 172.21.15.5:0/3604882323 conn(0x7feac00ce130 msgr2=0x7feac0098ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 shutdown_connections 2024-09-13T17:16:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.199+0000 7feac56e9640 1 -- 172.21.15.5:0/3604882323 wait complete. 2024-09-13T17:16:26.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.314+0000 7f6fec00d640 1 Processor -- start 2024-09-13T17:16:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.314+0000 7f6fec00d640 1 -- start start 2024-09-13T17:16:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fec00d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe40ad720 0x7f6fe415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fec00d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe406c520 con 0x7f6fe4157e20 2024-09-13T17:16:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fec00d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe406c800 con 0x7f6fe406c090 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fec00d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe415b900 con 0x7f6fe40ad720 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fea5aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe40ad720 0x7f6fe415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fe9da9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6fe4157e20 0x7f6fe40ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57696/0 (socket says 172.21.15.5:57696) 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fea5aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe40ad720 0x7f6fe415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47556/0 (socket says 172.21.15.5:47556) 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fe9da9640 1 -- 172.21.15.5:0/3531941136 learned_addr learned my addr 172.21.15.5:0/3531941136 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fea5aa640 1 -- 172.21.15.5:0/3531941136 >> v1:172.21.15.179:6789/0 conn(0x7f6fe406c090 legacy=0x7f6fe40b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fea5aa640 1 -- 172.21.15.5:0/3531941136 >> v1:172.21.15.5:6789/0 conn(0x7f6fe4157e20 legacy=0x7f6fe40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fea5aa640 1 -- 172.21.15.5:0/3531941136 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe406cae0 con 0x7f6fe40ad720 2024-09-13T17:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.315+0000 7f6fe8da7640 1 -- 172.21.15.5:0/3531941136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678680402 0 0) 0x7f6fe406c520 con 0x7f6fe4157e20 2024-09-13T17:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.316+0000 7f6fea5aa640 1 --2- 172.21.15.5:0/3531941136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe40ad720 0x7f6fe415b3c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6f44cc3e5f9af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.316+0000 7f6fe8da7640 1 -- 172.21.15.5:0/3531941136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007740 con 0x7f6fe40ad720 2024-09-13T17:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.316+0000 7f6fe8da7640 1 -- 172.21.15.5:0/3531941136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc02d050 con 0x7f6fe40ad720 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.316+0000 7f6fe8da7640 1 -- 172.21.15.5:0/3531941136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007ac0 con 0x7f6fe40ad720 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 -- 172.21.15.5:0/3531941136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe40ad720 msgr2=0x7f6fe415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3531941136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe40ad720 0x7f6fe415b3c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc02a6f0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 -- 172.21.15.5:0/3531941136 shutdown_connections 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3531941136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe40ad720 0x7f6fe415b3c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 -- 172.21.15.5:0/3531941136 >> 172.21.15.5:0/3531941136 conn(0x7f6fe40ce130 msgr2=0x7f6fe40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 -- 172.21.15.5:0/3531941136 shutdown_connections 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.317+0000 7f6fec00d640 1 -- 172.21.15.5:0/3531941136 wait complete. 2024-09-13T17:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.318+0000 7f6fec00d640 1 Processor -- start 2024-09-13T17:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.318+0000 7f6fec00d640 1 -- start start 2024-09-13T17:16:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe40ad720 0x7f6fe4150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe40b2ea0 0x7f6fe4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40af440 con 0x7f6fe4157e20 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe414cc30 con 0x7f6fe40ad720 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fec00d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40af690 con 0x7f6fe40b2ea0 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47564/0 (socket says 172.21.15.5:47564) 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 -- 172.21.15.5:0/3810399873 learned_addr learned my addr 172.21.15.5:0/3810399873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe9da9640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe40ad720 0x7f6fe4150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fea5aa640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe40b2ea0 0x7f6fe4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 -- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe40b2ea0 msgr2=0x7f6fe4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe40b2ea0 0x7f6fe4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 -- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe40ad720 msgr2=0x7f6fe4150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe40ad720 0x7f6fe4150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.319+0000 7f6fe95a8640 1 -- 172.21.15.5:0/3810399873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc009a70 con 0x7f6fe4157e20 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fe95a8640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c450 tx=0x7f6fd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80052d0 con 0x7f6fe4157e20 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd8005430 con 0x7f6fe4157e20 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe414ced0 con 0x7f6fe4157e20 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8012870 con 0x7f6fe4157e20 2024-09-13T17:16:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.320+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe41439f0 con 0x7f6fe4157e20 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.321+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe40af800 con 0x7f6fe4157e20 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.322+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6fd80129d0 con 0x7f6fe4157e20 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.322+0000 7f6fd67fc640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 0x7f6fc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.322+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6fd8088e90 con 0x7f6fe4157e20 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.322+0000 7f6fe9da9640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 0x7f6fc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.323+0000 7f6fe9da9640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 0x7f6fc806d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000f60 tx=0x7f6fe0007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.326+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6fd8053fe0 con 0x7f6fe4157e20 2024-09-13T17:16:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.496+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fe40672a0 con 0x7f6fe4157e20 2024-09-13T17:16:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.496+0000 7f6fd67fc640 1 -- 172.21.15.5:0/3810399873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fd8057600 con 0x7f6fe4157e20 2024-09-13T17:16:26.498 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 msgr2=0x7f6fc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 0x7f6fc806d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000f60 tx=0x7f6fe0007e40 comp rx=0 tx=0).stop 2024-09-13T17:16:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 msgr2=0x7f6fe4151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c450 tx=0x7f6fd800c910 comp rx=0 tx=0).stop 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 shutdown_connections 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe40b2ea0 0x7f6fe4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6fc806ac00 0x7f6fc806d0c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe4157e20 0x7f6fe4151060 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 --2- 172.21.15.5:0/3810399873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe40ad720 0x7f6fe4150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 >> 172.21.15.5:0/3810399873 conn(0x7f6fe40ce130 msgr2=0x7f6fe415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 shutdown_connections 2024-09-13T17:16:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.499+0000 7f6fec00d640 1 -- 172.21.15.5:0/3810399873 wait complete. 2024-09-13T17:16:26.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.613+0000 7ff183a87640 1 Processor -- start 2024-09-13T17:16:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.614+0000 7ff183a87640 1 -- start start 2024-09-13T17:16:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.614+0000 7ff183a87640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff17c06c090 0x7ff17c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.614+0000 7ff183a87640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c06c520 con 0x7ff17c157e20 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.614+0000 7ff183a87640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c06c800 con 0x7ff17c0ad720 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.614+0000 7ff183a87640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c15b900 con 0x7ff17c06c090 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181823640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff17c157e20 0x7ff17c0ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57712/0 (socket says 172.21.15.5:57712) 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181823640 1 -- 172.21.15.5:0/3009976549 learned_addr learned my addr 172.21.15.5:0/3009976549 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342178967 0 0) 0x7ff17c06c520 con 0x7ff17c157e20 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181022640 1 --2- 172.21.15.5:0/3009976549 >> v2:172.21.15.179:3300/0 conn(0x7ff17c06c090 0x7ff17c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff168003520 con 0x7ff17c157e20 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1160679212 0 0) 0x7ff168003520 con 0x7ff17c157e20 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 >> v2:172.21.15.179:3300/0 conn(0x7ff17c06c090 msgr2=0x7ff17c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 --2- 172.21.15.5:0/3009976549 >> v2:172.21.15.179:3300/0 conn(0x7ff17c06c090 0x7ff17c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 >> v1:172.21.15.179:6789/0 conn(0x7ff17c0ad720 legacy=0x7ff17c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c06cae0 con 0x7ff17c157e20 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff178001670 con 0x7ff17c157e20 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181022640 1 --2- 172.21.15.5:0/3009976549 >> v2:172.21.15.179:3300/0 conn(0x7ff17c06c090 0x7ff17c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 >> v1:172.21.15.5:6789/0 conn(0x7ff17c157e20 legacy=0x7ff17c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 0x7ff168003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1680047c0 0x7ff168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168005180 0x7ff16800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c15b900 con 0x7ff168003970 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16800c0d0 con 0x7ff168005180 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16800c290 con 0x7ff1680047c0 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181823640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 0x7ff168003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff181022640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1680047c0 0x7ff168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.615+0000 7ff182024640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168005180 0x7ff16800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 -- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1680047c0 msgr2=0x7ff168004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1680047c0 0x7ff168004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 -- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168005180 msgr2=0x7ff16800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168005180 0x7ff16800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 -- 172.21.15.5:0/3009976549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168003520 con 0x7ff168003970 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff182024640 1 -- 172.21.15.5:0/3009976549 reap_dead start 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff181823640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 0x7ff168003d90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c190 tx=0x7ff1680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165f3da93415e819 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178005ad0 con 0x7ff168003970 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17802d070 con 0x7ff168003970 2024-09-13T17:16:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.616+0000 7ff180821640 1 -- 172.21.15.5:0/3009976549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178007070 con 0x7ff168003970 2024-09-13T17:16:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 -- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 msgr2=0x7ff168003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 0x7ff168003d90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c190 tx=0x7ff1680057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 -- 172.21.15.5:0/3009976549 shutdown_connections 2024-09-13T17:16:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 --2- 172.21.15.5:0/3009976549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff168003970 0x7ff168003d90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 -- 172.21.15.5:0/3009976549 >> 172.21.15.5:0/3009976549 conn(0x7ff17c0ce130 msgr2=0x7ff17c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 -- 172.21.15.5:0/3009976549 shutdown_connections 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.617+0000 7ff183a87640 1 -- 172.21.15.5:0/3009976549 wait complete. 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.618+0000 7ff183a87640 1 Processor -- start 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.618+0000 7ff183a87640 1 -- start start 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168003970 0x7ff17c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff17c1416e0 0x7ff17c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c140cd0 con 0x7ff17c1431d0 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c140fb0 con 0x7ff168003970 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff183a87640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c141290 con 0x7ff17c1416e0 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47572/0 (socket says 172.21.15.5:47572) 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 -- 172.21.15.5:0/1803506706 learned_addr learned my addr 172.21.15.5:0/1803506706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff181022640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff17c1416e0 0x7ff17c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff181823640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168003970 0x7ff17c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 -- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff17c1416e0 msgr2=0x7ff17c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff17c1416e0 0x7ff17c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 -- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168003970 msgr2=0x7ff17c155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168003970 0x7ff17c155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.619+0000 7ff182024640 1 -- 172.21.15.5:0/1803506706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c070dd0 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff182024640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff174007fd0 tx=0x7ff17400e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174006d60 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174003970 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c0710b0 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174003d20 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.620+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c143b90 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.621+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c0672a0 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.621+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff174005110 con 0x7ff17c1431d0 2024-09-13T17:16:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.622+0000 7ff1727fc640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 0x7ff16006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.622+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff174088c30 con 0x7ff17c1431d0 2024-09-13T17:16:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.622+0000 7ff181823640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 0x7ff16006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.623+0000 7ff181823640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 0x7ff16006d0c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff178032000 tx=0x7ff17802d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.626+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff174053d60 con 0x7ff17c1431d0 2024-09-13T17:16:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.796+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff17c15b3c0 con 0x7ff17c1431d0 2024-09-13T17:16:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.796+0000 7ff1727fc640 1 -- 172.21.15.5:0/1803506706 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff174019020 con 0x7ff17c1431d0 2024-09-13T17:16:26.797 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 msgr2=0x7ff16006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 0x7ff16006d0c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff178032000 tx=0x7ff17802d000 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 msgr2=0x7ff17c143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff174007fd0 tx=0x7ff17400e980 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 shutdown_connections 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff16006ac00 0x7ff16006d0c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff17c1431d0 0x7ff17c143650 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff17c1416e0 0x7ff17c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 --2- 172.21.15.5:0/1803506706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff168003970 0x7ff17c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 >> 172.21.15.5:0/1803506706 conn(0x7ff17c0ce130 msgr2=0x7ff17c0cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 shutdown_connections 2024-09-13T17:16:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.798+0000 7ff183a87640 1 -- 172.21.15.5:0/1803506706 wait complete. 2024-09-13T17:16:26.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:26.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 Processor -- start 2024-09-13T17:16:26.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 -- start start 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6600156f40 0x7f660015a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66000b1080 0x7f660006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66000b2390 con 0x7f660006dff0 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660006e440 con 0x7f66000b1080 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.914+0000 7f66060aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000b14c0 con 0x7f6600156f40 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65feffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66000b1080 0x7f660006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65fffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f660006dff0 0x7f66000abec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57722/0 (socket says 172.21.15.5:57722) 2024-09-13T17:16:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65fffff640 1 -- 172.21.15.5:0/1258408578 learned_addr learned my addr 172.21.15.5:0/1258408578 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65ff7fe640 1 --2- 172.21.15.5:0/1258408578 >> v2:172.21.15.179:3300/0 conn(0x7f6600156f40 0x7f660015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65feffd640 1 -- 172.21.15.5:0/1258408578 >> v2:172.21.15.179:3300/0 conn(0x7f6600156f40 msgr2=0x7f660015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65feffd640 1 --2- 172.21.15.5:0/1258408578 >> v2:172.21.15.179:3300/0 conn(0x7f6600156f40 0x7f660015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65feffd640 1 -- 172.21.15.5:0/1258408578 >> v1:172.21.15.5:6789/0 conn(0x7f660006dff0 legacy=0x7f66000abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.915+0000 7f65feffd640 1 -- 172.21.15.5:0/1258408578 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000b1780 con 0x7f66000b1080 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f65feffd640 1 --2- 172.21.15.5:0/1258408578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66000b1080 0x7f660006dab0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f660006aea0 tx=0x7f65f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a403bbcf55c463 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f65fe7fc640 1 -- 172.21.15.5:0/1258408578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4032440 con 0x7f66000b1080 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f65fe7fc640 1 -- 172.21.15.5:0/1258408578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f40325a0 con 0x7f66000b1080 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f65fe7fc640 1 -- 172.21.15.5:0/1258408578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4032930 con 0x7f66000b1080 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 -- 172.21.15.5:0/1258408578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66000b1080 msgr2=0x7f660006dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 --2- 172.21.15.5:0/1258408578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66000b1080 0x7f660006dab0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f660006aea0 tx=0x7f65f402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 -- 172.21.15.5:0/1258408578 shutdown_connections 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 --2- 172.21.15.5:0/1258408578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66000b1080 0x7f660006dab0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 --2- 172.21.15.5:0/1258408578 >> v2:172.21.15.179:3300/0 conn(0x7f6600156f40 0x7f660015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 -- 172.21.15.5:0/1258408578 >> 172.21.15.5:0/1258408578 conn(0x7f66000ce0d0 msgr2=0x7f66000ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 -- 172.21.15.5:0/1258408578 shutdown_connections 2024-09-13T17:16:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.916+0000 7f66060aa640 1 -- 172.21.15.5:0/1258408578 wait complete. 2024-09-13T17:16:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.918+0000 7f66060aa640 1 Processor -- start 2024-09-13T17:16:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.918+0000 7f66060aa640 1 -- start start 2024-09-13T17:16:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660006dff0 0x7f6600153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66000b1080 0x7f66000ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660009bbd0 con 0x7f6600156f40 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66000ca450 con 0x7f660006dff0 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660009bde0 con 0x7f66000b1080 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47590/0 (socket says 172.21.15.5:47590) 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 -- 172.21.15.5:0/3695873179 learned_addr learned my addr 172.21.15.5:0/3695873179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65ff7fe640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660006dff0 0x7f6600153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65feffd640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66000b1080 0x7f66000ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 -- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66000b1080 msgr2=0x7f66000ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66000b1080 0x7f66000ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 -- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660006dff0 msgr2=0x7f6600153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660006dff0 0x7f6600153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 -- 172.21.15.5:0/3695873179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009400 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65fffff640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f65f800cbc0 tx=0x7f65f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800ad40 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8012400 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.919+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66000ca6f0 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.920+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800aea0 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.920+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660009c0c0 con 0x7f6600156f40 2024-09-13T17:16:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.921+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66000cac10 con 0x7f6600156f40 2024-09-13T17:16:26.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.921+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65f8007070 con 0x7f6600156f40 2024-09-13T17:16:26.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.922+0000 7f65e7fff640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 0x7f65ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.922+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f65f8089330 con 0x7f6600156f40 2024-09-13T17:16:26.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.922+0000 7f65ff7fe640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 0x7f65ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.922+0000 7f65ff7fe640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 0x7f65ec06d0c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f65f000aa20 tx=0x7f65f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:26.926+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f66000cac10 con 0x7f6600156f40 2024-09-13T17:16:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.108+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66000cac10 con 0x7f6600156f40 2024-09-13T17:16:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.109+0000 7f65e7fff640 1 -- 172.21.15.5:0/3695873179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66000cac10 con 0x7f6600156f40 2024-09-13T17:16:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.110+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 msgr2=0x7f65ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.110+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 0x7f65ec06d0c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f65f000aa20 tx=0x7f65f0008040 comp rx=0 tx=0).stop 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 msgr2=0x7f66000ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f65f800cbc0 tx=0x7f65f800a430 comp rx=0 tx=0).stop 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 shutdown_connections 2024-09-13T17:16:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f65ec06ac00 0x7f65ec06d0c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6600156f40 0x7f66000ae610 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66000b1080 0x7f66000ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 --2- 172.21.15.5:0/3695873179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f660006dff0 0x7f6600153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 >> 172.21.15.5:0/3695873179 conn(0x7f66000ce0d0 msgr2=0x7f66001575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 shutdown_connections 2024-09-13T17:16:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.111+0000 7f66060aa640 1 -- 172.21.15.5:0/3695873179 wait complete. 2024-09-13T17:16:27.123 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:16:27.123 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:27.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.280+0000 7f08c4e4f640 1 Processor -- start 2024-09-13T17:16:27.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.280+0000 7f08c4e4f640 1 -- start start 2024-09-13T17:16:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08c4e4f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08c0160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08c4e4f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08c00b2230 0x7f08c00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08c4e4f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00b1ac0 con 0x7f08c00ae320 2024-09-13T17:16:27.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08c4e4f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c015d210 con 0x7f08c00b2230 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08c4e4f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015d4f0 con 0x7f08c00adf40 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08bdd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08c00ae320 0x7f08c015ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57724/0 (socket says 172.21.15.5:57724) 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.281+0000 7f08bdd9b640 1 -- 172.21.15.5:0/3554551233 learned_addr learned my addr 172.21.15.5:0/3554551233 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bed9d640 1 --2- 172.21.15.5:0/3554551233 >> v2:172.21.15.179:3300/0 conn(0x7f08c00b2230 0x7f08c00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08c0160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790768893 0 0) 0x7f08c00b1ac0 con 0x7f08c00ae320 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08ac003520 con 0x7f08c00ae320 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1633813061 0 0) 0x7f08ac003520 con 0x7f08c00ae320 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 msgr2=0x7f08c0160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08c0160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 >> v2:172.21.15.179:3300/0 conn(0x7f08c00b2230 msgr2=0x7f08c00b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 --2- 172.21.15.5:0/3554551233 >> v2:172.21.15.179:3300/0 conn(0x7f08c00b2230 0x7f08c00b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c015d7d0 con 0x7f08c00ae320 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f08a8001670 con 0x7f08c00ae320 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 >> v1:172.21.15.5:6789/0 conn(0x7f08c00ae320 legacy=0x7f08c015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08ac0047c0 0x7f08ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015d210 con 0x7f08ac003970 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015d4f0 con 0x7f08ac0047c0 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac00b980 con 0x7f08c00adf40 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bed9d640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bdd9b640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08ac0047c0 0x7f08ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 -- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 msgr2=0x7f08ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00adf40 0x7f08ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 -- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08ac0047c0 msgr2=0x7f08ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08ac0047c0 0x7f08ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08be59c640 1 -- 172.21.15.5:0/3554551233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac003520 con 0x7f08ac003970 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.282+0000 7f08bdd9b640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08ac0047c0 0x7f08ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.283+0000 7f08be59c640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08ac003d90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ac0 tx=0x7f08ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e198e106715ad746 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.283+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8031400 con 0x7f08ac003970 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.283+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b802d050 con 0x7f08ac003970 2024-09-13T17:16:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.283+0000 7f08bd59a640 1 -- 172.21.15.5:0/3554551233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8031780 con 0x7f08ac003970 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 -- 172.21.15.5:0/3554551233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 msgr2=0x7f08ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/3554551233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08ac003d90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ac0 tx=0x7f08ac0057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08bed9d640 1 -- 172.21.15.5:0/3554551233 reap_dead start 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 -- 172.21.15.5:0/3554551233 shutdown_connections 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 -- 172.21.15.5:0/3554551233 >> 172.21.15.5:0/3554551233 conn(0x7f08c0070af0 msgr2=0x7f08c0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 -- 172.21.15.5:0/3554551233 shutdown_connections 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.284+0000 7f08c4e4f640 1 -- 172.21.15.5:0/3554551233 wait complete. 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.285+0000 7f08c4e4f640 1 Processor -- start 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.285+0000 7f08c4e4f640 1 -- start start 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00cd580 0x7f08c0155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c015b8c0 0x7f08c015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01595f0 con 0x7f08ac003970 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0155a80 con 0x7f08c00cd580 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08c4e4f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015c280 con 0x7f08c015b8c0 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47604/0 (socket says 172.21.15.5:47604) 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 -- 172.21.15.5:0/2391576106 learned_addr learned my addr 172.21.15.5:0/2391576106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08bdd9b640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00cd580 0x7f08c0155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08bed9d640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c015b8c0 0x7f08c015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 -- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c015b8c0 msgr2=0x7f08c015bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c015b8c0 0x7f08c015bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 -- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00cd580 msgr2=0x7f08c0155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00cd580 0x7f08c0155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.286+0000 7f08be59c640 1 -- 172.21.15.5:0/2391576106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00cda00 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08be59c640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ac0 tx=0x7f08b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8003bd0 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8003d30 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c0155f20 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8003ea0 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.287+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c00c5be0 con 0x7f08ac003970 2024-09-13T17:16:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.288+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c00672e0 con 0x7f08ac003970 2024-09-13T17:16:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.288+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08b8038070 con 0x7f08ac003970 2024-09-13T17:16:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.289+0000 7f08b6ffd640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 0x7f08a006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.289+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08b80a9500 con 0x7f08ac003970 2024-09-13T17:16:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.289+0000 7f08bdd9b640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 0x7f08a006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.290+0000 7f08bdd9b640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 0x7f08a006d0f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08c006b450 tx=0x7f08a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.293+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f08b80746e0 con 0x7f08ac003970 2024-09-13T17:16:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.465+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08c00b2670 con 0x7f08ac003970 2024-09-13T17:16:27.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.466+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2391576106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f08b8077d00 con 0x7f08ac003970 2024-09-13T17:16:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:27.467 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:27.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 msgr2=0x7f08a006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 0x7f08a006d0f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f08c006b450 tx=0x7f08a8009040 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 msgr2=0x7f08c00c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ac0 tx=0x7f08b8004730 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 shutdown_connections 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c015b8c0 0x7f08c015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00cd580 0x7f08c0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f08a006ac30 0x7f08a006d0f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 --2- 172.21.15.5:0/2391576106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08ac003970 0x7f08c00c5600 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 >> 172.21.15.5:0/2391576106 conn(0x7f08c0070af0 msgr2=0x7f08c0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 shutdown_connections 2024-09-13T17:16:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.468+0000 7f08c4e4f640 1 -- 172.21.15.5:0/2391576106 wait complete. 2024-09-13T17:16:27.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:27.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 Processor -- start 2024-09-13T17:16:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 -- start start 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8be80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8be806da30 0x7f8be806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80ad050 con 0x7f8be81591e0 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be806e420 con 0x7f8be806da30 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.584+0000 7f8bed95e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80ac440 con 0x7f8be80abe60 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8be81591e0 0x7f8be80ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57730/0 (socket says 172.21.15.5:57730) 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be6ffd640 1 -- 172.21.15.5:0/1906347755 learned_addr learned my addr 172.21.15.5:0/1906347755 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be67fc640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8be80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be77fe640 1 --2- 172.21.15.5:0/1906347755 >> v2:172.21.15.179:3300/0 conn(0x7f8be806da30 0x7f8be806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391752586 0 0) 0x7f8be80ad050 con 0x7f8be81591e0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd0005730 con 0x7f8be81591e0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4230262725 0 0) 0x7f8bd0005730 con 0x7f8be81591e0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 msgr2=0x7f8be80b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8be80b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 >> v2:172.21.15.179:3300/0 conn(0x7f8be806da30 msgr2=0x7f8be806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 --2- 172.21.15.5:0/1906347755 >> v2:172.21.15.179:3300/0 conn(0x7f8be806da30 0x7f8be806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80ac720 con 0x7f8be81591e0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8bd8001670 con 0x7f8be81591e0 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 >> v1:172.21.15.5:6789/0 conn(0x7f8be81591e0 legacy=0x7f8be80ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8bd0005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8bd00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bd0006f10 0x7f8bd0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be806e420 con 0x7f8bd0006100 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80ac440 con 0x7f8bd0006f10 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd000db90 con 0x7f8be80abe60 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be67fc640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8bd00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.585+0000 7f8be6ffd640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8bd0005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be77fe640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bd0006f10 0x7f8bd0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 -- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 msgr2=0x7f8bd0005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be80abe60 0x7f8bd0005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 -- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bd0006f10 msgr2=0x7f8bd0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bd0006f10 0x7f8bd0007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 -- 172.21.15.5:0/1906347755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0005730 con 0x7f8bd0006100 2024-09-13T17:16:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be77fe640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bd0006f10 0x7f8bd0007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:27.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.586+0000 7f8be67fc640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8bd00069d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009a90 tx=0x7f8bd0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fa18ef77102609 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc031400 con 0x7f8bd0006100 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc02d050 con 0x7f8bd0006100 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8be5ffb640 1 -- 172.21.15.5:0/1906347755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0317a0 con 0x7f8bd0006100 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 -- 172.21.15.5:0/1906347755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 msgr2=0x7f8bd00069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 --2- 172.21.15.5:0/1906347755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8bd00069d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009a90 tx=0x7f8bd0007a00 comp rx=0 tx=0).stop 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8be77fe640 1 -- 172.21.15.5:0/1906347755 reap_dead start 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 -- 172.21.15.5:0/1906347755 shutdown_connections 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 -- 172.21.15.5:0/1906347755 >> 172.21.15.5:0/1906347755 conn(0x7f8be80ce130 msgr2=0x7f8be80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 -- 172.21.15.5:0/1906347755 shutdown_connections 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.587+0000 7f8bed95e640 1 -- 172.21.15.5:0/1906347755 wait complete. 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.588+0000 7f8bed95e640 1 Processor -- start 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.588+0000 7f8bed95e640 1 -- start start 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 0x7f8be815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 0x7f8be8145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be815c310 con 0x7f8bd0006100 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8144960 con 0x7f8be8144df0 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8bed95e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81443a0 con 0x7f8be815b950 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8be6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8be6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47630/0 (socket says 172.21.15.5:47630) 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.589+0000 7f8be6ffd640 1 -- 172.21.15.5:0/2681928218 learned_addr learned my addr 172.21.15.5:0/2681928218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be77fe640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 0x7f8be8145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be67fc640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 0x7f8be815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 -- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 msgr2=0x7f8be815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 0x7f8be815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 -- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 msgr2=0x7f8be8145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 0x7f8be8145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 -- 172.21.15.5:0/2681928218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be809bd20 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be77fe640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 0x7f8be8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be67fc640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 0x7f8be815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8be6ffd640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007370 tx=0x7f8bd8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800f9c0 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd800fb20 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800fe90 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be809c000 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.590+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8146ca0 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.591+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be809c190 con 0x7f8bd0006100 2024-09-13T17:16:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.592+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8bd801d360 con 0x7f8bd0006100 2024-09-13T17:16:27.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.592+0000 7f8bcffff640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 0x7f8bd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.592+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8bd8088e80 con 0x7f8bd0006100 2024-09-13T17:16:27.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.592+0000 7f8be67fc640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 0x7f8bd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.593+0000 7f8be67fc640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 0x7f8bd406d0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc033000 tx=0x7f8bdc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.596+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8bd8053fb0 con 0x7f8bd0006100 2024-09-13T17:16:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.768+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8be80672a0 con 0x7f8bd0006100 2024-09-13T17:16:27.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.769+0000 7f8bcffff640 1 -- 172.21.15.5:0/2681928218 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bd801a070 con 0x7f8bd0006100 2024-09-13T17:16:27.770 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 msgr2=0x7f8bd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 0x7f8bd406d0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc033000 tx=0x7f8bdc008030 comp rx=0 tx=0).stop 2024-09-13T17:16:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 msgr2=0x7f8be8146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007370 tx=0x7f8bd8007830 comp rx=0 tx=0).stop 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 shutdown_connections 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8be8144df0 0x7f8be8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8be815b950 0x7f8be815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8bd406ac00 0x7f8bd406d0c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 --2- 172.21.15.5:0/2681928218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0006100 0x7f8be8146760 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 >> 172.21.15.5:0/2681928218 conn(0x7f8be80ce130 msgr2=0x7f8be80aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 shutdown_connections 2024-09-13T17:16:27.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.771+0000 7f8bed95e640 1 -- 172.21.15.5:0/2681928218 wait complete. 2024-09-13T17:16:27.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:27.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.886+0000 7f21f9880640 1 Processor -- start 2024-09-13T17:16:27.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.886+0000 7f21f9880640 1 -- start start 2024-09-13T17:16:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f9880640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21f415c6e0 0x7f21f40cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f9880640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f9880640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40d0630 con 0x7f21f40cf000 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f9880640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40d0910 con 0x7f21f415c6e0 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f9880640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40d0bf0 con 0x7f21f40cf440 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f27fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21f40cf000 0x7f21f41602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57744/0 (socket says 172.21.15.5:57744) 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.887+0000 7f21f27fc640 1 -- 172.21.15.5:0/4046403535 learned_addr learned my addr 172.21.15.5:0/4046403535 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/4046403535 >> v2:172.21.15.179:3300/0 conn(0x7f21f415c6e0 0x7f21f40cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449342672 0 0) 0x7f21f40d0630 con 0x7f21f40cf000 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21dc003520 con 0x7f21f40cf000 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132633881 0 0) 0x7f21dc003520 con 0x7f21f40cf000 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 msgr2=0x7f21f41609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 >> v2:172.21.15.179:3300/0 conn(0x7f21f415c6e0 msgr2=0x7f21f40cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 --2- 172.21.15.5:0/4046403535 >> v2:172.21.15.179:3300/0 conn(0x7f21f415c6e0 0x7f21f40cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40d0ed0 con 0x7f21f40cf000 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f21e8001690 con 0x7f21f40cf000 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 >> v1:172.21.15.5:6789/0 conn(0x7f21f40cf000 legacy=0x7f21f41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21dc003970 0x7f21dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21dc0047c0 0x7f21dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40d0910 con 0x7f21dc0047c0 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40d0bf0 con 0x7f21dc003970 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc00b980 con 0x7f21f40cf440 2024-09-13T17:16:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21dc003970 0x7f21dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.888+0000 7f21f27fc640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21dc0047c0 0x7f21dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 -- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21dc003970 msgr2=0x7f21dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21dc003970 0x7f21dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 -- 172.21.15.5:0/4046403535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21dc0047c0 msgr2=0x7f21dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21dc0047c0 0x7f21dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 -- 172.21.15.5:0/4046403535 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec009a70 con 0x7f21f40cf440 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21dc003970 0x7f21dc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.889+0000 7f21f37fe640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21dc005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e350 tx=0x7f21dc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6579b7039dd761d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec02e660 con 0x7f21f40cf440 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00f040 con 0x7f21f40cf440 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f1ffb640 1 -- 172.21.15.5:0/4046403535 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec02e9c0 con 0x7f21f40cf440 2024-09-13T17:16:27.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 -- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 msgr2=0x7f21dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 --2- 172.21.15.5:0/4046403535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21dc005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e350 tx=0x7f21dc0057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f37fe640 1 -- 172.21.15.5:0/4046403535 reap_dead start 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 -- 172.21.15.5:0/4046403535 shutdown_connections 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 -- 172.21.15.5:0/4046403535 >> 172.21.15.5:0/4046403535 conn(0x7f21f4089f90 msgr2=0x7f21f40d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 -- 172.21.15.5:0/4046403535 shutdown_connections 2024-09-13T17:16:27.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.890+0000 7f21f9880640 1 -- 172.21.15.5:0/4046403535 wait complete. 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.891+0000 7f21f9880640 1 Processor -- start 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 -- start start 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 0x7f21f40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40ca730 con 0x7f21f40ca2c0 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40cb2b0 con 0x7f21f40cc2e0 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f9880640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40cb520 con 0x7f21f40cf440 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.892+0000 7f21f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47652/0 (socket says 172.21.15.5:47652) 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 -- 172.21.15.5:0/1729319674 learned_addr learned my addr 172.21.15.5:0/1729319674 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f27fc640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 0x7f21f40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 -- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 msgr2=0x7f21f41f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 -- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 msgr2=0x7f21f40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 0x7f21f40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 -- 172.21.15.5:0/1729319674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40cb800 con 0x7f21f40ca2c0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f27fc640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 0x7f21f40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f37fe640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e470 tx=0x7f21ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec003b90 con 0x7f21f40ca2c0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec003d10 con 0x7f21f40ca2c0 2024-09-13T17:16:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40cbae0 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec004260 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.893+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f41f3a90 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.894+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f40672e0 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.894+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21ec0043c0 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.895+0000 7f21dbfff640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 0x7f21e006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.895+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f21ec03d040 con 0x7f21f40ca2c0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.895+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 0x7f21e006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.896+0000 7f21f2ffd640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 0x7f21e006d0f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21f414b550 tx=0x7f21e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:27.899+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21ec0753e0 con 0x7f21f40ca2c0 2024-09-13T17:16:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.071+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21f40cc000 con 0x7f21f40ca2c0 2024-09-13T17:16:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.071+0000 7f21dbfff640 1 -- 172.21.15.5:0/1729319674 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21f40cc000 con 0x7f21f40ca2c0 2024-09-13T17:16:28.072 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 msgr2=0x7f21e006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 0x7f21e006d0f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21f414b550 tx=0x7f21e4008040 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 msgr2=0x7f21f4159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e470 tx=0x7f21ec009750 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 shutdown_connections 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f21e006ac30 0x7f21e006d0f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21f40ca2c0 0x7f21f4159a50 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21f40cc2e0 0x7f21f40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 --2- 172.21.15.5:0/1729319674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21f40cf440 0x7f21f41f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 >> 172.21.15.5:0/1729319674 conn(0x7f21f4089f90 msgr2=0x7f21f40730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 shutdown_connections 2024-09-13T17:16:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.073+0000 7f21f9880640 1 -- 172.21.15.5:0/1729319674 wait complete. 2024-09-13T17:16:28.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.189+0000 7ff5b7a2b640 1 Processor -- start 2024-09-13T17:16:28.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.190+0000 7ff5b7a2b640 1 -- start start 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.190+0000 7ff5b7a2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff5b00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b7a2b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5b015d850 0x7ff5b00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b7a2b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00b27f0 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b7a2b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b006ed60 con 0x7ff5b015d850 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b7a2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00b40d0 con 0x7ff5b0069e90 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b4fc6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5b00ae7b0 0x7ff5b006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57754/0 (socket says 172.21.15.5:57754) 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b4fc6640 1 -- 172.21.15.5:0/1108728866 learned_addr learned my addr 172.21.15.5:0/1108728866 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b57c7640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff5b00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/1108728866 >> v2:172.21.15.179:3300/0 conn(0x7ff5b015d850 0x7ff5b00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881535574 0 0) 0x7ff5b00b27f0 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c003520 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809541389 0 0) 0x7ff59c003520 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 msgr2=0x7ff5b00b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff5b00b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 >> v2:172.21.15.179:3300/0 conn(0x7ff5b015d850 msgr2=0x7ff5b00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 --2- 172.21.15.5:0/1108728866 >> v2:172.21.15.179:3300/0 conn(0x7ff5b015d850 0x7ff5b00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00ae390 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ff5a0001670 con 0x7ff5b00ae7b0 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 >> v1:172.21.15.5:6789/0 conn(0x7ff5b00ae7b0 legacy=0x7ff5b006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff59c003970 0x7ff59c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff59c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c004d00 0x7ff59c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b006ed60 con 0x7ff59c004d00 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00b40d0 con 0x7ff59c003970 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c00b980 con 0x7ff5b0069e90 2024-09-13T17:16:28.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c004d00 0x7ff59c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.191+0000 7ff5b57c7640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff59c003970 0x7ff59c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b4fc6640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff59c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 msgr2=0x7ff59c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5b0069e90 0x7ff59c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff59c003970 msgr2=0x7ff59c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff59c003970 0x7ff59c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/1108728866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c003520 con 0x7ff59c004d00 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.192+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c004d00 0x7ff59c005180 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009fc0 tx=0x7ff59c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82441e1c831b9ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8031670 con 0x7ff59c004d00 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a800f040 con 0x7ff59c004d00 2024-09-13T17:16:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5a7fff640 1 -- 172.21.15.5:0/1108728866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8031a10 con 0x7ff59c004d00 2024-09-13T17:16:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/1108728866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c004d00 msgr2=0x7ff59c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/1108728866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c004d00 0x7ff59c005180 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009fc0 tx=0x7ff59c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/1108728866 reap_dead start 2024-09-13T17:16:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/1108728866 shutdown_connections 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/1108728866 >> 172.21.15.5:0/1108728866 conn(0x7ff5b00b4650 msgr2=0x7ff5b00b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/1108728866 shutdown_connections 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.193+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/1108728866 wait complete. 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 Processor -- start 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 -- start start 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff59c004d00 0x7ff5b014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 0x7ff5b00cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0153300 con 0x7ff5b0154820 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01535e0 con 0x7ff5b01543a0 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.195+0000 7ff5b7a2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01538c0 con 0x7ff59c004d00 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47668/0 (socket says 172.21.15.5:47668) 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/3097507460 learned_addr learned my addr 172.21.15.5:0/3097507460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b57c7640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff59c004d00 0x7ff5b014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b4fc6640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 0x7ff5b00cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff59c004d00 msgr2=0x7ff5b014fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff59c004d00 0x7ff5b014fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 msgr2=0x7ff5b00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 0x7ff5b00cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 -- 172.21.15.5:0/3097507460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0153ba0 con 0x7ff5b0154820 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b4fc6640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 0x7ff5b00cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b5fc8640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff5a802ae40 tx=0x7ff5a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8003b90 con 0x7ff5b0154820 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8040070 con 0x7ff5b0154820 2024-09-13T17:16:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b0153e80 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8031e10 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.196+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b0155f10 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.197+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b00672a0 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.198+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5a8042030 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.198+0000 7ff5a5ffb640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 0x7ff59406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.198+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff5a80aa5f0 con 0x7ff5b0154820 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.199+0000 7ff5b57c7640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 0x7ff59406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.199+0000 7ff5b57c7640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 0x7ff59406d0c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006aec0 tx=0x7ff5ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.202+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff5a8079120 con 0x7ff5b0154820 2024-09-13T17:16:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.376+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5b00ac110 con 0x7ff5b0154820 2024-09-13T17:16:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.377+0000 7ff5a5ffb640 1 -- 172.21.15.5:0/3097507460 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5a804a0a0 con 0x7ff5b0154820 2024-09-13T17:16:28.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 msgr2=0x7ff59406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 0x7ff59406d0c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006aec0 tx=0x7ff5ac008040 comp rx=0 tx=0).stop 2024-09-13T17:16:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 msgr2=0x7ff5b00cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff5a802ae40 tx=0x7ff5a8009750 comp rx=0 tx=0).stop 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 shutdown_connections 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff59406ac00 0x7ff59406d0c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5b0154820 0x7ff5b00cb0d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5b01543a0 0x7ff5b00cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 --2- 172.21.15.5:0/3097507460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff59c004d00 0x7ff5b014fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 >> 172.21.15.5:0/3097507460 conn(0x7ff5b00b4650 msgr2=0x7ff5b00b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 shutdown_connections 2024-09-13T17:16:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.379+0000 7ff5b7a2b640 1 -- 172.21.15.5:0/3097507460 wait complete. 2024-09-13T17:16:28.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:28.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.492+0000 7f6f2ce5a640 1 Processor -- start 2024-09-13T17:16:28.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.492+0000 7f6f2ce5a640 1 -- start start 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f2ce5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f28156f40 0x7f6f2815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f2ce5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280b2390 con 0x7f6f2806e1c0 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f2ce5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280b14c0 con 0x7f6f280b1080 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f2ce5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f280b1780 con 0x7f6f28156f40 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f2659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f28156f40 0x7f6f2815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f26d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f2806e1c0 0x7f6f28162da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57766/0 (socket says 172.21.15.5:57766) 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.493+0000 7f6f26d9d640 1 -- 172.21.15.5:0/1567953279 learned_addr learned my addr 172.21.15.5:0/1567953279 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:28.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2559a640 1 -- 172.21.15.5:0/1567953279 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911071053 0 0) 0x7f6f280b2390 con 0x7f6f2806e1c0 2024-09-13T17:16:28.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2559a640 1 -- 172.21.15.5:0/1567953279 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f10003520 con 0x7f6f2806e1c0 2024-09-13T17:16:28.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2659c640 1 -- 172.21.15.5:0/1567953279 >> v1:172.21.15.179:6789/0 conn(0x7f6f280b1080 legacy=0x7f6f2806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2659c640 1 -- 172.21.15.5:0/1567953279 >> v1:172.21.15.5:6789/0 conn(0x7f6f2806e1c0 legacy=0x7f6f28162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2659c640 1 -- 172.21.15.5:0/1567953279 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280b1a60 con 0x7f6f28156f40 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.494+0000 7f6f2659c640 1 --2- 172.21.15.5:0/1567953279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f28156f40 0x7f6f2815a290 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6f180097a0 tx=0x7f6f1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffcc603d8660e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2559a640 1 -- 172.21.15.5:0/1567953279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18032440 con 0x7f6f28156f40 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2559a640 1 -- 172.21.15.5:0/1567953279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180325a0 con 0x7f6f28156f40 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2559a640 1 -- 172.21.15.5:0/1567953279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18032930 con 0x7f6f28156f40 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/1567953279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f28156f40 msgr2=0x7f6f2815a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/1567953279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f28156f40 0x7f6f2815a290 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6f180097a0 tx=0x7f6f1802a230 comp rx=0 tx=0).stop 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/1567953279 shutdown_connections 2024-09-13T17:16:28.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/1567953279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f28156f40 0x7f6f2815a290 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/1567953279 >> 172.21.15.5:0/1567953279 conn(0x7f6f280ce0d0 msgr2=0x7f6f280ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:28.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/1567953279 shutdown_connections 2024-09-13T17:16:28.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.495+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/1567953279 wait complete. 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 Processor -- start 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 -- start start 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2806e1c0 0x7f6f280cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f28156f40 0x7f6f28158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280cdba0 con 0x7f6f280b1080 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28145970 con 0x7f6f2806e1c0 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.497+0000 7f6f2ce5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28145c50 con 0x7f6f28156f40 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47684/0 (socket says 172.21.15.5:47684) 2024-09-13T17:16:28.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 -- 172.21.15.5:0/2264184755 learned_addr learned my addr 172.21.15.5:0/2264184755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f2659c640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2806e1c0 0x7f6f280cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f26d9d640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f28156f40 0x7f6f28158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 -- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f28156f40 msgr2=0x7f6f28158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f28156f40 0x7f6f28158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 -- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2806e1c0 msgr2=0x7f6f280cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2806e1c0 0x7f6f280cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 -- 172.21.15.5:0/2264184755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009400 con 0x7f6f280b1080 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f25d9b640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c450 tx=0x7f6f1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0052d0 con 0x7f6f280b1080 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c005430 con 0x7f6f280b1080 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c012870 con 0x7f6f280b1080 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f28145f30 con 0x7f6f280b1080 2024-09-13T17:16:28.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.498+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f28146450 con 0x7f6f280b1080 2024-09-13T17:16:28.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.499+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f280672a0 con 0x7f6f280b1080 2024-09-13T17:16:28.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.500+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f1c0129d0 con 0x7f6f280b1080 2024-09-13T17:16:28.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.500+0000 7f6f16ffd640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 0x7f6f0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:28.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.501+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6f1c088f10 con 0x7f6f280b1080 2024-09-13T17:16:28.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.501+0000 7f6f2659c640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 0x7f6f0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:28.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.501+0000 7f6f2659c640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 0x7f6f0806d0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6f18034000 tx=0x7f6f1802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:28.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.505+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f1c053fe0 con 0x7f6f280b1080 2024-09-13T17:16:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.693+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f28146120 con 0x7f6f280b1080 2024-09-13T17:16:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.693+0000 7f6f16ffd640 1 -- 172.21.15.5:0/2264184755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f1c057600 con 0x7f6f280b1080 2024-09-13T17:16:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 msgr2=0x7f6f0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 0x7f6f0806d0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6f18034000 tx=0x7f6f1802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 msgr2=0x7f6f281585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c450 tx=0x7f6f1c00c910 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 shutdown_connections 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f28156f40 0x7f6f28158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6f0806ac00 0x7f6f0806d0c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f280b1080 0x7f6f281585d0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 --2- 172.21.15.5:0/2264184755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2806e1c0 0x7f6f280cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 >> 172.21.15.5:0/2264184755 conn(0x7f6f280ce0d0 msgr2=0x7f6f280ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 shutdown_connections 2024-09-13T17:16:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:28.696+0000 7f6f2ce5a640 1 -- 172.21.15.5:0/2264184755 wait complete. 2024-09-13T17:16:28.708 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:16:28.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:28.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:16:28.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[61715]: fuse finished with error 0 and tester_r 0 2024-09-13T17:16:28.734 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:34.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:16:34.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:34.835 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:16:34.856 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:34.856 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:34.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:35.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.009+0000 7f330e296640 1 Processor -- start 2024-09-13T17:16:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.009+0000 7f330e296640 1 -- start start 2024-09-13T17:16:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330e296640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f330815a180 0x7f33080b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330e296640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330815cbc0 con 0x7f3308070c20 2024-09-13T17:16:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330e296640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080b2020 con 0x7f330815d960 2024-09-13T17:16:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330e296640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330815ce80 con 0x7f330815a180 2024-09-13T17:16:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330c833640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3308070c20 0x7f33080ac1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32810/0 (socket says 172.21.15.5:32810) 2024-09-13T17:16:35.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.010+0000 7f330c833640 1 -- 172.21.15.5:0/3825486862 learned_addr learned my addr 172.21.15.5:0/3825486862 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3307fff640 1 --2- 172.21.15.5:0/3825486862 >> v2:172.21.15.179:3300/0 conn(0x7f330815a180 0x7f33080b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12489228 0 0) 0x7f330815cbc0 con 0x7f3308070c20 2024-09-13T17:16:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f0003520 con 0x7f3308070c20 2024-09-13T17:16:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779895545 0 0) 0x7f32f0003520 con 0x7f3308070c20 2024-09-13T17:16:35.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 >> v2:172.21.15.179:3300/0 conn(0x7f330815a180 msgr2=0x7f33080b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 --2- 172.21.15.5:0/3825486862 >> v2:172.21.15.179:3300/0 conn(0x7f330815a180 0x7f33080b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 >> v1:172.21.15.179:6789/0 conn(0x7f330815d960 legacy=0x7f3308070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330815d160 con 0x7f3308070c20 2024-09-13T17:16:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f33000019f0 con 0x7f3308070c20 2024-09-13T17:16:35.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 >> v1:172.21.15.5:6789/0 conn(0x7f3308070c20 legacy=0x7f33080ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0003970 0x7f32f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00047c0 0x7f32f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 0x7f32f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330815ce80 con 0x7f32f0005180 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f000c020 con 0x7f32f0003970 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f000c1e0 con 0x7f32f00047c0 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 0x7f32f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f3307fff640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0003970 0x7f32f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f33077fe640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00047c0 0x7f32f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 -- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00047c0 msgr2=0x7f32f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00047c0 0x7f32f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 -- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0003970 msgr2=0x7f32f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0003970 0x7f32f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f330c833640 1 -- 172.21.15.5:0/3825486862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0003520 con 0x7f32f0005180 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.011+0000 7f33077fe640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f00047c0 0x7f32f0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.012+0000 7f330c833640 1 -- 172.21.15.5:0/3825486862 reap_dead start 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.012+0000 7f330c833640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 0x7f32f000b980 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f330000a830 tx=0x7f32f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc7ebd6ff7b8d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.012+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330002ba50 con 0x7f32f0005180 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.012+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330002bbf0 con 0x7f32f0005180 2024-09-13T17:16:35.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.012+0000 7f3306ffd640 1 -- 172.21.15.5:0/3825486862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300034470 con 0x7f32f0005180 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 -- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 msgr2=0x7f32f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 0x7f32f000b980 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f330000a830 tx=0x7f32f00057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 -- 172.21.15.5:0/3825486862 shutdown_connections 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 --2- 172.21.15.5:0/3825486862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32f0005180 0x7f32f000b980 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 -- 172.21.15.5:0/3825486862 >> 172.21.15.5:0/3825486862 conn(0x7f33080b0420 msgr2=0x7f33080b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 -- 172.21.15.5:0/3825486862 shutdown_connections 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.013+0000 7f330e296640 1 -- 172.21.15.5:0/3825486862 wait complete. 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.014+0000 7f330e296640 1 Processor -- start 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 -- start start 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f0005180 0x7f330815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3308144e00 0x7f330815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330806e1c0 con 0x7f33080cd2b0 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330815a880 con 0x7f3308144e00 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f330e296640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330806dc00 con 0x7f32f0005180 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f33077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f33077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35566/0 (socket says 172.21.15.5:35566) 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.015+0000 7f33077fe640 1 -- 172.21.15.5:0/3489960204 learned_addr learned my addr 172.21.15.5:0/3489960204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f3307fff640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f0005180 0x7f330815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f330c833640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3308144e00 0x7f330815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 -- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f0005180 msgr2=0x7f330815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f0005180 0x7f330815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 -- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3308144e00 msgr2=0x7f330815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3308144e00 0x7f330815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 -- 172.21.15.5:0/3489960204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330806dee0 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f33077fe640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0052e0 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc005440 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330815ab60 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc003830 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.016+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3308145460 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.017+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3308070510 con 0x7f33080cd2b0 2024-09-13T17:16:35.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.018+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32fc003990 con 0x7f33080cd2b0 2024-09-13T17:16:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.018+0000 7f3304ff9640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 0x7f32f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.018+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32fc088ba0 con 0x7f33080cd2b0 2024-09-13T17:16:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.019+0000 7f3307fff640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 0x7f32f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.019+0000 7f3307fff640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 0x7f32f406d0f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009a80 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.023+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f32fc053d80 con 0x7f33080cd2b0 2024-09-13T17:16:35.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.195+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33080caec0 con 0x7f33080cd2b0 2024-09-13T17:16:35.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.196+0000 7f3304ff9640 1 -- 172.21.15.5:0/3489960204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f32fc019020 con 0x7f33080cd2b0 2024-09-13T17:16:35.197 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:35.198 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:35.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 msgr2=0x7f32f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 0x7f32f406d0f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009a80 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 msgr2=0x7f33080cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc00e8f0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 shutdown_connections 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3308144e00 0x7f330815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f32f406ac30 0x7f32f406d0f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33080cd2b0 0x7f33080cdfa0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 --2- 172.21.15.5:0/3489960204 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f0005180 0x7f330815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 >> 172.21.15.5:0/3489960204 conn(0x7f33080b0420 msgr2=0x7f330815dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 shutdown_connections 2024-09-13T17:16:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.198+0000 7f330e296640 1 -- 172.21.15.5:0/3489960204 wait complete. 2024-09-13T17:16:35.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:35.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.315+0000 7fdaaa9aa640 1 Processor -- start 2024-09-13T17:16:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.315+0000 7fdaaa9aa640 1 -- start start 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaaa9aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaaa9aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa40ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaaa9aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa40b27f0 con 0x7fdaa4069e90 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaaa9aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa406ed60 con 0x7fdaa415d850 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaaa9aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40b40d0 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaa8f47640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa40ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaa37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaa37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:36464/0 (socket says 172.21.15.5:36464) 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.316+0000 7fdaa37fe640 1 -- 172.21.15.5:0/3017177921 learned_addr learned my addr 172.21.15.5:0/3017177921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3017177921 >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 msgr2=0x7fdaa40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa8f47640 1 --2- 172.21.15.5:0/3017177921 >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3017177921 >> v1:172.21.15.179:6789/0 conn(0x7fdaa4069e90 legacy=0x7fdaa406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3017177921 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40ae390 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa37fe640 1 --2- 172.21.15.5:0/3017177921 >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.317+0000 7fdaa8f47640 1 --2- 172.21.15.5:0/3017177921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa40ac110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009d90 tx=0x7fda9c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46fc27b80d37f299 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaa2ffd640 1 -- 172.21.15.5:0/3017177921 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c007740 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaa2ffd640 1 -- 172.21.15.5:0/3017177921 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c02d050 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaa2ffd640 1 -- 172.21.15.5:0/3017177921 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c007ac0 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3017177921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 msgr2=0x7fdaa40ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3017177921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa40ac110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009d90 tx=0x7fda9c02a660 comp rx=0 tx=0).stop 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3017177921 shutdown_connections 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3017177921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa40ac110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3017177921 >> v2:172.21.15.179:3300/0 conn(0x7fdaa415d850 0x7fdaa40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3017177921 >> 172.21.15.5:0/3017177921 conn(0x7fdaa40b4650 msgr2=0x7fdaa40b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3017177921 shutdown_connections 2024-09-13T17:16:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.318+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3017177921 wait complete. 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.319+0000 7fdaaa9aa640 1 Processor -- start 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 -- start start 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaa4069e90 0x7fdaa40ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa4151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4099980 con 0x7fdaa415d850 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4152240 con 0x7fdaa4069e90 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaaa9aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40cfcb0 con 0x7fdaa40ae7b0 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaa8f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaa8f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35582/0 (socket says 172.21.15.5:35582) 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.320+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3924973592 learned_addr learned my addr 172.21.15.5:0/3924973592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa37fe640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa4151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa3fff640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaa4069e90 0x7fdaa40ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 msgr2=0x7fdaa4151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa4151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaa4069e90 msgr2=0x7fdaa40ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaa4069e90 0x7fdaa40ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 -- 172.21.15.5:0/3924973592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980094d0 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa8f47640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009eb0 tx=0x7fda9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c03c830 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c03c990 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c009a70 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c03cd20 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.321+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa4099330 con 0x7fdaa415d850 2024-09-13T17:16:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.322+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa40672a0 con 0x7fdaa415d850 2024-09-13T17:16:35.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.323+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda9c031400 con 0x7fdaa415d850 2024-09-13T17:16:35.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.323+0000 7fdaa0ff9640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 0x7fda9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.323+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda9c0ab100 con 0x7fdaa415d850 2024-09-13T17:16:35.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.323+0000 7fdaa3fff640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 0x7fda9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.324+0000 7fdaa3fff640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 0x7fda9006d0f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda94007fd0 tx=0x7fda94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.327+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda9c076400 con 0x7fdaa415d850 2024-09-13T17:16:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.497+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdaa40ac110 con 0x7fdaa415d850 2024-09-13T17:16:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.498+0000 7fdaa0ff9640 1 -- 172.21.15.5:0/3924973592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda9c079a20 con 0x7fdaa415d850 2024-09-13T17:16:35.499 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 msgr2=0x7fda9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 0x7fda9006d0f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda94007fd0 tx=0x7fda94009040 comp rx=0 tx=0).stop 2024-09-13T17:16:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 msgr2=0x7fdaa40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009eb0 tx=0x7fda9c004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 shutdown_connections 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda9006ac30 0x7fda9006d0f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa415d850 0x7fdaa40cc650 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdaa40ae7b0 0x7fdaa4151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 --2- 172.21.15.5:0/3924973592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdaa4069e90 0x7fdaa40ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 >> 172.21.15.5:0/3924973592 conn(0x7fdaa40b4650 msgr2=0x7fdaa40b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 shutdown_connections 2024-09-13T17:16:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.500+0000 7fdaaa9aa640 1 -- 172.21.15.5:0/3924973592 wait complete. 2024-09-13T17:16:35.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 Processor -- start 2024-09-13T17:16:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 -- start start 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50140cf000 0x7f50140cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50141645e0 0x7f50141669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50140cf980 con 0x7f501415c6e0 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50140ce570 con 0x7f50140cf000 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.615+0000 7f5019f08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50140d0630 con 0x7f50141645e0 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f50137fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f501415c6e0 0x7f50140cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32814/0 (socket says 172.21.15.5:32814) 2024-09-13T17:16:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f50137fe640 1 -- 172.21.15.5:0/194178351 learned_addr learned my addr 172.21.15.5:0/194178351 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5012ffd640 1 --2- 172.21.15.5:0/194178351 >> v2:172.21.15.5:3300/0 conn(0x7f50140cf000 0x7f50140cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5013fff640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50141645e0 0x7f50141669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5012ffd640 1 -- 172.21.15.5:0/194178351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50141645e0 msgr2=0x7f50141669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5012ffd640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50141645e0 0x7f50141669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5012ffd640 1 -- 172.21.15.5:0/194178351 >> v1:172.21.15.5:6789/0 conn(0x7f501415c6e0 legacy=0x7f50140cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f5012ffd640 1 -- 172.21.15.5:0/194178351 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140d0910 con 0x7f50140cf000 2024-09-13T17:16:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.616+0000 7f50127fc640 1 -- 172.21.15.5:0/194178351 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276822092 0 0) 0x7f50140cf980 con 0x7f501415c6e0 2024-09-13T17:16:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5012ffd640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50140cf000 0x7f50140cf440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f50080097a0 tx=0x7f500802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c87b15aef1643 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f50127fc640 1 -- 172.21.15.5:0/194178351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008032440 con 0x7f50140cf000 2024-09-13T17:16:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f50127fc640 1 -- 172.21.15.5:0/194178351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50080325a0 con 0x7f50140cf000 2024-09-13T17:16:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f50127fc640 1 -- 172.21.15.5:0/194178351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008032930 con 0x7f50140cf000 2024-09-13T17:16:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 -- 172.21.15.5:0/194178351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50140cf000 msgr2=0x7f50140cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50140cf000 0x7f50140cf440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f50080097a0 tx=0x7f500802a180 comp rx=0 tx=0).stop 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 -- 172.21.15.5:0/194178351 shutdown_connections 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50141645e0 0x7f50141669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 --2- 172.21.15.5:0/194178351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50140cf000 0x7f50140cf440 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.617+0000 7f5019f08640 1 -- 172.21.15.5:0/194178351 >> 172.21.15.5:0/194178351 conn(0x7f5014089f90 msgr2=0x7f50140d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.618+0000 7f5019f08640 1 -- 172.21.15.5:0/194178351 shutdown_connections 2024-09-13T17:16:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.618+0000 7f5019f08640 1 -- 172.21.15.5:0/194178351 wait complete. 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.619+0000 7f5019f08640 1 Processor -- start 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.619+0000 7f5019f08640 1 -- start start 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50140cf000 0x7f50140c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 0x7f50140b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50141585c0 con 0x7f50141645e0 2024-09-13T17:16:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50140c7a10 con 0x7f501415c6e0 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50141620a0 con 0x7f50140cf000 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35596/0 (socket says 172.21.15.5:35596) 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 -- 172.21.15.5:0/3634892343 learned_addr learned my addr 172.21.15.5:0/3634892343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f50137fe640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50140cf000 0x7f50140c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5012ffd640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 0x7f50140b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 -- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50140cf000 msgr2=0x7f50140c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50140cf000 0x7f50140c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 -- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 msgr2=0x7f50140b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 0x7f50140b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 -- 172.21.15.5:0/3634892343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008009400 con 0x7f50141645e0 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5012ffd640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 0x7f50140b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5013fff640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f500c007e60 tx=0x7f500c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c014420 con 0x7f50141645e0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0145a0 con 0x7f50141645e0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5014162380 con 0x7f50141645e0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c014950 con 0x7f50141645e0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.620+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50140c6cd0 con 0x7f50141645e0 2024-09-13T17:16:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.621+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50140672e0 con 0x7f50141645e0 2024-09-13T17:16:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.622+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f500c014ab0 con 0x7f50141645e0 2024-09-13T17:16:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.622+0000 7f4ffbfff640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 0x7f500006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.622+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f500c089d00 con 0x7f50141645e0 2024-09-13T17:16:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.622+0000 7f50137fe640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 0x7f500006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.623+0000 7f50137fe640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 0x7f500006d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5004000f60 tx=0x7f5004007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.626+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f500c054da0 con 0x7f50141645e0 2024-09-13T17:16:35.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.799+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f501415cac0 con 0x7f50141645e0 2024-09-13T17:16:35.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.800+0000 7f4ffbfff640 1 -- 172.21.15.5:0/3634892343 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f500c0583c0 con 0x7f50141645e0 2024-09-13T17:16:35.801 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 msgr2=0x7f500006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 0x7f500006d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5004000f60 tx=0x7f5004007d50 comp rx=0 tx=0).stop 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 msgr2=0x7f50140b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f500c007e60 tx=0x7f500c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 shutdown_connections 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f500006ac00 0x7f500006d0c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50141645e0 0x7f50140b7240 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f501415c6e0 0x7f50140b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 --2- 172.21.15.5:0/3634892343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50140cf000 0x7f50140c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.801+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 >> 172.21.15.5:0/3634892343 conn(0x7f5014089f90 msgr2=0x7f50140cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.802+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 shutdown_connections 2024-09-13T17:16:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.802+0000 7f5019f08640 1 -- 172.21.15.5:0/3634892343 wait complete. 2024-09-13T17:16:35.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.917+0000 7fda7dbae640 1 Processor -- start 2024-09-13T17:16:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.917+0000 7fda7dbae640 1 -- start start 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda781591e0 0x7fda780abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 0x7fda780b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 0x7fda7806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7806e400 con 0x7fda781591e0 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780ad050 con 0x7fda780ad4e0 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda7dbae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780ac440 con 0x7fda7806da30 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda781591e0 0x7fda780abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda781591e0 0x7fda780abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35608/0 (socket says 172.21.15.5:35608) 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 -- 172.21.15.5:0/1861268916 learned_addr learned my addr 172.21.15.5:0/1861268916 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 -- 172.21.15.5:0/1861268916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 msgr2=0x7fda7806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda76ffd640 1 --2- 172.21.15.5:0/1861268916 >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 0x7fda780b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda77fff640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 0x7fda7806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 0x7fda7806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 -- 172.21.15.5:0/1861268916 >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 msgr2=0x7fda780b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 --2- 172.21.15.5:0/1861268916 >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 0x7fda780b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda777fe640 1 -- 172.21.15.5:0/1861268916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780ac720 con 0x7fda781591e0 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda76ffd640 1 --2- 172.21.15.5:0/1861268916 >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 0x7fda780b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.918+0000 7fda77fff640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 0x7fda7806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.919+0000 7fda777fe640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780abe60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fda780ce100 tx=0x7fda6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acbe86896e153ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.919+0000 7fda767fc640 1 -- 172.21.15.5:0/1861268916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68032440 con 0x7fda781591e0 2024-09-13T17:16:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.919+0000 7fda767fc640 1 -- 172.21.15.5:0/1861268916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680325a0 con 0x7fda781591e0 2024-09-13T17:16:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.919+0000 7fda767fc640 1 -- 172.21.15.5:0/1861268916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68032930 con 0x7fda781591e0 2024-09-13T17:16:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 -- 172.21.15.5:0/1861268916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 msgr2=0x7fda780abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780abe60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fda780ce100 tx=0x7fda6802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 -- 172.21.15.5:0/1861268916 shutdown_connections 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda7806da30 0x7fda7806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 --2- 172.21.15.5:0/1861268916 >> v2:172.21.15.179:3300/0 conn(0x7fda780ad4e0 0x7fda780b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 --2- 172.21.15.5:0/1861268916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780abe60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 -- 172.21.15.5:0/1861268916 >> 172.21.15.5:0/1861268916 conn(0x7fda780ce130 msgr2=0x7fda780ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 -- 172.21.15.5:0/1861268916 shutdown_connections 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.920+0000 7fda7dbae640 1 -- 172.21.15.5:0/1861268916 wait complete. 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.921+0000 7fda7dbae640 1 Processor -- start 2024-09-13T17:16:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.921+0000 7fda7dbae640 1 -- start start 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda7806da30 0x7fda781f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda780ad4e0 0x7fda78071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7814d060 con 0x7fda781591e0 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7815b4e0 con 0x7fda7806da30 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda7dbae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda78151e60 con 0x7fda780ad4e0 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35620/0 (socket says 172.21.15.5:35620) 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 -- 172.21.15.5:0/2979216365 learned_addr learned my addr 172.21.15.5:0/2979216365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda777fe640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda7806da30 0x7fda781f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda76ffd640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda780ad4e0 0x7fda78071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 -- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda780ad4e0 msgr2=0x7fda78071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda780ad4e0 0x7fda78071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 -- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda7806da30 msgr2=0x7fda781f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda7806da30 0x7fda781f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.922+0000 7fda77fff640 1 -- 172.21.15.5:0/2979216365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680094d0 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda77fff640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fda7000cd80 tx=0x7fda7000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000f680 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000f800 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda78152140 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000fbb0 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.923+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78152700 con 0x7fda781591e0 2024-09-13T17:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.924+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7814d1a0 con 0x7fda781591e0 2024-09-13T17:16:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.924+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda7000b040 con 0x7fda781591e0 2024-09-13T17:16:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.925+0000 7fda5ffff640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 0x7fda6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.925+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda70089d10 con 0x7fda781591e0 2024-09-13T17:16:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.925+0000 7fda777fe640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 0x7fda6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.925+0000 7fda777fe640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 0x7fda6406d0f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda68034000 tx=0x7fda6802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:35.929+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda7814d1a0 con 0x7fda781591e0 2024-09-13T17:16:36.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.099+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda7814d1a0 con 0x7fda781591e0 2024-09-13T17:16:36.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.099+0000 7fda5ffff640 1 -- 172.21.15.5:0/2979216365 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda7814d1a0 con 0x7fda781591e0 2024-09-13T17:16:36.101 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 msgr2=0x7fda6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 0x7fda6406d0f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda68034000 tx=0x7fda6802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 msgr2=0x7fda780717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fda7000cd80 tx=0x7fda7000a650 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 shutdown_connections 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda6406ac30 0x7fda6406d0f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda781591e0 0x7fda780717a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda780ad4e0 0x7fda78071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 --2- 172.21.15.5:0/2979216365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda7806da30 0x7fda781f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.101+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 >> 172.21.15.5:0/2979216365 conn(0x7fda780ce130 msgr2=0x7fda780ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.102+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 shutdown_connections 2024-09-13T17:16:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.102+0000 7fda7dbae640 1 -- 172.21.15.5:0/2979216365 wait complete. 2024-09-13T17:16:36.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.216+0000 7fdf627c7640 1 Processor -- start 2024-09-13T17:16:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.216+0000 7fdf627c7640 1 -- start start 2024-09-13T17:16:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.216+0000 7fdf627c7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf5c0b4cf0 0x7fdf5c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.216+0000 7fdf627c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 0x7fdf5c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.216+0000 7fdf627c7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c0d1e80 con 0x7fdf5c15c810 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf627c7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0d1750 con 0x7fdf5c0b4cf0 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf627c7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0d0bd0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf5bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf5c15c810 0x7fdf5c0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32820/0 (socket says 172.21.15.5:32820) 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf5bfff640 1 -- 172.21.15.5:0/3616005769 learned_addr learned my addr 172.21.15.5:0/3616005769 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf60d64640 1 --2- 172.21.15.5:0/3616005769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 0x7fdf5c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf53fff640 1 --2- 172.21.15.5:0/3616005769 >> v2:172.21.15.179:3300/0 conn(0x7fdf5c0b4cf0 0x7fdf5c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf5b7fe640 1 -- 172.21.15.5:0/3616005769 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849167289 0 0) 0x7fdf5c0d1e80 con 0x7fdf5c15c810 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf5b7fe640 1 -- 172.21.15.5:0/3616005769 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf48003520 con 0x7fdf5c15c810 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf60d64640 1 -- 172.21.15.5:0/3616005769 >> v2:172.21.15.179:3300/0 conn(0x7fdf5c0b4cf0 msgr2=0x7fdf5c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf60d64640 1 --2- 172.21.15.5:0/3616005769 >> v2:172.21.15.179:3300/0 conn(0x7fdf5c0b4cf0 0x7fdf5c0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf60d64640 1 -- 172.21.15.5:0/3616005769 >> v1:172.21.15.5:6789/0 conn(0x7fdf5c15c810 legacy=0x7fdf5c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.217+0000 7fdf60d64640 1 -- 172.21.15.5:0/3616005769 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0d0eb0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.218+0000 7fdf60d64640 1 --2- 172.21.15.5:0/3616005769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 0x7fdf5c0b5a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009d90 tx=0x7fdf5402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a52547c1d0932ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.218+0000 7fdf5b7fe640 1 -- 172.21.15.5:0/3616005769 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007740 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.218+0000 7fdf5b7fe640 1 -- 172.21.15.5:0/3616005769 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5402d050 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.218+0000 7fdf5b7fe640 1 -- 172.21.15.5:0/3616005769 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007aa0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 -- 172.21.15.5:0/3616005769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 msgr2=0x7fdf5c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3616005769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 0x7fdf5c0b5a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009d90 tx=0x7fdf5402a660 comp rx=0 tx=0).stop 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 -- 172.21.15.5:0/3616005769 shutdown_connections 2024-09-13T17:16:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3616005769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c0d06d0 0x7fdf5c0b5a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3616005769 >> v2:172.21.15.179:3300/0 conn(0x7fdf5c0b4cf0 0x7fdf5c0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 -- 172.21.15.5:0/3616005769 >> 172.21.15.5:0/3616005769 conn(0x7fdf5c0717a0 msgr2=0x7fdf5c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 -- 172.21.15.5:0/3616005769 shutdown_connections 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.219+0000 7fdf627c7640 1 -- 172.21.15.5:0/3616005769 wait complete. 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.220+0000 7fdf627c7640 1 Processor -- start 2024-09-13T17:16:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.220+0000 7fdf627c7640 1 -- start start 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf5c0b4cf0 0x7fdf5c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c15c810 0x7fdf5c1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c15b5d0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c14bca0 con 0x7fdf5c0b4cf0 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf627c7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0c7270 con 0x7fdf5c15c810 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35628/0 (socket says 172.21.15.5:35628) 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 -- 172.21.15.5:0/3362678906 learned_addr learned my addr 172.21.15.5:0/3362678906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf60d64640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c15c810 0x7fdf5c1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf5bfff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf5c0b4cf0 0x7fdf5c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 -- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c15c810 msgr2=0x7fdf5c1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c15c810 0x7fdf5c1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 -- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf5c0b4cf0 msgr2=0x7fdf5c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf5c0b4cf0 0x7fdf5c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.221+0000 7fdf53fff640 1 -- 172.21.15.5:0/3362678906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54009a70 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf53fff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e9b0 tx=0x7fdf4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44009670 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4400c9a0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400cd50 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c0c7550 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.222+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c0c7b10 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.223+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c0672a0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.223+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf44013470 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.224+0000 7fdf597fa640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 0x7fdf3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.224+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdf440896e0 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.224+0000 7fdf5bfff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 0x7fdf3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.225+0000 7fdf5bfff640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 0x7fdf3c06d0c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005880 tx=0x7fdf4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.228+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf44054830 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.413+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf5c0ccd00 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.413+0000 7fdf597fa640 1 -- 172.21.15.5:0/3362678906 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdf5c0ccd00 con 0x7fdf5c0d06d0 2024-09-13T17:16:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:36.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 msgr2=0x7fdf3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 0x7fdf3c06d0c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005880 tx=0x7fdf4c009040 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 msgr2=0x7fdf5c14b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e9b0 tx=0x7fdf4400ee70 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 shutdown_connections 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf5c15c810 0x7fdf5c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdf3c06ac00 0x7fdf3c06d0c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf5c0d06d0 0x7fdf5c14b4d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 --2- 172.21.15.5:0/3362678906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf5c0b4cf0 0x7fdf5c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 >> 172.21.15.5:0/3362678906 conn(0x7fdf5c0717a0 msgr2=0x7fdf5c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 shutdown_connections 2024-09-13T17:16:36.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.415+0000 7fdf627c7640 1 -- 172.21.15.5:0/3362678906 wait complete. 2024-09-13T17:16:36.427 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:36.427 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:36.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:36.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.548+0000 7f73fd52c640 1 Processor -- start 2024-09-13T17:16:36.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.548+0000 7f73fd52c640 1 -- start start 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.549+0000 7f73fd52c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f815c580 0x7f73f80cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.549+0000 7f73fd52c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80cf520 0x7f73f806b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.549+0000 7f73fd52c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80cd350 con 0x7f73f8160de0 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.549+0000 7f73fd52c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80cd630 con 0x7f73f815c580 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.549+0000 7f73fd52c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80cd910 con 0x7f73f80cf520 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f815c580 0x7f73f80cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f815c580 0x7f73f80cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35630/0 (socket says 172.21.15.5:35630) 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 -- 172.21.15.5:0/447980061 learned_addr learned my addr 172.21.15.5:0/447980061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f77fe640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80cf520 0x7f73f806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 -- 172.21.15.5:0/447980061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80cf520 msgr2=0x7f73f806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80cf520 0x7f73f806b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 -- 172.21.15.5:0/447980061 >> v1:172.21.15.179:6789/0 conn(0x7f73f8160de0 legacy=0x7f73f80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.550+0000 7f73f6ffd640 1 -- 172.21.15.5:0/447980061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80cdbf0 con 0x7f73f815c580 2024-09-13T17:16:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73f6ffd640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f815c580 0x7f73f80cca50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009e50 tx=0x7f73e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be6c1dca5e985c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73f5ffb640 1 -- 172.21.15.5:0/447980061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8031600 con 0x7f73f815c580 2024-09-13T17:16:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73f5ffb640 1 -- 172.21.15.5:0/447980061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e802d050 con 0x7f73f815c580 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73f5ffb640 1 -- 172.21.15.5:0/447980061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8031980 con 0x7f73f815c580 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 -- 172.21.15.5:0/447980061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f815c580 msgr2=0x7f73f80cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f815c580 0x7f73f80cca50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009e50 tx=0x7f73e802a710 comp rx=0 tx=0).stop 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 -- 172.21.15.5:0/447980061 shutdown_connections 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f80cf520 0x7f73f806b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 --2- 172.21.15.5:0/447980061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f815c580 0x7f73f80cca50 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 -- 172.21.15.5:0/447980061 >> 172.21.15.5:0/447980061 conn(0x7f73f8089f90 msgr2=0x7f73f80d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 -- 172.21.15.5:0/447980061 shutdown_connections 2024-09-13T17:16:36.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.551+0000 7f73fd52c640 1 -- 172.21.15.5:0/447980061 wait complete. 2024-09-13T17:16:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.553+0000 7f73fd52c640 1 Processor -- start 2024-09-13T17:16:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.553+0000 7f73fd52c640 1 -- start start 2024-09-13T17:16:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.553+0000 7f73fd52c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80cf520 0x7f73f81f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 0x7f73f8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81f6db0 con 0x7f73f8160de0 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80c7c10 con 0x7f73f80cf520 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81542d0 con 0x7f73f815c580 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35638/0 (socket says 172.21.15.5:35638) 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 -- 172.21.15.5:0/4283748434 learned_addr learned my addr 172.21.15.5:0/4283748434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f6ffd640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80cf520 0x7f73f81f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f67fc640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 0x7f73f8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 -- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 msgr2=0x7f73f8153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 0x7f73f8153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 -- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80cf520 msgr2=0x7f73f81f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80cf520 0x7f73f81f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 -- 172.21.15.5:0/4283748434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8009b30 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f67fc640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 0x7f73f8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73f77fe640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d800 tx=0x7f73f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000b6c0 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000b840 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f815daf0 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000bbf0 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.554+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80c7930 con 0x7f73f8160de0 2024-09-13T17:16:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.555+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f808af60 con 0x7f73f8160de0 2024-09-13T17:16:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.556+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73f000bd50 con 0x7f73f8160de0 2024-09-13T17:16:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.556+0000 7f73ef7fe640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 0x7f73d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.557+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f73f0089910 con 0x7f73f8160de0 2024-09-13T17:16:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.557+0000 7f73f6ffd640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 0x7f73d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.557+0000 7f73f6ffd640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 0x7f73d806d0f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f73e8033000 tx=0x7f73e8009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.561+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73f00549b0 con 0x7f73f8160de0 2024-09-13T17:16:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.733+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f80cca50 con 0x7f73f8160de0 2024-09-13T17:16:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.734+0000 7f73ef7fe640 1 -- 172.21.15.5:0/4283748434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f73f0057fd0 con 0x7f73f8160de0 2024-09-13T17:16:36.736 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:36.736 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 msgr2=0x7f73d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 0x7f73d806d0f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f73e8033000 tx=0x7f73e8009000 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 msgr2=0x7f73f80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d800 tx=0x7f73f000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 shutdown_connections 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73d806ac30 0x7f73d806d0f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f8160de0 0x7f73f80b5560 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f815c580 0x7f73f8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 --2- 172.21.15.5:0/4283748434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f80cf520 0x7f73f81f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 >> 172.21.15.5:0/4283748434 conn(0x7f73f8089f90 msgr2=0x7f73f80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 shutdown_connections 2024-09-13T17:16:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.736+0000 7f73fd52c640 1 -- 172.21.15.5:0/4283748434 wait complete. 2024-09-13T17:16:36.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:36.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.852+0000 7fd5b40a3640 1 Processor -- start 2024-09-13T17:16:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.852+0000 7fd5b40a3640 1 -- start start 2024-09-13T17:16:36.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b40a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 0x7fd5ac0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b40a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0704a0 con 0x7fd5ac15fd80 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b40a3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac06bd80 con 0x7fd5ac099110 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b40a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac06cc10 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b1e3f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5ac15fd80 0x7fd5ac098a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32822/0 (socket says 172.21.15.5:32822) 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b1e3f640 1 -- 172.21.15.5:0/2393263493 learned_addr learned my addr 172.21.15.5:0/2393263493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b2640640 1 --2- 172.21.15.5:0/2393263493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 0x7fd5ac0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126164753 0 0) 0x7fd5ac0704a0 con 0x7fd5ac15fd80 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd598003520 con 0x7fd5ac15fd80 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125231300 0 0) 0x7fd5ac06bd80 con 0x7fd5ac099110 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ac0704a0 con 0x7fd5ac099110 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b2640640 1 -- 172.21.15.5:0/2393263493 >> v1:172.21.15.179:6789/0 conn(0x7fd5ac099110 legacy=0x7fd5ac06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b2640640 1 -- 172.21.15.5:0/2393263493 >> v1:172.21.15.5:6789/0 conn(0x7fd5ac15fd80 legacy=0x7fd5ac098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.853+0000 7fd5b2640640 1 -- 172.21.15.5:0/2393263493 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac06c210 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.854+0000 7fd5b2640640 1 --2- 172.21.15.5:0/2393263493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 0x7fd5ac0d0e30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009dc0 tx=0x7fd5a402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97239f52eb07ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.854+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4007740 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.854+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a402d050 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.854+0000 7fd5b0e3d640 1 -- 172.21.15.5:0/2393263493 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4007aa0 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 -- 172.21.15.5:0/2393263493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 msgr2=0x7fd5ac0d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/2393263493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 0x7fd5ac0d0e30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009dc0 tx=0x7fd5a402a640 comp rx=0 tx=0).stop 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 -- 172.21.15.5:0/2393263493 shutdown_connections 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/2393263493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac0cfd30 0x7fd5ac0d0e30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 -- 172.21.15.5:0/2393263493 >> 172.21.15.5:0/2393263493 conn(0x7fd5ac0d0310 msgr2=0x7fd5ac0d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 -- 172.21.15.5:0/2393263493 shutdown_connections 2024-09-13T17:16:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.855+0000 7fd5b40a3640 1 -- 172.21.15.5:0/2393263493 wait complete. 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.856+0000 7fd5b40a3640 1 Processor -- start 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.856+0000 7fd5b40a3640 1 -- start start 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac099110 0x7fd5ac0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 0x7fd5ac0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0c3e40 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0b4b00 con 0x7fd5ac15fd80 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b40a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0c4050 con 0x7fd5ac099110 2024-09-13T17:16:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b163e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b163e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35644/0 (socket says 172.21.15.5:35644) 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b163e640 1 -- 172.21.15.5:0/1510656748 learned_addr learned my addr 172.21.15.5:0/1510656748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b1e3f640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac099110 0x7fd5ac0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b2640640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 0x7fd5ac0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.857+0000 7fd5b163e640 1 -- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac099110 msgr2=0x7fd5ac0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b163e640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac099110 0x7fd5ac0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b163e640 1 -- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 msgr2=0x7fd5ac0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b163e640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 0x7fd5ac0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b163e640 1 -- 172.21.15.5:0/1510656748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009a70 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b2640640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 0x7fd5ac0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b163e640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c430 tx=0x7fd59c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0052d0 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c005450 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac0c4330 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c003830 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.858+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac159f40 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.859+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac0b1cb0 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.859+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd59c003990 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.860+0000 7fd5a27fc640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 0x7fd59006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.860+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd59c088970 con 0x7fd5ac0cfd30 2024-09-13T17:16:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.860+0000 7fd5b1e3f640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 0x7fd59006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.861+0000 7fd5b1e3f640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 0x7fd59006d0c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80011e0 tx=0x7fd5a8007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:36.864+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd59c0575e0 con 0x7fd5ac0cfd30 2024-09-13T17:16:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.036+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5ac0cfa60 con 0x7fd5ac0cfd30 2024-09-13T17:16:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.036+0000 7fd5a27fc640 1 -- 172.21.15.5:0/1510656748 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd59c0170a0 con 0x7fd5ac0cfd30 2024-09-13T17:16:37.037 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 msgr2=0x7fd59006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 0x7fd59006d0c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80011e0 tx=0x7fd5a8007d30 comp rx=0 tx=0).stop 2024-09-13T17:16:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 msgr2=0x7fd5ac0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c430 tx=0x7fd59c00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 shutdown_connections 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5ac15fd80 0x7fd5ac0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd59006ac00 0x7fd59006d0c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5ac0cfd30 0x7fd5ac0b4ed0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 --2- 172.21.15.5:0/1510656748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5ac099110 0x7fd5ac0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 >> 172.21.15.5:0/1510656748 conn(0x7fd5ac0d0310 msgr2=0x7fd5ac0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 shutdown_connections 2024-09-13T17:16:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.038+0000 7fd5b40a3640 1 -- 172.21.15.5:0/1510656748 wait complete. 2024-09-13T17:16:37.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.153+0000 7f25cb345640 1 Processor -- start 2024-09-13T17:16:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.153+0000 7f25cb345640 1 -- start start 2024-09-13T17:16:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25cb345640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25c41591e0 0x7f25c40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25cb345640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c40ad050 con 0x7f25c40ad4e0 2024-09-13T17:16:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25cb345640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c40ac440 con 0x7f25c406da30 2024-09-13T17:16:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25cb345640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40ac720 con 0x7f25c41591e0 2024-09-13T17:16:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25c88e0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25c40ad4e0 0x7f25c40b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32834/0 (socket says 172.21.15.5:32834) 2024-09-13T17:16:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25c88e0640 1 -- 172.21.15.5:0/1380810860 learned_addr learned my addr 172.21.15.5:0/1380810860 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25b7fff640 1 -- 172.21.15.5:0/1380810860 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470125467 0 0) 0x7f25c40ad050 con 0x7f25c40ad4e0 2024-09-13T17:16:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25c90e1640 1 --2- 172.21.15.5:0/1380810860 >> v2:172.21.15.179:3300/0 conn(0x7f25c41591e0 0x7f25c40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.154+0000 7f25b7fff640 1 -- 172.21.15.5:0/1380810860 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b0003520 con 0x7f25c40ad4e0 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.155+0000 7f25c90e1640 1 -- 172.21.15.5:0/1380810860 >> v1:172.21.15.179:6789/0 conn(0x7f25c406da30 legacy=0x7f25c40700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.155+0000 7f25c90e1640 1 -- 172.21.15.5:0/1380810860 >> v1:172.21.15.5:6789/0 conn(0x7f25c40ad4e0 legacy=0x7f25c40b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.155+0000 7f25c90e1640 1 -- 172.21.15.5:0/1380810860 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40aca00 con 0x7f25c41591e0 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25c90e1640 1 --2- 172.21.15.5:0/1380810860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c41591e0 0x7f25c40abe60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25c00097a0 tx=0x7f25c002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32472605f106c69b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25b7fff640 1 -- 172.21.15.5:0/1380810860 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0032440 con 0x7f25c41591e0 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25b7fff640 1 -- 172.21.15.5:0/1380810860 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c00325a0 con 0x7f25c41591e0 2024-09-13T17:16:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25b7fff640 1 -- 172.21.15.5:0/1380810860 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0032930 con 0x7f25c41591e0 2024-09-13T17:16:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 -- 172.21.15.5:0/1380810860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c41591e0 msgr2=0x7f25c40abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 --2- 172.21.15.5:0/1380810860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c41591e0 0x7f25c40abe60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25c00097a0 tx=0x7f25c002a230 comp rx=0 tx=0).stop 2024-09-13T17:16:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 -- 172.21.15.5:0/1380810860 shutdown_connections 2024-09-13T17:16:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 --2- 172.21.15.5:0/1380810860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c41591e0 0x7f25c40abe60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 -- 172.21.15.5:0/1380810860 >> 172.21.15.5:0/1380810860 conn(0x7f25c40ce130 msgr2=0x7f25c40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 -- 172.21.15.5:0/1380810860 shutdown_connections 2024-09-13T17:16:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.156+0000 7f25cb345640 1 -- 172.21.15.5:0/1380810860 wait complete. 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 Processor -- start 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 -- start start 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c406da30 0x7f25c40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25c41591e0 0x7f25c4157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c409bd90 con 0x7f25c40ad4e0 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c409ade0 con 0x7f25c406da30 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25cb345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41f0130 con 0x7f25c41591e0 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.158+0000 7f25c88e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35660/0 (socket says 172.21.15.5:35660) 2024-09-13T17:16:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 -- 172.21.15.5:0/1162971702 learned_addr learned my addr 172.21.15.5:0/1162971702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c98e2640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25c41591e0 0x7f25c4157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c90e1640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c406da30 0x7f25c40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 -- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25c41591e0 msgr2=0x7f25c4157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25c41591e0 0x7f25c4157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 -- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c406da30 msgr2=0x7f25c40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c406da30 0x7f25c40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 -- 172.21.15.5:0/1162971702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009400 con 0x7f25c40ad4e0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25c88e0640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c530 tx=0x7f25b800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005ce0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8005e40 con 0x7f25c40ad4e0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80072b0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.159+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c41579c0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.160+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c4157bf0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.161+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c40672a0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.161+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25b8007410 con 0x7f25c40ad4e0 2024-09-13T17:16:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.161+0000 7f25b5ffb640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 0x7f25a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.161+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25b8088a00 con 0x7f25c40ad4e0 2024-09-13T17:16:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.162+0000 7f25c90e1640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 0x7f25a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.162+0000 7f25c90e1640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 0x7f25a806d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25c0034000 tx=0x7f25c002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.166+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25b8053c10 con 0x7f25c40ad4e0 2024-09-13T17:16:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.337+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25c40abe60 con 0x7f25c40ad4e0 2024-09-13T17:16:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.337+0000 7f25b5ffb640 1 -- 172.21.15.5:0/1162971702 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25b80170a0 con 0x7f25c40ad4e0 2024-09-13T17:16:37.339 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 msgr2=0x7f25a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 0x7f25a806d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25c0034000 tx=0x7f25c002e000 comp rx=0 tx=0).stop 2024-09-13T17:16:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 msgr2=0x7f25c41efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c530 tx=0x7f25b800c9f0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 shutdown_connections 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25c41591e0 0x7f25c4157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25a806ac00 0x7f25a806d0c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c40ad4e0 0x7f25c41efbf0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 --2- 172.21.15.5:0/1162971702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25c406da30 0x7f25c40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 >> 172.21.15.5:0/1162971702 conn(0x7f25c40ce130 msgr2=0x7f25c40b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 shutdown_connections 2024-09-13T17:16:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.340+0000 7f25cb345640 1 -- 172.21.15.5:0/1162971702 wait complete. 2024-09-13T17:16:37.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.456+0000 7f880aec9640 1 Processor -- start 2024-09-13T17:16:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.456+0000 7f880aec9640 1 -- start start 2024-09-13T17:16:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f880aec9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88040ae320 0x7f8804160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f880aec9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88040b2230 0x7f88040b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f880aec9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040b1ac0 con 0x7f88040adf40 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f880aec9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880415d210 con 0x7f88040b2230 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f880aec9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880415d4f0 con 0x7f88040ae320 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f8809466640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88040b2230 0x7f88040b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f8809466640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88040b2230 0x7f88040b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35676/0 (socket says 172.21.15.5:35676) 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f8809466640 1 -- 172.21.15.5:0/2513941915 learned_addr learned my addr 172.21.15.5:0/2513941915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.457+0000 7f8803fff640 1 --2- 172.21.15.5:0/2513941915 >> v2:172.21.15.179:3300/0 conn(0x7f88040ae320 0x7f8804160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f8809466640 1 -- 172.21.15.5:0/2513941915 >> v2:172.21.15.179:3300/0 conn(0x7f88040ae320 msgr2=0x7f8804160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f8809466640 1 --2- 172.21.15.5:0/2513941915 >> v2:172.21.15.179:3300/0 conn(0x7f88040ae320 0x7f8804160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f8809466640 1 -- 172.21.15.5:0/2513941915 >> v1:172.21.15.179:6789/0 conn(0x7f88040adf40 legacy=0x7f880415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f8809466640 1 -- 172.21.15.5:0/2513941915 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880415d7d0 con 0x7f88040b2230 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f8809466640 1 --2- 172.21.15.5:0/2513941915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040b2230 0x7f88040b2680 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f880415d140 tx=0x7f87fc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed17eb13c638b378 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f88037fe640 1 -- 172.21.15.5:0/2513941915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc031600 con 0x7f88040b2230 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f88037fe640 1 -- 172.21.15.5:0/2513941915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc02d050 con 0x7f88040b2230 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.458+0000 7f88037fe640 1 -- 172.21.15.5:0/2513941915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc031980 con 0x7f88040b2230 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 -- 172.21.15.5:0/2513941915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040b2230 msgr2=0x7f88040b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 --2- 172.21.15.5:0/2513941915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040b2230 0x7f88040b2680 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f880415d140 tx=0x7f87fc02a730 comp rx=0 tx=0).stop 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 -- 172.21.15.5:0/2513941915 shutdown_connections 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 --2- 172.21.15.5:0/2513941915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040b2230 0x7f88040b2680 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 --2- 172.21.15.5:0/2513941915 >> v2:172.21.15.179:3300/0 conn(0x7f88040ae320 0x7f8804160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 -- 172.21.15.5:0/2513941915 >> 172.21.15.5:0/2513941915 conn(0x7f8804070af0 msgr2=0x7f8804070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 -- 172.21.15.5:0/2513941915 shutdown_connections 2024-09-13T17:16:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.459+0000 7f880aec9640 1 -- 172.21.15.5:0/2513941915 wait complete. 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.460+0000 7f880aec9640 1 Processor -- start 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.460+0000 7f880aec9640 1 -- start start 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 0x7f8804069e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b2230 0x7f880406a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880413e230 con 0x7f88040adf40 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880413df40 con 0x7f88040ae320 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f880aec9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880414f8d0 con 0x7f88040b2230 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f8808c65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f8808c65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35688/0 (socket says 172.21.15.5:35688) 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f8808c65640 1 -- 172.21.15.5:0/2425672772 learned_addr learned my addr 172.21.15.5:0/2425672772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f8809466640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b2230 0x7f880406a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.461+0000 7f8803fff640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 0x7f8804069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 -- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b2230 msgr2=0x7f880406a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b2230 0x7f880406a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 -- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 msgr2=0x7f8804069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 0x7f8804069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 -- 172.21.15.5:0/2425672772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009b30 con 0x7f88040adf40 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8803fff640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 0x7f8804069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f8808c65640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c450 tx=0x7f87f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40052d0 con 0x7f88040adf40 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4005430 con 0x7f88040adf40 2024-09-13T17:16:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880414fbb0 con 0x7f88040adf40 2024-09-13T17:16:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4012870 con 0x7f88040adf40 2024-09-13T17:16:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.462+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880413e760 con 0x7f88040adf40 2024-09-13T17:16:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.463+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040672e0 con 0x7f88040adf40 2024-09-13T17:16:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.464+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87f40129d0 con 0x7f88040adf40 2024-09-13T17:16:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.464+0000 7f88017fa640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.464+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f87f4088e60 con 0x7f88040adf40 2024-09-13T17:16:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.464+0000 7f8803fff640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.465+0000 7f8803fff640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 0x7f87e406d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f88040b00f0 tx=0x7f87ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.468+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87f4053f90 con 0x7f88040adf40 2024-09-13T17:16:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.637+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f880406e600 con 0x7f88040adf40 2024-09-13T17:16:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.637+0000 7f88017fa640 1 -- 172.21.15.5:0/2425672772 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f40575b0 con 0x7f88040adf40 2024-09-13T17:16:37.638 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 msgr2=0x7f87e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 0x7f87e406d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f88040b00f0 tx=0x7f87ec008040 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 msgr2=0x7f880413da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c450 tx=0x7f87f400c910 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 shutdown_connections 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b2230 0x7f880406a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040ae320 0x7f8804069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f87e406ac00 0x7f87e406d0c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 --2- 172.21.15.5:0/2425672772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88040adf40 0x7f880413da00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 >> 172.21.15.5:0/2425672772 conn(0x7f8804070af0 msgr2=0x7f88040ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 shutdown_connections 2024-09-13T17:16:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.639+0000 7f880aec9640 1 -- 172.21.15.5:0/2425672772 wait complete. 2024-09-13T17:16:37.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:37.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.753+0000 7f25ab3ae640 1 Processor -- start 2024-09-13T17:16:37.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.753+0000 7f25ab3ae640 1 -- start start 2024-09-13T17:16:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25ab3ae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25a415a3e0 0x7f25a406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25ab3ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25ab3ae640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a406d410 con 0x7f25a406c320 2024-09-13T17:16:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25ab3ae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a406cb70 con 0x7f25a415a3e0 2024-09-13T17:16:37.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25ab3ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a406ce50 con 0x7f25a40ab770 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a914a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25a415a3e0 0x7f25a406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:39764/0 (socket says 172.21.15.5:39764) 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 -- 172.21.15.5:0/3468026243 learned_addr learned my addr 172.21.15.5:0/3468026243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 -- 172.21.15.5:0/3468026243 >> v2:172.21.15.179:3300/0 conn(0x7f25a415a3e0 msgr2=0x7f25a406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 --2- 172.21.15.5:0/3468026243 >> v2:172.21.15.179:3300/0 conn(0x7f25a415a3e0 0x7f25a406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 -- 172.21.15.5:0/3468026243 >> v1:172.21.15.179:6789/0 conn(0x7f25a406c320 legacy=0x7f25a40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.754+0000 7f25a994b640 1 -- 172.21.15.5:0/3468026243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a406d130 con 0x7f25a40ab770 2024-09-13T17:16:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.755+0000 7f25a994b640 1 --2- 172.21.15.5:0/3468026243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca1012b2a24feb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.755+0000 7f259bfff640 1 -- 172.21.15.5:0/3468026243 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c031600 con 0x7f25a40ab770 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.755+0000 7f259bfff640 1 -- 172.21.15.5:0/3468026243 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c02d050 con 0x7f25a40ab770 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.755+0000 7f259bfff640 1 -- 172.21.15.5:0/3468026243 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c031980 con 0x7f25a40ab770 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 -- 172.21.15.5:0/3468026243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 msgr2=0x7f25a40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/3468026243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c02a710 comp rx=0 tx=0).stop 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 -- 172.21.15.5:0/3468026243 shutdown_connections 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/3468026243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40b1640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/3468026243 >> v2:172.21.15.179:3300/0 conn(0x7f25a415a3e0 0x7f25a406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 -- 172.21.15.5:0/3468026243 >> 172.21.15.5:0/3468026243 conn(0x7f25a40ce0d0 msgr2=0x7f25a40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 -- 172.21.15.5:0/3468026243 shutdown_connections 2024-09-13T17:16:37.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.756+0000 7f25ab3ae640 1 -- 172.21.15.5:0/3468026243 wait complete. 2024-09-13T17:16:37.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.757+0000 7f25ab3ae640 1 Processor -- start 2024-09-13T17:16:37.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.757+0000 7f25ab3ae640 1 -- start start 2024-09-13T17:16:37.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a406c320 0x7f25a415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4151f90 con 0x7f25a415a3e0 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41513a0 con 0x7f25a406c320 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25ab3ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41515f0 con 0x7f25a40ab770 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35698/0 (socket says 172.21.15.5:35698) 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 -- 172.21.15.5:0/1456000402 learned_addr learned my addr 172.21.15.5:0/1456000402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a914a640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a406c320 0x7f25a415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a8949640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 -- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 msgr2=0x7f25a40acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 -- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a406c320 msgr2=0x7f25a415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a406c320 0x7f25a415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.758+0000 7f25a994b640 1 -- 172.21.15.5:0/1456000402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009b30 con 0x7f25a415a3e0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f25a994b640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c03d860 con 0x7f25a415a3e0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c03d9c0 con 0x7f25a415a3e0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a41518d0 con 0x7f25a415a3e0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c03dd70 con 0x7f25a415a3e0 2024-09-13T17:16:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.759+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a41523b0 con 0x7f25a415a3e0 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.760+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a41520d0 con 0x7f25a415a3e0 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.761+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f259c03b400 con 0x7f25a415a3e0 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.761+0000 7f2599ffb640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 0x7f258806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.761+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f259c0aa190 con 0x7f25a415a3e0 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.761+0000 7f25a914a640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 0x7f258806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.762+0000 7f25a914a640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 0x7f258806d0f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f25a41f3370 tx=0x7f25a0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.765+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25a41520d0 con 0x7f25a415a3e0 2024-09-13T17:16:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.950+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25a41520d0 con 0x7f25a415a3e0 2024-09-13T17:16:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.951+0000 7f2599ffb640 1 -- 172.21.15.5:0/1456000402 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25a41520d0 con 0x7f25a415a3e0 2024-09-13T17:16:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 msgr2=0x7f258806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 0x7f258806d0f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f25a41f3370 tx=0x7f25a0009190 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 msgr2=0x7f25a40ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f259c009e50 tx=0x7f259c004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 shutdown_connections 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f258806ac30 0x7f258806d0f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25a415a3e0 0x7f25a40ad4a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a40ab770 0x7f25a40acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 --2- 172.21.15.5:0/1456000402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a406c320 0x7f25a415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 >> 172.21.15.5:0/1456000402 conn(0x7f25a40ce0d0 msgr2=0x7f25a40adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 shutdown_connections 2024-09-13T17:16:37.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:37.953+0000 7f25ab3ae640 1 -- 172.21.15.5:0/1456000402 wait complete. 2024-09-13T17:16:37.965 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:16:37.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:37.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:37.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45242]: fuse finished with error 0 and tester_r 0 2024-09-13T17:16:37.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:38.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:16:38.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:38.032 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:16:38.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.badguy mds 'allow rw path=/foo/bar' osd 'allow rw' mon 'allow r' 2024-09-13T17:16:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.198+0000 7fafffe20640 1 Processor -- start 2024-09-13T17:16:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.198+0000 7fafffe20640 1 -- start start 2024-09-13T17:16:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7fafffe20640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faff806c090 0x7faff815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7fafffe20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff80ad720 0x7faff806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7fafffe20640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff806c520 con 0x7faff8157e20 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7fafffe20640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff815b900 con 0x7faff806c090 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7fafffe20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff806db00 con 0x7faff80ad720 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffd3bb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faff806c090 0x7faff815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffdbbc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faff8157e20 0x7faff80ad010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32838/0 (socket says 172.21.15.5:32838) 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffdbbc640 1 -- 172.21.15.5:0/2298213408 learned_addr learned my addr 172.21.15.5:0/2298213408 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffd3bb640 1 -- 172.21.15.5:0/2298213408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff80ad720 msgr2=0x7faff806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffd3bb640 1 --2- 172.21.15.5:0/2298213408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff80ad720 0x7faff806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffd3bb640 1 -- 172.21.15.5:0/2298213408 >> v1:172.21.15.5:6789/0 conn(0x7faff8157e20 legacy=0x7faff80ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffd3bb640 1 -- 172.21.15.5:0/2298213408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff806c800 con 0x7faff806c090 2024-09-13T17:16:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.199+0000 7faffcbba640 1 -- 172.21.15.5:0/2298213408 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48851792 0 0) 0x7faff806c520 con 0x7faff8157e20 2024-09-13T17:16:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.200+0000 7faffd3bb640 1 --2- 172.21.15.5:0/2298213408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff806c090 0x7faff815b3c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fafe80097a0 tx=0x7fafe802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4beb6845e8694ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.200+0000 7faffcbba640 1 -- 172.21.15.5:0/2298213408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8032440 con 0x7faff806c090 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.200+0000 7faffcbba640 1 -- 172.21.15.5:0/2298213408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80325a0 con 0x7faff806c090 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.200+0000 7faffcbba640 1 -- 172.21.15.5:0/2298213408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8032930 con 0x7faff806c090 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 -- 172.21.15.5:0/2298213408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff806c090 msgr2=0x7faff815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 --2- 172.21.15.5:0/2298213408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff806c090 0x7faff815b3c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fafe80097a0 tx=0x7fafe802a180 comp rx=0 tx=0).stop 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 -- 172.21.15.5:0/2298213408 shutdown_connections 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 --2- 172.21.15.5:0/2298213408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff80ad720 0x7faff806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 --2- 172.21.15.5:0/2298213408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff806c090 0x7faff815b3c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 -- 172.21.15.5:0/2298213408 >> 172.21.15.5:0/2298213408 conn(0x7faff80ce130 msgr2=0x7faff80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 -- 172.21.15.5:0/2298213408 shutdown_connections 2024-09-13T17:16:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.201+0000 7fafffe20640 1 -- 172.21.15.5:0/2298213408 wait complete. 2024-09-13T17:16:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.202+0000 7fafffe20640 1 Processor -- start 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.202+0000 7fafffe20640 1 -- start start 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faff80ad720 0x7faff81f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff8157e20 0x7faff81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8156200 con 0x7faff8155a60 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8098d50 con 0x7faff80ad720 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7fafffe20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff8098420 con 0x7faff8157e20 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35716/0 (socket says 172.21.15.5:35716) 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 -- 172.21.15.5:0/3392901291 learned_addr learned my addr 172.21.15.5:0/3392901291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffd3bb640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff8157e20 0x7faff81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffdbbc640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faff80ad720 0x7faff81f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 -- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff8157e20 msgr2=0x7faff81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff8157e20 0x7faff81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 -- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faff80ad720 msgr2=0x7faff81f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faff80ad720 0x7faff81f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.203+0000 7faffe3bd640 1 -- 172.21.15.5:0/3392901291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009400 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7faffe3bd640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7faff000b970 tx=0x7faff000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000cae0 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000cc60 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8098700 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0014440 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.204+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff8155ef0 con 0x7faff8155a60 2024-09-13T17:16:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.205+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff80672a0 con 0x7faff8155a60 2024-09-13T17:16:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.205+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faff0007370 con 0x7faff8155a60 2024-09-13T17:16:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.206+0000 7fafee7fc640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 0x7fafdc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.206+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faff00893e0 con 0x7faff8155a60 2024-09-13T17:16:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.206+0000 7faffdbbc640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 0x7fafdc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.207+0000 7faffdbbc640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 0x7fafdc06d0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.210+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faff0054410 con 0x7faff8155a60 2024-09-13T17:16:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.447+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.badguy", "caps": ["mds", "allow rw path=/foo/bar", "osd", "allow rw", "mon", "allow r"]} v 0) v1 -- 0x7faff8158200 con 0x7faff8155a60 2024-09-13T17:16:38.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.451+0000 7fafee7fc640 1 -- 172.21.15.5:0/3392901291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.badguy", "caps": ["mds", "allow rw path=/foo/bar", "osd", "allow rw", "mon", "allow r"]}]=0 v12) v1 ==== 173+0+64 (secure 0 0 0) 0x7faff0057a30 con 0x7faff8155a60 2024-09-13T17:16:38.452 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:16:38.452 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB2c+Rm6wbAGhAAv0xMdRwS87ZJzNnU3xjXvA== 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 msgr2=0x7fafdc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 0x7fafdc06d0f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4007de0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 msgr2=0x7faff809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7faff000b970 tx=0x7faff000be30 comp rx=0 tx=0).stop 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 shutdown_connections 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fafdc06ac30 0x7fafdc06d0f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faff8155a60 0x7faff809a1f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faff8157e20 0x7faff81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 --2- 172.21.15.5:0/3392901291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faff80ad720 0x7faff81f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 >> 172.21.15.5:0/3392901291 conn(0x7faff80ce130 msgr2=0x7faff80730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 shutdown_connections 2024-09-13T17:16:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.453+0000 7fafffe20640 1 -- 172.21.15.5:0/3392901291 wait complete. 2024-09-13T17:16:38.466 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:38.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.badguy.keyring 2024-09-13T17:16:38.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:16:38.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.542 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:16:38.543 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:16:38.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:16:38.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:16:38.546 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:16:38.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:16:38.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:16:38.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:16:38.550 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:16:38.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:16:38.552 INFO:teuthology.orchestra.run.smithi005.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:16:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.585 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:16:38.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:16:38.587 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.588 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:16:38.589 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:38.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:16:38.591 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:16:38.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:16:38.593 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:16:38.594 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:16:38.595 INFO:teuthology.orchestra.run.smithi179.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-09-13T17:16:38.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.696+0000 7f17048e5640 1 Processor -- start 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.696+0000 7f17048e5640 1 -- start start 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1700142c90 0x7f17000b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f170006dce0 0x7f170006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700159930 0x7f1700159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170006c9b0 con 0x7f170006dce0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170006e690 con 0x7f1700142c90 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f17048e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170015a2c0 con 0x7f1700159930 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f170006dce0 0x7f170006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f170006dce0 0x7f170006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35720/0 (socket says 172.21.15.5:35720) 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 -- 172.21.15.5:0/1154404997 learned_addr learned my addr 172.21.15.5:0/1154404997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fed9d640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700159930 0x7f1700159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fe59c640 1 --2- 172.21.15.5:0/1154404997 >> v2:172.21.15.179:3300/0 conn(0x7f1700142c90 0x7f17000b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 -- 172.21.15.5:0/1154404997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700159930 msgr2=0x7f1700159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700159930 0x7f1700159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 -- 172.21.15.5:0/1154404997 >> v2:172.21.15.179:3300/0 conn(0x7f1700142c90 msgr2=0x7f17000b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/1154404997 >> v2:172.21.15.179:3300/0 conn(0x7f1700142c90 0x7f17000b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.697+0000 7f16fdd9b640 1 -- 172.21.15.5:0/1154404997 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170015a860 con 0x7f170006dce0 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.698+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f170006e150 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f170006c0b0 tx=0x7f16f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb81a5902b48e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.698+0000 7f16fd59a640 1 -- 172.21.15.5:0/1154404997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4031600 con 0x7f170006dce0 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.698+0000 7f16fd59a640 1 -- 172.21.15.5:0/1154404997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f402d050 con 0x7f170006dce0 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.698+0000 7f16fd59a640 1 -- 172.21.15.5:0/1154404997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4031980 con 0x7f170006dce0 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 -- 172.21.15.5:0/1154404997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 msgr2=0x7f170006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f170006e150 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f170006c0b0 tx=0x7f16f402a6a0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 -- 172.21.15.5:0/1154404997 shutdown_connections 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700159930 0x7f1700159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 --2- 172.21.15.5:0/1154404997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f170006e150 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 --2- 172.21.15.5:0/1154404997 >> v2:172.21.15.179:3300/0 conn(0x7f1700142c90 0x7f17000b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 -- 172.21.15.5:0/1154404997 >> 172.21.15.5:0/1154404997 conn(0x7f1700069ed0 msgr2=0x7f170006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 -- 172.21.15.5:0/1154404997 shutdown_connections 2024-09-13T17:16:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.699+0000 7f17048e5640 1 -- 172.21.15.5:0/1154404997 wait complete. 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.700+0000 7f17048e5640 1 Processor -- start 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.700+0000 7f17048e5640 1 -- start start 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700142c90 0x7f17000ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1700159930 0x7f17000add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c48e0 con 0x7f170006dce0 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700142510 con 0x7f1700159930 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f17048e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c6d20 con 0x7f1700142c90 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f16fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f16fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35724/0 (socket says 172.21.15.5:35724) 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f16fe59c640 1 -- 172.21.15.5:0/2031220549 learned_addr learned my addr 172.21.15.5:0/2031220549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700142c90 0x7f17000ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.701+0000 7f16fed9d640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1700159930 0x7f17000add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 -- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700142c90 msgr2=0x7f17000ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700142c90 0x7f17000ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 -- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1700159930 msgr2=0x7f17000add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1700159930 0x7f17000add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 -- 172.21.15.5:0/2031220549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4009b30 con 0x7f170006dce0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16fe59c640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e8c0 tx=0x7f16f000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000c940 con 0x7f170006dce0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f000caa0 con 0x7f170006dce0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000ce30 con 0x7f170006dce0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17001f20d0 con 0x7f170006dce0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.702+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17000c4db0 con 0x7f170006dce0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.703+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700143070 con 0x7f170006dce0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.704+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f16f0013470 con 0x7f170006dce0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.704+0000 7f16eeffd640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 0x7f16e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.704+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f16f0089600 con 0x7f170006dce0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.704+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 0x7f16e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.705+0000 7f16fdd9b640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 0x7f16e006d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f16f4033000 tx=0x7f16f4009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.708+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f16f0054750 con 0x7f170006dce0 2024-09-13T17:16:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.913+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17000ad5f0 con 0x7f170006dce0 2024-09-13T17:16:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.913+0000 7f16eeffd640 1 -- 172.21.15.5:0/2031220549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f16f0057d70 con 0x7f170006dce0 2024-09-13T17:16:38.915 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 msgr2=0x7f16e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 0x7f16e006d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f16f4033000 tx=0x7f16f4009000 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 msgr2=0x7f17000c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e8c0 tx=0x7f16f000ed80 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 shutdown_connections 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1700159930 0x7f17000add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1700142c90 0x7f17000ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f16e006ac00 0x7f16e006d0c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 --2- 172.21.15.5:0/2031220549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f170006dce0 0x7f17000c43a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 >> 172.21.15.5:0/2031220549 conn(0x7f1700069ed0 msgr2=0x7f170006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 shutdown_connections 2024-09-13T17:16:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:38.915+0000 7f17048e5640 1 -- 172.21.15.5:0/2031220549 wait complete. 2024-09-13T17:16:38.927 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:16:38.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.client.name = client.badguy 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /foo/bar 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:16:38.928 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:38.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:38.928 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:38.946 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42496sec preferred_lft 42496sec 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:16:38.947 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:38.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:38.949 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:16:39.011 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:16:39.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.013 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:16:39.070 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:16:39.070 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:16:39.070 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:16:39.070 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:16:39.070 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:16:39.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:16:39.071 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:16:39.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.158 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:16:39.173 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:16:39.174 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:16:39.174 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:39.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:16:39.238 INFO:tasks.cephfs.fuse_mount:Client client.badguy config is {} 2024-09-13T17:16:39.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:39.239 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:39.294 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:39.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:39.295 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:39.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:39.416 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:39.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:39.480 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:39.480 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:39.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.481 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:39.536 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:16:39.536 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id badguy --client_mountpoint=/foo/bar) 2024-09-13T17:16:39.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:39.604 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:39.604 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:39.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:16:39.659+0000 7fc65491d480 -1 init, newargv = 0x55dc584a93f0 newargc=15 2024-09-13T17:16:39.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45731]: starting ceph client 2024-09-13T17:16:39.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45731]: starting fuse 2024-09-13T17:16:39.670 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:39.671 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:39.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:39.672 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:39.727 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:16:39.728 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.badguy.*.asok" 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:16:39.728 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:16:39.729 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.badguy")) 2024-09-13T17:16:39.730 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:16:39.841 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.badguy.45731.asok 2024-09-13T17:16:40.028 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.badguy.45731.asok 2024-09-13T17:16:40.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:40.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.badguy.45731.asok status 2024-09-13T17:16:40.161 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:16:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "badguy", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "45731", 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/foo/bar" 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 6017, 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:16:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 6017 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1347304903 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1347304903 2024-09-13T17:16:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.6017 192.168.0.1:0/1347304903", 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/1347304903", 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 30, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 69, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:16:40.164 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:16:40.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:40.170 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:16:40.170 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:40.185 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:16:40.185 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:40.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:40.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:40.252 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:40.252 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:40.309 DEBUG:tasks.cephfs.mount:Creating test file 2024-09-13 17:16:40.309014 badguy 2024-09-13T17:16:40.309 DEBUG:teuthology.orchestra.run.smithi179:> touch '/home/ubuntu/cephtest/mnt.1/2024-09-13 17:16:40.309014 badguy' 2024-09-13T17:16:40.368 DEBUG:tasks.cephfs.mount:Deleting test file 2024-09-13 17:16:40.309014 badguy 2024-09-13T17:16:40.368 DEBUG:teuthology.orchestra.run.smithi179:> rm -f '/home/ubuntu/cephtest/mnt.1/2024-09-13 17:16:40.309014 badguy' 2024-09-13T17:16:40.425 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:40.425 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:40.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.596+0000 7fe61c69c640 1 Processor -- start 2024-09-13T17:16:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.596+0000 7fe61c69c640 1 -- start start 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61c69c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6140ca8e0 0x7fe614161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61c69c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140cb3e0 con 0x7fe61415a8f0 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61c69c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61406dd80 con 0x7fe614159500 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61c69c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140cb100 con 0x7fe6140ca8e0 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61ac39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe61415a8f0 0x7fe614163570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32844/0 (socket says 172.21.15.5:32844) 2024-09-13T17:16:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe61ac39640 1 -- 172.21.15.5:0/3832491126 learned_addr learned my addr 172.21.15.5:0/3832491126 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:40.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.597+0000 7fe619c37640 1 --2- 172.21.15.5:0/3832491126 >> v2:172.21.15.5:3300/0 conn(0x7fe6140ca8e0 0x7fe614161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619c37640 1 -- 172.21.15.5:0/3832491126 >> v1:172.21.15.179:6789/0 conn(0x7fe614159500 legacy=0x7fe6140cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619c37640 1 -- 172.21.15.5:0/3832491126 >> v1:172.21.15.5:6789/0 conn(0x7fe61415a8f0 legacy=0x7fe614163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619436640 1 -- 172.21.15.5:0/3832491126 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525261239 0 0) 0x7fe61406dd80 con 0x7fe614159500 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619c37640 1 -- 172.21.15.5:0/3832491126 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140b3450 con 0x7fe6140ca8e0 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619c37640 1 --2- 172.21.15.5:0/3832491126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140ca8e0 0x7fe614161020 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe6040097a0 tx=0x7fe60402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e018c21d7473f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619436640 1 -- 172.21.15.5:0/3832491126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60402ad30 con 0x7fe6140ca8e0 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.598+0000 7fe619436640 1 -- 172.21.15.5:0/3832491126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60402ae90 con 0x7fe6140ca8e0 2024-09-13T17:16:40.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe619436640 1 -- 172.21.15.5:0/3832491126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604032660 con 0x7fe6140ca8e0 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 -- 172.21.15.5:0/3832491126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140ca8e0 msgr2=0x7fe614161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 --2- 172.21.15.5:0/3832491126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140ca8e0 0x7fe614161020 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe6040097a0 tx=0x7fe60402a0a0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 -- 172.21.15.5:0/3832491126 shutdown_connections 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 --2- 172.21.15.5:0/3832491126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140ca8e0 0x7fe614161020 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 -- 172.21.15.5:0/3832491126 >> 172.21.15.5:0/3832491126 conn(0x7fe6140b01d0 msgr2=0x7fe6140b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 -- 172.21.15.5:0/3832491126 shutdown_connections 2024-09-13T17:16:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.599+0000 7fe61c69c640 1 -- 172.21.15.5:0/3832491126 wait complete. 2024-09-13T17:16:40.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.600+0000 7fe61c69c640 1 Processor -- start 2024-09-13T17:16:40.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.600+0000 7fe61c69c640 1 -- start start 2024-09-13T17:16:40.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6140ca8e0 0x7fe614153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe61415a8f0 0x7fe6140af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c9860 con 0x7fe614159500 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141453e0 con 0x7fe6140ca8e0 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61c69c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614145870 con 0x7fe61415a8f0 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe619c37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe619c37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35734/0 (socket says 172.21.15.5:35734) 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe619c37640 1 -- 172.21.15.5:0/456269180 learned_addr learned my addr 172.21.15.5:0/456269180 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61a438640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6140ca8e0 0x7fe614153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.601+0000 7fe61ac39640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe61415a8f0 0x7fe6140af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 -- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe61415a8f0 msgr2=0x7fe6140af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe61415a8f0 0x7fe6140af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 -- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6140ca8e0 msgr2=0x7fe614153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6140ca8e0 0x7fe614153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 -- 172.21.15.5:0/456269180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604009400 con 0x7fe614159500 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe619c37640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe60402a0e0 tx=0x7fe6040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604004230 con 0x7fe614159500 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6040043b0 con 0x7fe614159500 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6141447d0 con 0x7fe614159500 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604003850 con 0x7fe614159500 2024-09-13T17:16:40.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.602+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614144d90 con 0x7fe614159500 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.603+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61406c9b0 con 0x7fe614159500 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.604+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe604039040 con 0x7fe614159500 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.604+0000 7fe60affd640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 0x7fe5f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.604+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe6040a9eb0 con 0x7fe614159500 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.604+0000 7fe61a438640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 0x7fe5f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.605+0000 7fe61a438640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 0x7fe5f806d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe610000f60 tx=0x7fe610009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.608+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe6040750a0 con 0x7fe614159500 2024-09-13T17:16:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.780+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe614145550 con 0x7fe614159500 2024-09-13T17:16:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.781+0000 7fe60affd640 1 -- 172.21.15.5:0/456269180 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fe60404c090 con 0x7fe614159500 2024-09-13T17:16:40.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:40.782 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 msgr2=0x7fe5f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 0x7fe5f806d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe610000f60 tx=0x7fe610009040 comp rx=0 tx=0).stop 2024-09-13T17:16:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 msgr2=0x7fe6140aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe60402a0e0 tx=0x7fe6040046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 shutdown_connections 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe61415a8f0 0x7fe6140af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe5f806ac00 0x7fe5f806d0c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe614159500 0x7fe6140aeea0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 --2- 172.21.15.5:0/456269180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6140ca8e0 0x7fe614153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 >> 172.21.15.5:0/456269180 conn(0x7fe6140b01d0 msgr2=0x7fe6140cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 shutdown_connections 2024-09-13T17:16:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.783+0000 7fe61c69c640 1 -- 172.21.15.5:0/456269180 wait complete. 2024-09-13T17:16:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:40.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.899+0000 7f119e680640 1 Processor -- start 2024-09-13T17:16:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.899+0000 7f119e680640 1 -- start start 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119e680640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119e680640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11980d1380 0x7f119806be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119e680640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11980af280 con 0x7f11980cddd0 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119e680640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119806b120 con 0x7f11980d1380 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119e680640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119806b9c0 con 0x7f119815c710 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11980d1380 0x7f119806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11980d1380 0x7f119806be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35746/0 (socket says 172.21.15.5:35746) 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 -- 172.21.15.5:0/2075591155 learned_addr learned my addr 172.21.15.5:0/2075591155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f1197fff640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 -- 172.21.15.5:0/2075591155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 msgr2=0x7f11980d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 -- 172.21.15.5:0/2075591155 >> v1:172.21.15.179:6789/0 conn(0x7f11980cddd0 legacy=0x7f11980d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.900+0000 7f119cc1d640 1 -- 172.21.15.5:0/2075591155 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980ce540 con 0x7f11980d1380 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.901+0000 7f119cc1d640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119806be50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1190009e50 tx=0x7f119002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4f5064fb1149dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.901+0000 7f11977fe640 1 -- 172.21.15.5:0/2075591155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190031600 con 0x7f11980d1380 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.901+0000 7f11977fe640 1 -- 172.21.15.5:0/2075591155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119002d050 con 0x7f11980d1380 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.901+0000 7f11977fe640 1 -- 172.21.15.5:0/2075591155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190031980 con 0x7f11980d1380 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 -- 172.21.15.5:0/2075591155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 msgr2=0x7f119806be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119806be50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1190009e50 tx=0x7f119002a710 comp rx=0 tx=0).stop 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 -- 172.21.15.5:0/2075591155 shutdown_connections 2024-09-13T17:16:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119806be50 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 --2- 172.21.15.5:0/2075591155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 -- 172.21.15.5:0/2075591155 >> 172.21.15.5:0/2075591155 conn(0x7f1198089fc0 msgr2=0x7f11980d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 -- 172.21.15.5:0/2075591155 shutdown_connections 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.902+0000 7f119e680640 1 -- 172.21.15.5:0/2075591155 wait complete. 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.903+0000 7f119e680640 1 Processor -- start 2024-09-13T17:16:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.903+0000 7f119e680640 1 -- start start 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11980cddd0 0x7f11981f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980b7a30 con 0x7f11980d1380 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981f2dc0 con 0x7f11980cddd0 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119e680640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11981f30a0 con 0x7f119815c710 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35756/0 (socket says 172.21.15.5:35756) 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 -- 172.21.15.5:0/1804877643 learned_addr learned my addr 172.21.15.5:0/1804877643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f1197fff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11980cddd0 0x7f11981f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f119cc1d640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 -- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 msgr2=0x7f11980af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 -- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11980cddd0 msgr2=0x7f11981f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11980cddd0 0x7f11981f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 -- 172.21.15.5:0/1804877643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009b30 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.904+0000 7f118ffff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f118000c400 tx=0x7f118000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.905+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800052d0 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.905+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180005430 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.905+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11981f5840 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.905+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180003830 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.905+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11981f5e00 con 0x7f11980d1380 2024-09-13T17:16:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.906+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980d0640 con 0x7f11980d1380 2024-09-13T17:16:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.906+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1180003990 con 0x7f11980d1380 2024-09-13T17:16:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.907+0000 7f11957fa640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 0x7f117806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.907+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1180088900 con 0x7f11980d1380 2024-09-13T17:16:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.907+0000 7f1197fff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 0x7f117806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.907+0000 7f1197fff640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 0x7f117806d0f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f11880079a0 tx=0x7f1188008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:40.911+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1180053ae0 con 0x7f11980d1380 2024-09-13T17:16:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.080+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f119815c310 con 0x7f11980d1380 2024-09-13T17:16:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.081+0000 7f11957fa640 1 -- 172.21.15.5:0/1804877643 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1180017020 con 0x7f11980d1380 2024-09-13T17:16:41.082 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:41.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 msgr2=0x7f117806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 0x7f117806d0f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f11880079a0 tx=0x7f1188008040 comp rx=0 tx=0).stop 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 msgr2=0x7f119815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f118000c400 tx=0x7f118000c8c0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 shutdown_connections 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f119815c710 0x7f11980af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f117806ac30 0x7f117806d0f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11980d1380 0x7f119815a6d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 --2- 172.21.15.5:0/1804877643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11980cddd0 0x7f11981f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 >> 172.21.15.5:0/1804877643 conn(0x7f1198089fc0 msgr2=0x7f11980b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 shutdown_connections 2024-09-13T17:16:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.083+0000 7f119e680640 1 -- 172.21.15.5:0/1804877643 wait complete. 2024-09-13T17:16:41.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 Processor -- start 2024-09-13T17:16:41.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 -- start start 2024-09-13T17:16:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 0x7f649806be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980af280 con 0x7f64980cddd0 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649806b120 con 0x7f64980d1380 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.199+0000 7f649ea20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649806b9c0 con 0x7f649815c710 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6497fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f649cfbd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 0x7f649806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f64977fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f64980cddd0 0x7f64980d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:49330/0 (socket says 172.21.15.5:49330) 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f64977fe640 1 -- 172.21.15.5:0/3419817635 learned_addr learned my addr 172.21.15.5:0/3419817635 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6496ffd640 1 -- 172.21.15.5:0/3419817635 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357990828 0 0) 0x7f64980af280 con 0x7f64980cddd0 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6496ffd640 1 -- 172.21.15.5:0/3419817635 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6480003520 con 0x7f64980cddd0 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6497fff640 1 -- 172.21.15.5:0/3419817635 >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 msgr2=0x7f649806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6497fff640 1 --2- 172.21.15.5:0/3419817635 >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 0x7f649806be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6497fff640 1 -- 172.21.15.5:0/3419817635 >> v1:172.21.15.179:6789/0 conn(0x7f64980cddd0 legacy=0x7f64980d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f6497fff640 1 -- 172.21.15.5:0/3419817635 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980ce540 con 0x7f649815c710 2024-09-13T17:16:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.200+0000 7f649cfbd640 1 --2- 172.21.15.5:0/3419817635 >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 0x7f649806be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.201+0000 7f6497fff640 1 --2- 172.21.15.5:0/3419817635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980d0640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64880097a0 tx=0x7f648802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d0e6142c1efd303 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.201+0000 7f6496ffd640 1 -- 172.21.15.5:0/3419817635 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488032440 con 0x7f649815c710 2024-09-13T17:16:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.201+0000 7f6496ffd640 1 -- 172.21.15.5:0/3419817635 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880325a0 con 0x7f649815c710 2024-09-13T17:16:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.201+0000 7f6496ffd640 1 -- 172.21.15.5:0/3419817635 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488032910 con 0x7f649815c710 2024-09-13T17:16:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 -- 172.21.15.5:0/3419817635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 msgr2=0x7f64980d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 --2- 172.21.15.5:0/3419817635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980d0640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64880097a0 tx=0x7f648802a180 comp rx=0 tx=0).stop 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 -- 172.21.15.5:0/3419817635 shutdown_connections 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 --2- 172.21.15.5:0/3419817635 >> v2:172.21.15.179:3300/0 conn(0x7f64980d1380 0x7f649806be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 --2- 172.21.15.5:0/3419817635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980d0640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 -- 172.21.15.5:0/3419817635 >> 172.21.15.5:0/3419817635 conn(0x7f6498089fc0 msgr2=0x7f64980d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 -- 172.21.15.5:0/3419817635 shutdown_connections 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.202+0000 7f649ea20640 1 -- 172.21.15.5:0/3419817635 wait complete. 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.203+0000 7f649ea20640 1 Processor -- start 2024-09-13T17:16:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.203+0000 7f649ea20640 1 -- start start 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 0x7f64980c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c9110 con 0x7f64980d1380 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981f2de0 con 0x7f64980cddd0 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649ea20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649814e880 con 0x7f649815c710 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35758/0 (socket says 172.21.15.5:35758) 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 -- 172.21.15.5:0/1354574695 learned_addr learned my addr 172.21.15.5:0/1354574695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f649cfbd640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f6497fff640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 0x7f64980c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 -- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 msgr2=0x7f64980c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 -- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 msgr2=0x7f64980c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 0x7f64980c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f64977fe640 1 -- 172.21.15.5:0/1354574695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009a70 con 0x7f64980d1380 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.204+0000 7f6497fff640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 0x7f64980c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f64977fe640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c400 tx=0x7f648c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c005ce0 con 0x7f64980d1380 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c005e60 con 0x7f64980d1380 2024-09-13T17:16:41.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488009400 con 0x7f64980d1380 2024-09-13T17:16:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c007310 con 0x7f64980d1380 2024-09-13T17:16:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.205+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649814ee40 con 0x7f64980d1380 2024-09-13T17:16:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.206+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64980d0640 con 0x7f64980d1380 2024-09-13T17:16:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.206+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f648c007470 con 0x7f64980d1380 2024-09-13T17:16:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.207+0000 7f6494ff9640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.207+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f648c088a30 con 0x7f64980d1380 2024-09-13T17:16:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.207+0000 7f6497fff640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.207+0000 7f6497fff640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6488034000 tx=0x7f648802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.211+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f648c053ad0 con 0x7f64980d1380 2024-09-13T17:16:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.380+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64980afe60 con 0x7f64980d1380 2024-09-13T17:16:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.380+0000 7f6494ff9640 1 -- 172.21.15.5:0/1354574695 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f648c0170a0 con 0x7f64980d1380 2024-09-13T17:16:41.381 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 msgr2=0x7f648406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 0x7f648406d0c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6488034000 tx=0x7f648802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 msgr2=0x7f64980c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c400 tx=0x7f648c00c800 comp rx=0 tx=0).stop 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 shutdown_connections 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f649815c710 0x7f64980c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f648406ac00 0x7f648406d0c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64980d1380 0x7f64980c7c10 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 --2- 172.21.15.5:0/1354574695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64980cddd0 0x7f64980c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 >> 172.21.15.5:0/1354574695 conn(0x7f6498089fc0 msgr2=0x7f64980b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 shutdown_connections 2024-09-13T17:16:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.382+0000 7f649ea20640 1 -- 172.21.15.5:0/1354574695 wait complete. 2024-09-13T17:16:41.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.500+0000 7feeef35a640 1 Processor -- start 2024-09-13T17:16:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.501+0000 7feeef35a640 1 -- start start 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.501+0000 7feeef35a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feee815c710 0x7feee80d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.501+0000 7feeef35a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 0x7feee80d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeef35a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80af280 con 0x7feee80d11b0 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeef35a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee80d1660 con 0x7feee815c710 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeef35a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee806b120 con 0x7feee80cddd0 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed0f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feee815c710 0x7feee80d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed8f7640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feee80d11b0 0x7feee80ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32858/0 (socket says 172.21.15.5:32858) 2024-09-13T17:16:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed8f7640 1 -- 172.21.15.5:0/3218022304 learned_addr learned my addr 172.21.15.5:0/3218022304 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeec8f5640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 0x7feee80d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed0f6640 1 -- 172.21.15.5:0/3218022304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 msgr2=0x7feee80d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed0f6640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 0x7feee80d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed0f6640 1 -- 172.21.15.5:0/3218022304 >> v1:172.21.15.5:6789/0 conn(0x7feee80d11b0 legacy=0x7feee80ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeed0f6640 1 -- 172.21.15.5:0/3218022304 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee806b9c0 con 0x7feee815c710 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feedffff640 1 -- 172.21.15.5:0/3218022304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741238403 0 0) 0x7feee80af280 con 0x7feee80d11b0 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.502+0000 7feeec8f5640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 0x7feee80d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feeed0f6640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee815c710 0x7feee80d0640 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7feee40097d0 tx=0x7feee402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d414d0c5f4dd1544 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feedffff640 1 -- 172.21.15.5:0/3218022304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4032440 con 0x7feee815c710 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feedffff640 1 -- 172.21.15.5:0/3218022304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee40325a0 con 0x7feee815c710 2024-09-13T17:16:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feedffff640 1 -- 172.21.15.5:0/3218022304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4032930 con 0x7feee815c710 2024-09-13T17:16:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feeef35a640 1 -- 172.21.15.5:0/3218022304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee815c710 msgr2=0x7feee80d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.503+0000 7feeef35a640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee815c710 0x7feee80d0640 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7feee40097d0 tx=0x7feee402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 -- 172.21.15.5:0/3218022304 shutdown_connections 2024-09-13T17:16:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee80cddd0 0x7feee80d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 --2- 172.21.15.5:0/3218022304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee815c710 0x7feee80d0640 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 -- 172.21.15.5:0/3218022304 >> 172.21.15.5:0/3218022304 conn(0x7feee8089fc0 msgr2=0x7feee80d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 -- 172.21.15.5:0/3218022304 shutdown_connections 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.504+0000 7feeef35a640 1 -- 172.21.15.5:0/3218022304 wait complete. 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.505+0000 7feeef35a640 1 Processor -- start 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.505+0000 7feeef35a640 1 -- start start 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80d11b0 0x7feee8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee815c710 0x7feee8157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c8d40 con 0x7feee80cddd0 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b7560 con 0x7feee80d11b0 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b7840 con 0x7feee815c710 2024-09-13T17:16:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35778/0 (socket says 172.21.15.5:35778) 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 -- 172.21.15.5:0/1621431777 learned_addr learned my addr 172.21.15.5:0/1621431777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed8f7640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee815c710 0x7feee8157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeec8f5640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80d11b0 0x7feee8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 -- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee815c710 msgr2=0x7feee8157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee815c710 0x7feee8157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 -- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80d11b0 msgr2=0x7feee8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80d11b0 0x7feee8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 -- 172.21.15.5:0/1621431777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4009400 con 0x7feee80cddd0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeed0f6640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7feee4035040 tx=0x7feee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4032440 con 0x7feee80cddd0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4006e10 con 0x7feee80cddd0 2024-09-13T17:16:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80b7b20 con 0x7feee80cddd0 2024-09-13T17:16:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.506+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4030be0 con 0x7feee80cddd0 2024-09-13T17:16:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.507+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee80b80e0 con 0x7feee80cddd0 2024-09-13T17:16:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.508+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee815caf0 con 0x7feee80cddd0 2024-09-13T17:16:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.508+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feee4039040 con 0x7feee80cddd0 2024-09-13T17:16:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.508+0000 7feeddffb640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 0x7feecc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.509+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feee40a9d50 con 0x7feee80cddd0 2024-09-13T17:16:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.509+0000 7feeec8f5640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 0x7feecc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.509+0000 7feeec8f5640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 0x7feecc06d0f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7feee8071ae0 tx=0x7feed8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.513+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feee40ad030 con 0x7feee80cddd0 2024-09-13T17:16:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.681+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feee8159f30 con 0x7feee80cddd0 2024-09-13T17:16:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.681+0000 7feeddffb640 1 -- 172.21.15.5:0/1621431777 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7feee4074e80 con 0x7feee80cddd0 2024-09-13T17:16:41.683 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 msgr2=0x7feecc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 0x7feecc06d0f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7feee8071ae0 tx=0x7feed8008040 comp rx=0 tx=0).stop 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 msgr2=0x7feee80c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7feee4035040 tx=0x7feee40046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 shutdown_connections 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feee815c710 0x7feee8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80d11b0 0x7feee8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feecc06ac30 0x7feecc06d0f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 --2- 172.21.15.5:0/1621431777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feee80cddd0 0x7feee80c8800 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.683+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 >> 172.21.15.5:0/1621431777 conn(0x7feee8089fc0 msgr2=0x7feee80b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.684+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 shutdown_connections 2024-09-13T17:16:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.684+0000 7feeef35a640 1 -- 172.21.15.5:0/1621431777 wait complete. 2024-09-13T17:16:41.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.797+0000 7f18c689c640 1 Processor -- start 2024-09-13T17:16:41.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.797+0000 7f18c689c640 1 -- start start 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c689c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c00cff50 0x7f18c00b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c689c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 0x7f18c00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c689c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c00aede0 con 0x7f18c01439c0 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c689c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c006aea0 con 0x7f18c00cff50 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c689c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c0143da0 con 0x7f18c00cf320 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18bf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c00cff50 0x7f18c00b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18bffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18c01439c0 0x7f18c00adae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32860/0 (socket says 172.21.15.5:32860) 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18bffff640 1 -- 172.21.15.5:0/369630113 learned_addr learned my addr 172.21.15.5:0/369630113 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18bf7fe640 1 -- 172.21.15.5:0/369630113 >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 msgr2=0x7f18c00cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18c4e39640 1 --2- 172.21.15.5:0/369630113 >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 0x7f18c00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.798+0000 7f18bf7fe640 1 --2- 172.21.15.5:0/369630113 >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 0x7f18c00cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18bf7fe640 1 -- 172.21.15.5:0/369630113 >> v1:172.21.15.5:6789/0 conn(0x7f18c01439c0 legacy=0x7f18c00adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18bf7fe640 1 -- 172.21.15.5:0/369630113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c006a8e0 con 0x7f18c00cff50 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18beffd640 1 -- 172.21.15.5:0/369630113 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006662770 0 0) 0x7f18c00aede0 con 0x7f18c01439c0 2024-09-13T17:16:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18c4e39640 1 --2- 172.21.15.5:0/369630113 >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 0x7f18c00cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18bf7fe640 1 --2- 172.21.15.5:0/369630113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c00b4f50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ad8d0 tx=0x7f18b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63b0a38e34fee2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18beffd640 1 -- 172.21.15.5:0/369630113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b402ae60 con 0x7f18c00cff50 2024-09-13T17:16:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18beffd640 1 -- 172.21.15.5:0/369630113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4032440 con 0x7f18c00cff50 2024-09-13T17:16:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.799+0000 7f18beffd640 1 -- 172.21.15.5:0/369630113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40327d0 con 0x7f18c00cff50 2024-09-13T17:16:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 -- 172.21.15.5:0/369630113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 msgr2=0x7f18c00b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 --2- 172.21.15.5:0/369630113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c00b4f50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f18c00ad8d0 tx=0x7f18b402a110 comp rx=0 tx=0).stop 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 -- 172.21.15.5:0/369630113 shutdown_connections 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 --2- 172.21.15.5:0/369630113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c00b4f50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 --2- 172.21.15.5:0/369630113 >> v2:172.21.15.179:3300/0 conn(0x7f18c00cf320 0x7f18c00cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 -- 172.21.15.5:0/369630113 >> 172.21.15.5:0/369630113 conn(0x7f18c0098a30 msgr2=0x7f18c00b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 -- 172.21.15.5:0/369630113 shutdown_connections 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.800+0000 7f18c689c640 1 -- 172.21.15.5:0/369630113 wait complete. 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.801+0000 7f18c689c640 1 Processor -- start 2024-09-13T17:16:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.801+0000 7f18c689c640 1 -- start start 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 0x7f18c01efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 0x7f18c0138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01f03b0 con 0x7f18c00cff50 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01f0690 con 0x7f18c00cf320 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c689c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01f0970 con 0x7f18c01439c0 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35802/0 (socket says 172.21.15.5:35802) 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18bf7fe640 1 -- 172.21.15.5:0/1773614563 learned_addr learned my addr 172.21.15.5:0/1773614563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18bffff640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 0x7f18c01efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.802+0000 7f18c4e39640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 0x7f18c0138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 -- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 msgr2=0x7f18c0138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 0x7f18c0138d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 -- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 msgr2=0x7f18c01efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 0x7f18c01efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 -- 172.21.15.5:0/1773614563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009400 con 0x7f18c00cff50 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bffff640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 0x7f18c01efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18c4e39640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 0x7f18c0138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bf7fe640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004230 con 0x7f18c00cff50 2024-09-13T17:16:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4004390 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c01f3410 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b403d850 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.803+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c013fa80 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.804+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c00cf790 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.804+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18b403d9b0 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.805+0000 7f18bcff9640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 0x7f18ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.805+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f18b40aa1f0 con 0x7f18c00cff50 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.805+0000 7f18bffff640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 0x7f18ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.806+0000 7f18bffff640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 0x7f18ac06d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b0007c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.809+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18b4075290 con 0x7f18c00cff50 2024-09-13T17:16:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.993+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18c00b3220 con 0x7f18c00cff50 2024-09-13T17:16:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.994+0000 7f18bcff9640 1 -- 172.21.15.5:0/1773614563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f18b40788b0 con 0x7f18c00cff50 2024-09-13T17:16:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 msgr2=0x7f18ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 0x7f18ac06d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b0007c30 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 msgr2=0x7f18c01426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b40046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 shutdown_connections 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18c01439c0 0x7f18c0138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f18ac06ac00 0x7f18ac06d0c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c00cff50 0x7f18c01426f0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 --2- 172.21.15.5:0/1773614563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18c00cf320 0x7f18c01efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 >> 172.21.15.5:0/1773614563 conn(0x7f18c0098a30 msgr2=0x7f18c015b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 shutdown_connections 2024-09-13T17:16:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:41.996+0000 7f18c689c640 1 -- 172.21.15.5:0/1773614563 wait complete. 2024-09-13T17:16:42.008 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:16:42.008 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:16:42.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.128+0000 7f2e5fac9640 1 Processor -- start 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.128+0000 7f2e5fac9640 1 -- start start 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5fac9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e580ca8e0 0x7f2e58161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5fac9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e580cb3e0 con 0x7f2e58159500 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5fac9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5806dd80 con 0x7f2e5815a8f0 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5fac9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e580cb100 con 0x7f2e580ca8e0 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5d865640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e58159500 0x7f2e580cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32864/0 (socket says 172.21.15.5:32864) 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5d064640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e580ca8e0 0x7f2e58161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.129+0000 7f2e5d865640 1 -- 172.21.15.5:0/3295691683 learned_addr learned my addr 172.21.15.5:0/3295691683 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5c863640 1 -- 172.21.15.5:0/3295691683 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875391111 0 0) 0x7f2e580cb3e0 con 0x7f2e58159500 2024-09-13T17:16:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5c863640 1 -- 172.21.15.5:0/3295691683 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e40003520 con 0x7f2e58159500 2024-09-13T17:16:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5d064640 1 -- 172.21.15.5:0/3295691683 >> v1:172.21.15.179:6789/0 conn(0x7f2e5815a8f0 legacy=0x7f2e58163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5d064640 1 -- 172.21.15.5:0/3295691683 >> v1:172.21.15.5:6789/0 conn(0x7f2e58159500 legacy=0x7f2e580cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5d064640 1 -- 172.21.15.5:0/3295691683 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580b3450 con 0x7f2e580ca8e0 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.130+0000 7f2e5d064640 1 --2- 172.21.15.5:0/3295691683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e580ca8e0 0x7f2e58161020 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0097a0 tx=0x7f2e4c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f80551fc6a963cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5c863640 1 -- 172.21.15.5:0/3295691683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c02ae50 con 0x7f2e580ca8e0 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5c863640 1 -- 172.21.15.5:0/3295691683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c032440 con 0x7f2e580ca8e0 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5c863640 1 -- 172.21.15.5:0/3295691683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0327d0 con 0x7f2e580ca8e0 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3295691683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e580ca8e0 msgr2=0x7f2e58161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3295691683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e580ca8e0 0x7f2e58161020 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0097a0 tx=0x7f2e4c02a140 comp rx=0 tx=0).stop 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3295691683 shutdown_connections 2024-09-13T17:16:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3295691683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e580ca8e0 0x7f2e58161020 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3295691683 >> 172.21.15.5:0/3295691683 conn(0x7f2e580b01d0 msgr2=0x7f2e580b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3295691683 shutdown_connections 2024-09-13T17:16:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.131+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3295691683 wait complete. 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.132+0000 7f2e5fac9640 1 Processor -- start 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 -- start start 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e580ca8e0 0x7f2e581546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e58159500 0x7f2e581f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580c8ae0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581f5bd0 con 0x7f2e580ca8e0 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5fac9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581f5de0 con 0x7f2e58159500 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5e066640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5e066640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35820/0 (socket says 172.21.15.5:35820) 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.133+0000 7f2e5e066640 1 -- 172.21.15.5:0/3649582008 learned_addr learned my addr 172.21.15.5:0/3649582008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5d865640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e580ca8e0 0x7f2e581546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5d064640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e58159500 0x7f2e581f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 -- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e58159500 msgr2=0x7f2e581f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e58159500 0x7f2e581f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 -- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e580ca8e0 msgr2=0x7f2e581546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e580ca8e0 0x7f2e581546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 -- 172.21.15.5:0/3649582008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009400 con 0x7f2e5815a8f0 2024-09-13T17:16:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5e066640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000b410 tx=0x7f2e5000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50004020 con 0x7f2e5815a8f0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50004180 con 0x7f2e5815a8f0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e581f60c0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50011630 con 0x7f2e5815a8f0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.134+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e580c8cc0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.135+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e581f65e0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.136+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e50011790 con 0x7f2e5815a8f0 2024-09-13T17:16:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.136+0000 7f2e567fc640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 0x7f2e4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.136+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e50089060 con 0x7f2e5815a8f0 2024-09-13T17:16:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.137+0000 7f2e5d865640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 0x7f2e4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.137+0000 7f2e5d865640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 0x7f2e4406d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001560 tx=0x7f2e48001a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.141+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2e581f65e0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.312+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e581f65e0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.313+0000 7f2e567fc640 1 -- 172.21.15.5:0/3649582008 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f2e581f65e0 con 0x7f2e5815a8f0 2024-09-13T17:16:42.314 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:42.315 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:13.973468+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:16:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 msgr2=0x7f2e4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 0x7f2e4406d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001560 tx=0x7f2e48001a90 comp rx=0 tx=0).stop 2024-09-13T17:16:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 msgr2=0x7f2e58148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000b410 tx=0x7f2e5000b8d0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 shutdown_connections 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2e4406ac00 0x7f2e4406d0c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e5815a8f0 0x7f2e58148b40 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e58159500 0x7f2e581f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 --2- 172.21.15.5:0/3649582008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e580ca8e0 0x7f2e581546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 >> 172.21.15.5:0/3649582008 conn(0x7f2e580b01d0 msgr2=0x7f2e58156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 shutdown_connections 2024-09-13T17:16:42.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.315+0000 7f2e5fac9640 1 -- 172.21.15.5:0/3649582008 wait complete. 2024-09-13T17:16:42.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:16:42.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:16:42.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.431+0000 7f5cb7195640 1 Processor -- start 2024-09-13T17:16:42.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.431+0000 7f5cb7195640 1 -- start start 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb7195640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb0159500 0x7f5cb00cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb7195640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 0x7f5cb00cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb7195640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00cb3e0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb7195640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb006dd80 con 0x7f5cb0159500 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb7195640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00cde30 con 0x7f5cb00ca8e0 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb0159500 0x7f5cb00cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb0159500 0x7f5cb00cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35834/0 (socket says 172.21.15.5:35834) 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 -- 172.21.15.5:0/3500770572 learned_addr learned my addr 172.21.15.5:0/3500770572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5ca7fff640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 0x7f5cb00cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 -- 172.21.15.5:0/3500770572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 msgr2=0x7f5cb00cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 0x7f5cb00cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 -- 172.21.15.5:0/3500770572 >> v1:172.21.15.179:6789/0 conn(0x7f5cb00b0cc0 legacy=0x7f5cb01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5cb4f31640 1 -- 172.21.15.5:0/3500770572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00cb100 con 0x7f5cb0159500 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.432+0000 7f5ca7fff640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 0x7f5cb00cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.433+0000 7f5cb4f31640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0159500 0x7f5cb00cd3b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009870 tx=0x7f5cac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddca6b3eb167b134 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.433+0000 7f5ca77fe640 1 -- 172.21.15.5:0/3500770572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac02ae90 con 0x7f5cb0159500 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.433+0000 7f5ca77fe640 1 -- 172.21.15.5:0/3500770572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac032440 con 0x7f5cb0159500 2024-09-13T17:16:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.433+0000 7f5ca77fe640 1 -- 172.21.15.5:0/3500770572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0327d0 con 0x7f5cb0159500 2024-09-13T17:16:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 -- 172.21.15.5:0/3500770572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0159500 msgr2=0x7f5cb00cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0159500 0x7f5cb00cd3b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009870 tx=0x7f5cac02a180 comp rx=0 tx=0).stop 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 -- 172.21.15.5:0/3500770572 shutdown_connections 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb00ca8e0 0x7f5cb00cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 --2- 172.21.15.5:0/3500770572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0159500 0x7f5cb00cd3b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 -- 172.21.15.5:0/3500770572 >> 172.21.15.5:0/3500770572 conn(0x7f5cb00b01d0 msgr2=0x7f5cb00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 -- 172.21.15.5:0/3500770572 shutdown_connections 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.434+0000 7f5cb7195640 1 -- 172.21.15.5:0/3500770572 wait complete. 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.435+0000 7f5cb7195640 1 Processor -- start 2024-09-13T17:16:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.435+0000 7f5cb7195640 1 -- start start 2024-09-13T17:16:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb00ca8e0 0x7f5cb0151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb0159500 0x7f5cb00a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f2cc0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f57d0 con 0x7f5cb00ca8e0 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb7195640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f5ab0 con 0x7f5cb0159500 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35848/0 (socket says 172.21.15.5:35848) 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 -- 172.21.15.5:0/2071311290 learned_addr learned my addr 172.21.15.5:0/2071311290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5ca7fff640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb00ca8e0 0x7f5cb0151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb5732640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb0159500 0x7f5cb00a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 -- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb0159500 msgr2=0x7f5cb00a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb0159500 0x7f5cb00a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 -- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb00ca8e0 msgr2=0x7f5cb0151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb00ca8e0 0x7f5cb0151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.436+0000 7f5cb4f31640 1 -- 172.21.15.5:0/2071311290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0094d0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5cb4f31640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac030b80 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac030d00 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac03d680 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb01f5d90 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.437+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb01521c0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.438+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb01f5bf0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.438+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5cac039040 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.439+0000 7f5ca57fa640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 0x7f5c9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.439+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5cac0aa040 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.439+0000 7f5ca7fff640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 0x7f5c9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.440+0000 7f5ca7fff640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 0x7f5c9c06d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00cb7e0 tx=0x7f5ca0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.443+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5cb01f5bf0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.615+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cb01f5bf0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.615+0000 7f5ca57fa640 1 -- 172.21.15.5:0/2071311290 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cb01f5bf0 con 0x7f5cb00b0cc0 2024-09-13T17:16:42.616 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 msgr2=0x7f5c9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 0x7f5c9c06d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00cb7e0 tx=0x7f5ca0008040 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 msgr2=0x7f5cb01f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac0046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 shutdown_connections 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb0159500 0x7f5cb00a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb00ca8e0 0x7f5cb0151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5c9c06ac00 0x7f5c9c06d0c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 --2- 172.21.15.5:0/2071311290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb00b0cc0 0x7f5cb01f2780 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 >> 172.21.15.5:0/2071311290 conn(0x7f5cb00b01d0 msgr2=0x7f5cb01585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 shutdown_connections 2024-09-13T17:16:42.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.617+0000 7f5cb7195640 1 -- 172.21.15.5:0/2071311290 wait complete. 2024-09-13T17:16:42.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:16:42.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:16:42.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:16:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 Processor -- start 2024-09-13T17:16:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 -- start start 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc60815c710 0x7fc6080d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080cddd0 0x7fc6080d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6080af280 con 0x7fc6080d11b0 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6080d1660 con 0x7fc60815c710 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc60df26640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60806b120 con 0x7fc6080cddd0 2024-09-13T17:16:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.774+0000 7fc6077fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc60815c710 0x7fc6080d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc60815c710 0x7fc6080d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35862/0 (socket says 172.21.15.5:35862) 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 -- 172.21.15.5:0/1427859559 learned_addr learned my addr 172.21.15.5:0/1427859559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc606ffd640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080cddd0 0x7fc6080d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 -- 172.21.15.5:0/1427859559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080cddd0 msgr2=0x7fc6080d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080cddd0 0x7fc6080d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 -- 172.21.15.5:0/1427859559 >> v1:172.21.15.179:6789/0 conn(0x7fc6080d11b0 legacy=0x7fc6080ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.775+0000 7fc6077fe640 1 -- 172.21.15.5:0/1427859559 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60806b9c0 con 0x7fc60815c710 2024-09-13T17:16:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc6077fe640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6080d0640 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80098a0 tx=0x7fc5f802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c850cc383fdf0e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc6067fc640 1 -- 172.21.15.5:0/1427859559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8032440 con 0x7fc60815c710 2024-09-13T17:16:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc6067fc640 1 -- 172.21.15.5:0/1427859559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80325a0 con 0x7fc60815c710 2024-09-13T17:16:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc6067fc640 1 -- 172.21.15.5:0/1427859559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8032930 con 0x7fc60815c710 2024-09-13T17:16:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 -- 172.21.15.5:0/1427859559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 msgr2=0x7fc6080d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6080d0640 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80098a0 tx=0x7fc5f802a290 comp rx=0 tx=0).stop 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 -- 172.21.15.5:0/1427859559 shutdown_connections 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080cddd0 0x7fc6080d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 --2- 172.21.15.5:0/1427859559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6080d0640 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 -- 172.21.15.5:0/1427859559 >> 172.21.15.5:0/1427859559 conn(0x7fc608089fc0 msgr2=0x7fc6080d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 -- 172.21.15.5:0/1427859559 shutdown_connections 2024-09-13T17:16:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.776+0000 7fc60df26640 1 -- 172.21.15.5:0/1427859559 wait complete. 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.778+0000 7fc60df26640 1 Processor -- start 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.778+0000 7fc60df26640 1 -- start start 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.778+0000 7fc60df26640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6080cddd0 0x7fc608158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080d11b0 0x7fc608156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080ca7d0 con 0x7fc60815c710 2024-09-13T17:16:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6081592e0 con 0x7fc6080cddd0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6081595c0 con 0x7fc6080d11b0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35870/0 (socket says 172.21.15.5:35870) 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 -- 172.21.15.5:0/3899389031 learned_addr learned my addr 172.21.15.5:0/3899389031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc606ffd640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080d11b0 0x7fc608156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc6077fe640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6080cddd0 0x7fc608158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 -- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080d11b0 msgr2=0x7fc608156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080d11b0 0x7fc608156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 -- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6080cddd0 msgr2=0x7fc608158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6080cddd0 0x7fc608158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 -- 172.21.15.5:0/3899389031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80094d0 con 0x7fc60815c710 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc607fff640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c7a0 tx=0x7fc60000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600003b70 con 0x7fc60815c710 2024-09-13T17:16:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600003cf0 con 0x7fc60815c710 2024-09-13T17:16:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.779+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6080ca9e0 con 0x7fc60815c710 2024-09-13T17:16:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.780+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600003ea0 con 0x7fc60815c710 2024-09-13T17:16:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.780+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc608156c40 con 0x7fc60815c710 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.780+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6080caf00 con 0x7fc60815c710 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.781+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc60000aa90 con 0x7fc60815c710 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.782+0000 7fc5effff640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.782+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6000890d0 con 0x7fc60815c710 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.782+0000 7fc6077fe640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.782+0000 7fc6077fe640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 0x7fc5f406d0f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8034000 tx=0x7fc5f802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.786+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6080caf00 con 0x7fc60815c710 2024-09-13T17:16:42.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.960+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6080caf00 con 0x7fc60815c710 2024-09-13T17:16:42.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.961+0000 7fc5effff640 1 -- 172.21.15.5:0/3899389031 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6080caf00 con 0x7fc60815c710 2024-09-13T17:16:42.962 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:16:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 msgr2=0x7fc5f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 0x7fc5f406d0f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8034000 tx=0x7fc5f802e000 comp rx=0 tx=0).stop 2024-09-13T17:16:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 msgr2=0x7fc6081f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c7a0 tx=0x7fc60000cc60 comp rx=0 tx=0).stop 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 shutdown_connections 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5f406ac30 0x7fc5f406d0f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc60815c710 0x7fc6081f1b10 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6080d11b0 0x7fc608156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 --2- 172.21.15.5:0/3899389031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6080cddd0 0x7fc608158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 >> 172.21.15.5:0/3899389031 conn(0x7fc608089fc0 msgr2=0x7fc6080b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 shutdown_connections 2024-09-13T17:16:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:42.963+0000 7fc60df26640 1 -- 172.21.15.5:0/3899389031 wait complete. 2024-09-13T17:16:42.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:16:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.078+0000 7f484acd7640 1 Processor -- start 2024-09-13T17:16:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.078+0000 7f484acd7640 1 -- start start 2024-09-13T17:16:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f484acd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f484406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f484acd7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484406e9a0 con 0x7f48440ae000 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f484acd7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484415da70 con 0x7f48440b1bb0 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f484acd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484415cac0 con 0x7f48440ae3e0 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f4848a73640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f48440ae000 0x7f4844160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32874/0 (socket says 172.21.15.5:32874) 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f4848a73640 1 -- 172.21.15.5:0/2537271337 learned_addr learned my addr 172.21.15.5:0/2537271337 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483bfff640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f484406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676956387 0 0) 0x7f484406e9a0 con 0x7f48440ae000 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003520 con 0x7f48440ae000 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 977596284 0 0) 0x7f482c003520 con 0x7f48440ae000 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 msgr2=0x7f484406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f484406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 >> v1:172.21.15.179:6789/0 conn(0x7f48440b1bb0 legacy=0x7f4844152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484415ccb0 con 0x7f48440ae000 2024-09-13T17:16:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f4840001670 con 0x7f48440ae000 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483bfff640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f484406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 >> v1:172.21.15.5:6789/0 conn(0x7f48440ae000 legacy=0x7f4844160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.079+0000 7f483b7fe640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f482c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483b7fe640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f482c003f30 0x7f482c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483b7fe640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482c004d00 0x7f482c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00ba60 con 0x7f482c004d00 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00bbd0 con 0x7f482c003f30 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00bd90 con 0x7f48440ae3e0 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482c004d00 0x7f482c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4848a73640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f482c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f483bfff640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f482c003f30 0x7f482c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 -- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 msgr2=0x7f482c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440ae3e0 0x7f482c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 -- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f482c003f30 msgr2=0x7f482c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f482c003f30 0x7f482c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.080+0000 7f4849274640 1 -- 172.21.15.5:0/2537271337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834009400 con 0x7f482c004d00 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f4849274640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482c004d00 0x7f482c005180 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f483c001e20 tx=0x7f482c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b9091a1f2693cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c02ae40 con 0x7f482c004d00 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c003970 con 0x7f482c004d00 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f483b7fe640 1 -- 172.21.15.5:0/2537271337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c003d20 con 0x7f482c004d00 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 -- 172.21.15.5:0/2537271337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482c004d00 msgr2=0x7f482c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 --2- 172.21.15.5:0/2537271337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482c004d00 0x7f482c005180 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f483c001e20 tx=0x7f482c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f4849274640 1 -- 172.21.15.5:0/2537271337 reap_dead start 2024-09-13T17:16:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 -- 172.21.15.5:0/2537271337 shutdown_connections 2024-09-13T17:16:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 -- 172.21.15.5:0/2537271337 >> 172.21.15.5:0/2537271337 conn(0x7f48440cebc0 msgr2=0x7f48440cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 -- 172.21.15.5:0/2537271337 shutdown_connections 2024-09-13T17:16:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.081+0000 7f484acd7640 1 -- 172.21.15.5:0/2537271337 wait complete. 2024-09-13T17:16:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.083+0000 7f484acd7640 1 Processor -- start 2024-09-13T17:16:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.083+0000 7f484acd7640 1 -- start start 2024-09-13T17:16:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440c5710 0x7f48440c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48440c45a0 0x7f48440c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c60d0 con 0x7f4844159cb0 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c5310 con 0x7f48440c45a0 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48441e5690 con 0x7f48440c5710 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35884/0 (socket says 172.21.15.5:35884) 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 -- 172.21.15.5:0/1768005608 learned_addr learned my addr 172.21.15.5:0/1768005608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f483bfff640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440c5710 0x7f48440c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4849274640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48440c45a0 0x7f48440c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 -- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440c5710 msgr2=0x7f48440c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440c5710 0x7f48440c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 -- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48440c45a0 msgr2=0x7f48440c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48440c45a0 0x7f48440c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 -- 172.21.15.5:0/1768005608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48441e5970 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f4848a73640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f4840001200 tx=0x7f4840007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000f940 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000fac0 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48441e5c50 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.084+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000fe70 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.085+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48440c4f90 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.086+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48441e6170 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.086+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f484001d460 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.087+0000 7f48397fa640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 0x7f483006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.087+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4840089580 con 0x7f4844159cb0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.087+0000 7f483bfff640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 0x7f483006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.087+0000 7f483bfff640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 0x7f483006d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48440c5570 tx=0x7f4834009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.091+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f48441e6170 con 0x7f4844159cb0 2024-09-13T17:16:43.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.260+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48441e6170 con 0x7f4844159cb0 2024-09-13T17:16:43.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.260+0000 7f48397fa640 1 -- 172.21.15.5:0/1768005608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48441e6170 con 0x7f4844159cb0 2024-09-13T17:16:43.262 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.262+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 msgr2=0x7f483006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.262+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 0x7f483006d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48440c5570 tx=0x7f4834009190 comp rx=0 tx=0).stop 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.262+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 msgr2=0x7f48441f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.262+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f4840001200 tx=0x7f4840007660 comp rx=0 tx=0).stop 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 shutdown_connections 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48440c45a0 0x7f48440c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48440c5710 0x7f48440c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f483006ac00 0x7f483006d0c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 --2- 172.21.15.5:0/1768005608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4844159cb0 0x7f48441f3360 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 >> 172.21.15.5:0/1768005608 conn(0x7f48440cebc0 msgr2=0x7f484406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 shutdown_connections 2024-09-13T17:16:43.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.263+0000 7f484acd7640 1 -- 172.21.15.5:0/1768005608 wait complete. 2024-09-13T17:16:43.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:16:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.376+0000 7f0768757640 1 Processor -- start 2024-09-13T17:16:43.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 -- start start 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07600ae3e0 0x7f076006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 0x7f07600b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076006e9a0 con 0x7f07600ae000 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076015cac0 con 0x7f07600ae3e0 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.377+0000 7f0768757640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600b2500 con 0x7f07600b1bb0 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0765cf2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07600ae3e0 0x7f076006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f07664f3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f07600ae000 0x7f0760160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44292/0 (socket says 172.21.15.5:44292) 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f07664f3640 1 -- 172.21.15.5:0/189172020 learned_addr learned my addr 172.21.15.5:0/189172020 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0766cf4640 1 --2- 172.21.15.5:0/189172020 >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 0x7f07600b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0765cf2640 1 -- 172.21.15.5:0/189172020 >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 msgr2=0x7f07600b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0765cf2640 1 --2- 172.21.15.5:0/189172020 >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 0x7f07600b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0765cf2640 1 -- 172.21.15.5:0/189172020 >> v1:172.21.15.5:6789/0 conn(0x7f07600ae000 legacy=0x7f0760160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0765cf2640 1 -- 172.21.15.5:0/189172020 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076015da70 con 0x7f07600ae3e0 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f07654f1640 1 -- 172.21.15.5:0/189172020 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032562122 0 0) 0x7f076006e9a0 con 0x7f07600ae000 2024-09-13T17:16:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.378+0000 7f0766cf4640 1 --2- 172.21.15.5:0/189172020 >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 0x7f07600b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f0765cf2640 1 --2- 172.21.15.5:0/189172020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076006e3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f076006cc80 tx=0x7f075002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6dd7f8ad459a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f07654f1640 1 -- 172.21.15.5:0/189172020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750032440 con 0x7f07600ae3e0 2024-09-13T17:16:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f07654f1640 1 -- 172.21.15.5:0/189172020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500325a0 con 0x7f07600ae3e0 2024-09-13T17:16:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f07654f1640 1 -- 172.21.15.5:0/189172020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750032930 con 0x7f07600ae3e0 2024-09-13T17:16:43.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f0768757640 1 -- 172.21.15.5:0/189172020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 msgr2=0x7f076006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.379+0000 7f0768757640 1 --2- 172.21.15.5:0/189172020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076006e3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f076006cc80 tx=0x7f075002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 -- 172.21.15.5:0/189172020 shutdown_connections 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 --2- 172.21.15.5:0/189172020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076006e3c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 --2- 172.21.15.5:0/189172020 >> v2:172.21.15.179:3300/0 conn(0x7f07600b1bb0 0x7f07600b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 -- 172.21.15.5:0/189172020 >> 172.21.15.5:0/189172020 conn(0x7f07600cebc0 msgr2=0x7f07600cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 -- 172.21.15.5:0/189172020 shutdown_connections 2024-09-13T17:16:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.380+0000 7f0768757640 1 -- 172.21.15.5:0/189172020 wait complete. 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 Processor -- start 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 -- start start 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07600ae000 0x7f07600b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07600b1bb0 0x7f0760145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600b05f0 con 0x7f07600ae3e0 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760158680 con 0x7f07600b1bb0 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.381+0000 7f0768757640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0760158960 con 0x7f07600ae000 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34110/0 (socket says 172.21.15.5:34110) 2024-09-13T17:16:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 -- 172.21.15.5:0/1168039470 learned_addr learned my addr 172.21.15.5:0/1168039470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 -- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07600ae000 msgr2=0x7f07600b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07600ae000 0x7f07600b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0766cf4640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07600b1bb0 0x7f0760145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 -- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07600b1bb0 msgr2=0x7f0760145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07600b1bb0 0x7f0760145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 -- 172.21.15.5:0/1168039470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750009400 con 0x7f07600ae3e0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0765cf2640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0750000c00 tx=0x7f07500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750030b80 con 0x7f07600ae3e0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750030d00 con 0x7f07600ae3e0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07600af8b0 con 0x7f07600ae3e0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075003d680 con 0x7f07600ae3e0 2024-09-13T17:16:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.382+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076015edf0 con 0x7f07600ae3e0 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.383+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07600afd70 con 0x7f07600ae3e0 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.384+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0750039040 con 0x7f07600ae3e0 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.384+0000 7f0756ffd640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 0x7f074406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.384+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07500a9f80 con 0x7f07600ae3e0 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.384+0000 7f07664f3640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 0x7f074406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.385+0000 7f07664f3640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 0x7f074406d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f075c007fd0 tx=0x7f075c007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.388+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f07500dd9c0 con 0x7f07600ae3e0 2024-09-13T17:16:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.575+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f076006e3c0 con 0x7f07600ae3e0 2024-09-13T17:16:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.576+0000 7f0756ffd640 1 -- 172.21.15.5:0/1168039470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0750075160 con 0x7f07600ae3e0 2024-09-13T17:16:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:16:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 msgr2=0x7f074406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 0x7f074406d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f075c007fd0 tx=0x7f075c007920 comp rx=0 tx=0).stop 2024-09-13T17:16:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 msgr2=0x7f076015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0750000c00 tx=0x7f07500046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 shutdown_connections 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07600b1bb0 0x7f0760145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f074406ac00 0x7f074406d0c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07600ae3e0 0x7f076015e8b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 --2- 172.21.15.5:0/1168039470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07600ae000 0x7f07600b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 >> 172.21.15.5:0/1168039470 conn(0x7f07600cebc0 msgr2=0x7f0760156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 shutdown_connections 2024-09-13T17:16:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.578+0000 7f0768757640 1 -- 172.21.15.5:0/1168039470 wait complete. 2024-09-13T17:16:43.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:16:43.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:43.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:43.619 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[45731]: fuse finished with error 0 and tester_r 0 2024-09-13T17:16:43.621 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:16:43.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:16:43.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:43.655 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:16:43.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:16:43.716 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:16:43.758 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:16:43.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:16:43.760 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:16:43.761 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.762 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:16:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:16:43.764 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:16:43.766 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:16:43.767 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:16:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:16:43.769 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:16:43.770 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:16:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-09-13T17:16:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: client_metadata = root=/baz 2024-09-13T17:16:43.801 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:16:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:16:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:16:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:16:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:16:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:16:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:16:43.805 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:16:43.806 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:43.807 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:16:43.808 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:16:43.809 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:16:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:16:43.811 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:16:43.812 INFO:teuthology.orchestra.run.smithi179.stdout: keyring = /etc/ceph/ceph.client.badguy.keyring 2024-09-13T17:16:43.813 INFO:teuthology.orchestra.run.smithi179.stdout: client_metadata = root=/baz 2024-09-13T17:16:43.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-13T17:16:43.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:16:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.916+0000 7fb1f142b640 1 Processor -- start 2024-09-13T17:16:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.916+0000 7fb1f142b640 1 -- start start 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1f142b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1ec0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1f142b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0b2710 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1f142b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec06ee90 con 0x7fb1ec06a520 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1f142b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec06f170 con 0x7fb1ec15c5f0 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1ea7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1ec15c9d0 0x7fb1ec069e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44296/0 (socket says 172.21.15.5:44296) 2024-09-13T17:16:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1ea7fc640 1 -- 172.21.15.5:0/890980403 learned_addr learned my addr 172.21.15.5:0/890980403 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1ec0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775397849 0 0) 0x7fb1ec0b2710 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d4003520 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059659114 0 0) 0x7fb1d4003520 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 msgr2=0x7fb1ec0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1ec0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 >> v1:172.21.15.179:6789/0 conn(0x7fb1ec06a520 legacy=0x7fb1ec06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0b29f0 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb1e0001670 con 0x7fb1ec15c9d0 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 >> v1:172.21.15.5:6789/0 conn(0x7fb1ec15c9d0 legacy=0x7fb1ec069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d40039a0 0x7fb1d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d40047c0 0x7fb1d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec06f170 con 0x7fb1d40039a0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d400bab0 con 0x7fb1d40047c0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.917+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d400bc70 con 0x7fb1ec15c5f0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d40039a0 0x7fb1d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1ea7fc640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d40047c0 0x7fb1d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eb7fe640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 -- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 msgr2=0x7fb1d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1ec15c5f0 0x7fb1d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 -- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d40047c0 msgr2=0x7fb1d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d40047c0 0x7fb1d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1eaffd640 1 -- 172.21.15.5:0/890980403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4003520 con 0x7fb1d40039a0 2024-09-13T17:16:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.918+0000 7fb1ea7fc640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d40047c0 0x7fb1d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d40039a0 0x7fb1d4003d80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ac0 tx=0x7fb1d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265f96ac01bc3c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc031400 con 0x7fb1d40039a0 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc02d050 con 0x7fb1d40039a0 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1e9ffb640 1 -- 172.21.15.5:0/890980403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc031780 con 0x7fb1d40039a0 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 -- 172.21.15.5:0/890980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d40039a0 msgr2=0x7fb1d4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 --2- 172.21.15.5:0/890980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d40039a0 0x7fb1d4003d80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ac0 tx=0x7fb1d40057f0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1eb7fe640 1 -- 172.21.15.5:0/890980403 reap_dead start 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 -- 172.21.15.5:0/890980403 shutdown_connections 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 -- 172.21.15.5:0/890980403 >> 172.21.15.5:0/890980403 conn(0x7fb1ec098a40 msgr2=0x7fb1ec0b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 -- 172.21.15.5:0/890980403 shutdown_connections 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.919+0000 7fb1f142b640 1 -- 172.21.15.5:0/890980403 wait complete. 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.921+0000 7fb1f142b640 1 Processor -- start 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.921+0000 7fb1f142b640 1 -- start start 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d40039a0 0x7fb1ec0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 0x7fb1ec152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec152510 con 0x7fb1ec152e70 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec151890 con 0x7fb1ec153c60 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1f142b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec151b70 con 0x7fb1d40039a0 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1ea7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 0x7fb1ec152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34124/0 (socket says 172.21.15.5:34124) 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eaffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d40039a0 0x7fb1ec0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 -- 172.21.15.5:0/4176090377 learned_addr learned my addr 172.21.15.5:0/4176090377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 -- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d40039a0 msgr2=0x7fb1ec0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d40039a0 0x7fb1ec0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 -- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 msgr2=0x7fb1ec152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 0x7fb1ec152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 -- 172.21.15.5:0/4176090377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec151e50 con 0x7fb1ec152e70 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1ea7fc640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 0x7fb1ec152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.922+0000 7fb1eb7fe640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec06aec0 tx=0x7fb1e400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.923+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4003b80 con 0x7fb1ec152e70 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.923+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4003d00 con 0x7fb1ec152e70 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.923+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4005310 con 0x7fb1ec152e70 2024-09-13T17:16:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.923+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec152130 con 0x7fb1ec152e70 2024-09-13T17:16:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.923+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec0b1cc0 con 0x7fb1ec152e70 2024-09-13T17:16:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.924+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec067330 con 0x7fb1ec152e70 2024-09-13T17:16:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.925+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1e4005470 con 0x7fb1ec152e70 2024-09-13T17:16:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.925+0000 7fb1d37fe640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 0x7fb1d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.925+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1e4089440 con 0x7fb1ec152e70 2024-09-13T17:16:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.926+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 0x7fb1d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.926+0000 7fb1eaffd640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 0x7fb1d806d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc033000 tx=0x7fb1dc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.930+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb1e4054620 con 0x7fb1ec152e70 2024-09-13T17:16:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.939+0000 7fec5495a640 1 Processor -- start 2024-09-13T17:16:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.939+0000 7fec5495a640 1 -- start start 2024-09-13T17:16:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec5495a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 0x7fec50167450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec5495a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec500d09d0 con 0x7fec5015c790 2024-09-13T17:16:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec5495a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec500cdd20 con 0x7fec5006af60 2024-09-13T17:16:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec5495a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec500ce000 con 0x7fec500cf730 2024-09-13T17:16:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec4e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec5015c790 0x7fec500cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44302/0 (socket says 172.21.15.5:44302) 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.940+0000 7fec4e59c640 1 -- 172.21.15.5:0/1054081633 learned_addr learned my addr 172.21.15.5:0/1054081633 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4ed9d640 1 --2- 172.21.15.5:0/1054081633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 0x7fec50167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505034528 0 0) 0x7fec500d09d0 con 0x7fec5015c790 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec3c003520 con 0x7fec5015c790 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074486348 0 0) 0x7fec500cdd20 con 0x7fec5006af60 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec500d09d0 con 0x7fec5006af60 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4ed9d640 1 -- 172.21.15.5:0/1054081633 >> v1:172.21.15.179:6789/0 conn(0x7fec5006af60 legacy=0x7fec500cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4ed9d640 1 -- 172.21.15.5:0/1054081633 >> v1:172.21.15.5:6789/0 conn(0x7fec5015c790 legacy=0x7fec500cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460288216 0 0) 0x7fec3c003520 con 0x7fec5015c790 2024-09-13T17:16:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.941+0000 7fec4ed9d640 1 -- 172.21.15.5:0/1054081633 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec500ce2e0 con 0x7fec500cf730 2024-09-13T17:16:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.942+0000 7fec4ed9d640 1 --2- 172.21.15.5:0/1054081633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 0x7fec50167450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec500d0bc0 tx=0x7fec4802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9ac3fb7708c561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.942+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40001670 con 0x7fec500cf730 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.942+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4802d050 con 0x7fec500cf730 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.942+0000 7fec4d59a640 1 -- 172.21.15.5:0/1054081633 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48007760 con 0x7fec500cf730 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 -- 172.21.15.5:0/1054081633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 msgr2=0x7fec50167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 --2- 172.21.15.5:0/1054081633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 0x7fec50167450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec500d0bc0 tx=0x7fec4802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 -- 172.21.15.5:0/1054081633 shutdown_connections 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 --2- 172.21.15.5:0/1054081633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec500cf730 0x7fec50167450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 -- 172.21.15.5:0/1054081633 >> 172.21.15.5:0/1054081633 conn(0x7fec5009ba00 msgr2=0x7fec50089fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 -- 172.21.15.5:0/1054081633 shutdown_connections 2024-09-13T17:16:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.943+0000 7fec5495a640 1 -- 172.21.15.5:0/1054081633 wait complete. 2024-09-13T17:16:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.944+0000 7fec5495a640 1 Processor -- start 2024-09-13T17:16:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.944+0000 7fec5495a640 1 -- start start 2024-09-13T17:16:43.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec5006af60 0x7fec500b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec500cf730 0x7fec50159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5015c790 0x7fec500cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec500b55b0 con 0x7fec500cf730 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec501f5a40 con 0x7fec5015c790 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec5495a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec501f5d20 con 0x7fec5006af60 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec500cf730 0x7fec50159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec500cf730 0x7fec50159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34128/0 (socket says 172.21.15.5:34128) 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 -- 172.21.15.5:0/2458450357 learned_addr learned my addr 172.21.15.5:0/2458450357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4e59c640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec5006af60 0x7fec500b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4ed9d640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5015c790 0x7fec500cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 -- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec5006af60 msgr2=0x7fec500b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec5006af60 0x7fec500b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 -- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5015c790 msgr2=0x7fec500cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec5015c790 0x7fec500cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.945+0000 7fec4dd9b640 1 -- 172.21.15.5:0/2458450357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec48009a70 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec4dd9b640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec500cf730 0x7fec50159aa0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c490 tx=0x7fec3800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec380052d0 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec38005430 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec5495a640 1 -- 172.21.15.5:0/2458450357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec500cdaf0 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38012870 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec5495a640 1 -- 172.21.15.5:0/2458450357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec501f62e0 con 0x7fec500cf730 2024-09-13T17:16:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.946+0000 7fec5495a640 1 -- 172.21.15.5:0/2458450357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fec5006c8d0 con 0x7fec500cf730 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.947+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec380129d0 con 0x7fec500cf730 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.948+0000 7fec46ffd640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec3006ac00 0x7fec3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.948+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec38089ad0 con 0x7fec500cf730 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.948+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+512 (secure 0 0 0) 0x7fec3808a290 con 0x7fec500cf730 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.948+0000 7fec4e59c640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec3006ac00 0x7fec3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:43.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.948+0000 7fec5495a640 1 -- 172.21.15.5:0/2458450357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fec5015cc50 con 0x7fec500cf730 2024-09-13T17:16:43.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:43.949+0000 7fec4e59c640 1 --2- 172.21.15.5:0/2458450357 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec3006ac00 0x7fec3006d0c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fec400011e0 tx=0x7fec40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:44.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.138+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1ec152650 con 0x7fb1ec152e70 2024-09-13T17:16:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.138+0000 7fb1d37fe640 1 -- 172.21.15.5:0/4176090377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb1ec152650 con 0x7fb1ec152e70 2024-09-13T17:16:44.141 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:16:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 msgr2=0x7fb1d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 0x7fb1d806d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc033000 tx=0x7fb1dc008030 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 msgr2=0x7fb1ec154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec06aec0 tx=0x7fb1e400ff70 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 shutdown_connections 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb1d806ac00 0x7fb1d806d0c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ec152e70 0x7fb1ec154ce0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1ec153c60 0x7fb1ec152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 --2- 172.21.15.5:0/4176090377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d40039a0 0x7fb1ec0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 >> 172.21.15.5:0/4176090377 conn(0x7fb1ec098a40 msgr2=0x7fb1ec0ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 shutdown_connections 2024-09-13T17:16:44.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:44.140+0000 7fb1f142b640 1 -- 172.21.15.5:0/4176090377 wait complete. 2024-09-13T17:16:44.153 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:16:44.153 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:16:44.153 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:16:44.153 INFO:tasks.cephfs.mount:self.client.name = client.badguy 2024-09-13T17:16:44.154 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:44.154 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:16:44.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /foo/bar 2024-09-13T17:16:44.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:16:44.154 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:44.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.154 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:16:44.171 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:16:44.172 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.173 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:16:44.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.174 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:16:44.237 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:16:44.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.239 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:16:44.296 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:16:44.296 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:16:44.296 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:16:44.296 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:16:44.296 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:16:44.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:16:44.297 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:16:44.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.385 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:16:44.401 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:16:44.401 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:16:44.401 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:16:44.466 INFO:tasks.cephfs.fuse_mount:Client client.badguy config is {} 2024-09-13T17:16:44.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:44.467 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:44.523 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:16:44.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:16:44.523 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:16:44.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:44.644 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:44.644 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:44.708 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:44.709 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:44.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.710 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:44.765 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:16:44.766 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id badguy --client_mountpoint=/foo/bar) 2024-09-13T17:16:44.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:44.833 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:44.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:44.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:16:44.888+0000 7f16b8c4b480 -1 init, newargv = 0x562c0afc6630 newargc=15 2024-09-13T17:16:44.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[46267]: starting ceph client 2024-09-13T17:16:44.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:16:44.891+0000 7f16a5ffb640 -1 client.6610 mds.0 rejected us (non-allowable root '/baz') 2024-09-13T17:16:44.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[46267]: ceph mount failed with (1) Operation not permitted 2024-09-13T17:16:44.897 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:44.898 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:44.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:44.899 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:45.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:daemon-helper: command failed with exit status 1 2024-09-13T17:16:46.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:16:46.087 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:16:46.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:16:46.154 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:16:46.155 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:16:46.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:16:46.156 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:16:46.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:16:46.213 INFO:tasks.cephfs.fuse_mount:mount command failed. 2024-09-13T17:16:46.314 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2024-09-13T17:16:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:46.466+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 7 ==== log(1 entries from seq 1 at 2024-09-13T17:16:44.891693+0000) v1 ==== 260+0+0 (secure 0 0 0) 0x7fec38058f20 con 0x7fec500cf730 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: cluster: 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: id: 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: health: HEALTH_OK 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: services: 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: mgr: x(active, since 3m), standbys: y 2024-09-13T17:16:46.469 INFO:teuthology.orchestra.run.smithi005.stdout: mds: 1/1 daemons up, 3 standby 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: data: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: volumes: 1/1 healthy 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: pools: 3 pools, 97 pgs 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: objects: 25 objects, 596 KiB 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: usage: 235 MiB used, 720 GiB / 720 GiB avail 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: pgs: 97 active+clean 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: io: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: client: 85 B/s rd, 2.0 KiB/s wr, 0 op/s rd, 1 op/s wr 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:16:46.470 INFO:teuthology.orchestra.run.smithi005.stdout:2024-09-13T17:16:44.891693+0000 mds.c [WRN] client session with non-allowable root '/baz' denied (client.6610 192.168.0.1:0/471335118) 2024-09-13T17:16:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:56.489+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 8 ==== log(10 entries from seq 122 at 2024-09-13T17:16:56.400770+0000) v1 ==== 2752+0+0 (secure 0 0 0) 0x7fec38058820 con 0x7fec500cf730 2024-09-13T17:16:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:16:57.496+0000 7fec46ffd640 1 -- 172.21.15.5:0/2458450357 <== mon.0 v2:172.21.15.5:3300/0 9 ==== log(5 entries from seq 705 at 2024-09-13T17:16:56.484886+0000) v1 ==== 1340+0+0 (secure 0 0 0) 0x7fec38055000 con 0x7fec500cf730 2024-09-13T17:17:01.329 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:17:01.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:01.412 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:01.458 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:17:01.459 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:01.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:01.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:01.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:17:01.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:01.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:17:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T17:17:01.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:01.537 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:01.537 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:01.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:01.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:17:01.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:01.557 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:17:01.615 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:01.615 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:01.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:01.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:17:01.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:01.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:17:01.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:01.692 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:17:01.692 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:01.693 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:01.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:01.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:17:01.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:01.711 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:17:01.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:01.769 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:17:01.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.879+0000 7f69dfa48640 1 Processor -- start 2024-09-13T17:17:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.880+0000 7f69dfa48640 1 -- start start 2024-09-13T17:17:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dfa48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d80cdd70 0x7f69d80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dfa48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d8160390 0x7f69d8160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dfa48640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d8160d40 con 0x7f69d815c930 2024-09-13T17:17:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dfa48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d80d1490 con 0x7f69d8160390 2024-09-13T17:17:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dfa48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d815cd10 con 0x7f69d80cdd70 2024-09-13T17:17:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d8160390 0x7f69d8160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d8160390 0x7f69d8160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33014/0 (socket says 172.21.15.5:33014) 2024-09-13T17:17:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 -- 172.21.15.5:0/2797401229 learned_addr learned my addr 172.21.15.5:0/2797401229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69dcfe3640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d80cdd70 0x7f69d80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 -- 172.21.15.5:0/2797401229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d80cdd70 msgr2=0x7f69d80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d80cdd70 0x7f69d80b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 -- 172.21.15.5:0/2797401229 >> v1:172.21.15.179:6789/0 conn(0x7f69d815c930 legacy=0x7f69d80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.881+0000 7f69ddfe5640 1 -- 172.21.15.5:0/2797401229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80cd350 con 0x7f69d8160390 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.882+0000 7f69ddfe5640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d8160390 0x7f69d8160800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009e50 tx=0x7f69d002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec4d79f5f3fc37a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.882+0000 7f69cffff640 1 -- 172.21.15.5:0/2797401229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0031600 con 0x7f69d8160390 2024-09-13T17:17:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.882+0000 7f69cffff640 1 -- 172.21.15.5:0/2797401229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d002d050 con 0x7f69d8160390 2024-09-13T17:17:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.882+0000 7f69cffff640 1 -- 172.21.15.5:0/2797401229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0031980 con 0x7f69d8160390 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 -- 172.21.15.5:0/2797401229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d8160390 msgr2=0x7f69d8160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d8160390 0x7f69d8160800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009e50 tx=0x7f69d002a630 comp rx=0 tx=0).stop 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 -- 172.21.15.5:0/2797401229 shutdown_connections 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d8160390 0x7f69d8160800 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 --2- 172.21.15.5:0/2797401229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d80cdd70 0x7f69d80b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 -- 172.21.15.5:0/2797401229 >> 172.21.15.5:0/2797401229 conn(0x7f69d8071540 msgr2=0x7f69d8071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 -- 172.21.15.5:0/2797401229 shutdown_connections 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.883+0000 7f69dfa48640 1 -- 172.21.15.5:0/2797401229 wait complete. 2024-09-13T17:17:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.884+0000 7f69dfa48640 1 Processor -- start 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.884+0000 7f69dfa48640 1 -- start start 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d815c930 0x7f69d8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 0x7f69d815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d815d5e0 con 0x7f69d80cdd70 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d815fff0 con 0x7f69d8160390 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dfa48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8158910 con 0x7f69d815c930 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33030/0 (socket says 172.21.15.5:33030) 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 -- 172.21.15.5:0/3547001808 learned_addr learned my addr 172.21.15.5:0/3547001808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69ddfe5640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 0x7f69d815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dcfe3640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d815c930 0x7f69d8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 -- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d815c930 msgr2=0x7f69d8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d815c930 0x7f69d8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 -- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 msgr2=0x7f69d815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 0x7f69d815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69dd7e4640 1 -- 172.21.15.5:0/3547001808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0009b30 con 0x7f69d80cdd70 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.885+0000 7f69ddfe5640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 0x7f69d815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69dd7e4640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c430 tx=0x7f69d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4011790 con 0x7f69d80cdd70 2024-09-13T17:17:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d40118f0 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d8158350 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4011ca0 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.886+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d8155c60 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.887+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d815d720 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.887+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69d401c460 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.888+0000 7f69cdffb640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 0x7f69bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.888+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f69d4089330 con 0x7f69d80cdd70 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.888+0000 7f69dcfe3640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 0x7f69bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.889+0000 7f69dcfe3640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 0x7f69bc06d0c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f69d81f5410 tx=0x7f69c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:01.892+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f69d815d720 con 0x7f69d80cdd70 2024-09-13T17:17:02.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.098+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69d815d720 con 0x7f69d80cdd70 2024-09-13T17:17:02.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.098+0000 7f69cdffb640 1 -- 172.21.15.5:0/3547001808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f69d40543d0 con 0x7f69d80cdd70 2024-09-13T17:17:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:02.101 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:17:02.102 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:17:02.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 msgr2=0x7f69bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 0x7f69bc06d0c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f69d81f5410 tx=0x7f69c8008040 comp rx=0 tx=0).stop 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 msgr2=0x7f69d81555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c430 tx=0x7f69d400c8f0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 shutdown_connections 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69d8160390 0x7f69d815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69d815c930 0x7f69d8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f69bc06ac00 0x7f69bc06d0c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 --2- 172.21.15.5:0/3547001808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d80cdd70 0x7f69d81555d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 >> 172.21.15.5:0/3547001808 conn(0x7f69d8071540 msgr2=0x7f69d80d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 shutdown_connections 2024-09-13T17:17:02.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.100+0000 7f69dfa48640 1 -- 172.21.15.5:0/3547001808 wait complete. 2024-09-13T17:17:02.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:02.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.213+0000 7f4c87d83640 1 Processor -- start 2024-09-13T17:17:02.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 -- start start 2024-09-13T17:17:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 0x7f4c8015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c800b4280 0x7f4c80069e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8015d0d0 con 0x7f4c800b46c0 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c800b1040 con 0x7f4c800b4280 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.214+0000 7f4c87d83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8015deb0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c8531e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c800b4280 0x7f4c80069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c85b1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 0x7f4c8015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c86320640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c800b46c0 0x7f4c801604d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:51906/0 (socket says 172.21.15.5:51906) 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c86320640 1 -- 172.21.15.5:0/925754055 learned_addr learned my addr 172.21.15.5:0/925754055 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c8531e640 1 -- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 msgr2=0x7f4c8015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c8531e640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 0x7f4c8015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c8531e640 1 -- 172.21.15.5:0/925754055 >> v1:172.21.15.179:6789/0 conn(0x7f4c800b46c0 legacy=0x7f4c801604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c8531e640 1 -- 172.21.15.5:0/925754055 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8015d330 con 0x7f4c800b4280 2024-09-13T17:17:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.215+0000 7f4c85b1f640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 0x7f4c8015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.216+0000 7f4c8531e640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b4280 0x7f4c80069e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c700097a0 tx=0x7f4c7002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3137fb6f5fd97284 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.216+0000 7f4c84b1d640 1 -- 172.21.15.5:0/925754055 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7002adb0 con 0x7f4c800b4280 2024-09-13T17:17:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.216+0000 7f4c84b1d640 1 -- 172.21.15.5:0/925754055 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70032440 con 0x7f4c800b4280 2024-09-13T17:17:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.216+0000 7f4c84b1d640 1 -- 172.21.15.5:0/925754055 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700327d0 con 0x7f4c800b4280 2024-09-13T17:17:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 -- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b4280 msgr2=0x7f4c80069e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b4280 0x7f4c80069e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c700097a0 tx=0x7f4c7002a060 comp rx=0 tx=0).stop 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 -- 172.21.15.5:0/925754055 shutdown_connections 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b4280 0x7f4c80069e10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 --2- 172.21.15.5:0/925754055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c8015c7b0 0x7f4c8015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 -- 172.21.15.5:0/925754055 >> 172.21.15.5:0/925754055 conn(0x7f4c800b4be0 msgr2=0x7f4c80098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 -- 172.21.15.5:0/925754055 shutdown_connections 2024-09-13T17:17:02.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.217+0000 7f4c87d83640 1 -- 172.21.15.5:0/925754055 wait complete. 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.218+0000 7f4c87d83640 1 Processor -- start 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.218+0000 7f4c87d83640 1 -- start start 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c800b4280 0x7f4c80140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b46c0 0x7f4c80153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80157220 con 0x7f4c8015c7b0 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801568c0 con 0x7f4c800b46c0 2024-09-13T17:17:02.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c87d83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80156b60 con 0x7f4c800b4280 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33036/0 (socket says 172.21.15.5:33036) 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 -- 172.21.15.5:0/3056210682 learned_addr learned my addr 172.21.15.5:0/3056210682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c85b1f640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c800b4280 0x7f4c80140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c8531e640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b46c0 0x7f4c80153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 -- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c800b4280 msgr2=0x7f4c80140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c800b4280 0x7f4c80140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 -- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b46c0 msgr2=0x7f4c80153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b46c0 0x7f4c80153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 -- 172.21.15.5:0/3056210682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009400 con 0x7f4c8015c7b0 2024-09-13T17:17:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c86320640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800cae0 tx=0x7f4c7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.219+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800ac40 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.220+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800ada0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.220+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c70009400 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.220+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78012620 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.220+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c80153b50 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.221+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c80157360 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.221+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4c78007070 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.222+0000 7f4c767fc640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 0x7f4c6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.222+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f4c780893e0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.222+0000 7f4c85b1f640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 0x7f4c6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.222+0000 7f4c85b1f640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 0x7f4c6406d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009c30 tx=0x7f4c7c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.226+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4c780544a0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.397+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c800660c0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.398+0000 7f4c767fc640 1 -- 172.21.15.5:0/3056210682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16919 (secure 0 0 0) 0x7f4c78057ac0 con 0x7f4c8015c7b0 2024-09-13T17:17:02.400 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:02.400 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:57.482150+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:02.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 msgr2=0x7f4c6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 0x7f4c6406d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009c30 tx=0x7f4c7c009190 comp rx=0 tx=0).stop 2024-09-13T17:17:02.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 msgr2=0x7f4c80150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800cae0 tx=0x7f4c7800a060 comp rx=0 tx=0).stop 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 shutdown_connections 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4c6406ac00 0x7f4c6406d0c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c8015c7b0 0x7f4c80150850 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c800b46c0 0x7f4c80153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 --2- 172.21.15.5:0/3056210682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c800b4280 0x7f4c80140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 >> 172.21.15.5:0/3056210682 conn(0x7f4c800b4be0 msgr2=0x7f4c8015efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 shutdown_connections 2024-09-13T17:17:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.400+0000 7f4c87d83640 1 -- 172.21.15.5:0/3056210682 wait complete. 2024-09-13T17:17:02.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:16:11.142325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:16:11.882203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:02.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.516+0000 7fec23c80640 1 Processor -- start 2024-09-13T17:17:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.516+0000 7fec23c80640 1 -- start start 2024-09-13T17:17:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec23c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c15c910 0x7fec1c099450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec23c80640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec1c06af20 0x7fec1c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec23c80640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c15d6c0 con 0x7fec1c06b910 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec23c80640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c06b3d0 con 0x7fec1c06af20 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec23c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15cd90 con 0x7fec1c15c910 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec21a1c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec1c06b910 0x7fec1c06bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42162/0 (socket says 172.21.15.5:42162) 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec21a1c640 1 -- 172.21.15.5:0/2658749191 learned_addr learned my addr 172.21.15.5:0/2658749191 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec2221d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec1c06af20 0x7fec1c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.517+0000 7fec2121b640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c15c910 0x7fec1c099450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec2221d640 1 -- 172.21.15.5:0/2658749191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c15c910 msgr2=0x7fec1c099450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec2221d640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c15c910 0x7fec1c099450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec2221d640 1 -- 172.21.15.5:0/2658749191 >> v1:172.21.15.5:6789/0 conn(0x7fec1c06b910 legacy=0x7fec1c06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec20a1a640 1 -- 172.21.15.5:0/2658749191 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234060321 0 0) 0x7fec1c15d6c0 con 0x7fec1c06b910 2024-09-13T17:17:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec2221d640 1 -- 172.21.15.5:0/2658749191 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c15d070 con 0x7fec1c06af20 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec2221d640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06af20 0x7fec1c0ce680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fec14009d90 tx=0x7fec1402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889c38066dd5dd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec20a1a640 1 -- 172.21.15.5:0/2658749191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14031600 con 0x7fec1c06af20 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec20a1a640 1 -- 172.21.15.5:0/2658749191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1402d050 con 0x7fec1c06af20 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.518+0000 7fec20a1a640 1 -- 172.21.15.5:0/2658749191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14031980 con 0x7fec1c06af20 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 -- 172.21.15.5:0/2658749191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06af20 msgr2=0x7fec1c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06af20 0x7fec1c0ce680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fec14009d90 tx=0x7fec1402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 -- 172.21.15.5:0/2658749191 shutdown_connections 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06af20 0x7fec1c0ce680 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 --2- 172.21.15.5:0/2658749191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c15c910 0x7fec1c099450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 -- 172.21.15.5:0/2658749191 >> 172.21.15.5:0/2658749191 conn(0x7fec1c0b1f30 msgr2=0x7fec1c0b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 -- 172.21.15.5:0/2658749191 shutdown_connections 2024-09-13T17:17:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.519+0000 7fec23c80640 1 -- 172.21.15.5:0/2658749191 wait complete. 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.520+0000 7fec23c80640 1 Processor -- start 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.520+0000 7fec23c80640 1 -- start start 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c06af20 0x7fec1c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 0x7fec1c0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0ae270 con 0x7fec1c06b910 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0af410 con 0x7fec1c15c910 2024-09-13T17:17:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec23c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0adbf0 con 0x7fec1c06af20 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec2121b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec2121b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33042/0 (socket says 172.21.15.5:33042) 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.521+0000 7fec2121b640 1 -- 172.21.15.5:0/1647676385 learned_addr learned my addr 172.21.15.5:0/1647676385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2221d640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 0x7fec1c0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec21a1c640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c06af20 0x7fec1c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 -- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c06af20 msgr2=0x7fec1c1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c06af20 0x7fec1c1547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 -- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 msgr2=0x7fec1c0c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 0x7fec1c0c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 -- 172.21.15.5:0/1647676385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009a70 con 0x7fec1c06b910 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2221d640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 0x7fec1c0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec2121b640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e840 tx=0x7fec0c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0094f0 con 0x7fec1c06b910 2024-09-13T17:17:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00c940 con 0x7fec1c06b910 2024-09-13T17:17:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0af130 con 0x7fec1c06b910 2024-09-13T17:17:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00ccd0 con 0x7fec1c06b910 2024-09-13T17:17:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.522+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0aede0 con 0x7fec1c06b910 2024-09-13T17:17:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.523+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c067330 con 0x7fec1c06b910 2024-09-13T17:17:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.524+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec0c013470 con 0x7fec1c06b910 2024-09-13T17:17:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.524+0000 7fec127fc640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.524+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fec0c089570 con 0x7fec1c06b910 2024-09-13T17:17:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.524+0000 7fec21a1c640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.525+0000 7fec21a1c640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 0x7fec0006d0c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fec18000f60 tx=0x7fec18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.529+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec0c054610 con 0x7fec1c06b910 2024-09-13T17:17:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.697+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec1c15db30 con 0x7fec1c06b910 2024-09-13T17:17:02.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.697+0000 7fec127fc640 1 -- 172.21.15.5:0/1647676385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec1c15db30 con 0x7fec1c06b910 2024-09-13T17:17:02.699 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 msgr2=0x7fec0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 0x7fec0006d0c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fec18000f60 tx=0x7fec18009040 comp rx=0 tx=0).stop 2024-09-13T17:17:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 msgr2=0x7fec1c0ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e840 tx=0x7fec0c00ed00 comp rx=0 tx=0).stop 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 shutdown_connections 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1c15c910 0x7fec1c0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec1c06b910 0x7fec1c0ae690 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 --2- 172.21.15.5:0/1647676385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec1c06af20 0x7fec1c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 >> 172.21.15.5:0/1647676385 conn(0x7fec1c0b1f30 msgr2=0x7fec1c0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 shutdown_connections 2024-09-13T17:17:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.699+0000 7fec23c80640 1 -- 172.21.15.5:0/1647676385 wait complete. 2024-09-13T17:17:02.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.813+0000 7fe739165640 1 Processor -- start 2024-09-13T17:17:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.813+0000 7fe739165640 1 -- start start 2024-09-13T17:17:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe739165640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340cd790 0x7fe73406c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe739165640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7340c30d0 0x7fe7340c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe739165640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73406c710 con 0x7fe734159440 2024-09-13T17:17:02.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe739165640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7340cc030 con 0x7fe7340c30d0 2024-09-13T17:17:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe739165640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73406d1e0 con 0x7fe7340cd790 2024-09-13T17:17:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe73359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7340c30d0 0x7fe7340c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe73359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7340c30d0 0x7fe7340c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33044/0 (socket says 172.21.15.5:33044) 2024-09-13T17:17:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe73359e640 1 -- 172.21.15.5:0/1703574917 learned_addr learned my addr 172.21.15.5:0/1703574917 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:02.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.814+0000 7fe73259c640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340cd790 0x7fe73406c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe73359e640 1 -- 172.21.15.5:0/1703574917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340cd790 msgr2=0x7fe73406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe73359e640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340cd790 0x7fe73406c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe73359e640 1 -- 172.21.15.5:0/1703574917 >> v1:172.21.15.179:6789/0 conn(0x7fe734159440 legacy=0x7fe7340b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe73359e640 1 -- 172.21.15.5:0/1703574917 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340c3a40 con 0x7fe7340c30d0 2024-09-13T17:17:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe73359e640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340c30d0 0x7fe7340c3500 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009e50 tx=0x7fe72c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e1af6ae401d6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.815+0000 7fe731d9b640 1 -- 172.21.15.5:0/1703574917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c031600 con 0x7fe7340c30d0 2024-09-13T17:17:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe731d9b640 1 -- 172.21.15.5:0/1703574917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c02d050 con 0x7fe7340c30d0 2024-09-13T17:17:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe731d9b640 1 -- 172.21.15.5:0/1703574917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c031980 con 0x7fe7340c30d0 2024-09-13T17:17:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 -- 172.21.15.5:0/1703574917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340c30d0 msgr2=0x7fe7340c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340c30d0 0x7fe7340c3500 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009e50 tx=0x7fe72c02a5f0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 -- 172.21.15.5:0/1703574917 shutdown_connections 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340c30d0 0x7fe7340c3500 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 --2- 172.21.15.5:0/1703574917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340cd790 0x7fe73406c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 -- 172.21.15.5:0/1703574917 >> 172.21.15.5:0/1703574917 conn(0x7fe734069e10 msgr2=0x7fe73406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 -- 172.21.15.5:0/1703574917 shutdown_connections 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.816+0000 7fe739165640 1 -- 172.21.15.5:0/1703574917 wait complete. 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 Processor -- start 2024-09-13T17:17:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 -- start start 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340c30d0 0x7fe734154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe734159440 0x7fe7340abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe734152940 con 0x7fe7340cd790 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe734150910 con 0x7fe734159440 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe739165640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe734150bf0 con 0x7fe7340c30d0 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe73259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe73259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33052/0 (socket says 172.21.15.5:33052) 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.818+0000 7fe73259c640 1 -- 172.21.15.5:0/1094207474 learned_addr learned my addr 172.21.15.5:0/1094207474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73359e640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe734159440 0x7fe7340abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe732d9d640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340c30d0 0x7fe734154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 -- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340c30d0 msgr2=0x7fe734154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340c30d0 0x7fe734154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 -- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe734159440 msgr2=0x7fe7340abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe734159440 0x7fe7340abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 -- 172.21.15.5:0/1094207474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c009b30 con 0x7fe7340cd790 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe73259c640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e9b0 tx=0x7fe72800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728009670 con 0x7fe7340cd790 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800c9a0 con 0x7fe7340cd790 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe734150ed0 con 0x7fe7340cd790 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800cd50 con 0x7fe7340cd790 2024-09-13T17:17:02.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.819+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734150550 con 0x7fe7340cd790 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.820+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7340c3500 con 0x7fe7340cd790 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.821+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe728013470 con 0x7fe7340cd790 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.821+0000 7fe71b7fe640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.821+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fe728089700 con 0x7fe7340cd790 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.821+0000 7fe732d9d640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.822+0000 7fe732d9d640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 0x7fe72006d0c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe724000f60 tx=0x7fe724009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.825+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe7280547c0 con 0x7fe7340cd790 2024-09-13T17:17:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.995+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe734151060 con 0x7fe7340cd790 2024-09-13T17:17:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.996+0000 7fe71b7fe640 1 -- 172.21.15.5:0/1094207474 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe728057de0 con 0x7fe7340cd790 2024-09-13T17:17:02.998 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 msgr2=0x7fe72006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 0x7fe72006d0c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe724000f60 tx=0x7fe724009040 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 msgr2=0x7fe7340adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e9b0 tx=0x7fe72800ee70 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 shutdown_connections 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe734159440 0x7fe7340abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe72006ac00 0x7fe72006d0c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7340cd790 0x7fe7340adf20 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 --2- 172.21.15.5:0/1094207474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7340c30d0 0x7fe734154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 >> 172.21.15.5:0/1094207474 conn(0x7fe734069e10 msgr2=0x7fe7340b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 shutdown_connections 2024-09-13T17:17:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:02.998+0000 7fe739165640 1 -- 172.21.15.5:0/1094207474 wait complete. 2024-09-13T17:17:03.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.114+0000 7f51f60c9640 1 Processor -- start 2024-09-13T17:17:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.114+0000 7f51f60c9640 1 -- start start 2024-09-13T17:17:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.114+0000 7f51f60c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51f006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51f60c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f006c710 con 0x7f51f0159440 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51f60c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f006d1e0 con 0x7f51f00c30d0 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51f60c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00cc030 con 0x7f51f00cd790 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51f0159440 0x7f51f00b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42168/0 (socket says 172.21.15.5:42168) 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ef7fe640 1 -- 172.21.15.5:0/3898968664 learned_addr learned my addr 172.21.15.5:0/3898968664 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51eeffd640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51f006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142056199 0 0) 0x7f51f006c710 con 0x7f51f0159440 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51dc003520 con 0x7f51f0159440 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842051881 0 0) 0x7f51dc003520 con 0x7f51f0159440 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 msgr2=0x7f51f006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51f006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 >> v1:172.21.15.179:6789/0 conn(0x7f51f00c30d0 legacy=0x7f51f00cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f006c940 con 0x7f51f0159440 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f51e0001670 con 0x7f51f0159440 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 >> v1:172.21.15.5:6789/0 conn(0x7f51f0159440 legacy=0x7f51f00b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51dc003f20 0x7f51dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51dc004d00 0x7f51dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00cc030 con 0x7f51dc003f20 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc00bbc0 con 0x7f51dc004d00 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc00bd80 con 0x7f51f00cd790 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.115+0000 7f51eeffd640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51dc003f20 0x7f51dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51effff640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51dc004d00 0x7f51dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51eeffd640 1 -- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 msgr2=0x7f51dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51eeffd640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f00cd790 0x7f51dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51eeffd640 1 -- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51dc004d00 msgr2=0x7f51dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51eeffd640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51dc004d00 0x7f51dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.116+0000 7f51eeffd640 1 -- 172.21.15.5:0/3898968664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc003520 con 0x7f51dc003f20 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51eeffd640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51dc003f20 0x7f51dc0047c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009ac0 tx=0x7f51dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2229aa5e3239ff83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8031400 con 0x7f51dc003f20 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d802d050 con 0x7f51dc003f20 2024-09-13T17:17:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3898968664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8031780 con 0x7f51dc003f20 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 -- 172.21.15.5:0/3898968664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51dc003f20 msgr2=0x7f51dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 --2- 172.21.15.5:0/3898968664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51dc003f20 0x7f51dc0047c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009ac0 tx=0x7f51dc0057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51effff640 1 -- 172.21.15.5:0/3898968664 reap_dead start 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 -- 172.21.15.5:0/3898968664 shutdown_connections 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 -- 172.21.15.5:0/3898968664 >> 172.21.15.5:0/3898968664 conn(0x7f51f0069e10 msgr2=0x7f51f006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 -- 172.21.15.5:0/3898968664 shutdown_connections 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.117+0000 7f51f60c9640 1 -- 172.21.15.5:0/3898968664 wait complete. 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.118+0000 7f51f60c9640 1 Processor -- start 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 -- start start 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51dc003f20 0x7f51f014e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f00c7be0 0x7f51f00977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00cb6a0 con 0x7f51f00cace0 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c7750 con 0x7f51f00c7be0 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.119+0000 7f51f60c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f014e8d0 con 0x7f51dc003f20 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33066/0 (socket says 172.21.15.5:33066) 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 -- 172.21.15.5:0/694157531 learned_addr learned my addr 172.21.15.5:0/694157531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51dc003f20 0x7f51f014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51eeffd640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f00c7be0 0x7f51f00977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 -- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51dc003f20 msgr2=0x7f51f014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51dc003f20 0x7f51f014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 -- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f00c7be0 msgr2=0x7f51f00977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f00c7be0 0x7f51f00977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 -- 172.21.15.5:0/694157531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00c68a0 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51effff640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f51f006e280 tx=0x7f51e800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8006d60 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8003970 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003d20 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00c6b40 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.120+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00c7100 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.121+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f00c78c0 con 0x7f51f00cace0 2024-09-13T17:17:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.122+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f51e8005110 con 0x7f51f00cace0 2024-09-13T17:17:03.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.122+0000 7f51e7fff640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 0x7f51d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.122+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f51e8088930 con 0x7f51f00cace0 2024-09-13T17:17:03.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.122+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 0x7f51d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.123+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 0x7f51d006d0f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51e00014c0 tx=0x7f51e0001450 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.126+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51e8053a00 con 0x7f51f00cace0 2024-09-13T17:17:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.296+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51f006c5a0 con 0x7f51f00cace0 2024-09-13T17:17:03.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.297+0000 7f51e7fff640 1 -- 172.21.15.5:0/694157531 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51e8057020 con 0x7f51f00cace0 2024-09-13T17:17:03.299 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 msgr2=0x7f51d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 0x7f51d006d0f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51e00014c0 tx=0x7f51e0001450 comp rx=0 tx=0).stop 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 msgr2=0x7f51f00cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f51f006e280 tx=0x7f51e800fd40 comp rx=0 tx=0).stop 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 shutdown_connections 2024-09-13T17:17:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d006ac30 0x7f51d006d0f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00cace0 0x7f51f00cb160 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f00c7be0 0x7f51f00977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 --2- 172.21.15.5:0/694157531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51dc003f20 0x7f51f014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 >> 172.21.15.5:0/694157531 conn(0x7f51f0069e10 msgr2=0x7f51f00b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 shutdown_connections 2024-09-13T17:17:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.299+0000 7f51f60c9640 1 -- 172.21.15.5:0/694157531 wait complete. 2024-09-13T17:17:03.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.411+0000 7f111adae640 1 Processor -- start 2024-09-13T17:17:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.411+0000 7f111adae640 1 -- start start 2024-09-13T17:17:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.412+0000 7f111adae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.412+0000 7f111adae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f111415a3e0 0x7f11140ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.412+0000 7f111adae640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140707c0 con 0x7f111415a000 2024-09-13T17:17:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.412+0000 7f111adae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1114071140 con 0x7f111415a3e0 2024-09-13T17:17:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.412+0000 7f111adae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140ad000 con 0x7f11140b35c0 2024-09-13T17:17:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f111934b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f111415a3e0 0x7f11140ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1118b4a640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f111415a000 0x7f11140b2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:54066/0 (socket says 172.21.15.5:54066) 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1118b4a640 1 -- 172.21.15.5:0/2090806244 learned_addr learned my addr 172.21.15.5:0/2090806244 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:46342/0 (socket says 172.21.15.5:46342) 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 -- 172.21.15.5:0/2090806244 >> v2:172.21.15.179:3300/0 conn(0x7f111415a3e0 msgr2=0x7f11140ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 --2- 172.21.15.5:0/2090806244 >> v2:172.21.15.179:3300/0 conn(0x7f111415a3e0 0x7f11140ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f11137fe640 1 -- 172.21.15.5:0/2090806244 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436171136 0 0) 0x7f11140707c0 con 0x7f111415a000 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 -- 172.21.15.5:0/2090806244 >> v1:172.21.15.179:6789/0 conn(0x7f111415a000 legacy=0x7f11140b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.413+0000 7f1113fff640 1 -- 172.21.15.5:0/2090806244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1114070a80 con 0x7f11140b35c0 2024-09-13T17:17:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.414+0000 7f1113fff640 1 --2- 172.21.15.5:0/2090806244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0097a0 tx=0x7f10fc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb60d823d89c4783 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.414+0000 7f11137fe640 1 -- 172.21.15.5:0/2090806244 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc02ae50 con 0x7f11140b35c0 2024-09-13T17:17:03.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.414+0000 7f11137fe640 1 -- 172.21.15.5:0/2090806244 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc032440 con 0x7f11140b35c0 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.414+0000 7f11137fe640 1 -- 172.21.15.5:0/2090806244 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0327d0 con 0x7f11140b35c0 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 -- 172.21.15.5:0/2090806244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 msgr2=0x7f1114071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 --2- 172.21.15.5:0/2090806244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0097a0 tx=0x7f10fc02a100 comp rx=0 tx=0).stop 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 -- 172.21.15.5:0/2090806244 shutdown_connections 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 --2- 172.21.15.5:0/2090806244 >> v2:172.21.15.179:3300/0 conn(0x7f111415a3e0 0x7f11140ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 --2- 172.21.15.5:0/2090806244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11140b35c0 0x7f1114071560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 -- 172.21.15.5:0/2090806244 >> 172.21.15.5:0/2090806244 conn(0x7f11140ce820 msgr2=0x7f11140cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 -- 172.21.15.5:0/2090806244 shutdown_connections 2024-09-13T17:17:03.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.415+0000 7f111adae640 1 -- 172.21.15.5:0/2090806244 wait complete. 2024-09-13T17:17:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.416+0000 7f111adae640 1 Processor -- start 2024-09-13T17:17:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.416+0000 7f111adae640 1 -- start start 2024-09-13T17:17:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415a000 0x7f1114143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f111415a3e0 0x7f1114146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114153d00 con 0x7f11140b35c0 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114155f40 con 0x7f111415a000 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111adae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114155970 con 0x7f111415a3e0 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58232/0 (socket says 172.21.15.5:58232) 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 -- 172.21.15.5:0/2959643262 learned_addr learned my addr 172.21.15.5:0/2959643262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1113fff640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415a000 0x7f1114143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f111934b640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f111415a3e0 0x7f1114146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 -- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f111415a3e0 msgr2=0x7f1114146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f111415a3e0 0x7f1114146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 -- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415a000 msgr2=0x7f1114143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415a000 0x7f1114143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 -- 172.21.15.5:0/2959643262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc009400 con 0x7f11140b35c0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.417+0000 7f1118b4a640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f110400c4d0 tx=0x7f110400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.418+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040074e0 con 0x7f11140b35c0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.418+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104007660 con 0x7f11140b35c0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.418+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104004a20 con 0x7f11140b35c0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.418+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114155c10 con 0x7f11140b35c0 2024-09-13T17:17:03.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.418+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1114153f10 con 0x7f11140b35c0 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.419+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11140ac2d0 con 0x7f11140b35c0 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.419+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1104004b80 con 0x7f11140b35c0 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.419+0000 7f11117fa640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.420+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f1104088640 con 0x7f11140b35c0 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.420+0000 7f1113fff640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.420+0000 7f1113fff640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10fc034000 tx=0x7f10fc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.424+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1104053700 con 0x7f11140b35c0 2024-09-13T17:17:03.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.631+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f111406f180 con 0x7f11140b35c0 2024-09-13T17:17:03.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.631+0000 7f11117fa640 1 -- 172.21.15.5:0/2959643262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f1104056d20 con 0x7f11140b35c0 2024-09-13T17:17:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:03.634 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:17:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 msgr2=0x7f10f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10fc034000 tx=0x7f10fc02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 msgr2=0x7f11141441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f110400c4d0 tx=0x7f110400c990 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 shutdown_connections 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f111415a3e0 0x7f1114146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f111415a000 0x7f1114143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10f406ac30 0x7f10f406d0f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 --2- 172.21.15.5:0/2959643262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11140b35c0 0x7f11141441a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 >> 172.21.15.5:0/2959643262 conn(0x7f11140ce820 msgr2=0x7f11140ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.633+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 shutdown_connections 2024-09-13T17:17:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.634+0000 7f111adae640 1 -- 172.21.15.5:0/2959643262 wait complete. 2024-09-13T17:17:03.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.746+0000 7fa13c11f640 1 Processor -- start 2024-09-13T17:17:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.746+0000 7fa13c11f640 1 -- start start 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa13c11f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa134157d80 0x7fa1340b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa13c11f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa134158160 0x7fa1340b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa13c11f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13406c060 con 0x7fa13415aa40 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa13c11f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13415b5c0 con 0x7fa134158160 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa13c11f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13415cad0 con 0x7fa134157d80 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa134158160 0x7fa1340b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa134158160 0x7fa1340b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58246/0 (socket says 172.21.15.5:58246) 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 -- 172.21.15.5:0/3743371629 learned_addr learned my addr 172.21.15.5:0/3743371629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa139ebb640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa134157d80 0x7fa1340b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 -- 172.21.15.5:0/3743371629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa134157d80 msgr2=0x7fa1340b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa134157d80 0x7fa1340b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.747+0000 7fa1396ba640 1 -- 172.21.15.5:0/3743371629 >> v1:172.21.15.179:6789/0 conn(0x7fa13415aa40 legacy=0x7fa13415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.748+0000 7fa1396ba640 1 -- 172.21.15.5:0/3743371629 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13415b7e0 con 0x7fa134158160 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.748+0000 7fa1396ba640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134158160 0x7fa1340b3da0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa128009870 tx=0x7fa12802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f050e016da32f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.748+0000 7fa138eb9640 1 -- 172.21.15.5:0/3743371629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128032440 con 0x7fa134158160 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.748+0000 7fa138eb9640 1 -- 172.21.15.5:0/3743371629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280325a0 con 0x7fa134158160 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.748+0000 7fa138eb9640 1 -- 172.21.15.5:0/3743371629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128032930 con 0x7fa134158160 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 -- 172.21.15.5:0/3743371629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134158160 msgr2=0x7fa1340b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134158160 0x7fa1340b3da0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa128009870 tx=0x7fa12802a270 comp rx=0 tx=0).stop 2024-09-13T17:17:03.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 -- 172.21.15.5:0/3743371629 shutdown_connections 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134158160 0x7fa1340b3da0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 --2- 172.21.15.5:0/3743371629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa134157d80 0x7fa1340b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 -- 172.21.15.5:0/3743371629 >> 172.21.15.5:0/3743371629 conn(0x7fa1340b0a40 msgr2=0x7fa134069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 -- 172.21.15.5:0/3743371629 shutdown_connections 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.749+0000 7fa13c11f640 1 -- 172.21.15.5:0/3743371629 wait complete. 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.750+0000 7fa13c11f640 1 Processor -- start 2024-09-13T17:17:03.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.750+0000 7fa13c11f640 1 -- start start 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa134158160 0x7fa1340a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 0x7fa1340ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341e4d80 con 0x7fa134157d80 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341e5060 con 0x7fa134158160 2024-09-13T17:17:03.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13c11f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341e5340 con 0x7fa13415aa40 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58262/0 (socket says 172.21.15.5:58262) 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 -- 172.21.15.5:0/854511831 learned_addr learned my addr 172.21.15.5:0/854511831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa1396ba640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa134158160 0x7fa1340a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13a6bc640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 0x7fa1340ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 -- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 msgr2=0x7fa1340ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 0x7fa1340ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 -- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa134158160 msgr2=0x7fa1340a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa134158160 0x7fa1340a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa139ebb640 1 -- 172.21.15.5:0/854511831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280094d0 con 0x7fa134157d80 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.751+0000 7fa13a6bc640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 0x7fa1340ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa139ebb640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa124007ef0 tx=0x7fa12400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124014620 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124014780 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124014b30 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1341e5620 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.752+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1340adb70 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.753+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13415aeb0 con 0x7fa134157d80 2024-09-13T17:17:03.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.753+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa124014c90 con 0x7fa134157d80 2024-09-13T17:17:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.754+0000 7fa1327fc640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 0x7fa12006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.754+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fa124089dd0 con 0x7fa134157d80 2024-09-13T17:17:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.754+0000 7fa1396ba640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 0x7fa12006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.755+0000 7fa1396ba640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 0x7fa12006d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa128034000 tx=0x7fa12802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.758+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa124054e70 con 0x7fa134157d80 2024-09-13T17:17:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.931+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa13415dda0 con 0x7fa134157d80 2024-09-13T17:17:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.932+0000 7fa1327fc640 1 -- 172.21.15.5:0/854511831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16919 (secure 0 0 0) 0x7fa124058490 con 0x7fa134157d80 2024-09-13T17:17:03.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:57.482150+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 msgr2=0x7fa12006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 0x7fa12006d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa128034000 tx=0x7fa12802e000 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 msgr2=0x7fa1341e46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa124007ef0 tx=0x7fa12400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 shutdown_connections 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa13415aa40 0x7fa1340ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa134158160 0x7fa1340a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa12006ac00 0x7fa12006d0c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 --2- 172.21.15.5:0/854511831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa134157d80 0x7fa1341e46f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 >> 172.21.15.5:0/854511831 conn(0x7fa1340b0a40 msgr2=0x7fa1340b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 shutdown_connections 2024-09-13T17:17:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:03.934+0000 7fa13c11f640 1 -- 172.21.15.5:0/854511831 wait complete. 2024-09-13T17:17:03.948 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:17:03.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.047+0000 7f832a357640 1 Processor -- start 2024-09-13T17:17:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.047+0000 7f832a357640 1 -- start start 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f832a357640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f832406ae20 0x7f832406b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f832a357640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 0x7f832415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f832a357640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832415dfc0 con 0x7f8324156c80 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f832a357640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832406b7f0 con 0x7f832406ae20 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f832a357640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240acbe0 con 0x7f832415e780 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.048+0000 7f831bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f832406ae20 0x7f832406b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f832406ae20 0x7f832406b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58276/0 (socket says 172.21.15.5:58276) 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 -- 172.21.15.5:0/2614982182 learned_addr learned my addr 172.21.15.5:0/2614982182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f83288f4640 1 --2- 172.21.15.5:0/2614982182 >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 0x7f832415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 -- 172.21.15.5:0/2614982182 >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 msgr2=0x7f832415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 --2- 172.21.15.5:0/2614982182 >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 0x7f832415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 -- 172.21.15.5:0/2614982182 >> v1:172.21.15.179:6789/0 conn(0x7f8324156c80 legacy=0x7f83240ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f831bfff640 1 -- 172.21.15.5:0/2614982182 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240acec0 con 0x7f832406ae20 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.049+0000 7f83288f4640 1 --2- 172.21.15.5:0/2614982182 >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 0x7f832415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f831bfff640 1 --2- 172.21.15.5:0/2614982182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832406ae20 0x7f832406b2b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f8324071ff0 tx=0x7f830c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98f0c15b68c406c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f83237fe640 1 -- 172.21.15.5:0/2614982182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c032440 con 0x7f832406ae20 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f83237fe640 1 -- 172.21.15.5:0/2614982182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c0325a0 con 0x7f832406ae20 2024-09-13T17:17:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f83237fe640 1 -- 172.21.15.5:0/2614982182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c032930 con 0x7f832406ae20 2024-09-13T17:17:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 -- 172.21.15.5:0/2614982182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832406ae20 msgr2=0x7f832406b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 --2- 172.21.15.5:0/2614982182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832406ae20 0x7f832406b2b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f8324071ff0 tx=0x7f830c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 -- 172.21.15.5:0/2614982182 shutdown_connections 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 --2- 172.21.15.5:0/2614982182 >> v2:172.21.15.179:3300/0 conn(0x7f832415e780 0x7f832415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 --2- 172.21.15.5:0/2614982182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832406ae20 0x7f832406b2b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 -- 172.21.15.5:0/2614982182 >> 172.21.15.5:0/2614982182 conn(0x7f8324070c20 msgr2=0x7f8324071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 -- 172.21.15.5:0/2614982182 shutdown_connections 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.050+0000 7f832a357640 1 -- 172.21.15.5:0/2614982182 wait complete. 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 Processor -- start 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 -- start start 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 0x7f832415f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8324156c80 0x7f83240b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83241f68f0 con 0x7f832415e780 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83241f23a0 con 0x7f8324156c80 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f832a357640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83241f5d70 con 0x7f832406ae20 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f83288f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.052+0000 7f83288f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58290/0 (socket says 172.21.15.5:58290) 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 -- 172.21.15.5:0/3453857648 learned_addr learned my addr 172.21.15.5:0/3453857648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f831bfff640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8324156c80 0x7f83240b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f8323fff640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 0x7f832415f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 -- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 msgr2=0x7f832415f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 0x7f832415f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 -- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8324156c80 msgr2=0x7f83240b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8324156c80 0x7f83240b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 -- 172.21.15.5:0/3453857648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0094d0 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f8323fff640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 0x7f832415f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83288f4640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f831c007df0 tx=0x7f831c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c003990 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00f040 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83241f6050 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c003d30 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.053+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83241f6610 con 0x7f832415e780 2024-09-13T17:17:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.054+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83240679b0 con 0x7f832415e780 2024-09-13T17:17:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.055+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f831c004030 con 0x7f832415e780 2024-09-13T17:17:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.055+0000 7f83217fa640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.055+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f831c0897b0 con 0x7f832415e780 2024-09-13T17:17:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.055+0000 7f8323fff640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.056+0000 7f8323fff640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 0x7f830406d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.060+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f831c054870 con 0x7f832415e780 2024-09-13T17:17:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.265+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83241f2510 con 0x7f832415e780 2024-09-13T17:17:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.266+0000 7f83217fa640 1 -- 172.21.15.5:0/3453857648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f83241f2510 con 0x7f832415e780 2024-09-13T17:17:04.270 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:04.270 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 msgr2=0x7f830406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 0x7f830406d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).stop 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 msgr2=0x7f83240cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f831c007df0 tx=0x7f831c00d4a0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 shutdown_connections 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f830406ac00 0x7f830406d0c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832415e780 0x7f83240cb200 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8324156c80 0x7f83240b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 --2- 172.21.15.5:0/3453857648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832406ae20 0x7f832415f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 >> 172.21.15.5:0/3453857648 conn(0x7f8324070c20 msgr2=0x7f8324160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 shutdown_connections 2024-09-13T17:17:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.268+0000 7f832a357640 1 -- 172.21.15.5:0/3453857648 wait complete. 2024-09-13T17:17:04.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.381+0000 7f1af6087640 1 Processor -- start 2024-09-13T17:17:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.381+0000 7f1af6087640 1 -- start start 2024-09-13T17:17:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 0x7f1af00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1af0160390 0x7f1af0160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00d1490 con 0x7f1af0160390 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af0160d80 con 0x7f1af00cd660 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1af6087640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af015cd10 con 0x7f1af015c930 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1af0160390 0x7f1af0160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1af0160390 0x7f1af0160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58302/0 (socket says 172.21.15.5:58302) 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 -- 172.21.15.5:0/4191867321 learned_addr learned my addr 172.21.15.5:0/4191867321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/4191867321 >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 0x7f1af00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aef7fe640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 -- 172.21.15.5:0/4191867321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 msgr2=0x7f1af00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 -- 172.21.15.5:0/4191867321 >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 msgr2=0x7f1af00cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 --2- 172.21.15.5:0/4191867321 >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 0x7f1af00cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aeffff640 1 -- 172.21.15.5:0/4191867321 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00ce000 con 0x7f1af0160390 2024-09-13T17:17:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1aef7fe640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.382+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/4191867321 >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 0x7f1af00cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.383+0000 7f1aeffff640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af0160840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1af008ac10 tx=0x7f1ae802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf09c9d47b5522c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.383+0000 7f1aeeffd640 1 -- 172.21.15.5:0/4191867321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8031600 con 0x7f1af0160390 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.383+0000 7f1aeeffd640 1 -- 172.21.15.5:0/4191867321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae802d050 con 0x7f1af0160390 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.383+0000 7f1aeeffd640 1 -- 172.21.15.5:0/4191867321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8031980 con 0x7f1af0160390 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 -- 172.21.15.5:0/4191867321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 msgr2=0x7f1af0160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af0160840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1af008ac10 tx=0x7f1ae802a610 comp rx=0 tx=0).stop 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 -- 172.21.15.5:0/4191867321 shutdown_connections 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af0160840 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 --2- 172.21.15.5:0/4191867321 >> v2:172.21.15.179:3300/0 conn(0x7f1af00cd660 0x7f1af00cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 --2- 172.21.15.5:0/4191867321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 -- 172.21.15.5:0/4191867321 >> 172.21.15.5:0/4191867321 conn(0x7f1af0071540 msgr2=0x7f1af0071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 -- 172.21.15.5:0/4191867321 shutdown_connections 2024-09-13T17:17:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.384+0000 7f1af6087640 1 -- 172.21.15.5:0/4191867321 wait complete. 2024-09-13T17:17:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.385+0000 7f1af6087640 1 Processor -- start 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.385+0000 7f1af6087640 1 -- start start 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1af00cd660 0x7f1af00d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af015d9c0 con 0x7f1af0160390 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af015dca0 con 0x7f1af00cd660 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af015eb70 con 0x7f1af015c930 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58304/0 (socket says 172.21.15.5:58304) 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 -- 172.21.15.5:0/1418658812 learned_addr learned my addr 172.21.15.5:0/1418658812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aef7fe640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1af00cd660 0x7f1af00d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 -- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 msgr2=0x7f1af01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af01553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 -- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1af00cd660 msgr2=0x7f1af00d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1af00cd660 0x7f1af00d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 -- 172.21.15.5:0/1418658812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8009b30 con 0x7f1af0160390 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1ae7fff640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aeffff640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8034040 tx=0x7f1ae8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae803b820 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae803b9a0 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af015ee50 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae803bd50 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.387+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af00d30b0 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.388+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af015e9d0 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.388+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ae8038050 con 0x7f1af0160390 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.388+0000 7f1aecff9640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 0x7f1ad006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.388+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f1ae80a9f60 con 0x7f1af0160390 2024-09-13T17:17:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.389+0000 7f1aef7fe640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 0x7f1ad006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.392+0000 7f1aef7fe640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 0x7f1ad006d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000ab60 tx=0x7f1ae0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.393+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1af015e9d0 con 0x7f1af0160390 2024-09-13T17:17:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.602+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1af015e9d0 con 0x7f1af0160390 2024-09-13T17:17:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.602+0000 7f1aecff9640 1 -- 172.21.15.5:0/1418658812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f1af015e9d0 con 0x7f1af0160390 2024-09-13T17:17:04.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:04.605 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:16:12.971543+0000","modified":"2024-09-13T17:16:14.978457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6639},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6639":{"gid":6639,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1809726047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1809726047},{"type":"v1","addr":"172.21.15.5:6835","nonce":1809726047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T17:17:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-09-13T17:17:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 msgr2=0x7f1ad006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 0x7f1ad006d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000ab60 tx=0x7f1ae0008040 comp rx=0 tx=0).stop 2024-09-13T17:17:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 msgr2=0x7f1af015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8034040 tx=0x7f1ae8004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 shutdown_connections 2024-09-13T17:17:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ad006ac00 0x7f1ad006d0c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1af0160390 0x7f1af015f370 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1af015c930 0x7f1af01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 --2- 172.21.15.5:0/1418658812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1af00cd660 0x7f1af00d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.604+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 >> 172.21.15.5:0/1418658812 conn(0x7f1af0071540 msgr2=0x7f1af00c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.605+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 shutdown_connections 2024-09-13T17:17:04.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.605+0000 7f1af6087640 1 -- 172.21.15.5:0/1418658812 wait complete. 2024-09-13T17:17:04.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 Processor -- start 2024-09-13T17:17:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 -- start start 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8240add60 0x7fb82413f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82406d170 0x7fb82406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82415ce80 con 0x7fb824159890 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240cb4b0 con 0x7fb8240add60 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.717+0000 7fb82bfbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82406db40 con 0x7fb82406d170 2024-09-13T17:17:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8240add60 0x7fb82413f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8240add60 0x7fb82413f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58316/0 (socket says 172.21.15.5:58316) 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 -- 172.21.15.5:0/1617484252 learned_addr learned my addr 172.21.15.5:0/1617484252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb82a559640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82406d170 0x7fb82406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 -- 172.21.15.5:0/1617484252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82406d170 msgr2=0x7fb82406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82406d170 0x7fb82406d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 -- 172.21.15.5:0/1617484252 >> v1:172.21.15.179:6789/0 conn(0x7fb824159890 legacy=0x7fb82413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.718+0000 7fb829d58640 1 -- 172.21.15.5:0/1617484252 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82413c610 con 0x7fb8240add60 2024-09-13T17:17:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb829d58640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8240add60 0x7fb82413f340 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb820009e50 tx=0x7fb82002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb6001e22af29aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb828d56640 1 -- 172.21.15.5:0/1617484252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820031600 con 0x7fb8240add60 2024-09-13T17:17:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb828d56640 1 -- 172.21.15.5:0/1617484252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82002d050 con 0x7fb8240add60 2024-09-13T17:17:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb828d56640 1 -- 172.21.15.5:0/1617484252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820031980 con 0x7fb8240add60 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 -- 172.21.15.5:0/1617484252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8240add60 msgr2=0x7fb82413f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8240add60 0x7fb82413f340 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb820009e50 tx=0x7fb82002a710 comp rx=0 tx=0).stop 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 -- 172.21.15.5:0/1617484252 shutdown_connections 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82406d170 0x7fb82406d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/1617484252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8240add60 0x7fb82413f340 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.719+0000 7fb82bfbc640 1 -- 172.21.15.5:0/1617484252 >> 172.21.15.5:0/1617484252 conn(0x7fb8240b0a40 msgr2=0x7fb824069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.720+0000 7fb82bfbc640 1 -- 172.21.15.5:0/1617484252 shutdown_connections 2024-09-13T17:17:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.720+0000 7fb82bfbc640 1 -- 172.21.15.5:0/1617484252 wait complete. 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.721+0000 7fb82bfbc640 1 Processor -- start 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.721+0000 7fb82bfbc640 1 -- start start 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.721+0000 7fb82bfbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8240add60 0x7fb82406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 0x7fb824138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241f3060 con 0x7fb82406d170 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241f23e0 con 0x7fb824159890 2024-09-13T17:17:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241f26c0 con 0x7fb8240add60 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58326/0 (socket says 172.21.15.5:58326) 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 -- 172.21.15.5:0/3511757118 learned_addr learned my addr 172.21.15.5:0/3511757118 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82a559640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 0x7fb824138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829557640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8240add60 0x7fb82406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 -- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8240add60 msgr2=0x7fb82406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8240add60 0x7fb82406c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 -- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 msgr2=0x7fb824138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 0x7fb824138020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 -- 172.21.15.5:0/3511757118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820009b30 con 0x7fb82406d170 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82a559640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 0x7fb824138020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb829d58640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb820000f80 tx=0x7fb820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82003d860 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82003d9c0 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8241f29a0 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82003dd70 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.722+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8241f20f0 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.723+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8241f5710 con 0x7fb82406d170 2024-09-13T17:17:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.724+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb82003b400 con 0x7fb82406d170 2024-09-13T17:17:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.724+0000 7fb81a7fc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 0x7fb80806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.724+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb8200aa4d0 con 0x7fb82406d170 2024-09-13T17:17:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.724+0000 7fb829557640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 0x7fb80806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.725+0000 7fb829557640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 0x7fb80806d0c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb82406d140 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.729+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8241f5710 con 0x7fb82406d170 2024-09-13T17:17:04.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.898+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb82415a3f0 con 0x7fb82406d170 2024-09-13T17:17:04.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.899+0000 7fb81a7fc640 1 -- 172.21.15.5:0/3511757118 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16919 (secure 0 0 0) 0x7fb8200754e0 con 0x7fb82406d170 2024-09-13T17:17:04.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:04.902 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:16:57.482150+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:16:11.142325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T17:16:11.882203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.23","mappings":[{"from":4,"to":5}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.31","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 msgr2=0x7fb80806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 0x7fb80806d0c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb82406d140 tx=0x7fb814009040 comp rx=0 tx=0).stop 2024-09-13T17:17:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 msgr2=0x7fb8240b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb820000f80 tx=0x7fb820004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 shutdown_connections 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb824159890 0x7fb824138020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8240add60 0x7fb82406c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb80806ac00 0x7fb80806d0c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 --2- 172.21.15.5:0/3511757118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb82406d170 0x7fb8240b1550 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 >> 172.21.15.5:0/3511757118 conn(0x7fb8240b0a40 msgr2=0x7fb82415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 shutdown_connections 2024-09-13T17:17:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:04.902+0000 7fb82bfbc640 1 -- 172.21.15.5:0/3511757118 wait complete. 2024-09-13T17:17:04.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:17:05.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.015+0000 7fd9f6d9d640 1 Processor -- start 2024-09-13T17:17:05.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 -- start start 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9f00d0ff0 0x7fd9f015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9f00b1510 0x7fd9f015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f00d34b0 con 0x7fd9f00d0c10 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00d2f30 con 0x7fd9f00b1510 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.016+0000 7fd9f6d9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00d31d0 con 0x7fd9f00d0ff0 2024-09-13T17:17:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9f00b1510 0x7fd9f015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f5d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9f00d0c10 0x7fd9f00cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53800/0 (socket says 172.21.15.5:53800) 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f5d9b640 1 -- 172.21.15.5:0/804649324 learned_addr learned my addr 172.21.15.5:0/804649324 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f659c640 1 -- 172.21.15.5:0/804649324 >> v2:172.21.15.179:3300/0 conn(0x7fd9f00d0ff0 msgr2=0x7fd9f015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f659c640 1 --2- 172.21.15.5:0/804649324 >> v2:172.21.15.179:3300/0 conn(0x7fd9f00d0ff0 0x7fd9f015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f659c640 1 -- 172.21.15.5:0/804649324 >> v1:172.21.15.5:6789/0 conn(0x7fd9f00d0c10 legacy=0x7fd9f00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.017+0000 7fd9f659c640 1 -- 172.21.15.5:0/804649324 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00d0260 con 0x7fd9f00b1510 2024-09-13T17:17:05.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f659c640 1 --2- 172.21.15.5:0/804649324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f015c3b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd9f008b4b0 tx=0x7fd9e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bce7b9093200c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f4d99640 1 -- 172.21.15.5:0/804649324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e802ae60 con 0x7fd9f00b1510 2024-09-13T17:17:05.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f4d99640 1 -- 172.21.15.5:0/804649324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8032440 con 0x7fd9f00b1510 2024-09-13T17:17:05.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f4d99640 1 -- 172.21.15.5:0/804649324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80327d0 con 0x7fd9f00b1510 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/804649324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 msgr2=0x7fd9f015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/804649324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f015c3b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd9f008b4b0 tx=0x7fd9e802a110 comp rx=0 tx=0).stop 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/804649324 shutdown_connections 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/804649324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f015c3b0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/804649324 >> v2:172.21.15.179:3300/0 conn(0x7fd9f00d0ff0 0x7fd9f015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/804649324 >> 172.21.15.5:0/804649324 conn(0x7fd9f0089fd0 msgr2=0x7fd9f00d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/804649324 shutdown_connections 2024-09-13T17:17:05.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.018+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/804649324 wait complete. 2024-09-13T17:17:05.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 Processor -- start 2024-09-13T17:17:05.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 -- start start 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 0x7fd9f00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 0x7fd9f006c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00b7990 con 0x7fd9f00b1510 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0152600 con 0x7fd9f00d0c10 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f6d9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01528e0 con 0x7fd9f00d0ff0 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58356/0 (socket says 172.21.15.5:58356) 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.020+0000 7fd9f5d9b640 1 -- 172.21.15.5:0/4063396618 learned_addr learned my addr 172.21.15.5:0/4063396618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f559a640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 0x7fd9f00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f659c640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 0x7fd9f006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 -- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 msgr2=0x7fd9f006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 0x7fd9f006c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 -- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 msgr2=0x7fd9f00b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 0x7fd9f00b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 -- 172.21.15.5:0/4063396618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e8009400 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f559a640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 0x7fd9f00b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f659c640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 0x7fd9f006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f5d9b640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cba0 tx=0x7fd9e000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000ad40 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0012400 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0152bc0 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000aea0 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.021+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f00b75d0 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.022+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f00cf980 con 0x7fd9f00b1510 2024-09-13T17:17:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.022+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9e0007070 con 0x7fd9f00b1510 2024-09-13T17:17:05.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.023+0000 7fd9ee7fc640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 0x7fd9dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.023+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fd9e00893b0 con 0x7fd9f00b1510 2024-09-13T17:17:05.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.023+0000 7fd9f559a640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 0x7fd9dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.024+0000 7fd9f559a640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 0x7fd9dc06d0c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9f015b0d0 tx=0x7fd9e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.027+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9e0054500 con 0x7fd9f00b1510 2024-09-13T17:17:05.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.233+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd9f00d2c70 con 0x7fd9f00b1510 2024-09-13T17:17:05.235 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:17:05.234+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:17:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.242+0000 7fd9ee7fc640 1 -- 172.21.15.5:0/4063396618 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd9e005ce60 con 0x7fd9f00b1510 2024-09-13T17:17:05.243 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 msgr2=0x7fd9dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 0x7fd9dc06d0c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9f015b0d0 tx=0x7fd9e4008040 comp rx=0 tx=0).stop 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 msgr2=0x7fd9f014e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000cba0 tx=0x7fd9e000a430 comp rx=0 tx=0).stop 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 shutdown_connections 2024-09-13T17:17:05.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00d0ff0 0x7fd9f006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0c10 0x7fd9f00b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd9dc06ac00 0x7fd9dc06d0c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 --2- 172.21.15.5:0/4063396618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9f00b1510 0x7fd9f014e720 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 >> 172.21.15.5:0/4063396618 conn(0x7fd9f0089fd0 msgr2=0x7fd9f00afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 shutdown_connections 2024-09-13T17:17:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.244+0000 7fd9f6d9d640 1 -- 172.21.15.5:0/4063396618 wait complete. 2024-09-13T17:17:05.246 INFO:tasks.ceph.mds.c.smithi005.stderr: -4312> 2024-09-13T17:16:18.802+0000 7f0f7ee9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:17:05.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:17:05.277 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:17:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.361+0000 7f45bd945640 1 Processor -- start 2024-09-13T17:17:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.361+0000 7f45bd945640 1 -- start start 2024-09-13T17:17:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45bd945640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 0x7f45b806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45bd945640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b806c710 con 0x7f45b80c30d0 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45bd945640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b806d1e0 con 0x7f45b8159440 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45bd945640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80cc030 con 0x7f45b80cd790 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45b80c30d0 0x7f45b80cc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53830/0 (socket says 172.21.15.5:53830) 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b77fe640 1 -- 172.21.15.5:0/2261695524 learned_addr learned my addr 172.21.15.5:0/2261695524 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45affff640 1 --2- 172.21.15.5:0/2261695524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 0x7f45b806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990778431 0 0) 0x7f45b806c710 con 0x7f45b80c30d0 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a4003520 con 0x7f45b80c30d0 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961255154 0 0) 0x7f45b806d1e0 con 0x7f45b8159440 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b806c710 con 0x7f45b8159440 2024-09-13T17:17:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45affff640 1 -- 172.21.15.5:0/2261695524 >> v1:172.21.15.179:6789/0 conn(0x7f45b8159440 legacy=0x7f45b80b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45affff640 1 -- 172.21.15.5:0/2261695524 >> v1:172.21.15.5:6789/0 conn(0x7f45b80c30d0 legacy=0x7f45b80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.362+0000 7f45affff640 1 -- 172.21.15.5:0/2261695524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b806c940 con 0x7f45b80cd790 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.363+0000 7f45affff640 1 --2- 172.21.15.5:0/2261695524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 0x7f45b806c1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097d0 tx=0x7f45a002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c832c6905a4c7377 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.363+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a002ae50 con 0x7f45b80cd790 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.363+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a0032440 con 0x7f45b80cd790 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.363+0000 7f45b67fc640 1 -- 172.21.15.5:0/2261695524 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00327d0 con 0x7f45b80cd790 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 -- 172.21.15.5:0/2261695524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 msgr2=0x7f45b806c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 --2- 172.21.15.5:0/2261695524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 0x7f45b806c1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097d0 tx=0x7f45a002a100 comp rx=0 tx=0).stop 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 -- 172.21.15.5:0/2261695524 shutdown_connections 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 --2- 172.21.15.5:0/2261695524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cd790 0x7f45b806c1d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 -- 172.21.15.5:0/2261695524 >> 172.21.15.5:0/2261695524 conn(0x7f45b8069e10 msgr2=0x7f45b806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 -- 172.21.15.5:0/2261695524 shutdown_connections 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.364+0000 7f45bd945640 1 -- 172.21.15.5:0/2261695524 wait complete. 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.365+0000 7f45bd945640 1 Processor -- start 2024-09-13T17:17:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.365+0000 7f45bd945640 1 -- start start 2024-09-13T17:17:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 0x7f45b80ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80cd790 0x7f45b80c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80c64f0 con 0x7f45b8159440 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80714b0 con 0x7f45b80cd790 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45bd945640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80ab680 con 0x7f45b80c30d0 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58398/0 (socket says 172.21.15.5:58398) 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 -- 172.21.15.5:0/124295324 learned_addr learned my addr 172.21.15.5:0/124295324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45affff640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80cd790 0x7f45b80c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b6ffd640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 0x7f45b80ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 -- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 msgr2=0x7f45b80ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 0x7f45b80ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 -- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80cd790 msgr2=0x7f45b80c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80cd790 0x7f45b80c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b77fe640 1 -- 172.21.15.5:0/124295324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009400 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.366+0000 7f45b6ffd640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 0x7f45b80ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45b77fe640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f45b000cc00 tx=0x7f45b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b000ce10 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0012400 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80c9f60 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0012790 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.367+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b80c6700 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.368+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80cce90 con 0x7f45b8159440 2024-09-13T17:17:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.368+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45b0007070 con 0x7f45b8159440 2024-09-13T17:17:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.369+0000 7f45b4ff9640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.369+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f45b00894b0 con 0x7f45b8159440 2024-09-13T17:17:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.369+0000 7f45b6ffd640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.370+0000 7f45b6ffd640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 0x7f459806d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f45a80011e0 tx=0x7f45a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:05.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.373+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45b00545a0 con 0x7f45b8159440 2024-09-13T17:17:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:05.583+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45b80ad590 con 0x7f45b8159440 2024-09-13T17:17:06.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.247+0000 7f45b4ff9640 1 -- 172.21.15.5:0/124295324 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45b0057bc0 con 0x7f45b8159440 2024-09-13T17:17:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 msgr2=0x7f459806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 0x7f459806d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f45a80011e0 tx=0x7f45a8009040 comp rx=0 tx=0).stop 2024-09-13T17:17:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 msgr2=0x7f45b8071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f45b000cc00 tx=0x7f45b000a430 comp rx=0 tx=0).stop 2024-09-13T17:17:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 shutdown_connections 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b8159440 0x7f45b8071a50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80cd790 0x7f45b80c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 --2- 172.21.15.5:0/124295324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80c30d0 0x7f45b80ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 >> 172.21.15.5:0/124295324 conn(0x7f45b8069e10 msgr2=0x7f45b80b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 shutdown_connections 2024-09-13T17:17:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.250+0000 7f45bd945640 1 -- 172.21.15.5:0/124295324 wait complete. 2024-09-13T17:17:06.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:17:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.412+0000 7f324ff65640 1 Processor -- start 2024-09-13T17:17:06.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324ff65640 1 -- start start 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324ff65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3248160280 0x7f32481606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324ff65640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480d0b20 con 0x7f324815c710 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324ff65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480d16c0 con 0x7f32480d31a0 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324ff65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480d35d0 con 0x7f3248160280 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324dd01640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f324815c710 0x7f32480cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53844/0 (socket says 172.21.15.5:53844) 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.413+0000 7f324dd01640 1 -- 172.21.15.5:0/2751088436 learned_addr learned my addr 172.21.15.5:0/2751088436 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473847094 0 0) 0x7f32480d0b20 con 0x7f324815c710 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3230003520 con 0x7f324815c710 2024-09-13T17:17:06.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324e502640 1 --2- 172.21.15.5:0/2751088436 >> v2:172.21.15.179:3300/0 conn(0x7f3248160280 0x7f32481606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933399632 0 0) 0x7f3230003520 con 0x7f324815c710 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 >> v2:172.21.15.179:3300/0 conn(0x7f3248160280 msgr2=0x7f32481606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 --2- 172.21.15.5:0/2751088436 >> v2:172.21.15.179:3300/0 conn(0x7f3248160280 0x7f32481606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 >> v1:172.21.15.179:6789/0 conn(0x7f32480d31a0 legacy=0x7f32480d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248160bf0 con 0x7f324815c710 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3240001670 con 0x7f324815c710 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 >> v1:172.21.15.5:6789/0 conn(0x7f324815c710 legacy=0x7f32480cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230003970 0x7f3230003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 0x7f3230004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3230005180 0x7f323000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480d35d0 con 0x7f32300047c0 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323000c020 con 0x7f3230005180 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323000c1e0 con 0x7f3230003970 2024-09-13T17:17:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324d500640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 0x7f3230004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324dd01640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230003970 0x7f3230003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.414+0000 7f324e502640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3230005180 0x7f323000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 -- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230003970 msgr2=0x7f3230003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3230003970 0x7f3230003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 -- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3230005180 msgr2=0x7f323000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3230005180 0x7f323000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 -- 172.21.15.5:0/2751088436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230003520 con 0x7f32300047c0 2024-09-13T17:17:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324e502640 1 -- 172.21.15.5:0/2751088436 reap_dead start 2024-09-13T17:17:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.415+0000 7f324d500640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 0x7f3230004c40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f323c001770 tx=0x7f32300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf3dc59b4434182 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0052d0 con 0x7f32300047c0 2024-09-13T17:17:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c005430 con 0x7f32300047c0 2024-09-13T17:17:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ccff640 1 -- 172.21.15.5:0/2751088436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c02aae0 con 0x7f32300047c0 2024-09-13T17:17:06.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 -- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 msgr2=0x7f3230004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 0x7f3230004c40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f323c001770 tx=0x7f32300057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 -- 172.21.15.5:0/2751088436 shutdown_connections 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 --2- 172.21.15.5:0/2751088436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32300047c0 0x7f3230004c40 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 -- 172.21.15.5:0/2751088436 >> 172.21.15.5:0/2751088436 conn(0x7f3248089fd0 msgr2=0x7f32480d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 -- 172.21.15.5:0/2751088436 shutdown_connections 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.416+0000 7f324ff65640 1 -- 172.21.15.5:0/2751088436 wait complete. 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.417+0000 7f324ff65640 1 Processor -- start 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.417+0000 7f324ff65640 1 -- start start 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 0x7f3248158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32480b7ea0 0x7f32480c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324815fe00 con 0x7f32480b7a20 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324815f840 con 0x7f32300047c0 2024-09-13T17:17:06.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324ff65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324815fb20 con 0x7f32480b7ea0 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324d500640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324d500640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58414/0 (socket says 172.21.15.5:58414) 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324d500640 1 -- 172.21.15.5:0/1582116100 learned_addr learned my addr 172.21.15.5:0/1582116100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324dd01640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 0x7f3248158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324e502640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32480b7ea0 0x7f32480c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.418+0000 7f324d500640 1 -- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32480b7ea0 msgr2=0x7f32480c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324d500640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32480b7ea0 0x7f32480c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324d500640 1 -- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 msgr2=0x7f3248158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324d500640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 0x7f3248158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324d500640 1 -- 172.21.15.5:0/1582116100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480b7220 con 0x7f32480b7a20 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324dd01640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 0x7f3248158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324d500640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f323c005040 tx=0x7f323c001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c006a20 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c006b80 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480b7500 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c007040 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.419+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248159520 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.420+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32480d2000 con 0x7f32480b7a20 2024-09-13T17:17:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.420+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f323c0071a0 con 0x7f32480b7a20 2024-09-13T17:17:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.421+0000 7f32467fc640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 0x7f323406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.421+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f323c0a9080 con 0x7f32480b7a20 2024-09-13T17:17:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.421+0000 7f324dd01640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 0x7f323406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.421+0000 7f324dd01640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 0x7f323406d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3240001200 tx=0x7f3240009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:06.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.425+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f323c0740c0 con 0x7f32480b7a20 2024-09-13T17:17:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:06.598+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32480d2000 con 0x7f32480b7a20 2024-09-13T17:17:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.520+0000 7f32467fc640 1 -- 172.21.15.5:0/1582116100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f323c0776e0 con 0x7f32480b7a20 2024-09-13T17:17:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.524+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 msgr2=0x7f323406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.524+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 0x7f323406d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3240001200 tx=0x7f3240009040 comp rx=0 tx=0).stop 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 msgr2=0x7f32480c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f323c005040 tx=0x7f323c001170 comp rx=0 tx=0).stop 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 shutdown_connections 2024-09-13T17:17:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32480b7ea0 0x7f32480c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f323406ac00 0x7f323406d0c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32480b7a20 0x7f32480c96f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 --2- 172.21.15.5:0/1582116100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300047c0 0x7f3248158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 >> 172.21.15.5:0/1582116100 conn(0x7f3248089fd0 msgr2=0x7f32480b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 shutdown_connections 2024-09-13T17:17:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.525+0000 7f324ff65640 1 -- 172.21.15.5:0/1582116100 wait complete. 2024-09-13T17:17:07.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:17:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.651+0000 7fe3f200d640 1 Processor -- start 2024-09-13T17:17:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.651+0000 7fe3f200d640 1 -- start start 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3f200d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3ec160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3f200d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec161320 con 0x7fe3ec0cee20 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3f200d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec0d0b60 con 0x7fe3ec0ccd40 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3f200d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0d0e40 con 0x7fe3ec15c7e0 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3eaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe3ec0cee20 0x7fe3ec0cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53856/0 (socket says 172.21.15.5:53856) 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3eaffd640 1 -- 172.21.15.5:0/3122716124 learned_addr learned my addr 172.21.15.5:0/3122716124 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3eb7fe640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3ec160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227634191 0 0) 0x7fe3e0001110 con 0x7fe3ec0cee20 2024-09-13T17:17:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d4003520 con 0x7fe3ec0cee20 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241491628 0 0) 0x7fe3d4003520 con 0x7fe3ec0cee20 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 msgr2=0x7fe3ec160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3ec160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 >> v1:172.21.15.179:6789/0 conn(0x7fe3ec0ccd40 legacy=0x7fe3ec0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.652+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0d1120 con 0x7fe3ec0cee20 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe3e0001800 con 0x7fe3ec0cee20 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 >> v1:172.21.15.5:6789/0 conn(0x7fe3ec0cee20 legacy=0x7fe3ec0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d40039a0 0x7fe3d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d4004350 0x7fe3d4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3d4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0d0e40 con 0x7fe3d4004350 2024-09-13T17:17:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d400b980 con 0x7fe3d40039a0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d400bb40 con 0x7fe3ec15c7e0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d4004350 0x7fe3d4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eb7fe640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d40039a0 0x7fe3d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3d4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 -- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 msgr2=0x7fe3d4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3d4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 -- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d40039a0 msgr2=0x7fe3d4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d40039a0 0x7fe3d4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3eaffd640 1 -- 172.21.15.5:0/3122716124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4003520 con 0x7fe3d4004350 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.653+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec15c7e0 0x7fe3d4005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3eaffd640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d4004350 0x7fe3d4004820 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c160 tx=0x7fe3d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e294d52ca81f1eea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0005ad0 con 0x7fe3d4004350 2024-09-13T17:17:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e002d070 con 0x7fe3d4004350 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3ea7fc640 1 -- 172.21.15.5:0/3122716124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0005e90 con 0x7fe3d4004350 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3f200d640 1 -- 172.21.15.5:0/3122716124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d4004350 msgr2=0x7fe3d4004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3f200d640 1 --2- 172.21.15.5:0/3122716124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3d4004350 0x7fe3d4004820 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c160 tx=0x7fe3d40057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3ebfff640 1 -- 172.21.15.5:0/3122716124 reap_dead start 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3f200d640 1 -- 172.21.15.5:0/3122716124 shutdown_connections 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3f200d640 1 -- 172.21.15.5:0/3122716124 >> 172.21.15.5:0/3122716124 conn(0x7fe3ec0b43e0 msgr2=0x7fe3ec0b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.654+0000 7fe3f200d640 1 -- 172.21.15.5:0/3122716124 shutdown_connections 2024-09-13T17:17:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.655+0000 7fe3f200d640 1 -- 172.21.15.5:0/3122716124 wait complete. 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.656+0000 7fe3f200d640 1 Processor -- start 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.656+0000 7fe3f200d640 1 -- start start 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d4004350 0x7fe3ec0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec15b4f0 0x7fe3ec0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0cb820 con 0x7fe3ec15ce40 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0cba10 con 0x7fe3ec15b4f0 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0cbcf0 con 0x7fe3d4004350 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58436/0 (socket says 172.21.15.5:58436) 2024-09-13T17:17:07.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 -- 172.21.15.5:0/902309972 learned_addr learned my addr 172.21.15.5:0/902309972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3eb7fe640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d4004350 0x7fe3ec0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3eaffd640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec15b4f0 0x7fe3ec0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 -- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d4004350 msgr2=0x7fe3ec0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d4004350 0x7fe3ec0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 -- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec15b4f0 msgr2=0x7fe3ec0cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec15b4f0 0x7fe3ec0cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 -- 172.21.15.5:0/902309972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0cbfd0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3ebfff640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0d0270 tx=0x7fe3e400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4006b50 con 0x7fe3ec15ce40 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e4006cb0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec0cc2b0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.657+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4003bb0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.658+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec15bcc0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.658+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec0cc7d0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.659+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3e4003d10 con 0x7fe3ec15ce40 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.659+0000 7fe3d3fff640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 0x7fe3d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.660+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5793+0+0 (secure 0 0 0) 0x7fe3e4088d30 con 0x7fe3ec15ce40 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.660+0000 7fe3eb7fe640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 0x7fe3d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.660+0000 7fe3eb7fe640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 0x7fe3d806d0f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009bc0 tx=0x7fe3dc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.664+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3ec0cc7d0 con 0x7fe3ec15ce40 2024-09-13T17:17:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:07.839+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3ec0cc7d0 con 0x7fe3ec15ce40 2024-09-13T17:17:08.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.522+0000 7fe3d3fff640 1 -- 172.21.15.5:0/902309972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe3ec0cc7d0 con 0x7fe3ec15ce40 2024-09-13T17:17:08.524 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 msgr2=0x7fe3d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 0x7fe3d806d0f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009bc0 tx=0x7fe3dc009190 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 msgr2=0x7fe3ec15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0d0270 tx=0x7fe3e400eb20 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 shutdown_connections 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe3d806ac30 0x7fe3d806d0f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3ec15ce40 0x7fe3ec15d2c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec15b4f0 0x7fe3ec0cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 --2- 172.21.15.5:0/902309972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d4004350 0x7fe3ec0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.526+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 >> 172.21.15.5:0/902309972 conn(0x7fe3ec0b43e0 msgr2=0x7fe3ec0d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.527+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 shutdown_connections 2024-09-13T17:17:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.527+0000 7fe3f200d640 1 -- 172.21.15.5:0/902309972 wait complete. 2024-09-13T17:17:08.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:17:08.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.593 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.594 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.595 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:17:08.596 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.597 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:17:08.598 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:17:08.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:17:08.600 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:17:08.601 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:17:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:17:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.604 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:17:08.605 INFO:teuthology.orchestra.run.smithi005.stdout: client_metadata = root=/baz 2024-09-13T17:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout: client_metadata = root=/baz 2024-09-13T17:17:08.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:17:08.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:17:08.693 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:17:08.693 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:17:08.693 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.694 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:17:08.695 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:17:08.696 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:17:08.697 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.698 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:17:08.699 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:17:08.700 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:17:08.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.703 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:17:08.704 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.705 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:17:08.706 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:17:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:17:08.706 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.707 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:17:08.708 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:17:08.709 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.710 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:17:08.711 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:17:08.712 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:17:08.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.714 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:17:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.716 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:17:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:17:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:17:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:17:08.718 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:17:08.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:17:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.852+0000 7fbc9e901640 1 Processor -- start 2024-09-13T17:17:08.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.852+0000 7fbc9e901640 1 -- start start 2024-09-13T17:17:08.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9e901640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbc981597d0 0x7fbc9813f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9e901640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc9813f670 0x7fbc9813cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9e901640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9815a7d0 con 0x7fbc980703e0 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9e901640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9813c740 con 0x7fbc9813f670 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9e901640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc98159f30 con 0x7fbc981597d0 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9ce9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc9813f670 0x7fbc9813cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc97fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbc980703e0 0x7fbc980707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53870/0 (socket says 172.21.15.5:53870) 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc97fff640 1 -- 172.21.15.5:0/545316517 learned_addr learned my addr 172.21.15.5:0/545316517 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc977fe640 1 --2- 172.21.15.5:0/545316517 >> v2:172.21.15.179:3300/0 conn(0x7fbc981597d0 0x7fbc9813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/545316517 >> v2:172.21.15.179:3300/0 conn(0x7fbc981597d0 msgr2=0x7fbc9813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9ce9e640 1 --2- 172.21.15.5:0/545316517 >> v2:172.21.15.179:3300/0 conn(0x7fbc981597d0 0x7fbc9813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/545316517 >> v1:172.21.15.5:6789/0 conn(0x7fbc980703e0 legacy=0x7fbc980707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/545316517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9815a210 con 0x7fbc9813f670 2024-09-13T17:17:08.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.853+0000 7fbc96ffd640 1 -- 172.21.15.5:0/545316517 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593215794 0 0) 0x7fbc9815a7d0 con 0x7fbc980703e0 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.854+0000 7fbc9ce9e640 1 --2- 172.21.15.5:0/545316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc9813f670 0x7fbc9813cfd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b10b0 tx=0x7fbc9002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad168cb692b196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.854+0000 7fbc96ffd640 1 -- 172.21.15.5:0/545316517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90007740 con 0x7fbc9813f670 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.854+0000 7fbc96ffd640 1 -- 172.21.15.5:0/545316517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9002d050 con 0x7fbc9813f670 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.854+0000 7fbc96ffd640 1 -- 172.21.15.5:0/545316517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90007ac0 con 0x7fbc9813f670 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 -- 172.21.15.5:0/545316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc9813f670 msgr2=0x7fbc9813cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 --2- 172.21.15.5:0/545316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc9813f670 0x7fbc9813cfd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b10b0 tx=0x7fbc9002a5f0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 -- 172.21.15.5:0/545316517 shutdown_connections 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 --2- 172.21.15.5:0/545316517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc9813f670 0x7fbc9813cfd0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 --2- 172.21.15.5:0/545316517 >> v2:172.21.15.179:3300/0 conn(0x7fbc981597d0 0x7fbc9813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 -- 172.21.15.5:0/545316517 >> 172.21.15.5:0/545316517 conn(0x7fbc980b02f0 msgr2=0x7fbc980b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 -- 172.21.15.5:0/545316517 shutdown_connections 2024-09-13T17:17:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.855+0000 7fbc9e901640 1 -- 172.21.15.5:0/545316517 wait complete. 2024-09-13T17:17:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.856+0000 7fbc9e901640 1 Processor -- start 2024-09-13T17:17:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.856+0000 7fbc9e901640 1 -- start start 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc980703e0 0x7fbc980af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc9813f670 0x7fbc981efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc981effc0 con 0x7fbc981597d0 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98138760 con 0x7fbc9813f670 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9e901640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98138a20 con 0x7fbc980703e0 2024-09-13T17:17:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58464/0 (socket says 172.21.15.5:58464) 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/1690583174 learned_addr learned my addr 172.21.15.5:0/1690583174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc977fe640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc9813f670 0x7fbc981efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc97fff640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc980703e0 0x7fbc980af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc980703e0 msgr2=0x7fbc980af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc980703e0 0x7fbc980af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc9813f670 msgr2=0x7fbc981efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc9813f670 0x7fbc981efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 -- 172.21.15.5:0/1690583174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009a70 con 0x7fbc981597d0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.857+0000 7fbc9ce9e640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002abe0 tx=0x7fbc90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.858+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90031890 con 0x7fbc981597d0 2024-09-13T17:17:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.858+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc900319f0 con 0x7fbc981597d0 2024-09-13T17:17:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.858+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc98141d10 con 0x7fbc981597d0 2024-09-13T17:17:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.858+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90031d60 con 0x7fbc981597d0 2024-09-13T17:17:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.858+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc981422d0 con 0x7fbc981597d0 2024-09-13T17:17:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.859+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980672f0 con 0x7fbc981597d0 2024-09-13T17:17:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.859+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc9003c420 con 0x7fbc981597d0 2024-09-13T17:17:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.860+0000 7fbc94ff9640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 0x7fbc8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.860+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbc900aae50 con 0x7fbc981597d0 2024-09-13T17:17:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.860+0000 7fbc97fff640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 0x7fbc8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.860+0000 7fbc97fff640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 0x7fbc8406d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:08.864+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc900763b0 con 0x7fbc981597d0 2024-09-13T17:17:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.038+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc9813b1d0 con 0x7fbc981597d0 2024-09-13T17:17:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.041+0000 7fbc94ff9640 1 -- 172.21.15.5:0/1690583174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc900799d0 con 0x7fbc981597d0 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 msgr2=0x7fbc8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 0x7fbc8406d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88007d50 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 msgr2=0x7fbc980b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002abe0 tx=0x7fbc90004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 shutdown_connections 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc8406ac00 0x7fbc8406d0c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc981597d0 0x7fbc980b16f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc9813f670 0x7fbc981efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 --2- 172.21.15.5:0/1690583174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc980703e0 0x7fbc980af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 >> 172.21.15.5:0/1690583174 conn(0x7fbc980b02f0 msgr2=0x7fbc980b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.043+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 shutdown_connections 2024-09-13T17:17:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.044+0000 7fbc9e901640 1 -- 172.21.15.5:0/1690583174 wait complete. 2024-09-13T17:17:09.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-13T17:17:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.156+0000 7f528e953640 1 Processor -- start 2024-09-13T17:17:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.156+0000 7f528e953640 1 -- start start 2024-09-13T17:17:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528e953640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52881592d0 0x7f528806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528e953640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 0x7f528806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528e953640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52880b3150 con 0x7f52880cdcb0 2024-09-13T17:17:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528e953640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528815cf00 con 0x7f52881592d0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528e953640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880b3430 con 0x7f52880cb7b0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f5287fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52881592d0 0x7f528806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528cef0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52880cdcb0 0x7f528815d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53884/0 (socket says 172.21.15.5:53884) 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f528cef0640 1 -- 172.21.15.5:0/3399907779 learned_addr learned my addr 172.21.15.5:0/3399907779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f527ffff640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 0x7f528806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f5287fff640 1 -- 172.21.15.5:0/3399907779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 msgr2=0x7f528806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f5287fff640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 0x7f528806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f5287fff640 1 -- 172.21.15.5:0/3399907779 >> v1:172.21.15.5:6789/0 conn(0x7f52880cdcb0 legacy=0x7f528815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f52877fe640 1 -- 172.21.15.5:0/3399907779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905641988 0 0) 0x7f52880b3150 con 0x7f52880cdcb0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f5287fff640 1 -- 172.21.15.5:0/3399907779 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880b3710 con 0x7f52881592d0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.157+0000 7f527ffff640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 0x7f528806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.158+0000 7f5287fff640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52881592d0 0x7f528806c440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6052960e1aa9f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.158+0000 7f52877fe640 1 -- 172.21.15.5:0/3399907779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527802ae50 con 0x7f52881592d0 2024-09-13T17:17:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.158+0000 7f52877fe640 1 -- 172.21.15.5:0/3399907779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278032440 con 0x7f52881592d0 2024-09-13T17:17:09.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.158+0000 7f52877fe640 1 -- 172.21.15.5:0/3399907779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780327d0 con 0x7f52881592d0 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 -- 172.21.15.5:0/3399907779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52881592d0 msgr2=0x7f528806c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52881592d0 0x7f528806c440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f52780097a0 tx=0x7f527802a100 comp rx=0 tx=0).stop 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 -- 172.21.15.5:0/3399907779 shutdown_connections 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cb7b0 0x7f528806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 --2- 172.21.15.5:0/3399907779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52881592d0 0x7f528806c440 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 -- 172.21.15.5:0/3399907779 >> 172.21.15.5:0/3399907779 conn(0x7f5288066200 msgr2=0x7f5288069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 -- 172.21.15.5:0/3399907779 shutdown_connections 2024-09-13T17:17:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.159+0000 7f528e953640 1 -- 172.21.15.5:0/3399907779 wait complete. 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.160+0000 7f528e953640 1 Processor -- start 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.160+0000 7f528e953640 1 -- start start 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cdcb0 0x7f52880c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52881592d0 0x7f52880ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c3940 con 0x7f52880cb7b0 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c3c20 con 0x7f52881592d0 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f528e953640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c3f00 con 0x7f52880cdcb0 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58476/0 (socket says 172.21.15.5:58476) 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 -- 172.21.15.5:0/1588820608 learned_addr learned my addr 172.21.15.5:0/1588820608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f527ffff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cdcb0 0x7f52880c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 -- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cdcb0 msgr2=0x7f52880c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cdcb0 0x7f52880c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 -- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52881592d0 msgr2=0x7f52880ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52881592d0 0x7f52880ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.161+0000 7f5287fff640 1 -- 172.21.15.5:0/1588820608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278009400 con 0x7f52880cb7b0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f5287fff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5278000c00 tx=0x7f52780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527803d910 con 0x7f52880cb7b0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527803da70 con 0x7f52880cb7b0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880c41e0 con 0x7f52880cb7b0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527803de20 con 0x7f52880cb7b0 2024-09-13T17:17:09.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.162+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52880c35d0 con 0x7f52880cb7b0 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.163+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52880672f0 con 0x7f52880cb7b0 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.163+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5278039040 con 0x7f52880cb7b0 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.164+0000 7f52857fa640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 0x7f526806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.164+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f52780a9af0 con 0x7f52880cb7b0 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.164+0000 7f527ffff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 0x7f526806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.164+0000 7f527ffff640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 0x7f526806d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5270006fd0 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.168+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5278074e90 con 0x7f52880cb7b0 2024-09-13T17:17:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.404+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f5288070510 con 0x7f52880cb7b0 2024-09-13T17:17:09.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.529+0000 7f52857fa640 1 -- 172.21.15.5:0/1588820608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v224) v1 ==== 142+0+0 (secure 0 0 0) 0x7f52780410d0 con 0x7f52880cb7b0 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 msgr2=0x7f526806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 0x7f526806d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5270006fd0 tx=0x7f5270008040 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 msgr2=0x7f5288149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5278000c00 tx=0x7f52780046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 shutdown_connections 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52881592d0 0x7f52880ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52880cdcb0 0x7f52880c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f526806ac00 0x7f526806d0c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 --2- 172.21.15.5:0/1588820608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52880cb7b0 0x7f5288149ec0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 >> 172.21.15.5:0/1588820608 conn(0x7f5288066200 msgr2=0x7f5288070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 shutdown_connections 2024-09-13T17:17:09.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.531+0000 7f528e953640 1 -- 172.21.15.5:0/1588820608 wait complete. 2024-09-13T17:17:09.543 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... ok 2024-09-13T17:17:09.544 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-13T17:17:09.544 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:17:09.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.645+0000 7f1f0c9db640 1 Processor -- start 2024-09-13T17:17:09.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.645+0000 7f1f0c9db640 1 -- start start 2024-09-13T17:17:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a4a0 0x7f1f080cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f0815a880 0x7f1f080cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 0x7f1f080cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080cb9a0 con 0x7f1f0815a880 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080cdab0 con 0x7f1f080cafb0 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.646+0000 7f1f0c9db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080b2180 con 0x7f1f0815a4a0 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f0815a880 0x7f1f080cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f0815a880 0x7f1f080cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58478/0 (socket says 172.21.15.5:58478) 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 -- 172.21.15.5:0/4136058446 learned_addr learned my addr 172.21.15.5:0/4136058446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f06d9d640 1 --2- 172.21.15.5:0/4136058446 >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 0x7f1f080cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f0659c640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a4a0 0x7f1f080cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 -- 172.21.15.5:0/4136058446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a4a0 msgr2=0x7f1f080cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a4a0 0x7f1f080cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 -- 172.21.15.5:0/4136058446 >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 msgr2=0x7f1f080cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/4136058446 >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 0x7f1f080cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f05d9b640 1 -- 172.21.15.5:0/4136058446 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080b2420 con 0x7f1f0815a880 2024-09-13T17:17:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.647+0000 7f1f06d9d640 1 --2- 172.21.15.5:0/4136058446 >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 0x7f1f080cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815a880 0x7f1f080cd570 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1f080ae270 tx=0x7f1efc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95d4c2152f0f81b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0559a640 1 -- 172.21.15.5:0/4136058446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc032440 con 0x7f1f0815a880 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0559a640 1 -- 172.21.15.5:0/4136058446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc0325a0 con 0x7f1f0815a880 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0559a640 1 -- 172.21.15.5:0/4136058446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc032930 con 0x7f1f0815a880 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0c9db640 1 -- 172.21.15.5:0/4136058446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815a880 msgr2=0x7f1f080cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815a880 0x7f1f080cd570 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1f080ae270 tx=0x7f1efc02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.648+0000 7f1f0c9db640 1 -- 172.21.15.5:0/4136058446 shutdown_connections 2024-09-13T17:17:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/4136058446 >> v2:172.21.15.179:3300/0 conn(0x7f1f080cafb0 0x7f1f080cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f0815a880 0x7f1f080cd570 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/4136058446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a4a0 0x7f1f080cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 -- 172.21.15.5:0/4136058446 >> 172.21.15.5:0/4136058446 conn(0x7f1f08066200 msgr2=0x7f1f08069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 -- 172.21.15.5:0/4136058446 shutdown_connections 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.649+0000 7f1f0c9db640 1 -- 172.21.15.5:0/4136058446 wait complete. 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.650+0000 7f1f0c9db640 1 Processor -- start 2024-09-13T17:17:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.650+0000 7f1f0c9db640 1 -- start start 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f0815a4a0 0x7f1f080ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a880 0x7f1f0806c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080ac150 con 0x7f1f080cafb0 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080ac430 con 0x7f1f0815a4a0 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0c9db640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080ac710 con 0x7f1f0815a880 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58490/0 (socket says 172.21.15.5:58490) 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 -- 172.21.15.5:0/3840885729 learned_addr learned my addr 172.21.15.5:0/3840885729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f0815a4a0 0x7f1f080ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f06d9d640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a880 0x7f1f0806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 -- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a880 msgr2=0x7f1f0806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a880 0x7f1f0806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 -- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f0815a4a0 msgr2=0x7f1f080ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f0815a4a0 0x7f1f080ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 -- 172.21.15.5:0/3840885729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0094d0 con 0x7f1f080cafb0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.651+0000 7f1f0659c640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800d800 tx=0x7f1ef800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.652+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800b6c0 con 0x7f1f080cafb0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.652+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800b820 con 0x7f1f080cafb0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.652+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f081563e0 con 0x7f1f080cafb0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.652+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800bbb0 con 0x7f1f080cafb0 2024-09-13T17:17:09.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.652+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08156000 con 0x7f1f080cafb0 2024-09-13T17:17:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.653+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f080672f0 con 0x7f1f080cafb0 2024-09-13T17:17:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.653+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ef800bd10 con 0x7f1f080cafb0 2024-09-13T17:17:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.654+0000 7f1ef6ffd640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 0x7f1ee806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.654+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1ef8089510 con 0x7f1f080cafb0 2024-09-13T17:17:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.654+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 0x7f1ee806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.654+0000 7f1f05d9b640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 0x7f1ee806d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1efc034000 tx=0x7f1efc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.658+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1ef80549f0 con 0x7f1f080cafb0 2024-09-13T17:17:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.828+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f08156220 con 0x7f1f080cafb0 2024-09-13T17:17:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.829+0000 7f1ef6ffd640 1 -- 172.21.15.5:0/3840885729 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+13154 (secure 0 0 0) 0x7f1ef8058010 con 0x7f1f080cafb0 2024-09-13T17:17:09.830 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:09.830 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":74,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:08.518891+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1809726047":"2024-09-14T17:17:05.234313+0000","172.21.15.5:6833/1809726047":"2024-09-14T17:17:05.234313+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 msgr2=0x7f1ee806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 0x7f1ee806d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1efc034000 tx=0x7f1efc02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 msgr2=0x7f1f081501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800d800 tx=0x7f1ef800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 shutdown_connections 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f0815a880 0x7f1f0806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f0815a4a0 0x7f1f080ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1ee806ac00 0x7f1ee806d0c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 --2- 172.21.15.5:0/3840885729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f080cafb0 0x7f1f081501c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 >> 172.21.15.5:0/3840885729 conn(0x7f1f08066200 msgr2=0x7f1f080aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.831+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 shutdown_connections 2024-09-13T17:17:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.832+0000 7f1f0c9db640 1 -- 172.21.15.5:0/3840885729 wait complete. 2024-09-13T17:17:09.844 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:09.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.946+0000 7f52d50b1640 1 Processor -- start 2024-09-13T17:17:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 -- start start 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d006b5f0 0x7f52d00ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d0065f30 0x7f52d00ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d0071e40 con 0x7f52d015c840 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015cc20 con 0x7f52d006b5f0 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.947+0000 7f52d50b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0071880 con 0x7f52d0065f30 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d006b5f0 0x7f52d00ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ced9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52d015c840 0x7f52d006aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53896/0 (socket says 172.21.15.5:53896) 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52d006b5f0 0x7f52d00ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58502/0 (socket says 172.21.15.5:58502) 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ced9d640 1 -- 172.21.15.5:0/3098335920 learned_addr learned my addr 172.21.15.5:0/3098335920 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52cf59e640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d0065f30 0x7f52d00ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 -- 172.21.15.5:0/3098335920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d0065f30 msgr2=0x7f52d00ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d0065f30 0x7f52d00ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 -- 172.21.15.5:0/3098335920 >> v1:172.21.15.5:6789/0 conn(0x7f52d015c840 legacy=0x7f52d006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52ce59c640 1 -- 172.21.15.5:0/3098335920 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0071b60 con 0x7f52d006b5f0 2024-09-13T17:17:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.948+0000 7f52cdd9b640 1 -- 172.21.15.5:0/3098335920 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892132308 0 0) 0x7f52d0071e40 con 0x7f52d015c840 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52ce59c640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d006b5f0 0x7f52d00ae380 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097a0 tx=0x7f52c402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5b3c83b659da9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52cdd9b640 1 -- 172.21.15.5:0/3098335920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c402adb0 con 0x7f52d006b5f0 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52cdd9b640 1 -- 172.21.15.5:0/3098335920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4032440 con 0x7f52d006b5f0 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52cdd9b640 1 -- 172.21.15.5:0/3098335920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40327d0 con 0x7f52d006b5f0 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 -- 172.21.15.5:0/3098335920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d006b5f0 msgr2=0x7f52d00ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d006b5f0 0x7f52d00ae380 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097a0 tx=0x7f52c402a060 comp rx=0 tx=0).stop 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 -- 172.21.15.5:0/3098335920 shutdown_connections 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d0065f30 0x7f52d00ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 --2- 172.21.15.5:0/3098335920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d006b5f0 0x7f52d00ae380 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 -- 172.21.15.5:0/3098335920 >> 172.21.15.5:0/3098335920 conn(0x7f52d00cc570 msgr2=0x7f52d0070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 -- 172.21.15.5:0/3098335920 shutdown_connections 2024-09-13T17:17:09.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.949+0000 7f52d50b1640 1 -- 172.21.15.5:0/3098335920 wait complete. 2024-09-13T17:17:09.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.951+0000 7f52d50b1640 1 Processor -- start 2024-09-13T17:17:09.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.951+0000 7f52d50b1640 1 -- start start 2024-09-13T17:17:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52d006b5f0 0x7f52d014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d015c840 0x7f52d015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01546d0 con 0x7f52d0065f30 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0153de0 con 0x7f52d006b5f0 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0154080 con 0x7f52d015c840 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58510/0 (socket says 172.21.15.5:58510) 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 -- 172.21.15.5:0/118545643 learned_addr learned my addr 172.21.15.5:0/118545643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52cf59e640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d015c840 0x7f52d015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ce59c640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52d006b5f0 0x7f52d014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 -- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d015c840 msgr2=0x7f52d015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d015c840 0x7f52d015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 -- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52d006b5f0 msgr2=0x7f52d014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52d006b5f0 0x7f52d014ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 -- 172.21.15.5:0/118545643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009400 con 0x7f52d0065f30 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52ced9d640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c430 tx=0x7f52c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00074e0 con 0x7f52d0065f30 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0007660 con 0x7f52d0065f30 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d0154360 con 0x7f52d0065f30 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.952+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0004a20 con 0x7f52d0065f30 2024-09-13T17:17:09.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.953+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d014f5e0 con 0x7f52d0065f30 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.954+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00672c0 con 0x7f52d0065f30 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.954+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f52c0004b80 con 0x7f52d0065f30 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.954+0000 7f52b77fe640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 0x7f52bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.954+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f52c0088e40 con 0x7f52d0065f30 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.955+0000 7f52ce59c640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 0x7f52bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.955+0000 7f52ce59c640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 0x7f52bc06d0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52c4034000 tx=0x7f52c402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:09.959+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f52c0054320 con 0x7f52d0065f30 2024-09-13T17:17:10.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.128+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52d00ac6c0 con 0x7f52d0065f30 2024-09-13T17:17:10.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.129+0000 7f52b77fe640 1 -- 172.21.15.5:0/118545643 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52c0057940 con 0x7f52d0065f30 2024-09-13T17:17:10.130 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.130+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 msgr2=0x7f52bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.130+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 0x7f52bc06d0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52c4034000 tx=0x7f52c402e000 comp rx=0 tx=0).stop 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.130+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 msgr2=0x7f52d00b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.130+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c430 tx=0x7f52c000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 shutdown_connections 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52d015c840 0x7f52d015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52d006b5f0 0x7f52d014ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f52bc06ac00 0x7f52bc06d0c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 --2- 172.21.15.5:0/118545643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d0065f30 0x7f52d00b0430 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 >> 172.21.15.5:0/118545643 conn(0x7f52d00cc570 msgr2=0x7f52d00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 shutdown_connections 2024-09-13T17:17:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.131+0000 7f52d50b1640 1 -- 172.21.15.5:0/118545643 wait complete. 2024-09-13T17:17:10.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-13T17:17:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.244+0000 7fdeb7496640 1 Processor -- start 2024-09-13T17:17:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.244+0000 7fdeb7496640 1 -- start start 2024-09-13T17:17:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb7496640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 0x7fdeb006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb7496640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00b3150 con 0x7fdeb006e370 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb7496640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00b3430 con 0x7fdeb00cb7b0 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb7496640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015cf00 con 0x7fdeb01592d0 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5a33640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdeb006e370 0x7fdeb015d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53906/0 (socket says 172.21.15.5:53906) 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5a33640 1 -- 172.21.15.5:0/187212634 learned_addr learned my addr 172.21.15.5:0/187212634 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5232640 1 --2- 172.21.15.5:0/187212634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 0x7fdeb006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009226179 0 0) 0x7fdeb00b3150 con 0x7fdeb006e370 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003520 con 0x7fdeb006e370 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5232640 1 -- 172.21.15.5:0/187212634 >> v1:172.21.15.179:6789/0 conn(0x7fdeb00cb7b0 legacy=0x7fdeb006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378136996 0 0) 0x7fdeb00b3430 con 0x7fdeb00cb7b0 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5232640 1 -- 172.21.15.5:0/187212634 >> v1:172.21.15.5:6789/0 conn(0x7fdeb006e370 legacy=0x7fdeb015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.245+0000 7fdeb5232640 1 -- 172.21.15.5:0/187212634 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00b3710 con 0x7fdeb01592d0 2024-09-13T17:17:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.246+0000 7fdeb5232640 1 --2- 172.21.15.5:0/187212634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 0x7fdeb006c440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0097d0 tx=0x7fdeac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae17922ee2a10e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.246+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac032440 con 0x7fdeb01592d0 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.246+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac0325a0 con 0x7fdeb01592d0 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.246+0000 7fdea7fff640 1 -- 172.21.15.5:0/187212634 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac032930 con 0x7fdeb01592d0 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 -- 172.21.15.5:0/187212634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 msgr2=0x7fdeb006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 --2- 172.21.15.5:0/187212634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 0x7fdeb006c440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0097d0 tx=0x7fdeac02a180 comp rx=0 tx=0).stop 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 -- 172.21.15.5:0/187212634 shutdown_connections 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 --2- 172.21.15.5:0/187212634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb01592d0 0x7fdeb006c440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 -- 172.21.15.5:0/187212634 >> 172.21.15.5:0/187212634 conn(0x7fdeb0066200 msgr2=0x7fdeb0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 -- 172.21.15.5:0/187212634 shutdown_connections 2024-09-13T17:17:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.247+0000 7fdeb7496640 1 -- 172.21.15.5:0/187212634 wait complete. 2024-09-13T17:17:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.248+0000 7fdeb7496640 1 Processor -- start 2024-09-13T17:17:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.248+0000 7fdeb7496640 1 -- start start 2024-09-13T17:17:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb006e370 0x7fdeb01ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 0x7fdeb01f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0156fb0 con 0x7fdeb01592d0 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0157290 con 0x7fdeb00cb7b0 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb7496640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0157570 con 0x7fdeb006e370 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb5a33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb5a33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58514/0 (socket says 172.21.15.5:58514) 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb5a33640 1 -- 172.21.15.5:0/4030709796 learned_addr learned my addr 172.21.15.5:0/4030709796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb5232640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb006e370 0x7fdeb01ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb4a31640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 0x7fdeb01f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.249+0000 7fdeb5a33640 1 -- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb006e370 msgr2=0x7fdeb01ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb5a33640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb006e370 0x7fdeb01ee750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb5a33640 1 -- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 msgr2=0x7fdeb01f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb5a33640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 0x7fdeb01f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb5a33640 1 -- 172.21.15.5:0/4030709796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009400 con 0x7fdeb01592d0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb4a31640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 0x7fdeb01f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb5a33640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cae0 tx=0x7fdea800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ac40 con 0x7fdeb01592d0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800ada0 con 0x7fdeb01592d0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb0157850 con 0x7fdeb01592d0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8012640 con 0x7fdeb01592d0 2024-09-13T17:17:10.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.250+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb0141a00 con 0x7fdeb01592d0 2024-09-13T17:17:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.251+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb00672f0 con 0x7fdeb01592d0 2024-09-13T17:17:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.252+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdea8007070 con 0x7fdeb01592d0 2024-09-13T17:17:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.252+0000 7fdea5ffb640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 0x7fde9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.252+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdea8089060 con 0x7fdeb01592d0 2024-09-13T17:17:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.252+0000 7fdeb5232640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 0x7fde9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.253+0000 7fdeb5232640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 0x7fde9406d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdeac034000 tx=0x7fdeac02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.256+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdea8054540 con 0x7fdeb01592d0 2024-09-13T17:17:10.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.491+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7fdeb00b3430 con 0x7fdeb01592d0 2024-09-13T17:17:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.530+0000 7fdea5ffb640 1 -- 172.21.15.5:0/4030709796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v225) v1 ==== 146+0+0 (secure 0 0 0) 0x7fdea8057b60 con 0x7fdeb01592d0 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 msgr2=0x7fde9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 0x7fde9406d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdeac034000 tx=0x7fdeac02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 msgr2=0x7fdeb01f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cae0 tx=0x7fdea800a060 comp rx=0 tx=0).stop 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 shutdown_connections 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fde9406ac00 0x7fde9406d0c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeb01592d0 0x7fdeb01f2a40 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeb00cb7b0 0x7fdeb01f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 --2- 172.21.15.5:0/4030709796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeb006e370 0x7fdeb01ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 >> 172.21.15.5:0/4030709796 conn(0x7fdeb0066200 msgr2=0x7fdeb01584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 shutdown_connections 2024-09-13T17:17:10.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.532+0000 7fdeb7496640 1 -- 172.21.15.5:0/4030709796 wait complete. 2024-09-13T17:17:10.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:17:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.647+0000 7ff721fce640 1 Processor -- start 2024-09-13T17:17:10.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.647+0000 7ff721fce640 1 -- start start 2024-09-13T17:17:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.648+0000 7ff721fce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.648+0000 7ff721fce640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff71c0cb510 0x7ff71c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.648+0000 7ff721fce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0cbf70 con 0x7ff71c15af90 2024-09-13T17:17:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.648+0000 7ff721fce640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c0cb9b0 con 0x7ff71c0cb510 2024-09-13T17:17:10.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.648+0000 7ff721fce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0cbc90 con 0x7ff71c143800 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71affd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff71c0cb510 0x7ff71c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:46630/0 (socket says 172.21.15.5:46630) 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 -- 172.21.15.5:0/3897788489 learned_addr learned my addr 172.21.15.5:0/3897788489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71bfff640 1 --1- 172.21.15.5:0/3897788489 >> v1:172.21.15.179:6789/0 conn(0x7ff71c15af90 0x7ff71c0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:54144/0 (socket says 172.21.15.5:54144) 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 -- 172.21.15.5:0/3897788489 >> v2:172.21.15.179:3300/0 conn(0x7ff71c0cb510 msgr2=0x7ff71c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 --2- 172.21.15.5:0/3897788489 >> v2:172.21.15.179:3300/0 conn(0x7ff71c0cb510 0x7ff71c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 -- 172.21.15.5:0/3897788489 >> v1:172.21.15.179:6789/0 conn(0x7ff71c15af90 legacy=0x7ff71c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.649+0000 7ff71b7fe640 1 -- 172.21.15.5:0/3897788489 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0b1720 con 0x7ff71c143800 2024-09-13T17:17:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff71b7fe640 1 --2- 172.21.15.5:0/3897788489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009870 tx=0x7ff70c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b368bd2ff5190518 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff71a7fc640 1 -- 172.21.15.5:0/3897788489 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c02ae80 con 0x7ff71c143800 2024-09-13T17:17:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff71a7fc640 1 -- 172.21.15.5:0/3897788489 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c032440 con 0x7ff71c143800 2024-09-13T17:17:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff71a7fc640 1 -- 172.21.15.5:0/3897788489 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0327b0 con 0x7ff71c143800 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 -- 172.21.15.5:0/3897788489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 msgr2=0x7ff71c0cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 --2- 172.21.15.5:0/3897788489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009870 tx=0x7ff70c02a130 comp rx=0 tx=0).stop 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 -- 172.21.15.5:0/3897788489 shutdown_connections 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 --2- 172.21.15.5:0/3897788489 >> v2:172.21.15.179:3300/0 conn(0x7ff71c0cb510 0x7ff71c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 --2- 172.21.15.5:0/3897788489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0cafd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.650+0000 7ff721fce640 1 -- 172.21.15.5:0/3897788489 >> 172.21.15.5:0/3897788489 conn(0x7ff71c0b02f0 msgr2=0x7ff71c0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.651+0000 7ff721fce640 1 -- 172.21.15.5:0/3897788489 shutdown_connections 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.651+0000 7ff721fce640 1 -- 172.21.15.5:0/3897788489 wait complete. 2024-09-13T17:17:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.652+0000 7ff721fce640 1 Processor -- start 2024-09-13T17:17:10.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.652+0000 7ff721fce640 1 -- start start 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c0cb510 0x7ff71c13e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0aceb0 con 0x7ff71c15af90 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c130090 con 0x7ff71c0cb510 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c130370 con 0x7ff71c143800 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58526/0 (socket says 172.21.15.5:58526) 2024-09-13T17:17:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 -- 172.21.15.5:0/3843350362 learned_addr learned my addr 172.21.15.5:0/3843350362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71b7fe640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c0cb510 0x7ff71c13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71affd640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 -- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 msgr2=0x7ff71c0c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 -- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c0cb510 msgr2=0x7ff71c13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c0cb510 0x7ff71c13e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 -- 172.21.15.5:0/3843350362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c0094d0 con 0x7ff71c15af90 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71affd640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff71bfff640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c780 tx=0x7ff71400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71400ce90 con 0x7ff71c15af90 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71400a640 con 0x7ff71c15af90 2024-09-13T17:17:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.653+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c130650 con 0x7ff71c15af90 2024-09-13T17:17:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.654+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71400a9f0 con 0x7ff71c15af90 2024-09-13T17:17:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.654+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c0ad190 con 0x7ff71c15af90 2024-09-13T17:17:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.654+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c0672f0 con 0x7ff71c15af90 2024-09-13T17:17:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.655+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff71400ab50 con 0x7ff71c15af90 2024-09-13T17:17:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.656+0000 7ff703fff640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 0x7ff70806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.656+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff714088940 con 0x7ff71c15af90 2024-09-13T17:17:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.656+0000 7ff71b7fe640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 0x7ff70806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.657+0000 7ff71b7fe640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 0x7ff70806d0c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff70c034000 tx=0x7ff70c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.660+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff714053d00 con 0x7ff71c15af90 2024-09-13T17:17:10.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.832+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff71c0b0c30 con 0x7ff71c15af90 2024-09-13T17:17:10.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.836+0000 7ff703fff640 1 -- 172.21.15.5:0/3843350362 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff714057320 con 0x7ff71c15af90 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 msgr2=0x7ff70806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 0x7ff70806d0c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff70c034000 tx=0x7ff70c02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 msgr2=0x7ff71c132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c780 tx=0x7ff71400cc40 comp rx=0 tx=0).stop 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 shutdown_connections 2024-09-13T17:17:10.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff70806ac00 0x7ff70806d0c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff71c15af90 0x7ff71c132080 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff71c143800 0x7ff71c0c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 --2- 172.21.15.5:0/3843350362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c0cb510 0x7ff71c13e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 >> 172.21.15.5:0/3843350362 conn(0x7ff71c0b02f0 msgr2=0x7ff71c0afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 shutdown_connections 2024-09-13T17:17:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:10.838+0000 7ff721fce640 1 -- 172.21.15.5:0/3843350362 wait complete. 2024-09-13T17:17:10.850 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:17:10.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:10.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:10.936 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:17:10.936 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:10.936 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:10.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:10.953 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:10.953 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:10.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:10.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:10.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:11.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:11.010 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:11.010 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:11.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:11.053 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:17:11.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.154+0000 7f6a5a6d7640 1 Processor -- start 2024-09-13T17:17:11.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.154+0000 7f6a5a6d7640 1 -- start start 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a5a6d7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a5415c680 0x7f6a540b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a5a6d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a540ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a5a6d7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a540ac5f0 con 0x7f6a540cd140 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a5a6d7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a54071a80 con 0x7f6a5415c680 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a5a6d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540714c0 con 0x7f6a540ae270 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a53fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a5415c680 0x7f6a540b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a4bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a540ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a53fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a5415c680 0x7f6a540b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:36758/0 (socket says 172.21.15.5:36758) 2024-09-13T17:17:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a58c74640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6a540cd140 0x7f6a540ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:54150/0 (socket says 172.21.15.5:54150) 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.155+0000 7f6a53fff640 1 -- 172.21.15.5:0/3397916129 learned_addr learned my addr 172.21.15.5:0/3397916129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a53fff640 1 -- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 msgr2=0x7f6a540ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a53fff640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a540ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a53fff640 1 -- 172.21.15.5:0/3397916129 >> v1:172.21.15.179:6789/0 conn(0x7f6a540cd140 legacy=0x7f6a540ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a53fff640 1 -- 172.21.15.5:0/3397916129 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540717a0 con 0x7f6a5415c680 2024-09-13T17:17:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a4bfff640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a540ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.156+0000 7f6a53fff640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5415c680 0x7f6a540b1db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=709a20c7eb558d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a537fe640 1 -- 172.21.15.5:0/3397916129 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032440 con 0x7f6a5415c680 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a537fe640 1 -- 172.21.15.5:0/3397916129 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440325a0 con 0x7f6a5415c680 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a537fe640 1 -- 172.21.15.5:0/3397916129 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44032930 con 0x7f6a5415c680 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5415c680 msgr2=0x7f6a540b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5415c680 0x7f6a540b1db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4402a270 comp rx=0 tx=0).stop 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/3397916129 shutdown_connections 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a540ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/3397916129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5415c680 0x7f6a540b1db0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/3397916129 >> 172.21.15.5:0/3397916129 conn(0x7f6a540cc610 msgr2=0x7f6a54070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/3397916129 shutdown_connections 2024-09-13T17:17:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.157+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/3397916129 wait complete. 2024-09-13T17:17:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 Processor -- start 2024-09-13T17:17:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 -- start start 2024-09-13T17:17:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a54151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a540cd140 0x7f6a5415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5415e870 con 0x7f6a5415c680 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54151db0 con 0x7f6a540cd140 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a5a6d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5415dcf0 con 0x7f6a540ae270 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.159+0000 7f6a58c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58536/0 (socket says 172.21.15.5:58536) 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 -- 172.21.15.5:0/2529583525 learned_addr learned my addr 172.21.15.5:0/2529583525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a4bfff640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a540cd140 0x7f6a5415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a53fff640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a54151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 -- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 msgr2=0x7f6a54151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a54151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 -- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a540cd140 msgr2=0x7f6a5415f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a540cd140 0x7f6a5415f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 -- 172.21.15.5:0/2529583525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009400 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a58c74640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c7d0 tx=0x7f6a4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00a640 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00a7a0 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440094d0 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00ab10 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.160+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5415e2b0 con 0x7f6a5415c680 2024-09-13T17:17:11.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.161+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540ccc00 con 0x7f6a5415c680 2024-09-13T17:17:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.162+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a4c00ac70 con 0x7f6a5415c680 2024-09-13T17:17:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.162+0000 7f6a517fa640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 0x7f6a3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.162+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6a4c088820 con 0x7f6a5415c680 2024-09-13T17:17:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.162+0000 7f6a53fff640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 0x7f6a3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.163+0000 7f6a53fff640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 0x7f6a3406d0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a4402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.167+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a4c053d00 con 0x7f6a5415c680 2024-09-13T17:17:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.375+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a5406b0f0 con 0x7f6a5415c680 2024-09-13T17:17:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.375+0000 7f6a517fa640 1 -- 172.21.15.5:0/2529583525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f6a4c017020 con 0x7f6a5415c680 2024-09-13T17:17:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:11.376 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3504352308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3504352308},{"type":"v1","addr":"172.21.15.179:6835","nonce":3504352308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/725867672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":725867672},{"type":"v1","addr":"172.21.15.179:6837","nonce":725867672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6636,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1964526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1964526},{"type":"v1","addr":"172.21.15.5:6834","nonce":1964526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4109580511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4109580511},{"type":"v1","addr":"172.21.15.5:6835","nonce":4109580511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2024-09-13T17:17:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 msgr2=0x7f6a3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 0x7f6a3406d0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a44034000 tx=0x7f6a4402e000 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 msgr2=0x7f6a54154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c7d0 tx=0x7f6a4c00cc90 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 shutdown_connections 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6a3406ac30 0x7f6a3406d0f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5415c680 0x7f6a54154270 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a540cd140 0x7f6a5415f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 --2- 172.21.15.5:0/2529583525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a540ae270 0x7f6a54151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 >> 172.21.15.5:0/2529583525 conn(0x7f6a540cc610 msgr2=0x7f6a540ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 shutdown_connections 2024-09-13T17:17:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.377+0000 7f6a5a6d7640 1 -- 172.21.15.5:0/2529583525 wait complete. 2024-09-13T17:17:11.389 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:17:11.389 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:17:11.389 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:17:11.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:11.390 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:17:11.390 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:17:11.390 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:17:11.390 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:11.390 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:17:11.390 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:17:11.390 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:17:11.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:11.391 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:17:11.391 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:17:11.391 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:17:11.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:11.399 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:17:11.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:17:11.400 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:17:11.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:17:11.402 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:17:11.403 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:17:11.403 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:17:11.404 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:17:11.441 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:17:11.441 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:11.442 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:17:11.442 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:11.445 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:17:11.446 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:11.446 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:17:11.446 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:11.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:17:11.518 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:17:11.518 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:17:11.533 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:17:11.533 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:17:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.554+0000 7f7c9bde2640 1 Processor -- start 2024-09-13T17:17:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.554+0000 7f7c9bde2640 1 -- start start 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c9bde2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c940707e0 0x7f7c940b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c9bde2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940cd730 con 0x7f7c9415a4a0 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c9bde2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9415a880 con 0x7f7c94070370 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c9bde2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940a74b0 con 0x7f7c940707e0 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c99b7e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c9415a4a0 0x7f7c940cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53926/0 (socket says 172.21.15.5:53926) 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c99b7e640 1 -- 172.21.15.5:0/2742050589 learned_addr learned my addr 172.21.15.5:0/2742050589 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.555+0000 7f7c9a37f640 1 --2- 172.21.15.5:0/2742050589 >> v2:172.21.15.179:3300/0 conn(0x7f7c940707e0 0x7f7c940b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.556+0000 7f7c98b7c640 1 -- 172.21.15.5:0/2742050589 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823256938 0 0) 0x7f7c940cd730 con 0x7f7c9415a4a0 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.556+0000 7f7c98b7c640 1 -- 172.21.15.5:0/2742050589 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c80003520 con 0x7f7c9415a4a0 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.556+0000 7f7c9a37f640 1 -- 172.21.15.5:0/2742050589 >> v1:172.21.15.179:6789/0 conn(0x7f7c94070370 legacy=0x7f7c940b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.556+0000 7f7c9a37f640 1 -- 172.21.15.5:0/2742050589 >> v1:172.21.15.5:6789/0 conn(0x7f7c9415a4a0 legacy=0x7f7c940cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.556+0000 7f7c9a37f640 1 -- 172.21.15.5:0/2742050589 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940cce90 con 0x7f7c940707e0 2024-09-13T17:17:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.557+0000 7f7c9a37f640 1 --2- 172.21.15.5:0/2742050589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c940b2330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009dc0 tx=0x7f7c8c02a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21518df5dd384ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.557+0000 7f7c98b7c640 1 -- 172.21.15.5:0/2742050589 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c007740 con 0x7f7c940707e0 2024-09-13T17:17:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.559+0000 7f7c98b7c640 1 -- 172.21.15.5:0/2742050589 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c0078a0 con 0x7f7c940707e0 2024-09-13T17:17:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.559+0000 7f7c98b7c640 1 -- 172.21.15.5:0/2742050589 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c007c10 con 0x7f7c940707e0 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2742050589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 msgr2=0x7f7c940b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2742050589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c940b2330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009dc0 tx=0x7f7c8c02a7c0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2742050589 shutdown_connections 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2742050589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c940b2330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2742050589 >> 172.21.15.5:0/2742050589 conn(0x7f7c9406a500 msgr2=0x7f7c940b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2742050589 shutdown_connections 2024-09-13T17:17:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.560+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2742050589 wait complete. 2024-09-13T17:17:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.561+0000 7f7c9bde2640 1 Processor -- start 2024-09-13T17:17:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.561+0000 7f7c9bde2640 1 -- start start 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c94145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c9415a4a0 0x7f7c9406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941464e0 con 0x7f7c94070370 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941524d0 con 0x7f7c940707e0 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9bde2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415c7b0 con 0x7f7c9415a4a0 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c99b7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c99b7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58570/0 (socket says 172.21.15.5:58570) 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c99b7e640 1 -- 172.21.15.5:0/2717028514 learned_addr learned my addr 172.21.15.5:0/2717028514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9a37f640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c9415a4a0 0x7f7c9406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c9937d640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c94145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c99b7e640 1 -- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c9415a4a0 msgr2=0x7f7c9406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.562+0000 7f7c99b7e640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c9415a4a0 0x7f7c9406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c99b7e640 1 -- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 msgr2=0x7f7c94145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c99b7e640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c94145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c99b7e640 1 -- 172.21.15.5:0/2717028514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009a70 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c9937d640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c94145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c99b7e640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c410 tx=0x7f7c9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90005ce0 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90005e40 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9415ca90 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900072f0 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c940aba30 con 0x7f7c94070370 2024-09-13T17:17:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.564+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9415cc80 con 0x7f7c94070370 2024-09-13T17:17:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.564+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c90007510 con 0x7f7c94070370 2024-09-13T17:17:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.565+0000 7f7c8a7fc640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.565+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7c90088750 con 0x7f7c94070370 2024-09-13T17:17:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.565+0000 7f7c9937d640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.565+0000 7f7c9937d640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 0x7f7c7806d0c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ade40 tx=0x7f7c84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.569+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c90053c60 con 0x7f7c94070370 2024-09-13T17:17:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:11.750+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7c940b0d40 con 0x7f7c94070370 2024-09-13T17:17:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.560+0000 7f7c8a7fc640 1 -- 172.21.15.5:0/2717028514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7c90057280 con 0x7f7c94070370 2024-09-13T17:17:12.562 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 msgr2=0x7f7c7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 0x7f7c7806d0c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ade40 tx=0x7f7c84009040 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 msgr2=0x7f7c9415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c410 tx=0x7f7c9000c8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 shutdown_connections 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c9415a4a0 0x7f7c9406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c940707e0 0x7f7c94145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 --2- 172.21.15.5:0/2717028514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c94070370 0x7f7c9415d5f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.563+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 >> 172.21.15.5:0/2717028514 conn(0x7f7c9406a500 msgr2=0x7f7c9415df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.564+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 shutdown_connections 2024-09-13T17:17:12.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.564+0000 7f7c9bde2640 1 -- 172.21.15.5:0/2717028514 wait complete. 2024-09-13T17:17:12.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:17:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.686+0000 7f0937ca3640 1 Processor -- start 2024-09-13T17:17:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.686+0000 7f0937ca3640 1 -- start start 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0937ca3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f093015a4a0 0x7f09300cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0937ca3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 0x7f09300cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0937ca3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09300b2180 con 0x7f093015a880 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0937ca3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300cdab0 con 0x7f093015a4a0 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0937ca3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300b2420 con 0x7f09300cb6c0 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f0935a3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f093015a4a0 0x7f09300cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f093523e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f093015a880 0x7f09300cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53940/0 (socket says 172.21.15.5:53940) 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.687+0000 7f093523e640 1 -- 172.21.15.5:0/4280984788 learned_addr learned my addr 172.21.15.5:0/4280984788 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0936240640 1 --2- 172.21.15.5:0/4280984788 >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 0x7f09300cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0935a3f640 1 -- 172.21.15.5:0/4280984788 >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 msgr2=0x7f09300cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0934a3d640 1 -- 172.21.15.5:0/4280984788 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160580966 0 0) 0x7f09300b2180 con 0x7f093015a880 2024-09-13T17:17:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0935a3f640 1 --2- 172.21.15.5:0/4280984788 >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 0x7f09300cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0935a3f640 1 -- 172.21.15.5:0/4280984788 >> v1:172.21.15.5:6789/0 conn(0x7f093015a880 legacy=0x7f09300cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0935a3f640 1 -- 172.21.15.5:0/4280984788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300b2700 con 0x7f093015a4a0 2024-09-13T17:17:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0936240640 1 --2- 172.21.15.5:0/4280984788 >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 0x7f09300cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0935a3f640 1 --2- 172.21.15.5:0/4280984788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a4a0 0x7f09300cdc50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c864543c441e6b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.688+0000 7f0934a3d640 1 -- 172.21.15.5:0/4280984788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920007740 con 0x7f093015a4a0 2024-09-13T17:17:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0934a3d640 1 -- 172.21.15.5:0/4280984788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092002d050 con 0x7f093015a4a0 2024-09-13T17:17:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0934a3d640 1 -- 172.21.15.5:0/4280984788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920007ac0 con 0x7f093015a4a0 2024-09-13T17:17:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 -- 172.21.15.5:0/4280984788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a4a0 msgr2=0x7f09300cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 --2- 172.21.15.5:0/4280984788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a4a0 0x7f09300cdc50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d90 tx=0x7f092002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 -- 172.21.15.5:0/4280984788 shutdown_connections 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 --2- 172.21.15.5:0/4280984788 >> v2:172.21.15.179:3300/0 conn(0x7f09300cb6c0 0x7f09300cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 --2- 172.21.15.5:0/4280984788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a4a0 0x7f09300cdc50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 -- 172.21.15.5:0/4280984788 >> 172.21.15.5:0/4280984788 conn(0x7f0930066200 msgr2=0x7f0930069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 -- 172.21.15.5:0/4280984788 shutdown_connections 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.689+0000 7f0937ca3640 1 -- 172.21.15.5:0/4280984788 wait complete. 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.690+0000 7f0937ca3640 1 Processor -- start 2024-09-13T17:17:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.690+0000 7f0937ca3640 1 -- start start 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09300cb6c0 0x7f093014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093015a4a0 0x7f09300ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300accb0 con 0x7f093015a880 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300acf90 con 0x7f093015a4a0 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0937ca3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09300ad270 con 0x7f09300cb6c0 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0936240640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0936240640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58586/0 (socket says 172.21.15.5:58586) 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0936240640 1 -- 172.21.15.5:0/2107781303 learned_addr learned my addr 172.21.15.5:0/2107781303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f0935a3f640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09300cb6c0 0x7f093014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.691+0000 7f093523e640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093015a4a0 0x7f09300ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 -- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09300cb6c0 msgr2=0x7f093014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09300cb6c0 0x7f093014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 -- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093015a4a0 msgr2=0x7f09300ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093015a4a0 0x7f09300ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 -- 172.21.15.5:0/2107781303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009a70 con 0x7f093015a880 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0936240640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f092800c7f0 tx=0x7f092800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928004220 con 0x7f093015a880 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09280043a0 con 0x7f093015a880 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928007860 con 0x7f093015a880 2024-09-13T17:17:12.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093006c670 con 0x7f093015a880 2024-09-13T17:17:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.692+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093014e5d0 con 0x7f093015a880 2024-09-13T17:17:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.693+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093015d740 con 0x7f093015a880 2024-09-13T17:17:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.694+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0928007bd0 con 0x7f093015a880 2024-09-13T17:17:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.694+0000 7f092e7fc640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.694+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0928089190 con 0x7f093015a880 2024-09-13T17:17:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.694+0000 7f0935a3f640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:12.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.695+0000 7f0935a3f640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 0x7f091c06d0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0920034000 tx=0x7f092002f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:12.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.698+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0928054580 con 0x7f093015a880 2024-09-13T17:17:12.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:17:12.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:17:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.934+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f09300672f0 con 0x7f093015a880 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.935+0000 7f092e7fc640 1 -- 172.21.15.5:0/2107781303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5580 (secure 0 0 0) 0x7f0928057ba0 con 0x7f093015a880 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:12.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:17:12.940 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:17:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:17:12.944 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:12.945 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.946 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:12.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.badguy", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2c+Rm6wbAGhAAv0xMdRwS87ZJzNnU3xjXvA==", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow rw path=/foo/bar", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw" 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:12.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:17:12.950 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:12.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:12.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:17:12.950 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:17:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 msgr2=0x7f091c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 0x7f091c06d0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0920034000 tx=0x7f092002f000 comp rx=0 tx=0).stop 2024-09-13T17:17:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 msgr2=0x7f0930155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f092800c7f0 tx=0x7f092800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 shutdown_connections 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093015a880 0x7f0930155620 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f093015a4a0 0x7f09300ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 --2- 172.21.15.5:0/2107781303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09300cb6c0 0x7f093014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 >> 172.21.15.5:0/2107781303 conn(0x7f0930066200 msgr2=0x7f0930069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 shutdown_connections 2024-09-13T17:17:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:12.936+0000 7f0937ca3640 1 -- 172.21.15.5:0/2107781303 wait complete. 2024-09-13T17:17:12.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.badguy 2024-09-13T17:17:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.054+0000 7f9f3a661640 1 Processor -- start 2024-09-13T17:17:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.054+0000 7f9f3a661640 1 -- start start 2024-09-13T17:17:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f3a661640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f340b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f3a661640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340b24b0 con 0x7f9f340b33a0 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f3a661640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3415d370 con 0x7f9f340caed0 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f3a661640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340b3810 con 0x7f9f3414f9f0 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f38bfe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9f340b33a0 0x7f9f3415cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53950/0 (socket says 172.21.15.5:53950) 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3150885485 learned_addr learned my addr 172.21.15.5:0/3150885485 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f340b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537470203 0 0) 0x7f9f340b24b0 con 0x7f9f340b33a0 2024-09-13T17:17:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.055+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f1c004630 con 0x7f9f340b33a0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806662439 0 0) 0x7f9f3415d370 con 0x7f9f340caed0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f340b24b0 con 0x7f9f340caed0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660261229 0 0) 0x7f9f1c004630 con 0x7f9f340b33a0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 msgr2=0x7f9f340b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f340b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 >> v1:172.21.15.179:6789/0 conn(0x7f9f340caed0 legacy=0x7f9f3415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3414fdd0 con 0x7f9f340b33a0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f9f2c0019f0 con 0x7f9f340b33a0 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 >> v1:172.21.15.5:6789/0 conn(0x7f9f340b33a0 legacy=0x7f9f3415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f1c004c40 0x7f9f1c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c0058d0 0x7f9f1c005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f1c006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340b3810 con 0x7f9f1c004c40 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c00cb40 con 0x7f9f1c0058d0 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c00ccd0 con 0x7f9f3414f9f0 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f1c004c40 0x7f9f1c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f337fe640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c0058d0 0x7f9f1c005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f38bfe640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f1c006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 -- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 msgr2=0x7f9f1c006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f3414f9f0 0x7f9f1c006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 -- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c0058d0 msgr2=0x7f9f1c005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c0058d0 0x7f9f1c005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.056+0000 7f9f33fff640 1 -- 172.21.15.5:0/3150885485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c004630 con 0x7f9f1c004c40 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.057+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f1c004c40 0x7f9f1c005040 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009ac0 tx=0x7f9f1c006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43122b5eaf733036 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.057+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24031400 con 0x7f9f1c004c40 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.057+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2402d050 con 0x7f9f1c004c40 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.057+0000 7f9f32ffd640 1 -- 172.21.15.5:0/3150885485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24031780 con 0x7f9f1c004c40 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 -- 172.21.15.5:0/3150885485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f1c004c40 msgr2=0x7f9f1c005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3150885485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f1c004c40 0x7f9f1c005040 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009ac0 tx=0x7f9f1c006900 comp rx=0 tx=0).stop 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3150885485 reap_dead start 2024-09-13T17:17:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 -- 172.21.15.5:0/3150885485 shutdown_connections 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 -- 172.21.15.5:0/3150885485 >> 172.21.15.5:0/3150885485 conn(0x7f9f34069ed0 msgr2=0x7f9f3406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 -- 172.21.15.5:0/3150885485 shutdown_connections 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.058+0000 7f9f3a661640 1 -- 172.21.15.5:0/3150885485 wait complete. 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.059+0000 7f9f3a661640 1 Processor -- start 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.059+0000 7f9f3a661640 1 -- start start 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c004c40 0x7f9f340c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 0x7f9f340c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340c6830 con 0x7f9f340ab020 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340c6550 con 0x7f9f1c004c40 2024-09-13T17:17:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f3a661640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340c3620 con 0x7f9f340aaba0 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58608/0 (socket says 172.21.15.5:58608) 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3348886081 learned_addr learned my addr 172.21.15.5:0/3348886081 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c004c40 0x7f9f340c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f337fe640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 0x7f9f340c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 msgr2=0x7f9f340c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 0x7f9f340c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c004c40 msgr2=0x7f9f340c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c004c40 0x7f9f340c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 -- 172.21.15.5:0/3348886081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340c3900 con 0x7f9f340ab020 2024-09-13T17:17:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f337fe640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 0x7f9f340c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f38bfe640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b1780 tx=0x7f9f2c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.060+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00ee20 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.061+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c013420 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.061+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f340c3be0 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.061+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0137d0 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.061+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3414d760 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.061+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340c3460 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.062+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f2c013930 con 0x7f9f340ab020 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.063+0000 7f9f30ff9640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 0x7f9f2006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.063+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9f2c0894d0 con 0x7f9f340ab020 2024-09-13T17:17:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.063+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 0x7f9f2006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.063+0000 7f9f33fff640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 0x7f9f2006d0f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9f24033000 tx=0x7f9f24008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.067+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9f2c0548c0 con 0x7f9f340ab020 2024-09-13T17:17:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.303+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.badguy"} v 0) v1 -- 0x7f9f340b2140 con 0x7f9f340ab020 2024-09-13T17:17:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.306+0000 7f9f30ff9640 1 -- 172.21.15.5:0/3348886081 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.badguy"}]=0 v13) v1 ==== 83+0+0 (secure 0 0 0) 0x7f9f2c057ee0 con 0x7f9f340ab020 2024-09-13T17:17:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 msgr2=0x7f9f2006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 0x7f9f2006d0f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9f24033000 tx=0x7f9f24008030 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 msgr2=0x7f9f340c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b1780 tx=0x7f9f2c00e530 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 shutdown_connections 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9f2006ac30 0x7f9f2006d0f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f340ab020 0x7f9f340c4640 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f340aaba0 0x7f9f340c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 --2- 172.21.15.5:0/3348886081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f1c004c40 0x7f9f340c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 >> 172.21.15.5:0/3348886081 conn(0x7f9f34069ed0 msgr2=0x7f9f340cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 shutdown_connections 2024-09-13T17:17:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.308+0000 7f9f3a661640 1 -- 172.21.15.5:0/3348886081 wait complete. 2024-09-13T17:17:13.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.420+0000 7fca616d7640 1 Processor -- start 2024-09-13T17:17:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.420+0000 7fca616d7640 1 -- start start 2024-09-13T17:17:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca616d7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 0x7fca5c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca616d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca5c0cb7b0 0x7fca5c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca616d7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c0b3150 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca616d7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c15cf00 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca616d7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c0b3430 con 0x7fca5c1592d0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca5a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca5c0cb7b0 0x7fca5c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca5a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca5c0cb7b0 0x7fca5c06dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52988/0 (socket says 172.21.15.5:52988) 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca5a7fc640 1 -- 172.21.15.5:0/4194433393 learned_addr learned my addr 172.21.15.5:0/4194433393 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.421+0000 7fca5affd640 1 --2- 172.21.15.5:0/4194433393 >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 0x7fca5c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5a7fc640 1 -- 172.21.15.5:0/4194433393 >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 msgr2=0x7fca5c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5a7fc640 1 --2- 172.21.15.5:0/4194433393 >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 0x7fca5c06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5a7fc640 1 -- 172.21.15.5:0/4194433393 >> v1:172.21.15.179:6789/0 conn(0x7fca5c0cdcb0 legacy=0x7fca5c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5a7fc640 1 -- 172.21.15.5:0/4194433393 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0b3710 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5affd640 1 --2- 172.21.15.5:0/4194433393 >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 0x7fca5c06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca5a7fc640 1 --2- 172.21.15.5:0/4194433393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cb7b0 0x7fca5c06dc60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0715a0 tx=0x7fca4402c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f48b2d21e878538 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca59ffb640 1 -- 172.21.15.5:0/4194433393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44032710 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca59ffb640 1 -- 172.21.15.5:0/4194433393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44030050 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.422+0000 7fca59ffb640 1 -- 172.21.15.5:0/4194433393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44032ab0 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 -- 172.21.15.5:0/4194433393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cb7b0 msgr2=0x7fca5c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 --2- 172.21.15.5:0/4194433393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cb7b0 0x7fca5c06dc60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0715a0 tx=0x7fca4402c810 comp rx=0 tx=0).stop 2024-09-13T17:17:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 -- 172.21.15.5:0/4194433393 shutdown_connections 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 --2- 172.21.15.5:0/4194433393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cb7b0 0x7fca5c06dc60 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 --2- 172.21.15.5:0/4194433393 >> v2:172.21.15.179:3300/0 conn(0x7fca5c1592d0 0x7fca5c06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 -- 172.21.15.5:0/4194433393 >> 172.21.15.5:0/4194433393 conn(0x7fca5c066200 msgr2=0x7fca5c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 -- 172.21.15.5:0/4194433393 shutdown_connections 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.423+0000 7fca616d7640 1 -- 172.21.15.5:0/4194433393 wait complete. 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.424+0000 7fca616d7640 1 Processor -- start 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.424+0000 7fca616d7640 1 -- start start 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 0x7fca5c145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca5c1592d0 0x7fca5c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0a7ee0 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0aac50 con 0x7fca5c1592d0 2024-09-13T17:17:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca616d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0aaf30 con 0x7fca5c0cb7b0 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52998/0 (socket says 172.21.15.5:52998) 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca5a7fc640 1 -- 172.21.15.5:0/149842846 learned_addr learned my addr 172.21.15.5:0/149842846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca5b7fe640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca5c1592d0 0x7fca5c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.425+0000 7fca5affd640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 0x7fca5c145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 -- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 msgr2=0x7fca5c145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 0x7fca5c145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 -- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca5c1592d0 msgr2=0x7fca5c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca5c1592d0 0x7fca5c0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 -- 172.21.15.5:0/149842846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4400b770 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5affd640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 0x7fca5c145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca5a7fc640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fca4402c850 tx=0x7fca440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44032710 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44032870 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c0a8150 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44032c20 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.426+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c0ab210 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.427+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c0672f0 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.427+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca4403e440 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.428+0000 7fca537fe640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 0x7fca3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.428+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fca440ac8d0 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.428+0000 7fca5affd640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 0x7fca3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.429+0000 7fca5affd640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 0x7fca3c06d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0044f0 tx=0x7fca4c003a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.432+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fca44077e90 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.607+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5c0cc700 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.608+0000 7fca537fe640 1 -- 172.21.15.5:0/149842846 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13027 (secure 0 0 0) 0x7fca4404e090 con 0x7fca5c0cdcb0 2024-09-13T17:17:13.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:13.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:12.558030+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 msgr2=0x7fca3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 0x7fca3c06d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0044f0 tx=0x7fca4c003a30 comp rx=0 tx=0).stop 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 msgr2=0x7fca5c0ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fca4402c850 tx=0x7fca440046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 shutdown_connections 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca5c1592d0 0x7fca5c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fca3c06ac00 0x7fca3c06d0c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca5c0cdcb0 0x7fca5c0ad760 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 --2- 172.21.15.5:0/149842846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca5c0cb7b0 0x7fca5c145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 >> 172.21.15.5:0/149842846 conn(0x7fca5c066200 msgr2=0x7fca5c070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 shutdown_connections 2024-09-13T17:17:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.610+0000 7fca616d7640 1 -- 172.21.15.5:0/149842846 wait complete. 2024-09-13T17:17:13.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:13.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 Processor -- start 2024-09-13T17:17:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 -- start start 2024-09-13T17:17:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f894c0cfd50 0x7f894c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c0d20c0 0x7f894c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0d34d0 con 0x7f894c15c760 2024-09-13T17:17:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c0cddb0 con 0x7f894c0cfd50 2024-09-13T17:17:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.726+0000 7f8952619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0b5700 con 0x7f894c0d20c0 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f894c0cfd50 0x7f894c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f894c0cfd50 0x7f894c0b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53002/0 (socket says 172.21.15.5:53002) 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 -- 172.21.15.5:0/1902437398 learned_addr learned my addr 172.21.15.5:0/1902437398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8950bb6640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c0d20c0 0x7f894c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 -- 172.21.15.5:0/1902437398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c0d20c0 msgr2=0x7f894c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c0d20c0 0x7f894c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 -- 172.21.15.5:0/1902437398 >> v1:172.21.15.179:6789/0 conn(0x7f894c15c760 legacy=0x7f894c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.727+0000 7f8943fff640 1 -- 172.21.15.5:0/1902437398 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0d2950 con 0x7f894c0cfd50 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8943fff640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c0b1100 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1017aa4942fb27e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f894b7fe640 1 -- 172.21.15.5:0/1902437398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934032440 con 0x7f894c0cfd50 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f894b7fe640 1 -- 172.21.15.5:0/1902437398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89340325a0 con 0x7f894c0cfd50 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f894b7fe640 1 -- 172.21.15.5:0/1902437398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934032930 con 0x7f894c0cfd50 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8952619640 1 -- 172.21.15.5:0/1902437398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 msgr2=0x7f894c0b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8952619640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c0b1100 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8952619640 1 -- 172.21.15.5:0/1902437398 shutdown_connections 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8952619640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c0d20c0 0x7f894c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.728+0000 7f8952619640 1 --2- 172.21.15.5:0/1902437398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c0b1100 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.729+0000 7f8952619640 1 -- 172.21.15.5:0/1902437398 >> 172.21.15.5:0/1902437398 conn(0x7f894c071a20 msgr2=0x7f894c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.729+0000 7f8952619640 1 -- 172.21.15.5:0/1902437398 shutdown_connections 2024-09-13T17:17:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.729+0000 7f8952619640 1 -- 172.21.15.5:0/1902437398 wait complete. 2024-09-13T17:17:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.730+0000 7f8952619640 1 Processor -- start 2024-09-13T17:17:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.730+0000 7f8952619640 1 -- start start 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.730+0000 7f8952619640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 0x7f894c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 0x7f894c15e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15ccc0 con 0x7f894c0cfd50 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15cfa0 con 0x7f894c0d20c0 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15d280 con 0x7f894c15c760 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53010/0 (socket says 172.21.15.5:53010) 2024-09-13T17:17:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 -- 172.21.15.5:0/3206614331 learned_addr learned my addr 172.21.15.5:0/3206614331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8950bb6640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 0x7f894c15e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8943fff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 0x7f894c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 -- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 msgr2=0x7f894c15e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 0x7f894c15e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 -- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 msgr2=0x7f894c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 0x7f894c0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 -- 172.21.15.5:0/3206614331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340094d0 con 0x7f894c0cfd50 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8950bb6640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 0x7f894c15e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8943fff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 0x7f894c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f894bfff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f893c00c400 tx=0x7f893c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0052d0 con 0x7f894c0cfd50 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c005430 con 0x7f894c0cfd50 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c15d560 con 0x7f894c0cfd50 2024-09-13T17:17:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c003830 con 0x7f894c0cfd50 2024-09-13T17:17:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.731+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c0c8e60 con 0x7f894c0cfd50 2024-09-13T17:17:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.732+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c0d2580 con 0x7f894c0cfd50 2024-09-13T17:17:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.733+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f893c003990 con 0x7f894c0cfd50 2024-09-13T17:17:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.733+0000 7f89497fa640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 0x7f892c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:13.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.733+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f893c0886c0 con 0x7f894c0cfd50 2024-09-13T17:17:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.734+0000 7f8943fff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 0x7f892c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.734+0000 7f8943fff640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 0x7f892c06d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8934034000 tx=0x7f893402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.737+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f893c053ab0 con 0x7f894c0cfd50 2024-09-13T17:17:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.906+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f894c0d1b00 con 0x7f894c0cfd50 2024-09-13T17:17:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.907+0000 7f89497fa640 1 -- 172.21.15.5:0/3206614331 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f893c017020 con 0x7f894c0cfd50 2024-09-13T17:17:13.908 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 msgr2=0x7f892c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 0x7f892c06d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8934034000 tx=0x7f893402e000 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 msgr2=0x7f894c150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f893c00c400 tx=0x7f893c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 shutdown_connections 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f894c15c760 0x7f894c15e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f894c0d20c0 0x7f894c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f892c06ac00 0x7f892c06d0c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 --2- 172.21.15.5:0/3206614331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f894c0cfd50 0x7f894c150c80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 >> 172.21.15.5:0/3206614331 conn(0x7f894c071a20 msgr2=0x7f894c0b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 shutdown_connections 2024-09-13T17:17:13.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:13.908+0000 7f8952619640 1 -- 172.21.15.5:0/3206614331 wait complete. 2024-09-13T17:17:13.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:17:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.020+0000 7f129889c640 1 Processor -- start 2024-09-13T17:17:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.020+0000 7f129889c640 1 -- start start 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.021+0000 7f129889c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f129415c9f0 0x7f12940b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.021+0000 7f129889c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12940b5820 0x7f12940b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.021+0000 7f129889c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129415cdd0 con 0x7f12940cd630 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.021+0000 7f129889c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940b8750 con 0x7f12940b5820 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.021+0000 7f129889c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940d2c20 con 0x7f129415c9f0 2024-09-13T17:17:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12940b5820 0x7f12940b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12940b5820 0x7f12940b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53012/0 (socket says 172.21.15.5:53012) 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 -- 172.21.15.5:0/1368867984 learned_addr learned my addr 172.21.15.5:0/1368867984 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f129259c640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f129415c9f0 0x7f12940b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 -- 172.21.15.5:0/1368867984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f129415c9f0 msgr2=0x7f12940b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f129415c9f0 0x7f12940b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 -- 172.21.15.5:0/1368867984 >> v1:172.21.15.179:6789/0 conn(0x7f12940cd630 legacy=0x7f12940b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.022+0000 7f1292d9d640 1 -- 172.21.15.5:0/1368867984 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940d3040 con 0x7f12940b5820 2024-09-13T17:17:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f1292d9d640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12940b5820 0x7f12940b5c70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098a0 tx=0x7f128c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568cbf3b0a8bd76e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129159a640 1 -- 172.21.15.5:0/1368867984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c032440 con 0x7f12940b5820 2024-09-13T17:17:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129159a640 1 -- 172.21.15.5:0/1368867984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0325a0 con 0x7f12940b5820 2024-09-13T17:17:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129159a640 1 -- 172.21.15.5:0/1368867984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c032930 con 0x7f12940b5820 2024-09-13T17:17:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 -- 172.21.15.5:0/1368867984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12940b5820 msgr2=0x7f12940b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12940b5820 0x7f12940b5c70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098a0 tx=0x7f128c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 -- 172.21.15.5:0/1368867984 shutdown_connections 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12940b5820 0x7f12940b5c70 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 --2- 172.21.15.5:0/1368867984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f129415c9f0 0x7f12940b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 -- 172.21.15.5:0/1368867984 >> 172.21.15.5:0/1368867984 conn(0x7f1294071a20 msgr2=0x7f1294071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 -- 172.21.15.5:0/1368867984 shutdown_connections 2024-09-13T17:17:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.023+0000 7f129889c640 1 -- 172.21.15.5:0/1368867984 wait complete. 2024-09-13T17:17:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.025+0000 7f129889c640 1 Processor -- start 2024-09-13T17:17:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.025+0000 7f129889c640 1 -- start start 2024-09-13T17:17:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12940b5820 0x7f1294151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12940cd630 0x7f12940ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940b5060 con 0x7f129415c9f0 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940b4aa0 con 0x7f12940b5820 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129889c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940b4d80 con 0x7f12940cd630 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53028/0 (socket says 172.21.15.5:53028) 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 -- 172.21.15.5:0/3824941212 learned_addr learned my addr 172.21.15.5:0/3824941212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f129259c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12940b5820 0x7f1294151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1291d9b640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12940cd630 0x7f12940ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 -- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12940cd630 msgr2=0x7f12940ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12940cd630 0x7f12940ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 -- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12940b5820 msgr2=0x7f1294151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12940b5820 0x7f1294151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 -- 172.21.15.5:0/3824941212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0094d0 con 0x7f129415c9f0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f1292d9d640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098a0 tx=0x7f128c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c032440 con 0x7f129415c9f0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.026+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c030b80 con 0x7f129415c9f0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.027+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c03d420 con 0x7f129415c9f0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.027+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12940cb680 con 0x7f129415c9f0 2024-09-13T17:17:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.027+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294151d60 con 0x7f129415c9f0 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.028+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12940cb8c0 con 0x7f129415c9f0 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.028+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f128c039040 con 0x7f129415c9f0 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.028+0000 7f128affd640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 0x7f127406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.029+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f128c0a9d40 con 0x7f129415c9f0 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.029+0000 7f129259c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 0x7f127406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.029+0000 7f129259c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 0x7f127406d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f12840070b0 tx=0x7f1284007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.033+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f12940cb8c0 con 0x7f129415c9f0 2024-09-13T17:17:14.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.204+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f12940cb8c0 con 0x7f129415c9f0 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.205+0000 7f128affd640 1 -- 172.21.15.5:0/3824941212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f12940cb8c0 con 0x7f129415c9f0 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:14.206 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 msgr2=0x7f127406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 0x7f127406d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f12840070b0 tx=0x7f1284007040 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 msgr2=0x7f12940caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f128c0098a0 tx=0x7f128c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 shutdown_connections 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f127406ac00 0x7f127406d0c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f129415c9f0 0x7f12940caa80 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12940cd630 0x7f12940ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 --2- 172.21.15.5:0/3824941212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12940b5820 0x7f1294151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.206+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 >> 172.21.15.5:0/3824941212 conn(0x7f1294071a20 msgr2=0x7f129415e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.207+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 shutdown_connections 2024-09-13T17:17:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.207+0000 7f129889c640 1 -- 172.21.15.5:0/3824941212 wait complete. 2024-09-13T17:17:14.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:17:14.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:17:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.323+0000 7f1863a48640 1 Processor -- start 2024-09-13T17:17:14.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.323+0000 7f1863a48640 1 -- start start 2024-09-13T17:17:14.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1863a48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1863a48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f185c06aee0 0x7f185c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1863a48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0b2d50 con 0x7f185c0b1cb0 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1863a48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c06b890 con 0x7f185c06aee0 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1863a48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0ad3e0 con 0x7f185c15c5d0 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1861fe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f185c06aee0 0x7f185c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1860fe3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f185c0b1cb0 0x7f185c0accd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59916/0 (socket says 172.21.15.5:59916) 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1860fe3640 1 -- 172.21.15.5:0/1323379656 learned_addr learned my addr 172.21.15.5:0/1323379656 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f18617e4640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1861fe5640 1 -- 172.21.15.5:0/1323379656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 msgr2=0x7f185c06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1861fe5640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c06cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1861fe5640 1 -- 172.21.15.5:0/1323379656 >> v1:172.21.15.5:6789/0 conn(0x7f185c0b1cb0 legacy=0x7f185c0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.324+0000 7f1861fe5640 1 -- 172.21.15.5:0/1323379656 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c15c9b0 con 0x7f185c06aee0 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.325+0000 7f1861fe5640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c06b350 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1854009d90 tx=0x7f185402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb241040acc11501 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.325+0000 7f1853fff640 1 -- 172.21.15.5:0/1323379656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854007740 con 0x7f185c06aee0 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.325+0000 7f1853fff640 1 -- 172.21.15.5:0/1323379656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185402d050 con 0x7f185c06aee0 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.325+0000 7f1853fff640 1 -- 172.21.15.5:0/1323379656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854007ac0 con 0x7f185c06aee0 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 -- 172.21.15.5:0/1323379656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 msgr2=0x7f185c06b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c06b350 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1854009d90 tx=0x7f185402a560 comp rx=0 tx=0).stop 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 -- 172.21.15.5:0/1323379656 shutdown_connections 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c06b350 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 --2- 172.21.15.5:0/1323379656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c06cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 -- 172.21.15.5:0/1323379656 >> 172.21.15.5:0/1323379656 conn(0x7f185c070b70 msgr2=0x7f185c070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 -- 172.21.15.5:0/1323379656 shutdown_connections 2024-09-13T17:17:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.326+0000 7f1863a48640 1 -- 172.21.15.5:0/1323379656 wait complete. 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.327+0000 7f1863a48640 1 Processor -- start 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.327+0000 7f1863a48640 1 -- start start 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c13f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c13d1b0 0x7f185c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13e2c0 con 0x7f185c06aee0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13d6b0 con 0x7f185c13d1b0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1863a48640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13d990 con 0x7f185c15c5d0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53046/0 (socket says 172.21.15.5:53046) 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 -- 172.21.15.5:0/3533074831 learned_addr learned my addr 172.21.15.5:0/3533074831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1860fe3640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c13f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f1861fe5640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c13d1b0 0x7f185c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 -- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 msgr2=0x7f185c13f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c13f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 -- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c13d1b0 msgr2=0x7f185c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c13d1b0 0x7f185c0cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 -- 172.21.15.5:0/3533074831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009a70 con 0x7f185c06aee0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.328+0000 7f18617e4640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f185800d800 tx=0x7f185800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.329+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800b6c0 con 0x7f185c06aee0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.329+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800b820 con 0x7f185c06aee0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.329+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800bbb0 con 0x7f185c06aee0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.329+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c13dc70 con 0x7f185c06aee0 2024-09-13T17:17:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.329+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c0ce860 con 0x7f185c06aee0 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.330+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c0ce9f0 con 0x7f185c06aee0 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.330+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f185800bd10 con 0x7f185c06aee0 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.331+0000 7f1851ffb640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 0x7f184006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.331+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1858089660 con 0x7f185c06aee0 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.331+0000 7f1860fe3640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 0x7f184006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.331+0000 7f1860fe3640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 0x7f184006d0c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f184c007fd0 tx=0x7f184c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.335+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1858054ae0 con 0x7f185c06aee0 2024-09-13T17:17:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:14.504+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f185c06b350 con 0x7f185c06aee0 2024-09-13T17:17:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.310+0000 7f1851ffb640 1 -- 172.21.15.5:0/3533074831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1858058100 con 0x7f185c06aee0 2024-09-13T17:17:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.315+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 msgr2=0x7f184006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.315+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 0x7f184006d0c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f184c007fd0 tx=0x7f184c009040 comp rx=0 tx=0).stop 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.315+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 msgr2=0x7f185c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.315+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f185800d800 tx=0x7f185800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 shutdown_connections 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f185c13d1b0 0x7f185c0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f185c15c5d0 0x7f185c13f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f184006ac00 0x7f184006d0c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 --2- 172.21.15.5:0/3533074831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f185c06aee0 0x7f185c0ce320 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.316+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 >> 172.21.15.5:0/3533074831 conn(0x7f185c070b70 msgr2=0x7f185c157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:15.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.317+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 shutdown_connections 2024-09-13T17:17:15.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.317+0000 7f1863a48640 1 -- 172.21.15.5:0/3533074831 wait complete. 2024-09-13T17:17:15.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:17:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.446+0000 7effcdc61640 1 Processor -- start 2024-09-13T17:17:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.446+0000 7effcdc61640 1 -- start start 2024-09-13T17:17:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effcdc61640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc806e360 0x7effc80cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effcdc61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effc8159860 0x7effc8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effcdc61640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80b21e0 con 0x7effc806df80 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effcdc61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc80b24c0 con 0x7effc8159860 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effcdc61640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc80b27a0 con 0x7effc806e360 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effc8159860 0x7effc8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effc8159860 0x7effc8159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53062/0 (socket says 172.21.15.5:53062) 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 -- 172.21.15.5:0/3827953691 learned_addr learned my addr 172.21.15.5:0/3827953691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc6ffd640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc806e360 0x7effc80cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 -- 172.21.15.5:0/3827953691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc806e360 msgr2=0x7effc80cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc806e360 0x7effc80cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 -- 172.21.15.5:0/3827953691 >> v1:172.21.15.179:6789/0 conn(0x7effc806df80 legacy=0x7effc80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.447+0000 7effc7fff640 1 -- 172.21.15.5:0/3827953691 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80b2a80 con 0x7effc8159860 2024-09-13T17:17:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.448+0000 7effc7fff640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc8159860 0x7effc8159cf0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ccb1acee19a79a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.448+0000 7effc67fc640 1 -- 172.21.15.5:0/3827953691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc002aea0 con 0x7effc8159860 2024-09-13T17:17:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.448+0000 7effc67fc640 1 -- 172.21.15.5:0/3827953691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc002d050 con 0x7effc8159860 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.448+0000 7effc67fc640 1 -- 172.21.15.5:0/3827953691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0031820 con 0x7effc8159860 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 -- 172.21.15.5:0/3827953691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc8159860 msgr2=0x7effc8159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc8159860 0x7effc8159cf0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc002a6c0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 -- 172.21.15.5:0/3827953691 shutdown_connections 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc8159860 0x7effc8159cf0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 --2- 172.21.15.5:0/3827953691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc806e360 0x7effc80cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 -- 172.21.15.5:0/3827953691 >> 172.21.15.5:0/3827953691 conn(0x7effc8069ed0 msgr2=0x7effc806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 -- 172.21.15.5:0/3827953691 shutdown_connections 2024-09-13T17:17:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.449+0000 7effcdc61640 1 -- 172.21.15.5:0/3827953691 wait complete. 2024-09-13T17:17:15.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.450+0000 7effcdc61640 1 Processor -- start 2024-09-13T17:17:15.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.450+0000 7effcdc61640 1 -- start start 2024-09-13T17:17:15.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effc806df80 0x7effc8146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 0x7effc80a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc81472f0 con 0x7effc806e360 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc81f21c0 con 0x7effc806df80 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effcdc61640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc81f24a0 con 0x7effc8159860 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53074/0 (socket says 172.21.15.5:53074) 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 -- 172.21.15.5:0/2031597947 learned_addr learned my addr 172.21.15.5:0/2031597947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc7fff640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 0x7effc80a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc77fe640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effc806df80 0x7effc8146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 -- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 msgr2=0x7effc80a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 0x7effc80a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 -- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effc806df80 msgr2=0x7effc8146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effc806df80 0x7effc8146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc6ffd640 1 -- 172.21.15.5:0/2031597947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009b30 con 0x7effc806e360 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.451+0000 7effc7fff640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 0x7effc80a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effc6ffd640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d5f0 tx=0x7effbc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0125f0 con 0x7effc806e360 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc012750 con 0x7effc806e360 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc012b00 con 0x7effc806e360 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc81f2780 con 0x7effc806e360 2024-09-13T17:17:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.452+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc81f2d40 con 0x7effc806e360 2024-09-13T17:17:15.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.453+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc81f2f00 con 0x7effc806e360 2024-09-13T17:17:15.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.454+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7effbc012c60 con 0x7effc806e360 2024-09-13T17:17:15.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.454+0000 7effaffff640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 0x7effb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.455+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5547+0+0 (secure 0 0 0) 0x7effbc08a220 con 0x7effc806e360 2024-09-13T17:17:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.455+0000 7effc77fe640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 0x7effb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.455+0000 7effc77fe640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 0x7effb406d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7effb8006fd0 tx=0x7effb8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.459+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7effbc0554a0 con 0x7effc806e360 2024-09-13T17:17:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:15.631+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7effc80cb7c0 con 0x7effc806e360 2024-09-13T17:17:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.313+0000 7effaffff640 1 -- 172.21.15.5:0/2031597947 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7effbc058ac0 con 0x7effc806e360 2024-09-13T17:17:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:17:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.321+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 msgr2=0x7effb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.321+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 0x7effb406d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7effb8006fd0 tx=0x7effb8008040 comp rx=0 tx=0).stop 2024-09-13T17:17:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.321+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 msgr2=0x7effc81f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.321+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d5f0 tx=0x7effbc00dab0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 shutdown_connections 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effc8159860 0x7effc80a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7effb406ac00 0x7effb406d0c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc806e360 0x7effc81f1700 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 --2- 172.21.15.5:0/2031597947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effc806df80 0x7effc8146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.329+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 >> 172.21.15.5:0/2031597947 conn(0x7effc8069ed0 msgr2=0x7effc80b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:16.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.330+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 shutdown_connections 2024-09-13T17:17:16.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.330+0000 7effcdc61640 1 -- 172.21.15.5:0/2031597947 wait complete. 2024-09-13T17:17:16.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:17:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.456+0000 7f7b5d9c7640 1 Processor -- start 2024-09-13T17:17:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.456+0000 7f7b5d9c7640 1 -- start start 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b5d9c7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7b580703e0 0x7f7b581597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b5d9c7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5815a7d0 con 0x7f7b580707c0 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b5d9c7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b58159f30 con 0x7f7b5813cfd0 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b5d9c7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5813c740 con 0x7f7b580703e0 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b4ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b580707c0 0x7f7b5813f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59918/0 (socket says 172.21.15.5:59918) 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b4ffff640 1 -- 172.21.15.5:0/569007 learned_addr learned my addr 172.21.15.5:0/569007 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624848017 0 0) 0x7f7b5815a7d0 con 0x7f7b580707c0 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b44003520 con 0x7f7b580707c0 2024-09-13T17:17:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.457+0000 7f7b56ffd640 1 --2- 172.21.15.5:0/569007 >> v2:172.21.15.179:3300/0 conn(0x7f7b580703e0 0x7f7b581597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59483037 0 0) 0x7f7b44003520 con 0x7f7b580707c0 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 >> v2:172.21.15.179:3300/0 conn(0x7f7b580703e0 msgr2=0x7f7b581597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 --2- 172.21.15.5:0/569007 >> v2:172.21.15.179:3300/0 conn(0x7f7b580703e0 0x7f7b581597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 >> v1:172.21.15.179:6789/0 conn(0x7f7b5813cfd0 legacy=0x7f7b5813d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5815a210 con 0x7f7b580707c0 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f7b40001670 con 0x7f7b580707c0 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 >> v1:172.21.15.5:6789/0 conn(0x7f7b580707c0 legacy=0x7f7b5813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b44003970 0x7f7b44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b440047c0 0x7f7b44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b4400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5813c740 con 0x7f7b44005180 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400e330 con 0x7f7b44003970 2024-09-13T17:17:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4400e4f0 con 0x7f7b440047c0 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b4400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b4ffff640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b440047c0 0x7f7b44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b56ffd640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b44003970 0x7f7b44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 -- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b440047c0 msgr2=0x7f7b44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b440047c0 0x7f7b44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 -- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b44003970 msgr2=0x7f7b44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b44003970 0x7f7b44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.458+0000 7f7b577fe640 1 -- 172.21.15.5:0/569007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44003520 con 0x7f7b44005180 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.459+0000 7f7b577fe640 1 -- 172.21.15.5:0/569007 reap_dead start 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.459+0000 7f7b577fe640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b4400db90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7b50001e50 tx=0x7f7b440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b1c91adf4d5b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.459+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5002ae70 con 0x7f7b44005180 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.459+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50003970 con 0x7f7b44005180 2024-09-13T17:17:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.459+0000 7f7b567fc640 1 -- 172.21.15.5:0/569007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50003d40 con 0x7f7b44005180 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 msgr2=0x7f7b4400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b4400db90 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7b50001e50 tx=0x7f7b440057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/569007 shutdown_connections 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/569007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b4400db90 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/569007 >> 172.21.15.5:0/569007 conn(0x7f7b580b02f0 msgr2=0x7f7b580b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/569007 shutdown_connections 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.460+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/569007 wait complete. 2024-09-13T17:17:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.461+0000 7f7b5d9c7640 1 Processor -- start 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.461+0000 7f7b5d9c7640 1 -- start start 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 0x7f7b5813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b58142460 0x7f7b58140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58133e90 con 0x7f7b44005180 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b581ee260 con 0x7f7b58142460 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b5d9c7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b581edf80 con 0x7f7b58142000 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53090/0 (socket says 172.21.15.5:53090) 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 -- 172.21.15.5:0/346846555 learned_addr learned my addr 172.21.15.5:0/346846555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b4ffff640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 0x7f7b5813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b577fe640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b58142460 0x7f7b58140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 -- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 msgr2=0x7f7b5813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 0x7f7b5813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 -- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b58142460 msgr2=0x7f7b58140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b58142460 0x7f7b58140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 -- 172.21.15.5:0/346846555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b581429c0 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b4ffff640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 0x7f7b5813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.462+0000 7f7b56ffd640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7b480118e0 tx=0x7f7b48011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.463+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800faf0 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.463+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800fc50 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.463+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b58142ca0 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.463+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48014440 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.463+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5813f410 con 0x7f7b44005180 2024-09-13T17:17:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.464+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b580672f0 con 0x7f7b44005180 2024-09-13T17:17:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.464+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b480145a0 con 0x7f7b44005180 2024-09-13T17:17:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.465+0000 7f7b54ff9640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 0x7f7b3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.465+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f7b48089d10 con 0x7f7b44005180 2024-09-13T17:17:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.465+0000 7f7b4ffff640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 0x7f7b3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.466+0000 7f7b4ffff640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 0x7f7b3806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7b580b0d50 tx=0x7f7b40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.469+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b48054e10 con 0x7f7b44005180 2024-09-13T17:17:16.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.678+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7b58159b60 con 0x7f7b44005180 2024-09-13T17:17:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 11 and data pool 12 2024-09-13T17:17:16.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.686+0000 7f7b54ff9640 1 -- 172.21.15.5:0/346846555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7b48058430 con 0x7f7b44005180 2024-09-13T17:17:16.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 msgr2=0x7f7b3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 0x7f7b3806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7b580b0d50 tx=0x7f7b40009040 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 msgr2=0x7f7b58133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7b480118e0 tx=0x7f7b48011da0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 shutdown_connections 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b58142460 0x7f7b58140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b58142000 0x7f7b5813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b3806ac00 0x7f7b3806d0c0 secure :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7b580b0d50 tx=0x7f7b40009040 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 --2- 172.21.15.5:0/346846555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b44005180 0x7f7b58133950 secure :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7b480118e0 tx=0x7f7b48011da0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.696+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 >> 172.21.15.5:0/346846555 conn(0x7f7b580b02f0 msgr2=0x7f7b5813d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.699+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 shutdown_connections 2024-09-13T17:17:16.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.699+0000 7f7b5d9c7640 1 -- 172.21.15.5:0/346846555 wait complete. 2024-09-13T17:17:16.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.820+0000 7f8c1bb11640 1 Processor -- start 2024-09-13T17:17:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 -- start start 2024-09-13T17:17:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c1415c9f0 0x7f8c140b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c140cd630 0x7f8c140b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1415cdd0 con 0x7f8c140b4bf0 2024-09-13T17:17:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c140b8750 con 0x7f8c140cd630 2024-09-13T17:17:16.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.821+0000 7f8c1bb11640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c140d2c20 con 0x7f8c1415c9f0 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c140cd630 0x7f8c140b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c140cd630 0x7f8c140b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53106/0 (socket says 172.21.15.5:53106) 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 -- 172.21.15.5:0/4088047899 learned_addr learned my addr 172.21.15.5:0/4088047899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c198ad640 1 --2- 172.21.15.5:0/4088047899 >> v2:172.21.15.179:3300/0 conn(0x7f8c1415c9f0 0x7f8c140b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 -- 172.21.15.5:0/4088047899 >> v2:172.21.15.179:3300/0 conn(0x7f8c1415c9f0 msgr2=0x7f8c140b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 --2- 172.21.15.5:0/4088047899 >> v2:172.21.15.179:3300/0 conn(0x7f8c1415c9f0 0x7f8c140b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 -- 172.21.15.5:0/4088047899 >> v1:172.21.15.179:6789/0 conn(0x7f8c140b4bf0 legacy=0x7f8c140d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.822+0000 7f8c190ac640 1 -- 172.21.15.5:0/4088047899 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140d3040 con 0x7f8c140cd630 2024-09-13T17:17:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c190ac640 1 --2- 172.21.15.5:0/4088047899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c140cd630 0x7f8c140b46b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8c140b52e0 tx=0x7f8c0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a726bf3ba5117258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c188ab640 1 -- 172.21.15.5:0/4088047899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08032440 con 0x7f8c140cd630 2024-09-13T17:17:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c188ab640 1 -- 172.21.15.5:0/4088047899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c080325a0 con 0x7f8c140cd630 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c188ab640 1 -- 172.21.15.5:0/4088047899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08032930 con 0x7f8c140cd630 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 -- 172.21.15.5:0/4088047899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c140cd630 msgr2=0x7f8c140b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/4088047899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c140cd630 0x7f8c140b46b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8c140b52e0 tx=0x7f8c0802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 -- 172.21.15.5:0/4088047899 shutdown_connections 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/4088047899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c140cd630 0x7f8c140b46b0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/4088047899 >> v2:172.21.15.179:3300/0 conn(0x7f8c1415c9f0 0x7f8c140b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.823+0000 7f8c1bb11640 1 -- 172.21.15.5:0/4088047899 >> 172.21.15.5:0/4088047899 conn(0x7f8c14071a20 msgr2=0x7f8c14071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.824+0000 7f8c1bb11640 1 -- 172.21.15.5:0/4088047899 shutdown_connections 2024-09-13T17:17:16.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.824+0000 7f8c1bb11640 1 -- 172.21.15.5:0/4088047899 wait complete. 2024-09-13T17:17:16.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.825+0000 7f8c1bb11640 1 Processor -- start 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.825+0000 7f8c1bb11640 1 -- start start 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.825+0000 7f8c1bb11640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c140b4bf0 0x7f8c14150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c140cd630 0x7f8c140c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140cc770 con 0x7f8c1415c9f0 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141515d0 con 0x7f8c140cd630 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1415e400 con 0x7f8c140b4bf0 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53110/0 (socket says 172.21.15.5:53110) 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 -- 172.21.15.5:0/3448445761 learned_addr learned my addr 172.21.15.5:0/3448445761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c190ac640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c140cd630 0x7f8c140c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c198ad640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c140b4bf0 0x7f8c14150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 -- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c140b4bf0 msgr2=0x7f8c14150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c140b4bf0 0x7f8c14150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 -- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c140cd630 msgr2=0x7f8c140c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c140cd630 0x7f8c140c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 -- 172.21.15.5:0/3448445761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c080094d0 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1a0ae640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001eb0 tx=0x7f8c0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0052d0 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c005430 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c140c7d90 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c003810 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.826+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1415e980 con 0x7f8c1415c9f0 2024-09-13T17:17:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.827+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140b1d90 con 0x7f8c1415c9f0 2024-09-13T17:17:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.828+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c0c003970 con 0x7f8c1415c9f0 2024-09-13T17:17:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.828+0000 7f8c127fc640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 0x7f8c0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.828+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c0c088950 con 0x7f8c1415c9f0 2024-09-13T17:17:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.829+0000 7f8c198ad640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 0x7f8c0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.829+0000 7f8c198ad640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 0x7f8c0006d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8c140d1ed0 tx=0x7f8c04009800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:16.833+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8c0c053aa0 con 0x7f8c1415c9f0 2024-09-13T17:17:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.004+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c140c5e90 con 0x7f8c1415c9f0 2024-09-13T17:17:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.005+0000 7f8c127fc640 1 -- 172.21.15.5:0/3448445761 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f8c0c017090 con 0x7f8c1415c9f0 2024-09-13T17:17:17.006 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:16.679138+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 msgr2=0x7f8c0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 0x7f8c0006d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8c140d1ed0 tx=0x7f8c04009800 comp rx=0 tx=0).stop 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 msgr2=0x7f8c140caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001eb0 tx=0x7f8c0c00c890 comp rx=0 tx=0).stop 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 shutdown_connections 2024-09-13T17:17:17.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c0006ac00 0x7f8c0006d0c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c1415c9f0 0x7f8c140caef0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c140cd630 0x7f8c140c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 --2- 172.21.15.5:0/3448445761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c140b4bf0 0x7f8c14150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 >> 172.21.15.5:0/3448445761 conn(0x7f8c14071a20 msgr2=0x7f8c140d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 shutdown_connections 2024-09-13T17:17:17.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.007+0000 7f8c1bb11640 1 -- 172.21.15.5:0/3448445761 wait complete. 2024-09-13T17:17:17.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:17.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.119+0000 7f06fc4b1640 1 Processor -- start 2024-09-13T17:17:17.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.119+0000 7f06fc4b1640 1 -- start start 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06fc4b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06f40cb7b0 0x7f06f406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06fc4b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 0x7f06f406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06fc4b1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40b3150 con 0x7f06f41592d0 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06fc4b1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f415cf00 con 0x7f06f40cb7b0 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06fc4b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b3430 con 0x7f06f40cdcb0 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06f40cb7b0 0x7f06f406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06f40cb7b0 0x7f06f406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53126/0 (socket says 172.21.15.5:53126) 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 -- 172.21.15.5:0/1704854040 learned_addr learned my addr 172.21.15.5:0/1704854040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06faa4e640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 0x7f06f406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 -- 172.21.15.5:0/1704854040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 msgr2=0x7f06f406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:17.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 0x7f06f406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 -- 172.21.15.5:0/1704854040 >> v1:172.21.15.179:6789/0 conn(0x7f06f41592d0 legacy=0x7f06f406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06f9a4c640 1 -- 172.21.15.5:0/1704854040 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40b3710 con 0x7f06f40cb7b0 2024-09-13T17:17:17.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.120+0000 7f06faa4e640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 0x7f06f406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.121+0000 7f06f9a4c640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f40cb7b0 0x7f06f406dc60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfbc79457ec73a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.121+0000 7f06f924b640 1 -- 172.21.15.5:0/1704854040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032440 con 0x7f06f40cb7b0 2024-09-13T17:17:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.121+0000 7f06f924b640 1 -- 172.21.15.5:0/1704854040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e40325a0 con 0x7f06f40cb7b0 2024-09-13T17:17:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.121+0000 7f06f924b640 1 -- 172.21.15.5:0/1704854040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032930 con 0x7f06f40cb7b0 2024-09-13T17:17:17.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1704854040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f40cb7b0 msgr2=0x7f06f406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f40cb7b0 0x7f06f406dc60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1704854040 shutdown_connections 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cdcb0 0x7f06f406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1704854040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f40cb7b0 0x7f06f406dc60 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1704854040 >> 172.21.15.5:0/1704854040 conn(0x7f06f4066200 msgr2=0x7f06f4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1704854040 shutdown_connections 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.122+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1704854040 wait complete. 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.123+0000 7f06fc4b1640 1 Processor -- start 2024-09-13T17:17:17.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.123+0000 7f06fc4b1640 1 -- start start 2024-09-13T17:17:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cb7b0 0x7f06f4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40cdcb0 0x7f06f40a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4149550 con 0x7f06f41592d0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40a93e0 con 0x7f06f40cdcb0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06fc4b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f414cf10 con 0x7f06f40cb7b0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06faa4e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06faa4e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53138/0 (socket says 172.21.15.5:53138) 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06faa4e640 1 -- 172.21.15.5:0/1933737755 learned_addr learned my addr 172.21.15.5:0/1933737755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06f9a4c640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40cdcb0 0x7f06f40a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.124+0000 7f06faa4e640 1 -- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cb7b0 msgr2=0x7f06f4148800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06faa4e640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cb7b0 0x7f06f4148800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06faa4e640 1 -- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40cdcb0 msgr2=0x7f06f40a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06faa4e640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40cdcb0 0x7f06f40a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06faa4e640 1 -- 172.21.15.5:0/1933737755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094d0 con 0x7f06f41592d0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06faa4e640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007ef0 tx=0x7f06ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec003b90 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00f040 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f414d1f0 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00de80 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.125+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f414d7b0 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.126+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f40672f0 con 0x7f06f41592d0 2024-09-13T17:17:17.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.126+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06ec004030 con 0x7f06f41592d0 2024-09-13T17:17:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.127+0000 7f06eaffd640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 0x7f06d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.127+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06ec089700 con 0x7f06f41592d0 2024-09-13T17:17:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.127+0000 7f06fa24d640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 0x7f06d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.127+0000 7f06fa24d640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 0x7f06d806d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000f60 tx=0x7f06f00079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.131+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06ec054850 con 0x7f06f41592d0 2024-09-13T17:17:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.302+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06f40b26d0 con 0x7f06f41592d0 2024-09-13T17:17:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.303+0000 7f06eaffd640 1 -- 172.21.15.5:0/1933737755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16754 (secure 0 0 0) 0x7f06ec057e70 con 0x7f06f41592d0 2024-09-13T17:17:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:17.305 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:16.679138+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 msgr2=0x7f06d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 0x7f06d806d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000f60 tx=0x7f06f00079b0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 msgr2=0x7f06f415b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007ef0 tx=0x7f06ec00d4a0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 shutdown_connections 2024-09-13T17:17:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f06d806ac00 0x7f06d806d0c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f41592d0 0x7f06f415b140 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40cdcb0 0x7f06f40a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 --2- 172.21.15.5:0/1933737755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f40cb7b0 0x7f06f4148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 >> 172.21.15.5:0/1933737755 conn(0x7f06f4066200 msgr2=0x7f06f414fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 shutdown_connections 2024-09-13T17:17:17.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.305+0000 7f06fc4b1640 1 -- 172.21.15.5:0/1933737755 wait complete. 2024-09-13T17:17:17.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:17:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.421+0000 7fc23889c640 1 Processor -- start 2024-09-13T17:17:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.421+0000 7fc23889c640 1 -- start start 2024-09-13T17:17:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 0x7fc2340cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2340cb510 0x7fc23415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc23415af90 0x7fc2340703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2340cbf70 con 0x7fc23415af90 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2340cb9b0 con 0x7fc234143800 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23889c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cbc90 con 0x7fc2340cb510 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc23415af90 0x7fc2340703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc23415af90 0x7fc2340703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53146/0 (socket says 172.21.15.5:53146) 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 -- 172.21.15.5:0/1774102225 learned_addr learned my addr 172.21.15.5:0/1774102225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc231d9b640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2340cb510 0x7fc23415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23259c640 1 --2- 172.21.15.5:0/1774102225 >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 0x7fc2340cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 -- 172.21.15.5:0/1774102225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2340cb510 msgr2=0x7fc23415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2340cb510 0x7fc23415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 -- 172.21.15.5:0/1774102225 >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 msgr2=0x7fc2340cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 --2- 172.21.15.5:0/1774102225 >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 0x7fc2340cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc232d9d640 1 -- 172.21.15.5:0/1774102225 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340b1720 con 0x7fc23415af90 2024-09-13T17:17:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.422+0000 7fc23259c640 1 --2- 172.21.15.5:0/1774102225 >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 0x7fc2340cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.423+0000 7fc232d9d640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23415af90 0x7fc2340703e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1260 tx=0x7fc22c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e570cba90af28e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.423+0000 7fc23159a640 1 -- 172.21.15.5:0/1774102225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c031600 con 0x7fc23415af90 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.423+0000 7fc23159a640 1 -- 172.21.15.5:0/1774102225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c02d050 con 0x7fc23415af90 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.423+0000 7fc23159a640 1 -- 172.21.15.5:0/1774102225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c031980 con 0x7fc23415af90 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 -- 172.21.15.5:0/1774102225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23415af90 msgr2=0x7fc2340703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23415af90 0x7fc2340703e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1260 tx=0x7fc22c02a570 comp rx=0 tx=0).stop 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 -- 172.21.15.5:0/1774102225 shutdown_connections 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23415af90 0x7fc2340703e0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 --2- 172.21.15.5:0/1774102225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2340cb510 0x7fc23415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 --2- 172.21.15.5:0/1774102225 >> v2:172.21.15.179:3300/0 conn(0x7fc234143800 0x7fc2340cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 -- 172.21.15.5:0/1774102225 >> 172.21.15.5:0/1774102225 conn(0x7fc2340b02f0 msgr2=0x7fc2340b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 -- 172.21.15.5:0/1774102225 shutdown_connections 2024-09-13T17:17:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.424+0000 7fc23889c640 1 -- 172.21.15.5:0/1774102225 wait complete. 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.425+0000 7fc23889c640 1 Processor -- start 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.425+0000 7fc23889c640 1 -- start start 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2340cb510 0x7fc2340a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc23415af90 0x7fc23412f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340adf40 con 0x7fc234143800 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340c3600 con 0x7fc2340cb510 2024-09-13T17:17:17.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23889c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340c38e0 con 0x7fc23415af90 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53162/0 (socket says 172.21.15.5:53162) 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 -- 172.21.15.5:0/3757185481 learned_addr learned my addr 172.21.15.5:0/3757185481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc232d9d640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc23415af90 0x7fc23412f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc23259c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2340cb510 0x7fc2340a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 -- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc23415af90 msgr2=0x7fc23412f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc23415af90 0x7fc23412f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 -- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2340cb510 msgr2=0x7fc2340a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2340cb510 0x7fc2340a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.426+0000 7fc231d9b640 1 -- 172.21.15.5:0/3757185481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c009b30 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc231d9b640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d800 tx=0x7fc22800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2280096a0 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228009800 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2340a91f0 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228009990 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.427+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2340a8ef0 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.428+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2340672f0 con 0x7fc234143800 2024-09-13T17:17:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.428+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc228009af0 con 0x7fc234143800 2024-09-13T17:17:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.429+0000 7fc222ffd640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 0x7fc21406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.429+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc2280897a0 con 0x7fc234143800 2024-09-13T17:17:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.429+0000 7fc23259c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 0x7fc21406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.430+0000 7fc23259c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 0x7fc21406d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc22400aac0 tx=0x7fc224008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.433+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc228054980 con 0x7fc234143800 2024-09-13T17:17:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.640+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc2340af990 con 0x7fc234143800 2024-09-13T17:17:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.683+0000 7fc222ffd640 1 -- 172.21.15.5:0/3757185481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc228057fa0 con 0x7fc234143800 2024-09-13T17:17:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 msgr2=0x7fc21406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 0x7fc21406d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc22400aac0 tx=0x7fc224008040 comp rx=0 tx=0).stop 2024-09-13T17:17:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 msgr2=0x7fc2340ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d800 tx=0x7fc22800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 shutdown_connections 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc23415af90 0x7fc23412f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc21406ac00 0x7fc21406d0c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc234143800 0x7fc2340ada00 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 --2- 172.21.15.5:0/3757185481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2340cb510 0x7fc2340a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 >> 172.21.15.5:0/3757185481 conn(0x7fc2340b02f0 msgr2=0x7fc2340ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 shutdown_connections 2024-09-13T17:17:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.686+0000 7fc23889c640 1 -- 172.21.15.5:0/3757185481 wait complete. 2024-09-13T17:17:17.698 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:17:17.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:17:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.802+0000 7f007b73e640 1 Processor -- start 2024-09-13T17:17:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.802+0000 7f007b73e640 1 -- start start 2024-09-13T17:17:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.803+0000 7f007b73e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.803+0000 7f007b73e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 0x7f00740cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.803+0000 7f007b73e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074098a50 con 0x7f007406cd20 2024-09-13T17:17:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.803+0000 7f007b73e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0074099360 con 0x7f00740cfb10 2024-09-13T17:17:17.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.803+0000 7f007b73e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074160340 con 0x7f00740ce620 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f00794da640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0079cdb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 0x7f00740cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0078cd9640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f007406cd20 0x7f0074099780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:49938/0 (socket says 172.21.15.5:49938) 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0078cd9640 1 -- 172.21.15.5:0/2948476147 learned_addr learned my addr 172.21.15.5:0/2948476147 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f00794da640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:39070/0 (socket says 172.21.15.5:39070) 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0073fff640 1 -- 172.21.15.5:0/2948476147 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695852391 0 0) 0x7f0074098a50 con 0x7f007406cd20 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0073fff640 1 -- 172.21.15.5:0/2948476147 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c003520 con 0x7f007406cd20 2024-09-13T17:17:17.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0079cdb640 1 -- 172.21.15.5:0/2948476147 >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 msgr2=0x7f007406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0079cdb640 1 --2- 172.21.15.5:0/2948476147 >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0079cdb640 1 -- 172.21.15.5:0/2948476147 >> v1:172.21.15.179:6789/0 conn(0x7f007406cd20 legacy=0x7f0074099780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f0079cdb640 1 -- 172.21.15.5:0/2948476147 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007406c9f0 con 0x7f00740ce620 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.804+0000 7f00794da640 1 --2- 172.21.15.5:0/2948476147 >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f0079cdb640 1 --2- 172.21.15.5:0/2948476147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 0x7f00740cea50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f006c0097a0 tx=0x7f006c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f994137aee8732 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f0073fff640 1 -- 172.21.15.5:0/2948476147 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c02ae50 con 0x7f00740ce620 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f0073fff640 1 -- 172.21.15.5:0/2948476147 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c032440 con 0x7f00740ce620 2024-09-13T17:17:17.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f0073fff640 1 -- 172.21.15.5:0/2948476147 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0327d0 con 0x7f00740ce620 2024-09-13T17:17:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f007b73e640 1 -- 172.21.15.5:0/2948476147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 msgr2=0x7f00740cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.805+0000 7f007b73e640 1 --2- 172.21.15.5:0/2948476147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 0x7f00740cea50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f006c0097a0 tx=0x7f006c02a100 comp rx=0 tx=0).stop 2024-09-13T17:17:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 -- 172.21.15.5:0/2948476147 shutdown_connections 2024-09-13T17:17:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 --2- 172.21.15.5:0/2948476147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00740ce620 0x7f00740cea50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 --2- 172.21.15.5:0/2948476147 >> v2:172.21.15.179:3300/0 conn(0x7f00740cfb10 0x7f007406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 -- 172.21.15.5:0/2948476147 >> 172.21.15.5:0/2948476147 conn(0x7f00740b1ff0 msgr2=0x7f00740b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 -- 172.21.15.5:0/2948476147 shutdown_connections 2024-09-13T17:17:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.806+0000 7f007b73e640 1 -- 172.21.15.5:0/2948476147 wait complete. 2024-09-13T17:17:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.807+0000 7f007b73e640 1 Processor -- start 2024-09-13T17:17:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.807+0000 7f007b73e640 1 -- start start 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f007406cd20 0x7f00740b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00740cfb10 0x7f00741f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740b3940 con 0x7f00740ce620 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740b3350 con 0x7f00740cfb10 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f007b73e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00741f2f40 con 0x7f007406cd20 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53170/0 (socket says 172.21.15.5:53170) 2024-09-13T17:17:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 -- 172.21.15.5:0/3183111792 learned_addr learned my addr 172.21.15.5:0/3183111792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f00794da640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f007406cd20 0x7f00740b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0079cdb640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00740cfb10 0x7f00741f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 -- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f007406cd20 msgr2=0x7f00740b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f007406cd20 0x7f00740b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 -- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00740cfb10 msgr2=0x7f00741f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00740cfb10 0x7f00741f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 -- 172.21.15.5:0/3183111792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009a70 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0078cd9640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f006800c410 tx=0x7f006800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.808+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068005ce0 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.809+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068005e40 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.809+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c009400 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.809+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680072f0 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.809+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740b3560 con 0x7f00740ce620 2024-09-13T17:17:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.810+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00740672f0 con 0x7f00740ce620 2024-09-13T17:17:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.810+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0068007450 con 0x7f00740ce620 2024-09-13T17:17:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.810+0000 7f0071ffb640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 0x7f006006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.811+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0068088990 con 0x7f00740ce620 2024-09-13T17:17:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.811+0000 7f00794da640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 0x7f006006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.811+0000 7f00794da640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 0x7f006006d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0064009fd0 tx=0x7f006400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:17.815+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0068053c30 con 0x7f00740ce620 2024-09-13T17:17:18.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.026+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f00740b3a80 con 0x7f00740ce620 2024-09-13T17:17:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.688+0000 7f0071ffb640 1 -- 172.21.15.5:0/3183111792 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00740b3a80 con 0x7f00740ce620 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 msgr2=0x7f006006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 0x7f006006d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0064009fd0 tx=0x7f006400b040 comp rx=0 tx=0).stop 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 msgr2=0x7f00740cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f006800c410 tx=0x7f006800c8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 shutdown_connections 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00740cfb10 0x7f00741f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f006006ac00 0x7f006006d0c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00740ce620 0x7f00740cb010 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 --2- 172.21.15.5:0/3183111792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f007406cd20 0x7f00740b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 >> 172.21.15.5:0/3183111792 conn(0x7f00740b1ff0 msgr2=0x7f0074099780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.690+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 shutdown_connections 2024-09-13T17:17:18.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.691+0000 7f007b73e640 1 -- 172.21.15.5:0/3183111792 wait complete. 2024-09-13T17:17:18.705 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:17:18.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:18.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.812+0000 7f12daf5a640 1 Processor -- start 2024-09-13T17:17:18.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.812+0000 7f12daf5a640 1 -- start start 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12daf5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 0x7f12d40cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12daf5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40b2180 con 0x7f12d415a880 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12daf5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40b2420 con 0x7f12d415a4a0 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12daf5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b2700 con 0x7f12d40cb6c0 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12d3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12d415a880 0x7f12d415afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59926/0 (socket says 172.21.15.5:59926) 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.813+0000 7f12d3fff640 1 -- 172.21.15.5:0/2305442474 learned_addr learned my addr 172.21.15.5:0/2305442474 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d94f7640 1 --2- 172.21.15.5:0/2305442474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 0x7f12d40cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:18.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851551689 0 0) 0x7f12d40b2180 con 0x7f12d415a880 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c0003520 con 0x7f12d415a880 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152997469 0 0) 0x7f12d40b2420 con 0x7f12d415a4a0 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d40b2180 con 0x7f12d415a4a0 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048720524 0 0) 0x7f12c0003520 con 0x7f12d415a880 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d94f7640 1 -- 172.21.15.5:0/2305442474 >> v1:172.21.15.179:6789/0 conn(0x7f12d415a4a0 legacy=0x7f12d40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d94f7640 1 -- 172.21.15.5:0/2305442474 >> v1:172.21.15.5:6789/0 conn(0x7f12d415a880 legacy=0x7f12d415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.814+0000 7f12d94f7640 1 -- 172.21.15.5:0/2305442474 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40ce330 con 0x7f12d40cb6c0 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12d94f7640 1 --2- 172.21.15.5:0/2305442474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 0x7f12d40cdc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009dc0 tx=0x7f12cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca00ca3b4bba05bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc001670 con 0x7f12d40cb6c0 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc02d050 con 0x7f12d40cb6c0 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12d37fe640 1 -- 172.21.15.5:0/2305442474 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc007760 con 0x7f12d40cb6c0 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12daf5a640 1 -- 172.21.15.5:0/2305442474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 msgr2=0x7f12d40cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12daf5a640 1 --2- 172.21.15.5:0/2305442474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 0x7f12d40cdc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009dc0 tx=0x7f12cc02a660 comp rx=0 tx=0).stop 2024-09-13T17:17:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12daf5a640 1 -- 172.21.15.5:0/2305442474 shutdown_connections 2024-09-13T17:17:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12daf5a640 1 --2- 172.21.15.5:0/2305442474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d40cb6c0 0x7f12d40cdc50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.815+0000 7f12daf5a640 1 -- 172.21.15.5:0/2305442474 >> 172.21.15.5:0/2305442474 conn(0x7f12d4066200 msgr2=0x7f12d4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.816+0000 7f12daf5a640 1 -- 172.21.15.5:0/2305442474 shutdown_connections 2024-09-13T17:17:18.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.816+0000 7f12daf5a640 1 -- 172.21.15.5:0/2305442474 wait complete. 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.817+0000 7f12daf5a640 1 Processor -- start 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.817+0000 7f12daf5a640 1 -- start start 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d415a4a0 0x7f12d40af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12d415a880 0x7f12d40afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b04e0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41f63d0 con 0x7f12d415a880 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41f2050 con 0x7f12d415a4a0 2024-09-13T17:17:18.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53182/0 (socket says 172.21.15.5:53182) 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 -- 172.21.15.5:0/1761199214 learned_addr learned my addr 172.21.15.5:0/1761199214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d3fff640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d415a4a0 0x7f12d40af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d94f7640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12d415a880 0x7f12d40afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 -- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d415a4a0 msgr2=0x7f12d40af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d415a4a0 0x7f12d40af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 -- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12d415a880 msgr2=0x7f12d40afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12d415a880 0x7f12d40afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 -- 172.21.15.5:0/1761199214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc009a70 con 0x7f12d40cb6c0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d8cf6640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c490 tx=0x7f12c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40052d0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4005430 con 0x7f12d40cb6c0 2024-09-13T17:17:18.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d41f2dd0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.818+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4012870 con 0x7f12d40cb6c0 2024-09-13T17:17:18.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.819+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d41f25d0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.820+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d40672f0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.820+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f12c40129d0 con 0x7f12d40cb6c0 2024-09-13T17:17:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.821+0000 7f12d17fa640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 0x7f12b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.821+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12c4089010 con 0x7f12d40cb6c0 2024-09-13T17:17:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.821+0000 7f12d3fff640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 0x7f12b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:18.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.821+0000 7f12d3fff640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 0x7f12b406d0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f12d40c63f0 tx=0x7f12bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:18.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:18.825+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f12c4054140 con 0x7f12d40cb6c0 2024-09-13T17:17:19.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.034+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12d40cdc50 con 0x7f12d40cb6c0 2024-09-13T17:17:19.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.035+0000 7f12d17fa640 1 -- 172.21.15.5:0/1761199214 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f12c4057760 con 0x7f12d40cb6c0 2024-09-13T17:17:19.036 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:19.036 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:19.037 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 msgr2=0x7f12b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 0x7f12b406d0c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f12d40c63f0 tx=0x7f12bc009040 comp rx=0 tx=0).stop 2024-09-13T17:17:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 msgr2=0x7f12d40cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c490 tx=0x7f12c400c950 comp rx=0 tx=0).stop 2024-09-13T17:17:19.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 shutdown_connections 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12d415a880 0x7f12d40afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12d415a4a0 0x7f12d40af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f12b406ac00 0x7f12b406d0c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 --2- 172.21.15.5:0/1761199214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d40cb6c0 0x7f12d40cae10 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 >> 172.21.15.5:0/1761199214 conn(0x7f12d4066200 msgr2=0x7f12d406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 shutdown_connections 2024-09-13T17:17:19.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.037+0000 7f12daf5a640 1 -- 172.21.15.5:0/1761199214 wait complete. 2024-09-13T17:17:19.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:19.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.149+0000 7f82b5d11640 1 Processor -- start 2024-09-13T17:17:19.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 -- start start 2024-09-13T17:17:19.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82b00cd630 0x7f82b00b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b00b4bf0 0x7f82b00d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00b8750 con 0x7f82b00b4bf0 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00b5040 con 0x7f82b00cd630 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.150+0000 7f82b5d11640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00d2c20 con 0x7f82b015c9f0 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b00b4bf0 0x7f82b00d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82b00b4bf0 0x7f82b00d09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53194/0 (socket says 172.21.15.5:53194) 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 -- 172.21.15.5:0/290318744 learned_addr learned my addr 172.21.15.5:0/290318744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82af7fe640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 -- 172.21.15.5:0/290318744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 msgr2=0x7f82b00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b00b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 -- 172.21.15.5:0/290318744 >> v2:172.21.15.179:3300/0 conn(0x7f82b00cd630 msgr2=0x7f82b00b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 --2- 172.21.15.5:0/290318744 >> v2:172.21.15.179:3300/0 conn(0x7f82b00cd630 0x7f82b00b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.151+0000 7f82affff640 1 -- 172.21.15.5:0/290318744 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b015cdd0 con 0x7f82b00b4bf0 2024-09-13T17:17:19.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82affff640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00d09a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f82b00d3360 tx=0x7f82a802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58848b56699eebe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82ae7fc640 1 -- 172.21.15.5:0/290318744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8031600 con 0x7f82b00b4bf0 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82ae7fc640 1 -- 172.21.15.5:0/290318744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a802d050 con 0x7f82b00b4bf0 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82ae7fc640 1 -- 172.21.15.5:0/290318744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8031980 con 0x7f82b00b4bf0 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 -- 172.21.15.5:0/290318744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 msgr2=0x7f82b00d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00d09a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f82b00d3360 tx=0x7f82a802a610 comp rx=0 tx=0).stop 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 -- 172.21.15.5:0/290318744 shutdown_connections 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00d09a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 --2- 172.21.15.5:0/290318744 >> v2:172.21.15.179:3300/0 conn(0x7f82b00cd630 0x7f82b00b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 --2- 172.21.15.5:0/290318744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 -- 172.21.15.5:0/290318744 >> 172.21.15.5:0/290318744 conn(0x7f82b0071a20 msgr2=0x7f82b0071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 -- 172.21.15.5:0/290318744 shutdown_connections 2024-09-13T17:17:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.152+0000 7f82b5d11640 1 -- 172.21.15.5:0/290318744 wait complete. 2024-09-13T17:17:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.153+0000 7f82b5d11640 1 Processor -- start 2024-09-13T17:17:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 -- start start 2024-09-13T17:17:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b00cd630 0x7f82b01f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c5e90 con 0x7f82b00b4bf0 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cc750 con 0x7f82b00cd630 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.154+0000 7f82b5d11640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c73d0 con 0x7f82b015c9f0 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53208/0 (socket says 172.21.15.5:53208) 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 -- 172.21.15.5:0/738244859 learned_addr learned my addr 172.21.15.5:0/738244859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82affff640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82aeffd640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b00cd630 0x7f82b01f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 -- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 msgr2=0x7f82b01f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b01f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 -- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b00cd630 msgr2=0x7f82b01f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b00cd630 0x7f82b01f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 -- 172.21.15.5:0/738244859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009b30 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82af7fe640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c7f0 tx=0x7f82a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004220 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0004380 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b014bb70 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0003830 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.155+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b015fc90 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.156+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b015fe80 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.157+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82a0003ba0 con 0x7f82b00b4bf0 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.157+0000 7f8297fff640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 0x7f829c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.157+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82a0089340 con 0x7f82b00b4bf0 2024-09-13T17:17:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.158+0000 7f82aeffd640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 0x7f829c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.158+0000 7f82aeffd640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 0x7f829c06d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ced50 tx=0x7f82a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.161+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f82a00543e0 con 0x7f82b00b4bf0 2024-09-13T17:17:19.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.335+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82b00b1d90 con 0x7f82b00b4bf0 2024-09-13T17:17:19.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.336+0000 7f8297fff640 1 -- 172.21.15.5:0/738244859 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f82a0057a00 con 0x7f82b00b4bf0 2024-09-13T17:17:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:19.337 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 msgr2=0x7f829c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 0x7f829c06d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ced50 tx=0x7f82a4008040 comp rx=0 tx=0).stop 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 msgr2=0x7f82b00cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c7f0 tx=0x7f82a000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 shutdown_connections 2024-09-13T17:17:19.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82b015c9f0 0x7f82b01f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82b00cd630 0x7f82b01f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f829c06ac00 0x7f829c06d0c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 --2- 172.21.15.5:0/738244859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82b00b4bf0 0x7f82b00cc210 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 >> 172.21.15.5:0/738244859 conn(0x7f82b0071a20 msgr2=0x7f82b00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 shutdown_connections 2024-09-13T17:17:19.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.338+0000 7f82b5d11640 1 -- 172.21.15.5:0/738244859 wait complete. 2024-09-13T17:17:19.350 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:17:19.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.450+0000 7f1ca837d640 1 Processor -- start 2024-09-13T17:17:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.450+0000 7f1ca837d640 1 -- start start 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.451+0000 7f1ca837d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.451+0000 7f1ca837d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ca006e370 0x7f1ca015d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.451+0000 7f1ca837d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00b3150 con 0x7f1ca00cb7b0 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.451+0000 7f1ca837d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca015cf00 con 0x7f1ca006e370 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.451+0000 7f1ca837d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b3430 con 0x7f1ca01592d0 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca6119640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca691a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1ca006e370 0x7f1ca015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca6119640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca006c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55270/0 (socket says 172.21.15.5:55270) 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca5918640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1ca00cb7b0 0x7f1ca006dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:49964/0 (socket says 172.21.15.5:49964) 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca6119640 1 -- 172.21.15.5:0/2128477183 learned_addr learned my addr 172.21.15.5:0/2128477183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca691a640 1 -- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 msgr2=0x7f1ca006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca691a640 1 --2- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca006c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca691a640 1 -- 172.21.15.5:0/2128477183 >> v1:172.21.15.179:6789/0 conn(0x7f1ca00cb7b0 legacy=0x7f1ca006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca691a640 1 -- 172.21.15.5:0/2128477183 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00b3710 con 0x7f1ca006e370 2024-09-13T17:17:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.452+0000 7f1ca5117640 1 -- 172.21.15.5:0/2128477183 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749258501 0 0) 0x7f1ca00b3150 con 0x7f1ca00cb7b0 2024-09-13T17:17:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca691a640 1 --2- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca015d350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009d90 tx=0x7f1c9002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c423afb6753e87ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca5117640 1 -- 172.21.15.5:0/2128477183 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031600 con 0x7f1ca006e370 2024-09-13T17:17:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca5117640 1 -- 172.21.15.5:0/2128477183 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9002d050 con 0x7f1ca006e370 2024-09-13T17:17:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca5117640 1 -- 172.21.15.5:0/2128477183 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031980 con 0x7f1ca006e370 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca837d640 1 -- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 msgr2=0x7f1ca015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.453+0000 7f1ca837d640 1 --2- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca015d350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009d90 tx=0x7f1c9002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 -- 172.21.15.5:0/2128477183 shutdown_connections 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 --2- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca015d350 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 --2- 172.21.15.5:0/2128477183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 -- 172.21.15.5:0/2128477183 >> 172.21.15.5:0/2128477183 conn(0x7f1ca0066200 msgr2=0x7f1ca0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 -- 172.21.15.5:0/2128477183 shutdown_connections 2024-09-13T17:17:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.454+0000 7f1ca837d640 1 -- 172.21.15.5:0/2128477183 wait complete. 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.455+0000 7f1ca837d640 1 Processor -- start 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.455+0000 7f1ca837d640 1 -- start start 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca0144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0159f50 con 0x7f1ca00cb7b0 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00ad1e0 con 0x7f1ca006e370 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca837d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00acc20 con 0x7f1ca01592d0 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca5918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca5918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53210/0 (socket says 172.21.15.5:53210) 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:39136/0 (socket says 172.21.15.5:39136) 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca5918640 1 -- 172.21.15.5:0/143918331 learned_addr learned my addr 172.21.15.5:0/143918331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca691a640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca0144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 -- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 msgr2=0x7f1ca0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca0144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 -- 172.21.15.5:0/143918331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 msgr2=0x7f1ca0150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 -- 172.21.15.5:0/143918331 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009a70 con 0x7f1ca006e370 2024-09-13T17:17:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca5918640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.456+0000 7f1ca6119640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e850 tx=0x7f1c9800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.457+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800c940 con 0x7f1ca006e370 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.457+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800caa0 con 0x7f1ca006e370 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.457+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800ce10 con 0x7f1ca006e370 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.457+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00acf00 con 0x7f1ca006e370 2024-09-13T17:17:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.457+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00ac810 con 0x7f1ca006e370 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.458+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca00672f0 con 0x7f1ca006e370 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.458+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c98013470 con 0x7f1ca006e370 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.459+0000 7f1c9effd640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 0x7f1c8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.459+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1c98089540 con 0x7f1ca006e370 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.459+0000 7f1ca5918640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 0x7f1c8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.459+0000 7f1ca5918640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 0x7f1c8c06d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1ca01f5130 tx=0x7f1c94007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.464+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1c98054700 con 0x7f1ca006e370 2024-09-13T17:17:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.631+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ca01596b0 con 0x7f1c8c06ac00 2024-09-13T17:17:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.639+0000 7f1c9effd640 1 -- 172.21.15.5:0/143918331 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289112 (secure 0 0 0) 0x7f1c94004e30 con 0x7f1c8c06ac00 2024-09-13T17:17:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:19.646 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:19.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 msgr2=0x7f1c8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 0x7f1c8c06d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1ca01f5130 tx=0x7f1c94007de0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 msgr2=0x7f1ca00ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e850 tx=0x7f1c9800ed10 comp rx=0 tx=0).stop 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 shutdown_connections 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ca01592d0 0x7f1ca0144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1c8c06ac00 0x7f1c8c06d0c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca00cb7b0 0x7f1ca0150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 --2- 172.21.15.5:0/143918331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ca006e370 0x7f1ca00ac2d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 >> 172.21.15.5:0/143918331 conn(0x7f1ca0066200 msgr2=0x7f1ca00708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 shutdown_connections 2024-09-13T17:17:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.642+0000 7f1ca837d640 1 -- 172.21.15.5:0/143918331 wait complete. 2024-09-13T17:17:19.654 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T17:17:19.315458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241584,"kb_used_data":9004,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754733136,"statfs":{"total":773094113280,"available":772846731264,"internally_reserved":0,"allocated":9220096,"data_stored":4805677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.006006"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706271+0000","last_change":"2024-09-13T17:17:16.700126+0000","last_active":"2024-09-13T17:17:16.706271+0000","last_peered":"2024-09-13T17:17:16.706271+0000","last_clean":"2024-09-13T17:17:16.706271+0000","last_became_active":"2024-09-13T17:17:16.699842+0000","last_became_peered":"2024-09-13T17:17:16.699842+0000","last_unstale":"2024-09-13T17:17:16.706271+0000","last_undegraded":"2024-09-13T17:17:16.706271+0000","last_fullsized":"2024-09-13T17:17:16.706271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:03.048104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707228+0000","last_change":"2024-09-13T17:17:16.703071+0000","last_active":"2024-09-13T17:17:16.707228+0000","last_peered":"2024-09-13T17:17:16.707228+0000","last_clean":"2024-09-13T17:17:16.707228+0000","last_became_active":"2024-09-13T17:17:16.702823+0000","last_became_peered":"2024-09-13T17:17:16.702823+0000","last_unstale":"2024-09-13T17:17:16.707228+0000","last_undegraded":"2024-09-13T17:17:16.707228+0000","last_fullsized":"2024-09-13T17:17:16.707228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:22.567906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.695628+0000","last_change":"2024-09-13T17:17:16.693648+0000","last_active":"2024-09-13T17:17:16.695628+0000","last_peered":"2024-09-13T17:17:16.695628+0000","last_clean":"2024-09-13T17:17:16.695628+0000","last_became_active":"2024-09-13T17:17:16.693309+0000","last_became_peered":"2024-09-13T17:17:16.693309+0000","last_unstale":"2024-09-13T17:17:16.695628+0000","last_undegraded":"2024-09-13T17:17:16.695628+0000","last_fullsized":"2024-09-13T17:17:16.695628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.699446+0000","last_change":"2024-09-13T17:17:16.694656+0000","last_active":"2024-09-13T17:17:16.699446+0000","last_peered":"2024-09-13T17:17:16.699446+0000","last_clean":"2024-09-13T17:17:16.699446+0000","last_became_active":"2024-09-13T17:17:16.694352+0000","last_became_peered":"2024-09-13T17:17:16.694352+0000","last_unstale":"2024-09-13T17:17:16.699446+0000","last_undegraded":"2024-09-13T17:17:16.699446+0000","last_fullsized":"2024-09-13T17:17:16.699446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709994+0000","last_change":"2024-09-13T17:17:16.707940+0000","last_active":"2024-09-13T17:17:16.709994+0000","last_peered":"2024-09-13T17:17:16.709994+0000","last_clean":"2024-09-13T17:17:16.709994+0000","last_became_active":"2024-09-13T17:17:16.707567+0000","last_became_peered":"2024-09-13T17:17:16.707567+0000","last_unstale":"2024-09-13T17:17:16.709994+0000","last_undegraded":"2024-09-13T17:17:16.709994+0000","last_fullsized":"2024-09-13T17:17:16.709994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.302094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702478+0000","last_change":"2024-09-13T17:17:16.700282+0000","last_active":"2024-09-13T17:17:16.702478+0000","last_peered":"2024-09-13T17:17:16.702478+0000","last_clean":"2024-09-13T17:17:16.702478+0000","last_became_active":"2024-09-13T17:17:16.699991+0000","last_became_peered":"2024-09-13T17:17:16.699991+0000","last_unstale":"2024-09-13T17:17:16.702478+0000","last_undegraded":"2024-09-13T17:17:16.702478+0000","last_fullsized":"2024-09-13T17:17:16.702478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:00.237030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704683+0000","last_change":"2024-09-13T17:17:16.700982+0000","last_active":"2024-09-13T17:17:16.704683+0000","last_peered":"2024-09-13T17:17:16.704683+0000","last_clean":"2024-09-13T17:17:16.704683+0000","last_became_active":"2024-09-13T17:17:16.700723+0000","last_became_peered":"2024-09-13T17:17:16.700723+0000","last_unstale":"2024-09-13T17:17:16.704683+0000","last_undegraded":"2024-09-13T17:17:16.704683+0000","last_fullsized":"2024-09-13T17:17:16.704683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:52.730759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710309+0000","last_change":"2024-09-13T17:17:16.708011+0000","last_active":"2024-09-13T17:17:16.710309+0000","last_peered":"2024-09-13T17:17:16.710309+0000","last_clean":"2024-09-13T17:17:16.710309+0000","last_became_active":"2024-09-13T17:17:16.707599+0000","last_became_peered":"2024-09-13T17:17:16.707599+0000","last_unstale":"2024-09-13T17:17:16.710309+0000","last_undegraded":"2024-09-13T17:17:16.710309+0000","last_fullsized":"2024-09-13T17:17:16.710309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:34.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702667+0000","last_change":"2024-09-13T17:17:16.698934+0000","last_active":"2024-09-13T17:17:16.702667+0000","last_peered":"2024-09-13T17:17:16.702667+0000","last_clean":"2024-09-13T17:17:16.702667+0000","last_became_active":"2024-09-13T17:17:16.698535+0000","last_became_peered":"2024-09-13T17:17:16.698535+0000","last_unstale":"2024-09-13T17:17:16.702667+0000","last_undegraded":"2024-09-13T17:17:16.702667+0000","last_fullsized":"2024-09-13T17:17:16.702667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:57.713115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703913+0000","last_change":"2024-09-13T17:17:16.700184+0000","last_active":"2024-09-13T17:17:16.703913+0000","last_peered":"2024-09-13T17:17:16.703913+0000","last_clean":"2024-09-13T17:17:16.703913+0000","last_became_active":"2024-09-13T17:17:16.699054+0000","last_became_peered":"2024-09-13T17:17:16.699054+0000","last_unstale":"2024-09-13T17:17:16.703913+0000","last_undegraded":"2024-09-13T17:17:16.703913+0000","last_fullsized":"2024-09-13T17:17:16.703913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708154+0000","last_change":"2024-09-13T17:17:16.703205+0000","last_active":"2024-09-13T17:17:16.708154+0000","last_peered":"2024-09-13T17:17:16.708154+0000","last_clean":"2024-09-13T17:17:16.708154+0000","last_became_active":"2024-09-13T17:17:16.702953+0000","last_became_peered":"2024-09-13T17:17:16.702953+0000","last_unstale":"2024-09-13T17:17:16.708154+0000","last_undegraded":"2024-09-13T17:17:16.708154+0000","last_fullsized":"2024-09-13T17:17:16.708154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:30.426816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702395+0000","last_change":"2024-09-13T17:17:16.696874+0000","last_active":"2024-09-13T17:17:16.702395+0000","last_peered":"2024-09-13T17:17:16.702395+0000","last_clean":"2024-09-13T17:17:16.702395+0000","last_became_active":"2024-09-13T17:17:16.696549+0000","last_became_peered":"2024-09-13T17:17:16.696549+0000","last_unstale":"2024-09-13T17:17:16.702395+0000","last_undegraded":"2024-09-13T17:17:16.702395+0000","last_fullsized":"2024-09-13T17:17:16.702395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:04.713078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709956+0000","last_change":"2024-09-13T17:17:16.707367+0000","last_active":"2024-09-13T17:17:16.709956+0000","last_peered":"2024-09-13T17:17:16.709956+0000","last_clean":"2024-09-13T17:17:16.709956+0000","last_became_active":"2024-09-13T17:17:16.707063+0000","last_became_peered":"2024-09-13T17:17:16.707063+0000","last_unstale":"2024-09-13T17:17:16.709956+0000","last_undegraded":"2024-09-13T17:17:16.709956+0000","last_fullsized":"2024-09-13T17:17:16.709956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:35.833166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702979+0000","last_change":"2024-09-13T17:17:16.702163+0000","last_active":"2024-09-13T17:17:16.702979+0000","last_peered":"2024-09-13T17:17:16.702979+0000","last_clean":"2024-09-13T17:17:16.702979+0000","last_became_active":"2024-09-13T17:17:16.701897+0000","last_became_peered":"2024-09-13T17:17:16.701897+0000","last_unstale":"2024-09-13T17:17:16.702979+0000","last_undegraded":"2024-09-13T17:17:16.702979+0000","last_fullsized":"2024-09-13T17:17:16.702979+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:26.687422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705618+0000","last_change":"2024-09-13T17:17:16.696377+0000","last_active":"2024-09-13T17:17:16.705618+0000","last_peered":"2024-09-13T17:17:16.705618+0000","last_clean":"2024-09-13T17:17:16.705618+0000","last_became_active":"2024-09-13T17:17:16.696121+0000","last_became_peered":"2024-09-13T17:17:16.696121+0000","last_unstale":"2024-09-13T17:17:16.705618+0000","last_undegraded":"2024-09-13T17:17:16.705618+0000","last_fullsized":"2024-09-13T17:17:16.705618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:09.856348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700133+0000","last_change":"2024-09-13T17:17:16.696007+0000","last_active":"2024-09-13T17:17:16.700133+0000","last_peered":"2024-09-13T17:17:16.700133+0000","last_clean":"2024-09-13T17:17:16.700133+0000","last_became_active":"2024-09-13T17:17:16.695391+0000","last_became_peered":"2024-09-13T17:17:16.695391+0000","last_unstale":"2024-09-13T17:17:16.700133+0000","last_undegraded":"2024-09-13T17:17:16.700133+0000","last_fullsized":"2024-09-13T17:17:16.700133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:29.614611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710397+0000","last_change":"2024-09-13T17:17:16.704342+0000","last_active":"2024-09-13T17:17:16.710397+0000","last_peered":"2024-09-13T17:17:16.710397+0000","last_clean":"2024-09-13T17:17:16.710397+0000","last_became_active":"2024-09-13T17:17:16.704042+0000","last_became_peered":"2024-09-13T17:17:16.704042+0000","last_unstale":"2024-09-13T17:17:16.710397+0000","last_undegraded":"2024-09-13T17:17:16.710397+0000","last_fullsized":"2024-09-13T17:17:16.710397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:42.127758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696190+0000","last_change":"2024-09-13T17:17:16.695375+0000","last_active":"2024-09-13T17:17:16.696190+0000","last_peered":"2024-09-13T17:17:16.696190+0000","last_clean":"2024-09-13T17:17:16.696190+0000","last_became_active":"2024-09-13T17:17:16.695132+0000","last_became_peered":"2024-09-13T17:17:16.695132+0000","last_unstale":"2024-09-13T17:17:16.696190+0000","last_undegraded":"2024-09-13T17:17:16.696190+0000","last_fullsized":"2024-09-13T17:17:16.696190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708720+0000","last_change":"2024-09-13T17:17:16.707791+0000","last_active":"2024-09-13T17:17:16.708720+0000","last_peered":"2024-09-13T17:17:16.708720+0000","last_clean":"2024-09-13T17:17:16.708720+0000","last_became_active":"2024-09-13T17:17:16.707486+0000","last_became_peered":"2024-09-13T17:17:16.707486+0000","last_unstale":"2024-09-13T17:17:16.708720+0000","last_undegraded":"2024-09-13T17:17:16.708720+0000","last_fullsized":"2024-09-13T17:17:16.708720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:57.084204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710072+0000","last_change":"2024-09-13T17:17:16.707169+0000","last_active":"2024-09-13T17:17:16.710072+0000","last_peered":"2024-09-13T17:17:16.710072+0000","last_clean":"2024-09-13T17:17:16.710072+0000","last_became_active":"2024-09-13T17:17:16.706913+0000","last_became_peered":"2024-09-13T17:17:16.706913+0000","last_unstale":"2024-09-13T17:17:16.710072+0000","last_undegraded":"2024-09-13T17:17:16.710072+0000","last_fullsized":"2024-09-13T17:17:16.710072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:33.132730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700178+0000","last_change":"2024-09-13T17:17:16.695644+0000","last_active":"2024-09-13T17:17:16.700178+0000","last_peered":"2024-09-13T17:17:16.700178+0000","last_clean":"2024-09-13T17:17:16.700178+0000","last_became_active":"2024-09-13T17:17:16.694893+0000","last_became_peered":"2024-09-13T17:17:16.694893+0000","last_unstale":"2024-09-13T17:17:16.700178+0000","last_undegraded":"2024-09-13T17:17:16.700178+0000","last_fullsized":"2024-09-13T17:17:16.700178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:07.162520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696506+0000","last_change":"2024-09-13T17:17:16.695693+0000","last_active":"2024-09-13T17:17:16.696506+0000","last_peered":"2024-09-13T17:17:16.696506+0000","last_clean":"2024-09-13T17:17:16.696506+0000","last_became_active":"2024-09-13T17:17:16.695436+0000","last_became_peered":"2024-09-13T17:17:16.695436+0000","last_unstale":"2024-09-13T17:17:16.696506+0000","last_undegraded":"2024-09-13T17:17:16.696506+0000","last_fullsized":"2024-09-13T17:17:16.696506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:15.635442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700031+0000","last_change":"2024-09-13T17:17:16.694234+0000","last_active":"2024-09-13T17:17:16.700031+0000","last_peered":"2024-09-13T17:17:16.700031+0000","last_clean":"2024-09-13T17:17:16.700031+0000","last_became_active":"2024-09-13T17:17:16.693568+0000","last_became_peered":"2024-09-13T17:17:16.693568+0000","last_unstale":"2024-09-13T17:17:16.700031+0000","last_undegraded":"2024-09-13T17:17:16.700031+0000","last_fullsized":"2024-09-13T17:17:16.700031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:49.824795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702901+0000","last_change":"2024-09-13T17:17:16.694091+0000","last_active":"2024-09-13T17:17:16.702901+0000","last_peered":"2024-09-13T17:17:16.702901+0000","last_clean":"2024-09-13T17:17:16.702901+0000","last_became_active":"2024-09-13T17:17:16.693856+0000","last_became_peered":"2024-09-13T17:17:16.693856+0000","last_unstale":"2024-09-13T17:17:16.702901+0000","last_undegraded":"2024-09-13T17:17:16.702901+0000","last_fullsized":"2024-09-13T17:17:16.702901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:16.347199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702793+0000","last_change":"2024-09-13T17:17:16.693560+0000","last_active":"2024-09-13T17:17:16.702793+0000","last_peered":"2024-09-13T17:17:16.702793+0000","last_clean":"2024-09-13T17:17:16.702793+0000","last_became_active":"2024-09-13T17:17:16.693290+0000","last_became_peered":"2024-09-13T17:17:16.693290+0000","last_unstale":"2024-09-13T17:17:16.702793+0000","last_undegraded":"2024-09-13T17:17:16.702793+0000","last_fullsized":"2024-09-13T17:17:16.702793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:00.237030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.698790+0000","last_change":"2024-09-13T17:17:16.692756+0000","last_active":"2024-09-13T17:17:16.698790+0000","last_peered":"2024-09-13T17:17:16.698790+0000","last_clean":"2024-09-13T17:17:16.698790+0000","last_became_active":"2024-09-13T17:17:16.692433+0000","last_became_peered":"2024-09-13T17:17:16.692433+0000","last_unstale":"2024-09-13T17:17:16.698790+0000","last_undegraded":"2024-09-13T17:17:16.698790+0000","last_fullsized":"2024-09-13T17:17:16.698790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:46.568550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700090+0000","last_change":"2024-09-13T17:17:16.695658+0000","last_active":"2024-09-13T17:17:16.700090+0000","last_peered":"2024-09-13T17:17:16.700090+0000","last_clean":"2024-09-13T17:17:16.700090+0000","last_became_active":"2024-09-13T17:17:16.695267+0000","last_became_peered":"2024-09-13T17:17:16.695267+0000","last_unstale":"2024-09-13T17:17:16.700090+0000","last_undegraded":"2024-09-13T17:17:16.700090+0000","last_fullsized":"2024-09-13T17:17:16.700090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:44.037795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700724+0000","last_change":"2024-09-13T17:17:16.699533+0000","last_active":"2024-09-13T17:17:16.700724+0000","last_peered":"2024-09-13T17:17:16.700724+0000","last_clean":"2024-09-13T17:17:16.700724+0000","last_became_active":"2024-09-13T17:17:16.699295+0000","last_became_peered":"2024-09-13T17:17:16.699295+0000","last_unstale":"2024-09-13T17:17:16.700724+0000","last_undegraded":"2024-09-13T17:17:16.700724+0000","last_fullsized":"2024-09-13T17:17:16.700724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:39.481312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706332+0000","last_change":"2024-09-13T17:17:16.702981+0000","last_active":"2024-09-13T17:17:16.706332+0000","last_peered":"2024-09-13T17:17:16.706332+0000","last_clean":"2024-09-13T17:17:16.706332+0000","last_became_active":"2024-09-13T17:17:16.702695+0000","last_became_peered":"2024-09-13T17:17:16.702695+0000","last_unstale":"2024-09-13T17:17:16.706332+0000","last_undegraded":"2024-09-13T17:17:16.706332+0000","last_fullsized":"2024-09-13T17:17:16.706332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:48.297780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700243+0000","last_change":"2024-09-13T17:17:16.697012+0000","last_active":"2024-09-13T17:17:16.700243+0000","last_peered":"2024-09-13T17:17:16.700243+0000","last_clean":"2024-09-13T17:17:16.700243+0000","last_became_active":"2024-09-13T17:17:16.696727+0000","last_became_peered":"2024-09-13T17:17:16.696727+0000","last_unstale":"2024-09-13T17:17:16.700243+0000","last_undegraded":"2024-09-13T17:17:16.700243+0000","last_fullsized":"2024-09-13T17:17:16.700243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:08.431777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703171+0000","last_change":"2024-09-13T17:17:16.699517+0000","last_active":"2024-09-13T17:17:16.703171+0000","last_peered":"2024-09-13T17:17:16.703171+0000","last_clean":"2024-09-13T17:17:16.703171+0000","last_became_active":"2024-09-13T17:17:16.699261+0000","last_became_peered":"2024-09-13T17:17:16.699261+0000","last_unstale":"2024-09-13T17:17:16.703171+0000","last_undegraded":"2024-09-13T17:17:16.703171+0000","last_fullsized":"2024-09-13T17:17:16.703171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:41.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700149+0000","last_change":"2024-09-13T17:17:16.696180+0000","last_active":"2024-09-13T17:17:16.700149+0000","last_peered":"2024-09-13T17:17:16.700149+0000","last_clean":"2024-09-13T17:17:16.700149+0000","last_became_active":"2024-09-13T17:17:16.695749+0000","last_became_peered":"2024-09-13T17:17:16.695749+0000","last_unstale":"2024-09-13T17:17:16.700149+0000","last_undegraded":"2024-09-13T17:17:16.700149+0000","last_fullsized":"2024-09-13T17:17:16.700149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:10.786062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696765+0000","last_change":"2024-09-13T17:17:16.694984+0000","last_active":"2024-09-13T17:17:16.696765+0000","last_peered":"2024-09-13T17:17:16.696765+0000","last_clean":"2024-09-13T17:17:16.696765+0000","last_became_active":"2024-09-13T17:17:16.694556+0000","last_became_peered":"2024-09-13T17:17:16.694556+0000","last_unstale":"2024-09-13T17:17:16.696765+0000","last_undegraded":"2024-09-13T17:17:16.696765+0000","last_fullsized":"2024-09-13T17:17:16.696765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:52.730759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711333+0000","last_change":"2024-09-13T17:17:16.334474+0000","last_active":"2024-09-13T17:17:16.711333+0000","last_peered":"2024-09-13T17:17:16.711333+0000","last_clean":"2024-09-13T17:17:16.711333+0000","last_became_active":"2024-09-13T17:17:16.334224+0000","last_became_peered":"2024-09-13T17:17:16.334224+0000","last_unstale":"2024-09-13T17:17:16.711333+0000","last_undegraded":"2024-09-13T17:17:16.711333+0000","last_fullsized":"2024-09-13T17:17:16.711333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:36.847692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694622+0000","last_change":"2024-09-13T17:17:16.691773+0000","last_active":"2024-09-13T17:17:16.694622+0000","last_peered":"2024-09-13T17:17:16.694622+0000","last_clean":"2024-09-13T17:17:16.694622+0000","last_became_active":"2024-09-13T17:17:16.691460+0000","last_became_peered":"2024-09-13T17:17:16.691460+0000","last_unstale":"2024-09-13T17:17:16.694622+0000","last_undegraded":"2024-09-13T17:17:16.694622+0000","last_fullsized":"2024-09-13T17:17:16.694622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:03.235378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712701+0000","last_change":"2024-09-13T17:17:16.332329+0000","last_active":"2024-09-13T17:17:16.712701+0000","last_peered":"2024-09-13T17:17:16.712701+0000","last_clean":"2024-09-13T17:17:16.712701+0000","last_became_active":"2024-09-13T17:17:16.332021+0000","last_became_peered":"2024-09-13T17:17:16.332021+0000","last_unstale":"2024-09-13T17:17:16.712701+0000","last_undegraded":"2024-09-13T17:17:16.712701+0000","last_fullsized":"2024-09-13T17:17:16.712701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:21.457823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700396+0000","last_change":"2024-09-13T17:17:16.696459+0000","last_active":"2024-09-13T17:17:16.700396+0000","last_peered":"2024-09-13T17:17:16.700396+0000","last_clean":"2024-09-13T17:17:16.700396+0000","last_became_active":"2024-09-13T17:17:16.696182+0000","last_became_peered":"2024-09-13T17:17:16.696182+0000","last_unstale":"2024-09-13T17:17:16.700396+0000","last_undegraded":"2024-09-13T17:17:16.700396+0000","last_fullsized":"2024-09-13T17:17:16.700396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:20.885946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709032+0000","last_change":"2024-09-13T17:17:16.332857+0000","last_active":"2024-09-13T17:17:16.709032+0000","last_peered":"2024-09-13T17:17:16.709032+0000","last_clean":"2024-09-13T17:17:16.709032+0000","last_became_active":"2024-09-13T17:17:16.332602+0000","last_became_peered":"2024-09-13T17:17:16.332602+0000","last_unstale":"2024-09-13T17:17:16.709032+0000","last_undegraded":"2024-09-13T17:17:16.709032+0000","last_fullsized":"2024-09-13T17:17:16.709032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:40.982508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700161+0000","last_change":"2024-09-13T17:17:16.695020+0000","last_active":"2024-09-13T17:17:16.700161+0000","last_peered":"2024-09-13T17:17:16.700161+0000","last_clean":"2024-09-13T17:17:16.700161+0000","last_became_active":"2024-09-13T17:17:16.694538+0000","last_became_peered":"2024-09-13T17:17:16.694538+0000","last_unstale":"2024-09-13T17:17:16.700161+0000","last_undegraded":"2024-09-13T17:17:16.700161+0000","last_fullsized":"2024-09-13T17:17:16.700161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712739+0000","last_change":"2024-09-13T17:17:16.330808+0000","last_active":"2024-09-13T17:17:16.712739+0000","last_peered":"2024-09-13T17:17:16.712739+0000","last_clean":"2024-09-13T17:17:16.712739+0000","last_became_active":"2024-09-13T17:17:16.330551+0000","last_became_peered":"2024-09-13T17:17:16.330551+0000","last_unstale":"2024-09-13T17:17:16.712739+0000","last_undegraded":"2024-09-13T17:17:16.712739+0000","last_fullsized":"2024-09-13T17:17:16.712739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:48.822963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707253+0000","last_change":"2024-09-13T17:17:16.697538+0000","last_active":"2024-09-13T17:17:16.707253+0000","last_peered":"2024-09-13T17:17:16.707253+0000","last_clean":"2024-09-13T17:17:16.707253+0000","last_became_active":"2024-09-13T17:17:16.697294+0000","last_became_peered":"2024-09-13T17:17:16.697294+0000","last_unstale":"2024-09-13T17:17:16.707253+0000","last_undegraded":"2024-09-13T17:17:16.707253+0000","last_fullsized":"2024-09-13T17:17:16.707253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:57.084204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706458+0000","last_change":"2024-09-13T17:17:16.327006+0000","last_active":"2024-09-13T17:17:16.706458+0000","last_peered":"2024-09-13T17:17:16.706458+0000","last_clean":"2024-09-13T17:17:16.706458+0000","last_became_active":"2024-09-13T17:17:16.326696+0000","last_became_peered":"2024-09-13T17:17:16.326696+0000","last_unstale":"2024-09-13T17:17:16.706458+0000","last_undegraded":"2024-09-13T17:17:16.706458+0000","last_fullsized":"2024-09-13T17:17:16.706458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:48.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708096+0000","last_change":"2024-09-13T17:17:16.701232+0000","last_active":"2024-09-13T17:17:16.708096+0000","last_peered":"2024-09-13T17:17:16.708096+0000","last_clean":"2024-09-13T17:17:16.708096+0000","last_became_active":"2024-09-13T17:17:16.701001+0000","last_became_peered":"2024-09-13T17:17:16.701001+0000","last_unstale":"2024-09-13T17:17:16.708096+0000","last_undegraded":"2024-09-13T17:17:16.708096+0000","last_fullsized":"2024-09-13T17:17:16.708096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:56.338714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711976+0000","last_change":"2024-09-13T17:17:16.329800+0000","last_active":"2024-09-13T17:17:16.711976+0000","last_peered":"2024-09-13T17:17:16.711976+0000","last_clean":"2024-09-13T17:17:16.711976+0000","last_became_active":"2024-09-13T17:17:16.329523+0000","last_became_peered":"2024-09-13T17:17:16.329523+0000","last_unstale":"2024-09-13T17:17:16.711976+0000","last_undegraded":"2024-09-13T17:17:16.711976+0000","last_fullsized":"2024-09-13T17:17:16.711976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:45.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700066+0000","last_change":"2024-09-13T17:17:16.696712+0000","last_active":"2024-09-13T17:17:16.700066+0000","last_peered":"2024-09-13T17:17:16.700066+0000","last_clean":"2024-09-13T17:17:16.700066+0000","last_became_active":"2024-09-13T17:17:16.696176+0000","last_became_peered":"2024-09-13T17:17:16.696176+0000","last_unstale":"2024-09-13T17:17:16.700066+0000","last_undegraded":"2024-09-13T17:17:16.700066+0000","last_fullsized":"2024-09-13T17:17:16.700066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.861892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.683473+0000","last_change":"2024-09-13T17:17:16.328055+0000","last_active":"2024-09-13T17:17:16.683473+0000","last_peered":"2024-09-13T17:17:16.683473+0000","last_clean":"2024-09-13T17:17:16.683473+0000","last_became_active":"2024-09-13T17:17:16.327467+0000","last_became_peered":"2024-09-13T17:17:16.327467+0000","last_unstale":"2024-09-13T17:17:16.683473+0000","last_undegraded":"2024-09-13T17:17:16.683473+0000","last_fullsized":"2024-09-13T17:17:16.683473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:05.566663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712434+0000","last_change":"2024-09-13T17:17:16.704103+0000","last_active":"2024-09-13T17:17:16.712434+0000","last_peered":"2024-09-13T17:17:16.712434+0000","last_clean":"2024-09-13T17:17:16.712434+0000","last_became_active":"2024-09-13T17:17:16.703828+0000","last_became_peered":"2024-09-13T17:17:16.703828+0000","last_unstale":"2024-09-13T17:17:16.712434+0000","last_undegraded":"2024-09-13T17:17:16.712434+0000","last_fullsized":"2024-09-13T17:17:16.712434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687112+0000","last_change":"2024-09-13T17:17:16.331317+0000","last_active":"2024-09-13T17:17:16.687112+0000","last_peered":"2024-09-13T17:17:16.687112+0000","last_clean":"2024-09-13T17:17:16.687112+0000","last_became_active":"2024-09-13T17:17:16.329686+0000","last_became_peered":"2024-09-13T17:17:16.329686+0000","last_unstale":"2024-09-13T17:17:16.687112+0000","last_undegraded":"2024-09-13T17:17:16.687112+0000","last_fullsized":"2024-09-13T17:17:16.687112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:44.031387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706845+0000","last_change":"2024-09-13T17:17:16.701725+0000","last_active":"2024-09-13T17:17:16.706845+0000","last_peered":"2024-09-13T17:17:16.706845+0000","last_clean":"2024-09-13T17:17:16.706845+0000","last_became_active":"2024-09-13T17:17:16.701488+0000","last_became_peered":"2024-09-13T17:17:16.701488+0000","last_unstale":"2024-09-13T17:17:16.706845+0000","last_undegraded":"2024-09-13T17:17:16.706845+0000","last_fullsized":"2024-09-13T17:17:16.706845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.911236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689830+0000","last_change":"2024-09-13T17:17:16.332730+0000","last_active":"2024-09-13T17:17:16.689830+0000","last_peered":"2024-09-13T17:17:16.689830+0000","last_clean":"2024-09-13T17:17:16.689830+0000","last_became_active":"2024-09-13T17:17:16.332093+0000","last_became_peered":"2024-09-13T17:17:16.332093+0000","last_unstale":"2024-09-13T17:17:16.689830+0000","last_undegraded":"2024-09-13T17:17:16.689830+0000","last_fullsized":"2024-09-13T17:17:16.689830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.401946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696681+0000","last_change":"2024-09-13T17:17:16.692046+0000","last_active":"2024-09-13T17:17:16.696681+0000","last_peered":"2024-09-13T17:17:16.696681+0000","last_clean":"2024-09-13T17:17:16.696681+0000","last_became_active":"2024-09-13T17:17:16.691781+0000","last_became_peered":"2024-09-13T17:17:16.691781+0000","last_unstale":"2024-09-13T17:17:16.696681+0000","last_undegraded":"2024-09-13T17:17:16.696681+0000","last_fullsized":"2024-09-13T17:17:16.696681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686388+0000","last_change":"2024-09-13T17:17:16.326285+0000","last_active":"2024-09-13T17:17:16.686388+0000","last_peered":"2024-09-13T17:17:16.686388+0000","last_clean":"2024-09-13T17:17:16.686388+0000","last_became_active":"2024-09-13T17:17:16.326026+0000","last_became_peered":"2024-09-13T17:17:16.326026+0000","last_unstale":"2024-09-13T17:17:16.686388+0000","last_undegraded":"2024-09-13T17:17:16.686388+0000","last_fullsized":"2024-09-13T17:17:16.686388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.588830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.701370+0000","last_change":"2024-09-13T17:17:16.698732+0000","last_active":"2024-09-13T17:17:16.701370+0000","last_peered":"2024-09-13T17:17:16.701370+0000","last_clean":"2024-09-13T17:17:16.701370+0000","last_became_active":"2024-09-13T17:17:16.698411+0000","last_became_peered":"2024-09-13T17:17:16.698411+0000","last_unstale":"2024-09-13T17:17:16.701370+0000","last_undegraded":"2024-09-13T17:17:16.701370+0000","last_fullsized":"2024-09-13T17:17:16.701370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:16.347199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710111+0000","last_change":"2024-09-13T17:17:16.332696+0000","last_active":"2024-09-13T17:17:16.710111+0000","last_peered":"2024-09-13T17:17:16.710111+0000","last_clean":"2024-09-13T17:17:16.710111+0000","last_became_active":"2024-09-13T17:17:16.332392+0000","last_became_peered":"2024-09-13T17:17:16.332392+0000","last_unstale":"2024-09-13T17:17:16.710111+0000","last_undegraded":"2024-09-13T17:17:16.710111+0000","last_fullsized":"2024-09-13T17:17:16.710111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.244978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696634+0000","last_change":"2024-09-13T17:17:16.694186+0000","last_active":"2024-09-13T17:17:16.696634+0000","last_peered":"2024-09-13T17:17:16.696634+0000","last_clean":"2024-09-13T17:17:16.696634+0000","last_became_active":"2024-09-13T17:17:16.693860+0000","last_became_peered":"2024-09-13T17:17:16.693860+0000","last_unstale":"2024-09-13T17:17:16.696634+0000","last_undegraded":"2024-09-13T17:17:16.696634+0000","last_fullsized":"2024-09-13T17:17:16.696634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"82'6","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.714666+0000","last_change":"2024-09-13T17:17:16.328724+0000","last_active":"2024-09-13T17:17:16.714666+0000","last_peered":"2024-09-13T17:17:16.714666+0000","last_clean":"2024-09-13T17:17:16.714666+0000","last_became_active":"2024-09-13T17:17:16.328494+0000","last_became_peered":"2024-09-13T17:17:16.328494+0000","last_unstale":"2024-09-13T17:17:16.714666+0000","last_undegraded":"2024-09-13T17:17:16.714666+0000","last_fullsized":"2024-09-13T17:17:16.714666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.316938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703484+0000","last_change":"2024-09-13T17:17:16.699330+0000","last_active":"2024-09-13T17:17:16.703484+0000","last_peered":"2024-09-13T17:17:16.703484+0000","last_clean":"2024-09-13T17:17:16.703484+0000","last_became_active":"2024-09-13T17:17:16.698517+0000","last_became_peered":"2024-09-13T17:17:16.698517+0000","last_unstale":"2024-09-13T17:17:16.703484+0000","last_undegraded":"2024-09-13T17:17:16.703484+0000","last_fullsized":"2024-09-13T17:17:16.703484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:12.125455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712453+0000","last_change":"2024-09-13T17:17:16.320644+0000","last_active":"2024-09-13T17:17:16.712453+0000","last_peered":"2024-09-13T17:17:16.712453+0000","last_clean":"2024-09-13T17:17:16.712453+0000","last_became_active":"2024-09-13T17:17:16.320327+0000","last_became_peered":"2024-09-13T17:17:16.320327+0000","last_unstale":"2024-09-13T17:17:16.712453+0000","last_undegraded":"2024-09-13T17:17:16.712453+0000","last_fullsized":"2024-09-13T17:17:16.712453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:54.584084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704173+0000","last_change":"2024-09-13T17:17:16.697967+0000","last_active":"2024-09-13T17:17:16.704173+0000","last_peered":"2024-09-13T17:17:16.704173+0000","last_clean":"2024-09-13T17:17:16.704173+0000","last_became_active":"2024-09-13T17:17:16.697660+0000","last_became_peered":"2024-09-13T17:17:16.697660+0000","last_unstale":"2024-09-13T17:17:16.704173+0000","last_undegraded":"2024-09-13T17:17:16.704173+0000","last_fullsized":"2024-09-13T17:17:16.704173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.688984+0000","last_change":"2024-09-13T17:17:16.335098+0000","last_active":"2024-09-13T17:17:16.688984+0000","last_peered":"2024-09-13T17:17:16.688984+0000","last_clean":"2024-09-13T17:17:16.688984+0000","last_became_active":"2024-09-13T17:17:16.334873+0000","last_became_peered":"2024-09-13T17:17:16.334873+0000","last_unstale":"2024-09-13T17:17:16.688984+0000","last_undegraded":"2024-09-13T17:17:16.688984+0000","last_fullsized":"2024-09-13T17:17:16.688984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:57.978998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705004+0000","last_change":"2024-09-13T17:17:16.701685+0000","last_active":"2024-09-13T17:17:16.705004+0000","last_peered":"2024-09-13T17:17:16.705004+0000","last_clean":"2024-09-13T17:17:16.705004+0000","last_became_active":"2024-09-13T17:17:16.701409+0000","last_became_peered":"2024-09-13T17:17:16.701409+0000","last_unstale":"2024-09-13T17:17:16.705004+0000","last_undegraded":"2024-09-13T17:17:16.705004+0000","last_fullsized":"2024-09-13T17:17:16.705004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.585916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687249+0000","last_change":"2024-09-13T17:17:16.334393+0000","last_active":"2024-09-13T17:17:16.687249+0000","last_peered":"2024-09-13T17:17:16.687249+0000","last_clean":"2024-09-13T17:17:16.687249+0000","last_became_active":"2024-09-13T17:17:16.334130+0000","last_became_peered":"2024-09-13T17:17:16.334130+0000","last_unstale":"2024-09-13T17:17:16.687249+0000","last_undegraded":"2024-09-13T17:17:16.687249+0000","last_fullsized":"2024-09-13T17:17:16.687249+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:25.081137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705428+0000","last_change":"2024-09-13T17:17:16.701970+0000","last_active":"2024-09-13T17:17:16.705428+0000","last_peered":"2024-09-13T17:17:16.705428+0000","last_clean":"2024-09-13T17:17:16.705428+0000","last_became_active":"2024-09-13T17:17:16.701707+0000","last_became_peered":"2024-09-13T17:17:16.701707+0000","last_unstale":"2024-09-13T17:17:16.705428+0000","last_undegraded":"2024-09-13T17:17:16.705428+0000","last_fullsized":"2024-09-13T17:17:16.705428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"82'8","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.713469+0000","last_change":"2024-09-13T17:17:16.331655+0000","last_active":"2024-09-13T17:17:16.713469+0000","last_peered":"2024-09-13T17:17:16.713469+0000","last_clean":"2024-09-13T17:17:16.713469+0000","last_became_active":"2024-09-13T17:17:16.331357+0000","last_became_peered":"2024-09-13T17:17:16.331357+0000","last_unstale":"2024-09-13T17:17:16.713469+0000","last_undegraded":"2024-09-13T17:17:16.713469+0000","last_fullsized":"2024-09-13T17:17:16.713469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:45.566718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.701350+0000","last_change":"2024-09-13T17:17:16.697114+0000","last_active":"2024-09-13T17:17:16.701350+0000","last_peered":"2024-09-13T17:17:16.701350+0000","last_clean":"2024-09-13T17:17:16.701350+0000","last_became_active":"2024-09-13T17:17:16.696867+0000","last_became_peered":"2024-09-13T17:17:16.696867+0000","last_unstale":"2024-09-13T17:17:16.701350+0000","last_undegraded":"2024-09-13T17:17:16.701350+0000","last_fullsized":"2024-09-13T17:17:16.701350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:56.338714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708158+0000","last_change":"2024-09-13T17:17:16.328532+0000","last_active":"2024-09-13T17:17:16.708158+0000","last_peered":"2024-09-13T17:17:16.708158+0000","last_clean":"2024-09-13T17:17:16.708158+0000","last_became_active":"2024-09-13T17:17:16.328203+0000","last_became_peered":"2024-09-13T17:17:16.328203+0000","last_unstale":"2024-09-13T17:17:16.708158+0000","last_undegraded":"2024-09-13T17:17:16.708158+0000","last_fullsized":"2024-09-13T17:17:16.708158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:11.408333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708976+0000","last_change":"2024-09-13T17:17:16.703745+0000","last_active":"2024-09-13T17:17:16.708976+0000","last_peered":"2024-09-13T17:17:16.708976+0000","last_clean":"2024-09-13T17:17:16.708976+0000","last_became_active":"2024-09-13T17:17:16.703312+0000","last_became_peered":"2024-09-13T17:17:16.703312+0000","last_unstale":"2024-09-13T17:17:16.708976+0000","last_undegraded":"2024-09-13T17:17:16.708976+0000","last_fullsized":"2024-09-13T17:17:16.708976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:20.698629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707695+0000","last_change":"2024-09-13T17:17:16.320133+0000","last_active":"2024-09-13T17:17:16.707695+0000","last_peered":"2024-09-13T17:17:16.707695+0000","last_clean":"2024-09-13T17:17:16.707695+0000","last_became_active":"2024-09-13T17:17:16.319882+0000","last_became_peered":"2024-09-13T17:17:16.319882+0000","last_unstale":"2024-09-13T17:17:16.707695+0000","last_undegraded":"2024-09-13T17:17:16.707695+0000","last_fullsized":"2024-09-13T17:17:16.707695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:17.325763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709010+0000","last_change":"2024-09-13T17:17:16.703858+0000","last_active":"2024-09-13T17:17:16.709010+0000","last_peered":"2024-09-13T17:17:16.709010+0000","last_clean":"2024-09-13T17:17:16.709010+0000","last_became_active":"2024-09-13T17:17:16.703574+0000","last_became_peered":"2024-09-13T17:17:16.703574+0000","last_unstale":"2024-09-13T17:17:16.709010+0000","last_undegraded":"2024-09-13T17:17:16.709010+0000","last_fullsized":"2024-09-13T17:17:16.709010+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:52.062873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711945+0000","last_change":"2024-09-13T17:17:16.331308+0000","last_active":"2024-09-13T17:17:16.711945+0000","last_peered":"2024-09-13T17:17:16.711945+0000","last_clean":"2024-09-13T17:17:16.711945+0000","last_became_active":"2024-09-13T17:17:16.331015+0000","last_became_peered":"2024-09-13T17:17:16.331015+0000","last_unstale":"2024-09-13T17:17:16.711945+0000","last_undegraded":"2024-09-13T17:17:16.711945+0000","last_fullsized":"2024-09-13T17:17:16.711945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:36.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702452+0000","last_change":"2024-09-13T17:17:16.700165+0000","last_active":"2024-09-13T17:17:16.702452+0000","last_peered":"2024-09-13T17:17:16.702452+0000","last_clean":"2024-09-13T17:17:16.702452+0000","last_became_active":"2024-09-13T17:17:16.699912+0000","last_became_peered":"2024-09-13T17:17:16.699912+0000","last_unstale":"2024-09-13T17:17:16.702452+0000","last_undegraded":"2024-09-13T17:17:16.702452+0000","last_fullsized":"2024-09-13T17:17:16.702452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:59.019568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.688428+0000","last_change":"2024-09-13T17:17:16.326635+0000","last_active":"2024-09-13T17:17:16.688428+0000","last_peered":"2024-09-13T17:17:16.688428+0000","last_clean":"2024-09-13T17:17:16.688428+0000","last_became_active":"2024-09-13T17:17:16.326361+0000","last_became_peered":"2024-09-13T17:17:16.326361+0000","last_unstale":"2024-09-13T17:17:16.688428+0000","last_undegraded":"2024-09-13T17:17:16.688428+0000","last_fullsized":"2024-09-13T17:17:16.688428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:06.160688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705517+0000","last_change":"2024-09-13T17:17:16.694316+0000","last_active":"2024-09-13T17:17:16.705517+0000","last_peered":"2024-09-13T17:17:16.705517+0000","last_clean":"2024-09-13T17:17:16.705517+0000","last_became_active":"2024-09-13T17:17:16.694071+0000","last_became_peered":"2024-09-13T17:17:16.694071+0000","last_unstale":"2024-09-13T17:17:16.705517+0000","last_undegraded":"2024-09-13T17:17:16.705517+0000","last_fullsized":"2024-09-13T17:17:16.705517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:33.434051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709080+0000","last_change":"2024-09-13T17:17:16.328308+0000","last_active":"2024-09-13T17:17:16.709080+0000","last_peered":"2024-09-13T17:17:16.709080+0000","last_clean":"2024-09-13T17:17:16.709080+0000","last_became_active":"2024-09-13T17:17:16.327344+0000","last_became_peered":"2024-09-13T17:17:16.327344+0000","last_unstale":"2024-09-13T17:17:16.709080+0000","last_undegraded":"2024-09-13T17:17:16.709080+0000","last_fullsized":"2024-09-13T17:17:16.709080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.612779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707209+0000","last_change":"2024-09-13T17:17:16.696845+0000","last_active":"2024-09-13T17:17:16.707209+0000","last_peered":"2024-09-13T17:17:16.707209+0000","last_clean":"2024-09-13T17:17:16.707209+0000","last_became_active":"2024-09-13T17:17:16.696573+0000","last_became_peered":"2024-09-13T17:17:16.696573+0000","last_unstale":"2024-09-13T17:17:16.707209+0000","last_undegraded":"2024-09-13T17:17:16.707209+0000","last_fullsized":"2024-09-13T17:17:16.707209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:59.019568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686775+0000","last_change":"2024-09-13T17:17:16.327629+0000","last_active":"2024-09-13T17:17:16.686775+0000","last_peered":"2024-09-13T17:17:16.686775+0000","last_clean":"2024-09-13T17:17:16.686775+0000","last_became_active":"2024-09-13T17:17:16.327353+0000","last_became_peered":"2024-09-13T17:17:16.327353+0000","last_unstale":"2024-09-13T17:17:16.686775+0000","last_undegraded":"2024-09-13T17:17:16.686775+0000","last_fullsized":"2024-09-13T17:17:16.686775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:02.046273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704497+0000","last_change":"2024-09-13T17:17:16.700603+0000","last_active":"2024-09-13T17:17:16.704497+0000","last_peered":"2024-09-13T17:17:16.704497+0000","last_clean":"2024-09-13T17:17:16.704497+0000","last_became_active":"2024-09-13T17:17:16.699396+0000","last_became_peered":"2024-09-13T17:17:16.699396+0000","last_unstale":"2024-09-13T17:17:16.704497+0000","last_undegraded":"2024-09-13T17:17:16.704497+0000","last_fullsized":"2024-09-13T17:17:16.704497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:22.459655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686636+0000","last_change":"2024-09-13T17:17:16.323769+0000","last_active":"2024-09-13T17:17:16.686636+0000","last_peered":"2024-09-13T17:17:16.686636+0000","last_clean":"2024-09-13T17:17:16.686636+0000","last_became_active":"2024-09-13T17:17:16.323491+0000","last_became_peered":"2024-09-13T17:17:16.323491+0000","last_unstale":"2024-09-13T17:17:16.686636+0000","last_undegraded":"2024-09-13T17:17:16.686636+0000","last_fullsized":"2024-09-13T17:17:16.686636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:09.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703891+0000","last_change":"2024-09-13T17:17:16.701175+0000","last_active":"2024-09-13T17:17:16.703891+0000","last_peered":"2024-09-13T17:17:16.703891+0000","last_clean":"2024-09-13T17:17:16.703891+0000","last_became_active":"2024-09-13T17:17:16.700838+0000","last_became_peered":"2024-09-13T17:17:16.700838+0000","last_unstale":"2024-09-13T17:17:16.703891+0000","last_undegraded":"2024-09-13T17:17:16.703891+0000","last_fullsized":"2024-09-13T17:17:16.703891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:48.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712088+0000","last_change":"2024-09-13T17:17:16.324117+0000","last_active":"2024-09-13T17:17:16.712088+0000","last_peered":"2024-09-13T17:17:16.712088+0000","last_clean":"2024-09-13T17:17:16.712088+0000","last_became_active":"2024-09-13T17:17:16.323792+0000","last_became_peered":"2024-09-13T17:17:16.323792+0000","last_unstale":"2024-09-13T17:17:16.712088+0000","last_undegraded":"2024-09-13T17:17:16.712088+0000","last_fullsized":"2024-09-13T17:17:16.712088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:19.884114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712556+0000","last_change":"2024-09-13T17:17:16.705190+0000","last_active":"2024-09-13T17:17:16.712556+0000","last_peered":"2024-09-13T17:17:16.712556+0000","last_clean":"2024-09-13T17:17:16.712556+0000","last_became_active":"2024-09-13T17:17:16.704889+0000","last_became_peered":"2024-09-13T17:17:16.704889+0000","last_unstale":"2024-09-13T17:17:16.712556+0000","last_undegraded":"2024-09-13T17:17:16.712556+0000","last_fullsized":"2024-09-13T17:17:16.712556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.684225+0000","last_change":"2024-09-13T17:17:16.330820+0000","last_active":"2024-09-13T17:17:16.684225+0000","last_peered":"2024-09-13T17:17:16.684225+0000","last_clean":"2024-09-13T17:17:16.684225+0000","last_became_active":"2024-09-13T17:17:16.329860+0000","last_became_peered":"2024-09-13T17:17:16.329860+0000","last_unstale":"2024-09-13T17:17:16.684225+0000","last_undegraded":"2024-09-13T17:17:16.684225+0000","last_fullsized":"2024-09-13T17:17:16.684225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:03.711246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700417+0000","last_change":"2024-09-13T17:17:16.697234+0000","last_active":"2024-09-13T17:17:16.700417+0000","last_peered":"2024-09-13T17:17:16.700417+0000","last_clean":"2024-09-13T17:17:16.700417+0000","last_became_active":"2024-09-13T17:17:16.696877+0000","last_became_peered":"2024-09-13T17:17:16.696877+0000","last_unstale":"2024-09-13T17:17:16.700417+0000","last_undegraded":"2024-09-13T17:17:16.700417+0000","last_fullsized":"2024-09-13T17:17:16.700417+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:26.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689628+0000","last_change":"2024-09-13T17:17:16.329775+0000","last_active":"2024-09-13T17:17:16.689628+0000","last_peered":"2024-09-13T17:17:16.689628+0000","last_clean":"2024-09-13T17:17:16.689628+0000","last_became_active":"2024-09-13T17:17:16.329513+0000","last_became_peered":"2024-09-13T17:17:16.329513+0000","last_unstale":"2024-09-13T17:17:16.689628+0000","last_undegraded":"2024-09-13T17:17:16.689628+0000","last_fullsized":"2024-09-13T17:17:16.689628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:45.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694267+0000","last_change":"2024-09-13T17:17:16.692378+0000","last_active":"2024-09-13T17:17:16.694267+0000","last_peered":"2024-09-13T17:17:16.694267+0000","last_clean":"2024-09-13T17:17:16.694267+0000","last_became_active":"2024-09-13T17:17:16.692146+0000","last_became_peered":"2024-09-13T17:17:16.692146+0000","last_unstale":"2024-09-13T17:17:16.694267+0000","last_undegraded":"2024-09-13T17:17:16.694267+0000","last_fullsized":"2024-09-13T17:17:16.694267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.713215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689383+0000","last_change":"2024-09-13T17:17:16.332243+0000","last_active":"2024-09-13T17:17:16.689383+0000","last_peered":"2024-09-13T17:17:16.689383+0000","last_clean":"2024-09-13T17:17:16.689383+0000","last_became_active":"2024-09-13T17:17:16.331818+0000","last_became_peered":"2024-09-13T17:17:16.331818+0000","last_unstale":"2024-09-13T17:17:16.689383+0000","last_undegraded":"2024-09-13T17:17:16.689383+0000","last_fullsized":"2024-09-13T17:17:16.689383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:16.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711555+0000","last_change":"2024-09-13T17:17:16.703195+0000","last_active":"2024-09-13T17:17:16.711555+0000","last_peered":"2024-09-13T17:17:16.711555+0000","last_clean":"2024-09-13T17:17:16.711555+0000","last_became_active":"2024-09-13T17:17:16.702878+0000","last_became_peered":"2024-09-13T17:17:16.702878+0000","last_unstale":"2024-09-13T17:17:16.711555+0000","last_undegraded":"2024-09-13T17:17:16.711555+0000","last_fullsized":"2024-09-13T17:17:16.711555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.690927+0000","last_change":"2024-09-13T17:17:16.327277+0000","last_active":"2024-09-13T17:17:16.690927+0000","last_peered":"2024-09-13T17:17:16.690927+0000","last_clean":"2024-09-13T17:17:16.690927+0000","last_became_active":"2024-09-13T17:17:16.326981+0000","last_became_peered":"2024-09-13T17:17:16.326981+0000","last_unstale":"2024-09-13T17:17:16.690927+0000","last_undegraded":"2024-09-13T17:17:16.690927+0000","last_fullsized":"2024-09-13T17:17:16.690927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:54.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702872+0000","last_change":"2024-09-13T17:17:16.697819+0000","last_active":"2024-09-13T17:17:16.702872+0000","last_peered":"2024-09-13T17:17:16.702872+0000","last_clean":"2024-09-13T17:17:16.702872+0000","last_became_active":"2024-09-13T17:17:16.697499+0000","last_became_peered":"2024-09-13T17:17:16.697499+0000","last_unstale":"2024-09-13T17:17:16.702872+0000","last_undegraded":"2024-09-13T17:17:16.702872+0000","last_fullsized":"2024-09-13T17:17:16.702872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:41.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689821+0000","last_change":"2024-09-13T17:17:16.335032+0000","last_active":"2024-09-13T17:17:16.689821+0000","last_peered":"2024-09-13T17:17:16.689821+0000","last_clean":"2024-09-13T17:17:16.689821+0000","last_became_active":"2024-09-13T17:17:16.334775+0000","last_became_peered":"2024-09-13T17:17:16.334775+0000","last_unstale":"2024-09-13T17:17:16.689821+0000","last_undegraded":"2024-09-13T17:17:16.689821+0000","last_fullsized":"2024-09-13T17:17:16.689821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:29.222302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696207+0000","last_change":"2024-09-13T17:17:16.695366+0000","last_active":"2024-09-13T17:17:16.696207+0000","last_peered":"2024-09-13T17:17:16.696207+0000","last_clean":"2024-09-13T17:17:16.696207+0000","last_became_active":"2024-09-13T17:17:16.694866+0000","last_became_peered":"2024-09-13T17:17:16.694866+0000","last_unstale":"2024-09-13T17:17:16.696207+0000","last_undegraded":"2024-09-13T17:17:16.696207+0000","last_fullsized":"2024-09-13T17:17:16.696207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694149+0000","last_change":"2024-09-13T17:17:16.330262+0000","last_active":"2024-09-13T17:17:16.694149+0000","last_peered":"2024-09-13T17:17:16.694149+0000","last_clean":"2024-09-13T17:17:16.694149+0000","last_became_active":"2024-09-13T17:17:16.329622+0000","last_became_peered":"2024-09-13T17:17:16.329622+0000","last_unstale":"2024-09-13T17:17:16.694149+0000","last_undegraded":"2024-09-13T17:17:16.694149+0000","last_fullsized":"2024-09-13T17:17:16.694149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:26.397292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703085+0000","last_change":"2024-09-13T17:17:16.698489+0000","last_active":"2024-09-13T17:17:16.703085+0000","last_peered":"2024-09-13T17:17:16.703085+0000","last_clean":"2024-09-13T17:17:16.703085+0000","last_became_active":"2024-09-13T17:17:16.698199+0000","last_became_peered":"2024-09-13T17:17:16.698199+0000","last_unstale":"2024-09-13T17:17:16.703085+0000","last_undegraded":"2024-09-13T17:17:16.703085+0000","last_fullsized":"2024-09-13T17:17:16.703085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689194+0000","last_change":"2024-09-13T17:17:16.324411+0000","last_active":"2024-09-13T17:17:16.689194+0000","last_peered":"2024-09-13T17:17:16.689194+0000","last_clean":"2024-09-13T17:17:16.689194+0000","last_became_active":"2024-09-13T17:17:16.324146+0000","last_became_peered":"2024-09-13T17:17:16.324146+0000","last_unstale":"2024-09-13T17:17:16.689194+0000","last_undegraded":"2024-09-13T17:17:16.689194+0000","last_fullsized":"2024-09-13T17:17:16.689194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.711283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700109+0000","last_change":"2024-09-13T17:17:16.696337+0000","last_active":"2024-09-13T17:17:16.700109+0000","last_peered":"2024-09-13T17:17:16.700109+0000","last_clean":"2024-09-13T17:17:16.700109+0000","last_became_active":"2024-09-13T17:17:16.695883+0000","last_became_peered":"2024-09-13T17:17:16.695883+0000","last_unstale":"2024-09-13T17:17:16.700109+0000","last_undegraded":"2024-09-13T17:17:16.700109+0000","last_fullsized":"2024-09-13T17:17:16.700109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:04.713078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687902+0000","last_change":"2024-09-13T17:17:16.323574+0000","last_active":"2024-09-13T17:17:16.687902+0000","last_peered":"2024-09-13T17:17:16.687902+0000","last_clean":"2024-09-13T17:17:16.687902+0000","last_became_active":"2024-09-13T17:17:16.323302+0000","last_became_peered":"2024-09-13T17:17:16.323302+0000","last_unstale":"2024-09-13T17:17:16.687902+0000","last_undegraded":"2024-09-13T17:17:16.687902+0000","last_fullsized":"2024-09-13T17:17:16.687902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:07.429945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.324242+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:16.324242+0000","last_peered":"2024-09-13T17:17:16.324242+0000","last_clean":"2024-09-13T17:17:16.324242+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:16.324242+0000","last_undegraded":"2024-09-13T17:17:16.324242+0000","last_fullsized":"2024-09-13T17:17:16.324242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28576,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343264,"statfs":{"total":96636764160,"available":96607502336,"internally_reserved":0,"allocated":1585152,"data_stored":1038672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.379}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.438}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.26600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.35299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.33300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":456963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.505}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.436}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":455433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":448304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.748},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1007616,"data_stored":455981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.318}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.503}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.443}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1015808,"data_stored":456141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.247},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.311}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.27600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1011712,"data_stored":455511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.254}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.308},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.376}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1585152,"data_stored":1038672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.98499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":1.026},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.878}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:19.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:19.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.795+0000 7ff23b0b1640 1 Processor -- start 2024-09-13T17:17:19.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.795+0000 7ff23b0b1640 1 -- start start 2024-09-13T17:17:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23b0b1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff23415a4a0 0x7ff2340cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23b0b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 0x7ff2340cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23b0b1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2340b2180 con 0x7ff2340cafb0 2024-09-13T17:17:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23b0b1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2340cdab0 con 0x7ff23415a4a0 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23b0b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340b2420 con 0x7ff23415a880 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff238e4d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff23415a4a0 0x7ff2340cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23964e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2340cafb0 0x7ff2340703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59932/0 (socket says 172.21.15.5:59932) 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff23964e640 1 -- 172.21.15.5:0/2445415015 learned_addr learned my addr 172.21.15.5:0/2445415015 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff238e4d640 1 -- 172.21.15.5:0/2445415015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 msgr2=0x7ff2340cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff233fff640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 0x7ff2340cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff2337fe640 1 -- 172.21.15.5:0/2445415015 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129713928 0 0) 0x7ff2340b2180 con 0x7ff2340cafb0 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff238e4d640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 0x7ff2340cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff238e4d640 1 -- 172.21.15.5:0/2445415015 >> v1:172.21.15.5:6789/0 conn(0x7ff2340cafb0 legacy=0x7ff2340703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff238e4d640 1 -- 172.21.15.5:0/2445415015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340b2700 con 0x7ff23415a4a0 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.796+0000 7ff233fff640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 0x7ff2340cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.797+0000 7ff238e4d640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a4a0 0x7ff2340cdc50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097a0 tx=0x7ff22802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb7b16ce2e771f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.797+0000 7ff2337fe640 1 -- 172.21.15.5:0/2445415015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228032440 con 0x7ff23415a4a0 2024-09-13T17:17:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.797+0000 7ff2337fe640 1 -- 172.21.15.5:0/2445415015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280325a0 con 0x7ff23415a4a0 2024-09-13T17:17:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.797+0000 7ff2337fe640 1 -- 172.21.15.5:0/2445415015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228032930 con 0x7ff23415a4a0 2024-09-13T17:17:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2445415015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a4a0 msgr2=0x7ff2340cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a4a0 0x7ff2340cdc50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097a0 tx=0x7ff22802a180 comp rx=0 tx=0).stop 2024-09-13T17:17:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2445415015 shutdown_connections 2024-09-13T17:17:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff23415a880 0x7ff2340cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2445415015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a4a0 0x7ff2340cdc50 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2445415015 >> 172.21.15.5:0/2445415015 conn(0x7ff234066200 msgr2=0x7ff234069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2445415015 shutdown_connections 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.798+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2445415015 wait complete. 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.799+0000 7ff23b0b1640 1 Processor -- start 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.799+0000 7ff23b0b1640 1 -- start start 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2340cafb0 0x7ff2341f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 0x7ff234153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234155890 con 0x7ff23415a880 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234155aa0 con 0x7ff23415a4a0 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23b0b1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff234155d80 con 0x7ff2340cafb0 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53228/0 (socket says 172.21.15.5:53228) 2024-09-13T17:17:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 -- 172.21.15.5:0/2191313276 learned_addr learned my addr 172.21.15.5:0/2191313276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff233fff640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 0x7ff234153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff238e4d640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2340cafb0 0x7ff2341f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 -- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2340cafb0 msgr2=0x7ff2341f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2340cafb0 0x7ff2341f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 -- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 msgr2=0x7ff234153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 0x7ff234153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff23964e640 1 -- 172.21.15.5:0/2191313276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009400 con 0x7ff23415a880 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.800+0000 7ff233fff640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 0x7ff234153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff23964e640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c7e0 tx=0x7ff22c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00a640 con 0x7ff23415a880 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00a7c0 con 0x7ff23415a880 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff234156060 con 0x7ff23415a880 2024-09-13T17:17:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00ab70 con 0x7ff23415a880 2024-09-13T17:17:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.801+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff234154d50 con 0x7ff23415a880 2024-09-13T17:17:19.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.802+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2340672f0 con 0x7ff23415a880 2024-09-13T17:17:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.802+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff22c00acd0 con 0x7ff23415a880 2024-09-13T17:17:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.803+0000 7ff2317fa640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 0x7ff21806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.803+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff22c088d30 con 0x7ff23415a880 2024-09-13T17:17:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.803+0000 7ff238e4d640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 0x7ff21806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.803+0000 7ff238e4d640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 0x7ff21806d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff228034000 tx=0x7ff22802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.807+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff22c053dd0 con 0x7ff23415a880 2024-09-13T17:17:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.976+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff234156580 con 0x7ff21806ac00 2024-09-13T17:17:19.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.984+0000 7ff2317fa640 1 -- 172.21.15.5:0/2191313276 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289112 (secure 0 0 0) 0x7ff234156580 con 0x7ff21806ac00 2024-09-13T17:17:19.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:19.990 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 msgr2=0x7ff21806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 0x7ff21806d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff228034000 tx=0x7ff22802e000 comp rx=0 tx=0).stop 2024-09-13T17:17:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 msgr2=0x7ff23414f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c7e0 tx=0x7ff22c00cca0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 shutdown_connections 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff21806ac00 0x7ff21806d0c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff23415a880 0x7ff23414f0a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff23415a4a0 0x7ff234153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 --2- 172.21.15.5:0/2191313276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2340cafb0 0x7ff2341f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 >> 172.21.15.5:0/2191313276 conn(0x7ff234066200 msgr2=0x7ff2340cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 shutdown_connections 2024-09-13T17:17:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:19.988+0000 7ff23b0b1640 1 -- 172.21.15.5:0/2191313276 wait complete. 2024-09-13T17:17:20.000 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T17:17:19.315458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241584,"kb_used_data":9004,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754733136,"statfs":{"total":773094113280,"available":772846731264,"internally_reserved":0,"allocated":9220096,"data_stored":4805677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238014009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.006006"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706271+0000","last_change":"2024-09-13T17:17:16.700126+0000","last_active":"2024-09-13T17:17:16.706271+0000","last_peered":"2024-09-13T17:17:16.706271+0000","last_clean":"2024-09-13T17:17:16.706271+0000","last_became_active":"2024-09-13T17:17:16.699842+0000","last_became_peered":"2024-09-13T17:17:16.699842+0000","last_unstale":"2024-09-13T17:17:16.706271+0000","last_undegraded":"2024-09-13T17:17:16.706271+0000","last_fullsized":"2024-09-13T17:17:16.706271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:03.048104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707228+0000","last_change":"2024-09-13T17:17:16.703071+0000","last_active":"2024-09-13T17:17:16.707228+0000","last_peered":"2024-09-13T17:17:16.707228+0000","last_clean":"2024-09-13T17:17:16.707228+0000","last_became_active":"2024-09-13T17:17:16.702823+0000","last_became_peered":"2024-09-13T17:17:16.702823+0000","last_unstale":"2024-09-13T17:17:16.707228+0000","last_undegraded":"2024-09-13T17:17:16.707228+0000","last_fullsized":"2024-09-13T17:17:16.707228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:22.567906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.695628+0000","last_change":"2024-09-13T17:17:16.693648+0000","last_active":"2024-09-13T17:17:16.695628+0000","last_peered":"2024-09-13T17:17:16.695628+0000","last_clean":"2024-09-13T17:17:16.695628+0000","last_became_active":"2024-09-13T17:17:16.693309+0000","last_became_peered":"2024-09-13T17:17:16.693309+0000","last_unstale":"2024-09-13T17:17:16.695628+0000","last_undegraded":"2024-09-13T17:17:16.695628+0000","last_fullsized":"2024-09-13T17:17:16.695628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.699446+0000","last_change":"2024-09-13T17:17:16.694656+0000","last_active":"2024-09-13T17:17:16.699446+0000","last_peered":"2024-09-13T17:17:16.699446+0000","last_clean":"2024-09-13T17:17:16.699446+0000","last_became_active":"2024-09-13T17:17:16.694352+0000","last_became_peered":"2024-09-13T17:17:16.694352+0000","last_unstale":"2024-09-13T17:17:16.699446+0000","last_undegraded":"2024-09-13T17:17:16.699446+0000","last_fullsized":"2024-09-13T17:17:16.699446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709994+0000","last_change":"2024-09-13T17:17:16.707940+0000","last_active":"2024-09-13T17:17:16.709994+0000","last_peered":"2024-09-13T17:17:16.709994+0000","last_clean":"2024-09-13T17:17:16.709994+0000","last_became_active":"2024-09-13T17:17:16.707567+0000","last_became_peered":"2024-09-13T17:17:16.707567+0000","last_unstale":"2024-09-13T17:17:16.709994+0000","last_undegraded":"2024-09-13T17:17:16.709994+0000","last_fullsized":"2024-09-13T17:17:16.709994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.302094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702478+0000","last_change":"2024-09-13T17:17:16.700282+0000","last_active":"2024-09-13T17:17:16.702478+0000","last_peered":"2024-09-13T17:17:16.702478+0000","last_clean":"2024-09-13T17:17:16.702478+0000","last_became_active":"2024-09-13T17:17:16.699991+0000","last_became_peered":"2024-09-13T17:17:16.699991+0000","last_unstale":"2024-09-13T17:17:16.702478+0000","last_undegraded":"2024-09-13T17:17:16.702478+0000","last_fullsized":"2024-09-13T17:17:16.702478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:00.237030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704683+0000","last_change":"2024-09-13T17:17:16.700982+0000","last_active":"2024-09-13T17:17:16.704683+0000","last_peered":"2024-09-13T17:17:16.704683+0000","last_clean":"2024-09-13T17:17:16.704683+0000","last_became_active":"2024-09-13T17:17:16.700723+0000","last_became_peered":"2024-09-13T17:17:16.700723+0000","last_unstale":"2024-09-13T17:17:16.704683+0000","last_undegraded":"2024-09-13T17:17:16.704683+0000","last_fullsized":"2024-09-13T17:17:16.704683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:52.730759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710309+0000","last_change":"2024-09-13T17:17:16.708011+0000","last_active":"2024-09-13T17:17:16.710309+0000","last_peered":"2024-09-13T17:17:16.710309+0000","last_clean":"2024-09-13T17:17:16.710309+0000","last_became_active":"2024-09-13T17:17:16.707599+0000","last_became_peered":"2024-09-13T17:17:16.707599+0000","last_unstale":"2024-09-13T17:17:16.710309+0000","last_undegraded":"2024-09-13T17:17:16.710309+0000","last_fullsized":"2024-09-13T17:17:16.710309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:34.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702667+0000","last_change":"2024-09-13T17:17:16.698934+0000","last_active":"2024-09-13T17:17:16.702667+0000","last_peered":"2024-09-13T17:17:16.702667+0000","last_clean":"2024-09-13T17:17:16.702667+0000","last_became_active":"2024-09-13T17:17:16.698535+0000","last_became_peered":"2024-09-13T17:17:16.698535+0000","last_unstale":"2024-09-13T17:17:16.702667+0000","last_undegraded":"2024-09-13T17:17:16.702667+0000","last_fullsized":"2024-09-13T17:17:16.702667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:57.713115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703913+0000","last_change":"2024-09-13T17:17:16.700184+0000","last_active":"2024-09-13T17:17:16.703913+0000","last_peered":"2024-09-13T17:17:16.703913+0000","last_clean":"2024-09-13T17:17:16.703913+0000","last_became_active":"2024-09-13T17:17:16.699054+0000","last_became_peered":"2024-09-13T17:17:16.699054+0000","last_unstale":"2024-09-13T17:17:16.703913+0000","last_undegraded":"2024-09-13T17:17:16.703913+0000","last_fullsized":"2024-09-13T17:17:16.703913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708154+0000","last_change":"2024-09-13T17:17:16.703205+0000","last_active":"2024-09-13T17:17:16.708154+0000","last_peered":"2024-09-13T17:17:16.708154+0000","last_clean":"2024-09-13T17:17:16.708154+0000","last_became_active":"2024-09-13T17:17:16.702953+0000","last_became_peered":"2024-09-13T17:17:16.702953+0000","last_unstale":"2024-09-13T17:17:16.708154+0000","last_undegraded":"2024-09-13T17:17:16.708154+0000","last_fullsized":"2024-09-13T17:17:16.708154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:30.426816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702395+0000","last_change":"2024-09-13T17:17:16.696874+0000","last_active":"2024-09-13T17:17:16.702395+0000","last_peered":"2024-09-13T17:17:16.702395+0000","last_clean":"2024-09-13T17:17:16.702395+0000","last_became_active":"2024-09-13T17:17:16.696549+0000","last_became_peered":"2024-09-13T17:17:16.696549+0000","last_unstale":"2024-09-13T17:17:16.702395+0000","last_undegraded":"2024-09-13T17:17:16.702395+0000","last_fullsized":"2024-09-13T17:17:16.702395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:04.713078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709956+0000","last_change":"2024-09-13T17:17:16.707367+0000","last_active":"2024-09-13T17:17:16.709956+0000","last_peered":"2024-09-13T17:17:16.709956+0000","last_clean":"2024-09-13T17:17:16.709956+0000","last_became_active":"2024-09-13T17:17:16.707063+0000","last_became_peered":"2024-09-13T17:17:16.707063+0000","last_unstale":"2024-09-13T17:17:16.709956+0000","last_undegraded":"2024-09-13T17:17:16.709956+0000","last_fullsized":"2024-09-13T17:17:16.709956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:35.833166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702979+0000","last_change":"2024-09-13T17:17:16.702163+0000","last_active":"2024-09-13T17:17:16.702979+0000","last_peered":"2024-09-13T17:17:16.702979+0000","last_clean":"2024-09-13T17:17:16.702979+0000","last_became_active":"2024-09-13T17:17:16.701897+0000","last_became_peered":"2024-09-13T17:17:16.701897+0000","last_unstale":"2024-09-13T17:17:16.702979+0000","last_undegraded":"2024-09-13T17:17:16.702979+0000","last_fullsized":"2024-09-13T17:17:16.702979+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:26.687422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705618+0000","last_change":"2024-09-13T17:17:16.696377+0000","last_active":"2024-09-13T17:17:16.705618+0000","last_peered":"2024-09-13T17:17:16.705618+0000","last_clean":"2024-09-13T17:17:16.705618+0000","last_became_active":"2024-09-13T17:17:16.696121+0000","last_became_peered":"2024-09-13T17:17:16.696121+0000","last_unstale":"2024-09-13T17:17:16.705618+0000","last_undegraded":"2024-09-13T17:17:16.705618+0000","last_fullsized":"2024-09-13T17:17:16.705618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:09.856348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700133+0000","last_change":"2024-09-13T17:17:16.696007+0000","last_active":"2024-09-13T17:17:16.700133+0000","last_peered":"2024-09-13T17:17:16.700133+0000","last_clean":"2024-09-13T17:17:16.700133+0000","last_became_active":"2024-09-13T17:17:16.695391+0000","last_became_peered":"2024-09-13T17:17:16.695391+0000","last_unstale":"2024-09-13T17:17:16.700133+0000","last_undegraded":"2024-09-13T17:17:16.700133+0000","last_fullsized":"2024-09-13T17:17:16.700133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:29.614611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710397+0000","last_change":"2024-09-13T17:17:16.704342+0000","last_active":"2024-09-13T17:17:16.710397+0000","last_peered":"2024-09-13T17:17:16.710397+0000","last_clean":"2024-09-13T17:17:16.710397+0000","last_became_active":"2024-09-13T17:17:16.704042+0000","last_became_peered":"2024-09-13T17:17:16.704042+0000","last_unstale":"2024-09-13T17:17:16.710397+0000","last_undegraded":"2024-09-13T17:17:16.710397+0000","last_fullsized":"2024-09-13T17:17:16.710397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:42.127758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696190+0000","last_change":"2024-09-13T17:17:16.695375+0000","last_active":"2024-09-13T17:17:16.696190+0000","last_peered":"2024-09-13T17:17:16.696190+0000","last_clean":"2024-09-13T17:17:16.696190+0000","last_became_active":"2024-09-13T17:17:16.695132+0000","last_became_peered":"2024-09-13T17:17:16.695132+0000","last_unstale":"2024-09-13T17:17:16.696190+0000","last_undegraded":"2024-09-13T17:17:16.696190+0000","last_fullsized":"2024-09-13T17:17:16.696190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708720+0000","last_change":"2024-09-13T17:17:16.707791+0000","last_active":"2024-09-13T17:17:16.708720+0000","last_peered":"2024-09-13T17:17:16.708720+0000","last_clean":"2024-09-13T17:17:16.708720+0000","last_became_active":"2024-09-13T17:17:16.707486+0000","last_became_peered":"2024-09-13T17:17:16.707486+0000","last_unstale":"2024-09-13T17:17:16.708720+0000","last_undegraded":"2024-09-13T17:17:16.708720+0000","last_fullsized":"2024-09-13T17:17:16.708720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:57.084204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710072+0000","last_change":"2024-09-13T17:17:16.707169+0000","last_active":"2024-09-13T17:17:16.710072+0000","last_peered":"2024-09-13T17:17:16.710072+0000","last_clean":"2024-09-13T17:17:16.710072+0000","last_became_active":"2024-09-13T17:17:16.706913+0000","last_became_peered":"2024-09-13T17:17:16.706913+0000","last_unstale":"2024-09-13T17:17:16.710072+0000","last_undegraded":"2024-09-13T17:17:16.710072+0000","last_fullsized":"2024-09-13T17:17:16.710072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:33.132730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700178+0000","last_change":"2024-09-13T17:17:16.695644+0000","last_active":"2024-09-13T17:17:16.700178+0000","last_peered":"2024-09-13T17:17:16.700178+0000","last_clean":"2024-09-13T17:17:16.700178+0000","last_became_active":"2024-09-13T17:17:16.694893+0000","last_became_peered":"2024-09-13T17:17:16.694893+0000","last_unstale":"2024-09-13T17:17:16.700178+0000","last_undegraded":"2024-09-13T17:17:16.700178+0000","last_fullsized":"2024-09-13T17:17:16.700178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:07.162520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696506+0000","last_change":"2024-09-13T17:17:16.695693+0000","last_active":"2024-09-13T17:17:16.696506+0000","last_peered":"2024-09-13T17:17:16.696506+0000","last_clean":"2024-09-13T17:17:16.696506+0000","last_became_active":"2024-09-13T17:17:16.695436+0000","last_became_peered":"2024-09-13T17:17:16.695436+0000","last_unstale":"2024-09-13T17:17:16.696506+0000","last_undegraded":"2024-09-13T17:17:16.696506+0000","last_fullsized":"2024-09-13T17:17:16.696506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:28:15.635442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700031+0000","last_change":"2024-09-13T17:17:16.694234+0000","last_active":"2024-09-13T17:17:16.700031+0000","last_peered":"2024-09-13T17:17:16.700031+0000","last_clean":"2024-09-13T17:17:16.700031+0000","last_became_active":"2024-09-13T17:17:16.693568+0000","last_became_peered":"2024-09-13T17:17:16.693568+0000","last_unstale":"2024-09-13T17:17:16.700031+0000","last_undegraded":"2024-09-13T17:17:16.700031+0000","last_fullsized":"2024-09-13T17:17:16.700031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:49.824795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702901+0000","last_change":"2024-09-13T17:17:16.694091+0000","last_active":"2024-09-13T17:17:16.702901+0000","last_peered":"2024-09-13T17:17:16.702901+0000","last_clean":"2024-09-13T17:17:16.702901+0000","last_became_active":"2024-09-13T17:17:16.693856+0000","last_became_peered":"2024-09-13T17:17:16.693856+0000","last_unstale":"2024-09-13T17:17:16.702901+0000","last_undegraded":"2024-09-13T17:17:16.702901+0000","last_fullsized":"2024-09-13T17:17:16.702901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:16.347199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702793+0000","last_change":"2024-09-13T17:17:16.693560+0000","last_active":"2024-09-13T17:17:16.702793+0000","last_peered":"2024-09-13T17:17:16.702793+0000","last_clean":"2024-09-13T17:17:16.702793+0000","last_became_active":"2024-09-13T17:17:16.693290+0000","last_became_peered":"2024-09-13T17:17:16.693290+0000","last_unstale":"2024-09-13T17:17:16.702793+0000","last_undegraded":"2024-09-13T17:17:16.702793+0000","last_fullsized":"2024-09-13T17:17:16.702793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:00.237030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.698790+0000","last_change":"2024-09-13T17:17:16.692756+0000","last_active":"2024-09-13T17:17:16.698790+0000","last_peered":"2024-09-13T17:17:16.698790+0000","last_clean":"2024-09-13T17:17:16.698790+0000","last_became_active":"2024-09-13T17:17:16.692433+0000","last_became_peered":"2024-09-13T17:17:16.692433+0000","last_unstale":"2024-09-13T17:17:16.698790+0000","last_undegraded":"2024-09-13T17:17:16.698790+0000","last_fullsized":"2024-09-13T17:17:16.698790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:46.568550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700090+0000","last_change":"2024-09-13T17:17:16.695658+0000","last_active":"2024-09-13T17:17:16.700090+0000","last_peered":"2024-09-13T17:17:16.700090+0000","last_clean":"2024-09-13T17:17:16.700090+0000","last_became_active":"2024-09-13T17:17:16.695267+0000","last_became_peered":"2024-09-13T17:17:16.695267+0000","last_unstale":"2024-09-13T17:17:16.700090+0000","last_undegraded":"2024-09-13T17:17:16.700090+0000","last_fullsized":"2024-09-13T17:17:16.700090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:44.037795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700724+0000","last_change":"2024-09-13T17:17:16.699533+0000","last_active":"2024-09-13T17:17:16.700724+0000","last_peered":"2024-09-13T17:17:16.700724+0000","last_clean":"2024-09-13T17:17:16.700724+0000","last_became_active":"2024-09-13T17:17:16.699295+0000","last_became_peered":"2024-09-13T17:17:16.699295+0000","last_unstale":"2024-09-13T17:17:16.700724+0000","last_undegraded":"2024-09-13T17:17:16.700724+0000","last_fullsized":"2024-09-13T17:17:16.700724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:39.481312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706332+0000","last_change":"2024-09-13T17:17:16.702981+0000","last_active":"2024-09-13T17:17:16.706332+0000","last_peered":"2024-09-13T17:17:16.706332+0000","last_clean":"2024-09-13T17:17:16.706332+0000","last_became_active":"2024-09-13T17:17:16.702695+0000","last_became_peered":"2024-09-13T17:17:16.702695+0000","last_unstale":"2024-09-13T17:17:16.706332+0000","last_undegraded":"2024-09-13T17:17:16.706332+0000","last_fullsized":"2024-09-13T17:17:16.706332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:48.297780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700243+0000","last_change":"2024-09-13T17:17:16.697012+0000","last_active":"2024-09-13T17:17:16.700243+0000","last_peered":"2024-09-13T17:17:16.700243+0000","last_clean":"2024-09-13T17:17:16.700243+0000","last_became_active":"2024-09-13T17:17:16.696727+0000","last_became_peered":"2024-09-13T17:17:16.696727+0000","last_unstale":"2024-09-13T17:17:16.700243+0000","last_undegraded":"2024-09-13T17:17:16.700243+0000","last_fullsized":"2024-09-13T17:17:16.700243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:08.431777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703171+0000","last_change":"2024-09-13T17:17:16.699517+0000","last_active":"2024-09-13T17:17:16.703171+0000","last_peered":"2024-09-13T17:17:16.703171+0000","last_clean":"2024-09-13T17:17:16.703171+0000","last_became_active":"2024-09-13T17:17:16.699261+0000","last_became_peered":"2024-09-13T17:17:16.699261+0000","last_unstale":"2024-09-13T17:17:16.703171+0000","last_undegraded":"2024-09-13T17:17:16.703171+0000","last_fullsized":"2024-09-13T17:17:16.703171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:41.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700149+0000","last_change":"2024-09-13T17:17:16.696180+0000","last_active":"2024-09-13T17:17:16.700149+0000","last_peered":"2024-09-13T17:17:16.700149+0000","last_clean":"2024-09-13T17:17:16.700149+0000","last_became_active":"2024-09-13T17:17:16.695749+0000","last_became_peered":"2024-09-13T17:17:16.695749+0000","last_unstale":"2024-09-13T17:17:16.700149+0000","last_undegraded":"2024-09-13T17:17:16.700149+0000","last_fullsized":"2024-09-13T17:17:16.700149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:10.786062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696765+0000","last_change":"2024-09-13T17:17:16.694984+0000","last_active":"2024-09-13T17:17:16.696765+0000","last_peered":"2024-09-13T17:17:16.696765+0000","last_clean":"2024-09-13T17:17:16.696765+0000","last_became_active":"2024-09-13T17:17:16.694556+0000","last_became_peered":"2024-09-13T17:17:16.694556+0000","last_unstale":"2024-09-13T17:17:16.696765+0000","last_undegraded":"2024-09-13T17:17:16.696765+0000","last_fullsized":"2024-09-13T17:17:16.696765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:52.730759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"82'4","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711333+0000","last_change":"2024-09-13T17:17:16.334474+0000","last_active":"2024-09-13T17:17:16.711333+0000","last_peered":"2024-09-13T17:17:16.711333+0000","last_clean":"2024-09-13T17:17:16.711333+0000","last_became_active":"2024-09-13T17:17:16.334224+0000","last_became_peered":"2024-09-13T17:17:16.334224+0000","last_unstale":"2024-09-13T17:17:16.711333+0000","last_undegraded":"2024-09-13T17:17:16.711333+0000","last_fullsized":"2024-09-13T17:17:16.711333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:36.847692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694622+0000","last_change":"2024-09-13T17:17:16.691773+0000","last_active":"2024-09-13T17:17:16.694622+0000","last_peered":"2024-09-13T17:17:16.694622+0000","last_clean":"2024-09-13T17:17:16.694622+0000","last_became_active":"2024-09-13T17:17:16.691460+0000","last_became_peered":"2024-09-13T17:17:16.691460+0000","last_unstale":"2024-09-13T17:17:16.694622+0000","last_undegraded":"2024-09-13T17:17:16.694622+0000","last_fullsized":"2024-09-13T17:17:16.694622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:03.235378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712701+0000","last_change":"2024-09-13T17:17:16.332329+0000","last_active":"2024-09-13T17:17:16.712701+0000","last_peered":"2024-09-13T17:17:16.712701+0000","last_clean":"2024-09-13T17:17:16.712701+0000","last_became_active":"2024-09-13T17:17:16.332021+0000","last_became_peered":"2024-09-13T17:17:16.332021+0000","last_unstale":"2024-09-13T17:17:16.712701+0000","last_undegraded":"2024-09-13T17:17:16.712701+0000","last_fullsized":"2024-09-13T17:17:16.712701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:21.457823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700396+0000","last_change":"2024-09-13T17:17:16.696459+0000","last_active":"2024-09-13T17:17:16.700396+0000","last_peered":"2024-09-13T17:17:16.700396+0000","last_clean":"2024-09-13T17:17:16.700396+0000","last_became_active":"2024-09-13T17:17:16.696182+0000","last_became_peered":"2024-09-13T17:17:16.696182+0000","last_unstale":"2024-09-13T17:17:16.700396+0000","last_undegraded":"2024-09-13T17:17:16.700396+0000","last_fullsized":"2024-09-13T17:17:16.700396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:20.885946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709032+0000","last_change":"2024-09-13T17:17:16.332857+0000","last_active":"2024-09-13T17:17:16.709032+0000","last_peered":"2024-09-13T17:17:16.709032+0000","last_clean":"2024-09-13T17:17:16.709032+0000","last_became_active":"2024-09-13T17:17:16.332602+0000","last_became_peered":"2024-09-13T17:17:16.332602+0000","last_unstale":"2024-09-13T17:17:16.709032+0000","last_undegraded":"2024-09-13T17:17:16.709032+0000","last_fullsized":"2024-09-13T17:17:16.709032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:40.982508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700161+0000","last_change":"2024-09-13T17:17:16.695020+0000","last_active":"2024-09-13T17:17:16.700161+0000","last_peered":"2024-09-13T17:17:16.700161+0000","last_clean":"2024-09-13T17:17:16.700161+0000","last_became_active":"2024-09-13T17:17:16.694538+0000","last_became_peered":"2024-09-13T17:17:16.694538+0000","last_unstale":"2024-09-13T17:17:16.700161+0000","last_undegraded":"2024-09-13T17:17:16.700161+0000","last_fullsized":"2024-09-13T17:17:16.700161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712739+0000","last_change":"2024-09-13T17:17:16.330808+0000","last_active":"2024-09-13T17:17:16.712739+0000","last_peered":"2024-09-13T17:17:16.712739+0000","last_clean":"2024-09-13T17:17:16.712739+0000","last_became_active":"2024-09-13T17:17:16.330551+0000","last_became_peered":"2024-09-13T17:17:16.330551+0000","last_unstale":"2024-09-13T17:17:16.712739+0000","last_undegraded":"2024-09-13T17:17:16.712739+0000","last_fullsized":"2024-09-13T17:17:16.712739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:48.822963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707253+0000","last_change":"2024-09-13T17:17:16.697538+0000","last_active":"2024-09-13T17:17:16.707253+0000","last_peered":"2024-09-13T17:17:16.707253+0000","last_clean":"2024-09-13T17:17:16.707253+0000","last_became_active":"2024-09-13T17:17:16.697294+0000","last_became_peered":"2024-09-13T17:17:16.697294+0000","last_unstale":"2024-09-13T17:17:16.707253+0000","last_undegraded":"2024-09-13T17:17:16.707253+0000","last_fullsized":"2024-09-13T17:17:16.707253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:57.084204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706458+0000","last_change":"2024-09-13T17:17:16.327006+0000","last_active":"2024-09-13T17:17:16.706458+0000","last_peered":"2024-09-13T17:17:16.706458+0000","last_clean":"2024-09-13T17:17:16.706458+0000","last_became_active":"2024-09-13T17:17:16.326696+0000","last_became_peered":"2024-09-13T17:17:16.326696+0000","last_unstale":"2024-09-13T17:17:16.706458+0000","last_undegraded":"2024-09-13T17:17:16.706458+0000","last_fullsized":"2024-09-13T17:17:16.706458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:48.268931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708096+0000","last_change":"2024-09-13T17:17:16.701232+0000","last_active":"2024-09-13T17:17:16.708096+0000","last_peered":"2024-09-13T17:17:16.708096+0000","last_clean":"2024-09-13T17:17:16.708096+0000","last_became_active":"2024-09-13T17:17:16.701001+0000","last_became_peered":"2024-09-13T17:17:16.701001+0000","last_unstale":"2024-09-13T17:17:16.708096+0000","last_undegraded":"2024-09-13T17:17:16.708096+0000","last_fullsized":"2024-09-13T17:17:16.708096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:56.338714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711976+0000","last_change":"2024-09-13T17:17:16.329800+0000","last_active":"2024-09-13T17:17:16.711976+0000","last_peered":"2024-09-13T17:17:16.711976+0000","last_clean":"2024-09-13T17:17:16.711976+0000","last_became_active":"2024-09-13T17:17:16.329523+0000","last_became_peered":"2024-09-13T17:17:16.329523+0000","last_unstale":"2024-09-13T17:17:16.711976+0000","last_undegraded":"2024-09-13T17:17:16.711976+0000","last_fullsized":"2024-09-13T17:17:16.711976+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:45.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700066+0000","last_change":"2024-09-13T17:17:16.696712+0000","last_active":"2024-09-13T17:17:16.700066+0000","last_peered":"2024-09-13T17:17:16.700066+0000","last_clean":"2024-09-13T17:17:16.700066+0000","last_became_active":"2024-09-13T17:17:16.696176+0000","last_became_peered":"2024-09-13T17:17:16.696176+0000","last_unstale":"2024-09-13T17:17:16.700066+0000","last_undegraded":"2024-09-13T17:17:16.700066+0000","last_fullsized":"2024-09-13T17:17:16.700066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.861892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.683473+0000","last_change":"2024-09-13T17:17:16.328055+0000","last_active":"2024-09-13T17:17:16.683473+0000","last_peered":"2024-09-13T17:17:16.683473+0000","last_clean":"2024-09-13T17:17:16.683473+0000","last_became_active":"2024-09-13T17:17:16.327467+0000","last_became_peered":"2024-09-13T17:17:16.327467+0000","last_unstale":"2024-09-13T17:17:16.683473+0000","last_undegraded":"2024-09-13T17:17:16.683473+0000","last_fullsized":"2024-09-13T17:17:16.683473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:05.566663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712434+0000","last_change":"2024-09-13T17:17:16.704103+0000","last_active":"2024-09-13T17:17:16.712434+0000","last_peered":"2024-09-13T17:17:16.712434+0000","last_clean":"2024-09-13T17:17:16.712434+0000","last_became_active":"2024-09-13T17:17:16.703828+0000","last_became_peered":"2024-09-13T17:17:16.703828+0000","last_unstale":"2024-09-13T17:17:16.712434+0000","last_undegraded":"2024-09-13T17:17:16.712434+0000","last_fullsized":"2024-09-13T17:17:16.712434+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687112+0000","last_change":"2024-09-13T17:17:16.331317+0000","last_active":"2024-09-13T17:17:16.687112+0000","last_peered":"2024-09-13T17:17:16.687112+0000","last_clean":"2024-09-13T17:17:16.687112+0000","last_became_active":"2024-09-13T17:17:16.329686+0000","last_became_peered":"2024-09-13T17:17:16.329686+0000","last_unstale":"2024-09-13T17:17:16.687112+0000","last_undegraded":"2024-09-13T17:17:16.687112+0000","last_fullsized":"2024-09-13T17:17:16.687112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:44.031387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.706845+0000","last_change":"2024-09-13T17:17:16.701725+0000","last_active":"2024-09-13T17:17:16.706845+0000","last_peered":"2024-09-13T17:17:16.706845+0000","last_clean":"2024-09-13T17:17:16.706845+0000","last_became_active":"2024-09-13T17:17:16.701488+0000","last_became_peered":"2024-09-13T17:17:16.701488+0000","last_unstale":"2024-09-13T17:17:16.706845+0000","last_undegraded":"2024-09-13T17:17:16.706845+0000","last_fullsized":"2024-09-13T17:17:16.706845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:32:28.911236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689830+0000","last_change":"2024-09-13T17:17:16.332730+0000","last_active":"2024-09-13T17:17:16.689830+0000","last_peered":"2024-09-13T17:17:16.689830+0000","last_clean":"2024-09-13T17:17:16.689830+0000","last_became_active":"2024-09-13T17:17:16.332093+0000","last_became_peered":"2024-09-13T17:17:16.332093+0000","last_unstale":"2024-09-13T17:17:16.689830+0000","last_undegraded":"2024-09-13T17:17:16.689830+0000","last_fullsized":"2024-09-13T17:17:16.689830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.401946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696681+0000","last_change":"2024-09-13T17:17:16.692046+0000","last_active":"2024-09-13T17:17:16.696681+0000","last_peered":"2024-09-13T17:17:16.696681+0000","last_clean":"2024-09-13T17:17:16.696681+0000","last_became_active":"2024-09-13T17:17:16.691781+0000","last_became_peered":"2024-09-13T17:17:16.691781+0000","last_unstale":"2024-09-13T17:17:16.696681+0000","last_undegraded":"2024-09-13T17:17:16.696681+0000","last_fullsized":"2024-09-13T17:17:16.696681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686388+0000","last_change":"2024-09-13T17:17:16.326285+0000","last_active":"2024-09-13T17:17:16.686388+0000","last_peered":"2024-09-13T17:17:16.686388+0000","last_clean":"2024-09-13T17:17:16.686388+0000","last_became_active":"2024-09-13T17:17:16.326026+0000","last_became_peered":"2024-09-13T17:17:16.326026+0000","last_unstale":"2024-09-13T17:17:16.686388+0000","last_undegraded":"2024-09-13T17:17:16.686388+0000","last_fullsized":"2024-09-13T17:17:16.686388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.588830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.701370+0000","last_change":"2024-09-13T17:17:16.698732+0000","last_active":"2024-09-13T17:17:16.701370+0000","last_peered":"2024-09-13T17:17:16.701370+0000","last_clean":"2024-09-13T17:17:16.701370+0000","last_became_active":"2024-09-13T17:17:16.698411+0000","last_became_peered":"2024-09-13T17:17:16.698411+0000","last_unstale":"2024-09-13T17:17:16.701370+0000","last_undegraded":"2024-09-13T17:17:16.701370+0000","last_fullsized":"2024-09-13T17:17:16.701370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:16.347199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"82'3","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.710111+0000","last_change":"2024-09-13T17:17:16.332696+0000","last_active":"2024-09-13T17:17:16.710111+0000","last_peered":"2024-09-13T17:17:16.710111+0000","last_clean":"2024-09-13T17:17:16.710111+0000","last_became_active":"2024-09-13T17:17:16.332392+0000","last_became_peered":"2024-09-13T17:17:16.332392+0000","last_unstale":"2024-09-13T17:17:16.710111+0000","last_undegraded":"2024-09-13T17:17:16.710111+0000","last_fullsized":"2024-09-13T17:17:16.710111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.244978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696634+0000","last_change":"2024-09-13T17:17:16.694186+0000","last_active":"2024-09-13T17:17:16.696634+0000","last_peered":"2024-09-13T17:17:16.696634+0000","last_clean":"2024-09-13T17:17:16.696634+0000","last_became_active":"2024-09-13T17:17:16.693860+0000","last_became_peered":"2024-09-13T17:17:16.693860+0000","last_unstale":"2024-09-13T17:17:16.696634+0000","last_undegraded":"2024-09-13T17:17:16.696634+0000","last_fullsized":"2024-09-13T17:17:16.696634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"82'6","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.714666+0000","last_change":"2024-09-13T17:17:16.328724+0000","last_active":"2024-09-13T17:17:16.714666+0000","last_peered":"2024-09-13T17:17:16.714666+0000","last_clean":"2024-09-13T17:17:16.714666+0000","last_became_active":"2024-09-13T17:17:16.328494+0000","last_became_peered":"2024-09-13T17:17:16.328494+0000","last_unstale":"2024-09-13T17:17:16.714666+0000","last_undegraded":"2024-09-13T17:17:16.714666+0000","last_fullsized":"2024-09-13T17:17:16.714666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:34.316938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703484+0000","last_change":"2024-09-13T17:17:16.699330+0000","last_active":"2024-09-13T17:17:16.703484+0000","last_peered":"2024-09-13T17:17:16.703484+0000","last_clean":"2024-09-13T17:17:16.703484+0000","last_became_active":"2024-09-13T17:17:16.698517+0000","last_became_peered":"2024-09-13T17:17:16.698517+0000","last_unstale":"2024-09-13T17:17:16.703484+0000","last_undegraded":"2024-09-13T17:17:16.703484+0000","last_fullsized":"2024-09-13T17:17:16.703484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:12.125455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712453+0000","last_change":"2024-09-13T17:17:16.320644+0000","last_active":"2024-09-13T17:17:16.712453+0000","last_peered":"2024-09-13T17:17:16.712453+0000","last_clean":"2024-09-13T17:17:16.712453+0000","last_became_active":"2024-09-13T17:17:16.320327+0000","last_became_peered":"2024-09-13T17:17:16.320327+0000","last_unstale":"2024-09-13T17:17:16.712453+0000","last_undegraded":"2024-09-13T17:17:16.712453+0000","last_fullsized":"2024-09-13T17:17:16.712453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:54.584084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704173+0000","last_change":"2024-09-13T17:17:16.697967+0000","last_active":"2024-09-13T17:17:16.704173+0000","last_peered":"2024-09-13T17:17:16.704173+0000","last_clean":"2024-09-13T17:17:16.704173+0000","last_became_active":"2024-09-13T17:17:16.697660+0000","last_became_peered":"2024-09-13T17:17:16.697660+0000","last_unstale":"2024-09-13T17:17:16.704173+0000","last_undegraded":"2024-09-13T17:17:16.704173+0000","last_fullsized":"2024-09-13T17:17:16.704173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.688984+0000","last_change":"2024-09-13T17:17:16.335098+0000","last_active":"2024-09-13T17:17:16.688984+0000","last_peered":"2024-09-13T17:17:16.688984+0000","last_clean":"2024-09-13T17:17:16.688984+0000","last_became_active":"2024-09-13T17:17:16.334873+0000","last_became_peered":"2024-09-13T17:17:16.334873+0000","last_unstale":"2024-09-13T17:17:16.688984+0000","last_undegraded":"2024-09-13T17:17:16.688984+0000","last_fullsized":"2024-09-13T17:17:16.688984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:57.978998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705004+0000","last_change":"2024-09-13T17:17:16.701685+0000","last_active":"2024-09-13T17:17:16.705004+0000","last_peered":"2024-09-13T17:17:16.705004+0000","last_clean":"2024-09-13T17:17:16.705004+0000","last_became_active":"2024-09-13T17:17:16.701409+0000","last_became_peered":"2024-09-13T17:17:16.701409+0000","last_unstale":"2024-09-13T17:17:16.705004+0000","last_undegraded":"2024-09-13T17:17:16.705004+0000","last_fullsized":"2024-09-13T17:17:16.705004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.585916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687249+0000","last_change":"2024-09-13T17:17:16.334393+0000","last_active":"2024-09-13T17:17:16.687249+0000","last_peered":"2024-09-13T17:17:16.687249+0000","last_clean":"2024-09-13T17:17:16.687249+0000","last_became_active":"2024-09-13T17:17:16.334130+0000","last_became_peered":"2024-09-13T17:17:16.334130+0000","last_unstale":"2024-09-13T17:17:16.687249+0000","last_undegraded":"2024-09-13T17:17:16.687249+0000","last_fullsized":"2024-09-13T17:17:16.687249+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:25.081137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705428+0000","last_change":"2024-09-13T17:17:16.701970+0000","last_active":"2024-09-13T17:17:16.705428+0000","last_peered":"2024-09-13T17:17:16.705428+0000","last_clean":"2024-09-13T17:17:16.705428+0000","last_became_active":"2024-09-13T17:17:16.701707+0000","last_became_peered":"2024-09-13T17:17:16.701707+0000","last_unstale":"2024-09-13T17:17:16.705428+0000","last_undegraded":"2024-09-13T17:17:16.705428+0000","last_fullsized":"2024-09-13T17:17:16.705428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:17.824041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"82'8","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.713469+0000","last_change":"2024-09-13T17:17:16.331655+0000","last_active":"2024-09-13T17:17:16.713469+0000","last_peered":"2024-09-13T17:17:16.713469+0000","last_clean":"2024-09-13T17:17:16.713469+0000","last_became_active":"2024-09-13T17:17:16.331357+0000","last_became_peered":"2024-09-13T17:17:16.331357+0000","last_unstale":"2024-09-13T17:17:16.713469+0000","last_undegraded":"2024-09-13T17:17:16.713469+0000","last_fullsized":"2024-09-13T17:17:16.713469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:45.566718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.701350+0000","last_change":"2024-09-13T17:17:16.697114+0000","last_active":"2024-09-13T17:17:16.701350+0000","last_peered":"2024-09-13T17:17:16.701350+0000","last_clean":"2024-09-13T17:17:16.701350+0000","last_became_active":"2024-09-13T17:17:16.696867+0000","last_became_peered":"2024-09-13T17:17:16.696867+0000","last_unstale":"2024-09-13T17:17:16.701350+0000","last_undegraded":"2024-09-13T17:17:16.701350+0000","last_fullsized":"2024-09-13T17:17:16.701350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:56.338714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708158+0000","last_change":"2024-09-13T17:17:16.328532+0000","last_active":"2024-09-13T17:17:16.708158+0000","last_peered":"2024-09-13T17:17:16.708158+0000","last_clean":"2024-09-13T17:17:16.708158+0000","last_became_active":"2024-09-13T17:17:16.328203+0000","last_became_peered":"2024-09-13T17:17:16.328203+0000","last_unstale":"2024-09-13T17:17:16.708158+0000","last_undegraded":"2024-09-13T17:17:16.708158+0000","last_fullsized":"2024-09-13T17:17:16.708158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:11.408333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.708976+0000","last_change":"2024-09-13T17:17:16.703745+0000","last_active":"2024-09-13T17:17:16.708976+0000","last_peered":"2024-09-13T17:17:16.708976+0000","last_clean":"2024-09-13T17:17:16.708976+0000","last_became_active":"2024-09-13T17:17:16.703312+0000","last_became_peered":"2024-09-13T17:17:16.703312+0000","last_unstale":"2024-09-13T17:17:16.708976+0000","last_undegraded":"2024-09-13T17:17:16.708976+0000","last_fullsized":"2024-09-13T17:17:16.708976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:20.698629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707695+0000","last_change":"2024-09-13T17:17:16.320133+0000","last_active":"2024-09-13T17:17:16.707695+0000","last_peered":"2024-09-13T17:17:16.707695+0000","last_clean":"2024-09-13T17:17:16.707695+0000","last_became_active":"2024-09-13T17:17:16.319882+0000","last_became_peered":"2024-09-13T17:17:16.319882+0000","last_unstale":"2024-09-13T17:17:16.707695+0000","last_undegraded":"2024-09-13T17:17:16.707695+0000","last_fullsized":"2024-09-13T17:17:16.707695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:17.325763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709010+0000","last_change":"2024-09-13T17:17:16.703858+0000","last_active":"2024-09-13T17:17:16.709010+0000","last_peered":"2024-09-13T17:17:16.709010+0000","last_clean":"2024-09-13T17:17:16.709010+0000","last_became_active":"2024-09-13T17:17:16.703574+0000","last_became_peered":"2024-09-13T17:17:16.703574+0000","last_unstale":"2024-09-13T17:17:16.709010+0000","last_undegraded":"2024-09-13T17:17:16.709010+0000","last_fullsized":"2024-09-13T17:17:16.709010+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:52.062873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"82'1","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711945+0000","last_change":"2024-09-13T17:17:16.331308+0000","last_active":"2024-09-13T17:17:16.711945+0000","last_peered":"2024-09-13T17:17:16.711945+0000","last_clean":"2024-09-13T17:17:16.711945+0000","last_became_active":"2024-09-13T17:17:16.331015+0000","last_became_peered":"2024-09-13T17:17:16.331015+0000","last_unstale":"2024-09-13T17:17:16.711945+0000","last_undegraded":"2024-09-13T17:17:16.711945+0000","last_fullsized":"2024-09-13T17:17:16.711945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:36.787387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702452+0000","last_change":"2024-09-13T17:17:16.700165+0000","last_active":"2024-09-13T17:17:16.702452+0000","last_peered":"2024-09-13T17:17:16.702452+0000","last_clean":"2024-09-13T17:17:16.702452+0000","last_became_active":"2024-09-13T17:17:16.699912+0000","last_became_peered":"2024-09-13T17:17:16.699912+0000","last_unstale":"2024-09-13T17:17:16.702452+0000","last_undegraded":"2024-09-13T17:17:16.702452+0000","last_fullsized":"2024-09-13T17:17:16.702452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:59.019568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.688428+0000","last_change":"2024-09-13T17:17:16.326635+0000","last_active":"2024-09-13T17:17:16.688428+0000","last_peered":"2024-09-13T17:17:16.688428+0000","last_clean":"2024-09-13T17:17:16.688428+0000","last_became_active":"2024-09-13T17:17:16.326361+0000","last_became_peered":"2024-09-13T17:17:16.326361+0000","last_unstale":"2024-09-13T17:17:16.688428+0000","last_undegraded":"2024-09-13T17:17:16.688428+0000","last_fullsized":"2024-09-13T17:17:16.688428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:06.160688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.705517+0000","last_change":"2024-09-13T17:17:16.694316+0000","last_active":"2024-09-13T17:17:16.705517+0000","last_peered":"2024-09-13T17:17:16.705517+0000","last_clean":"2024-09-13T17:17:16.705517+0000","last_became_active":"2024-09-13T17:17:16.694071+0000","last_became_peered":"2024-09-13T17:17:16.694071+0000","last_unstale":"2024-09-13T17:17:16.705517+0000","last_undegraded":"2024-09-13T17:17:16.705517+0000","last_fullsized":"2024-09-13T17:17:16.705517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:33.434051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.709080+0000","last_change":"2024-09-13T17:17:16.328308+0000","last_active":"2024-09-13T17:17:16.709080+0000","last_peered":"2024-09-13T17:17:16.709080+0000","last_clean":"2024-09-13T17:17:16.709080+0000","last_became_active":"2024-09-13T17:17:16.327344+0000","last_became_peered":"2024-09-13T17:17:16.327344+0000","last_unstale":"2024-09-13T17:17:16.709080+0000","last_undegraded":"2024-09-13T17:17:16.709080+0000","last_fullsized":"2024-09-13T17:17:16.709080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.612779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.707209+0000","last_change":"2024-09-13T17:17:16.696845+0000","last_active":"2024-09-13T17:17:16.707209+0000","last_peered":"2024-09-13T17:17:16.707209+0000","last_clean":"2024-09-13T17:17:16.707209+0000","last_became_active":"2024-09-13T17:17:16.696573+0000","last_became_peered":"2024-09-13T17:17:16.696573+0000","last_unstale":"2024-09-13T17:17:16.707209+0000","last_undegraded":"2024-09-13T17:17:16.707209+0000","last_fullsized":"2024-09-13T17:17:16.707209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:59.019568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686775+0000","last_change":"2024-09-13T17:17:16.327629+0000","last_active":"2024-09-13T17:17:16.686775+0000","last_peered":"2024-09-13T17:17:16.686775+0000","last_clean":"2024-09-13T17:17:16.686775+0000","last_became_active":"2024-09-13T17:17:16.327353+0000","last_became_peered":"2024-09-13T17:17:16.327353+0000","last_unstale":"2024-09-13T17:17:16.686775+0000","last_undegraded":"2024-09-13T17:17:16.686775+0000","last_fullsized":"2024-09-13T17:17:16.686775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:02.046273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.704497+0000","last_change":"2024-09-13T17:17:16.700603+0000","last_active":"2024-09-13T17:17:16.704497+0000","last_peered":"2024-09-13T17:17:16.704497+0000","last_clean":"2024-09-13T17:17:16.704497+0000","last_became_active":"2024-09-13T17:17:16.699396+0000","last_became_peered":"2024-09-13T17:17:16.699396+0000","last_unstale":"2024-09-13T17:17:16.704497+0000","last_undegraded":"2024-09-13T17:17:16.704497+0000","last_fullsized":"2024-09-13T17:17:16.704497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:22.459655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.686636+0000","last_change":"2024-09-13T17:17:16.323769+0000","last_active":"2024-09-13T17:17:16.686636+0000","last_peered":"2024-09-13T17:17:16.686636+0000","last_clean":"2024-09-13T17:17:16.686636+0000","last_became_active":"2024-09-13T17:17:16.323491+0000","last_became_peered":"2024-09-13T17:17:16.323491+0000","last_unstale":"2024-09-13T17:17:16.686636+0000","last_undegraded":"2024-09-13T17:17:16.686636+0000","last_fullsized":"2024-09-13T17:17:16.686636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:09.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703891+0000","last_change":"2024-09-13T17:17:16.701175+0000","last_active":"2024-09-13T17:17:16.703891+0000","last_peered":"2024-09-13T17:17:16.703891+0000","last_clean":"2024-09-13T17:17:16.703891+0000","last_became_active":"2024-09-13T17:17:16.700838+0000","last_became_peered":"2024-09-13T17:17:16.700838+0000","last_unstale":"2024-09-13T17:17:16.703891+0000","last_undegraded":"2024-09-13T17:17:16.703891+0000","last_fullsized":"2024-09-13T17:17:16.703891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:48.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"82'2","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712088+0000","last_change":"2024-09-13T17:17:16.324117+0000","last_active":"2024-09-13T17:17:16.712088+0000","last_peered":"2024-09-13T17:17:16.712088+0000","last_clean":"2024-09-13T17:17:16.712088+0000","last_became_active":"2024-09-13T17:17:16.323792+0000","last_became_peered":"2024-09-13T17:17:16.323792+0000","last_unstale":"2024-09-13T17:17:16.712088+0000","last_undegraded":"2024-09-13T17:17:16.712088+0000","last_fullsized":"2024-09-13T17:17:16.712088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:19.884114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.712556+0000","last_change":"2024-09-13T17:17:16.705190+0000","last_active":"2024-09-13T17:17:16.712556+0000","last_peered":"2024-09-13T17:17:16.712556+0000","last_clean":"2024-09-13T17:17:16.712556+0000","last_became_active":"2024-09-13T17:17:16.704889+0000","last_became_peered":"2024-09-13T17:17:16.704889+0000","last_unstale":"2024-09-13T17:17:16.712556+0000","last_undegraded":"2024-09-13T17:17:16.712556+0000","last_fullsized":"2024-09-13T17:17:16.712556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:54.749893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.684225+0000","last_change":"2024-09-13T17:17:16.330820+0000","last_active":"2024-09-13T17:17:16.684225+0000","last_peered":"2024-09-13T17:17:16.684225+0000","last_clean":"2024-09-13T17:17:16.684225+0000","last_became_active":"2024-09-13T17:17:16.329860+0000","last_became_peered":"2024-09-13T17:17:16.329860+0000","last_unstale":"2024-09-13T17:17:16.684225+0000","last_undegraded":"2024-09-13T17:17:16.684225+0000","last_fullsized":"2024-09-13T17:17:16.684225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:03.711246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700417+0000","last_change":"2024-09-13T17:17:16.697234+0000","last_active":"2024-09-13T17:17:16.700417+0000","last_peered":"2024-09-13T17:17:16.700417+0000","last_clean":"2024-09-13T17:17:16.700417+0000","last_became_active":"2024-09-13T17:17:16.696877+0000","last_became_peered":"2024-09-13T17:17:16.696877+0000","last_unstale":"2024-09-13T17:17:16.700417+0000","last_undegraded":"2024-09-13T17:17:16.700417+0000","last_fullsized":"2024-09-13T17:17:16.700417+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:26.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689628+0000","last_change":"2024-09-13T17:17:16.329775+0000","last_active":"2024-09-13T17:17:16.689628+0000","last_peered":"2024-09-13T17:17:16.689628+0000","last_clean":"2024-09-13T17:17:16.689628+0000","last_became_active":"2024-09-13T17:17:16.329513+0000","last_became_peered":"2024-09-13T17:17:16.329513+0000","last_unstale":"2024-09-13T17:17:16.689628+0000","last_undegraded":"2024-09-13T17:17:16.689628+0000","last_fullsized":"2024-09-13T17:17:16.689628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:45.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694267+0000","last_change":"2024-09-13T17:17:16.692378+0000","last_active":"2024-09-13T17:17:16.694267+0000","last_peered":"2024-09-13T17:17:16.694267+0000","last_clean":"2024-09-13T17:17:16.694267+0000","last_became_active":"2024-09-13T17:17:16.692146+0000","last_became_peered":"2024-09-13T17:17:16.692146+0000","last_unstale":"2024-09-13T17:17:16.694267+0000","last_undegraded":"2024-09-13T17:17:16.694267+0000","last_fullsized":"2024-09-13T17:17:16.694267+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.713215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689383+0000","last_change":"2024-09-13T17:17:16.332243+0000","last_active":"2024-09-13T17:17:16.689383+0000","last_peered":"2024-09-13T17:17:16.689383+0000","last_clean":"2024-09-13T17:17:16.689383+0000","last_became_active":"2024-09-13T17:17:16.331818+0000","last_became_peered":"2024-09-13T17:17:16.331818+0000","last_unstale":"2024-09-13T17:17:16.689383+0000","last_undegraded":"2024-09-13T17:17:16.689383+0000","last_fullsized":"2024-09-13T17:17:16.689383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:16.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.711555+0000","last_change":"2024-09-13T17:17:16.703195+0000","last_active":"2024-09-13T17:17:16.711555+0000","last_peered":"2024-09-13T17:17:16.711555+0000","last_clean":"2024-09-13T17:17:16.711555+0000","last_became_active":"2024-09-13T17:17:16.702878+0000","last_became_peered":"2024-09-13T17:17:16.702878+0000","last_unstale":"2024-09-13T17:17:16.711555+0000","last_undegraded":"2024-09-13T17:17:16.711555+0000","last_fullsized":"2024-09-13T17:17:16.711555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:17.002108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.690927+0000","last_change":"2024-09-13T17:17:16.327277+0000","last_active":"2024-09-13T17:17:16.690927+0000","last_peered":"2024-09-13T17:17:16.690927+0000","last_clean":"2024-09-13T17:17:16.690927+0000","last_became_active":"2024-09-13T17:17:16.326981+0000","last_became_peered":"2024-09-13T17:17:16.326981+0000","last_unstale":"2024-09-13T17:17:16.690927+0000","last_undegraded":"2024-09-13T17:17:16.690927+0000","last_fullsized":"2024-09-13T17:17:16.690927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:54.123795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.702872+0000","last_change":"2024-09-13T17:17:16.697819+0000","last_active":"2024-09-13T17:17:16.702872+0000","last_peered":"2024-09-13T17:17:16.702872+0000","last_clean":"2024-09-13T17:17:16.702872+0000","last_became_active":"2024-09-13T17:17:16.697499+0000","last_became_peered":"2024-09-13T17:17:16.697499+0000","last_unstale":"2024-09-13T17:17:16.702872+0000","last_undegraded":"2024-09-13T17:17:16.702872+0000","last_fullsized":"2024-09-13T17:17:16.702872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:41.984340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689821+0000","last_change":"2024-09-13T17:17:16.335032+0000","last_active":"2024-09-13T17:17:16.689821+0000","last_peered":"2024-09-13T17:17:16.689821+0000","last_clean":"2024-09-13T17:17:16.689821+0000","last_became_active":"2024-09-13T17:17:16.334775+0000","last_became_peered":"2024-09-13T17:17:16.334775+0000","last_unstale":"2024-09-13T17:17:16.689821+0000","last_undegraded":"2024-09-13T17:17:16.689821+0000","last_fullsized":"2024-09-13T17:17:16.689821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:29.222302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.696207+0000","last_change":"2024-09-13T17:17:16.695366+0000","last_active":"2024-09-13T17:17:16.696207+0000","last_peered":"2024-09-13T17:17:16.696207+0000","last_clean":"2024-09-13T17:17:16.696207+0000","last_became_active":"2024-09-13T17:17:16.694866+0000","last_became_peered":"2024-09-13T17:17:16.694866+0000","last_unstale":"2024-09-13T17:17:16.696207+0000","last_undegraded":"2024-09-13T17:17:16.696207+0000","last_fullsized":"2024-09-13T17:17:16.696207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:39.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.694149+0000","last_change":"2024-09-13T17:17:16.330262+0000","last_active":"2024-09-13T17:17:16.694149+0000","last_peered":"2024-09-13T17:17:16.694149+0000","last_clean":"2024-09-13T17:17:16.694149+0000","last_became_active":"2024-09-13T17:17:16.329622+0000","last_became_peered":"2024-09-13T17:17:16.329622+0000","last_unstale":"2024-09-13T17:17:16.694149+0000","last_undegraded":"2024-09-13T17:17:16.694149+0000","last_fullsized":"2024-09-13T17:17:16.694149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:26.397292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.703085+0000","last_change":"2024-09-13T17:17:16.698489+0000","last_active":"2024-09-13T17:17:16.703085+0000","last_peered":"2024-09-13T17:17:16.703085+0000","last_clean":"2024-09-13T17:17:16.703085+0000","last_became_active":"2024-09-13T17:17:16.698199+0000","last_became_peered":"2024-09-13T17:17:16.698199+0000","last_unstale":"2024-09-13T17:17:16.703085+0000","last_undegraded":"2024-09-13T17:17:16.703085+0000","last_fullsized":"2024-09-13T17:17:16.703085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.403778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.689194+0000","last_change":"2024-09-13T17:17:16.324411+0000","last_active":"2024-09-13T17:17:16.689194+0000","last_peered":"2024-09-13T17:17:16.689194+0000","last_clean":"2024-09-13T17:17:16.689194+0000","last_became_active":"2024-09-13T17:17:16.324146+0000","last_became_peered":"2024-09-13T17:17:16.324146+0000","last_unstale":"2024-09-13T17:17:16.689194+0000","last_undegraded":"2024-09-13T17:17:16.689194+0000","last_fullsized":"2024-09-13T17:17:16.689194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.711283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.700109+0000","last_change":"2024-09-13T17:17:16.696337+0000","last_active":"2024-09-13T17:17:16.700109+0000","last_peered":"2024-09-13T17:17:16.700109+0000","last_clean":"2024-09-13T17:17:16.700109+0000","last_became_active":"2024-09-13T17:17:16.695883+0000","last_became_peered":"2024-09-13T17:17:16.695883+0000","last_unstale":"2024-09-13T17:17:16.700109+0000","last_undegraded":"2024-09-13T17:17:16.700109+0000","last_fullsized":"2024-09-13T17:17:16.700109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:16.308461+0000","last_clean_scrub_stamp":"2024-09-13T17:17:16.308461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:04.713078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.687902+0000","last_change":"2024-09-13T17:17:16.323574+0000","last_active":"2024-09-13T17:17:16.687902+0000","last_peered":"2024-09-13T17:17:16.687902+0000","last_clean":"2024-09-13T17:17:16.687902+0000","last_became_active":"2024-09-13T17:17:16.323302+0000","last_became_peered":"2024-09-13T17:17:16.323302+0000","last_unstale":"2024-09-13T17:17:16.687902+0000","last_undegraded":"2024-09-13T17:17:16.687902+0000","last_fullsized":"2024-09-13T17:17:16.687902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:15.306629+0000","last_clean_scrub_stamp":"2024-09-13T17:17:15.306629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:07.429945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T17:17:16.324242+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:16.324242+0000","last_peered":"2024-09-13T17:17:16.324242+0000","last_clean":"2024-09-13T17:17:16.324242+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:16.324242+0000","last_undegraded":"2024-09-13T17:17:16.324242+0000","last_fullsized":"2024-09-13T17:17:16.324242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28576,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343264,"statfs":{"total":96636764160,"available":96607502336,"internally_reserved":0,"allocated":1585152,"data_stored":1038672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.379}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.438}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.26600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.35299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.33300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":456963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.505}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.436}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":455433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":448304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.748},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1007616,"data_stored":455981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.318}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.376},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.503}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.443}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1015808,"data_stored":456141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.247},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.311}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.27600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1011712,"data_stored":455511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.254}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.308},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.376}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1585152,"data_stored":1038672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.98499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":1.026},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.878}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:20.004 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:17:20.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:17:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.147+0000 7f3862f1f640 1 Processor -- start 2024-09-13T17:17:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.147+0000 7f3862f1f640 1 -- start start 2024-09-13T17:17:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f3862f1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385c0adb60 0x7f385c165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f3862f1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c15ad50 con 0x7f385c15a910 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f3862f1f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c0cae40 con 0x7f385c143ea0 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f3862f1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385c0adff0 con 0x7f385c0adb60 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f38614bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385c0adb60 0x7f385c165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f385bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f385c15a910 0x7f385c0cc840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59936/0 (socket says 172.21.15.5:59936) 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f38614bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385c0adb60 0x7f385c165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53242/0 (socket says 172.21.15.5:53242) 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f385bfff640 1 -- 172.21.15.5:0/4261472000 learned_addr learned my addr 172.21.15.5:0/4261472000 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f38614bc640 1 -- 172.21.15.5:0/4261472000 >> v1:172.21.15.179:6789/0 conn(0x7f385c143ea0 legacy=0x7f385c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f38614bc640 1 -- 172.21.15.5:0/4261472000 >> v1:172.21.15.5:6789/0 conn(0x7f385c15a910 legacy=0x7f385c0cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.148+0000 7f38614bc640 1 -- 172.21.15.5:0/4261472000 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c0cbca0 con 0x7f385c0adb60 2024-09-13T17:17:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.149+0000 7f38614bc640 1 --2- 172.21.15.5:0/4261472000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c0adb60 0x7f385c165080 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f384c009d90 tx=0x7f384c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48efbcfc4302e641 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.149+0000 7f385b7fe640 1 -- 172.21.15.5:0/4261472000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c007740 con 0x7f385c0adb60 2024-09-13T17:17:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.149+0000 7f385b7fe640 1 -- 172.21.15.5:0/4261472000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c02d050 con 0x7f385c0adb60 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.149+0000 7f385b7fe640 1 -- 172.21.15.5:0/4261472000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c007ac0 con 0x7f385c0adb60 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 -- 172.21.15.5:0/4261472000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c0adb60 msgr2=0x7f385c165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 --2- 172.21.15.5:0/4261472000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c0adb60 0x7f385c165080 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f384c009d90 tx=0x7f384c02a6a0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 -- 172.21.15.5:0/4261472000 shutdown_connections 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 --2- 172.21.15.5:0/4261472000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c0adb60 0x7f385c165080 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 -- 172.21.15.5:0/4261472000 >> 172.21.15.5:0/4261472000 conn(0x7f385c069ed0 msgr2=0x7f385c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 -- 172.21.15.5:0/4261472000 shutdown_connections 2024-09-13T17:17:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.150+0000 7f3862f1f640 1 -- 172.21.15.5:0/4261472000 wait complete. 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.151+0000 7f3862f1f640 1 Processor -- start 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.151+0000 7f3862f1f640 1 -- start start 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385c0adb60 0x7f385c13e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 0x7f385c1e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c1e52d0 con 0x7f385c143ea0 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c1e5500 con 0x7f385c15a910 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3862f1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c1e57e0 con 0x7f385c0adb60 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53250/0 (socket says 172.21.15.5:53250) 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 -- 172.21.15.5:0/1063922429 learned_addr learned my addr 172.21.15.5:0/1063922429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f3860cbb640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385c0adb60 0x7f385c13e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 -- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385c0adb60 msgr2=0x7f385c13e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f38614bc640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 0x7f385c1e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385c0adb60 0x7f385c13e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 -- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 msgr2=0x7f385c1e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.152+0000 7f385bfff640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 0x7f385c1e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f385bfff640 1 -- 172.21.15.5:0/1063922429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009a70 con 0x7f385c143ea0 2024-09-13T17:17:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f38614bc640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 0x7f385c1e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f385bfff640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f384400c4a0 tx=0x7f384400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844005ce0 con 0x7f385c143ea0 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844005e40 con 0x7f385c143ea0 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c1e5ac0 con 0x7f385c143ea0 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844007270 con 0x7f385c143ea0 2024-09-13T17:17:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.153+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c1e6080 con 0x7f385c143ea0 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.154+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c1e6270 con 0x7f385c143ea0 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.154+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3844007490 con 0x7f385c143ea0 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.155+0000 7f38597fa640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 0x7f383c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.155+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f38440888b0 con 0x7f385c143ea0 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.155+0000 7f3860cbb640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 0x7f383c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.156+0000 7f3860cbb640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 0x7f383c06d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f385c1f36c0 tx=0x7f3854008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.159+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3844053a90 con 0x7f385c143ea0 2024-09-13T17:17:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.392+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f385c0cb650 con 0x7f385c143ea0 2024-09-13T17:17:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.396+0000 7f38597fa640 1 -- 172.21.15.5:0/1063922429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f38440170e0 con 0x7f385c143ea0 2024-09-13T17:17:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:17:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 msgr2=0x7f383c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 0x7f383c06d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f385c1f36c0 tx=0x7f3854008040 comp rx=0 tx=0).stop 2024-09-13T17:17:20.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 msgr2=0x7f385c1e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f384400c4a0 tx=0x7f384400c960 comp rx=0 tx=0).stop 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 shutdown_connections 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f385c15a910 0x7f385c1e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f383c06ac00 0x7f383c06d0c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385c143ea0 0x7f385c1e65a0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 --2- 172.21.15.5:0/1063922429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f385c0adb60 0x7f385c13e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 >> 172.21.15.5:0/1063922429 conn(0x7f385c069ed0 msgr2=0x7f385c06c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 shutdown_connections 2024-09-13T17:17:20.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.398+0000 7f3862f1f640 1 -- 172.21.15.5:0/1063922429 wait complete. 2024-09-13T17:17:20.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.511+0000 7fc5d479c640 1 Processor -- start 2024-09-13T17:17:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.511+0000 7fc5d479c640 1 -- start start 2024-09-13T17:17:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d479c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5cc0cb6c0 0x7fc5cc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d479c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0b2180 con 0x7fc5cc15a880 2024-09-13T17:17:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d479c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0b2420 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d479c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b2700 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d2d39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5cc0cb6c0 0x7fc5cc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d1d37640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc5cc15a880 0x7fc5cc15afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59944/0 (socket says 172.21.15.5:59944) 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d1d37640 1 -- 172.21.15.5:0/3302458160 learned_addr learned my addr 172.21.15.5:0/3302458160 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d2d39640 1 -- 172.21.15.5:0/3302458160 >> v1:172.21.15.179:6789/0 conn(0x7fc5cc15a4a0 legacy=0x7fc5cc0cafb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d2d39640 1 -- 172.21.15.5:0/3302458160 >> v1:172.21.15.5:6789/0 conn(0x7fc5cc15a880 legacy=0x7fc5cc15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d2d39640 1 -- 172.21.15.5:0/3302458160 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0ce330 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.512+0000 7fc5d1536640 1 -- 172.21.15.5:0/3302458160 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177557658 0 0) 0x7fc5cc0b2180 con 0x7fc5cc15a880 2024-09-13T17:17:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.513+0000 7fc5d2d39640 1 --2- 172.21.15.5:0/3302458160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0cdc50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0ce580 tx=0x7fc5c402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36284f27c829146a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.513+0000 7fc5d1536640 1 -- 172.21.15.5:0/3302458160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c402aea0 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.513+0000 7fc5d1536640 1 -- 172.21.15.5:0/3302458160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c402d050 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.513+0000 7fc5d1536640 1 -- 172.21.15.5:0/3302458160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4007960 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 -- 172.21.15.5:0/3302458160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc0cb6c0 msgr2=0x7fc5cc0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 --2- 172.21.15.5:0/3302458160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0cdc50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0ce580 tx=0x7fc5c402a6c0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 -- 172.21.15.5:0/3302458160 shutdown_connections 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 --2- 172.21.15.5:0/3302458160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0cdc50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 -- 172.21.15.5:0/3302458160 >> 172.21.15.5:0/3302458160 conn(0x7fc5cc066200 msgr2=0x7fc5cc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 -- 172.21.15.5:0/3302458160 shutdown_connections 2024-09-13T17:17:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.514+0000 7fc5d479c640 1 -- 172.21.15.5:0/3302458160 wait complete. 2024-09-13T17:17:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.515+0000 7fc5d479c640 1 Processor -- start 2024-09-13T17:17:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.515+0000 7fc5d479c640 1 -- start start 2024-09-13T17:17:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5cc15a880 0x7fc5cc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0add30 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1f2960 con 0x7fc5cc0cb6c0 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0adff0 con 0x7fc5cc15a880 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53272/0 (socket says 172.21.15.5:53272) 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 -- 172.21.15.5:0/1810553914 learned_addr learned my addr 172.21.15.5:0/1810553914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d2d39640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5cc15a880 0x7fc5cc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d2538640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 -- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5cc15a880 msgr2=0x7fc5cc157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5cc15a880 0x7fc5cc157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 -- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5cc0cb6c0 msgr2=0x7fc5cc0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 -- 172.21.15.5:0/1810553914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4009a70 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d1d37640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c410 tx=0x7fc5bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0074e0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc007660 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc0ae2d0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc004a20 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.516+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc0b10b0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.517+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0672f0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.518+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5bc004b80 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.518+0000 7fc5c2ffd640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 0x7fc5b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.518+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc5bc089290 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.519+0000 7fc5d2538640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 0x7fc5b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:20.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.519+0000 7fc5d2538640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 0x7fc5b006d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006fd0 tx=0x7fc5c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.522+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc5bc057db0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.730+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5cc0ae7f0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.731+0000 7fc5c2ffd640 1 -- 172.21.15.5:0/1810553914 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7fc5cc0ae7f0 con 0x7fc5cc15a4a0 2024-09-13T17:17:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:20.732 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:20.733 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 msgr2=0x7fc5b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 0x7fc5b006d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006fd0 tx=0x7fc5c8008040 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 msgr2=0x7fc5cc156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c410 tx=0x7fc5bc00c8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 shutdown_connections 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5cc15a880 0x7fc5cc157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc5b006ac00 0x7fc5b006d0c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5cc15a4a0 0x7fc5cc156c00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 --2- 172.21.15.5:0/1810553914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5cc0cb6c0 0x7fc5cc0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 >> 172.21.15.5:0/1810553914 conn(0x7fc5cc066200 msgr2=0x7fc5cc06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 shutdown_connections 2024-09-13T17:17:20.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:20.733+0000 7fc5d479c640 1 -- 172.21.15.5:0/1810553914 wait complete. 2024-09-13T17:17:21.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:17:16.679448+0000', 'modified': '2024-09-13T17:17:18.685406+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7212}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7212': {'gid': 7212, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1039859962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1039859962}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1039859962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:17:21.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:17:21.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:17:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.253+0000 7faa52072640 1 Processor -- start 2024-09-13T17:17:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.253+0000 7faa52072640 1 -- start start 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 0x7faa4c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 0x7faa4c0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa4c0abd90 0x7faa4c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c06de70 con 0x7faa4c0abd90 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c06e150 con 0x7faa4c0cb1c0 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa52072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c06e430 con 0x7faa4c15c540 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa4bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa4c0abd90 0x7faa4c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa4bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faa4c0abd90 0x7faa4c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53276/0 (socket says 172.21.15.5:53276) 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.254+0000 7faa4bfff640 1 -- 172.21.15.5:0/2671502992 learned_addr learned my addr 172.21.15.5:0/2671502992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 0x7faa4c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4affd640 1 --2- 172.21.15.5:0/2671502992 >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 0x7faa4c0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 -- 172.21.15.5:0/2671502992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 msgr2=0x7faa4c06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 0x7faa4c06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 -- 172.21.15.5:0/2671502992 >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 msgr2=0x7faa4c0ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2671502992 >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 0x7faa4c0ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 -- 172.21.15.5:0/2671502992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c06e710 con 0x7faa4c0abd90 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 0x7faa4c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4affd640 1 --2- 172.21.15.5:0/2671502992 >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 0x7faa4c0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.255+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c0abd90 0x7faa4c0adb60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faa4c06c430 tx=0x7faa4402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd5cf7148f7db39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa4a7fc640 1 -- 172.21.15.5:0/2671502992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44031600 con 0x7faa4c0abd90 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa4a7fc640 1 -- 172.21.15.5:0/2671502992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4402d050 con 0x7faa4c0abd90 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa4a7fc640 1 -- 172.21.15.5:0/2671502992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44031980 con 0x7faa4c0abd90 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 -- 172.21.15.5:0/2671502992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c0abd90 msgr2=0x7faa4c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c0abd90 0x7faa4c0adb60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7faa4c06c430 tx=0x7faa4402a6a0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 -- 172.21.15.5:0/2671502992 shutdown_connections 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c0abd90 0x7faa4c0adb60 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 --2- 172.21.15.5:0/2671502992 >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cb1c0 0x7faa4c0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 --2- 172.21.15.5:0/2671502992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c15c540 0x7faa4c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 -- 172.21.15.5:0/2671502992 >> 172.21.15.5:0/2671502992 conn(0x7faa4c0719e0 msgr2=0x7faa4c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 -- 172.21.15.5:0/2671502992 shutdown_connections 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.256+0000 7faa52072640 1 -- 172.21.15.5:0/2671502992 wait complete. 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.257+0000 7faa52072640 1 Processor -- start 2024-09-13T17:17:21.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 -- start start 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0abd90 0x7faa4c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c0cb1c0 0x7faa4c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15d040 con 0x7faa4c15c540 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c15e540 con 0x7faa4c0abd90 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa52072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c14cc60 con 0x7faa4c0cb1c0 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.258+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53284/0 (socket says 172.21.15.5:53284) 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 -- 172.21.15.5:0/403475030 learned_addr learned my addr 172.21.15.5:0/403475030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4affd640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c0cb1c0 0x7faa4c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 -- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c0cb1c0 msgr2=0x7faa4c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c0cb1c0 0x7faa4c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 -- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0abd90 msgr2=0x7faa4c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0abd90 0x7faa4c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 -- 172.21.15.5:0/403475030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009b30 con 0x7faa4c15c540 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa4bfff640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faa44034040 tx=0x7faa44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa33fff640 1 -- 172.21.15.5:0/403475030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4403d860 con 0x7faa4c15c540 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa33fff640 1 -- 172.21.15.5:0/403475030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4403d9e0 con 0x7faa4c15c540 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c154980 con 0x7faa4c15c540 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa33fff640 1 -- 172.21.15.5:0/403475030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4403dd90 con 0x7faa4c15c540 2024-09-13T17:17:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.259+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c15ea70 con 0x7faa4c15c540 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.261+0000 7faa33fff640 1 -- 172.21.15.5:0/403475030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa4403b400 con 0x7faa4c15c540 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.261+0000 7faa33fff640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 0x7faa3806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.262+0000 7faa33fff640 1 -- 172.21.15.5:0/403475030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa440aa370 con 0x7faa4c15c540 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.262+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 0x7faa3806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.262+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 0x7faa3806d0f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006e80 tx=0x7faa3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.262+0000 7faa54e75740 1 Processor -- start 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.262+0000 7faa54e75740 1 -- start start 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793936860 0x559793986570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x559793986ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597938937c0 con 0x5597939390a0 2024-09-13T17:17:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597938a2b70 con 0x559793960550 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597938a0300 con 0x559793936860 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53296/0 (socket says 172.21.15.5:53296) 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.263+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1618976754 learned_addr learned my addr 172.21.15.5:0/1618976754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793936860 msgr2=0x559793986570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4bfff640 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x559793986ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4affd640 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793936860 0x559793986570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793936860 0x559793986570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 msgr2=0x559793986ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x559793986ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1618976754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597938284b0 con 0x5597939390a0 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7faa3c004130 tx=0x7faa3c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6379c9ba1456b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa317fa640 1 -- 172.21.15.5:0/1618976754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003610 con 0x5597939390a0 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa317fa640 1 -- 172.21.15.5:0/1618976754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c003770 con 0x5597939390a0 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa317fa640 1 -- 172.21.15.5:0/1618976754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003ae0 con 0x5597939390a0 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa54e75740 1 -- 172.21.15.5:0/1618976754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 msgr2=0x559793939480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.264+0000 7faa54e75740 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7faa3c004130 tx=0x7faa3c010000 comp rx=0 tx=0).stop 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 -- 172.21.15.5:0/1618976754 shutdown_connections 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x559793986ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793936860 0x559793986570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 --2- 172.21.15.5:0/1618976754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793939480 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 -- 172.21.15.5:0/1618976754 >> 172.21.15.5:0/1618976754 conn(0x5597939357d0 msgr2=0x55979397dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 -- 172.21.15.5:0/1618976754 shutdown_connections 2024-09-13T17:17:21.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 -- 172.21.15.5:0/1618976754 wait complete. 2024-09-13T17:17:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 -- start start 2024-09-13T17:17:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.265+0000 7faa54e75740 1 Processor -- start 2024-09-13T17:17:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597939390a0 0x55979395dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960550 0x5597939857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979389bbf0 con 0x559793960080 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979385a250 con 0x5597939390a0 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559793859ef0 con 0x559793960550 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa54e75740 10 client.0 _ll_register_callbacks cb 0x55979388c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53310/0 (socket says 172.21.15.5:53310) 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa4bfff640 1 -- 172.21.15.5:0/1118367619 learned_addr learned my addr 172.21.15.5:0/1118367619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa4affd640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960550 0x5597939857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.266+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597939390a0 0x55979395dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 -- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960550 msgr2=0x5597939857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960550 0x5597939857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 -- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597939390a0 msgr2=0x55979395dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597939390a0 0x55979395dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 -- 172.21.15.5:0/1118367619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c00e040 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa4bfff640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7faa44075660 tx=0x7faa44079860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688af9d7563c893 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4407cf90 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa44081550 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55979358f3c0 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa440793c0 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 10 client.7356 fetch_fsmap learned FSMap version 36 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55979389a270 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44094080 con 0x559793960080 2024-09-13T17:17:21.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7faa4404d020 con 0x559793960080 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 10 client.7356 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 10 client.7356 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 20 client.7356 populate_metadata read hostname 'smithi005' 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5597939843c0 0x55979395eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 4 client.7356 mds_command: new command op to 7212 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.267+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 --> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597935a06c0 con 0x5597939843c0 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5597939843c0 0x55979395eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa2a7fc640 10 client.7356 ms_handle_connect on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5597939843c0 0x55979395eaa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=739a3d25d7e1ddcf server_cookie=da9cd0a8701dfaf0 in_seq=0 out_seq=0 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1118367619 <== mds.0 v2:172.21.15.5:6834/1039859962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5597935a06c0 con 0x5597939843c0 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa2a7fc640 10 client.7356 handle_command_reply: tid=0 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.268+0000 7faa54e75740 1 client.7356 shutdown 2024-09-13T17:17:21.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 msgr2=0x559793985cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7faa44075660 tx=0x7faa44079860 comp rx=0 tx=0).stop 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 shutdown_connections 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5597939843c0 0x55979395eaa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960080 0x559793985cf0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960550 0x5597939857b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa2a7fc640 0 client.7356 ms_handle_reset on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 --2- 172.21.15.5:0/1118367619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597939390a0 0x55979395dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 >> 172.21.15.5:0/1118367619 conn(0x559793936860 msgr2=0x559793981960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 shutdown_connections 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 1 -- 172.21.15.5:0/1118367619 wait complete. 2024-09-13T17:17:21.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.269+0000 7faa54e75740 20 client.7356 trim_cache size 0 max 16384 2024-09-13T17:17:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.284+0000 7faa54e75740 1 Processor -- start 2024-09-13T17:17:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.284+0000 7faa54e75740 1 -- start start 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597939390a0 0x5597939969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 0x55979397bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979381f460 con 0x559793960550 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597938d0e50 con 0x559793960080 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x559793963f30 con 0x5597939390a0 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53320/0 (socket says 172.21.15.5:53320) 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 -- 172.21.15.5:0/2859120740 learned_addr learned my addr 172.21.15.5:0/2859120740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4affd640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 0x55979397bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597939390a0 0x5597939969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 -- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597939390a0 msgr2=0x5597939969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597939390a0 0x5597939969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 -- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 msgr2=0x55979397bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 0x55979397bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 -- 172.21.15.5:0/2859120740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55979383c5f0 con 0x559793960550 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4affd640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 0x55979397bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.285+0000 7faa4bfff640 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7faa44079320 tx=0x7faa44048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9321fb736b812c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa31ffb640 1 -- 172.21.15.5:0/2859120740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44079660 con 0x559793960550 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa31ffb640 1 -- 172.21.15.5:0/2859120740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55979358f3c0 con 0x559793960550 2024-09-13T17:17:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa31ffb640 1 -- 172.21.15.5:0/2859120740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44081550 con 0x559793960550 2024-09-13T17:17:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 -- 172.21.15.5:0/2859120740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 msgr2=0x55979397c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7faa44079320 tx=0x7faa44048000 comp rx=0 tx=0).stop 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 -- 172.21.15.5:0/2859120740 shutdown_connections 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559793960550 0x55979397c210 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960080 0x55979397bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 --2- 172.21.15.5:0/2859120740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597939390a0 0x5597939969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 -- 172.21.15.5:0/2859120740 >> 172.21.15.5:0/2859120740 conn(0x559793936860 msgr2=0x55979392ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 -- 172.21.15.5:0/2859120740 shutdown_connections 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.286+0000 7faa54e75740 1 -- 172.21.15.5:0/2859120740 wait complete. 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.287+0000 7faa54e75740 1 -- start start 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.287+0000 7faa54e75740 1 Processor -- start 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960080 0x55979395bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x5597939e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597939904e0 con 0x5597939390a0 2024-09-13T17:17:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559793938440 con 0x559793960550 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55979395c710 con 0x559793960080 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa54e75740 10 client.0 _ll_register_callbacks cb 0x7faa440092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53334/0 (socket says 172.21.15.5:53334) 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1402230737 learned_addr learned my addr 172.21.15.5:0/1402230737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4bfff640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x5597939e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4affd640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960080 0x55979395bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960080 msgr2=0x55979395bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960080 0x55979395bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 msgr2=0x5597939e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x5597939e6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 -- 172.21.15.5:0/1402230737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55979389a270 con 0x5597939390a0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa4b7fe640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006b00 tx=0x7faa3c006df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de416bc9b920c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.288+0000 7faa2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003e10 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa3c005990 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa3c003770 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa3c005b50 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 10 client.7362 fetch_fsmap learned FSMap version 36 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x559793861d00 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c003770 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7faa3c005cb0 con 0x5597939390a0 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 10 client.7362 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 10 client.7362 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 20 client.7362 populate_metadata read hostname 'smithi005' 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x559793951300 0x5597939516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 4 client.7362 mds_command: new command op to 7212 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:17:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 --> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5597935f3d10 con 0x559793951300 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa4affd640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x559793951300 0x5597939516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa2a7fc640 10 client.7362 ms_handle_connect on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.289+0000 7faa4affd640 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x559793951300 0x5597939516e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8f1ecb94246a9d server_cookie=9ebca73e6c1fc1ef in_seq=0 out_seq=0 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa2a7fc640 1 -- 172.21.15.5:0/1402230737 <== mds.0 v2:172.21.15.5:6834/1039859962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5597935f3d10 con 0x559793951300 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa2a7fc640 10 client.7362 handle_command_reply: tid=0 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 client.7362 shutdown 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 msgr2=0x559793937f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006b00 tx=0x7faa3c006df0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 shutdown_connections 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x559793951300 0x5597939516e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559793960550 0x5597939e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559793960080 0x55979395bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa2a7fc640 0 client.7362 ms_handle_reset on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 --2- 172.21.15.5:0/1402230737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5597939390a0 0x559793937f00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 >> 172.21.15.5:0/1402230737 conn(0x559793936860 msgr2=0x55979397bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 shutdown_connections 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 1 -- 172.21.15.5:0/1402230737 wait complete. 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.290+0000 7faa54e75740 20 client.7362 trim_cache size 0 max 16384 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7212, 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:17:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.6092479669999999, 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 36, 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 83, 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 83, 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 9.7697727370000003 2024-09-13T17:17:21.298 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 msgr2=0x7faa3806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 0x7faa3806d0f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006e80 tx=0x7faa3c008040 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 msgr2=0x7faa4c15f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faa44034040 tx=0x7faa44004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 shutdown_connections 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa3806ac30 0x7faa3806d0f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa4c15c540 0x7faa4c15f550 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa4c0cb1c0 0x7faa4c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 --2- 172.21.15.5:0/403475030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0abd90 0x7faa4c14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 >> 172.21.15.5:0/403475030 conn(0x7faa4c0719e0 msgr2=0x7faa4c0aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 shutdown_connections 2024-09-13T17:17:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.291+0000 7faa52072640 1 -- 172.21.15.5:0/403475030 wait complete. 2024-09-13T17:17:21.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:17:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.403+0000 7f94f1612640 1 Processor -- start 2024-09-13T17:17:21.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.403+0000 7f94f1612640 1 -- start start 2024-09-13T17:17:21.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94ec15c880 0x7f94ec0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 0x7f94ec06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec0998b0 0x7f94ec06f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec0ce860 con 0x7f94ec15c880 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec0ceb40 con 0x7f94ec099460 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94f1612640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0cee20 con 0x7f94ec0998b0 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94ec15c880 0x7f94ec0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94ec15c880 0x7f94ec0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53336/0 (socket says 172.21.15.5:53336) 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 -- 172.21.15.5:0/3237386552 learned_addr learned my addr 172.21.15.5:0/3237386552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94ea7fc640 1 --2- 172.21.15.5:0/3237386552 >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 0x7f94ec06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 -- 172.21.15.5:0/3237386552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec0998b0 msgr2=0x7f94ec06f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eb7fe640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec0998b0 0x7f94ec06f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec0998b0 0x7f94ec06f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.404+0000 7f94eaffd640 1 -- 172.21.15.5:0/3237386552 >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 msgr2=0x7f94ec06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94eaffd640 1 --2- 172.21.15.5:0/3237386552 >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 0x7f94ec06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94eaffd640 1 -- 172.21.15.5:0/3237386552 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0cf100 con 0x7f94ec15c880 2024-09-13T17:17:21.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94ea7fc640 1 --2- 172.21.15.5:0/3237386552 >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 0x7f94ec06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:21.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94eaffd640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec15c880 0x7f94ec0cf900 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f94ec072260 tx=0x7f94dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e253de6c59d544 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94e9ffb640 1 -- 172.21.15.5:0/3237386552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc032440 con 0x7f94ec15c880 2024-09-13T17:17:21.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94e9ffb640 1 -- 172.21.15.5:0/3237386552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc0325a0 con 0x7f94ec15c880 2024-09-13T17:17:21.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.405+0000 7f94e9ffb640 1 -- 172.21.15.5:0/3237386552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc032930 con 0x7f94ec15c880 2024-09-13T17:17:21.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 -- 172.21.15.5:0/3237386552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec15c880 msgr2=0x7f94ec0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec15c880 0x7f94ec0cf900 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f94ec072260 tx=0x7f94dc02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 -- 172.21.15.5:0/3237386552 shutdown_connections 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec0998b0 0x7f94ec06f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 --2- 172.21.15.5:0/3237386552 >> v2:172.21.15.179:3300/0 conn(0x7f94ec099460 0x7f94ec06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 --2- 172.21.15.5:0/3237386552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec15c880 0x7f94ec0cf900 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 -- 172.21.15.5:0/3237386552 >> 172.21.15.5:0/3237386552 conn(0x7f94ec0d04c0 msgr2=0x7f94ec0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 -- 172.21.15.5:0/3237386552 shutdown_connections 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.406+0000 7f94f1612640 1 -- 172.21.15.5:0/3237386552 wait complete. 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.407+0000 7f94f1612640 1 Processor -- start 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.407+0000 7f94f1612640 1 -- start start 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec099460 0x7f94ec15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94ec15c880 0x7f94ec0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0ca660 con 0x7f94ec0998b0 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec15d250 con 0x7f94ec15c880 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94f1612640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0c9dc0 con 0x7f94ec099460 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53346/0 (socket says 172.21.15.5:53346) 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94ea7fc640 1 -- 172.21.15.5:0/2395202719 learned_addr learned my addr 172.21.15.5:0/2395202719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94eaffd640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec099460 0x7f94ec15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.408+0000 7f94eb7fe640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94ec15c880 0x7f94ec0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 -- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec099460 msgr2=0x7f94ec15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec099460 0x7f94ec15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 -- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94ec15c880 msgr2=0x7f94ec0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94ec15c880 0x7f94ec0c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 -- 172.21.15.5:0/2395202719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0094d0 con 0x7f94ec0998b0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94ea7fc640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c7c0 tx=0x7f94e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0007a30 con 0x7f94ec0998b0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0007b90 con 0x7f94ec0998b0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000ce70 con 0x7f94ec0998b0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec0ca0a0 con 0x7f94ec0998b0 2024-09-13T17:17:21.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.409+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec0c7ad0 con 0x7f94ec0998b0 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.410+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec15d410 con 0x7f94ec0998b0 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.411+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94e00113f0 con 0x7f94ec0998b0 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.411+0000 7f94d37fe640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 0x7f94d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.412+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94e00894d0 con 0x7f94ec0998b0 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.412+0000 7f94eaffd640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 0x7f94d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:21.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.412+0000 7f94eaffd640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 0x7f94d806d0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f94dc034000 tx=0x7f94dc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.416+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94e0054610 con 0x7f94ec0998b0 2024-09-13T17:17:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.624+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94ec0cf900 con 0x7f94ec0998b0 2024-09-13T17:17:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.624+0000 7f94d37fe640 1 -- 172.21.15.5:0/2395202719 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94e0057c30 con 0x7f94ec0998b0 2024-09-13T17:17:21.626 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.626+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 msgr2=0x7f94d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.626+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 0x7f94d806d0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f94dc034000 tx=0x7f94dc02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.626+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 msgr2=0x7f94ec0c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.626+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c7c0 tx=0x7f94e000cc80 comp rx=0 tx=0).stop 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.626+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 shutdown_connections 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94ec15c880 0x7f94ec0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f94d806ac00 0x7f94d806d0c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94ec0998b0 0x7f94ec0c7590 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 --2- 172.21.15.5:0/2395202719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94ec099460 0x7f94ec15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 >> 172.21.15.5:0/2395202719 conn(0x7f94ec0d04c0 msgr2=0x7f94ec0b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 shutdown_connections 2024-09-13T17:17:21.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:21.627+0000 7f94f1612640 1 -- 172.21.15.5:0/2395202719 wait complete. 2024-09-13T17:17:21.638 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:17:21.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:17:21.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:17:21.639 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:17:21.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.639 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:17:21.657 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:17:21.657 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:17:21.657 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:17:21.657 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:17:21.658 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.659 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:21.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.660 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:17:21.722 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:17:21.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.724 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:17:21.780 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:17:21.780 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:17:21.781 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:17:21.781 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:17:21.781 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:17:21.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:17:21.781 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:17:21.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:17:21.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:17:21.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:17:21.782 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:17:21.843 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-09-13T17:17:21.843+0000 7fed36f6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:17:21.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.870 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:17:21.926 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:17:21.926 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:17:21.926 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:17:21.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:21.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:17:21.991 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:17:21.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:17:21.992 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:22.048 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:17:22.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:17:22.048 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:22.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:17:22.170 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:17:22.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:17:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:17:22.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:17:22.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:22.237 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:17:22.294 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:17:22.294 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:17:22.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:17:22.362 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:17:22.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:17:22.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:17:22.419+0000 7f05b5182480 -1 init, newargv = 0x55eb38d972e0 newargc=15 2024-09-13T17:17:22.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[65847]: starting ceph client 2024-09-13T17:17:22.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[65847]: starting fuse 2024-09-13T17:17:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:17:22.431 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:17:22.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:22.431 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:17:22.488 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:17:22.488 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:17:22.488 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:17:22.489 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:17:22.490 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:17:22.604 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.65847.asok 2024-09-13T17:17:22.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65847.asok 2024-09-13T17:17:22.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:22.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65847.asok status 2024-09-13T17:17:22.927 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "65847", 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:17:22.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7377, 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 7377 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 504127724 2024-09-13T17:17:22.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 504127724 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.7377 192.168.0.1:0/504127724", 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/504127724", 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 36, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 83, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:17:22.930 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:17:22.931 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:17:22.931 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:17:22.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:22.936 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:17:22.936 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:22.952 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:17:22.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:22.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:22.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:23.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:17:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.159+0000 7f3082a61640 1 Processor -- start 2024-09-13T17:17:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.159+0000 7f3082a61640 1 -- start start 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f3082a61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f307c0b15f0 0x7f307c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f3082a61640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c0b3be0 con 0x7f307c0b19d0 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f3082a61640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c13f740 con 0x7f307c0cc440 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f3082a61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c13c8e0 con 0x7f307c0b15f0 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f307bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f307c0b15f0 0x7f307c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f307b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f307c0b19d0 0x7f307c13ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59956/0 (socket says 172.21.15.5:59956) 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.160+0000 7f307b7fe640 1 -- 172.21.15.5:0/197317539 learned_addr learned my addr 172.21.15.5:0/197317539 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.161+0000 7f307bfff640 1 -- 172.21.15.5:0/197317539 >> v1:172.21.15.179:6789/0 conn(0x7f307c0cc440 legacy=0x7f307c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.161+0000 7f307bfff640 1 -- 172.21.15.5:0/197317539 >> v1:172.21.15.5:6789/0 conn(0x7f307c0b19d0 legacy=0x7f307c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.161+0000 7f307bfff640 1 -- 172.21.15.5:0/197317539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c159a80 con 0x7f307c0b15f0 2024-09-13T17:17:23.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.161+0000 7f307affd640 1 -- 172.21.15.5:0/197317539 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577624740 0 0) 0x7f307c0b3be0 con 0x7f307c0b19d0 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.161+0000 7f307bfff640 1 --2- 172.21.15.5:0/197317539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0b15f0 0x7f307c15a560 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097a0 tx=0x7f306c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d61a14cb3fb2da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f307affd640 1 -- 172.21.15.5:0/197317539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c02ae50 con 0x7f307c0b15f0 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f307affd640 1 -- 172.21.15.5:0/197317539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c032440 con 0x7f307c0b15f0 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f307affd640 1 -- 172.21.15.5:0/197317539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0327d0 con 0x7f307c0b15f0 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 -- 172.21.15.5:0/197317539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0b15f0 msgr2=0x7f307c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 --2- 172.21.15.5:0/197317539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0b15f0 0x7f307c15a560 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097a0 tx=0x7f306c02a140 comp rx=0 tx=0).stop 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 -- 172.21.15.5:0/197317539 shutdown_connections 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 --2- 172.21.15.5:0/197317539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0b15f0 0x7f307c15a560 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 -- 172.21.15.5:0/197317539 >> 172.21.15.5:0/197317539 conn(0x7f307c06a500 msgr2=0x7f307c0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 -- 172.21.15.5:0/197317539 shutdown_connections 2024-09-13T17:17:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.162+0000 7f3082a61640 1 -- 172.21.15.5:0/197317539 wait complete. 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.163+0000 7f3082a61640 1 Processor -- start 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 -- start start 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f307c0b15f0 0x7f307c13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 0x7f307c0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0a7f30 con 0x7f307c0cc440 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0a8170 con 0x7f307c0b19d0 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3082a61640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c140ee0 con 0x7f307c0b15f0 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3080ffe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3080ffe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53378/0 (socket says 172.21.15.5:53378) 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.164+0000 7f3080ffe640 1 -- 172.21.15.5:0/172794019 learned_addr learned my addr 172.21.15.5:0/172794019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 -- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f307c0b15f0 msgr2=0x7f307c13dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f307bfff640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f307c0b15f0 0x7f307c13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f307b7fe640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 0x7f307c0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f307c0b15f0 0x7f307c13dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 -- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 msgr2=0x7f307c0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 0x7f307c0a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 -- 172.21.15.5:0/172794019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c009400 con 0x7f307c0cc440 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f307b7fe640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 0x7f307c0a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:23.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3080ffe640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f307400c780 tx=0x7f307400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:23.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074004b60 con 0x7f307c0cc440 2024-09-13T17:17:23.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400ce90 con 0x7f307c0cc440 2024-09-13T17:17:23.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c1411c0 con 0x7f307c0cc440 2024-09-13T17:17:23.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400a850 con 0x7f307c0cc440 2024-09-13T17:17:23.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.165+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c141780 con 0x7f307c0cc440 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.166+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c0cdde0 con 0x7f307c0cc440 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.167+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f307400a9b0 con 0x7f307c0cc440 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.167+0000 7f3078ff9640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 0x7f306806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.167+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3074089810 con 0x7f307c0cc440 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.167+0000 7f307bfff640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 0x7f306806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:23.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.168+0000 7f307bfff640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 0x7f306806d0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f306c034000 tx=0x7f306c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:23.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.171+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3074054940 con 0x7f307c0cc440 2024-09-13T17:17:23.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.380+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f307c06e610 con 0x7f307c0cc440 2024-09-13T17:17:23.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.380+0000 7f3078ff9640 1 -- 172.21.15.5:0/172794019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3074057f60 con 0x7f307c0cc440 2024-09-13T17:17:23.382 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.382+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 msgr2=0x7f306806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.382+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 0x7f306806d0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f306c034000 tx=0x7f306c02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.382+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 msgr2=0x7f307c0a79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.382+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f307400c780 tx=0x7f307400cc40 comp rx=0 tx=0).stop 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 shutdown_connections 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f306806ac00 0x7f306806d0c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f307c0cc440 0x7f307c0a79f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c0b19d0 0x7f307c0a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 --2- 172.21.15.5:0/172794019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f307c0b15f0 0x7f307c13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 >> 172.21.15.5:0/172794019 conn(0x7f307c06a500 msgr2=0x7f307c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 shutdown_connections 2024-09-13T17:17:23.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:23.383+0000 7f3082a61640 1 -- 172.21.15.5:0/172794019 wait complete. 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:17:23.395 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:17:23.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.396 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:17:23.415 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:17:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:17:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:17:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:17:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:17:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:17:23.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.418 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:17:23.483 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:17:23.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.485 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:17:23.542 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:17:23.543 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:17:23.543 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:17:23.543 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:17:23.543 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:17:23.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.543 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:17:23.543 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:17:23.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:17:23.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:17:23.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:17:23.544 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:17:23.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.634 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:17:23.651 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:17:23.651 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:17:23.651 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:17:23.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:17:23.717 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:17:23.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:17:23.717 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:23.772 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:17:23.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:17:23.773 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:23.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:17:23.894 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:17:23.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:17:23.957 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:17:23.958 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:17:23.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:23.959 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:17:24.014 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:17:24.015 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:17:24.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:17:24.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:17:24.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:17:24.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:17:24.138+0000 7f1e7de79480 -1 init, newargv = 0x558e1f499470 newargc=15 2024-09-13T17:17:24.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[46908]: starting ceph client 2024-09-13T17:17:24.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[46908]: starting fuse 2024-09-13T17:17:24.149 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:17:24.150 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:17:24.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:24.151 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:17:24.206 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:17:24.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:17:24.207 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:17:24.208 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:17:24.209 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:17:24.209 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:17:24.320 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.46908.asok 2024-09-13T17:17:24.507 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.46908.asok 2024-09-13T17:17:24.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:24.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.46908.asok status 2024-09-13T17:17:24.641 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "46908", 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:17:24.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 6287, 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 6287 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:17:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1676767671 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1676767671 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.6287 192.168.0.1:0/1676767671", 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/1676767671", 2024-09-13T17:17:24.644 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 36, 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 83, 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:17:24.645 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:17:24.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:24.650 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:17:24.650 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:24.666 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:17:24.666 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:24.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:24.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:24.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-13T17:17:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.847+0000 7fc65cb9d640 1 Processor -- start 2024-09-13T17:17:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.847+0000 7fc65cb9d640 1 -- start start 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc65cb9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc6580d2410 0x7fc6580d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc65cb9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580d12e0 con 0x7fc6580d0570 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc65cb9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580cd370 con 0x7fc65815fbf0 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc65cb9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580d2dc0 con 0x7fc6580d2410 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc657fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc6580d0570 0x7fc6580d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55724/0 (socket says 172.21.15.5:55724) 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc657fff640 1 -- 172.21.15.5:0/2016590246 learned_addr learned my addr 172.21.15.5:0/2016590246 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.848+0000 7fc656ffd640 1 --2- 172.21.15.5:0/2016590246 >> v2:172.21.15.179:3300/0 conn(0x7fc6580d2410 0x7fc6580d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494035351 0 0) 0x7fc6580d12e0 con 0x7fc6580d0570 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc640003520 con 0x7fc6580d0570 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208701937 0 0) 0x7fc6580cd370 con 0x7fc65815fbf0 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6580d12e0 con 0x7fc65815fbf0 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc656ffd640 1 -- 172.21.15.5:0/2016590246 >> v1:172.21.15.179:6789/0 conn(0x7fc65815fbf0 legacy=0x7fc6580cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc656ffd640 1 -- 172.21.15.5:0/2016590246 >> v1:172.21.15.5:6789/0 conn(0x7fc6580d0570 legacy=0x7fc6580d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.849+0000 7fc656ffd640 1 -- 172.21.15.5:0/2016590246 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580cd650 con 0x7fc6580d2410 2024-09-13T17:17:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.850+0000 7fc656ffd640 1 --2- 172.21.15.5:0/2016590246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6580d2410 0x7fc6580d2880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097a0 tx=0x7fc64c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e54c61d260a3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032440 con 0x7fc6580d2410 2024-09-13T17:17:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0325a0 con 0x7fc6580d2410 2024-09-13T17:17:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc6567fc640 1 -- 172.21.15.5:0/2016590246 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032930 con 0x7fc6580d2410 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2016590246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6580d2410 msgr2=0x7fc6580d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2016590246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6580d2410 0x7fc6580d2880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097a0 tx=0x7fc64c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2016590246 shutdown_connections 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2016590246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6580d2410 0x7fc6580d2880 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2016590246 >> 172.21.15.5:0/2016590246 conn(0x7fc65809b7e0 msgr2=0x7fc658089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2016590246 shutdown_connections 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.851+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2016590246 wait complete. 2024-09-13T17:17:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.852+0000 7fc65cb9d640 1 Processor -- start 2024-09-13T17:17:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 -- start start 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 0x7fc6581f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc65815fbf0 0x7fc65815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580b72c0 con 0x7fc6580d2410 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581f2e70 con 0x7fc65815fbf0 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.853+0000 7fc65cb9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580cc310 con 0x7fc6580d0570 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58200/0 (socket says 172.21.15.5:58200) 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 -- 172.21.15.5:0/2116810730 learned_addr learned my addr 172.21.15.5:0/2116810730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc657fff640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc65815fbf0 0x7fc65815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc6577fe640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 0x7fc6581f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 -- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 msgr2=0x7fc6581f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 0x7fc6581f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 -- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc65815fbf0 msgr2=0x7fc65815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc65815fbf0 0x7fc65815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 -- 172.21.15.5:0/2116810730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009400 con 0x7fc6580d2410 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc6577fe640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 0x7fc6581f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc656ffd640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0098c0 tx=0x7fc64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c03d8f0 con 0x7fc6580d2410 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c03da70 con 0x7fc6580d2410 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c03de20 con 0x7fc6580d2410 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6580b66b0 con 0x7fc6580d2410 2024-09-13T17:17:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.854+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6580b6c70 con 0x7fc6580d2410 2024-09-13T17:17:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.855+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580b7470 con 0x7fc6580d2410 2024-09-13T17:17:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.856+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc64c039040 con 0x7fc6580d2410 2024-09-13T17:17:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.856+0000 7fc63ffff640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 0x7fc64406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.857+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc64c0a9c40 con 0x7fc6580d2410 2024-09-13T17:17:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.857+0000 7fc6577fe640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 0x7fc64406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.857+0000 7fc6577fe640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 0x7fc64406d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc6480011e0 tx=0x7fc648009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:24.861+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6580b7470 con 0x7fc6580d2410 2024-09-13T17:17:25.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.035+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7fc6580b7470 con 0x7fc6580d2410 2024-09-13T17:17:25.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.039+0000 7fc63ffff640 1 -- 172.21.15.5:0/2116810730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc6580b7470 con 0x7fc6580d2410 2024-09-13T17:17:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 msgr2=0x7fc64406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 0x7fc64406d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc6480011e0 tx=0x7fc648009040 comp rx=0 tx=0).stop 2024-09-13T17:17:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 msgr2=0x7fc6580cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0098c0 tx=0x7fc64c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 shutdown_connections 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc65815fbf0 0x7fc65815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc64406ac00 0x7fc64406d0c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6580d2410 0x7fc6580cbdd0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 --2- 172.21.15.5:0/2116810730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6580d0570 0x7fc6581f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 >> 172.21.15.5:0/2116810730 conn(0x7fc65809b7e0 msgr2=0x7fc6580b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 shutdown_connections 2024-09-13T17:17:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.041+0000 7fc65cb9d640 1 -- 172.21.15.5:0/2116810730 wait complete. 2024-09-13T17:17:25.053 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:25.053 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:25.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:25.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.210+0000 7f6238232640 1 Processor -- start 2024-09-13T17:17:25.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.210+0000 7f6238232640 1 -- start start 2024-09-13T17:17:25.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f6238232640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f623015d9d0 0x7f62300cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f6238232640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62300cc5a0 con 0x7f623015e7b0 2024-09-13T17:17:25.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f6238232640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62300cb2a0 con 0x7f62300ceab0 2024-09-13T17:17:25.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f6238232640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62300cbc40 con 0x7f623015d9d0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f62367cf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f623015e7b0 0x7f62300afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55740/0 (socket says 172.21.15.5:55740) 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.211+0000 7f62367cf640 1 -- 172.21.15.5:0/1719519840 learned_addr learned my addr 172.21.15.5:0/1719519840 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6235fce640 1 --2- 172.21.15.5:0/1719519840 >> v2:172.21.15.179:3300/0 conn(0x7f623015d9d0 0x7f62300cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625276464 0 0) 0x7f62300cc5a0 con 0x7f623015e7b0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621c003520 con 0x7f623015e7b0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502573963 0 0) 0x7f621c003520 con 0x7f623015e7b0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 >> v2:172.21.15.179:3300/0 conn(0x7f623015d9d0 msgr2=0x7f62300cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 --2- 172.21.15.5:0/1719519840 >> v2:172.21.15.179:3300/0 conn(0x7f623015d9d0 0x7f62300cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 >> v1:172.21.15.179:6789/0 conn(0x7f62300ceab0 legacy=0x7f623015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300cb580 con 0x7f623015e7b0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f62280019f0 con 0x7f623015e7b0 2024-09-13T17:17:25.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 >> v1:172.21.15.5:6789/0 conn(0x7f623015e7b0 legacy=0x7f62300afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f621c003970 0x7f621c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c0047c0 0x7f621c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 0x7f621c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300cbc40 con 0x7f621c005180 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c120 con 0x7f621c003970 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c2e0 con 0x7f621c0047c0 2024-09-13T17:17:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 0x7f621c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6235fce640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f621c003970 0x7f621c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62357cd640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c0047c0 0x7f621c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 -- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c0047c0 msgr2=0x7f621c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c0047c0 0x7f621c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 -- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f621c003970 msgr2=0x7f621c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f621c003970 0x7f621c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f62367cf640 1 -- 172.21.15.5:0/1719519840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c003520 con 0x7f621c005180 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.212+0000 7f6235fce640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f621c003970 0x7f621c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.213+0000 7f62367cf640 1 -- 172.21.15.5:0/1719519840 reap_dead start 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.213+0000 7f62367cf640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 0x7f621c00b980 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f622800a830 tx=0x7f621c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3772e0174fe18978 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.213+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622802ba50 con 0x7f621c005180 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.213+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622802bbd0 con 0x7f621c005180 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.213+0000 7f6234fcc640 1 -- 172.21.15.5:0/1719519840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228034470 con 0x7f621c005180 2024-09-13T17:17:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 -- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 msgr2=0x7f621c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 0x7f621c00b980 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f622800a830 tx=0x7f621c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 -- 172.21.15.5:0/1719519840 shutdown_connections 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 --2- 172.21.15.5:0/1719519840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f621c005180 0x7f621c00b980 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 -- 172.21.15.5:0/1719519840 >> 172.21.15.5:0/1719519840 conn(0x7f62300d04d0 msgr2=0x7f62300d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 -- 172.21.15.5:0/1719519840 shutdown_connections 2024-09-13T17:17:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.214+0000 7f6238232640 1 -- 172.21.15.5:0/1719519840 wait complete. 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.215+0000 7f6238232640 1 Processor -- start 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.215+0000 7f6238232640 1 -- start start 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c005180 0x7f6230152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62300c6490 0x7f62300ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623006afe0 con 0x7f62300b42a0 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623006b230 con 0x7f62300c6490 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6238232640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623006b510 con 0x7f621c005180 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58226/0 (socket says 172.21.15.5:58226) 2024-09-13T17:17:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 -- 172.21.15.5:0/981692128 learned_addr learned my addr 172.21.15.5:0/981692128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f6235fce640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c005180 0x7f6230152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62367cf640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62300c6490 0x7f62300ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 -- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c005180 msgr2=0x7f6230152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c005180 0x7f6230152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 -- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62300c6490 msgr2=0x7f62300ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.216+0000 7f62357cd640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62300c6490 0x7f62300ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f62357cd640 1 -- 172.21.15.5:0/981692128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623006b7f0 con 0x7f62300b42a0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f62357cd640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f622000f5f0 tx=0x7f622000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200052e0 con 0x7f62300b42a0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220005440 con 0x7f62300b42a0 2024-09-13T17:17:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623006bad0 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220003810 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.217+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6230152d80 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.218+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62300cef20 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.218+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6220003970 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.219+0000 7f62267fc640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 0x7f621406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.219+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6220089220 con 0x7f62300b42a0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.219+0000 7f6235fce640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 0x7f621406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.220+0000 7f6235fce640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 0x7f621406d0c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f622c009ce0 tx=0x7f622c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.223+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f62200542c0 con 0x7f62300b42a0 2024-09-13T17:17:25.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.393+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62300ccb00 con 0x7f62300b42a0 2024-09-13T17:17:25.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.394+0000 7f62267fc640 1 -- 172.21.15.5:0/981692128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f62200578e0 con 0x7f62300b42a0 2024-09-13T17:17:25.396 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:25.396 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.396+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 msgr2=0x7f621406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.396+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 0x7f621406d0c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f622c009ce0 tx=0x7f622c009190 comp rx=0 tx=0).stop 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.396+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 msgr2=0x7f62300c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.396+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f622000f5f0 tx=0x7f622000f9f0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 shutdown_connections 2024-09-13T17:17:25.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62300c6490 0x7f62300ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f621406ac00 0x7f621406d0c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62300b42a0 0x7f62300c5f50 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 --2- 172.21.15.5:0/981692128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f621c005180 0x7f6230152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 >> 172.21.15.5:0/981692128 conn(0x7f62300d04d0 msgr2=0x7f62300cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 shutdown_connections 2024-09-13T17:17:25.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.397+0000 7f6238232640 1 -- 172.21.15.5:0/981692128 wait complete. 2024-09-13T17:17:25.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:14.535688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:15.662082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:25.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.512+0000 7faaa5a53640 1 Processor -- start 2024-09-13T17:17:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.512+0000 7faaa5a53640 1 -- start start 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faaa5a53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faaa015ccf0 0x7faaa00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faaa5a53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa015d0d0 con 0x7faaa01606e0 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faaa5a53640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa0160df0 con 0x7faaa00b41a0 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faaa5a53640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa01610b0 con 0x7faaa015ccf0 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faa9effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faaa015ccf0 0x7faaa00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faa9e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faaa01606e0 0x7faaa015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55752/0 (socket says 172.21.15.5:55752) 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.513+0000 7faa9e7fc640 1 -- 172.21.15.5:0/3954864088 learned_addr learned my addr 172.21.15.5:0/3954864088 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.514+0000 7faa9effd640 1 -- 172.21.15.5:0/3954864088 >> v1:172.21.15.179:6789/0 conn(0x7faaa00b41a0 legacy=0x7faaa00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.514+0000 7faa9effd640 1 -- 172.21.15.5:0/3954864088 >> v1:172.21.15.5:6789/0 conn(0x7faaa01606e0 legacy=0x7faaa015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.514+0000 7faa9dffb640 1 -- 172.21.15.5:0/3954864088 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218801383 0 0) 0x7faaa015d0d0 con 0x7faaa01606e0 2024-09-13T17:17:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.514+0000 7faa9effd640 1 -- 172.21.15.5:0/3954864088 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0161390 con 0x7faaa015ccf0 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faa9effd640 1 --2- 172.21.15.5:0/3954864088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00ccd70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7faa900097a0 tx=0x7faa9002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6fa8c2fba448d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faa9dffb640 1 -- 172.21.15.5:0/3954864088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90032440 con 0x7faaa015ccf0 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faa9dffb640 1 -- 172.21.15.5:0/3954864088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa900325a0 con 0x7faaa015ccf0 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faa9dffb640 1 -- 172.21.15.5:0/3954864088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90032930 con 0x7faaa015ccf0 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 -- 172.21.15.5:0/3954864088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 msgr2=0x7faaa00ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 --2- 172.21.15.5:0/3954864088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00ccd70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7faa900097a0 tx=0x7faa9002a230 comp rx=0 tx=0).stop 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 -- 172.21.15.5:0/3954864088 shutdown_connections 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 --2- 172.21.15.5:0/3954864088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00ccd70 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 -- 172.21.15.5:0/3954864088 >> 172.21.15.5:0/3954864088 conn(0x7faaa006b590 msgr2=0x7faaa006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 -- 172.21.15.5:0/3954864088 shutdown_connections 2024-09-13T17:17:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.515+0000 7faaa5a53640 1 -- 172.21.15.5:0/3954864088 wait complete. 2024-09-13T17:17:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.516+0000 7faaa5a53640 1 Processor -- start 2024-09-13T17:17:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 -- start start 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa00b41a0 0x7faaa00cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaa01606e0 0x7faaa0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c73d0 con 0x7faaa015ccf0 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c67c0 con 0x7faaa00b41a0 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faaa5a53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c6aa0 con 0x7faaa01606e0 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.517+0000 7faa9e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58244/0 (socket says 172.21.15.5:58244) 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 -- 172.21.15.5:0/250668065 learned_addr learned my addr 172.21.15.5:0/250668065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9effd640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa00b41a0 0x7faaa00cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9f7fe640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaa01606e0 0x7faaa0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 -- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaa01606e0 msgr2=0x7faaa0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaa01606e0 0x7faaa0155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 -- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa00b41a0 msgr2=0x7faaa00cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa00b41a0 0x7faaa00cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 -- 172.21.15.5:0/250668065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009400 con 0x7faaa015ccf0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa9e7fc640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c3f0 tx=0x7faa9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940074e0 con 0x7faaa015ccf0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94007640 con 0x7faaa015ccf0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94004a00 con 0x7faaa015ccf0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa00c6d80 con 0x7faaa015ccf0 2024-09-13T17:17:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.518+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa00cc430 con 0x7faaa015ccf0 2024-09-13T17:17:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.519+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa00c7580 con 0x7faaa015ccf0 2024-09-13T17:17:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.520+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa94004b60 con 0x7faaa015ccf0 2024-09-13T17:17:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.520+0000 7faa87fff640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 0x7faa8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.520+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa94089040 con 0x7faaa015ccf0 2024-09-13T17:17:25.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.521+0000 7faa9effd640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 0x7faa8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.521+0000 7faa9effd640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 0x7faa8c06d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa90034000 tx=0x7faa9002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.525+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faaa00c7580 con 0x7faaa015ccf0 2024-09-13T17:17:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.694+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaa00c7510 con 0x7faaa015ccf0 2024-09-13T17:17:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.694+0000 7faa87fff640 1 -- 172.21.15.5:0/250668065 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa94054220 con 0x7faaa015ccf0 2024-09-13T17:17:25.695 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 msgr2=0x7faa8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 0x7faa8c06d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7faa90034000 tx=0x7faa9002e000 comp rx=0 tx=0).stop 2024-09-13T17:17:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 msgr2=0x7faaa00b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c3f0 tx=0x7faa9400c8b0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 shutdown_connections 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faaa01606e0 0x7faaa0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faa8c06ac00 0x7faa8c06d0c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa015ccf0 0x7faaa00b4880 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 --2- 172.21.15.5:0/250668065 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa00b41a0 0x7faaa00cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 >> 172.21.15.5:0/250668065 conn(0x7faaa006b590 msgr2=0x7faaa00b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 shutdown_connections 2024-09-13T17:17:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.696+0000 7faaa5a53640 1 -- 172.21.15.5:0/250668065 wait complete. 2024-09-13T17:17:25.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.811+0000 7fb75f048640 1 Processor -- start 2024-09-13T17:17:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.811+0000 7fb75f048640 1 -- start start 2024-09-13T17:17:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb75f048640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb758153190 0x7fb758159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb75f048640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb758153570 con 0x7fb75815c640 2024-09-13T17:17:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb75f048640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75815a010 con 0x7fb7580b3240 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb75f048640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75806ad10 con 0x7fb758153190 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb757fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb75815c640 0x7fb7580b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55756/0 (socket says 172.21.15.5:55756) 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb757fff640 1 -- 172.21.15.5:0/1657098779 learned_addr learned my addr 172.21.15.5:0/1657098779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.812+0000 7fb75cde4640 1 --2- 172.21.15.5:0/1657098779 >> v2:172.21.15.179:3300/0 conn(0x7fb758153190 0x7fb758159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152435084 0 0) 0x7fb740001490 con 0x7fb75815c640 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003520 con 0x7fb75815c640 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1969772879 0 0) 0x7fb744003520 con 0x7fb75815c640 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb75cde4640 1 -- 172.21.15.5:0/1657098779 >> v1:172.21.15.179:6789/0 conn(0x7fb7580b3240 legacy=0x7fb7580cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb75cde4640 1 -- 172.21.15.5:0/1657098779 >> v1:172.21.15.5:6789/0 conn(0x7fb75815c640 legacy=0x7fb7580b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.813+0000 7fb75cde4640 1 -- 172.21.15.5:0/1657098779 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75815cb30 con 0x7fb758153190 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb75cde4640 1 --2- 172.21.15.5:0/1657098779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb758153190 0x7fb758159ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb74800a940 tx=0x7fb74802b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f806a5c498c348d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740001b80 con 0x7fb758153190 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74802e050 con 0x7fb758153190 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb7577fe640 1 -- 172.21.15.5:0/1657098779 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748030730 con 0x7fb758153190 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb75f048640 1 -- 172.21.15.5:0/1657098779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb758153190 msgr2=0x7fb758159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.814+0000 7fb75f048640 1 --2- 172.21.15.5:0/1657098779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb758153190 0x7fb758159ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb74800a940 tx=0x7fb74802b4a0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.815+0000 7fb75f048640 1 -- 172.21.15.5:0/1657098779 shutdown_connections 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.815+0000 7fb75f048640 1 --2- 172.21.15.5:0/1657098779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb758153190 0x7fb758159ad0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.815+0000 7fb75f048640 1 -- 172.21.15.5:0/1657098779 >> 172.21.15.5:0/1657098779 conn(0x7fb758069ed0 msgr2=0x7fb75806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.815+0000 7fb75f048640 1 -- 172.21.15.5:0/1657098779 shutdown_connections 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.815+0000 7fb75f048640 1 -- 172.21.15.5:0/1657098779 wait complete. 2024-09-13T17:17:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.816+0000 7fb75f048640 1 Processor -- start 2024-09-13T17:17:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.816+0000 7fb75f048640 1 -- start start 2024-09-13T17:17:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7580b3240 0x7fb758143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb758153190 0x7fb7581577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7581537b0 con 0x7fb75815c640 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758153a90 con 0x7fb7580b3240 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75f048640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb758153d70 con 0x7fb758153190 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58250/0 (socket says 172.21.15.5:58250) 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 -- 172.21.15.5:0/18483447 learned_addr learned my addr 172.21.15.5:0/18483447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75cde4640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7580b3240 0x7fb758143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb757fff640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb758153190 0x7fb7581577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 -- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb758153190 msgr2=0x7fb7581577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb758153190 0x7fb7581577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 -- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7580b3240 msgr2=0x7fb758143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7580b3240 0x7fb758143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:25.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 -- 172.21.15.5:0/18483447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74800a5a0 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.817+0000 7fb75d5e5640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c3c0 tx=0x7fb75000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.818+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500035f0 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.818+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750003750 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.818+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb758154050 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.818+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750003b00 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.818+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb758144250 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.819+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb758154570 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.819+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb750003c60 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.819+0000 7fb7557fa640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 0x7fb73806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.820+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb750088910 con 0x7fb75815c640 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.820+0000 7fb75cde4640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 0x7fb73806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.820+0000 7fb75cde4640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 0x7fb73806d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb748035000 tx=0x7fb748030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:25.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.824+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb750053bb0 con 0x7fb75815c640 2024-09-13T17:17:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.995+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb758159ad0 con 0x7fb75815c640 2024-09-13T17:17:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.996+0000 7fb7557fa640 1 -- 172.21.15.5:0/18483447 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb750017020 con 0x7fb75815c640 2024-09-13T17:17:25.997 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 msgr2=0x7fb73806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 0x7fb73806d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb748035000 tx=0x7fb748030000 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 msgr2=0x7fb758151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c3c0 tx=0x7fb75000c880 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 shutdown_connections 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb73806ac30 0x7fb73806d0f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75815c640 0x7fb758151280 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb758153190 0x7fb7581577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 --2- 172.21.15.5:0/18483447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7580b3240 0x7fb758143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 >> 172.21.15.5:0/18483447 conn(0x7fb758069ed0 msgr2=0x7fb7580af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 shutdown_connections 2024-09-13T17:17:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:25.998+0000 7fb75f048640 1 -- 172.21.15.5:0/18483447 wait complete. 2024-09-13T17:17:26.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 Processor -- start 2024-09-13T17:17:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 -- start start 2024-09-13T17:17:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0d34d0 con 0x7f15cc0d1b00 2024-09-13T17:17:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0cddb0 con 0x7f15cc0d20c0 2024-09-13T17:17:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.114+0000 7f15d23aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0b5700 con 0x7f15cc15c760 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15c3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15c3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:36190/0 (socket says 172.21.15.5:36190) 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15c3fff640 1 -- 172.21.15.5:0/3543268144 learned_addr learned my addr 172.21.15.5:0/3543268144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:48794/0 (socket says 172.21.15.5:48794) 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15d0947640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f15cc0d1b00 0x7f15cc0b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:35260/0 (socket says 172.21.15.5:35260) 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 -- 172.21.15.5:0/3543268144 >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 msgr2=0x7f15cc0cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 --2- 172.21.15.5:0/3543268144 >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 -- 172.21.15.5:0/3543268144 >> v1:172.21.15.179:6789/0 conn(0x7f15cc0d1b00 legacy=0x7f15cc0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15cbfff640 1 -- 172.21.15.5:0/3543268144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0d2950 con 0x7f15cc15c760 2024-09-13T17:17:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.115+0000 7f15c3fff640 1 --2- 172.21.15.5:0/3543268144 >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.116+0000 7f15cbfff640 1 --2- 172.21.15.5:0/3543268144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097a0 tx=0x7f15bc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d1ae5178d2805b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.116+0000 7f15cb7fe640 1 -- 172.21.15.5:0/3543268144 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc02ae50 con 0x7f15cc15c760 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.116+0000 7f15cb7fe640 1 -- 172.21.15.5:0/3543268144 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc032440 con 0x7f15cc15c760 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.116+0000 7f15cb7fe640 1 -- 172.21.15.5:0/3543268144 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0327d0 con 0x7f15cc15c760 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 -- 172.21.15.5:0/3543268144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 msgr2=0x7f15cc0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 --2- 172.21.15.5:0/3543268144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097a0 tx=0x7f15bc02a100 comp rx=0 tx=0).stop 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 -- 172.21.15.5:0/3543268144 shutdown_connections 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 --2- 172.21.15.5:0/3543268144 >> v2:172.21.15.179:3300/0 conn(0x7f15cc0d20c0 0x7f15cc0cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 --2- 172.21.15.5:0/3543268144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc0cf640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 -- 172.21.15.5:0/3543268144 >> 172.21.15.5:0/3543268144 conn(0x7f15cc071a20 msgr2=0x7f15cc071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 -- 172.21.15.5:0/3543268144 shutdown_connections 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.117+0000 7f15d23aa640 1 -- 172.21.15.5:0/3543268144 wait complete. 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.118+0000 7f15d23aa640 1 Processor -- start 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.118+0000 7f15d23aa640 1 -- start start 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15cc0d20c0 0x7f15cc1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc155e60 con 0x7f15cc0d1b00 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc153890 con 0x7f15cc0d20c0 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc153b70 con 0x7f15cc15c760 2024-09-13T17:17:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58258/0 (socket says 172.21.15.5:58258) 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 -- 172.21.15.5:0/2799677488 learned_addr learned my addr 172.21.15.5:0/2799677488 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15c3fff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15cc0d20c0 0x7f15cc1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d0947640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 -- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 msgr2=0x7f15cc155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 -- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15cc0d20c0 msgr2=0x7f15cc1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15cc0d20c0 0x7f15cc1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 -- 172.21.15.5:0/2799677488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094d0 con 0x7f15cc0d1b00 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15cbfff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f15bc035040 tx=0x7f15bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc03d850 con 0x7f15cc0d1b00 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc03d9d0 con 0x7f15cc0d1b00 2024-09-13T17:17:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.119+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc009400 con 0x7f15cc0d1b00 2024-09-13T17:17:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.120+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc03dd80 con 0x7f15cc0d1b00 2024-09-13T17:17:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.120+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc15df60 con 0x7f15cc0d1b00 2024-09-13T17:17:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.120+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc0d2580 con 0x7f15cc0d1b00 2024-09-13T17:17:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.121+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15bc039040 con 0x7f15cc0d1b00 2024-09-13T17:17:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.122+0000 7f15c97fa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.122+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15bc0a9e20 con 0x7f15cc0d1b00 2024-09-13T17:17:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.122+0000 7f15c3fff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.122+0000 7f15c3fff640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 0x7f15ac06d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f15cc159a20 tx=0x7f15b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.126+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f15bc074ec0 con 0x7f15cc0d1b00 2024-09-13T17:17:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.296+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15cc073770 con 0x7f15cc0d1b00 2024-09-13T17:17:26.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.296+0000 7f15c97fa640 1 -- 172.21.15.5:0/2799677488 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15bc041020 con 0x7f15cc0d1b00 2024-09-13T17:17:26.297 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:26.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 msgr2=0x7f15ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 0x7f15ac06d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f15cc159a20 tx=0x7f15b4008040 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 msgr2=0x7f15cc1f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f15bc035040 tx=0x7f15bc0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 shutdown_connections 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15cc15c760 0x7f15cc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15cc0d20c0 0x7f15cc1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 --2- 172.21.15.5:0/2799677488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15cc0d1b00 0x7f15cc1f4e90 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 >> 172.21.15.5:0/2799677488 conn(0x7f15cc071a20 msgr2=0x7f15cc0ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 shutdown_connections 2024-09-13T17:17:26.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.298+0000 7f15d23aa640 1 -- 172.21.15.5:0/2799677488 wait complete. 2024-09-13T17:17:26.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:17:26.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.411+0000 7f3774195640 1 Processor -- start 2024-09-13T17:17:26.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.411+0000 7f3774195640 1 -- start start 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3774195640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f376c0b15f0 0x7f376c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3774195640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f376c0b19d0 0x7f376c13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3774195640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0b3be0 con 0x7f376c13f130 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3774195640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c13c8e0 con 0x7f376c0b19d0 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3774195640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c13f740 con 0x7f376c0b15f0 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3771730640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f376c0b19d0 0x7f376c13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3771730640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f376c0b19d0 0x7f376c13ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58272/0 (socket says 172.21.15.5:58272) 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.412+0000 7f3771730640 1 -- 172.21.15.5:0/881110772 learned_addr learned my addr 172.21.15.5:0/881110772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771f31640 1 --2- 172.21.15.5:0/881110772 >> v2:172.21.15.179:3300/0 conn(0x7f376c0b15f0 0x7f376c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771730640 1 -- 172.21.15.5:0/881110772 >> v2:172.21.15.179:3300/0 conn(0x7f376c0b15f0 msgr2=0x7f376c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771730640 1 --2- 172.21.15.5:0/881110772 >> v2:172.21.15.179:3300/0 conn(0x7f376c0b15f0 0x7f376c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771730640 1 -- 172.21.15.5:0/881110772 >> v1:172.21.15.179:6789/0 conn(0x7f376c13f130 legacy=0x7f376c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:26.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771730640 1 -- 172.21.15.5:0/881110772 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c159a80 con 0x7f376c0b19d0 2024-09-13T17:17:26.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3771730640 1 --2- 172.21.15.5:0/881110772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c0b19d0 0x7f376c13ebf0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f376c06abc0 tx=0x7f376002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df47ccbc488d759 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3770f2f640 1 -- 172.21.15.5:0/881110772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760032440 con 0x7f376c0b19d0 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.413+0000 7f3770f2f640 1 -- 172.21.15.5:0/881110772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600325a0 con 0x7f376c0b19d0 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3770f2f640 1 -- 172.21.15.5:0/881110772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760032930 con 0x7f376c0b19d0 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 -- 172.21.15.5:0/881110772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c0b19d0 msgr2=0x7f376c13ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 --2- 172.21.15.5:0/881110772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c0b19d0 0x7f376c13ebf0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f376c06abc0 tx=0x7f376002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 -- 172.21.15.5:0/881110772 shutdown_connections 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 --2- 172.21.15.5:0/881110772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c0b19d0 0x7f376c13ebf0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 --2- 172.21.15.5:0/881110772 >> v2:172.21.15.179:3300/0 conn(0x7f376c0b15f0 0x7f376c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 -- 172.21.15.5:0/881110772 >> 172.21.15.5:0/881110772 conn(0x7f376c06a500 msgr2=0x7f376c0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 -- 172.21.15.5:0/881110772 shutdown_connections 2024-09-13T17:17:26.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.414+0000 7f3774195640 1 -- 172.21.15.5:0/881110772 wait complete. 2024-09-13T17:17:26.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.415+0000 7f3774195640 1 Processor -- start 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.415+0000 7f3774195640 1 -- start start 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f376c0b15f0 0x7f376c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 0x7f376c13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0a8bf0 con 0x7f376c13f130 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c140bd0 con 0x7f376c0b19d0 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3774195640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c141400 con 0x7f376c0b15f0 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58286/0 (socket says 172.21.15.5:58286) 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 -- 172.21.15.5:0/4222224654 learned_addr learned my addr 172.21.15.5:0/4222224654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3771f31640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f376c0b15f0 0x7f376c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3771730640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 0x7f376c13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 -- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f376c0b15f0 msgr2=0x7f376c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f376c0b15f0 0x7f376c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.416+0000 7f3772732640 1 -- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 msgr2=0x7f376c13bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3772732640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 0x7f376c13bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3772732640 1 -- 172.21.15.5:0/4222224654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600094d0 con 0x7f376c13f130 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3771730640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 0x7f376c13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3772732640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f376400c410 tx=0x7f376400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764011790 con 0x7f376c13f130 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640118f0 con 0x7f376c13f130 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c1416e0 con 0x7f376c13f130 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764011ce0 con 0x7f376c13f130 2024-09-13T17:17:26.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.417+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c141ca0 con 0x7f376c13f130 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.418+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c141e90 con 0x7f376c13f130 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.418+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f376401c460 con 0x7f376c13f130 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.419+0000 7f376a7fc640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 0x7f375806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.419+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3764089020 con 0x7f376c13f130 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.419+0000 7f3771f31640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 0x7f375806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.420+0000 7f3771f31640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 0x7f375806d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f375c003aa0 tx=0x7f375c009830 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.423+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3764054150 con 0x7f376c13f130 2024-09-13T17:17:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.604+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f376c0cdde0 con 0x7f376c13f130 2024-09-13T17:17:26.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.604+0000 7f376a7fc640 1 -- 172.21.15.5:0/4222224654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3764057770 con 0x7f376c13f130 2024-09-13T17:17:26.606 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:17:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 msgr2=0x7f375806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 0x7f375806d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f375c003aa0 tx=0x7f375c009830 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 msgr2=0x7f376c0a8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f376400c410 tx=0x7f376400c8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 shutdown_connections 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f375806ac00 0x7f375806d0c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f376c13f130 0x7f376c0a8080 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f376c0b19d0 0x7f376c13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 --2- 172.21.15.5:0/4222224654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f376c0b15f0 0x7f376c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 >> 172.21.15.5:0/4222224654 conn(0x7f376c06a500 msgr2=0x7f376c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 shutdown_connections 2024-09-13T17:17:26.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.606+0000 7f3774195640 1 -- 172.21.15.5:0/4222224654 wait complete. 2024-09-13T17:17:26.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:26.618 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:26.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:26.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.775+0000 7fa7a4c12640 1 Processor -- start 2024-09-13T17:17:26.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.775+0000 7fa7a4c12640 1 -- start start 2024-09-13T17:17:26.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa7a4c12640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa7a0151340 0x7fa7a00ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa7a4c12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a00ac780 con 0x7fa7a006b5f0 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa7a4c12640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a00aca60 con 0x7fa7a0151720 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa7a4c12640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a006ca00 con 0x7fa7a0151340 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7a006b5f0 0x7fa7a00ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55764/0 (socket says 172.21.15.5:55764) 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79ed9d640 1 -- 172.21.15.5:0/750022213 learned_addr learned my addr 172.21.15.5:0/750022213 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79e59c640 1 --2- 172.21.15.5:0/750022213 >> v2:172.21.15.179:3300/0 conn(0x7fa7a0151340 0x7fa7a00ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79dd9b640 1 -- 172.21.15.5:0/750022213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749140438 0 0) 0x7fa7a00ac780 con 0x7fa7a006b5f0 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79dd9b640 1 -- 172.21.15.5:0/750022213 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c003520 con 0x7fa7a006b5f0 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79e59c640 1 -- 172.21.15.5:0/750022213 >> v1:172.21.15.179:6789/0 conn(0x7fa7a0151720 legacy=0x7fa7a006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79e59c640 1 -- 172.21.15.5:0/750022213 >> v1:172.21.15.5:6789/0 conn(0x7fa7a006b5f0 legacy=0x7fa7a00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.776+0000 7fa79e59c640 1 -- 172.21.15.5:0/750022213 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00acd40 con 0x7fa7a0151340 2024-09-13T17:17:26.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.777+0000 7fa79e59c640 1 --2- 172.21.15.5:0/750022213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151340 0x7fa7a00ac030 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097a0 tx=0x7fa79002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232d9a2c0113bc1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.777+0000 7fa79dd9b640 1 -- 172.21.15.5:0/750022213 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790032640 con 0x7fa7a0151340 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.777+0000 7fa79dd9b640 1 -- 172.21.15.5:0/750022213 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900327a0 con 0x7fa7a0151340 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.777+0000 7fa79dd9b640 1 -- 172.21.15.5:0/750022213 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790032b30 con 0x7fa7a0151340 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 -- 172.21.15.5:0/750022213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151340 msgr2=0x7fa7a00ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/750022213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151340 0x7fa7a00ac030 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7900097a0 tx=0x7fa79002a2c0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 -- 172.21.15.5:0/750022213 shutdown_connections 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/750022213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151340 0x7fa7a00ac030 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 -- 172.21.15.5:0/750022213 >> 172.21.15.5:0/750022213 conn(0x7fa7a00cc610 msgr2=0x7fa7a0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 -- 172.21.15.5:0/750022213 shutdown_connections 2024-09-13T17:17:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.778+0000 7fa7a4c12640 1 -- 172.21.15.5:0/750022213 wait complete. 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.779+0000 7fa7a4c12640 1 Processor -- start 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.779+0000 7fa7a4c12640 1 -- start start 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 0x7fa7a0151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 0x7fa7a014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a014daa0 con 0x7fa7a006b5f0 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00c9b40 con 0x7fa7a0151720 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa7a4c12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a014cf20 con 0x7fa7a0151340 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58300/0 (socket says 172.21.15.5:58300) 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79e59c640 1 -- 172.21.15.5:0/850588631 learned_addr learned my addr 172.21.15.5:0/850588631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79ed9d640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 0x7fa7a014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa795d9b640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 0x7fa7a0151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79e59c640 1 -- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 msgr2=0x7fa7a0151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.780+0000 7fa79e59c640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 0x7fa7a0151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa79e59c640 1 -- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 msgr2=0x7fa7a014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa79e59c640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 0x7fa7a014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa79e59c640 1 -- 172.21.15.5:0/850588631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790009400 con 0x7fa7a006b5f0 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa795d9b640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 0x7fa7a0151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa79ed9d640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 0x7fa7a014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa79e59c640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa7900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790030910 con 0x7fa7a006b5f0 2024-09-13T17:17:26.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790030ab0 con 0x7fa7a006b5f0 2024-09-13T17:17:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a014d200 con 0x7fa7a006b5f0 2024-09-13T17:17:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790030e60 con 0x7fa7a006b5f0 2024-09-13T17:17:26.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.781+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a014d7c0 con 0x7fa7a006b5f0 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.782+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a00c9d10 con 0x7fa7a006b5f0 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.782+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa790039040 con 0x7fa7a006b5f0 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.783+0000 7fa7977fe640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.783+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa7900aa390 con 0x7fa7a006b5f0 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.783+0000 7fa795d9b640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.784+0000 7fa795d9b640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 0x7fa78006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0145ea0 tx=0x7fa788009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:26.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.787+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa790075430 con 0x7fa7a006b5f0 2024-09-13T17:17:26.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.958+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a00ac030 con 0x7fa7a006b5f0 2024-09-13T17:17:26.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.959+0000 7fa7977fe640 1 -- 172.21.15.5:0/850588631 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fa790078a50 con 0x7fa7a006b5f0 2024-09-13T17:17:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:26.960 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 msgr2=0x7fa78006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 0x7fa78006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0145ea0 tx=0x7fa788009040 comp rx=0 tx=0).stop 2024-09-13T17:17:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 msgr2=0x7fa7a0145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:26.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa7900046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 shutdown_connections 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7a0151720 0x7fa7a014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7a0151340 0x7fa7a0151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 --2- 172.21.15.5:0/850588631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a006b5f0 0x7fa7a0145960 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 >> 172.21.15.5:0/850588631 conn(0x7fa7a00cc610 msgr2=0x7fa7a0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 shutdown_connections 2024-09-13T17:17:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:26.961+0000 7fa7a4c12640 1 -- 172.21.15.5:0/850588631 wait complete. 2024-09-13T17:17:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:14.535688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:15.662082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:26.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.078+0000 7fd1c54f7640 1 Processor -- start 2024-09-13T17:17:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.078+0000 7fd1c54f7640 1 -- start start 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1c54f7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 0x7fd1c00ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1c54f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1c0065f30 0x7fd1c006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1c54f7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c0071e40 con 0x7fd1c006b420 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1c54f7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c006b8b0 con 0x7fd1c0065f30 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1c54f7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c015cc20 con 0x7fd1c015c840 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1be7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1c0065f30 0x7fd1c006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1bf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1c006b420 0x7fd1c0160330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55774/0 (socket says 172.21.15.5:55774) 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1bf7fe640 1 -- 172.21.15.5:0/2598318115 learned_addr learned my addr 172.21.15.5:0/2598318115 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1beffd640 1 --2- 172.21.15.5:0/2598318115 >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 0x7fd1c00ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.079+0000 7fd1bdffb640 1 -- 172.21.15.5:0/2598318115 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746177124 0 0) 0x7fd1c0071e40 con 0x7fd1c006b420 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1bdffb640 1 -- 172.21.15.5:0/2598318115 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003520 con 0x7fd1c006b420 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1be7fc640 1 -- 172.21.15.5:0/2598318115 >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 msgr2=0x7fd1c00ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1be7fc640 1 --2- 172.21.15.5:0/2598318115 >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 0x7fd1c00ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1be7fc640 1 -- 172.21.15.5:0/2598318115 >> v1:172.21.15.5:6789/0 conn(0x7fd1c006b420 legacy=0x7fd1c0160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1be7fc640 1 -- 172.21.15.5:0/2598318115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0071880 con 0x7fd1c0065f30 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1beffd640 1 --2- 172.21.15.5:0/2598318115 >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 0x7fd1c00ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1be7fc640 1 --2- 172.21.15.5:0/2598318115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c0065f30 0x7fd1c006aee0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0072cf0 tx=0x7fd1b402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd9b7483fbc877c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.080+0000 7fd1bdffb640 1 -- 172.21.15.5:0/2598318115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b402add0 con 0x7fd1c0065f30 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1bdffb640 1 -- 172.21.15.5:0/2598318115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4032440 con 0x7fd1c0065f30 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1bdffb640 1 -- 172.21.15.5:0/2598318115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40327d0 con 0x7fd1c0065f30 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2598318115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c0065f30 msgr2=0x7fd1c006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2598318115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c0065f30 0x7fd1c006aee0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0072cf0 tx=0x7fd1b402a080 comp rx=0 tx=0).stop 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2598318115 shutdown_connections 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2598318115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c0065f30 0x7fd1c006aee0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2598318115 >> v2:172.21.15.179:3300/0 conn(0x7fd1c015c840 0x7fd1c00ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2598318115 >> 172.21.15.5:0/2598318115 conn(0x7fd1c00cc570 msgr2=0x7fd1c0070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2598318115 shutdown_connections 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.081+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2598318115 wait complete. 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.082+0000 7fd1c54f7640 1 Processor -- start 2024-09-13T17:17:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.082+0000 7fd1c54f7640 1 -- start start 2024-09-13T17:17:27.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c0065f30 0x7fd1c015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1c006b420 0x7fd1c01f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c015bd00 con 0x7fd1c015c840 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c015ba50 con 0x7fd1c0065f30 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1c54f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c015f4e0 con 0x7fd1c006b420 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58314/0 (socket says 172.21.15.5:58314) 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.083+0000 7fd1bf7fe640 1 -- 172.21.15.5:0/2920752240 learned_addr learned my addr 172.21.15.5:0/2920752240 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1be7fc640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1c006b420 0x7fd1c01f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1beffd640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c0065f30 0x7fd1c015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 -- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1c006b420 msgr2=0x7fd1c01f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1c006b420 0x7fd1c01f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 -- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c0065f30 msgr2=0x7fd1c015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c0065f30 0x7fd1c015b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 -- 172.21.15.5:0/2920752240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009400 con 0x7fd1c015c840 2024-09-13T17:17:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1bf7fe640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800cb40 tx=0x7fd1b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800aca0 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800ae00 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c015f820 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8012620 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.084+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c01f2f50 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.085+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c00672c0 con 0x7fd1c015c840 2024-09-13T17:17:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.086+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1b8007070 con 0x7fd1c015c840 2024-09-13T17:17:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.086+0000 7fd1a77fe640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 0x7fd1ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.086+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd1b80894e0 con 0x7fd1c015c840 2024-09-13T17:17:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.086+0000 7fd1beffd640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 0x7fd1ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.087+0000 7fd1beffd640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 0x7fd1ac06d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0156990 tx=0x7fd1b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.090+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd1b8054580 con 0x7fd1c015c840 2024-09-13T17:17:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.259+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1c00b1820 con 0x7fd1c015c840 2024-09-13T17:17:27.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.259+0000 7fd1a77fe640 1 -- 172.21.15.5:0/2920752240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1b8057ba0 con 0x7fd1c015c840 2024-09-13T17:17:27.260 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 msgr2=0x7fd1ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 0x7fd1ac06d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0156990 tx=0x7fd1b0008040 comp rx=0 tx=0).stop 2024-09-13T17:17:27.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 msgr2=0x7fd1c0159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800cb40 tx=0x7fd1b800a060 comp rx=0 tx=0).stop 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 shutdown_connections 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd1ac06ac00 0x7fd1ac06d0c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c015c840 0x7fd1c0159780 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1c006b420 0x7fd1c01f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 --2- 172.21.15.5:0/2920752240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c0065f30 0x7fd1c015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 >> 172.21.15.5:0/2920752240 conn(0x7fd1c00cc570 msgr2=0x7fd1c00ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 shutdown_connections 2024-09-13T17:17:27.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.261+0000 7fd1c54f7640 1 -- 172.21.15.5:0/2920752240 wait complete. 2024-09-13T17:17:27.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.377+0000 7f273050f640 1 Processor -- start 2024-09-13T17:17:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.377+0000 7f273050f640 1 -- start start 2024-09-13T17:17:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f273050f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f272806e360 0x7f27280cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f273050f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280b21e0 con 0x7f2728159860 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f273050f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280b24c0 con 0x7f272806df80 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f273050f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280b27a0 con 0x7f272806e360 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272eaac640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2728159860 0x7f2728159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55784/0 (socket says 172.21.15.5:55784) 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272eaac640 1 -- 172.21.15.5:0/568296356 learned_addr learned my addr 172.21.15.5:0/568296356 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272daaa640 1 --2- 172.21.15.5:0/568296356 >> v2:172.21.15.179:3300/0 conn(0x7f272806e360 0x7f27280cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463862002 0 0) 0x7f27280b21e0 con 0x7f2728159860 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714003520 con 0x7f2728159860 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178117161 0 0) 0x7f27280b24c0 con 0x7f272806df80 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27280b21e0 con 0x7f272806df80 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122101904 0 0) 0x7f2714003520 con 0x7f2728159860 2024-09-13T17:17:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 >> v2:172.21.15.179:3300/0 conn(0x7f272806e360 msgr2=0x7f27280cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 --2- 172.21.15.5:0/568296356 >> v2:172.21.15.179:3300/0 conn(0x7f272806e360 0x7f27280cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.378+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 >> v1:172.21.15.179:6789/0 conn(0x7f272806df80 legacy=0x7f27280b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280b2a80 con 0x7f2728159860 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f27200019f0 con 0x7f2728159860 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272daaa640 1 --2- 172.21.15.5:0/568296356 >> v2:172.21.15.179:3300/0 conn(0x7f272806e360 0x7f27280cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 >> v1:172.21.15.5:6789/0 conn(0x7f2728159860 legacy=0x7f2728159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2714003b30 0x7f2714003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27140047c0 0x7f2714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f271400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280b27a0 con 0x7f2714005180 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271400e230 con 0x7f2714003b30 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271400e3f0 con 0x7f27140047c0 2024-09-13T17:17:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f271400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272e2ab640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2714003b30 0x7f2714003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272daaa640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27140047c0 0x7f2714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 -- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27140047c0 msgr2=0x7f2714004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27140047c0 0x7f2714004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 -- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2714003b30 msgr2=0x7f2714003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2714003b30 0x7f2714003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.379+0000 7f272eaac640 1 -- 172.21.15.5:0/568296356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714003520 con 0x7f2714005180 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f272eaac640 1 -- 172.21.15.5:0/568296356 reap_dead start 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f272eaac640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f271400db90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f272000a7a0 tx=0x7f27140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7eef52512a1ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272002b9a0 con 0x7f2714005180 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272002bb20 con 0x7f2714005180 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f272d2a9640 1 -- 172.21.15.5:0/568296356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720034470 con 0x7f2714005180 2024-09-13T17:17:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f273050f640 1 -- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 msgr2=0x7f271400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.380+0000 7f273050f640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f271400db90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f272000a7a0 tx=0x7f27140057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.381+0000 7f273050f640 1 -- 172.21.15.5:0/568296356 shutdown_connections 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.381+0000 7f273050f640 1 --2- 172.21.15.5:0/568296356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f271400db90 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.381+0000 7f273050f640 1 -- 172.21.15.5:0/568296356 >> 172.21.15.5:0/568296356 conn(0x7f2728069ed0 msgr2=0x7f272806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.381+0000 7f273050f640 1 -- 172.21.15.5:0/568296356 shutdown_connections 2024-09-13T17:17:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.381+0000 7f273050f640 1 -- 172.21.15.5:0/568296356 wait complete. 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.382+0000 7f273050f640 1 Processor -- start 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.382+0000 7f273050f640 1 -- start start 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 0x7f272814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27280c44d0 0x7f272814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272814ae00 con 0x7f2714005180 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280abc30 con 0x7f27280c4070 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27280abf10 con 0x7f27280c44d0 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58320/0 (socket says 172.21.15.5:58320) 2024-09-13T17:17:27.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 -- 172.21.15.5:0/1286705192 learned_addr learned my addr 172.21.15.5:0/1286705192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272daaa640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 0x7f272814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272eaac640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27280c44d0 0x7f272814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 -- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27280c44d0 msgr2=0x7f272814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27280c44d0 0x7f272814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 -- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 msgr2=0x7f272814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 0x7f272814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 -- 172.21.15.5:0/1286705192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280ac1f0 con 0x7f2714005180 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272daaa640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 0x7f272814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f272e2ab640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f272400f7a0 tx=0x7f272400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400fe50 con 0x7f2714005180 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724005320 con 0x7f2714005180 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280ac4d0 con 0x7f2714005180 2024-09-13T17:17:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724007290 con 0x7f2714005180 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.383+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27280accd0 con 0x7f2714005180 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.384+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27280c37b0 con 0x7f2714005180 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.385+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27240073f0 con 0x7f2714005180 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.385+0000 7f271effd640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 0x7f270c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.385+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2724088ad0 con 0x7f2714005180 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.386+0000 7f272daaa640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 0x7f270c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.386+0000 7f272daaa640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 0x7f270c06d0f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f27281f57d0 tx=0x7f2718008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.390+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2724053b70 con 0x7f2714005180 2024-09-13T17:17:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.559+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27280ac9f0 con 0x7f2714005180 2024-09-13T17:17:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.559+0000 7f271effd640 1 -- 172.21.15.5:0/1286705192 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2724005490 con 0x7f2714005180 2024-09-13T17:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 msgr2=0x7f270c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 0x7f270c06d0f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f27281f57d0 tx=0x7f2718008040 comp rx=0 tx=0).stop 2024-09-13T17:17:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 msgr2=0x7f272814a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f272400f7a0 tx=0x7f272400fc60 comp rx=0 tx=0).stop 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 shutdown_connections 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27280c44d0 0x7f272814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27280c4070 0x7f272814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f270c06ac30 0x7f270c06d0f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 --2- 172.21.15.5:0/1286705192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2714005180 0x7f272814a8c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 >> 172.21.15.5:0/1286705192 conn(0x7f2728069ed0 msgr2=0x7f27280cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 shutdown_connections 2024-09-13T17:17:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.561+0000 7f273050f640 1 -- 172.21.15.5:0/1286705192 wait complete. 2024-09-13T17:17:27.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.676+0000 7f5e8c0d0640 1 Processor -- start 2024-09-13T17:17:27.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.676+0000 7f5e8c0d0640 1 -- start start 2024-09-13T17:17:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8c0d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e84153190 0x7f5e84159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8c0d0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5e840b3240 0x7f5e840cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8c0d0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e84153570 con 0x7f5e8415c640 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8c0d0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8406ad10 con 0x7f5e84153190 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8c0d0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8415a010 con 0x7f5e840b3240 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e89e6c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e84153190 0x7f5e84159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8966b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e8415c640 0x7f5e840b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55790/0 (socket says 172.21.15.5:55790) 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e8966b640 1 -- 172.21.15.5:0/1874627053 learned_addr learned my addr 172.21.15.5:0/1874627053 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e89e6c640 1 -- 172.21.15.5:0/1874627053 >> v2:172.21.15.179:3300/0 conn(0x7f5e840b3240 msgr2=0x7f5e840cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e89e6c640 1 --2- 172.21.15.5:0/1874627053 >> v2:172.21.15.179:3300/0 conn(0x7f5e840b3240 0x7f5e840cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e89e6c640 1 -- 172.21.15.5:0/1874627053 >> v1:172.21.15.5:6789/0 conn(0x7f5e8415c640 legacy=0x7f5e840b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e89e6c640 1 -- 172.21.15.5:0/1874627053 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8415cb30 con 0x7f5e84153190 2024-09-13T17:17:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.677+0000 7f5e88e6a640 1 -- 172.21.15.5:0/1874627053 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589402086 0 0) 0x7f5e74001110 con 0x7f5e8415c640 2024-09-13T17:17:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.678+0000 7f5e89e6c640 1 --2- 172.21.15.5:0/1874627053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e84153190 0x7f5e84159ad0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5e8406e710 tx=0x7f5e8002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1116be931418a2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.678+0000 7f5e88e6a640 1 -- 172.21.15.5:0/1874627053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80032440 con 0x7f5e84153190 2024-09-13T17:17:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.678+0000 7f5e88e6a640 1 -- 172.21.15.5:0/1874627053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e800325a0 con 0x7f5e84153190 2024-09-13T17:17:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.678+0000 7f5e88e6a640 1 -- 172.21.15.5:0/1874627053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80032930 con 0x7f5e84153190 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/1874627053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e84153190 msgr2=0x7f5e84159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/1874627053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e84153190 0x7f5e84159ad0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f5e8406e710 tx=0x7f5e8002a200 comp rx=0 tx=0).stop 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/1874627053 shutdown_connections 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/1874627053 >> v2:172.21.15.179:3300/0 conn(0x7f5e840b3240 0x7f5e840cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/1874627053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e84153190 0x7f5e84159ad0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/1874627053 >> 172.21.15.5:0/1874627053 conn(0x7f5e84069ed0 msgr2=0x7f5e8406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/1874627053 shutdown_connections 2024-09-13T17:17:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.679+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/1874627053 wait complete. 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.680+0000 7f5e8c0d0640 1 Processor -- start 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.680+0000 7f5e8c0d0640 1 -- start start 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e84153190 0x7f5e84147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 0x7f5e84147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8413efe0 con 0x7f5e840b3240 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8413f880 con 0x7f5e84153190 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8c0d0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8414b7e0 con 0x7f5e8415c640 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58336/0 (socket says 172.21.15.5:58336) 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 -- 172.21.15.5:0/141588081 learned_addr learned my addr 172.21.15.5:0/141588081 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8966b640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e84153190 0x7f5e84147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8a66d640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 0x7f5e84147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 -- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 msgr2=0x7f5e84147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 0x7f5e84147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 -- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e84153190 msgr2=0x7f5e84147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e84153190 0x7f5e84147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e89e6c640 1 -- 172.21.15.5:0/141588081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80009400 con 0x7f5e840b3240 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.681+0000 7f5e8a66d640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 0x7f5e84147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e89e6c640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009720 tx=0x7f5e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80030b80 con 0x7f5e840b3240 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80030ce0 con 0x7f5e840b3240 2024-09-13T17:17:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8414bac0 con 0x7f5e840b3240 2024-09-13T17:17:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8003b600 con 0x7f5e840b3240 2024-09-13T17:17:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.682+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8413f510 con 0x7f5e840b3240 2024-09-13T17:17:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.683+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84159ad0 con 0x7f5e840b3240 2024-09-13T17:17:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.683+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e80039040 con 0x7f5e840b3240 2024-09-13T17:17:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.684+0000 7f5e7a7fc640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 0x7f5e6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.684+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e800a9ea0 con 0x7f5e840b3240 2024-09-13T17:17:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.684+0000 7f5e8966b640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 0x7f5e6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.684+0000 7f5e8966b640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 0x7f5e6806d0c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e841477d0 tx=0x7f5e74007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.688+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5e80074eb0 con 0x7f5e840b3240 2024-09-13T17:17:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.857+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e840674e0 con 0x7f5e840b3240 2024-09-13T17:17:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.857+0000 7f5e7a7fc640 1 -- 172.21.15.5:0/141588081 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e80037020 con 0x7f5e840b3240 2024-09-13T17:17:27.859 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 msgr2=0x7f5e6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 0x7f5e6806d0c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e841477d0 tx=0x7f5e74007c00 comp rx=0 tx=0).stop 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 msgr2=0x7f5e8413ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009720 tx=0x7f5e800046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 shutdown_connections 2024-09-13T17:17:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415c640 0x7f5e84147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e84153190 0x7f5e84147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5e6806ac00 0x7f5e6806d0c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 --2- 172.21.15.5:0/141588081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e840b3240 0x7f5e8413ad80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 >> 172.21.15.5:0/141588081 conn(0x7f5e84069ed0 msgr2=0x7f5e840b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 shutdown_connections 2024-09-13T17:17:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.860+0000 7f5e8c0d0640 1 -- 172.21.15.5:0/141588081 wait complete. 2024-09-13T17:17:27.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:17:27.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.973+0000 7f1483765640 1 Processor -- start 2024-09-13T17:17:27.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 -- start start 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f147c15c920 0x7f147c0d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f147c0d09f0 0x7f147c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0b5ab0 con 0x7f147c0d27e0 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c0d1b70 con 0x7f147c15c920 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1483765640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c0d2c50 con 0x7f147c0d09f0 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1481501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f147c15c920 0x7f147c0d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1481501640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f147c15c920 0x7f147c0d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58344/0 (socket says 172.21.15.5:58344) 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.974+0000 7f1481501640 1 -- 172.21.15.5:0/1216605229 learned_addr learned my addr 172.21.15.5:0/1216605229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:27.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481d02640 1 --2- 172.21.15.5:0/1216605229 >> v2:172.21.15.179:3300/0 conn(0x7f147c0d09f0 0x7f147c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481501640 1 -- 172.21.15.5:0/1216605229 >> v2:172.21.15.179:3300/0 conn(0x7f147c0d09f0 msgr2=0x7f147c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481501640 1 --2- 172.21.15.5:0/1216605229 >> v2:172.21.15.179:3300/0 conn(0x7f147c0d09f0 0x7f147c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481501640 1 -- 172.21.15.5:0/1216605229 >> v1:172.21.15.179:6789/0 conn(0x7f147c0d27e0 legacy=0x7f147c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481501640 1 -- 172.21.15.5:0/1216605229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0d0ff0 con 0x7f147c15c920 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.975+0000 7f1481501640 1 --2- 172.21.15.5:0/1216605229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0d22a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ceb20 tx=0x7f146c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1768e21f70445a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f147bfff640 1 -- 172.21.15.5:0/1216605229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c031600 con 0x7f147c15c920 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f147bfff640 1 -- 172.21.15.5:0/1216605229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c02d050 con 0x7f147c15c920 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f147bfff640 1 -- 172.21.15.5:0/1216605229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c031980 con 0x7f147c15c920 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 -- 172.21.15.5:0/1216605229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 msgr2=0x7f147c0d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 --2- 172.21.15.5:0/1216605229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0d22a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ceb20 tx=0x7f146c02a680 comp rx=0 tx=0).stop 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 -- 172.21.15.5:0/1216605229 shutdown_connections 2024-09-13T17:17:27.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 --2- 172.21.15.5:0/1216605229 >> v2:172.21.15.179:3300/0 conn(0x7f147c0d09f0 0x7f147c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 --2- 172.21.15.5:0/1216605229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0d22a0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 -- 172.21.15.5:0/1216605229 >> 172.21.15.5:0/1216605229 conn(0x7f147c071c30 msgr2=0x7f147c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 -- 172.21.15.5:0/1216605229 shutdown_connections 2024-09-13T17:17:27.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.976+0000 7f1483765640 1 -- 172.21.15.5:0/1216605229 wait complete. 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.977+0000 7f1483765640 1 Processor -- start 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 -- start start 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0d09f0 0x7f147c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c0d27e0 0x7f147c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1f22f0 con 0x7f147c15c920 2024-09-13T17:17:27.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1f32c0 con 0x7f147c0d09f0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1483765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1f2e30 con 0x7f147c0d27e0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1481d02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1481d02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58352/0 (socket says 172.21.15.5:58352) 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1481d02640 1 -- 172.21.15.5:0/520247857 learned_addr learned my addr 172.21.15.5:0/520247857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1481501640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0d09f0 0x7f147c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.978+0000 7f1480d00640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c0d27e0 0x7f147c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 -- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c0d27e0 msgr2=0x7f147c157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c0d27e0 0x7f147c157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 -- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0d09f0 msgr2=0x7f147c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0d09f0 0x7f147c157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 -- 172.21.15.5:0/520247857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009b30 con 0x7f147c15c920 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1481d02640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f147400d830 tx=0x7f147400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400b6c0 con 0x7f147c15c920 2024-09-13T17:17:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400b840 con 0x7f147c15c920 2024-09-13T17:17:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0c9b00 con 0x7f147c15c920 2024-09-13T17:17:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400bbf0 con 0x7f147c15c920 2024-09-13T17:17:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.979+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c1f27e0 con 0x7f147c15c920 2024-09-13T17:17:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.980+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c0672f0 con 0x7f147c15c920 2024-09-13T17:17:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.981+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f147401e460 con 0x7f147c15c920 2024-09-13T17:17:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.981+0000 7f1479ffb640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 0x7f146806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.981+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1474089ad0 con 0x7f147c15c920 2024-09-13T17:17:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.982+0000 7f1481501640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 0x7f146806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.982+0000 7f1481501640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 0x7f146806d0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f146c033000 tx=0x7f146c009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:27.986+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1474054c20 con 0x7f147c15c920 2024-09-13T17:17:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.169+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f147c0d22a0 con 0x7f147c15c920 2024-09-13T17:17:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.169+0000 7f1479ffb640 1 -- 172.21.15.5:0/520247857 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1474058240 con 0x7f147c15c920 2024-09-13T17:17:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:17:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 msgr2=0x7f146806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 0x7f146806d0c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f146c033000 tx=0x7f146c009000 comp rx=0 tx=0).stop 2024-09-13T17:17:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 msgr2=0x7f147c0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f147400d830 tx=0x7f147400dcf0 comp rx=0 tx=0).stop 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 shutdown_connections 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f146806ac00 0x7f146806d0c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f147c15c920 0x7f147c0ca260 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f147c0d27e0 0x7f147c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 --2- 172.21.15.5:0/520247857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147c0d09f0 0x7f147c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 >> 172.21.15.5:0/520247857 conn(0x7f147c071c30 msgr2=0x7f147c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 shutdown_connections 2024-09-13T17:17:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:28.171+0000 7f1483765640 1 -- 172.21.15.5:0/520247857 wait complete. 2024-09-13T17:17:28.183 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:17:28.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:28.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:17:28.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[65847]: fuse finished with error 0 and tester_r 0 2024-09-13T17:17:28.209 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:34.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:17:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:34.311 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:17:34.331 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:34.332 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:34.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.484+0000 7f1174ff4640 1 Processor -- start 2024-09-13T17:17:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.484+0000 7f1174ff4640 1 -- start start 2024-09-13T17:17:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.485+0000 7f1174ff4640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 0x7f11700703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f1174ff4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f117006ded0 0x7f11700b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f1174ff4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cd260 con 0x7f1170070920 2024-09-13T17:17:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f1174ff4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1170070d60 con 0x7f117006ded0 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f1174ff4640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cd6f0 con 0x7f1170158c60 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1170070920 0x7f117006d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48268/0 (socket says 172.21.15.5:48268) 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f117006ded0 0x7f11700b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116dd9b640 1 -- 172.21.15.5:0/2330993045 learned_addr learned my addr 172.21.15.5:0/2330993045 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116e59c640 1 --2- 172.21.15.5:0/2330993045 >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 0x7f11700703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116ed9d640 1 -- 172.21.15.5:0/2330993045 >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 msgr2=0x7f11700703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116ed9d640 1 --2- 172.21.15.5:0/2330993045 >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 0x7f11700703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116ed9d640 1 -- 172.21.15.5:0/2330993045 >> v1:172.21.15.5:6789/0 conn(0x7f1170070920 legacy=0x7f117006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116ed9d640 1 -- 172.21.15.5:0/2330993045 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700cc650 con 0x7f117006ded0 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116d59a640 1 -- 172.21.15.5:0/2330993045 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903039777 0 0) 0x7f11700cd260 con 0x7f1170070920 2024-09-13T17:17:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.486+0000 7f116e59c640 1 --2- 172.21.15.5:0/2330993045 >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 0x7f11700703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.487+0000 7f116ed9d640 1 --2- 172.21.15.5:0/2330993045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117006ded0 0x7f11700b2550 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f117006ef90 tx=0x7f116802b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db625d324023399f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.487+0000 7f116d59a640 1 -- 172.21.15.5:0/2330993045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168008640 con 0x7f117006ded0 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.487+0000 7f116d59a640 1 -- 172.21.15.5:0/2330993045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680087a0 con 0x7f117006ded0 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.487+0000 7f116d59a640 1 -- 172.21.15.5:0/2330993045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168008b30 con 0x7f117006ded0 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 -- 172.21.15.5:0/2330993045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117006ded0 msgr2=0x7f11700b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 --2- 172.21.15.5:0/2330993045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117006ded0 0x7f11700b2550 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f117006ef90 tx=0x7f116802b780 comp rx=0 tx=0).stop 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 -- 172.21.15.5:0/2330993045 shutdown_connections 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 --2- 172.21.15.5:0/2330993045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117006ded0 0x7f11700b2550 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 --2- 172.21.15.5:0/2330993045 >> v2:172.21.15.179:3300/0 conn(0x7f1170158c60 0x7f11700703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 -- 172.21.15.5:0/2330993045 >> 172.21.15.5:0/2330993045 conn(0x7f1170066200 msgr2=0x7f1170069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 -- 172.21.15.5:0/2330993045 shutdown_connections 2024-09-13T17:17:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.488+0000 7f1174ff4640 1 -- 172.21.15.5:0/2330993045 wait complete. 2024-09-13T17:17:34.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.489+0000 7f1174ff4640 1 Processor -- start 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.489+0000 7f1174ff4640 1 -- start start 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f117006ded0 0x7f1170157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 0x7f1170147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170156be0 con 0x7f1170158c60 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170156ec0 con 0x7f117006ded0 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f1174ff4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11701571a0 con 0x7f1170070920 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f116ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f116ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54368/0 (socket says 172.21.15.5:54368) 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f116ed9d640 1 -- 172.21.15.5:0/1052155417 learned_addr learned my addr 172.21.15.5:0/1052155417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f116e59c640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f117006ded0 0x7f1170157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.490+0000 7f116dd9b640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 0x7f1170147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 -- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 msgr2=0x7f1170147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 0x7f1170147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 -- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f117006ded0 msgr2=0x7f1170157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f117006ded0 0x7f1170157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 -- 172.21.15.5:0/1052155417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116800ab80 con 0x7f1170158c60 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116dd9b640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 0x7f1170147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f116ed9d640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1168035040 tx=0x7f1168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800a560 con 0x7f1170158c60 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680339b0 con 0x7f1170158c60 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11701e4ae0 con 0x7f1170158c60 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168033d60 con 0x7f1170158c60 2024-09-13T17:17:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.491+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170153110 con 0x7f1170158c60 2024-09-13T17:17:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.492+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170157360 con 0x7f1170158c60 2024-09-13T17:17:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.493+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f116803d450 con 0x7f1170158c60 2024-09-13T17:17:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.493+0000 7f115effd640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 0x7f115006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.493+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f11680aaa70 con 0x7f1170158c60 2024-09-13T17:17:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.493+0000 7f116e59c640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 0x7f115006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.494+0000 7f116e59c640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 0x7f115006d0f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f11701f5430 tx=0x7f1160008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.497+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1168075d80 con 0x7f1170158c60 2024-09-13T17:17:34.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.671+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11700672f0 con 0x7f1170158c60 2024-09-13T17:17:34.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.672+0000 7f115effd640 1 -- 172.21.15.5:0/1052155417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f11680793a0 con 0x7f1170158c60 2024-09-13T17:17:34.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:34.674 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 msgr2=0x7f115006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 0x7f115006d0f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f11701f5430 tx=0x7f1160008040 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 msgr2=0x7f11701e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1168035040 tx=0x7f1168004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 shutdown_connections 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f115006ac30 0x7f115006d0f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1170158c60 0x7f11701e3360 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1170070920 0x7f1170147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 --2- 172.21.15.5:0/1052155417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f117006ded0 0x7f1170157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 >> 172.21.15.5:0/1052155417 conn(0x7f1170066200 msgr2=0x7f1170155410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 shutdown_connections 2024-09-13T17:17:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.674+0000 7f1174ff4640 1 -- 172.21.15.5:0/1052155417 wait complete. 2024-09-13T17:17:34.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:14.535688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:15.662082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:34.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.790+0000 7f5d4b18a640 1 Processor -- start 2024-09-13T17:17:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.790+0000 7f5d4b18a640 1 -- start start 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.791+0000 7f5d4b18a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.791+0000 7f5d4b18a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d440cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.791+0000 7f5d4b18a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d440d34d0 con 0x7f5d440d1b00 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.791+0000 7f5d4b18a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d440cddb0 con 0x7f5d4415c760 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.791+0000 7f5d4b18a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440b5700 con 0x7f5d440d20c0 2024-09-13T17:17:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d48f26640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d440cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d48f26640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:59616/0 (socket says 172.21.15.5:59616) 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d49727640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f5d440d1b00 0x7f5d440b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:38734/0 (socket says 172.21.15.5:38734) 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d48f26640 1 -- 172.21.15.5:0/877932389 learned_addr learned my addr 172.21.15.5:0/877932389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d43fff640 1 -- 172.21.15.5:0/877932389 >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 msgr2=0x7f5d440cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d43fff640 1 --2- 172.21.15.5:0/877932389 >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d43fff640 1 -- 172.21.15.5:0/877932389 >> v1:172.21.15.179:6789/0 conn(0x7f5d440d1b00 legacy=0x7f5d440b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d43fff640 1 -- 172.21.15.5:0/877932389 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440d2950 con 0x7f5d440d20c0 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d437fe640 1 -- 172.21.15.5:0/877932389 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985368516 0 0) 0x7f5d440d34d0 con 0x7f5d440d1b00 2024-09-13T17:17:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.792+0000 7f5d48f26640 1 --2- 172.21.15.5:0/877932389 >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.793+0000 7f5d43fff640 1 --2- 172.21.15.5:0/877932389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d440cfb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009d90 tx=0x7f5d2c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e947e18237307700 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.793+0000 7f5d437fe640 1 -- 172.21.15.5:0/877932389 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c031600 con 0x7f5d440d20c0 2024-09-13T17:17:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.793+0000 7f5d437fe640 1 -- 172.21.15.5:0/877932389 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c02d050 con 0x7f5d440d20c0 2024-09-13T17:17:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.793+0000 7f5d437fe640 1 -- 172.21.15.5:0/877932389 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c031980 con 0x7f5d440d20c0 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 -- 172.21.15.5:0/877932389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 msgr2=0x7f5d440cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/877932389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d440cfb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009d90 tx=0x7f5d2c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 -- 172.21.15.5:0/877932389 shutdown_connections 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/877932389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d440cfb80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/877932389 >> v2:172.21.15.179:3300/0 conn(0x7f5d4415c760 0x7f5d440cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 -- 172.21.15.5:0/877932389 >> 172.21.15.5:0/877932389 conn(0x7f5d44071a20 msgr2=0x7f5d44071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 -- 172.21.15.5:0/877932389 shutdown_connections 2024-09-13T17:17:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.794+0000 7f5d4b18a640 1 -- 172.21.15.5:0/877932389 wait complete. 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.795+0000 7f5d4b18a640 1 Processor -- start 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.795+0000 7f5d4b18a640 1 -- start start 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d44152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4415c760 0x7f5d441509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44153c10 con 0x7f5d440d1b00 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440c9010 con 0x7f5d4415c760 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d4b18a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44152db0 con 0x7f5d440d20c0 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54374/0 (socket says 172.21.15.5:54374) 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 -- 172.21.15.5:0/3128156596 learned_addr learned my addr 172.21.15.5:0/3128156596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d49727640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4415c760 0x7f5d441509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d43fff640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d44152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 -- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 msgr2=0x7f5d44152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d44152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 -- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4415c760 msgr2=0x7f5d441509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4415c760 0x7f5d441509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 -- 172.21.15.5:0/3128156596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340094d0 con 0x7f5d440d1b00 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d43fff640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d44152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.796+0000 7f5d48f26640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400e9e0 tx=0x7f5d3400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.797+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400c9d0 con 0x7f5d440d1b00 2024-09-13T17:17:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.797+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400cb30 con 0x7f5d440d1b00 2024-09-13T17:17:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.797+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c009a70 con 0x7f5d440d1b00 2024-09-13T17:17:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.797+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400cea0 con 0x7f5d440d1b00 2024-09-13T17:17:34.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.797+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d441532e0 con 0x7f5d440d1b00 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.798+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d440d2580 con 0x7f5d440d1b00 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.798+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d34013470 con 0x7f5d440d1b00 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.799+0000 7f5d417fa640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 0x7f5d2406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.799+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5d34089670 con 0x7f5d440d1b00 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.799+0000 7f5d43fff640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 0x7f5d2406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.799+0000 7f5d43fff640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 0x7f5d2406d0f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c034000 tx=0x7f5d2c02f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.803+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5d34054740 con 0x7f5d440d1b00 2024-09-13T17:17:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.971+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d440ca6a0 con 0x7f5d440d1b00 2024-09-13T17:17:34.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.972+0000 7f5d417fa640 1 -- 172.21.15.5:0/3128156596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d34057d60 con 0x7f5d440d1b00 2024-09-13T17:17:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 msgr2=0x7f5d2406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 0x7f5d2406d0f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c034000 tx=0x7f5d2c02f000 comp rx=0 tx=0).stop 2024-09-13T17:17:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 msgr2=0x7f5d440c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400e9e0 tx=0x7f5d3400eea0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 shutdown_connections 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d4415c760 0x7f5d441509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d440d20c0 0x7f5d44152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5d2406ac30 0x7f5d2406d0f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 --2- 172.21.15.5:0/3128156596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d440d1b00 0x7f5d440c8ad0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 >> 172.21.15.5:0/3128156596 conn(0x7f5d44071a20 msgr2=0x7f5d440b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 shutdown_connections 2024-09-13T17:17:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:34.974+0000 7f5d4b18a640 1 -- 172.21.15.5:0/3128156596 wait complete. 2024-09-13T17:17:34.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:35.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.089+0000 7f08b7041640 1 Processor -- start 2024-09-13T17:17:35.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.089+0000 7f08b7041640 1 -- start start 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b7041640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08b0143ea0 0x7f08b015a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b7041640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b006c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b7041640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00cae40 con 0x7f08b00adb60 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b7041640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b00cbca0 con 0x7f08b0143ea0 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b7041640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00adfa0 con 0x7f08b00cc840 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b4ddd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08b0143ea0 0x7f08b015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b4ddd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08b0143ea0 0x7f08b015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54376/0 (socket says 172.21.15.5:54376) 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.090+0000 7f08b4ddd640 1 -- 172.21.15.5:0/3479798963 learned_addr learned my addr 172.21.15.5:0/3479798963 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08b4ddd640 1 -- 172.21.15.5:0/3479798963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 msgr2=0x7f08b006c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/3479798963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08b4ddd640 1 -- 172.21.15.5:0/3479798963 >> v1:172.21.15.179:6789/0 conn(0x7f08b00adb60 legacy=0x7f08b00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:35.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08b4ddd640 1 -- 172.21.15.5:0/3479798963 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0144280 con 0x7f08b0143ea0 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/3479798963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b015a910 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009870 tx=0x7f08a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9deb8c6935e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.091+0000 7f08af7fe640 1 -- 172.21.15.5:0/3479798963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a002ae90 con 0x7f08b0143ea0 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08af7fe640 1 -- 172.21.15.5:0/3479798963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0032440 con 0x7f08b0143ea0 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08af7fe640 1 -- 172.21.15.5:0/3479798963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a00327d0 con 0x7f08b0143ea0 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 -- 172.21.15.5:0/3479798963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 msgr2=0x7f08b015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 --2- 172.21.15.5:0/3479798963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b015a910 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009870 tx=0x7f08a002a180 comp rx=0 tx=0).stop 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 -- 172.21.15.5:0/3479798963 shutdown_connections 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 --2- 172.21.15.5:0/3479798963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b006c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 --2- 172.21.15.5:0/3479798963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b015a910 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 -- 172.21.15.5:0/3479798963 >> 172.21.15.5:0/3479798963 conn(0x7f08b0069ed0 msgr2=0x7f08b006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 -- 172.21.15.5:0/3479798963 shutdown_connections 2024-09-13T17:17:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.092+0000 7f08b7041640 1 -- 172.21.15.5:0/3479798963 wait complete. 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.093+0000 7f08b7041640 1 Processor -- start 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.093+0000 7f08b7041640 1 -- start start 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 0x7f08b01ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b00c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00ac420 con 0x7f08b0143ea0 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00aba80 con 0x7f08b00adb60 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b7041640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00abd60 con 0x7f08b00cc840 2024-09-13T17:17:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b55de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b55de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54392/0 (socket says 172.21.15.5:54392) 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b55de640 1 -- 172.21.15.5:0/740326824 learned_addr learned my addr 172.21.15.5:0/740326824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.094+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 0x7f08b01ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08affff640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b00c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 -- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 msgr2=0x7f08b00c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b00c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 -- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 msgr2=0x7f08b01ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 0x7f08b01ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 -- 172.21.15.5:0/740326824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00094d0 con 0x7f08b0143ea0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 0x7f08b01ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b55de640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b410 tx=0x7f08a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011830 con 0x7f08b0143ea0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80119b0 con 0x7f08b0143ea0 2024-09-13T17:17:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b00ac040 con 0x7f08b0143ea0 2024-09-13T17:17:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011d60 con 0x7f08b0143ea0 2024-09-13T17:17:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.095+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b00c39a0 con 0x7f08b0143ea0 2024-09-13T17:17:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.096+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b00ac560 con 0x7f08b0143ea0 2024-09-13T17:17:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.096+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08a801a400 con 0x7f08b0143ea0 2024-09-13T17:17:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.097+0000 7f08ad7fa640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 0x7f089006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.097+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08a8089560 con 0x7f08b0143ea0 2024-09-13T17:17:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.097+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 0x7f089006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.098+0000 7f08b4ddd640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 0x7f089006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f08a0034000 tx=0x7f08a002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.101+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f08a8054690 con 0x7f08b0143ea0 2024-09-13T17:17:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.271+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08b00cccd0 con 0x7f08b0143ea0 2024-09-13T17:17:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.272+0000 7f08ad7fa640 1 -- 172.21.15.5:0/740326824 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08a8057cb0 con 0x7f08b0143ea0 2024-09-13T17:17:35.273 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.273+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 msgr2=0x7f089006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.273+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 0x7f089006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f08a0034000 tx=0x7f08a002e000 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.273+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 msgr2=0x7f08b00b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.273+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b410 tx=0x7f08a800b8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 shutdown_connections 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f089006ac00 0x7f089006d0c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08b0143ea0 0x7f08b00b2280 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08b00cc840 0x7f08b00c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 --2- 172.21.15.5:0/740326824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08b00adb60 0x7f08b01ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 >> 172.21.15.5:0/740326824 conn(0x7f08b0069ed0 msgr2=0x7f08b006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 shutdown_connections 2024-09-13T17:17:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.274+0000 7f08b7041640 1 -- 172.21.15.5:0/740326824 wait complete. 2024-09-13T17:17:35.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:35.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.389+0000 7ff78d619640 1 Processor -- start 2024-09-13T17:17:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.389+0000 7ff78d619640 1 -- start start 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff78d619640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78815c760 0x7ff7880cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff78d619640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7880d1b00 0x7ff7880cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff78d619640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7880d34d0 con 0x7ff7880d20c0 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff78d619640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880cddb0 con 0x7ff78815c760 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff78d619640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880b5700 con 0x7ff7880d1b00 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff786ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78815c760 0x7ff7880cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff786ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78815c760 0x7ff7880cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54402/0 (socket says 172.21.15.5:54402) 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.390+0000 7ff786ffd640 1 -- 172.21.15.5:0/59147347 learned_addr learned my addr 172.21.15.5:0/59147347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff7877fe640 1 --2- 172.21.15.5:0/59147347 >> v2:172.21.15.179:3300/0 conn(0x7ff7880d1b00 0x7ff7880cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff786ffd640 1 -- 172.21.15.5:0/59147347 >> v2:172.21.15.179:3300/0 conn(0x7ff7880d1b00 msgr2=0x7ff7880cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff786ffd640 1 --2- 172.21.15.5:0/59147347 >> v2:172.21.15.179:3300/0 conn(0x7ff7880d1b00 0x7ff7880cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff786ffd640 1 -- 172.21.15.5:0/59147347 >> v1:172.21.15.179:6789/0 conn(0x7ff7880d20c0 legacy=0x7ff7880b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:35.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff786ffd640 1 -- 172.21.15.5:0/59147347 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7880d2950 con 0x7ff78815c760 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.391+0000 7ff786ffd640 1 --2- 172.21.15.5:0/59147347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880cf640 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff7880b5550 tx=0x7ff77802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bd2aa08b7f2d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff785ffb640 1 -- 172.21.15.5:0/59147347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778031600 con 0x7ff78815c760 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff785ffb640 1 -- 172.21.15.5:0/59147347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77802d050 con 0x7ff78815c760 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff785ffb640 1 -- 172.21.15.5:0/59147347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778031980 con 0x7ff78815c760 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 -- 172.21.15.5:0/59147347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 msgr2=0x7ff7880cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 --2- 172.21.15.5:0/59147347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880cf640 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff7880b5550 tx=0x7ff77802a6a0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 -- 172.21.15.5:0/59147347 shutdown_connections 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 --2- 172.21.15.5:0/59147347 >> v2:172.21.15.179:3300/0 conn(0x7ff7880d1b00 0x7ff7880cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 --2- 172.21.15.5:0/59147347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880cf640 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 -- 172.21.15.5:0/59147347 >> 172.21.15.5:0/59147347 conn(0x7ff788071a20 msgr2=0x7ff788071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 -- 172.21.15.5:0/59147347 shutdown_connections 2024-09-13T17:17:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.392+0000 7ff78d619640 1 -- 172.21.15.5:0/59147347 wait complete. 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.393+0000 7ff78d619640 1 Processor -- start 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 -- start start 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 0x7ff788152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7880d20c0 0x7ff788155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788156050 con 0x7ff78815c760 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788155a90 con 0x7ff7880d1b00 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff78d619640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff788155d70 con 0x7ff7880d20c0 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54414/0 (socket says 172.21.15.5:54414) 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff7877fe640 1 -- 172.21.15.5:0/3550401441 learned_addr learned my addr 172.21.15.5:0/3550401441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff786ffd640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 0x7ff788152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.394+0000 7ff7867fc640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7880d20c0 0x7ff788155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 -- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7880d20c0 msgr2=0x7ff788155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7880d20c0 0x7ff788155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 -- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 msgr2=0x7ff788152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 0x7ff788152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 -- 172.21.15.5:0/3550401441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778009b30 con 0x7ff78815c760 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff786ffd640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 0x7ff788152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff7877fe640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d800 tx=0x7ff78000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000b6c0 con 0x7ff78815c760 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78000b840 con 0x7ff78815c760 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7880c64d0 con 0x7ff78815c760 2024-09-13T17:17:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000bbf0 con 0x7ff78815c760 2024-09-13T17:17:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.395+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7881557a0 con 0x7ff78815c760 2024-09-13T17:17:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.396+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7880c69f0 con 0x7ff78815c760 2024-09-13T17:17:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.397+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff78000bd50 con 0x7ff78815c760 2024-09-13T17:17:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.397+0000 7ff76f7fe640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 0x7ff77406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.397+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7800899c0 con 0x7ff78815c760 2024-09-13T17:17:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.397+0000 7ff786ffd640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 0x7ff77406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.398+0000 7ff786ffd640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 0x7ff77406d0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff778033000 tx=0x7ff778009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.401+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7880c69f0 con 0x7ff78815c760 2024-09-13T17:17:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.571+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7880c69f0 con 0x7ff78815c760 2024-09-13T17:17:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.571+0000 7ff76f7fe640 1 -- 172.21.15.5:0/3550401441 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7880c69f0 con 0x7ff78815c760 2024-09-13T17:17:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 msgr2=0x7ff77406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 0x7ff77406d0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff778033000 tx=0x7ff778009000 comp rx=0 tx=0).stop 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 msgr2=0x7ff7880caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d800 tx=0x7ff78000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 shutdown_connections 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff77406ac00 0x7ff77406d0c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78815c760 0x7ff7880caef0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7880d20c0 0x7ff788155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 --2- 172.21.15.5:0/3550401441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7880d1b00 0x7ff788152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.573+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 >> 172.21.15.5:0/3550401441 conn(0x7ff788071a20 msgr2=0x7ff7880c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.574+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 shutdown_connections 2024-09-13T17:17:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.574+0000 7ff78d619640 1 -- 172.21.15.5:0/3550401441 wait complete. 2024-09-13T17:17:35.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:17:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.687+0000 7fc6e0be2640 1 Processor -- start 2024-09-13T17:17:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.687+0000 7fc6e0be2640 1 -- start start 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.688+0000 7fc6e0be2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.688+0000 7fc6e0be2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0b5ab0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.688+0000 7fc6e0be2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0d0ff0 con 0x7fc6dc15c920 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.688+0000 7fc6e0be2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0d1b70 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6dad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6d9d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc6dc0d29b0 0x7fc6dc0d02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48272/0 (socket says 172.21.15.5:48272) 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6dad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54426/0 (socket says 172.21.15.5:54426) 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6d9d9b640 1 -- 172.21.15.5:0/718892837 learned_addr learned my addr 172.21.15.5:0/718892837 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6dad9d640 1 -- 172.21.15.5:0/718892837 >> v1:172.21.15.179:6789/0 conn(0x7fc6dc15c920 legacy=0x7fc6dc0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6dad9d640 1 -- 172.21.15.5:0/718892837 >> v1:172.21.15.5:6789/0 conn(0x7fc6dc0d29b0 legacy=0x7fc6dc0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6d959a640 1 -- 172.21.15.5:0/718892837 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476145250 0 0) 0x7fc6dc0b5ab0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.689+0000 7fc6dad9d640 1 -- 172.21.15.5:0/718892837 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0d12d0 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6dad9d640 1 --2- 172.21.15.5:0/718892837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009dc0 tx=0x7fc6d402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7abcdf1a20f799c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6d959a640 1 -- 172.21.15.5:0/718892837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007740 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6d959a640 1 -- 172.21.15.5:0/718892837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d402d050 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6d959a640 1 -- 172.21.15.5:0/718892837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007ac0 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6e0be2640 1 -- 172.21.15.5:0/718892837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0b6fa0 msgr2=0x7fc6dc0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/718892837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009dc0 tx=0x7fc6d402a640 comp rx=0 tx=0).stop 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6e0be2640 1 -- 172.21.15.5:0/718892837 shutdown_connections 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/718892837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0d09f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.690+0000 7fc6e0be2640 1 -- 172.21.15.5:0/718892837 >> 172.21.15.5:0/718892837 conn(0x7fc6dc071c30 msgr2=0x7fc6dc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.691+0000 7fc6e0be2640 1 -- 172.21.15.5:0/718892837 shutdown_connections 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.691+0000 7fc6e0be2640 1 -- 172.21.15.5:0/718892837 wait complete. 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.692+0000 7fc6e0be2640 1 Processor -- start 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.692+0000 7fc6e0be2640 1 -- start start 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc15c920 0x7fc6dc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc152c70 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc152920 con 0x7fc6dc0b6fa0 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0cc020 con 0x7fc6dc15c920 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54434/0 (socket says 172.21.15.5:54434) 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 -- 172.21.15.5:0/1937496933 learned_addr learned my addr 172.21.15.5:0/1937496933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6da59c640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6dad9d640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc15c920 0x7fc6dc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 -- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc15c920 msgr2=0x7fc6dc0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc15c920 0x7fc6dc0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 -- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc0b6fa0 msgr2=0x7fc6dc0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 -- 172.21.15.5:0/1937496933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4009a70 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6d9d9b640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4d0 tx=0x7fc6d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00074e0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0007660 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc0cc300 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0004a20 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.693+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc1555a0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.694+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc0672f0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.695+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6d0004b80 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.695+0000 7fc6caffd640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 0x7fc6bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.695+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6d00888f0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.696+0000 7fc6da59c640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 0x7fc6bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.696+0000 7fc6da59c640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 0x7fc6bc06d0c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0c9900 tx=0x7fc6cc009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.700+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6d0053a30 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.883+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6dc152db0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.883+0000 7fc6caffd640 1 -- 172.21.15.5:0/1937496933 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6dc152db0 con 0x7fc6dc0d29b0 2024-09-13T17:17:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:17:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 msgr2=0x7fc6bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 0x7fc6bc06d0c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0c9900 tx=0x7fc6cc009060 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 msgr2=0x7fc6dc157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4d0 tx=0x7fc6d000c990 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 shutdown_connections 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc15c920 0x7fc6dc0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc6bc06ac00 0x7fc6bc06d0c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6dc0d29b0 0x7fc6dc157e10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 --2- 172.21.15.5:0/1937496933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc0b6fa0 0x7fc6dc0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 >> 172.21.15.5:0/1937496933 conn(0x7fc6dc071c30 msgr2=0x7fc6dc0cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 shutdown_connections 2024-09-13T17:17:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:35.885+0000 7fc6e0be2640 1 -- 172.21.15.5:0/1937496933 wait complete. 2024-09-13T17:17:35.898 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:35.898 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:35.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:36.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.018+0000 7f344db1f640 1 Processor -- start 2024-09-13T17:17:36.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.018+0000 7f344db1f640 1 -- start start 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f344db1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34480cd630 0x7f34480b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f344db1f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 0x7f34480b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f344db1f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344815cdd0 con 0x7f344815c9f0 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f344db1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480b8750 con 0x7f34480cd630 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f344db1f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480d2c20 con 0x7f34480b5820 2024-09-13T17:17:36.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f3446ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34480cd630 0x7f34480b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f3446ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34480cd630 0x7f34480b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54446/0 (socket says 172.21.15.5:54446) 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.019+0000 7f3446ffd640 1 -- 172.21.15.5:0/1617102708 learned_addr learned my addr 172.21.15.5:0/1617102708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3446ffd640 1 -- 172.21.15.5:0/1617102708 >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 msgr2=0x7f34480b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3447fff640 1 --2- 172.21.15.5:0/1617102708 >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 0x7f34480b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3446ffd640 1 --2- 172.21.15.5:0/1617102708 >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 0x7f34480b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3446ffd640 1 -- 172.21.15.5:0/1617102708 >> v1:172.21.15.179:6789/0 conn(0x7f344815c9f0 legacy=0x7f34480b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3446ffd640 1 -- 172.21.15.5:0/1617102708 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480d3040 con 0x7f34480cd630 2024-09-13T17:17:36.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3447fff640 1 --2- 172.21.15.5:0/1617102708 >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 0x7f34480b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.020+0000 7f3446ffd640 1 --2- 172.21.15.5:0/1617102708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f34480b4880 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f34480c60b0 tx=0x7f343c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34afe8f93f4bf43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f34467fc640 1 -- 172.21.15.5:0/1617102708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c032440 con 0x7f34480cd630 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f34467fc640 1 -- 172.21.15.5:0/1617102708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0325a0 con 0x7f34480cd630 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f34467fc640 1 -- 172.21.15.5:0/1617102708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c032930 con 0x7f34480cd630 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 -- 172.21.15.5:0/1617102708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 msgr2=0x7f34480b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 --2- 172.21.15.5:0/1617102708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f34480b4880 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f34480c60b0 tx=0x7f343c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 -- 172.21.15.5:0/1617102708 shutdown_connections 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 --2- 172.21.15.5:0/1617102708 >> v2:172.21.15.179:3300/0 conn(0x7f34480b5820 0x7f34480b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 --2- 172.21.15.5:0/1617102708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f34480b4880 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 -- 172.21.15.5:0/1617102708 >> 172.21.15.5:0/1617102708 conn(0x7f3448071a20 msgr2=0x7f3448071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 -- 172.21.15.5:0/1617102708 shutdown_connections 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 -- 172.21.15.5:0/1617102708 wait complete. 2024-09-13T17:17:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.021+0000 7f344db1f640 1 Processor -- start 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 -- start start 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480b5820 0x7f3448159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 0x7f34480c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480c8720 con 0x7f34480cd630 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3448153570 con 0x7f344815c9f0 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f344db1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34480c8b40 con 0x7f34480b5820 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.022+0000 7f3446ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54462/0 (socket says 172.21.15.5:54462) 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 -- 172.21.15.5:0/3031309494 learned_addr learned my addr 172.21.15.5:0/3031309494 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3447fff640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 0x7f34480c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f34477fe640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480b5820 0x7f3448159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 -- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480b5820 msgr2=0x7f3448159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480b5820 0x7f3448159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 -- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 msgr2=0x7f34480c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 0x7f34480c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 -- 172.21.15.5:0/3031309494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0094d0 con 0x7f34480cd630 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3447fff640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 0x7f34480c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f3446ffd640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c032440 con 0x7f34480cd630 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c030b80 con 0x7f34480cd630 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34480c7aa0 con 0x7f34480cd630 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c03d420 con 0x7f34480cd630 2024-09-13T17:17:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.023+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34480c8060 con 0x7f34480cd630 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.024+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34480c8860 con 0x7f34480cd630 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.025+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f343c039040 con 0x7f34480cd630 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.025+0000 7f342ffff640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 0x7f343406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.025+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f343c0aa170 con 0x7f34480cd630 2024-09-13T17:17:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.025+0000 7f34477fe640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 0x7f343406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.026+0000 7f34477fe640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 0x7f343406d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.029+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f34480c8860 con 0x7f34480cd630 2024-09-13T17:17:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.201+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34480c8860 con 0x7f34480cd630 2024-09-13T17:17:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.203+0000 7f342ffff640 1 -- 172.21.15.5:0/3031309494 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f34480c8860 con 0x7f34480cd630 2024-09-13T17:17:36.205 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:36.205 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 msgr2=0x7f343406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 0x7f343406d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).stop 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 msgr2=0x7f3448153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 shutdown_connections 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f344815c9f0 0x7f34480c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f343406ac00 0x7f343406d0c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34480cd630 0x7f3448153030 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 --2- 172.21.15.5:0/3031309494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34480b5820 0x7f3448159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.204+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 >> 172.21.15.5:0/3031309494 conn(0x7f3448071a20 msgr2=0x7f344815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.205+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 shutdown_connections 2024-09-13T17:17:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.205+0000 7f344db1f640 1 -- 172.21.15.5:0/3031309494 wait complete. 2024-09-13T17:17:36.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:14.535688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:15.662082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:36.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:36.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.320+0000 7f91cbaec640 1 Processor -- start 2024-09-13T17:17:36.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.320+0000 7f91cbaec640 1 -- start start 2024-09-13T17:17:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91cbaec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91c406e360 0x7f91c40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91cbaec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40b21e0 con 0x7f91c4159860 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91cbaec640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40b24c0 con 0x7f91c406df80 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91cbaec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40b27a0 con 0x7f91c406e360 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91c9087640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91c406e360 0x7f91c40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91ca089640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91c4159860 0x7f91c4159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48280/0 (socket says 172.21.15.5:48280) 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91ca089640 1 -- 172.21.15.5:0/3790311418 learned_addr learned my addr 172.21.15.5:0/3790311418 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91c9087640 1 -- 172.21.15.5:0/3790311418 >> v1:172.21.15.179:6789/0 conn(0x7f91c406df80 legacy=0x7f91c40b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91c9087640 1 -- 172.21.15.5:0/3790311418 >> v1:172.21.15.5:6789/0 conn(0x7f91c4159860 legacy=0x7f91c4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91c8886640 1 -- 172.21.15.5:0/3790311418 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521270839 0 0) 0x7f91c40b21e0 con 0x7f91c4159860 2024-09-13T17:17:36.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.321+0000 7f91c9087640 1 -- 172.21.15.5:0/3790311418 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40b2a80 con 0x7f91c406e360 2024-09-13T17:17:36.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.322+0000 7f91c9087640 1 --2- 172.21.15.5:0/3790311418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c406e360 0x7f91c40cb7c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ba70 tx=0x7f91b402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25157956354cbe32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.322+0000 7f91c8886640 1 -- 172.21.15.5:0/3790311418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40327e0 con 0x7f91c406e360 2024-09-13T17:17:36.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.322+0000 7f91c8886640 1 -- 172.21.15.5:0/3790311418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4032940 con 0x7f91c406e360 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.322+0000 7f91c8886640 1 -- 172.21.15.5:0/3790311418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4032cd0 con 0x7f91c406e360 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 -- 172.21.15.5:0/3790311418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c406e360 msgr2=0x7f91c40cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 --2- 172.21.15.5:0/3790311418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c406e360 0x7f91c40cb7c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ba70 tx=0x7f91b402c920 comp rx=0 tx=0).stop 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 -- 172.21.15.5:0/3790311418 shutdown_connections 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 --2- 172.21.15.5:0/3790311418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c406e360 0x7f91c40cb7c0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 -- 172.21.15.5:0/3790311418 >> 172.21.15.5:0/3790311418 conn(0x7f91c4069ed0 msgr2=0x7f91c406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 -- 172.21.15.5:0/3790311418 shutdown_connections 2024-09-13T17:17:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.323+0000 7f91cbaec640 1 -- 172.21.15.5:0/3790311418 wait complete. 2024-09-13T17:17:36.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.324+0000 7f91cbaec640 1 Processor -- start 2024-09-13T17:17:36.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.324+0000 7f91cbaec640 1 -- start start 2024-09-13T17:17:36.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c406df80 0x7f91c40a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c406e360 0x7f91c4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40a79f0 con 0x7f91c4159860 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4153790 con 0x7f91c406e360 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91cbaec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4153a70 con 0x7f91c406df80 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54486/0 (socket says 172.21.15.5:54486) 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 -- 172.21.15.5:0/2421756199 learned_addr learned my addr 172.21.15.5:0/2421756199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91c9087640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c406e360 0x7f91c4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91c9888640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c406df80 0x7f91c40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 -- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c406df80 msgr2=0x7f91c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c406df80 0x7f91c40a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 -- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c406e360 msgr2=0x7f91c4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c406e360 0x7f91c4146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 -- 172.21.15.5:0/2421756199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b400b6a0 con 0x7f91c4159860 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ca089640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c7e0 tx=0x7f91bc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.325+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00a640 con 0x7f91c4159860 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.326+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc00a7c0 con 0x7f91c4159860 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.326+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4153d50 con 0x7f91c4159860 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.326+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00ab70 con 0x7f91c4159860 2024-09-13T17:17:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.326+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4154310 con 0x7f91c4159860 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.326+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c40cb7c0 con 0x7f91c4159860 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.327+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91bc00acd0 con 0x7f91c4159860 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.327+0000 7f91ba7fc640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 0x7f91a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.328+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f91bc088c50 con 0x7f91c4159860 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.328+0000 7f91c9888640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 0x7f91a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.328+0000 7f91c9888640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 0x7f91a806d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000f60 tx=0x7f91c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.332+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f91bc08e020 con 0x7f91c4159860 2024-09-13T17:17:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.499+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91c4154500 con 0x7f91c4159860 2024-09-13T17:17:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.499+0000 7f91ba7fc640 1 -- 172.21.15.5:0/2421756199 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91bc018020 con 0x7f91c4159860 2024-09-13T17:17:36.502 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 msgr2=0x7f91a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 0x7f91a806d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000f60 tx=0x7f91c0009040 comp rx=0 tx=0).stop 2024-09-13T17:17:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 msgr2=0x7f91c40ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c7e0 tx=0x7f91bc00cca0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 shutdown_connections 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91a806ac00 0x7f91a806d0c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c4159860 0x7f91c40ae6b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91c406e360 0x7f91c4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 --2- 172.21.15.5:0/2421756199 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91c406df80 0x7f91c40a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 >> 172.21.15.5:0/2421756199 conn(0x7f91c4069ed0 msgr2=0x7f91c41585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 shutdown_connections 2024-09-13T17:17:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.502+0000 7f91cbaec640 1 -- 172.21.15.5:0/2421756199 wait complete. 2024-09-13T17:17:36.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.618+0000 7f85c66d7640 1 Processor -- start 2024-09-13T17:17:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.618+0000 7f85c66d7640 1 -- start start 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c66d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85c006b5f0 0x7f85c00ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c66d7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 0x7f85c00ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c66d7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c0071e40 con 0x7f85c015c840 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c66d7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c015cc20 con 0x7f85c006b5f0 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c66d7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c0071880 con 0x7f85c0065f30 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85c006b5f0 0x7f85c00ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85c015c840 0x7f85c006aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48282/0 (socket says 172.21.15.5:48282) 2024-09-13T17:17:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bffff640 1 -- 172.21.15.5:0/559159587 learned_addr learned my addr 172.21.15.5:0/559159587 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85beffd640 1 -- 172.21.15.5:0/559159587 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957068545 0 0) 0x7f85c0071e40 con 0x7f85c015c840 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85beffd640 1 -- 172.21.15.5:0/559159587 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8003520 con 0x7f85c015c840 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c4c74640 1 --2- 172.21.15.5:0/559159587 >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 0x7f85c00ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bf7fe640 1 -- 172.21.15.5:0/559159587 >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 msgr2=0x7f85c00ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bf7fe640 1 --2- 172.21.15.5:0/559159587 >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 0x7f85c00ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bf7fe640 1 -- 172.21.15.5:0/559159587 >> v1:172.21.15.5:6789/0 conn(0x7f85c015c840 legacy=0x7f85c006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85bf7fe640 1 -- 172.21.15.5:0/559159587 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0071b60 con 0x7f85c006b5f0 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.619+0000 7f85c4c74640 1 --2- 172.21.15.5:0/559159587 >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 0x7f85c00ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85bf7fe640 1 --2- 172.21.15.5:0/559159587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c006b5f0 0x7f85c00ae380 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f85c0070ac0 tx=0x7f85b402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707ed4c96b8e5a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85beffd640 1 -- 172.21.15.5:0/559159587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b402add0 con 0x7f85c006b5f0 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85beffd640 1 -- 172.21.15.5:0/559159587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4032440 con 0x7f85c006b5f0 2024-09-13T17:17:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85beffd640 1 -- 172.21.15.5:0/559159587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40327d0 con 0x7f85c006b5f0 2024-09-13T17:17:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85c66d7640 1 -- 172.21.15.5:0/559159587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c006b5f0 msgr2=0x7f85c00ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.620+0000 7f85c66d7640 1 --2- 172.21.15.5:0/559159587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c006b5f0 0x7f85c00ae380 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f85c0070ac0 tx=0x7f85b402a080 comp rx=0 tx=0).stop 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 -- 172.21.15.5:0/559159587 shutdown_connections 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 --2- 172.21.15.5:0/559159587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c006b5f0 0x7f85c00ae380 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 --2- 172.21.15.5:0/559159587 >> v2:172.21.15.179:3300/0 conn(0x7f85c0065f30 0x7f85c00ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 -- 172.21.15.5:0/559159587 >> 172.21.15.5:0/559159587 conn(0x7f85c00cc570 msgr2=0x7f85c0070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 -- 172.21.15.5:0/559159587 shutdown_connections 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.621+0000 7f85c66d7640 1 -- 172.21.15.5:0/559159587 wait complete. 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.622+0000 7f85c66d7640 1 Processor -- start 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.622+0000 7f85c66d7640 1 -- start start 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c0065f30 0x7f85c00c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c006b5f0 0x7f85c01f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01f3110 con 0x7f85c015c840 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c9ac0 con 0x7f85c0065f30 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c66d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c7a40 con 0x7f85c006b5f0 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54504/0 (socket says 172.21.15.5:54504) 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 -- 172.21.15.5:0/248141956 learned_addr learned my addr 172.21.15.5:0/248141956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85bffff640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c0065f30 0x7f85c00c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85bf7fe640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c006b5f0 0x7f85c01f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 -- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c006b5f0 msgr2=0x7f85c01f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c006b5f0 0x7f85c01f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 -- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c0065f30 msgr2=0x7f85c00c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c0065f30 0x7f85c00c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 -- 172.21.15.5:0/248141956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4009400 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.623+0000 7f85c4c74640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f85b800cef0 tx=0x7f85b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.624+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800d840 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.624+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b800d9c0 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.624+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c00c7d20 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.624+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800dd70 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.624+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c00c9370 con 0x7f85c015c840 2024-09-13T17:17:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.625+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00672c0 con 0x7f85c015c840 2024-09-13T17:17:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.625+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b801e3b0 con 0x7f85c015c840 2024-09-13T17:17:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.625+0000 7f85bcff9640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.626+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85b8089ec0 con 0x7f85c015c840 2024-09-13T17:17:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.626+0000 7f85bffff640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.626+0000 7f85bffff640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 0x7f85ac06d0c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85b00011e0 tx=0x7f85b0007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.630+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85b80550d0 con 0x7f85c015c840 2024-09-13T17:17:36.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.803+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85c00c9c30 con 0x7f85c015c840 2024-09-13T17:17:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.804+0000 7f85bcff9640 1 -- 172.21.15.5:0/248141956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85b801a0a0 con 0x7f85c015c840 2024-09-13T17:17:36.806 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 msgr2=0x7f85ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 0x7f85ac06d0c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85b00011e0 tx=0x7f85b0007d30 comp rx=0 tx=0).stop 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 msgr2=0x7f85c00b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f85b800cef0 tx=0x7f85b800a710 comp rx=0 tx=0).stop 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 shutdown_connections 2024-09-13T17:17:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f85ac06ac00 0x7f85ac06d0c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85c015c840 0x7f85c00b25b0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c006b5f0 0x7f85c01f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 --2- 172.21.15.5:0/248141956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c0065f30 0x7f85c00c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 >> 172.21.15.5:0/248141956 conn(0x7f85c00cc570 msgr2=0x7f85c00cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 shutdown_connections 2024-09-13T17:17:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.806+0000 7f85c66d7640 1 -- 172.21.15.5:0/248141956 wait complete. 2024-09-13T17:17:36.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:36.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.920+0000 7fe490868640 1 Processor -- start 2024-09-13T17:17:36.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.920+0000 7fe490868640 1 -- start start 2024-09-13T17:17:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe490868640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe48c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe490868640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0d34d0 con 0x7fe48c15c760 2024-09-13T17:17:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe490868640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0d2950 con 0x7fe48c0d20c0 2024-09-13T17:17:36.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe490868640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0cddb0 con 0x7fe48c0cfd50 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe48a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe48c15c760 0x7fe48c0cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48288/0 (socket says 172.21.15.5:48288) 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.921+0000 7fe48a59c640 1 -- 172.21.15.5:0/1042226091 learned_addr learned my addr 172.21.15.5:0/1042226091 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136723612 0 0) 0x7fe48c0d34d0 con 0x7fe48c15c760 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe489d9b640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe48c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478003520 con 0x7fe48c15c760 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818773514 0 0) 0x7fe478003520 con 0x7fe48c15c760 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 msgr2=0x7fe48c0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe48c0b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 >> v1:172.21.15.179:6789/0 conn(0x7fe48c0d20c0 legacy=0x7fe48c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0d2c30 con 0x7fe48c15c760 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe47c0019f0 con 0x7fe48c15c760 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 >> v1:172.21.15.5:6789/0 conn(0x7fe48c15c760 legacy=0x7fe48c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe478003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe4780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0cddb0 con 0x7fe4780039a0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800bab0 con 0x7fe4780047c0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800bc70 con 0x7fe48c0cfd50 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48a59c640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe478003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe489d9b640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.922+0000 7fe48ad9d640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe4780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 -- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 msgr2=0x7fe4780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe4780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 -- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780047c0 msgr2=0x7fe478004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 -- 172.21.15.5:0/1042226091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478003520 con 0x7fe4780039a0 2024-09-13T17:17:36.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48ad9d640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0cfd50 0x7fe4780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48a59c640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe478003dc0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00a830 tx=0x7fe4780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4767599686b938d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c02ba50 con 0x7fe4780039a0 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c02bbb0 con 0x7fe4780039a0 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.923+0000 7fe48959a640 1 -- 172.21.15.5:0/1042226091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c034470 con 0x7fe4780039a0 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 -- 172.21.15.5:0/1042226091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 msgr2=0x7fe478003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 --2- 172.21.15.5:0/1042226091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe478003dc0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00a830 tx=0x7fe4780057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe48ad9d640 1 -- 172.21.15.5:0/1042226091 reap_dead start 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 -- 172.21.15.5:0/1042226091 shutdown_connections 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 -- 172.21.15.5:0/1042226091 >> 172.21.15.5:0/1042226091 conn(0x7fe48c071a20 msgr2=0x7fe48c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:36.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 -- 172.21.15.5:0/1042226091 shutdown_connections 2024-09-13T17:17:36.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.924+0000 7fe490868640 1 -- 172.21.15.5:0/1042226091 wait complete. 2024-09-13T17:17:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.925+0000 7fe490868640 1 Processor -- start 2024-09-13T17:17:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 -- start start 2024-09-13T17:17:36.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe48c15daa0 0x7fe48c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0c88b0 0x7fe48c0a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0aaae0 con 0x7fe4780039a0 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c8d60 con 0x7fe48c15daa0 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe490868640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c15d680 con 0x7fe48c0c88b0 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe48a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe48a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54524/0 (socket says 172.21.15.5:54524) 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.926+0000 7fe48a59c640 1 -- 172.21.15.5:0/3820189534 learned_addr learned my addr 172.21.15.5:0/3820189534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 -- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0c88b0 msgr2=0x7fe48c0a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0c88b0 0x7fe48c0a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 -- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe48c15daa0 msgr2=0x7fe48c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe489d9b640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe48c15daa0 0x7fe48c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe48c15daa0 0x7fe48c0c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 -- 172.21.15.5:0/3820189534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c15cce0 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe48a59c640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe47c02b430 tx=0x7fe47c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c03b040 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c034470 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c15cfc0 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c034820 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.927+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c15bf90 con 0x7fe4780039a0 2024-09-13T17:17:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.928+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c0d2580 con 0x7fe4780039a0 2024-09-13T17:17:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.929+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe47c031070 con 0x7fe4780039a0 2024-09-13T17:17:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.929+0000 7fe482ffd640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 0x7fe46c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.929+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe47c0a97f0 con 0x7fe4780039a0 2024-09-13T17:17:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.929+0000 7fe489d9b640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 0x7fe46c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.930+0000 7fe489d9b640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 0x7fe46c06d0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0cc3b0 tx=0x7fe474008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:36.933+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe47c074920 con 0x7fe4780039a0 2024-09-13T17:17:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.103+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe48c0d1b00 con 0x7fe4780039a0 2024-09-13T17:17:37.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.103+0000 7fe482ffd640 1 -- 172.21.15.5:0/3820189534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe47c077f40 con 0x7fe4780039a0 2024-09-13T17:17:37.105 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 msgr2=0x7fe46c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 0x7fe46c06d0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0cc3b0 tx=0x7fe474008040 comp rx=0 tx=0).stop 2024-09-13T17:17:37.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 msgr2=0x7fe48c15ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe47c02b430 tx=0x7fe47c001d80 comp rx=0 tx=0).stop 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 shutdown_connections 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe48c0c88b0 0x7fe48c0a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe48c15daa0 0x7fe48c0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe46c06ac00 0x7fe46c06d0c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 --2- 172.21.15.5:0/3820189534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4780039a0 0x7fe48c15ba50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 >> 172.21.15.5:0/3820189534 conn(0x7fe48c071a20 msgr2=0x7fe48c0b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 shutdown_connections 2024-09-13T17:17:37.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.105+0000 7fe490868640 1 -- 172.21.15.5:0/3820189534 wait complete. 2024-09-13T17:17:37.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:17:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.218+0000 7fb17f42b640 1 Processor -- start 2024-09-13T17:17:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.218+0000 7fb17f42b640 1 -- start start 2024-09-13T17:17:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.219+0000 7fb17f42b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.219+0000 7fb17f42b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780b3be0 con 0x7fb1780b19d0 2024-09-13T17:17:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.219+0000 7fb17f42b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17813f740 con 0x7fb1780cc440 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.219+0000 7fb17f42b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17813c8e0 con 0x7fb1780b15f0 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17c9c6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1780b19d0 0x7fb17813ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48298/0 (socket says 172.21.15.5:48298) 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17c9c6640 1 -- 172.21.15.5:0/1564080985 learned_addr learned my addr 172.21.15.5:0/1564080985 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17d1c7640 1 --2- 172.21.15.5:0/1564080985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847536734 0 0) 0x7fb1780b3be0 con 0x7fb1780b19d0 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb160003520 con 0x7fb1780b19d0 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73579082 0 0) 0x7fb17813f740 con 0x7fb1780cc440 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1780b3be0 con 0x7fb1780cc440 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17d1c7640 1 -- 172.21.15.5:0/1564080985 >> v1:172.21.15.179:6789/0 conn(0x7fb1780cc440 legacy=0x7fb1780cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17d1c7640 1 -- 172.21.15.5:0/1564080985 >> v1:172.21.15.5:6789/0 conn(0x7fb1780b19d0 legacy=0x7fb17813ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.220+0000 7fb17d1c7640 1 -- 172.21.15.5:0/1564080985 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178159a80 con 0x7fb1780b15f0 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.221+0000 7fb17d1c7640 1 --2- 172.21.15.5:0/1564080985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17815a560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1700097d0 tx=0x7fb17002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895fd8c641a453b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.221+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170032440 con 0x7fb1780b15f0 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.221+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700325a0 con 0x7fb1780b15f0 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.221+0000 7fb177fff640 1 -- 172.21.15.5:0/1564080985 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170032910 con 0x7fb1780b15f0 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 -- 172.21.15.5:0/1564080985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 msgr2=0x7fb17815a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 --2- 172.21.15.5:0/1564080985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17815a560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1700097d0 tx=0x7fb17002a180 comp rx=0 tx=0).stop 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 -- 172.21.15.5:0/1564080985 shutdown_connections 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 --2- 172.21.15.5:0/1564080985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17815a560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 -- 172.21.15.5:0/1564080985 >> 172.21.15.5:0/1564080985 conn(0x7fb17806a500 msgr2=0x7fb1780b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 -- 172.21.15.5:0/1564080985 shutdown_connections 2024-09-13T17:17:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.222+0000 7fb17f42b640 1 -- 172.21.15.5:0/1564080985 wait complete. 2024-09-13T17:17:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.223+0000 7fb17f42b640 1 Processor -- start 2024-09-13T17:17:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.223+0000 7fb17f42b640 1 -- start start 2024-09-13T17:17:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17813bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1780b19d0 0x7fb1780a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781409c0 con 0x7fb1780cc440 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17813fd40 con 0x7fb1780b19d0 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17f42b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb178140020 con 0x7fb1780b15f0 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54534/0 (socket says 172.21.15.5:54534) 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 -- 172.21.15.5:0/640790629 learned_addr learned my addr 172.21.15.5:0/640790629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d1c7640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17813bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17c9c6640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1780b19d0 0x7fb1780a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 -- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 msgr2=0x7fb17813bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17813bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 -- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1780b19d0 msgr2=0x7fb1780a82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1780b19d0 0x7fb1780a82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 -- 172.21.15.5:0/640790629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009400 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb17d9c8640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c6e0 tx=0x7fb16800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168003b70 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.224+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168003cd0 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.225+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb178140300 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.225+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680052d0 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.225+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17813c2b0 con 0x7fb1780cc440 2024-09-13T17:17:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.226+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb178140b00 con 0x7fb1780cc440 2024-09-13T17:17:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.226+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb168005430 con 0x7fb1780cc440 2024-09-13T17:17:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.227+0000 7fb175ffb640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 0x7fb16406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.227+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1680890e0 con 0x7fb1780cc440 2024-09-13T17:17:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.227+0000 7fb17d1c7640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 0x7fb16406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.227+0000 7fb17d1c7640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 0x7fb16406d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb170034000 tx=0x7fb17002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.231+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb178140b00 con 0x7fb1780cc440 2024-09-13T17:17:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.413+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb178140b00 con 0x7fb1780cc440 2024-09-13T17:17:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.413+0000 7fb175ffb640 1 -- 172.21.15.5:0/640790629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb178140b00 con 0x7fb1780cc440 2024-09-13T17:17:37.416 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:17:37.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 msgr2=0x7fb16406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 0x7fb16406d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb170034000 tx=0x7fb17002e000 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 msgr2=0x7fb178070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c6e0 tx=0x7fb16800cba0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 shutdown_connections 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16406ac00 0x7fb16406d0c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1780cc440 0x7fb178070370 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1780b19d0 0x7fb1780a82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 --2- 172.21.15.5:0/640790629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1780b15f0 0x7fb17813bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 >> 172.21.15.5:0/640790629 conn(0x7fb17806a500 msgr2=0x7fb1780b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 shutdown_connections 2024-09-13T17:17:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.415+0000 7fb17f42b640 1 -- 172.21.15.5:0/640790629 wait complete. 2024-09-13T17:17:37.428 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:17:37.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:37.429 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:17:37.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[46908]: fuse finished with error 0 and tester_r 0 2024-09-13T17:17:37.459 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:37.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:17:37.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:37.547 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:17:37.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.666+0000 7f279acd0640 1 Processor -- start 2024-09-13T17:17:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.666+0000 7f279acd0640 1 -- start start 2024-09-13T17:17:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279acd0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27940b45c0 0x7f27940ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279acd0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279406db50 con 0x7f27940b2450 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279acd0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279406d540 con 0x7f2794145f20 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279acd0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279406ee60 con 0x7f27940b45c0 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279926d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27940b45c0 0x7f27940ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f2793fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27940b2450 0x7f27940b3eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48314/0 (socket says 172.21.15.5:48314) 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f2793fff640 1 -- 172.21.15.5:0/2481117727 learned_addr learned my addr 172.21.15.5:0/2481117727 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279926d640 1 -- 172.21.15.5:0/2481117727 >> v1:172.21.15.179:6789/0 conn(0x7f2794145f20 legacy=0x7f279406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.667+0000 7f279926d640 1 -- 172.21.15.5:0/2481117727 >> v1:172.21.15.5:6789/0 conn(0x7f27940b2450 legacy=0x7f27940b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f279926d640 1 -- 172.21.15.5:0/2481117727 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279406f140 con 0x7f27940b45c0 2024-09-13T17:17:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f27937fe640 1 -- 172.21.15.5:0/2481117727 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637143500 0 0) 0x7f279406db50 con 0x7f27940b2450 2024-09-13T17:17:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f279926d640 1 --2- 172.21.15.5:0/2481117727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b45c0 0x7f27940ac430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f278c0097a0 tx=0x7f278c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563e8e12f0ca298e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f27937fe640 1 -- 172.21.15.5:0/2481117727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c02ae50 con 0x7f27940b45c0 2024-09-13T17:17:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f27937fe640 1 -- 172.21.15.5:0/2481117727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c032440 con 0x7f27940b45c0 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.668+0000 7f27937fe640 1 -- 172.21.15.5:0/2481117727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0327d0 con 0x7f27940b45c0 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 -- 172.21.15.5:0/2481117727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b45c0 msgr2=0x7f27940ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 --2- 172.21.15.5:0/2481117727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b45c0 0x7f27940ac430 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f278c0097a0 tx=0x7f278c02a140 comp rx=0 tx=0).stop 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 -- 172.21.15.5:0/2481117727 shutdown_connections 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 --2- 172.21.15.5:0/2481117727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b45c0 0x7f27940ac430 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 -- 172.21.15.5:0/2481117727 >> 172.21.15.5:0/2481117727 conn(0x7f27940b50e0 msgr2=0x7f2794098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 -- 172.21.15.5:0/2481117727 shutdown_connections 2024-09-13T17:17:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.669+0000 7f279acd0640 1 -- 172.21.15.5:0/2481117727 wait complete. 2024-09-13T17:17:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.670+0000 7f279acd0640 1 Processor -- start 2024-09-13T17:17:37.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.670+0000 7f279acd0640 1 -- start start 2024-09-13T17:17:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27940b45c0 0x7f279413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2794145f20 0x7f279415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279413de50 con 0x7f27940b2450 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279415fbd0 con 0x7f27940b45c0 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279acd0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279413e0a0 con 0x7f2794145f20 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2798a6c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2798a6c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54544/0 (socket says 172.21.15.5:54544) 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2798a6c640 1 -- 172.21.15.5:0/3106076595 learned_addr learned my addr 172.21.15.5:0/3106076595 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2793fff640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27940b45c0 0x7f279413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f279926d640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2794145f20 0x7f279415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2798a6c640 1 -- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2794145f20 msgr2=0x7f279415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.671+0000 7f2798a6c640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2794145f20 0x7f279415ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f2798a6c640 1 -- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27940b45c0 msgr2=0x7f279413ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f2798a6c640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27940b45c0 0x7f279413ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f2798a6c640 1 -- 172.21.15.5:0/3106076595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009400 con 0x7f27940b2450 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f2798a6c640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f278400c7c0 tx=0x7f278400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400aa50 con 0x7f27940b2450 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278400abb0 con 0x7f27940b2450 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279413e380 con 0x7f27940b2450 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784012420 con 0x7f27940b2450 2024-09-13T17:17:37.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.672+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279413e940 con 0x7f27940b2450 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.673+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2794071b30 con 0x7f27940b2450 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.673+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2784012580 con 0x7f27940b2450 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.674+0000 7f27917fa640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 0x7f277406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.674+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2784089460 con 0x7f27940b2450 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.674+0000 7f2793fff640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 0x7f277406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.675+0000 7f2793fff640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 0x7f277406d0c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2794098ac0 tx=0x7f277c007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.678+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2784054500 con 0x7f27940b2450 2024-09-13T17:17:37.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.883+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2794098af0 con 0x7f27940b2450 2024-09-13T17:17:37.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.884+0000 7f27917fa640 1 -- 172.21.15.5:0/3106076595 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f2784057b20 con 0x7f27940b2450 2024-09-13T17:17:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:37.886 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:37.886 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 msgr2=0x7f277406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 0x7f277406d0c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2794098ac0 tx=0x7f277c007c00 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 msgr2=0x7f279415f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f278400c7c0 tx=0x7f278400cc80 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 shutdown_connections 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2794145f20 0x7f279415ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27940b45c0 0x7f279413ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f277406ac00 0x7f277406d0c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 --2- 172.21.15.5:0/3106076595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27940b2450 0x7f279415f690 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 >> 172.21.15.5:0/3106076595 conn(0x7f27940b50e0 msgr2=0x7f279406dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 shutdown_connections 2024-09-13T17:17:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:37.886+0000 7f279acd0640 1 -- 172.21.15.5:0/3106076595 wait complete. 2024-09-13T17:17:37.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-13T17:17:38.014 INFO:teuthology.orchestra.run.smithi005.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":28,"msgr_send_messages":28,"msgr_recv_bytes":8029,"msgr_send_bytes":14376,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.011812416,"msgr_running_send_time":0.000435241,"msgr_running_recv_time":0.009044420,"msgr_running_fast_dispatch_time":0.000466936,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.191649715,"avgtime":0.007098137},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":78,"msgr_send_messages":70,"msgr_recv_bytes":116681,"msgr_send_bytes":37140,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.011016106,"msgr_running_send_time":0.001829600,"msgr_running_recv_time":0.014001268,"msgr_running_fast_dispatch_time":0.000565769,"msgr_send_messages_queue_lat":{"avgcount":70,"sum":0.070751553,"avgtime":0.001010736},"msgr_handle_ack_lat":{"avgcount":19,"sum":0.000002858,"avgtime":0.000000150},"msgr_recv_encrypted_bytes":111040,"msgr_send_encrypted_bytes":12592},"AsyncMessenger::Worker-2":{"msgr_recv_messages":32,"msgr_send_messages":27,"msgr_recv_bytes":10155,"msgr_send_bytes":109073,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.005220499,"msgr_running_send_time":0.000834080,"msgr_running_recv_time":0.003296744,"msgr_running_fast_dispatch_time":0.000900499,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.155475501,"avgtime":0.006219020},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000003027,"avgtime":0.000000137},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":96336},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":55,"sum":0.002019671,"avgtime":0.000036721}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010862,"avgtime":0.000005431}},"mds":{"request":3,"reply":3,"reply_latency":{"avgcount":3,"sum":0.000771235,"avgtime":0.000257078},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":5,"traverse_hit":5,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":6,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197177,"rdpos":0,"jlat":{"avgcount":5,"sum":0.009386043,"avgtime":0.001877208},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":40320,"heap":207200},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":8,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":2,"sum":0.000526309,"avgtime":0.000263154},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000244926,"avgtime":0.000244926},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":2,"average_load":1,"avg_session_uptime":12,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":221427,"buffer_anon_items":63,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":14083,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.731986017,"avgtime":0.016636045},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":83,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":134,"get_sum":118490,"get_or_fail_fail":0,"get_or_fail_success":134,"take":0,"take_sum":0,"put":134,"put_sum":118490,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":14083,"put":44,"put_sum":14083,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563ffc3500a0":{"val":0,"max":3758096384,"get_started":0,"get":6,"get_sum":2873,"get_or_fail_fail":0,"get_or_fail_success":6,"take":0,"take_sum":0,"put":5,"put_sum":2873,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T17:17:38.015 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 8029, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.000466936, "msgr_running_recv_time": 0.00904442, "msgr_running_send_time": 0.000435241, "msgr_running_total_time": 0.011812416, "msgr_send_bytes": 14376, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.007098137, "sum": 0.191649715 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 19, "avgtime": 1.5e-07, "sum": 2.858e-06 }, "msgr_recv_bytes": 116681, "msgr_recv_encrypted_bytes": 111040, "msgr_recv_messages": 78, "msgr_running_fast_dispatch_time": 0.000565769, "msgr_running_recv_time": 0.014001268, "msgr_running_send_time": 0.0018296, "msgr_running_total_time": 0.011016106, "msgr_send_bytes": 37140, "msgr_send_encrypted_bytes": 12592, "msgr_send_messages": 70, "msgr_send_messages_queue_lat": { "avgcount": 70, "avgtime": 0.001010736, "sum": 0.070751553 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 1.37e-07, "sum": 3.027e-06 }, "msgr_recv_bytes": 10155, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 32, "msgr_running_fast_dispatch_time": 0.000900499, "msgr_running_recv_time": 0.003296744, "msgr_running_send_time": 0.00083408, "msgr_running_total_time": 0.005220499, "msgr_send_bytes": 109073, "msgr_send_encrypted_bytes": 96336, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.00621902, "sum": 0.155475501 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 55, "avgtime": 3.6721e-05, "sum": 0.002019671 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.431e-06, "sum": 1.0862e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 3, "reply_latency": { "avgcount": 3, "avgtime": 0.000257078, "sum": 0.000771235 }, "request": 3, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 6, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001877208, "sum": 0.009386043 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197177 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 40320 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 8, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 2, "avgtime": 0.000263154, "sum": 0.000526309 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000244926, "sum": 0.000244926 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 12, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 2 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 221427, "buffer_anon_items": 63, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 83, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.016636045, "sum": 0.731986017 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 14083, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 134, "get_or_fail_fail": 0, "get_or_fail_success": 134, "get_started": 0, "get_sum": 118490, "max": 104857600, "put": 134, "put_sum": 118490, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 14083, "take": 44, "take_sum": 14083, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563ffc3500a0": { "get": 6, "get_or_fail_fail": 0, "get_or_fail_success": 6, "get_started": 0, "get_sum": 2873, "max": 3758096384, "put": 5, "put_sum": 2873, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T17:17:38.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 session ls 2024-09-13T17:17:38.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.117+0000 7f1607711640 1 Processor -- start 2024-09-13T17:17:38.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.118+0000 7f1607711640 1 -- start start 2024-09-13T17:17:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.118+0000 7f1607711640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 0x7f16000cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.118+0000 7f1607711640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000b1f20 con 0x7f16000d20c0 2024-09-13T17:17:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.118+0000 7f1607711640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000d34d0 con 0x7f16000d1b00 2024-09-13T17:17:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.118+0000 7f1607711640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16000cddb0 con 0x7f160015c760 2024-09-13T17:17:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f1604cac640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f16000d20c0 0x7f16000b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48318/0 (socket says 172.21.15.5:48318) 2024-09-13T17:17:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f1604cac640 1 -- 172.21.15.5:0/2104904789 learned_addr learned my addr 172.21.15.5:0/2104904789 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f16054ad640 1 --2- 172.21.15.5:0/2104904789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 0x7f16000cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815947071 0 0) 0x7f16000b1f20 con 0x7f16000d20c0 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ec003520 con 0x7f16000d20c0 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f16054ad640 1 -- 172.21.15.5:0/2104904789 >> v1:172.21.15.179:6789/0 conn(0x7f16000d1b00 legacy=0x7f16000b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517786246 0 0) 0x7f16000d34d0 con 0x7f16000d1b00 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f16054ad640 1 -- 172.21.15.5:0/2104904789 >> v1:172.21.15.5:6789/0 conn(0x7f16000d20c0 legacy=0x7f16000b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.119+0000 7f16054ad640 1 -- 172.21.15.5:0/2104904789 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000d2950 con 0x7f160015c760 2024-09-13T17:17:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.120+0000 7f16054ad640 1 --2- 172.21.15.5:0/2104904789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 0x7f16000cf640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0097d0 tx=0x7f15fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98178b9e036df3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.120+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc032440 con 0x7f160015c760 2024-09-13T17:17:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.120+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0325a0 con 0x7f160015c760 2024-09-13T17:17:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.120+0000 7f15f7fff640 1 -- 172.21.15.5:0/2104904789 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc032910 con 0x7f160015c760 2024-09-13T17:17:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 -- 172.21.15.5:0/2104904789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 msgr2=0x7f16000cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 --2- 172.21.15.5:0/2104904789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 0x7f16000cf640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0097d0 tx=0x7f15fc02a180 comp rx=0 tx=0).stop 2024-09-13T17:17:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 -- 172.21.15.5:0/2104904789 shutdown_connections 2024-09-13T17:17:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 --2- 172.21.15.5:0/2104904789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f160015c760 0x7f16000cf640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 -- 172.21.15.5:0/2104904789 >> 172.21.15.5:0/2104904789 conn(0x7f1600071a20 msgr2=0x7f1600071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 -- 172.21.15.5:0/2104904789 shutdown_connections 2024-09-13T17:17:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.121+0000 7f1607711640 1 -- 172.21.15.5:0/2104904789 wait complete. 2024-09-13T17:17:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.122+0000 7f1607711640 1 Processor -- start 2024-09-13T17:17:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.122+0000 7f1607711640 1 -- start start 2024-09-13T17:17:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16000d1b00 0x7f160015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16000d20c0 0x7f160015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16000c61a0 con 0x7f160015c760 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160015d080 con 0x7f16000d20c0 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1607711640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16001f2f80 con 0x7f16000d1b00 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54554/0 (socket says 172.21.15.5:54554) 2024-09-13T17:17:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 -- 172.21.15.5:0/2132400108 learned_addr learned my addr 172.21.15.5:0/2132400108 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f16054ad640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16000d1b00 0x7f160015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1604cac640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16000d20c0 0x7f160015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 -- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16000d1b00 msgr2=0x7f160015f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16000d1b00 0x7f160015f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 -- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16000d20c0 msgr2=0x7f160015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16000d20c0 0x7f160015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.123+0000 7f1605cae640 1 -- 172.21.15.5:0/2132400108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009400 con 0x7f160015c760 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f1605cae640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c780 tx=0x7f15f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f15f5ffb640 1 -- 172.21.15.5:0/2132400108 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003da0 con 0x7f160015c760 2024-09-13T17:17:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f15f5ffb640 1 -- 172.21.15.5:0/2132400108 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f800ce30 con 0x7f160015c760 2024-09-13T17:17:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f15f5ffb640 1 -- 172.21.15.5:0/2132400108 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80052b0 con 0x7f160015c760 2024-09-13T17:17:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16001f3260 con 0x7f160015c760 2024-09-13T17:17:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.124+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16001f3b00 con 0x7f160015c760 2024-09-13T17:17:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.125+0000 7f15f5ffb640 1 -- 172.21.15.5:0/2132400108 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15f8005410 con 0x7f160015c760 2024-09-13T17:17:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.126+0000 7f15f5ffb640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 0x7f15e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.126+0000 7f15f5ffb640 1 -- 172.21.15.5:0/2132400108 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15f80890e0 con 0x7f160015c760 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.126+0000 7f16054ad640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 0x7f15e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.127+0000 7f16054ad640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 0x7f15e406d0c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f15fc034000 tx=0x7f15fc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.127+0000 7f160a434740 1 Processor -- start 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.127+0000 7f160a434740 1 -- start start 2024-09-13T17:17:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab70eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab630cc0 con 0x5575ab6ed5d0 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab62e450 con 0x5575ab70e5b0 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ab629d40 con 0x5575ab70de70 2024-09-13T17:17:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54564/0 (socket says 172.21.15.5:54564) 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 -- 172.21.15.5:0/2863852724 learned_addr learned my addr 172.21.15.5:0/2863852724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1604cac640 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab70eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f16054ad640 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 -- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 msgr2=0x5575ab70eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab70eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 -- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 msgr2=0x5575ab70e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 -- 172.21.15.5:0/2863852724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ab5f1620 con 0x5575ab6ed5d0 2024-09-13T17:17:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f1605cae640 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f15f8002230 tx=0x7f15f8057910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55300a3c352148f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f15e2ffd640 1 -- 172.21.15.5:0/2863852724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8060230 con 0x5575ab6ed5d0 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f15e2ffd640 1 -- 172.21.15.5:0/2863852724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8056290 con 0x5575ab6ed5d0 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.128+0000 7f15e2ffd640 1 -- 172.21.15.5:0/2863852724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8054600 con 0x5575ab6ed5d0 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 -- 172.21.15.5:0/2863852724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 msgr2=0x5575ab6eda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f15f8002230 tx=0x7f15f8057910 comp rx=0 tx=0).stop 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 -- 172.21.15.5:0/2863852724 shutdown_connections 2024-09-13T17:17:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6ed5d0 0x5575ab6eda50 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab70eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 --2- 172.21.15.5:0/2863852724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 -- 172.21.15.5:0/2863852724 >> 172.21.15.5:0/2863852724 conn(0x5575ab6c4910 msgr2=0x5575ab70ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 -- 172.21.15.5:0/2863852724 shutdown_connections 2024-09-13T17:17:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.129+0000 7f160a434740 1 -- 172.21.15.5:0/2863852724 wait complete. 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.130+0000 7f160a434740 1 -- start start 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.130+0000 7f160a434740 1 Processor -- start 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab704f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab6ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5e8180 con 0x5575ab6c7f60 2024-09-13T17:17:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab302430 con 0x5575ab70e5b0 2024-09-13T17:17:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ab5ad5e0 con 0x5575ab70de70 2024-09-13T17:17:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 10 client.0 _ll_register_callbacks cb 0x5575ab619aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54580/0 (socket says 172.21.15.5:54580) 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 -- 172.21.15.5:0/1414481028 learned_addr learned my addr 172.21.15.5:0/1414481028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f16054ad640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab704f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1604cac640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab6ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 -- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 msgr2=0x5575ab704f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab704f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 -- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 msgr2=0x5575ab6ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab6ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 -- 172.21.15.5:0/1414481028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16001f3b00 con 0x5575ab6c7f60 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f1605cae640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f15f8057e30 tx=0x7f15f8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5f4bea776656a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f15dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:17:38.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8087230 con 0x5575ab6c7f60 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15f8060230 con 0x5575ab6c7f60 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575ab653b80 con 0x5575ab6c7f60 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f80573e0 con 0x5575ab6c7f60 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 10 client.7551 fetch_fsmap learned FSMap version 36 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.131+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5575ab6283c0 con 0x5575ab6c7f60 2024-09-13T17:17:38.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5575ab653b80 con 0x5575ab6c7f60 2024-09-13T17:17:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f15f8019020 con 0x5575ab6c7f60 2024-09-13T17:17:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 10 client.7551 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:17:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 10 client.7551 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-13T17:17:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 20 client.7551 populate_metadata read hostname 'smithi005' 2024-09-13T17:17:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab6f15c0 0x5575ab6f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 4 client.7551 mds_command: new command op to 7212 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 --> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575ab61c1f0 con 0x5575ab6f15c0 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f16054ad640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab6f15c0 0x5575ab6f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f16054ad640 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab6f15c0 0x5575ab6f19d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9967ba42703351 server_cookie=d6dc0fbdb7ae33ce in_seq=0 out_seq=0 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.132+0000 7f15dbfff640 10 client.7551 ms_handle_connect on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f15dbfff640 1 -- 172.21.15.5:0/1414481028 <== mds.0 v2:172.21.15.5:6834/1039859962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5575ab61c1f0 con 0x5575ab6f15c0 2024-09-13T17:17:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f15dbfff640 10 client.7551 handle_command_reply: tid=0 2024-09-13T17:17:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 client.7551 shutdown 2024-09-13T17:17:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 msgr2=0x5575ab6c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f15f8057e30 tx=0x7f15f8001250 comp rx=0 tx=0).stop 2024-09-13T17:17:38.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 shutdown_connections 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab6f15c0 0x5575ab6f19d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab6c7f60 0x5575ab6c83e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab6ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f15dbfff640 0 client.7551 ms_handle_reset on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 --2- 172.21.15.5:0/1414481028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab70de70 0x5575ab704f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 >> 172.21.15.5:0/1414481028 conn(0x5575ab6ed5d0 msgr2=0x5575ab70ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 shutdown_connections 2024-09-13T17:17:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 1 -- 172.21.15.5:0/1414481028 wait complete. 2024-09-13T17:17:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.133+0000 7f160a434740 20 client.7551 trim_cache size 0 max 16384 2024-09-13T17:17:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.148+0000 7f160a434740 1 Processor -- start 2024-09-13T17:17:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.148+0000 7f160a434740 1 -- start start 2024-09-13T17:17:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab70d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab6be9a0 con 0x5575ab70de70 2024-09-13T17:17:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab6c4180 con 0x5575ab70e5b0 2024-09-13T17:17:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ab6eb370 con 0x5575ab6c7f60 2024-09-13T17:17:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54592/0 (socket says 172.21.15.5:54592) 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 -- 172.21.15.5:0/2459075998 learned_addr learned my addr 172.21.15.5:0/2459075998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f16054ad640 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab70d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 -- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 msgr2=0x5575ab70d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1605cae640 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab70d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 -- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 msgr2=0x5575ab70e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.149+0000 7f1604cac640 1 -- 172.21.15.5:0/2459075998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ab65d450 con 0x5575ab70de70 2024-09-13T17:17:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f1604cac640 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f16000cee90 tx=0x7f15f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66382dec4bbf805 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f15e37fe640 1 -- 172.21.15.5:0/2459075998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0015410 con 0x5575ab70de70 2024-09-13T17:17:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f15e37fe640 1 -- 172.21.15.5:0/2459075998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f0015570 con 0x5575ab70de70 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f15e37fe640 1 -- 172.21.15.5:0/2459075998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0015920 con 0x5575ab70de70 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 -- 172.21.15.5:0/2459075998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 msgr2=0x5575ab704eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f16000cee90 tx=0x7f15f0000bc0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 -- 172.21.15.5:0/2459075998 shutdown_connections 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70e5b0 0x5575ab70e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70de70 0x5575ab704eb0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 --2- 172.21.15.5:0/2459075998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab70d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 -- 172.21.15.5:0/2459075998 >> 172.21.15.5:0/2459075998 conn(0x5575ab6ed5d0 msgr2=0x5575ab70ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 -- 172.21.15.5:0/2459075998 shutdown_connections 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.150+0000 7f160a434740 1 -- 172.21.15.5:0/2459075998 wait complete. 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.151+0000 7f160a434740 1 -- start start 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.151+0000 7f160a434740 1 Processor -- start 2024-09-13T17:17:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab6ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70de70 0x5575ab76c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab709960 con 0x5575ab70e5b0 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ab7263f0 con 0x5575ab70de70 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ab726920 con 0x5575ab6c7f60 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f160a434740 10 client.0 _ll_register_callbacks cb 0x7f15f8001720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54602/0 (socket says 172.21.15.5:54602) 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 -- 172.21.15.5:0/1954132846 learned_addr learned my addr 172.21.15.5:0/1954132846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f16054ad640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab6ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1604cac640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70de70 0x5575ab76c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 -- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 msgr2=0x5575ab6ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab6ee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 -- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70de70 msgr2=0x5575ab76c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70de70 0x5575ab76c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 -- 172.21.15.5:0/1954132846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec003520 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f1605cae640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f15f8057e80 tx=0x7f15f806c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adf80b7837a6ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f15dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.152+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f805ffa0 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15f8060230 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15f8056290 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f805cb90 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 10 client.7557 fetch_fsmap learned FSMap version 36 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5575ab5ca770 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8056290 con 0x5575ab70e5b0 2024-09-13T17:17:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f15f8019040 con 0x5575ab70e5b0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 10 client.7557 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 10 client.7557 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 20 client.7557 populate_metadata read hostname 'smithi005' 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab76cbc0 0x5575ab7088c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 4 client.7557 mds_command: new command op to 7212 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 --> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x5575ab31d4e0 con 0x5575ab76cbc0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f16054ad640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab76cbc0 0x5575ab7088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 10 client.7557 ms_handle_connect on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f16054ad640 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab76cbc0 0x5575ab7088c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca08d06969359ab9 server_cookie=81debcdc8509bdff in_seq=0 out_seq=0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.153+0000 7f15dbfff640 1 -- 172.21.15.5:0/1954132846 <== mds.0 v2:172.21.15.5:6834/1039859962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575ab31d4e0 con 0x5575ab76cbc0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f15dbfff640 10 client.7557 handle_command_reply: tid=0 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 client.7557 shutdown 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 msgr2=0x5575ab76c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f15f8057e80 tx=0x7f15f806c000 comp rx=0 tx=0).stop 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 shutdown_connections 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:6834/1039859962,v1:172.21.15.5:6835/1039859962] conn(0x5575ab76cbc0 0x5575ab7088c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5575ab70e5b0 0x5575ab76c540 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575ab70de70 0x5575ab76c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f15dbfff640 0 client.7557 ms_handle_reset on v2:172.21.15.5:6834/1039859962 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 --2- 172.21.15.5:0/1954132846 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575ab6c7f60 0x5575ab6ee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 >> 172.21.15.5:0/1954132846 conn(0x5575ab6ed5d0 msgr2=0x5575ab6c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 shutdown_connections 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 1 -- 172.21.15.5:0/1954132846 wait complete. 2024-09-13T17:17:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f160a434740 20 client.7557 trim_cache size 0 max 16384 2024-09-13T17:17:38.187 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 msgr2=0x7f15e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 0x7f15e406d0c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f15fc034000 tx=0x7f15fc02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 msgr2=0x7f160015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f15f800c780 tx=0x7f15f800cc40 comp rx=0 tx=0).stop 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 shutdown_connections 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f15e406ac00 0x7f15e406d0c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160015c760 0x7f160015d750 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16000d20c0 0x7f160015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 --2- 172.21.15.5:0/2132400108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16000d1b00 0x7f160015f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.154+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 >> 172.21.15.5:0/2132400108 conn(0x7f1600071a20 msgr2=0x7f16000b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.155+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 shutdown_connections 2024-09-13T17:17:38.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.155+0000 7f1607711640 1 -- 172.21.15.5:0/2132400108 wait complete. 2024-09-13T17:17:38.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-13T17:17:38.306 INFO:teuthology.orchestra.run.smithi005.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":28,"msgr_send_messages":28,"msgr_recv_bytes":8029,"msgr_send_bytes":14376,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.011917703,"msgr_running_send_time":0.000435241,"msgr_running_recv_time":0.009044420,"msgr_running_fast_dispatch_time":0.000466936,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.191649715,"avgtime":0.007098137},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":80,"msgr_send_messages":72,"msgr_recv_bytes":116971,"msgr_send_bytes":56410,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.011701518,"msgr_running_send_time":0.001901455,"msgr_running_recv_time":0.014547658,"msgr_running_fast_dispatch_time":0.000565769,"msgr_send_messages_queue_lat":{"avgcount":72,"sum":0.070773181,"avgtime":0.000982960},"msgr_handle_ack_lat":{"avgcount":21,"sum":0.000003053,"avgtime":0.000000145},"msgr_recv_encrypted_bytes":111040,"msgr_send_encrypted_bytes":12592},"AsyncMessenger::Worker-2":{"msgr_recv_messages":32,"msgr_send_messages":27,"msgr_recv_bytes":10155,"msgr_send_bytes":109073,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.005220499,"msgr_running_send_time":0.000834080,"msgr_running_recv_time":0.003296744,"msgr_running_fast_dispatch_time":0.000900499,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.155475501,"avgtime":0.006219020},"msgr_handle_ack_lat":{"avgcount":22,"sum":0.000003027,"avgtime":0.000000137},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":96336},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":55,"sum":0.002019671,"avgtime":0.000036721}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000010862,"avgtime":0.000005431}},"mds":{"request":3,"reply":3,"reply_latency":{"avgcount":3,"sum":0.000771235,"avgtime":0.000257078},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":5,"traverse_hit":5,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":6,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197177,"rdpos":0,"jlat":{"avgcount":5,"sum":0.009386043,"avgtime":0.001877208},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":40320,"heap":207200},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":8,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":2,"sum":0.000526309,"avgtime":0.000263154},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000244926,"avgtime":0.000244926},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":2,"average_load":1,"avg_session_uptime":12,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":221427,"buffer_anon_items":63,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52088,"mds_co_items":212,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":14083,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.731986017,"avgtime":0.016636045},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":83,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":136,"get_sum":118600,"get_or_fail_fail":0,"get_or_fail_success":136,"take":0,"take_sum":0,"put":136,"put_sum":118600,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":14083,"put":44,"put_sum":14083,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563ffc3500a0":{"val":0,"max":3758096384,"get_started":0,"get":6,"get_sum":2873,"get_or_fail_fail":0,"get_or_fail_success":6,"take":0,"take_sum":0,"put":5,"put_sum":2873,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-13T17:17:38.308 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 8029, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.000466936, "msgr_running_recv_time": 0.00904442, "msgr_running_send_time": 0.000435241, "msgr_running_total_time": 0.011917703, "msgr_send_bytes": 14376, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.007098137, "sum": 0.191649715 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 21, "avgtime": 1.45e-07, "sum": 3.053e-06 }, "msgr_recv_bytes": 116971, "msgr_recv_encrypted_bytes": 111040, "msgr_recv_messages": 80, "msgr_running_fast_dispatch_time": 0.000565769, "msgr_running_recv_time": 0.014547658, "msgr_running_send_time": 0.001901455, "msgr_running_total_time": 0.011701518, "msgr_send_bytes": 56410, "msgr_send_encrypted_bytes": 12592, "msgr_send_messages": 72, "msgr_send_messages_queue_lat": { "avgcount": 72, "avgtime": 0.00098296, "sum": 0.070773181 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 22, "avgtime": 1.37e-07, "sum": 3.027e-06 }, "msgr_recv_bytes": 10155, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 32, "msgr_running_fast_dispatch_time": 0.000900499, "msgr_running_recv_time": 0.003296744, "msgr_running_send_time": 0.00083408, "msgr_running_total_time": 0.005220499, "msgr_send_bytes": 109073, "msgr_send_encrypted_bytes": 96336, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.00621902, "sum": 0.155475501 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 55, "avgtime": 3.6721e-05, "sum": 0.002019671 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 5.431e-06, "sum": 1.0862e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 3, "reply_latency": { "avgcount": 3, "avgtime": 0.000257078, "sum": 0.000771235 }, "request": 3, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 6, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001877208, "sum": 0.009386043 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197177 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 40320 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 8, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 2, "avgtime": 0.000263154, "sum": 0.000526309 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000244926, "sum": 0.000244926 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 12, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 2 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 221427, "buffer_anon_items": 63, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52088, "mds_co_items": 212, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 83, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.016636045, "sum": 0.731986017 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 14083, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 136, "get_or_fail_fail": 0, "get_or_fail_success": 136, "get_started": 0, "get_sum": 118600, "max": 104857600, "put": 136, "put_sum": 118600, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 14083, "take": 44, "take_sum": 14083, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563ffc3500a0": { "get": 6, "get_or_fail_fail": 0, "get_or_fail_success": 6, "get_started": 0, "get_sum": 2873, "max": 3758096384, "put": 5, "put_sum": 2873, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-13T17:17:38.308 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T17:17:38.308 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:17:38.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:38.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:38.391 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:17:38.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:38.391 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:38.407 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:38.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:17:38.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:38.408 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:17:38.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:38.464 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T17:17:38.464 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:38.464 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:38.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:38.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:17:38.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:38.483 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:17:38.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:38.541 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T17:17:38.542 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:38.542 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:38.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:38.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:17:38.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:38.558 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:17:38.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:17:38.615 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:38.615 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:38.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:38.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:17:38.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:17:38.634 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:17:38.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:17:38.692 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:17:38.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.793+0000 7fb8aa2d7640 1 Processor -- start 2024-09-13T17:17:38.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.793+0000 7fb8aa2d7640 1 -- start start 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8aa2d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a4158c60 0x7fb8a40703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8aa2d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 0x7fb8a406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8aa2d7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cd260 con 0x7fb8a406dd00 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8aa2d7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a4070d60 con 0x7fb8a4158c60 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8aa2d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cd6f0 con 0x7fb8a4070920 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a8874640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb8a406dd00 0x7fb8a406c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48320/0 (socket says 172.21.15.5:48320) 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a4158c60 0x7fb8a40703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a8874640 1 -- 172.21.15.5:0/2223087100 learned_addr learned my addr 172.21.15.5:0/2223087100 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a37fe640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 0x7fb8a406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a3fff640 1 -- 172.21.15.5:0/2223087100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 msgr2=0x7fb8a406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 0x7fb8a406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a3fff640 1 -- 172.21.15.5:0/2223087100 >> v1:172.21.15.5:6789/0 conn(0x7fb8a406dd00 legacy=0x7fb8a406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a3fff640 1 -- 172.21.15.5:0/2223087100 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40cc650 con 0x7fb8a4158c60 2024-09-13T17:17:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a2ffd640 1 -- 172.21.15.5:0/2223087100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265996399 0 0) 0x7fb8a40cd260 con 0x7fb8a406dd00 2024-09-13T17:17:38.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.794+0000 7fb8a37fe640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 0x7fb8a406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.795+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4158c60 0x7fb8a40703e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097a0 tx=0x7fb89402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f301a48495ad2733 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.795+0000 7fb8a2ffd640 1 -- 172.21.15.5:0/2223087100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894032440 con 0x7fb8a4158c60 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.795+0000 7fb8a2ffd640 1 -- 172.21.15.5:0/2223087100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940325a0 con 0x7fb8a4158c60 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.795+0000 7fb8a2ffd640 1 -- 172.21.15.5:0/2223087100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894032930 con 0x7fb8a4158c60 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/2223087100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4158c60 msgr2=0x7fb8a40703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4158c60 0x7fb8a40703e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097a0 tx=0x7fb89402a180 comp rx=0 tx=0).stop 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/2223087100 shutdown_connections 2024-09-13T17:17:38.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a4070920 0x7fb8a406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/2223087100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4158c60 0x7fb8a40703e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/2223087100 >> 172.21.15.5:0/2223087100 conn(0x7fb8a4066200 msgr2=0x7fb8a4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/2223087100 shutdown_connections 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.796+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/2223087100 wait complete. 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.797+0000 7fb8aa2d7640 1 Processor -- start 2024-09-13T17:17:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.797+0000 7fb8aa2d7640 1 -- start start 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a406dd00 0x7fb8a414a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a4158c60 0x7fb8a414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4148450 con 0x7fb8a4070920 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a414f5a0 con 0x7fb8a4158c60 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8aa2d7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a414ac20 con 0x7fb8a406dd00 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54618/0 (socket says 172.21.15.5:54618) 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 -- 172.21.15.5:0/4191697839 learned_addr learned my addr 172.21.15.5:0/4191697839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a406dd00 0x7fb8a414a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 -- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a406dd00 msgr2=0x7fb8a414a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a406dd00 0x7fb8a414a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 -- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a4158c60 msgr2=0x7fb8a414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a4158c60 0x7fb8a414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 -- 172.21.15.5:0/4191697839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009400 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.798+0000 7fb8a37fe640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c7f0 tx=0x7fb89800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.799+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800cea0 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.799+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb898004220 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.799+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a414a660 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.799+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898007830 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.799+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a414f840 con 0x7fb8a4070920 2024-09-13T17:17:38.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.800+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40672f0 con 0x7fb8a4070920 2024-09-13T17:17:38.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.800+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb898007990 con 0x7fb8a4070920 2024-09-13T17:17:38.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.801+0000 7fb8a0ff9640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 0x7fb89006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:38.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.801+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8980892d0 con 0x7fb8a4070920 2024-09-13T17:17:38.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.801+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 0x7fb89006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.802+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 0x7fb89006d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb894034000 tx=0x7fb89402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:38.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:38.805+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb898054370 con 0x7fb8a4070920 2024-09-13T17:17:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.010+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8a414f400 con 0x7fb8a4070920 2024-09-13T17:17:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.011+0000 7fb8a0ff9640 1 -- 172.21.15.5:0/4191697839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7fb8a414f400 con 0x7fb8a4070920 2024-09-13T17:17:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:39.013 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 msgr2=0x7fb89006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 0x7fb89006d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb894034000 tx=0x7fb89402e000 comp rx=0 tx=0).stop 2024-09-13T17:17:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 msgr2=0x7fb8a4147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c7f0 tx=0x7fb89800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 shutdown_connections 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a4158c60 0x7fb8a414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb89006ac00 0x7fb89006d0c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4070920 0x7fb8a4147f10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 --2- 172.21.15.5:0/4191697839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8a406dd00 0x7fb8a414a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 >> 172.21.15.5:0/4191697839 conn(0x7fb8a4066200 msgr2=0x7fb8a415bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 shutdown_connections 2024-09-13T17:17:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.013+0000 7fb8aa2d7640 1 -- 172.21.15.5:0/4191697839 wait complete. 2024-09-13T17:17:39.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.126+0000 7fb630ad7640 1 Processor -- start 2024-09-13T17:17:39.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.126+0000 7fb630ad7640 1 -- start start 2024-09-13T17:17:39.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb630ad7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb62c15a880 0x7fb62c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb630ad7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb62c0cb6c0 0x7fb62c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb630ad7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0b2180 con 0x7fb62c15a4a0 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb630ad7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0cdab0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb630ad7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0b2420 con 0x7fb62c15a880 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb62ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb62c0cb6c0 0x7fb62c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb62ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb62c0cb6c0 0x7fb62c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54630/0 (socket says 172.21.15.5:54630) 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.127+0000 7fb62ad9d640 1 -- 172.21.15.5:0/3103936833 learned_addr learned my addr 172.21.15.5:0/3103936833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb629d9b640 1 --2- 172.21.15.5:0/3103936833 >> v2:172.21.15.179:3300/0 conn(0x7fb62c15a880 0x7fb62c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62ad9d640 1 -- 172.21.15.5:0/3103936833 >> v2:172.21.15.179:3300/0 conn(0x7fb62c15a880 msgr2=0x7fb62c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62ad9d640 1 --2- 172.21.15.5:0/3103936833 >> v2:172.21.15.179:3300/0 conn(0x7fb62c15a880 0x7fb62c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62ad9d640 1 -- 172.21.15.5:0/3103936833 >> v1:172.21.15.179:6789/0 conn(0x7fb62c15a4a0 legacy=0x7fb62c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62ad9d640 1 -- 172.21.15.5:0/3103936833 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0b2700 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62ad9d640 1 --2- 172.21.15.5:0/3103936833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c0cd570 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb624009870 tx=0x7fb62402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3830f6bf500e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.128+0000 7fb62959a640 1 -- 172.21.15.5:0/3103936833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624032440 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb62959a640 1 -- 172.21.15.5:0/3103936833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240325a0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb62959a640 1 -- 172.21.15.5:0/3103936833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624032930 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 -- 172.21.15.5:0/3103936833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 msgr2=0x7fb62c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 --2- 172.21.15.5:0/3103936833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c0cd570 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb624009870 tx=0x7fb62402a270 comp rx=0 tx=0).stop 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 -- 172.21.15.5:0/3103936833 shutdown_connections 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 --2- 172.21.15.5:0/3103936833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c0cd570 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 --2- 172.21.15.5:0/3103936833 >> v2:172.21.15.179:3300/0 conn(0x7fb62c15a880 0x7fb62c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 -- 172.21.15.5:0/3103936833 >> 172.21.15.5:0/3103936833 conn(0x7fb62c066200 msgr2=0x7fb62c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 -- 172.21.15.5:0/3103936833 shutdown_connections 2024-09-13T17:17:39.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.129+0000 7fb630ad7640 1 -- 172.21.15.5:0/3103936833 wait complete. 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.130+0000 7fb630ad7640 1 Processor -- start 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 -- start start 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb62c15a4a0 0x7fb62c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 0x7fb62c14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c14ce50 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c153550 con 0x7fb62c15a880 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb630ad7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1505b0 con 0x7fb62c15a4a0 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb62a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb62a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54646/0 (socket says 172.21.15.5:54646) 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.131+0000 7fb62a59c640 1 -- 172.21.15.5:0/415584342 learned_addr learned my addr 172.21.15.5:0/415584342 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:39.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62ad9d640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 0x7fb62c14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb629d9b640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb62c15a4a0 0x7fb62c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 -- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb62c15a4a0 msgr2=0x7fb62c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb62c15a4a0 0x7fb62c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 -- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 msgr2=0x7fb62c14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 0x7fb62c14bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 -- 172.21.15.5:0/415584342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240094d0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62ad9d640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 0x7fb62c14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb62a59c640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c7f0 tx=0x7fb61c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00aa50 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00abb0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0ab930 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c012420 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.132+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c150800 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.133+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0672f0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.134+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb61c012580 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.134+0000 7fb622ffd640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.134+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb61c089360 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.134+0000 7fb629d9b640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.135+0000 7fb629d9b640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 0x7fb60c06d0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb614006fd0 tx=0x7fb614008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.138+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb61c054490 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.309+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb62c066dd0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.310+0000 7fb622ffd640 1 -- 172.21.15.5:0/415584342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fb61c057ab0 con 0x7fb62c0cb6c0 2024-09-13T17:17:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:39.312 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 msgr2=0x7fb60c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 0x7fb60c06d0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb614006fd0 tx=0x7fb614008040 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 msgr2=0x7fb62c06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c7f0 tx=0x7fb61c00ccb0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 shutdown_connections 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb62c15a880 0x7fb62c14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb62c15a4a0 0x7fb62c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 --2- 172.21.15.5:0/415584342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb62c0cb6c0 0x7fb62c06c440 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 >> 172.21.15.5:0/415584342 conn(0x7fb62c066200 msgr2=0x7fb62c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 shutdown_connections 2024-09-13T17:17:39.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.312+0000 7fb630ad7640 1 -- 172.21.15.5:0/415584342 wait complete. 2024-09-13T17:17:39.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:14.535688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:15.662082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:39.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.429+0000 7f589f983640 1 Processor -- start 2024-09-13T17:17:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.430+0000 7f589f983640 1 -- start start 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.430+0000 7f589f983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f589815c760 0x7f58980cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589f983640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58980d1b00 0x7f58980cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589f983640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980d34d0 con 0x7f58980d20c0 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589f983640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980cddb0 con 0x7f58980d1b00 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589f983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980b5700 con 0x7f589815c760 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589df20640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58980d1b00 0x7f58980cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589cf1e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f58980d20c0 0x7f58980b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48322/0 (socket says 172.21.15.5:48322) 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589cf1e640 1 -- 172.21.15.5:0/2883580642 learned_addr learned my addr 172.21.15.5:0/2883580642 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589d71f640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f589815c760 0x7f58980cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589df20640 1 -- 172.21.15.5:0/2883580642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f589815c760 msgr2=0x7f58980cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589df20640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f589815c760 0x7f58980cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589df20640 1 -- 172.21.15.5:0/2883580642 >> v1:172.21.15.5:6789/0 conn(0x7f58980d20c0 legacy=0x7f58980b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f589df20640 1 -- 172.21.15.5:0/2883580642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980d2950 con 0x7f58980d1b00 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.431+0000 7f588ffff640 1 -- 172.21.15.5:0/2883580642 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380164168 0 0) 0x7f58980d34d0 con 0x7f58980d20c0 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589df20640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d1b00 0x7f58980cfb80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d90 tx=0x7f589002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44b20110f2489a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f588ffff640 1 -- 172.21.15.5:0/2883580642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031600 con 0x7f58980d1b00 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f588ffff640 1 -- 172.21.15.5:0/2883580642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589002d050 con 0x7f58980d1b00 2024-09-13T17:17:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f588ffff640 1 -- 172.21.15.5:0/2883580642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031980 con 0x7f58980d1b00 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 -- 172.21.15.5:0/2883580642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d1b00 msgr2=0x7f58980cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d1b00 0x7f58980cfb80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d90 tx=0x7f589002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 -- 172.21.15.5:0/2883580642 shutdown_connections 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d1b00 0x7f58980cfb80 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 --2- 172.21.15.5:0/2883580642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f589815c760 0x7f58980cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.432+0000 7f589f983640 1 -- 172.21.15.5:0/2883580642 >> 172.21.15.5:0/2883580642 conn(0x7f5898071a20 msgr2=0x7f5898071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.433+0000 7f589f983640 1 -- 172.21.15.5:0/2883580642 shutdown_connections 2024-09-13T17:17:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.433+0000 7f589f983640 1 -- 172.21.15.5:0/2883580642 wait complete. 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.434+0000 7f589f983640 1 Processor -- start 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.434+0000 7f589f983640 1 -- start start 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58980d1b00 0x7f58981536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 0x7f58980cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898156ad0 con 0x7f58980d20c0 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981550d0 con 0x7f589815c760 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898159040 con 0x7f58980d1b00 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54664/0 (socket says 172.21.15.5:54664) 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 -- 172.21.15.5:0/3259273610 learned_addr learned my addr 172.21.15.5:0/3259273610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589d71f640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58980d1b00 0x7f58981536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589df20640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 0x7f58980cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 -- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58980d1b00 msgr2=0x7f58981536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58980d1b00 0x7f58981536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 -- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 msgr2=0x7f58980cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 0x7f58980cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 -- 172.21.15.5:0/3259273610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009a70 con 0x7f58980d20c0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589df20640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 0x7f58980cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589cf1e640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f588800c4b0 tx=0x7f588800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880074e0 con 0x7f58980d20c0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888007660 con 0x7f58980d20c0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888004a20 con 0x7f58980d20c0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.435+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898159320 con 0x7f58980d20c0 2024-09-13T17:17:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.436+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58981598e0 con 0x7f58980d20c0 2024-09-13T17:17:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.437+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58980d2580 con 0x7f58980d20c0 2024-09-13T17:17:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.437+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5888004b80 con 0x7f58980d20c0 2024-09-13T17:17:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.437+0000 7f588dffb640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 0x7f587c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.438+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5888088560 con 0x7f58980d20c0 2024-09-13T17:17:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.438+0000 7f589d71f640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 0x7f587c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.438+0000 7f589d71f640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 0x7f587c06d0c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f58940079a0 tx=0x7f5894008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.442+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5888053760 con 0x7f58980d20c0 2024-09-13T17:17:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.612+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5898158cf0 con 0x7f58980d20c0 2024-09-13T17:17:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.612+0000 7f588dffb640 1 -- 172.21.15.5:0/3259273610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5888018020 con 0x7f58980d20c0 2024-09-13T17:17:39.615 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 msgr2=0x7f587c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 0x7f587c06d0c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f58940079a0 tx=0x7f5894008040 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 msgr2=0x7f5898156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f588800c4b0 tx=0x7f588800c970 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 shutdown_connections 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f589815c760 0x7f58980cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f587c06ac00 0x7f587c06d0c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58980d20c0 0x7f5898156590 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 --2- 172.21.15.5:0/3259273610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58980d1b00 0x7f58981536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 >> 172.21.15.5:0/3259273610 conn(0x7f5898071a20 msgr2=0x7f58980d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 shutdown_connections 2024-09-13T17:17:39.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.614+0000 7f589f983640 1 -- 172.21.15.5:0/3259273610 wait complete. 2024-09-13T17:17:39.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:17:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.729+0000 7f746835a640 1 Processor -- start 2024-09-13T17:17:39.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.729+0000 7f746835a640 1 -- start start 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f746835a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7460165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f746835a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746015ad50 con 0x7f7460143ea0 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f746835a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600cae40 con 0x7f746015a910 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f746835a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600adff0 con 0x7f74600adb60 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f74660f6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7460143ea0 0x7f74600cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48332/0 (socket says 172.21.15.5:48332) 2024-09-13T17:17:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f74660f6640 1 -- 172.21.15.5:0/1552330391 learned_addr learned my addr 172.21.15.5:0/1552330391 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f74668f7640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7460165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009668704 0 0) 0x7f746015ad50 con 0x7f7460143ea0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.730+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7448003520 con 0x7f7460143ea0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155832511 0 0) 0x7f74600cae40 con 0x7f746015a910 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f746015ad50 con 0x7f746015a910 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131685953 0 0) 0x7f7448003520 con 0x7f7460143ea0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 msgr2=0x7f7460165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7460165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 >> v1:172.21.15.179:6789/0 conn(0x7f746015a910 legacy=0x7f74600cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600cbca0 con 0x7f7460143ea0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f74500019f0 con 0x7f7460143ea0 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 >> v1:172.21.15.5:6789/0 conn(0x7f7460143ea0 legacy=0x7f74600cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7448003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480040e0 0x7f74480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004d00 0x7f7448005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600adff0 con 0x7f74480040e0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744800bac0 con 0x7f7448004d00 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744800bc80 con 0x7f74600adb60 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480040e0 0x7f74480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74660f6640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7448003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74668f7640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004d00 0x7f7448005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 -- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 msgr2=0x7f7448003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74600adb60 0x7f7448003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 -- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004d00 msgr2=0x7f7448005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7448004d00 0x7f7448005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.731+0000 7f74658f5640 1 -- 172.21.15.5:0/1552330391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448003520 con 0x7f74480040e0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.732+0000 7f74658f5640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480040e0 0x7f74480047c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f74540018d0 tx=0x7f74480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20874a17a20615f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.732+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540052d0 con 0x7f74480040e0 2024-09-13T17:17:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.732+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454005430 con 0x7f74480040e0 2024-09-13T17:17:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.732+0000 7f74650f4640 1 -- 172.21.15.5:0/1552330391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745402abe0 con 0x7f74480040e0 2024-09-13T17:17:39.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 -- 172.21.15.5:0/1552330391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480040e0 msgr2=0x7f74480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 --2- 172.21.15.5:0/1552330391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74480040e0 0x7f74480047c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f74540018d0 tx=0x7f74480057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f74668f7640 1 -- 172.21.15.5:0/1552330391 reap_dead start 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 -- 172.21.15.5:0/1552330391 shutdown_connections 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 -- 172.21.15.5:0/1552330391 >> 172.21.15.5:0/1552330391 conn(0x7f7460069ed0 msgr2=0x7f746006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 -- 172.21.15.5:0/1552330391 shutdown_connections 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.733+0000 7f746835a640 1 -- 172.21.15.5:0/1552330391 wait complete. 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.734+0000 7f746835a640 1 Processor -- start 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.734+0000 7f746835a640 1 -- start start 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74480040e0 0x7f74600aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f746015a050 0x7f74600af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600afe60 con 0x7f74600af9e0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746013e780 con 0x7f74480040e0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f746835a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600a8a60 con 0x7f746015a050 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54672/0 (socket says 172.21.15.5:54672) 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 -- 172.21.15.5:0/3674484063 learned_addr learned my addr 172.21.15.5:0/3674484063 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74658f5640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f746015a050 0x7f74600af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74660f6640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74480040e0 0x7f74600aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 -- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f746015a050 msgr2=0x7f74600af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f746015a050 0x7f74600af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 -- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74480040e0 msgr2=0x7f74600aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74480040e0 0x7f74600aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 -- 172.21.15.5:0/3674484063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600a8d40 con 0x7f74600af9e0 2024-09-13T17:17:39.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f74668f7640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f746015de60 tx=0x7f7458011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.735+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011ee0 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.736+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458004240 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.736+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746013e410 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.736+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745800f770 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.736+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600a8270 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.737+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746013e8f0 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.737+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f745800f8d0 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.737+0000 7f745effd640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 0x7f744c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.738+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7458089960 con 0x7f74600af9e0 2024-09-13T17:17:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.738+0000 7f74660f6640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 0x7f744c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:39.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.738+0000 7f74660f6640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 0x7f744c06d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f746013dda0 tx=0x7f7450006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:39.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.742+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f74580549f0 con 0x7f74600af9e0 2024-09-13T17:17:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.914+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74600cced0 con 0x7f74600af9e0 2024-09-13T17:17:39.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.914+0000 7f745effd640 1 -- 172.21.15.5:0/3674484063 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7458019020 con 0x7f74600af9e0 2024-09-13T17:17:39.916 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 msgr2=0x7f744c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 0x7f744c06d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f746013dda0 tx=0x7f7450006040 comp rx=0 tx=0).stop 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 msgr2=0x7f74600a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f746015de60 tx=0x7f7458011cf0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 shutdown_connections 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f744c06ac00 0x7f744c06d0c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74600af9e0 0x7f74600a7d30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f746015a050 0x7f74600af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 --2- 172.21.15.5:0/3674484063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74480040e0 0x7f74600aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 >> 172.21.15.5:0/3674484063 conn(0x7f7460069ed0 msgr2=0x7f74600ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 shutdown_connections 2024-09-13T17:17:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:39.916+0000 7f746835a640 1 -- 172.21.15.5:0/3674484063 wait complete. 2024-09-13T17:17:39.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:17:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.032+0000 7faef3479640 1 Processor -- start 2024-09-13T17:17:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.032+0000 7faef3479640 1 -- start start 2024-09-13T17:17:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef3479640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faeec15c840 0x7faeec0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef3479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faeec0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef3479640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec071e40 con 0x7faeec065f30 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef3479640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec15cc20 con 0x7faeec15c840 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef3479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec071880 con 0x7faeec06b5f0 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef0a14640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faeec065f30 0x7faeec06aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48334/0 (socket says 172.21.15.5:48334) 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef0a14640 1 -- 172.21.15.5:0/234808445 learned_addr learned my addr 172.21.15.5:0/234808445 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef1215640 1 --2- 172.21.15.5:0/234808445 >> v2:172.21.15.179:3300/0 conn(0x7faeec15c840 0x7faeec0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faef1a16640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faeec0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143657162 0 0) 0x7faeec071e40 con 0x7faeec065f30 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed8003520 con 0x7faeec065f30 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177009681 0 0) 0x7faed8003520 con 0x7faeec065f30 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 msgr2=0x7faeec0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faeec0ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 >> v2:172.21.15.179:3300/0 conn(0x7faeec15c840 msgr2=0x7faeec0ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 --2- 172.21.15.5:0/234808445 >> v2:172.21.15.179:3300/0 conn(0x7faeec15c840 0x7faeec0ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec071b60 con 0x7faeec065f30 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7faedc001670 con 0x7faeec065f30 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 >> v1:172.21.15.5:6789/0 conn(0x7faeec065f30 legacy=0x7faeec06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faed8003970 0x7faed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.033+0000 7faee3fff640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed80047c0 0x7faed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faee3fff640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faed8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec15cc20 con 0x7faed8003970 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec071880 con 0x7faed80047c0 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed800ba00 con 0x7faeec06b5f0 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faed8003970 0x7faed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef0a14640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed80047c0 0x7faed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1a16640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faed8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 -- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 msgr2=0x7faed8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec06b5f0 0x7faed8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 -- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed80047c0 msgr2=0x7faed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed80047c0 0x7faed8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.034+0000 7faef1215640 1 -- 172.21.15.5:0/234808445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8003520 con 0x7faed8003970 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef1215640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faed8003970 0x7faed8003d90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faee8009ac0 tx=0x7faed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5eb983e050579e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8031400 con 0x7faed8003970 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee802d050 con 0x7faed8003970 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faee3fff640 1 -- 172.21.15.5:0/234808445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8031780 con 0x7faed8003970 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 -- 172.21.15.5:0/234808445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faed8003970 msgr2=0x7faed8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 --2- 172.21.15.5:0/234808445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faed8003970 0x7faed8003d90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faee8009ac0 tx=0x7faed80057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef1a16640 1 -- 172.21.15.5:0/234808445 reap_dead start 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 -- 172.21.15.5:0/234808445 shutdown_connections 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 -- 172.21.15.5:0/234808445 >> 172.21.15.5:0/234808445 conn(0x7faeec0cc570 msgr2=0x7faeec070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 -- 172.21.15.5:0/234808445 shutdown_connections 2024-09-13T17:17:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.035+0000 7faef3479640 1 -- 172.21.15.5:0/234808445 wait complete. 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 Processor -- start 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 -- start start 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 0x7faeec15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec0ce400 0x7faeec1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec15f5c0 con 0x7faeec0af530 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0afef0 con 0x7faed8003970 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef3479640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec15e940 con 0x7faeec0ce400 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.037+0000 7faef1a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54684/0 (socket says 172.21.15.5:54684) 2024-09-13T17:17:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 -- 172.21.15.5:0/2538940971 learned_addr learned my addr 172.21.15.5:0/2538940971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef0a14640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec0ce400 0x7faeec1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1215640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 0x7faeec15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 -- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec0ce400 msgr2=0x7faeec1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec0ce400 0x7faeec1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 -- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 msgr2=0x7faeec15f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 0x7faeec15f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 -- 172.21.15.5:0/2538940971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec15ec20 con 0x7faeec0af530 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1215640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 0x7faeec15f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef1a16640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b4180 tx=0x7faee400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400e040 con 0x7faeec0af530 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400f040 con 0x7faeec0af530 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4015430 con 0x7faeec0af530 2024-09-13T17:17:40.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.038+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec15ef00 con 0x7faeec0af530 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.039+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec0ce880 con 0x7faeec0af530 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.039+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec15ff20 con 0x7faeec0af530 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.040+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faee4015590 con 0x7faeec0af530 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.040+0000 7faee1ffb640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 0x7faed006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.040+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faee4089b60 con 0x7faeec0af530 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.040+0000 7faef1215640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 0x7faed006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.041+0000 7faef1215640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 0x7faed006d0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faee8033000 tx=0x7faee8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.044+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faee4054c00 con 0x7faeec0af530 2024-09-13T17:17:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.215+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faeec15f700 con 0x7faeec0af530 2024-09-13T17:17:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.216+0000 7faee1ffb640 1 -- 172.21.15.5:0/2538940971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7faeec15f700 con 0x7faeec0af530 2024-09-13T17:17:40.218 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:17:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.217+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 msgr2=0x7faed006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 0x7faed006d0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faee8033000 tx=0x7faee8008030 comp rx=0 tx=0).stop 2024-09-13T17:17:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 msgr2=0x7faeec0af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b4180 tx=0x7faee400f1b0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 shutdown_connections 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed006ac30 0x7faed006d0f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0af530 0x7faeec0af9b0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec0ce400 0x7faeec1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 --2- 172.21.15.5:0/2538940971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faed8003970 0x7faeec15f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 >> 172.21.15.5:0/2538940971 conn(0x7faeec0cc570 msgr2=0x7faeec1602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 shutdown_connections 2024-09-13T17:17:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.218+0000 7faef3479640 1 -- 172.21.15.5:0/2538940971 wait complete. 2024-09-13T17:17:40.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:40.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.330+0000 7f98f7019640 1 Processor -- start 2024-09-13T17:17:40.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.330+0000 7f98f7019640 1 -- start start 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f7019640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98f0158c60 0x7f98f00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f7019640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00cd260 con 0x7f98f006ded0 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f7019640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f0070d60 con 0x7f98f0070920 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f7019640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00cd6f0 con 0x7f98f0158c60 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f55b6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f98f006ded0 0x7f98f00b2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48336/0 (socket says 172.21.15.5:48336) 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f55b6640 1 -- 172.21.15.5:0/1547265927 learned_addr learned my addr 172.21.15.5:0/1547265927 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f4db5640 1 --2- 172.21.15.5:0/1547265927 >> v2:172.21.15.179:3300/0 conn(0x7f98f0158c60 0x7f98f00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98ef7fe640 1 -- 172.21.15.5:0/1547265927 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281443950 0 0) 0x7f98f00cd260 con 0x7f98f006ded0 2024-09-13T17:17:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98ef7fe640 1 -- 172.21.15.5:0/1547265927 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e0003520 con 0x7f98f006ded0 2024-09-13T17:17:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f4db5640 1 -- 172.21.15.5:0/1547265927 >> v1:172.21.15.179:6789/0 conn(0x7f98f0070920 legacy=0x7f98f006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f4db5640 1 -- 172.21.15.5:0/1547265927 >> v1:172.21.15.5:6789/0 conn(0x7f98f006ded0 legacy=0x7f98f00b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.331+0000 7f98f4db5640 1 -- 172.21.15.5:0/1547265927 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00cc650 con 0x7f98f0158c60 2024-09-13T17:17:40.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.332+0000 7f98f4db5640 1 --2- 172.21.15.5:0/1547265927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f00703e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f98e400a940 tx=0x7f98e402b5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc3584c10a918fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.332+0000 7f98ef7fe640 1 -- 172.21.15.5:0/1547265927 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4030510 con 0x7f98f0158c60 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.332+0000 7f98ef7fe640 1 -- 172.21.15.5:0/1547265927 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e402e050 con 0x7f98f0158c60 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.332+0000 7f98ef7fe640 1 -- 172.21.15.5:0/1547265927 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4030870 con 0x7f98f0158c60 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 -- 172.21.15.5:0/1547265927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 msgr2=0x7f98f00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 --2- 172.21.15.5:0/1547265927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f00703e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f98e400a940 tx=0x7f98e402b5e0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 -- 172.21.15.5:0/1547265927 shutdown_connections 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 --2- 172.21.15.5:0/1547265927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f00703e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 -- 172.21.15.5:0/1547265927 >> 172.21.15.5:0/1547265927 conn(0x7f98f0066200 msgr2=0x7f98f0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 -- 172.21.15.5:0/1547265927 shutdown_connections 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.333+0000 7f98f7019640 1 -- 172.21.15.5:0/1547265927 wait complete. 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.334+0000 7f98f7019640 1 Processor -- start 2024-09-13T17:17:40.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.334+0000 7f98f7019640 1 -- start start 2024-09-13T17:17:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98f006ded0 0x7f98f00a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f01f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00a8d50 con 0x7f98f0070920 2024-09-13T17:17:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00a9030 con 0x7f98f0158c60 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f7019640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00a9310 con 0x7f98f006ded0 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54694/0 (socket says 172.21.15.5:54694) 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98effff640 1 -- 172.21.15.5:0/2153914313 learned_addr learned my addr 172.21.15.5:0/2153914313 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f55b6640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f01f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.335+0000 7f98f4db5640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98f006ded0 0x7f98f00a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 -- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98f006ded0 msgr2=0x7f98f00a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98f006ded0 0x7f98f00a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 -- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 msgr2=0x7f98f01f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f01f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 -- 172.21.15.5:0/2153914313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e400a5a0 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98effff640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c400 tx=0x7f98dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0052d0 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc005450 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f00a95f0 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc007260 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.336+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f00a8a40 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.337+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00672f0 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.338+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98dc0073c0 con 0x7f98f0070920 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.338+0000 7f98ed7fa640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.338+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98dc0888a0 con 0x7f98f0070920 2024-09-13T17:17:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.338+0000 7f98f4db5640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.339+0000 7f98f4db5640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 0x7f98d406d0c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f98e4035000 tx=0x7f98e4030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.343+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98dc053970 con 0x7f98f0070920 2024-09-13T17:17:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.548+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98f00a9b10 con 0x7f98f0070920 2024-09-13T17:17:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.548+0000 7f98ed7fa640 1 -- 172.21.15.5:0/2153914313 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f98f00a9b10 con 0x7f98f0070920 2024-09-13T17:17:40.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:40.551 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.550+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 msgr2=0x7f98d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.550+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 0x7f98d406d0c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f98e4035000 tx=0x7f98e4030000 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.550+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 msgr2=0x7f98f01f3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.550+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c400 tx=0x7f98dc00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 shutdown_connections 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f0158c60 0x7f98f01f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98f0070920 0x7f98f01f3370 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 --2- 172.21.15.5:0/2153914313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98f006ded0 0x7f98f00a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 >> 172.21.15.5:0/2153914313 conn(0x7f98f0066200 msgr2=0x7f98f0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 shutdown_connections 2024-09-13T17:17:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.551+0000 7f98f7019640 1 -- 172.21.15.5:0/2153914313 wait complete. 2024-09-13T17:17:40.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:40.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.663+0000 7f935d861640 1 Processor -- start 2024-09-13T17:17:40.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.663+0000 7f935d861640 1 -- start start 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f935d861640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9358099940 0x7f9358098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f935d861640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580cb2c0 con 0x7f93580d1030 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f935d861640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580cf1d0 con 0x7f935815dbb0 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f935d861640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580cb940 con 0x7f9358099940 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f93567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9358099940 0x7f9358098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f93577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f93580d1030 0x7f93580afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48348/0 (socket says 172.21.15.5:48348) 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f93567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9358099940 0x7f9358098a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54704/0 (socket says 172.21.15.5:54704) 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.664+0000 7f93577fe640 1 -- 172.21.15.5:0/2883056315 learned_addr learned my addr 172.21.15.5:0/2883056315 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.665+0000 7f93567fc640 1 -- 172.21.15.5:0/2883056315 >> v1:172.21.15.179:6789/0 conn(0x7f935815dbb0 legacy=0x7f93580cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.665+0000 7f93567fc640 1 -- 172.21.15.5:0/2883056315 >> v1:172.21.15.5:6789/0 conn(0x7f93580d1030 legacy=0x7f93580afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.665+0000 7f93567fc640 1 -- 172.21.15.5:0/2883056315 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580cb560 con 0x7f9358099940 2024-09-13T17:17:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.665+0000 7f9355ffb640 1 -- 172.21.15.5:0/2883056315 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458636127 0 0) 0x7f93580cb2c0 con 0x7f93580d1030 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.665+0000 7f93567fc640 1 --2- 172.21.15.5:0/2883056315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9358099940 0x7f9358098a50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0097a0 tx=0x7f934c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2538e1ceddfedc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f9355ffb640 1 -- 172.21.15.5:0/2883056315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c02ae60 con 0x7f9358099940 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f9355ffb640 1 -- 172.21.15.5:0/2883056315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c032440 con 0x7f9358099940 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f9355ffb640 1 -- 172.21.15.5:0/2883056315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0327d0 con 0x7f9358099940 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 -- 172.21.15.5:0/2883056315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9358099940 msgr2=0x7f9358098a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 --2- 172.21.15.5:0/2883056315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9358099940 0x7f9358098a50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f934c0097a0 tx=0x7f934c02a110 comp rx=0 tx=0).stop 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 -- 172.21.15.5:0/2883056315 shutdown_connections 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 --2- 172.21.15.5:0/2883056315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9358099940 0x7f9358098a50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 -- 172.21.15.5:0/2883056315 >> 172.21.15.5:0/2883056315 conn(0x7f93580d0510 msgr2=0x7f93580d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 -- 172.21.15.5:0/2883056315 shutdown_connections 2024-09-13T17:17:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.666+0000 7f935d861640 1 -- 172.21.15.5:0/2883056315 wait complete. 2024-09-13T17:17:40.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.667+0000 7f935d861640 1 Processor -- start 2024-09-13T17:17:40.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 -- start start 2024-09-13T17:17:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9358099940 0x7f93580c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 0x7f93580c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935806cf00 con 0x7f93580d1030 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935806c2f0 con 0x7f935815dbb0 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f935d861640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935806c5d0 con 0x7f9358099940 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f93567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f93567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54714/0 (socket says 172.21.15.5:54714) 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.668+0000 7f93567fc640 1 -- 172.21.15.5:0/1391477111 learned_addr learned my addr 172.21.15.5:0/1391477111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93577fe640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 0x7f93580c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f9356ffd640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9358099940 0x7f93580c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 -- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9358099940 msgr2=0x7f93580c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9358099940 0x7f93580c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 -- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 msgr2=0x7f93580c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 0x7f93580c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 -- 172.21.15.5:0/1391477111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009400 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93577fe640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 0x7f93580c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f93567fc640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f934c02a150 tx=0x7f934c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c030970 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c030ad0 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935806c8b0 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c030e80 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.669+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580c39f0 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.670+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935815df90 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.671+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f934c03e450 con 0x7f93580d1030 2024-09-13T17:17:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.671+0000 7f933ffff640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 0x7f934406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.671+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f934c0aa6f0 con 0x7f93580d1030 2024-09-13T17:17:40.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.671+0000 7f9356ffd640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 0x7f934406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.672+0000 7f9356ffd640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 0x7f934406d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93480012e0 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.675+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f934c075680 con 0x7f93580d1030 2024-09-13T17:17:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.849+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93580995c0 con 0x7f93580d1030 2024-09-13T17:17:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.850+0000 7f933ffff640 1 -- 172.21.15.5:0/1391477111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f934c078ca0 con 0x7f93580d1030 2024-09-13T17:17:40.853 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:40.853 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.852+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 msgr2=0x7f934406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 0x7f934406d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93480012e0 tx=0x7f9348009040 comp rx=0 tx=0).stop 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 msgr2=0x7f935806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f934c02a150 tx=0x7f934c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 shutdown_connections 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f935815dbb0 0x7f93580c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f934406ac00 0x7f934406d0c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93580d1030 0x7f935806b9a0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 --2- 172.21.15.5:0/1391477111 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9358099940 0x7f93580c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 >> 172.21.15.5:0/1391477111 conn(0x7f93580d0510 msgr2=0x7f935815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 shutdown_connections 2024-09-13T17:17:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.853+0000 7f935d861640 1 -- 172.21.15.5:0/1391477111 wait complete. 2024-09-13T17:17:40.866 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:17:40.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.965+0000 7fd518c7d640 1 Processor -- start 2024-09-13T17:17:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.966+0000 7fd518c7d640 1 -- start start 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd518c7d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51415a880 0x7fd5140cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd518c7d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140b2180 con 0x7fd51415a4a0 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd518c7d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140b2420 con 0x7fd5140cb6c0 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd518c7d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5140b2700 con 0x7fd51415a880 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd51415a4a0 0x7fd5140cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48360/0 (socket says 172.21.15.5:48360) 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51259c640 1 -- 172.21.15.5:0/2681181417 learned_addr learned my addr 172.21.15.5:0/2681181417 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266563957 0 0) 0x7fd5140b2180 con 0x7fd51415a4a0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd511d9b640 1 --2- 172.21.15.5:0/2681181417 >> v2:172.21.15.179:3300/0 conn(0x7fd51415a880 0x7fd5140cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4fc003520 con 0x7fd51415a4a0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771947757 0 0) 0x7fd4fc003520 con 0x7fd51415a4a0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 >> v2:172.21.15.179:3300/0 conn(0x7fd51415a880 msgr2=0x7fd5140cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 --2- 172.21.15.5:0/2681181417 >> v2:172.21.15.179:3300/0 conn(0x7fd51415a880 0x7fd5140cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 >> v1:172.21.15.179:6789/0 conn(0x7fd5140cb6c0 legacy=0x7fd51415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140ce330 con 0x7fd51415a4a0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd504001670 con 0x7fd51415a4a0 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 >> v1:172.21.15.5:6789/0 conn(0x7fd51415a4a0 legacy=0x7fd5140cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4fc003970 0x7fd4fc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd4fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4fc005180 0x7fd4fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140b2700 con 0x7fd4fc0047c0 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc00c050 con 0x7fd4fc005180 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.967+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc00c210 con 0x7fd4fc003970 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd4fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd51259c640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4fc003970 0x7fd4fc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd512d9d640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4fc005180 0x7fd4fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 -- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4fc003970 msgr2=0x7fd4fc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4fc003970 0x7fd4fc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 -- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4fc005180 msgr2=0x7fd4fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4fc005180 0x7fd4fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd511d9b640 1 -- 172.21.15.5:0/2681181417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc003520 con 0x7fd4fc0047c0 2024-09-13T17:17:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd51259c640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4fc003970 0x7fd4fc003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd512d9d640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4fc005180 0x7fd4fc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.968+0000 7fd512d9d640 1 -- 172.21.15.5:0/2681181417 reap_dead start 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd511d9b640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd4fc004c40 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd508009a90 tx=0x7fd4fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b61d540ba7d6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508031400 con 0x7fd4fc0047c0 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50802d050 con 0x7fd4fc0047c0 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd51159a640 1 -- 172.21.15.5:0/2681181417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508031780 con 0x7fd4fc0047c0 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 -- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 msgr2=0x7fd4fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd4fc004c40 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd508009a90 tx=0x7fd4fc0057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 -- 172.21.15.5:0/2681181417 shutdown_connections 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 --2- 172.21.15.5:0/2681181417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd4fc004c40 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 -- 172.21.15.5:0/2681181417 >> 172.21.15.5:0/2681181417 conn(0x7fd514066200 msgr2=0x7fd514069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 -- 172.21.15.5:0/2681181417 shutdown_connections 2024-09-13T17:17:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.969+0000 7fd518c7d640 1 -- 172.21.15.5:0/2681181417 wait complete. 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 Processor -- start 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 -- start start 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5141e2d30 0x7fd51413ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 0x7fd514155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141527d0 con 0x7fd4fc0047c0 2024-09-13T17:17:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514151bc0 con 0x7fd5141e2d30 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.971+0000 7fd518c7d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd514151ea0 con 0x7fd514152c60 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54730/0 (socket says 172.21.15.5:54730) 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 -- 172.21.15.5:0/3077772387 learned_addr learned my addr 172.21.15.5:0/3077772387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd512d9d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 0x7fd514155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd511d9b640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5141e2d30 0x7fd51413ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 -- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 msgr2=0x7fd514155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 0x7fd514155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 -- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5141e2d30 msgr2=0x7fd51413ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5141e2d30 0x7fd51413ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 -- 172.21.15.5:0/3077772387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514152180 con 0x7fd4fc0047c0 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd512d9d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 0x7fd514155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd51259c640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e710 tx=0x7fd50400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400ee20 con 0x7fd4fc0047c0 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50400c8d0 con 0x7fd4fc0047c0 2024-09-13T17:17:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd514152460 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400cc80 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.972+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141530e0 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.973+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5140672f0 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.974+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd50401d460 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.974+0000 7fd502ffd640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 0x7fd4f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.974+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd504089460 con 0x7fd4fc0047c0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.975+0000 7fd511d9b640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 0x7fd4f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.975+0000 7fd511d9b640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 0x7fd4f406d0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd508009a90 tx=0x7fd508008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:40.979+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd504057f90 con 0x7fd4fc0047c0 2024-09-13T17:17:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.183+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5140cd900 con 0x7fd4fc0047c0 2024-09-13T17:17:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.183+0000 7fd502ffd640 1 -- 172.21.15.5:0/3077772387 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7fd504057b20 con 0x7fd4fc0047c0 2024-09-13T17:17:41.186 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:41.186 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 msgr2=0x7fd4f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 0x7fd4f406d0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd508009a90 tx=0x7fd508008030 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 msgr2=0x7fd5141515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e710 tx=0x7fd50400ebd0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 shutdown_connections 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd514152c60 0x7fd514155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5141e2d30 0x7fd51413ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd4f406ac30 0x7fd4f406d0f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 --2- 172.21.15.5:0/3077772387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4fc0047c0 0x7fd5141515c0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 >> 172.21.15.5:0/3077772387 conn(0x7fd514066200 msgr2=0x7fd5140ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 shutdown_connections 2024-09-13T17:17:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.185+0000 7fd518c7d640 1 -- 172.21.15.5:0/3077772387 wait complete. 2024-09-13T17:17:41.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.298+0000 7ff136cde640 1 Processor -- start 2024-09-13T17:17:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.298+0000 7ff136cde640 1 -- start start 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff13015a4a0 0x7ff1300cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff13015a880 0x7ff1300cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff1300cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1300cb9a0 con 0x7ff13015a4a0 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1300cdab0 con 0x7ff13015a880 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff136cde640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300b2180 con 0x7ff1300cafb0 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff13015a4a0 0x7ff1300cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff13015a4a0 0x7ff1300cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54746/0 (socket says 172.21.15.5:54746) 2024-09-13T17:17:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 -- 172.21.15.5:0/2681814521 learned_addr learned my addr 172.21.15.5:0/2681814521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff13527b640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff1300cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff12ffff640 1 --2- 172.21.15.5:0/2681814521 >> v2:172.21.15.179:3300/0 conn(0x7ff13015a880 0x7ff1300cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 -- 172.21.15.5:0/2681814521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 msgr2=0x7ff1300cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff1300cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 -- 172.21.15.5:0/2681814521 >> v2:172.21.15.179:3300/0 conn(0x7ff13015a880 msgr2=0x7ff1300cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 --2- 172.21.15.5:0/2681814521 >> v2:172.21.15.179:3300/0 conn(0x7ff13015a880 0x7ff1300cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.299+0000 7ff134a7a640 1 -- 172.21.15.5:0/2681814521 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300b2420 con 0x7ff13015a4a0 2024-09-13T17:17:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.300+0000 7ff134a7a640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a4a0 0x7ff1300cdc50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff1300b1d60 tx=0x7ff12002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68614d07f6c954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.300+0000 7ff12f7fe640 1 -- 172.21.15.5:0/2681814521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120032440 con 0x7ff13015a4a0 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.300+0000 7ff12f7fe640 1 -- 172.21.15.5:0/2681814521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200325a0 con 0x7ff13015a4a0 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.300+0000 7ff12f7fe640 1 -- 172.21.15.5:0/2681814521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120032930 con 0x7ff13015a4a0 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 -- 172.21.15.5:0/2681814521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a4a0 msgr2=0x7ff1300cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a4a0 0x7ff1300cdc50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff1300b1d60 tx=0x7ff12002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 -- 172.21.15.5:0/2681814521 shutdown_connections 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff1300cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 --2- 172.21.15.5:0/2681814521 >> v2:172.21.15.179:3300/0 conn(0x7ff13015a880 0x7ff1300cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 --2- 172.21.15.5:0/2681814521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a4a0 0x7ff1300cdc50 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 -- 172.21.15.5:0/2681814521 >> 172.21.15.5:0/2681814521 conn(0x7ff130066200 msgr2=0x7ff130069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 -- 172.21.15.5:0/2681814521 shutdown_connections 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.301+0000 7ff136cde640 1 -- 172.21.15.5:0/2681814521 wait complete. 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.302+0000 7ff136cde640 1 Processor -- start 2024-09-13T17:17:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.302+0000 7ff136cde640 1 -- start start 2024-09-13T17:17:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff130142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13015a4a0 0x7ff130143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130144d20 con 0x7ff13015a880 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130144110 con 0x7ff13015a4a0 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff136cde640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301443f0 con 0x7ff1300cafb0 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff13527b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff13527b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54756/0 (socket says 172.21.15.5:54756) 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff13527b640 1 -- 172.21.15.5:0/595577768 learned_addr learned my addr 172.21.15.5:0/595577768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff134a7a640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff130142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.303+0000 7ff12ffff640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13015a4a0 0x7ff130143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 -- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 msgr2=0x7ff130142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff130142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 -- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13015a4a0 msgr2=0x7ff130143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13015a4a0 0x7ff130143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 -- 172.21.15.5:0/595577768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200094d0 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff13527b640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff12800d800 tx=0x7ff12800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280096c0 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128009840 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128009bf0 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1301446d0 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.304+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff130143d50 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.305+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1300672f0 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.305+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff128009d50 con 0x7ff13015a880 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.306+0000 7ff12d7fa640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 0x7ff11006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.306+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff128089ab0 con 0x7ff13015a880 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.306+0000 7ff134a7a640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 0x7ff11006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.307+0000 7ff134a7a640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 0x7ff11006d0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff120034000 tx=0x7ff12002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.310+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff128054c00 con 0x7ff13015a880 2024-09-13T17:17:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.517+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1300cb460 con 0x7ff13015a880 2024-09-13T17:17:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.518+0000 7ff12d7fa640 1 -- 172.21.15.5:0/595577768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4733 (secure 0 0 0) 0x7ff128018090 con 0x7ff13015a880 2024-09-13T17:17:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:41.520 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:16.679448+0000","modified":"2024-09-13T17:17:18.685406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1039859962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1039859962},{"type":"v1","addr":"172.21.15.5:6835","nonce":1039859962}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T17:17:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-09-13T17:17:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 msgr2=0x7ff11006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 0x7ff11006d0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff120034000 tx=0x7ff12002e000 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 msgr2=0x7ff130154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff12800d800 tx=0x7ff12800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 shutdown_connections 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff11006ac30 0x7ff11006d0f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff13015a880 0x7ff130154740 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff13015a4a0 0x7ff130143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 --2- 172.21.15.5:0/595577768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300cafb0 0x7ff130142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 >> 172.21.15.5:0/595577768 conn(0x7ff130066200 msgr2=0x7ff13015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 shutdown_connections 2024-09-13T17:17:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.520+0000 7ff136cde640 1 -- 172.21.15.5:0/595577768 wait complete. 2024-09-13T17:17:41.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.632+0000 7fd3503ae640 1 Processor -- start 2024-09-13T17:17:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.632+0000 7fd3503ae640 1 -- start start 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd3503ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd3480cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd3503ae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd3480cb6c0 0x7fd3480cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd3503ae640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3480b2180 con 0x7fd34815a4a0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd3503ae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480cdab0 con 0x7fd3480cb6c0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd3503ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b2420 con 0x7fd34815a880 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd34e14a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd34815a4a0 0x7fd3480cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48366/0 (socket says 172.21.15.5:48366) 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.633+0000 7fd34e14a640 1 -- 172.21.15.5:0/2667326964 learned_addr learned my addr 172.21.15.5:0/2667326964 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27653091 0 0) 0x7fd3480b2180 con 0x7fd34815a4a0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330003520 con 0x7fd34815a4a0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd3480cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34e94b640 1 --2- 172.21.15.5:0/2667326964 >> v2:172.21.15.179:3300/0 conn(0x7fd3480cb6c0 0x7fd3480cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184971483 0 0) 0x7fd330003520 con 0x7fd34815a4a0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 msgr2=0x7fd3480cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd3480cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 >> v2:172.21.15.179:3300/0 conn(0x7fd3480cb6c0 msgr2=0x7fd3480cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 --2- 172.21.15.5:0/2667326964 >> v2:172.21.15.179:3300/0 conn(0x7fd3480cb6c0 0x7fd3480cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480b2700 con 0x7fd34815a4a0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fd3380019f0 con 0x7fd34815a4a0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 >> v1:172.21.15.5:6789/0 conn(0x7fd34815a4a0 legacy=0x7fd3480cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd330003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd330003ef0 0x7fd3300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd330004d00 0x7fd330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480cdab0 con 0x7fd330003ef0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b2420 con 0x7fd330004d00 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000b980 con 0x7fd34815a880 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd330003ef0 0x7fd3300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34e14a640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd330003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34e94b640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd330004d00 0x7fd330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 -- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 msgr2=0x7fd330003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd34815a880 0x7fd330003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 -- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd330004d00 msgr2=0x7fd330005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd330004d00 0x7fd330005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.634+0000 7fd34d949640 1 -- 172.21.15.5:0/2667326964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330003520 con 0x7fd330003ef0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.635+0000 7fd34d949640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd330003ef0 0x7fd3300047c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009ac0 tx=0x7fd3300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd162ea5a26f346 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.635+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c031400 con 0x7fd330003ef0 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.635+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c02d050 con 0x7fd330003ef0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.635+0000 7fd34d148640 1 -- 172.21.15.5:0/2667326964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c031780 con 0x7fd330003ef0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 -- 172.21.15.5:0/2667326964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd330003ef0 msgr2=0x7fd3300047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 --2- 172.21.15.5:0/2667326964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd330003ef0 0x7fd3300047c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009ac0 tx=0x7fd3300057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd34e94b640 1 -- 172.21.15.5:0/2667326964 reap_dead start 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 -- 172.21.15.5:0/2667326964 shutdown_connections 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 -- 172.21.15.5:0/2667326964 >> 172.21.15.5:0/2667326964 conn(0x7fd348066200 msgr2=0x7fd348069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 -- 172.21.15.5:0/2667326964 shutdown_connections 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.636+0000 7fd3503ae640 1 -- 172.21.15.5:0/2667326964 wait complete. 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.637+0000 7fd3503ae640 1 Processor -- start 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.637+0000 7fd3503ae640 1 -- start start 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd330003ef0 0x7fd3481f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd348158ae0 0x7fd3481f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348150f30 con 0x7fd348158f60 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481f0fb0 con 0x7fd348158ae0 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd3503ae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481508e0 con 0x7fd330003ef0 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54776/0 (socket says 172.21.15.5:54776) 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 -- 172.21.15.5:0/3695950903 learned_addr learned my addr 172.21.15.5:0/3695950903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e14a640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd330003ef0 0x7fd3481f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34d949640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd348158ae0 0x7fd3481f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 -- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd330003ef0 msgr2=0x7fd3481f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd330003ef0 0x7fd3481f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 -- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd348158ae0 msgr2=0x7fd3481f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd348158ae0 0x7fd3481f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 -- 172.21.15.5:0/3695950903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348150bc0 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.638+0000 7fd34e94b640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd3480b2fd0 tx=0x7fd340011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.639+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340004500 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.639+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340003610 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.639+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400039e0 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.639+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3481f0250 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.639+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3481f0710 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.640+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3480672f0 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.640+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd340003b40 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.640+0000 7fd346ffd640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 0x7fd33406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.641+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd340089570 con 0x7fd348158f60 2024-09-13T17:17:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.641+0000 7fd34e14a640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 0x7fd33406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.641+0000 7fd34e14a640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 0x7fd33406d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd3481595d0 tx=0x7fd338006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.645+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd340054610 con 0x7fd348158f60 2024-09-13T17:17:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.816+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd348150740 con 0x7fd348158f60 2024-09-13T17:17:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.817+0000 7fd346ffd640 1 -- 172.21.15.5:0/3695950903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fd348150740 con 0x7fd348158f60 2024-09-13T17:17:41.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:41.819 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:17.681488+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:14.535688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:15.662082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 msgr2=0x7fd33406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 0x7fd33406d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd3481595d0 tx=0x7fd338006040 comp rx=0 tx=0).stop 2024-09-13T17:17:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 msgr2=0x7fd3481f31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd3480b2fd0 tx=0x7fd340011920 comp rx=0 tx=0).stop 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 shutdown_connections 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd33406ac00 0x7fd33406d0c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd348158f60 0x7fd3481f31d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd348158ae0 0x7fd3481f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 --2- 172.21.15.5:0/3695950903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd330003ef0 0x7fd3481f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 >> 172.21.15.5:0/3695950903 conn(0x7fd348066200 msgr2=0x7fd34815ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 shutdown_connections 2024-09-13T17:17:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.819+0000 7fd3503ae640 1 -- 172.21.15.5:0/3695950903 wait complete. 2024-09-13T17:17:41.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:17:41.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.933+0000 7faef9627640 1 Processor -- start 2024-09-13T17:17:41.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.933+0000 7faef9627640 1 -- start start 2024-09-13T17:17:41.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faef4158ad0 0x7faef406e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 0x7faef4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40708b0 0x7faef40cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef4070d20 con 0x7faef4158ad0 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef40b3180 con 0x7faef40b1660 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef9627640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef40b3420 con 0x7faef40708b0 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faef4158ad0 0x7faef406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faef4158ad0 0x7faef406e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54786/0 (socket says 172.21.15.5:54786) 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.934+0000 7faef2ffd640 1 -- 172.21.15.5:0/2831150479 learned_addr learned my addr 172.21.15.5:0/2831150479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef27fc640 1 --2- 172.21.15.5:0/2831150479 >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 0x7faef4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef37fe640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40708b0 0x7faef40cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 -- 172.21.15.5:0/2831150479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40708b0 msgr2=0x7faef40cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40708b0 0x7faef40cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 -- 172.21.15.5:0/2831150479 >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 msgr2=0x7faef4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 --2- 172.21.15.5:0/2831150479 >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 0x7faef4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 -- 172.21.15.5:0/2831150479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40b3700 con 0x7faef4158ad0 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef27fc640 1 --2- 172.21.15.5:0/2831150479 >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 0x7faef4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef2ffd640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef406e020 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faef406db50 tx=0x7faee402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c747fdfd7520ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.935+0000 7faef1ffb640 1 -- 172.21.15.5:0/2831150479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee402f070 con 0x7faef4158ad0 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef1ffb640 1 -- 172.21.15.5:0/2831150479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4035400 con 0x7faef4158ad0 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef1ffb640 1 -- 172.21.15.5:0/2831150479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4035790 con 0x7faef4158ad0 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 -- 172.21.15.5:0/2831150479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 msgr2=0x7faef406e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef406e020 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faef406db50 tx=0x7faee402c8a0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 -- 172.21.15.5:0/2831150479 shutdown_connections 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40708b0 0x7faef40cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 --2- 172.21.15.5:0/2831150479 >> v2:172.21.15.179:3300/0 conn(0x7faef40b1660 0x7faef4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 --2- 172.21.15.5:0/2831150479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef406e020 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 -- 172.21.15.5:0/2831150479 >> 172.21.15.5:0/2831150479 conn(0x7faef406a500 msgr2=0x7faef40b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 -- 172.21.15.5:0/2831150479 shutdown_connections 2024-09-13T17:17:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.936+0000 7faef9627640 1 -- 172.21.15.5:0/2831150479 wait complete. 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.937+0000 7faef9627640 1 Processor -- start 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 -- start start 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 0x7faef4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40b1660 0x7faef41ee960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef40a8830 con 0x7faef4158ad0 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4152520 con 0x7faef40708b0 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef9627640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef40a74b0 con 0x7faef40b1660 2024-09-13T17:17:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54800/0 (socket says 172.21.15.5:54800) 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.938+0000 7faef37fe640 1 -- 172.21.15.5:0/1193483602 learned_addr learned my addr 172.21.15.5:0/1193483602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef2ffd640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 0x7faef4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef27fc640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40b1660 0x7faef41ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 -- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40b1660 msgr2=0x7faef41ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40b1660 0x7faef41ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 -- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 msgr2=0x7faef4151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 0x7faef4151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 -- 172.21.15.5:0/1193483602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee400bd40 con 0x7faef4158ad0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef2ffd640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 0x7faef4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef37fe640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7faeec00c570 tx=0x7faeec00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec004220 con 0x7faef4158ad0 2024-09-13T17:17:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec004380 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec003830 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef40a7790 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.939+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef40a7d50 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.940+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef4158eb0 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.941+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faeec003990 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.941+0000 7faeeb7fe640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 0x7faed406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.941+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faeec089090 con 0x7faef4158ad0 2024-09-13T17:17:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.941+0000 7faef2ffd640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 0x7faed406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.942+0000 7faef2ffd640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 0x7faed406d0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faee4038000 tx=0x7faee4037040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:41.945+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faeec0541c0 con 0x7faef4158ad0 2024-09-13T17:17:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.151+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faef406c6b0 con 0x7faef4158ad0 2024-09-13T17:17:42.154 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:17:42.152+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:17:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.166+0000 7faeeb7fe640 1 -- 172.21.15.5:0/1193483602 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7faeec0577e0 con 0x7faef4158ad0 2024-09-13T17:17:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:17:42.169 INFO:tasks.ceph.mds.c.smithi005.stderr: -1177> 2024-09-13T17:17:21.843+0000 7fed36f6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:17:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 msgr2=0x7faed406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 0x7faed406d0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faee4038000 tx=0x7faee4037040 comp rx=0 tx=0).stop 2024-09-13T17:17:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 msgr2=0x7faef415a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7faeec00c570 tx=0x7faeec00ca30 comp rx=0 tx=0).stop 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 shutdown_connections 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faed406ac00 0x7faed406d0c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faef4158ad0 0x7faef415a860 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faef40b1660 0x7faef41ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 --2- 172.21.15.5:0/1193483602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef40708b0 0x7faef4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 >> 172.21.15.5:0/1193483602 conn(0x7faef406a500 msgr2=0x7faef40ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 shutdown_connections 2024-09-13T17:17:42.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.168+0000 7faef9627640 1 -- 172.21.15.5:0/1193483602 wait complete. 2024-09-13T17:17:42.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:17:42.196 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:17:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.284+0000 7fb0b7a32640 1 Processor -- start 2024-09-13T17:17:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.284+0000 7fb0b7a32640 1 -- start start 2024-09-13T17:17:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b7a32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0b00b1cb0 0x7fb0b00accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b7a32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0b00ad210 0x7fb0b006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b7a32640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00b2d50 con 0x7fb0b015c5d0 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b7a32640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b015c9b0 con 0x7fb0b00ad210 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b7a32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00b2140 con 0x7fb0b00b1cb0 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b5fcf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0b00ad210 0x7fb0b006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b5fcf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0b00ad210 0x7fb0b006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54844/0 (socket says 172.21.15.5:54844) 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b5fcf640 1 -- 172.21.15.5:0/2561754570 learned_addr learned my addr 172.21.15.5:0/2561754570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.285+0000 7fb0b4fcd640 1 --2- 172.21.15.5:0/2561754570 >> v2:172.21.15.179:3300/0 conn(0x7fb0b00b1cb0 0x7fb0b00accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0b5fcf640 1 -- 172.21.15.5:0/2561754570 >> v2:172.21.15.179:3300/0 conn(0x7fb0b00b1cb0 msgr2=0x7fb0b00accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0b5fcf640 1 --2- 172.21.15.5:0/2561754570 >> v2:172.21.15.179:3300/0 conn(0x7fb0b00b1cb0 0x7fb0b00accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0b5fcf640 1 -- 172.21.15.5:0/2561754570 >> v1:172.21.15.179:6789/0 conn(0x7fb0b015c5d0 legacy=0x7fb0b006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0b5fcf640 1 -- 172.21.15.5:0/2561754570 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00b2420 con 0x7fb0b00ad210 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0b5fcf640 1 --2- 172.21.15.5:0/2561754570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b00ad210 0x7fb0b006aee0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0070b20 tx=0x7fb0a802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d193f06f4b99a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.286+0000 7fb0a7fff640 1 -- 172.21.15.5:0/2561754570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8031600 con 0x7fb0b00ad210 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0a7fff640 1 -- 172.21.15.5:0/2561754570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a802d050 con 0x7fb0b00ad210 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0a7fff640 1 -- 172.21.15.5:0/2561754570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8031980 con 0x7fb0b00ad210 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 -- 172.21.15.5:0/2561754570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b00ad210 msgr2=0x7fb0b006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/2561754570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b00ad210 0x7fb0b006aee0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0070b20 tx=0x7fb0a802a730 comp rx=0 tx=0).stop 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 -- 172.21.15.5:0/2561754570 shutdown_connections 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/2561754570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b00ad210 0x7fb0b006aee0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/2561754570 >> v2:172.21.15.179:3300/0 conn(0x7fb0b00b1cb0 0x7fb0b00accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 -- 172.21.15.5:0/2561754570 >> 172.21.15.5:0/2561754570 conn(0x7fb0b0070b70 msgr2=0x7fb0b0070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 -- 172.21.15.5:0/2561754570 shutdown_connections 2024-09-13T17:17:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.287+0000 7fb0b7a32640 1 -- 172.21.15.5:0/2561754570 wait complete. 2024-09-13T17:17:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.288+0000 7fb0b7a32640 1 Processor -- start 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.288+0000 7fb0b7a32640 1 -- start start 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b015c5d0 0x7fb0b01445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b0154800 0x7fb0b00cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0150740 con 0x7fb0b01543a0 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b014fb30 con 0x7fb0b015c5d0 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b7a32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b014fe10 con 0x7fb0b0154800 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b4fcd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b4fcd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54858/0 (socket says 172.21.15.5:54858) 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b4fcd640 1 -- 172.21.15.5:0/1537205025 learned_addr learned my addr 172.21.15.5:0/1537205025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b5fcf640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b0154800 0x7fb0b00cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.289+0000 7fb0b57ce640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b015c5d0 0x7fb0b01445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 -- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b0154800 msgr2=0x7fb0b00cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b0154800 0x7fb0b00cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 -- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b015c5d0 msgr2=0x7fb0b01445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b015c5d0 0x7fb0b01445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 -- 172.21.15.5:0/1537205025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009b30 con 0x7fb0b01543a0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b4fcd640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000d800 tx=0x7fb0a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000b6c0 con 0x7fb0b01543a0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000b820 con 0x7fb0b01543a0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b01500f0 con 0x7fb0b01543a0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000bbb0 con 0x7fb0b01543a0 2024-09-13T17:17:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.290+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0154fa0 con 0x7fb0b01543a0 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.291+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b01508b0 con 0x7fb0b01543a0 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.291+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0a000bd10 con 0x7fb0b01543a0 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.292+0000 7fb0a5ffb640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 0x7fb09406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.292+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fb0a0089890 con 0x7fb0b01543a0 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.292+0000 7fb0b57ce640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 0x7fb09406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.293+0000 7fb0b57ce640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 0x7fb09406d0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac000f60 tx=0x7fb0ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.296+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0a0054a10 con 0x7fb0b01543a0 2024-09-13T17:17:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:42.502+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb0b006aee0 con 0x7fb0b01543a0 2024-09-13T17:17:42.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:17:42.860 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:17:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.167+0000 7fb0a5ffb640 1 -- 172.21.15.5:0/1537205025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb0a0058030 con 0x7fb0b01543a0 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 msgr2=0x7fb09406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 0x7fb09406d0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac000f60 tx=0x7fb0ac009040 comp rx=0 tx=0).stop 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 msgr2=0x7fb0b00cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000d800 tx=0x7fb0a000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 shutdown_connections 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b0154800 0x7fb0b00cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb09406ac30 0x7fb09406d0f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0b01543a0 0x7fb0b00cd950 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 --2- 172.21.15.5:0/1537205025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b015c5d0 0x7fb0b01445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 >> 172.21.15.5:0/1537205025 conn(0x7fb0b0070b70 msgr2=0x7fb0b00b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 shutdown_connections 2024-09-13T17:17:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.170+0000 7fb0b7a32640 1 -- 172.21.15.5:0/1537205025 wait complete. 2024-09-13T17:17:43.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:17:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.289+0000 7f712c6e5640 1 Processor -- start 2024-09-13T17:17:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.289+0000 7f712c6e5640 1 -- start start 2024-09-13T17:17:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.290+0000 7f712c6e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f712406e360 0x7f71240cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.290+0000 7f712c6e5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240b21e0 con 0x7f7124159860 2024-09-13T17:17:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.290+0000 7f712c6e5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240b24c0 con 0x7f712406df80 2024-09-13T17:17:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.290+0000 7f712c6e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71240b27a0 con 0x7f712406e360 2024-09-13T17:17:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f712ac82640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7124159860 0x7f7124159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48382/0 (socket says 172.21.15.5:48382) 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f712ac82640 1 -- 172.21.15.5:0/4002830460 learned_addr learned my addr 172.21.15.5:0/4002830460 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f7129c80640 1 --2- 172.21.15.5:0/4002830460 >> v2:172.21.15.179:3300/0 conn(0x7f712406e360 0x7f71240cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981802990 0 0) 0x7f71240b21e0 con 0x7f7124159860 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7110003520 con 0x7f7124159860 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f7129c80640 1 -- 172.21.15.5:0/4002830460 >> v1:172.21.15.179:6789/0 conn(0x7f712406df80 legacy=0x7f71240b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f7129c80640 1 -- 172.21.15.5:0/4002830460 >> v1:172.21.15.5:6789/0 conn(0x7f7124159860 legacy=0x7f7124159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137759547 0 0) 0x7f7110003520 con 0x7f7124159860 2024-09-13T17:17:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.291+0000 7f7129c80640 1 -- 172.21.15.5:0/4002830460 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240b2a80 con 0x7f712406e360 2024-09-13T17:17:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.292+0000 7f7129c80640 1 --2- 172.21.15.5:0/4002830460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406e360 0x7f71240cb7c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f71140097d0 tx=0x7f711402a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76543817cd0e408f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.292+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0019f0 con 0x7f712406e360 2024-09-13T17:17:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.292+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711402ac90 con 0x7f712406e360 2024-09-13T17:17:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.292+0000 7f712947f640 1 -- 172.21.15.5:0/4002830460 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114032440 con 0x7f712406e360 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 -- 172.21.15.5:0/4002830460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406e360 msgr2=0x7f71240cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 --2- 172.21.15.5:0/4002830460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406e360 0x7f71240cb7c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f71140097d0 tx=0x7f711402a200 comp rx=0 tx=0).stop 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 -- 172.21.15.5:0/4002830460 shutdown_connections 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 --2- 172.21.15.5:0/4002830460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406e360 0x7f71240cb7c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 -- 172.21.15.5:0/4002830460 >> 172.21.15.5:0/4002830460 conn(0x7f7124069ed0 msgr2=0x7f712406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 -- 172.21.15.5:0/4002830460 shutdown_connections 2024-09-13T17:17:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.293+0000 7f712c6e5640 1 -- 172.21.15.5:0/4002830460 wait complete. 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.294+0000 7f712c6e5640 1 Processor -- start 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.294+0000 7f712c6e5640 1 -- start start 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406df80 0x7f71241461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f712406e360 0x7f7124146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240a81f0 con 0x7f7124159860 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71241519a0 con 0x7f712406df80 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712c6e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7124151c80 con 0x7f712406e360 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54866/0 (socket says 172.21.15.5:54866) 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 -- 172.21.15.5:0/806488528 learned_addr learned my addr 172.21.15.5:0/806488528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712a481640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406df80 0x7f71241461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f7129c80640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f712406e360 0x7f7124146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 -- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f712406e360 msgr2=0x7f7124146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f712406e360 0x7f7124146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 -- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406df80 msgr2=0x7f71241461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406df80 0x7f71241461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.295+0000 7f712ac82640 1 -- 172.21.15.5:0/806488528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009400 con 0x7f7124159860 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f712ac82640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f711c00cb80 tx=0x7f711c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00ad40 con 0x7f7124159860 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c012400 con 0x7f7124159860 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7124151f60 con 0x7f7124159860 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00aea0 con 0x7f7124159860 2024-09-13T17:17:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.296+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7124152520 con 0x7f7124159860 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.297+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71240b3800 con 0x7f7124159860 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.297+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f711c007070 con 0x7f7124159860 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.298+0000 7f711affd640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 0x7f710806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.298+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f711c089490 con 0x7f7124159860 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.298+0000 7f712a481640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 0x7f710806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.298+0000 7f712a481640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 0x7f710806d0c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.302+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f711c054610 con 0x7f7124159860 2024-09-13T17:17:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:43.474+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7124152710 con 0x7f7124159860 2024-09-13T17:17:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.171+0000 7f711affd640 1 -- 172.21.15.5:0/806488528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7f711c057c30 con 0x7f7124159860 2024-09-13T17:17:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 msgr2=0x7f710806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 0x7f710806d0c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120009040 comp rx=0 tx=0).stop 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 msgr2=0x7f71240ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f711c00cb80 tx=0x7f711c00a430 comp rx=0 tx=0).stop 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 shutdown_connections 2024-09-13T17:17:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f710806ac00 0x7f710806d0c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7124159860 0x7f71240ae160 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f712406e360 0x7f7124146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 --2- 172.21.15.5:0/806488528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f712406df80 0x7f71241461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 >> 172.21.15.5:0/806488528 conn(0x7f7124069ed0 msgr2=0x7f71240b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 shutdown_connections 2024-09-13T17:17:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.176+0000 7f712c6e5640 1 -- 172.21.15.5:0/806488528 wait complete. 2024-09-13T17:17:44.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:17:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 Processor -- start 2024-09-13T17:17:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 -- start start 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 0x7f94a80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94a80cfd70 0x7f94a8098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80afe00 con 0x7f94a8098f90 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80d0400 con 0x7f94a80cfd70 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.304+0000 7f94ad765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8099440 con 0x7f94a815fe80 2024-09-13T17:17:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94a80cfd70 0x7f94a8098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94a8098f90 0x7f94a806afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56554/0 (socket says 172.21.15.5:56554) 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a77fe640 1 -- 172.21.15.5:0/28546525 learned_addr learned my addr 172.21.15.5:0/28546525 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a6ffd640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 0x7f94a80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a67fc640 1 -- 172.21.15.5:0/28546525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 msgr2=0x7f94a80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a67fc640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 0x7f94a80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a67fc640 1 -- 172.21.15.5:0/28546525 >> v1:172.21.15.5:6789/0 conn(0x7f94a8098f90 legacy=0x7f94a806afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a67fc640 1 -- 172.21.15.5:0/28546525 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80d01b0 con 0x7f94a80cfd70 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a5ffb640 1 -- 172.21.15.5:0/28546525 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260382653 0 0) 0x7f94a80afe00 con 0x7f94a8098f90 2024-09-13T17:17:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.305+0000 7f94a6ffd640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 0x7f94a80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94a67fc640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a80cfd70 0x7f94a8098a50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f949c009800 tx=0x7f949c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e079043ad10464 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94a5ffb640 1 -- 172.21.15.5:0/28546525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c032440 con 0x7f94a80cfd70 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94a5ffb640 1 -- 172.21.15.5:0/28546525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0325a0 con 0x7f94a80cfd70 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94a5ffb640 1 -- 172.21.15.5:0/28546525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c032930 con 0x7f94a80cfd70 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 -- 172.21.15.5:0/28546525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a80cfd70 msgr2=0x7f94a8098a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a80cfd70 0x7f94a8098a50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f949c009800 tx=0x7f949c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 -- 172.21.15.5:0/28546525 shutdown_connections 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a80cfd70 0x7f94a8098a50 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 --2- 172.21.15.5:0/28546525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a815fe80 0x7f94a80d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 -- 172.21.15.5:0/28546525 >> 172.21.15.5:0/28546525 conn(0x7f94a80d0540 msgr2=0x7f94a80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 -- 172.21.15.5:0/28546525 shutdown_connections 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.306+0000 7f94ad765640 1 -- 172.21.15.5:0/28546525 wait complete. 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.308+0000 7f94ad765640 1 Processor -- start 2024-09-13T17:17:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.308+0000 7f94ad765640 1 -- start start 2024-09-13T17:17:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a8098f90 0x7f94a80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a80cfd70 0x7f94a80af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c71c0 con 0x7f94a815fe80 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c42a0 con 0x7f94a80cfd70 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c9ea0 con 0x7f94a8098f90 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46014/0 (socket says 172.21.15.5:46014) 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 -- 172.21.15.5:0/1378038244 learned_addr learned my addr 172.21.15.5:0/1378038244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a6ffd640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a8098f90 0x7f94a80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a67fc640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a80cfd70 0x7f94a80af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 -- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a8098f90 msgr2=0x7f94a80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a8098f90 0x7f94a80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 -- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a80cfd70 msgr2=0x7f94a80af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a80cfd70 0x7f94a80af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 -- 172.21.15.5:0/1378038244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009400 con 0x7f94a815fe80 2024-09-13T17:17:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94a77fe640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c410 tx=0x7f94a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a00074e0 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0007640 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.309+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a80ca180 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.310+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0004a20 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.310+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a80b6090 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.310+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a80ca6a0 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.311+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94a0004b80 con 0x7f94a815fe80 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.311+0000 7f948f7fe640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 0x7f949406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.311+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f94a0088f10 con 0x7f94a815fe80 2024-09-13T17:17:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.312+0000 7f94a6ffd640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 0x7f949406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.312+0000 7f94a6ffd640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 0x7f949406d0f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9498003b80 tx=0x7f9498009890 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.316+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94a80ca6a0 con 0x7f94a815fe80 2024-09-13T17:17:44.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:44.490+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94a80c4070 con 0x7f94a815fe80 2024-09-13T17:17:45.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.174+0000 7f948f7fe640 1 -- 172.21.15.5:0/1378038244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94a80c4070 con 0x7f94a815fe80 2024-09-13T17:17:45.176 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.178+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 msgr2=0x7f949406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.178+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 0x7f949406d0f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9498003b80 tx=0x7f9498009890 comp rx=0 tx=0).stop 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.178+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 msgr2=0x7f94a80b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.178+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c410 tx=0x7f94a000c8d0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 shutdown_connections 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949406ac30 0x7f949406d0f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94a815fe80 0x7f94a80b5b50 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94a80cfd70 0x7f94a80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 --2- 172.21.15.5:0/1378038244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94a8098f90 0x7f94a80c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 >> 172.21.15.5:0/1378038244 conn(0x7f94a80d0540 msgr2=0x7f94a80b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 shutdown_connections 2024-09-13T17:17:45.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.179+0000 7f94ad765640 1 -- 172.21.15.5:0/1378038244 wait complete. 2024-09-13T17:17:45.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:17:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.302+0000 7fc2cb57d640 1 Processor -- start 2024-09-13T17:17:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.302+0000 7fc2cb57d640 1 -- start start 2024-09-13T17:17:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2cb57d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2c406b5f0 0x7fc2c40b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2cb57d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c406f5a0 con 0x7fc2c406d790 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2cb57d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c406d300 con 0x7fc2c415a540 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2cb57d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c406f2c0 con 0x7fc2c406b5f0 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2c8b18640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2c406b5f0 0x7fc2c40b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2c9b1a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2c406d790 0x7fc2c40b2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56560/0 (socket says 172.21.15.5:56560) 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.303+0000 7fc2c9b1a640 1 -- 172.21.15.5:0/4041820744 learned_addr learned my addr 172.21.15.5:0/4041820744 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.304+0000 7fc2c8b18640 1 -- 172.21.15.5:0/4041820744 >> v1:172.21.15.179:6789/0 conn(0x7fc2c415a540 legacy=0x7fc2c406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.304+0000 7fc2bbfff640 1 -- 172.21.15.5:0/4041820744 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317140855 0 0) 0x7fc2c406f5a0 con 0x7fc2c406d790 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.304+0000 7fc2c8b18640 1 -- 172.21.15.5:0/4041820744 >> v1:172.21.15.5:6789/0 conn(0x7fc2c406d790 legacy=0x7fc2c40b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.304+0000 7fc2c8b18640 1 -- 172.21.15.5:0/4041820744 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c406cc30 con 0x7fc2c406b5f0 2024-09-13T17:17:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.304+0000 7fc2c8b18640 1 --2- 172.21.15.5:0/4041820744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c406b5f0 0x7fc2c40b26c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40097a0 tx=0x7fc2b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fc90b477109a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2bbfff640 1 -- 172.21.15.5:0/4041820744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4032440 con 0x7fc2c406b5f0 2024-09-13T17:17:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2bbfff640 1 -- 172.21.15.5:0/4041820744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b40325a0 con 0x7fc2c406b5f0 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2bbfff640 1 -- 172.21.15.5:0/4041820744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4032930 con 0x7fc2c406b5f0 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 -- 172.21.15.5:0/4041820744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c406b5f0 msgr2=0x7fc2c40b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/4041820744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c406b5f0 0x7fc2c40b26c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40097a0 tx=0x7fc2b402a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 -- 172.21.15.5:0/4041820744 shutdown_connections 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/4041820744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c406b5f0 0x7fc2c40b26c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 -- 172.21.15.5:0/4041820744 >> 172.21.15.5:0/4041820744 conn(0x7fc2c4070b70 msgr2=0x7fc2c4070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 -- 172.21.15.5:0/4041820744 shutdown_connections 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.305+0000 7fc2cb57d640 1 -- 172.21.15.5:0/4041820744 wait complete. 2024-09-13T17:17:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.306+0000 7fc2cb57d640 1 Processor -- start 2024-09-13T17:17:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 -- start start 2024-09-13T17:17:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 0x7fc2c414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 0x7fc2c409b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c409c1d0 con 0x7fc2c415a540 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c409c4b0 con 0x7fc2c406d790 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2cb57d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c409c790 con 0x7fc2c406b5f0 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2c9b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2c9b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46030/0 (socket says 172.21.15.5:46030) 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2c9b1a640 1 -- 172.21.15.5:0/639470653 learned_addr learned my addr 172.21.15.5:0/639470653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2c8b18640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 0x7fc2c409b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.307+0000 7fc2c9319640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 0x7fc2c414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 -- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 msgr2=0x7fc2c414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 0x7fc2c414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 -- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 msgr2=0x7fc2c409b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 0x7fc2c409b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 -- 172.21.15.5:0/639470653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009400 con 0x7fc2c415a540 2024-09-13T17:17:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9319640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 0x7fc2c414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c8b18640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 0x7fc2c409b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2c9b1a640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c7a0 tx=0x7fc2bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00a640 con 0x7fc2c415a540 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00a7a0 con 0x7fc2c415a540 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c415bab0 con 0x7fc2c415a540 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00abd0 con 0x7fc2c415a540 2024-09-13T17:17:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.308+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c40cc760 con 0x7fc2c415a540 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.309+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c40cc980 con 0x7fc2c415a540 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.310+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2bc00ad30 con 0x7fc2c415a540 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.310+0000 7fc2b9ffb640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 0x7fc2a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.310+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc2bc088a90 con 0x7fc2c415a540 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.310+0000 7fc2c9319640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 0x7fc2a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.311+0000 7fc2c9319640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 0x7fc2a806d0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0006fd0 tx=0x7fc2c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.314+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2bc053da0 con 0x7fc2c415a540 2024-09-13T17:17:45.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.485+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc2c40afab0 con 0x7fc2c415a540 2024-09-13T17:17:45.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.489+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/639470653 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc2bc018020 con 0x7fc2c415a540 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 msgr2=0x7fc2a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 0x7fc2a806d0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0006fd0 tx=0x7fc2c0008040 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 msgr2=0x7fc2c409bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c7a0 tx=0x7fc2bc00cc60 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 shutdown_connections 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc2a806ac00 0x7fc2a806d0c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c415a540 0x7fc2c409bb50 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c406d790 0x7fc2c409b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 --2- 172.21.15.5:0/639470653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2c406b5f0 0x7fc2c414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 >> 172.21.15.5:0/639470653 conn(0x7fc2c4070b70 msgr2=0x7fc2c40ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 shutdown_connections 2024-09-13T17:17:45.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.491+0000 7fc2cb57d640 1 -- 172.21.15.5:0/639470653 wait complete. 2024-09-13T17:17:45.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.605+0000 7f4b5999c640 1 Processor -- start 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.605+0000 7f4b5999c640 1 -- start start 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b5999c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b5999c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540cbf70 con 0x7f4b540cb510 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b5999c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540cb9b0 con 0x7f4b540703e0 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b5999c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540cbc90 con 0x7f4b54143800 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b527fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4b540cb510 0x7f4b5415aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56564/0 (socket says 172.21.15.5:56564) 2024-09-13T17:17:45.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b527fc640 1 -- 172.21.15.5:0/1960396889 learned_addr learned my addr 172.21.15.5:0/1960396889 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b52ffd640 1 --2- 172.21.15.5:0/1960396889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.606+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316231191 0 0) 0x7f4b540cbf70 con 0x7f4b540cb510 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b40003520 con 0x7f4b540cb510 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930498390 0 0) 0x7f4b540cb9b0 con 0x7f4b540703e0 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b540cbf70 con 0x7f4b540703e0 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b52ffd640 1 -- 172.21.15.5:0/1960396889 >> v1:172.21.15.179:6789/0 conn(0x7f4b540703e0 legacy=0x7f4b540707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b52ffd640 1 -- 172.21.15.5:0/1960396889 >> v1:172.21.15.5:6789/0 conn(0x7f4b540cb510 legacy=0x7f4b5415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.607+0000 7f4b52ffd640 1 -- 172.21.15.5:0/1960396889 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540b1720 con 0x7f4b54143800 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b52ffd640 1 --2- 172.21.15.5:0/1960396889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540cafd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009dc0 tx=0x7f4b4402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1424902a8857c219 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44007740 con 0x7f4b54143800 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4402d050 con 0x7f4b54143800 2024-09-13T17:17:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b51ffb640 1 -- 172.21.15.5:0/1960396889 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44007ac0 con 0x7f4b54143800 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 -- 172.21.15.5:0/1960396889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 msgr2=0x7f4b540cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 --2- 172.21.15.5:0/1960396889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540cafd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009dc0 tx=0x7f4b4402a5b0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 -- 172.21.15.5:0/1960396889 shutdown_connections 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 --2- 172.21.15.5:0/1960396889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540cafd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 -- 172.21.15.5:0/1960396889 >> 172.21.15.5:0/1960396889 conn(0x7f4b540b02f0 msgr2=0x7f4b540b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 -- 172.21.15.5:0/1960396889 shutdown_connections 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.608+0000 7f4b5999c640 1 -- 172.21.15.5:0/1960396889 wait complete. 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 Processor -- start 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 -- start start 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540cb510 0x7f4b541ef790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5415a5c0 con 0x7f4b540703e0 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54132bd0 con 0x7f4b540cb510 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.610+0000 7f4b5999c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5412ff90 con 0x7f4b54143800 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2024-09-13T17:17:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 -- 172.21.15.5:0/3455099239 learned_addr learned my addr 172.21.15.5:0/3455099239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b537fe640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b527fc640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540cb510 0x7f4b541ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 -- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 msgr2=0x7f4b540aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 -- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540cb510 msgr2=0x7f4b541ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540cb510 0x7f4b541ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 -- 172.21.15.5:0/3455099239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009a70 con 0x7f4b540703e0 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b52ffd640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000f80 tx=0x7f4b44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4403c830 con 0x7f4b540703e0 2024-09-13T17:17:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4403c990 con 0x7f4b540703e0 2024-09-13T17:17:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b54130270 con 0x7f4b540703e0 2024-09-13T17:17:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4403cd00 con 0x7f4b540703e0 2024-09-13T17:17:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.611+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54130830 con 0x7f4b540703e0 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.612+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b540672f0 con 0x7f4b540703e0 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.613+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b44031400 con 0x7f4b540703e0 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.614+0000 7f4b4bfff640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 0x7f4b3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.614+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4b440aad00 con 0x7f4b540703e0 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.614+0000 7f4b527fc640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 0x7f4b3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.614+0000 7f4b527fc640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 0x7f4b3406d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b541409f0 tx=0x7f4b3c007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.618+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b44076270 con 0x7f4b540703e0 2024-09-13T17:17:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.791+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f4b54144050 con 0x7f4b540703e0 2024-09-13T17:17:45.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.795+0000 7f4b4bfff640 1 -- 172.21.15.5:0/3455099239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v21) v1 ==== 106+0+0 (secure 0 0 0) 0x7f4b4403ce60 con 0x7f4b540703e0 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 msgr2=0x7f4b3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 0x7f4b3406d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b541409f0 tx=0x7f4b3c007d50 comp rx=0 tx=0).stop 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 msgr2=0x7f4b54132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000f80 tx=0x7f4b44004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 shutdown_connections 2024-09-13T17:17:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b54143800 0x7f4b540aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b540cb510 0x7f4b541ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4b3406ac00 0x7f4b3406d0c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 --2- 172.21.15.5:0/3455099239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b540703e0 0x7f4b54132690 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 >> 172.21.15.5:0/3455099239 conn(0x7f4b540b02f0 msgr2=0x7f4b540cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 shutdown_connections 2024-09-13T17:17:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.797+0000 7f4b5999c640 1 -- 172.21.15.5:0/3455099239 wait complete. 2024-09-13T17:17:45.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-13T17:17:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.910+0000 7fd6c8e53640 1 Processor -- start 2024-09-13T17:17:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.910+0000 7fd6c8e53640 1 -- start start 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c8e53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c41592d0 0x7fd6c406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c8e53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40b3150 con 0x7fd6c406e370 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c8e53640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40b3430 con 0x7fd6c40cb7b0 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c8e53640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c415cf00 con 0x7fd6c41592d0 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c41592d0 0x7fd6c406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c2d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd6c406e370 0x7fd6c415d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56568/0 (socket says 172.21.15.5:56568) 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.911+0000 7fd6c2d9d640 1 -- 172.21.15.5:0/1525333761 learned_addr learned my addr 172.21.15.5:0/1525333761 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.912+0000 7fd6c259c640 1 -- 172.21.15.5:0/1525333761 >> v1:172.21.15.179:6789/0 conn(0x7fd6c40cb7b0 legacy=0x7fd6c406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.912+0000 7fd6c259c640 1 -- 172.21.15.5:0/1525333761 >> v1:172.21.15.5:6789/0 conn(0x7fd6c406e370 legacy=0x7fd6c415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.912+0000 7fd6c259c640 1 -- 172.21.15.5:0/1525333761 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40b3710 con 0x7fd6c41592d0 2024-09-13T17:17:45.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.912+0000 7fd6c159a640 1 -- 172.21.15.5:0/1525333761 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489566075 0 0) 0x7fd6c40b3150 con 0x7fd6c406e370 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.912+0000 7fd6c259c640 1 --2- 172.21.15.5:0/1525333761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c41592d0 0x7fd6c406c440 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009d90 tx=0x7fd6b402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3d54c7761e5077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c159a640 1 -- 172.21.15.5:0/1525333761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4031600 con 0x7fd6c41592d0 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c159a640 1 -- 172.21.15.5:0/1525333761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b402d050 con 0x7fd6c41592d0 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c159a640 1 -- 172.21.15.5:0/1525333761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4031980 con 0x7fd6c41592d0 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 -- 172.21.15.5:0/1525333761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c41592d0 msgr2=0x7fd6c406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/1525333761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c41592d0 0x7fd6c406c440 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009d90 tx=0x7fd6b402a610 comp rx=0 tx=0).stop 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 -- 172.21.15.5:0/1525333761 shutdown_connections 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/1525333761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c41592d0 0x7fd6c406c440 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 -- 172.21.15.5:0/1525333761 >> 172.21.15.5:0/1525333761 conn(0x7fd6c4066200 msgr2=0x7fd6c4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 -- 172.21.15.5:0/1525333761 shutdown_connections 2024-09-13T17:17:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.913+0000 7fd6c8e53640 1 -- 172.21.15.5:0/1525333761 wait complete. 2024-09-13T17:17:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 Processor -- start 2024-09-13T17:17:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 -- start start 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 0x7fd6c4070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6c41592d0 0x7fd6c4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40ab8c0 con 0x7fd6c406e370 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40abad0 con 0x7fd6c40cb7b0 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c8e53640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40abdb0 con 0x7fd6c41592d0 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.915+0000 7fd6c259c640 1 -- 172.21.15.5:0/255645858 learned_addr learned my addr 172.21.15.5:0/255645858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c2d9d640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6c41592d0 0x7fd6c4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c1d9b640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 0x7fd6c4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 -- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6c41592d0 msgr2=0x7fd6c4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6c41592d0 0x7fd6c4150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 -- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 msgr2=0x7fd6c4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 0x7fd6c4070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 -- 172.21.15.5:0/255645858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009a70 con 0x7fd6c406e370 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c1d9b640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 0x7fd6c4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c259c640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009d90 tx=0x7fd6b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40308b0 con 0x7fd6c406e370 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4030a10 con 0x7fd6c406e370 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4030dc0 con 0x7fd6c406e370 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40ac090 con 0x7fd6c406e370 2024-09-13T17:17:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.916+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40cb4b0 con 0x7fd6c406e370 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.917+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40672f0 con 0x7fd6c406e370 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.918+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd6b403c420 con 0x7fd6c406e370 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.918+0000 7fd6baffd640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 0x7fd6a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.918+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd6b40aa930 con 0x7fd6c406e370 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.918+0000 7fd6c1d9b640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 0x7fd6a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.919+0000 7fd6c1d9b640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 0x7fd6a406d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd6c41549e0 tx=0x7fd6ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:45.922+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd6b4075d60 con 0x7fd6c406e370 2024-09-13T17:17:46.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.157+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7fd6c40cdcb0 con 0x7fd6c406e370 2024-09-13T17:17:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.177+0000 7fd6baffd640 1 -- 172.21.15.5:0/255645858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v256) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd6b4079380 con 0x7fd6c406e370 2024-09-13T17:17:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 msgr2=0x7fd6a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 0x7fd6a406d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd6c41549e0 tx=0x7fd6ac009040 comp rx=0 tx=0).stop 2024-09-13T17:17:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 msgr2=0x7fd6c41f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009d90 tx=0x7fd6b4004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 shutdown_connections 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd6c41592d0 0x7fd6c4150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6c40cb7b0 0x7fd6c4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd6a406ac00 0x7fd6a406d0c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 --2- 172.21.15.5:0/255645858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c406e370 0x7fd6c41f6010 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 >> 172.21.15.5:0/255645858 conn(0x7fd6c4066200 msgr2=0x7fd6c40b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 shutdown_connections 2024-09-13T17:17:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.179+0000 7fd6c8e53640 1 -- 172.21.15.5:0/255645858 wait complete. 2024-09-13T17:17:46.193 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-13T17:17:46.194 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-13T17:17:46.194 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:17:46.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.293+0000 7f233503a640 1 Processor -- start 2024-09-13T17:17:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.293+0000 7f233503a640 1 -- start start 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f233503a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f233015c9f0 0x7f23300b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f233503a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233015cdd0 con 0x7f23300cd630 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f233503a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300d3040 con 0x7f23300b5820 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f233503a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23300b8750 con 0x7f233015c9f0 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f232ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f233015c9f0 0x7f23300b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f232e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23300cd630 0x7f23300b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56578/0 (socket says 172.21.15.5:56578) 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.294+0000 7f232e59c640 1 -- 172.21.15.5:0/274725009 learned_addr learned my addr 172.21.15.5:0/274725009 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232ed9d640 1 -- 172.21.15.5:0/274725009 >> v1:172.21.15.179:6789/0 conn(0x7f23300b5820 legacy=0x7f23300b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232ed9d640 1 -- 172.21.15.5:0/274725009 >> v1:172.21.15.5:6789/0 conn(0x7f23300cd630 legacy=0x7f23300b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232dd9b640 1 -- 172.21.15.5:0/274725009 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671466171 0 0) 0x7f233015cdd0 con 0x7f23300cd630 2024-09-13T17:17:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232ed9d640 1 -- 172.21.15.5:0/274725009 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23300cdb10 con 0x7f233015c9f0 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232ed9d640 1 --2- 172.21.15.5:0/274725009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233015c9f0 0x7f23300b4170 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cafff095a8d8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.295+0000 7f232dd9b640 1 -- 172.21.15.5:0/274725009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232802ae50 con 0x7f233015c9f0 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f232dd9b640 1 -- 172.21.15.5:0/274725009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2328032440 con 0x7f233015c9f0 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f232dd9b640 1 -- 172.21.15.5:0/274725009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23280327d0 con 0x7f233015c9f0 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 -- 172.21.15.5:0/274725009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233015c9f0 msgr2=0x7f23300b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 --2- 172.21.15.5:0/274725009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233015c9f0 0x7f23300b4170 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802a140 comp rx=0 tx=0).stop 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 -- 172.21.15.5:0/274725009 shutdown_connections 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 --2- 172.21.15.5:0/274725009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f233015c9f0 0x7f23300b4170 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 -- 172.21.15.5:0/274725009 >> 172.21.15.5:0/274725009 conn(0x7f2330071a20 msgr2=0x7f2330071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 -- 172.21.15.5:0/274725009 shutdown_connections 2024-09-13T17:17:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.296+0000 7f233503a640 1 -- 172.21.15.5:0/274725009 wait complete. 2024-09-13T17:17:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 Processor -- start 2024-09-13T17:17:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 -- start start 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 0x7f23300c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 0x7f2330155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300d2c20 con 0x7f23300cd630 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c8440 con 0x7f23300b5820 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.298+0000 7f233503a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300b4b90 con 0x7f233015c9f0 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46076/0 (socket says 172.21.15.5:46076) 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 -- 172.21.15.5:0/397011927 learned_addr learned my addr 172.21.15.5:0/397011927 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232ed9d640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 0x7f23300c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232f59e640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 0x7f2330155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 -- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 msgr2=0x7f2330155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 0x7f2330155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 -- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 msgr2=0x7f23300c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 0x7f23300c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 -- 172.21.15.5:0/397011927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009400 con 0x7f23300cd630 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232f59e640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 0x7f2330155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232ed9d640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 0x7f23300c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f232e59c640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f231800c470 tx=0x7f231800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180074e0 con 0x7f23300cd630 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318007640 con 0x7f23300cd630 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23301564a0 con 0x7f23300cd630 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318004a20 con 0x7f23300cd630 2024-09-13T17:17:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.299+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23300c7b10 con 0x7f23300cd630 2024-09-13T17:17:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.300+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300b5cd0 con 0x7f23300cd630 2024-09-13T17:17:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.301+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2318004b80 con 0x7f23300cd630 2024-09-13T17:17:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.301+0000 7f23277fe640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 0x7f231006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.301+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f23180886a0 con 0x7f23300cd630 2024-09-13T17:17:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.302+0000 7f232ed9d640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 0x7f231006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.302+0000 7f232ed9d640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 0x7f231006d0c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2328034000 tx=0x7f232802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.305+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2318053a30 con 0x7f23300cd630 2024-09-13T17:17:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.477+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23300c8580 con 0x7f23300cd630 2024-09-13T17:17:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.477+0000 7f23277fe640 1 -- 172.21.15.5:0/397011927 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+13154 (secure 0 0 0) 0x7f2318018090 con 0x7f23300cd630 2024-09-13T17:17:46.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:46.480 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:45.171843+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1039859962":"2024-09-14T17:17:42.153529+0000","172.21.15.5:6834/1039859962":"2024-09-14T17:17:42.153529+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 msgr2=0x7f231006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 0x7f231006d0c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2328034000 tx=0x7f232802e000 comp rx=0 tx=0).stop 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 msgr2=0x7f23300b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f231800c470 tx=0x7f231800c930 comp rx=0 tx=0).stop 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 shutdown_connections 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f233015c9f0 0x7f2330155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f231006ac00 0x7f231006d0c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23300cd630 0x7f23300b4650 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 --2- 172.21.15.5:0/397011927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23300b5820 0x7f23300c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 >> 172.21.15.5:0/397011927 conn(0x7f2330071a20 msgr2=0x7f23300b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 shutdown_connections 2024-09-13T17:17:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.480+0000 7f233503a640 1 -- 172.21.15.5:0/397011927 wait complete. 2024-09-13T17:17:46.493 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:46.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.596+0000 7fd4a749c640 1 Processor -- start 2024-09-13T17:17:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.596+0000 7fd4a749c640 1 -- start start 2024-09-13T17:17:46.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a749c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a749c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a749c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00ad2b0 con 0x7fd4a006a410 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a749c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a006a8a0 con 0x7fd4a00acda0 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a749c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00ad590 con 0x7fd4a015c470 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a4a37640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a5238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a4a37640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:53480/0 (socket says 172.21.15.5:53480) 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a4a37640 1 -- 172.21.15.5:0/3796819686 learned_addr learned my addr 172.21.15.5:0/3796819686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a5238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55332/0 (socket says 172.21.15.5:55332) 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.597+0000 7fd4a5a39640 1 --1- 172.21.15.5:0/3796819686 >> v1:172.21.15.179:6789/0 conn(0x7fd4a006a410 0x7fd4a00aec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:41970/0 (socket says 172.21.15.5:41970) 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a5238640 1 -- 172.21.15.5:0/3796819686 >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 msgr2=0x7fd4a0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a5238640 1 --2- 172.21.15.5:0/3796819686 >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a5238640 1 -- 172.21.15.5:0/3796819686 >> v1:172.21.15.179:6789/0 conn(0x7fd4a006a410 legacy=0x7fd4a00aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd497fff640 1 -- 172.21.15.5:0/3796819686 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234599944 0 0) 0x7fd4a00ad2b0 con 0x7fd4a006a410 2024-09-13T17:17:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a5238640 1 -- 172.21.15.5:0/3796819686 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00ad870 con 0x7fd4a015c470 2024-09-13T17:17:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a4a37640 1 --2- 172.21.15.5:0/3796819686 >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.598+0000 7fd4a5238640 1 --2- 172.21.15.5:0/3796819686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097a0 tx=0x7fd49c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a0265d89f2fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd497fff640 1 -- 172.21.15.5:0/3796819686 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c032440 con 0x7fd4a015c470 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd497fff640 1 -- 172.21.15.5:0/3796819686 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c0325a0 con 0x7fd4a015c470 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd497fff640 1 -- 172.21.15.5:0/3796819686 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c032930 con 0x7fd4a015c470 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 -- 172.21.15.5:0/3796819686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 msgr2=0x7fd4a00b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 --2- 172.21.15.5:0/3796819686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097a0 tx=0x7fd49c02a180 comp rx=0 tx=0).stop 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 -- 172.21.15.5:0/3796819686 shutdown_connections 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 --2- 172.21.15.5:0/3796819686 >> v2:172.21.15.179:3300/0 conn(0x7fd4a00acda0 0x7fd4a0069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 --2- 172.21.15.5:0/3796819686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a015c470 0x7fd4a00b0340 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 -- 172.21.15.5:0/3796819686 >> 172.21.15.5:0/3796819686 conn(0x7fd4a0071970 msgr2=0x7fd4a0098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 -- 172.21.15.5:0/3796819686 shutdown_connections 2024-09-13T17:17:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.599+0000 7fd4a749c640 1 -- 172.21.15.5:0/3796819686 wait complete. 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.600+0000 7fd4a749c640 1 Processor -- start 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 -- start start 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 0x7fd4a01595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 0x7fd4a0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a015e870 con 0x7fd4a00acda0 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0159ae0 con 0x7fd4a015c470 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a749c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a015a920 con 0x7fd4a006a410 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a4a37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a4a37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46092/0 (socket says 172.21.15.5:46092) 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.601+0000 7fd4a4a37640 1 -- 172.21.15.5:0/2290913514 learned_addr learned my addr 172.21.15.5:0/2290913514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a5238640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 0x7fd4a01595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a5a39640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 0x7fd4a0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 -- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 msgr2=0x7fd4a01595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 0x7fd4a01595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 -- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 msgr2=0x7fd4a0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 0x7fd4a0153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 -- 172.21.15.5:0/2290913514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900094d0 con 0x7fd4a00acda0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a5a39640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 0x7fd4a0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a5238640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 0x7fd4a01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a4a37640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ea00 tx=0x7fd49000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000ca60 con 0x7fd4a00acda0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000cbc0 con 0x7fd4a00acda0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c009400 con 0x7fd4a00acda0 2024-09-13T17:17:46.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490013470 con 0x7fd4a00acda0 2024-09-13T17:17:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.602+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0159dc0 con 0x7fd4a00acda0 2024-09-13T17:17:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.603+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00afbb0 con 0x7fd4a00acda0 2024-09-13T17:17:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.604+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4900135d0 con 0x7fd4a00acda0 2024-09-13T17:17:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.604+0000 7fd495ffb640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 0x7fd48406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.604+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd4900898f0 con 0x7fd4a00acda0 2024-09-13T17:17:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.605+0000 7fd4a5238640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 0x7fd48406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.605+0000 7fd4a5238640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 0x7fd48406d0c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd49c034000 tx=0x7fd49c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.608+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd490054c00 con 0x7fd4a00acda0 2024-09-13T17:17:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.784+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4a00cd180 con 0x7fd4a00acda0 2024-09-13T17:17:46.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.784+0000 7fd495ffb640 1 -- 172.21.15.5:0/2290913514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4900210a0 con 0x7fd4a00acda0 2024-09-13T17:17:46.786 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 msgr2=0x7fd48406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 0x7fd48406d0c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd49c034000 tx=0x7fd49c02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 msgr2=0x7fd4a0147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ea00 tx=0x7fd49000eec0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 shutdown_connections 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a015c470 0x7fd4a0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd48406ac00 0x7fd48406d0c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a00acda0 0x7fd4a0147f00 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 --2- 172.21.15.5:0/2290913514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a006a410 0x7fd4a01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 >> 172.21.15.5:0/2290913514 conn(0x7fd4a0071970 msgr2=0x7fd4a0152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 shutdown_connections 2024-09-13T17:17:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.786+0000 7fd4a749c640 1 -- 172.21.15.5:0/2290913514 wait complete. 2024-09-13T17:17:46.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-13T17:17:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.899+0000 7f176839c640 1 Processor -- start 2024-09-13T17:17:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.899+0000 7f176839c640 1 -- start start 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f176839c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176015a4a0 0x7f17600cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f176839c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17600cb6c0 0x7f17600cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f176839c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600b2180 con 0x7f176015a880 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f176839c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600cdab0 con 0x7f176015a4a0 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f176839c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600b2420 con 0x7f17600cb6c0 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f1766138640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176015a4a0 0x7f17600cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f1766138640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176015a4a0 0x7f17600cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46106/0 (socket says 172.21.15.5:46106) 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f1766138640 1 -- 172.21.15.5:0/940684153 learned_addr learned my addr 172.21.15.5:0/940684153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.900+0000 7f1766939640 1 --2- 172.21.15.5:0/940684153 >> v2:172.21.15.179:3300/0 conn(0x7f17600cb6c0 0x7f17600cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.901+0000 7f1766138640 1 -- 172.21.15.5:0/940684153 >> v2:172.21.15.179:3300/0 conn(0x7f17600cb6c0 msgr2=0x7f17600cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.901+0000 7f1766138640 1 --2- 172.21.15.5:0/940684153 >> v2:172.21.15.179:3300/0 conn(0x7f17600cb6c0 0x7f17600cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.901+0000 7f1766138640 1 -- 172.21.15.5:0/940684153 >> v1:172.21.15.179:6789/0 conn(0x7f176015a880 legacy=0x7f17600cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.901+0000 7f1766138640 1 -- 172.21.15.5:0/940684153 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600b2700 con 0x7f176015a4a0 2024-09-13T17:17:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.901+0000 7f1766138640 1 --2- 172.21.15.5:0/940684153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f17600cdc50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1750009e50 tx=0x7f175002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c90f684900ec768 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f1765136640 1 -- 172.21.15.5:0/940684153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750031600 con 0x7f176015a4a0 2024-09-13T17:17:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f1765136640 1 -- 172.21.15.5:0/940684153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175002d050 con 0x7f176015a4a0 2024-09-13T17:17:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f1765136640 1 -- 172.21.15.5:0/940684153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750031980 con 0x7f176015a4a0 2024-09-13T17:17:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 -- 172.21.15.5:0/940684153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 msgr2=0x7f17600cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 --2- 172.21.15.5:0/940684153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f17600cdc50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1750009e50 tx=0x7f175002a710 comp rx=0 tx=0).stop 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 -- 172.21.15.5:0/940684153 shutdown_connections 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 --2- 172.21.15.5:0/940684153 >> v2:172.21.15.179:3300/0 conn(0x7f17600cb6c0 0x7f17600cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 --2- 172.21.15.5:0/940684153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f17600cdc50 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 -- 172.21.15.5:0/940684153 >> 172.21.15.5:0/940684153 conn(0x7f1760066200 msgr2=0x7f1760069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 -- 172.21.15.5:0/940684153 shutdown_connections 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.902+0000 7f176839c640 1 -- 172.21.15.5:0/940684153 wait complete. 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.903+0000 7f176839c640 1 Processor -- start 2024-09-13T17:17:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.903+0000 7f176839c640 1 -- start start 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 0x7f176014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 0x7f1760149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1760150d20 con 0x7f176015a4a0 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1760152fd0 con 0x7f17600cb6c0 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f176839c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1760149370 con 0x7f176015a880 2024-09-13T17:17:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f1765937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f1765937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46110/0 (socket says 172.21.15.5:46110) 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.904+0000 7f1765937640 1 -- 172.21.15.5:0/1574750450 learned_addr learned my addr 172.21.15.5:0/1574750450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1766138640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 0x7f176014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1766939640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 0x7f1760149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 -- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 msgr2=0x7f1760149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 0x7f1760149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 -- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 msgr2=0x7f176014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 0x7f176014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 -- 172.21.15.5:0/1574750450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009b30 con 0x7f176015a4a0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1766138640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 0x7f176014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1766939640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 0x7f1760149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f1765937640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f175400b3c0 tx=0x7f175400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754011830 con 0x7f176015a4a0 2024-09-13T17:17:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754011990 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1760149650 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754011d80 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.905+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1760153550 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.906+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17600672f0 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.906+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f175401b460 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.907+0000 7f175effd640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.907+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1754088d30 con 0x7f176015a4a0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.907+0000 7f1766138640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.908+0000 7f1766138640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 0x7f174c06d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1750033000 tx=0x7f1750009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:46.911+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f17540540c0 con 0x7f176015a4a0 2024-09-13T17:17:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.146+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f1760153770 con 0x7f176015a4a0 2024-09-13T17:17:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.178+0000 7f175effd640 1 -- 172.21.15.5:0/1574750450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v257) v1 ==== 148+0+0 (secure 0 0 0) 0x7f17540576e0 con 0x7f176015a4a0 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 msgr2=0x7f174c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 0x7f174c06d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1750033000 tx=0x7f1750009000 comp rx=0 tx=0).stop 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 msgr2=0x7f1760149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f175400b3c0 tx=0x7f175400b880 comp rx=0 tx=0).stop 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 shutdown_connections 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.180+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f176015a880 0x7f1760149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176015a4a0 0x7f1760149990 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 --2- 172.21.15.5:0/1574750450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17600cb6c0 0x7f176014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 >> 172.21.15.5:0/1574750450 conn(0x7f1760066200 msgr2=0x7f17600af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 shutdown_connections 2024-09-13T17:17:47.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.181+0000 7f176839c640 1 -- 172.21.15.5:0/1574750450 wait complete. 2024-09-13T17:17:47.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:17:47.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.295+0000 7f73d093e640 1 Processor -- start 2024-09-13T17:17:47.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.295+0000 7f73d093e640 1 -- start start 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73d093e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73d093e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73d093e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0b0ec0 con 0x7f73cc145df0 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73d093e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc06a8a0 con 0x7f73cc0b2850 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73d093e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0aefc0 con 0x7f73cc06a410 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73c9d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73cad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73ca59c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f73cc145df0 0x7f73cc0b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:41988/0 (socket says 172.21.15.5:41988) 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73c9d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:53518/0 (socket says 172.21.15.5:53518) 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73ca59c640 1 -- 172.21.15.5:0/673546187 learned_addr learned my addr 172.21.15.5:0/673546187 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.296+0000 7f73cad9d640 1 --2- 172.21.15.5:0/673546187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55354/0 (socket says 172.21.15.5:55354) 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73cad9d640 1 -- 172.21.15.5:0/673546187 >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 msgr2=0x7f73cc069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73cad9d640 1 --2- 172.21.15.5:0/673546187 >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73cad9d640 1 -- 172.21.15.5:0/673546187 >> v1:172.21.15.179:6789/0 conn(0x7f73cc145df0 legacy=0x7f73cc0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73cad9d640 1 -- 172.21.15.5:0/673546187 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0af230 con 0x7f73cc06a410 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73c959a640 1 -- 172.21.15.5:0/673546187 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555121979 0 0) 0x7f73cc0b0ec0 con 0x7f73cc145df0 2024-09-13T17:17:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.297+0000 7f73c9d9b640 1 --2- 172.21.15.5:0/673546187 >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73cad9d640 1 --2- 172.21.15.5:0/673546187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0097d0 tx=0x7f73bc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9231a0c1279d9c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73c959a640 1 -- 172.21.15.5:0/673546187 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032440 con 0x7f73cc06a410 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73c959a640 1 -- 172.21.15.5:0/673546187 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0325a0 con 0x7f73cc06a410 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73c959a640 1 -- 172.21.15.5:0/673546187 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032930 con 0x7f73cc06a410 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 -- 172.21.15.5:0/673546187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 msgr2=0x7f73cc0ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 --2- 172.21.15.5:0/673546187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0097d0 tx=0x7f73bc02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 -- 172.21.15.5:0/673546187 shutdown_connections 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 --2- 172.21.15.5:0/673546187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc06a410 0x7f73cc0ac320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 --2- 172.21.15.5:0/673546187 >> v2:172.21.15.179:3300/0 conn(0x7f73cc0b2850 0x7f73cc069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 -- 172.21.15.5:0/673546187 >> 172.21.15.5:0/673546187 conn(0x7f73cc0b4af0 msgr2=0x7f73cc098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 -- 172.21.15.5:0/673546187 shutdown_connections 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.298+0000 7f73d093e640 1 -- 172.21.15.5:0/673546187 wait complete. 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 Processor -- start 2024-09-13T17:17:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 -- start start 2024-09-13T17:17:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc06a410 0x7f73cc136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc145df0 0x7f73cc160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc1369c0 con 0x7f73cc0b2850 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc09aea0 con 0x7f73cc06a410 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.300+0000 7f73d093e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc09b180 con 0x7f73cc145df0 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46112/0 (socket says 172.21.15.5:46112) 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 -- 172.21.15.5:0/3905203133 learned_addr learned my addr 172.21.15.5:0/3905203133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73cad9d640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc145df0 0x7f73cc160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73ca59c640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc06a410 0x7f73cc136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 -- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc145df0 msgr2=0x7f73cc160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc145df0 0x7f73cc160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 -- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc06a410 msgr2=0x7f73cc136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc06a410 0x7f73cc136480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 -- 172.21.15.5:0/3905203133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009400 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c9d9b640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f73b400ebe0 tx=0x7f73b400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4009760 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400cc30 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc009400 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400eee0 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.301+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc09b740 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.302+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc1461d0 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.303+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73b4013470 con 0x7f73cc0b2850 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.303+0000 7f73c2ffd640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 0x7f73ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.303+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f73b40893a0 con 0x7f73cc0b2850 2024-09-13T17:17:47.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.303+0000 7f73ca59c640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 0x7f73ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.304+0000 7f73ca59c640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 0x7f73ac06d0f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73c40012e0 tx=0x7f73c4001700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.307+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73b4054880 con 0x7f73cc0b2850 2024-09-13T17:17:47.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.479+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73cc0aed00 con 0x7f73cc0b2850 2024-09-13T17:17:47.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.483+0000 7f73c2ffd640 1 -- 172.21.15.5:0/3905203133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73b4057ea0 con 0x7f73cc0b2850 2024-09-13T17:17:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 msgr2=0x7f73ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 0x7f73ac06d0f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73c40012e0 tx=0x7f73c4001700 comp rx=0 tx=0).stop 2024-09-13T17:17:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 msgr2=0x7f73cc09bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f73b400ebe0 tx=0x7f73b400c520 comp rx=0 tx=0).stop 2024-09-13T17:17:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 shutdown_connections 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73cc145df0 0x7f73cc160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f73ac06ac30 0x7f73ac06d0f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc0b2850 0x7f73cc09bf40 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 --2- 172.21.15.5:0/3905203133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73cc06a410 0x7f73cc136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 >> 172.21.15.5:0/3905203133 conn(0x7f73cc0b4af0 msgr2=0x7f73cc144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 shutdown_connections 2024-09-13T17:17:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.485+0000 7f73d093e640 1 -- 172.21.15.5:0/3905203133 wait complete. 2024-09-13T17:17:47.498 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:17:47.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:47.543 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:17:47.592 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:17:47.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:47.592 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:47.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:47.609 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:47.609 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:47.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:47.627 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:17:47.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:47.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:17:47.666 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:17:47.666 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:17:47.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:17:47.685 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:17:47.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.805+0000 7ff91aa9c640 1 Processor -- start 2024-09-13T17:17:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.805+0000 7ff91aa9c640 1 -- start start 2024-09-13T17:17:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff91aa9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff91aa9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff9140cdcb0 0x7ff91406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff91aa9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9140b3150 con 0x7ff9141592d0 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff91aa9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91415cf00 con 0x7ff9140cdcb0 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff91aa9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140b3430 con 0x7ff9140cb7b0 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff913fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff919039640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff9140cdcb0 0x7ff91406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff913fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55370/0 (socket says 172.21.15.5:55370) 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.806+0000 7ff913fff640 1 -- 172.21.15.5:0/2415272133 learned_addr learned my addr 172.21.15.5:0/2415272133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.807+0000 7ff919039640 1 -- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 msgr2=0x7ff91406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.807+0000 7ff919039640 1 --2- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.807+0000 7ff919039640 1 -- 172.21.15.5:0/2415272133 >> v1:172.21.15.179:6789/0 conn(0x7ff9141592d0 legacy=0x7ff91406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.807+0000 7ff919039640 1 -- 172.21.15.5:0/2415272133 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140b3710 con 0x7ff9140cdcb0 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.807+0000 7ff919039640 1 --2- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9140cdcb0 0x7ff91406e1a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00bfa0 tx=0x7ff90c02c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307772d9224cf2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff9137fe640 1 -- 172.21.15.5:0/2415272133 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c009540 con 0x7ff9140cdcb0 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff9137fe640 1 -- 172.21.15.5:0/2415272133 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c02f050 con 0x7ff9140cdcb0 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff9137fe640 1 -- 172.21.15.5:0/2415272133 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0098c0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 -- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9140cdcb0 msgr2=0x7ff91406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9140cdcb0 0x7ff91406e1a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00bfa0 tx=0x7ff90c02c7e0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 -- 172.21.15.5:0/2415272133 shutdown_connections 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9140cdcb0 0x7ff91406e1a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/2415272133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 -- 172.21.15.5:0/2415272133 >> 172.21.15.5:0/2415272133 conn(0x7ff914066200 msgr2=0x7ff914069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 -- 172.21.15.5:0/2415272133 shutdown_connections 2024-09-13T17:17:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.808+0000 7ff91aa9c640 1 -- 172.21.15.5:0/2415272133 wait complete. 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.809+0000 7ff91aa9c640 1 Processor -- start 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.809+0000 7ff91aa9c640 1 -- start start 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9141592d0 0x7ff91415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91413c3b0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91413cb40 con 0x7ff9141592d0 2024-09-13T17:17:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff91aa9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91413ce20 con 0x7ff9140cb7b0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46120/0 (socket says 172.21.15.5:46120) 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff913fff640 1 -- 172.21.15.5:0/1954361114 learned_addr learned my addr 172.21.15.5:0/1954361114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.810+0000 7ff918838640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff919039640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9141592d0 0x7ff91415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 -- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 msgr2=0x7ff91414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 -- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9141592d0 msgr2=0x7ff91415ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9141592d0 0x7ff91415ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 -- 172.21.15.5:0/1954361114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c00bc80 con 0x7ff9140cdcb0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff913fff640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7ff90000e870 tx=0x7ff90000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000c8e0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90000ca40 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000cdb0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91413d100 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.811+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91413d6c0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.812+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9140672f0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.813+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff900013470 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.813+0000 7ff9117fa640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 0x7ff8f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.813+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff9000891c0 con 0x7ff9140cdcb0 2024-09-13T17:17:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.813+0000 7ff918838640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 0x7ff8f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.814+0000 7ff918838640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 0x7ff8f806d0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f60 tx=0x7ff908009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:47.817+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff9000546a0 con 0x7ff9140cdcb0 2024-09-13T17:17:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.023+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9140aebb0 con 0x7ff9140cdcb0 2024-09-13T17:17:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.023+0000 7ff9117fa640 1 -- 172.21.15.5:0/1954361114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3526 (secure 0 0 0) 0x7ff900017de0 con 0x7ff9140cdcb0 2024-09-13T17:17:48.026 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:48.026 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/378967949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":378967949},{"type":"v1","addr":"172.21.15.179:6836","nonce":378967949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1875629099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1875629099},{"type":"v1","addr":"172.21.15.179:6837","nonce":1875629099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2911141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2911141601},{"type":"v1","addr":"172.21.15.5:6833","nonce":2911141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7641,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3505930577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3505930577},{"type":"v1","addr":"172.21.15.5:6835","nonce":3505930577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2024-09-13T17:17:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 38 2024-09-13T17:17:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 msgr2=0x7ff8f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 0x7ff8f806d0c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f60 tx=0x7ff908009040 comp rx=0 tx=0).stop 2024-09-13T17:17:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 msgr2=0x7ff91413be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7ff90000e870 tx=0x7ff90000ed30 comp rx=0 tx=0).stop 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 shutdown_connections 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9141592d0 0x7ff91415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8f806ac00 0x7ff8f806d0c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9140cdcb0 0x7ff91413be70 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 --2- 172.21.15.5:0/1954361114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9140cb7b0 0x7ff91414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 >> 172.21.15.5:0/1954361114 conn(0x7ff914066200 msgr2=0x7ff9140af320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 shutdown_connections 2024-09-13T17:17:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.025+0000 7ff91aa9c640 1 -- 172.21.15.5:0/1954361114 wait complete. 2024-09-13T17:17:48.039 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:17:48.039 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:17:48.039 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:17:48.039 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:48.039 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:17:48.040 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:17:48.040 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:17:48.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:48.040 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:17:48.040 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:17:48.040 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:17:48.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:48.040 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:17:48.041 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:17:48.041 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:17:48.041 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:17:48.049 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:17:48.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:17:48.050 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:17:48.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:17:48.052 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:17:48.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:17:48.053 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:17:48.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:17:48.093 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:17:48.093 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:48.093 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:17:48.094 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:48.095 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:17:48.096 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:48.096 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:17:48.097 DEBUG:teuthology.parallel:result is None 2024-09-13T17:17:48.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:17:48.170 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:17:48.170 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:17:48.179 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:17:48.180 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:17:48.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.208+0000 7f0aafeb8640 1 Processor -- start 2024-09-13T17:17:48.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.208+0000 7f0aafeb8640 1 -- start start 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aafeb8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aa80b6fa0 0x7f0aa80d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aafeb8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80b5ab0 con 0x7f0aa815c920 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aadc54640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0aa815c920 0x7f0aa80d22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56600/0 (socket says 172.21.15.5:56600) 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aadc54640 1 -- 172.21.15.5:0/4244411514 learned_addr learned my addr 172.21.15.5:0/4244411514 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80d0ff0 con 0x7f0aa80d29b0 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aae455640 1 --2- 172.21.15.5:0/4244411514 >> v2:172.21.15.5:3300/0 conn(0x7f0aa80b6fa0 0x7f0aa80d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80d1b70 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aacc52640 1 -- 172.21.15.5:0/4244411514 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177878688 0 0) 0x7f0aa80b5ab0 con 0x7f0aa815c920 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aacc52640 1 -- 172.21.15.5:0/4244411514 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a94003520 con 0x7f0aa815c920 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aae455640 1 -- 172.21.15.5:0/4244411514 >> v1:172.21.15.179:6789/0 conn(0x7f0aa80d29b0 legacy=0x7f0aa80d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aae455640 1 -- 172.21.15.5:0/4244411514 >> v1:172.21.15.5:6789/0 conn(0x7f0aa815c920 legacy=0x7f0aa80d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.209+0000 7f0aae455640 1 -- 172.21.15.5:0/4244411514 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80d12d0 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.210+0000 7f0aae455640 1 --2- 172.21.15.5:0/4244411514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa80b6fa0 0x7f0aa80d09f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009dc0 tx=0x7f0aa002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af94fa4f7d29cac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.210+0000 7f0aacc52640 1 -- 172.21.15.5:0/4244411514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0007740 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.210+0000 7f0aacc52640 1 -- 172.21.15.5:0/4244411514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa002d050 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.210+0000 7f0aacc52640 1 -- 172.21.15.5:0/4244411514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0007aa0 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa80b6fa0 msgr2=0x7f0aa80d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/4244411514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa80b6fa0 0x7f0aa80d09f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009dc0 tx=0x7f0aa002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 shutdown_connections 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/4244411514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa80b6fa0 0x7f0aa80d09f0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 >> 172.21.15.5:0/4244411514 conn(0x7f0aa8071c30 msgr2=0x7f0aa806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 shutdown_connections 2024-09-13T17:17:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.211+0000 7f0aafeb8640 1 -- 172.21.15.5:0/4244411514 wait complete. 2024-09-13T17:17:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.212+0000 7f0aafeb8640 1 Processor -- start 2024-09-13T17:17:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.212+0000 7f0aafeb8640 1 -- start start 2024-09-13T17:17:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa80b6fa0 0x7f0aa8150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa80d29b0 0x7f0aa81537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8157ea0 con 0x7f0aa815c920 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa815dee0 con 0x7f0aa80d29b0 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aafeb8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa815dc00 con 0x7f0aa80b6fa0 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aae455640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aae455640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46190/0 (socket says 172.21.15.5:46190) 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aadc54640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa80b6fa0 0x7f0aa8150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aae455640 1 -- 172.21.15.5:0/3214815060 learned_addr learned my addr 172.21.15.5:0/3214815060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.213+0000 7f0aad453640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa80d29b0 0x7f0aa81537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 -- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa80b6fa0 msgr2=0x7f0aa8150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa80b6fa0 0x7f0aa8150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 -- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa80d29b0 msgr2=0x7f0aa81537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa80d29b0 0x7f0aa81537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 -- 172.21.15.5:0/3214815060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009a70 con 0x7f0aa815c920 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aae455640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009eb0 tx=0x7f0aa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0031c70 con 0x7f0aa815c920 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa0031df0 con 0x7f0aa815c920 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa81578e0 con 0x7f0aa815c920 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0003bd0 con 0x7f0aa815c920 2024-09-13T17:17:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.214+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa8151290 con 0x7f0aa815c920 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.215+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa80672f0 con 0x7f0aa815c920 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.216+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0aa0003d30 con 0x7f0aa815c920 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.217+0000 7f0a9e7fc640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.217+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0aa00aa2e0 con 0x7f0aa815c920 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.217+0000 7f0aadc54640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.217+0000 7f0aadc54640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40011e0 tx=0x7f0aa4007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:48.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.221+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0aa0075730 con 0x7f0aa815c920 2024-09-13T17:17:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:48.403+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0aa8156530 con 0x7f0aa815c920 2024-09-13T17:17:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.196+0000 7f0a9e7fc640 1 -- 172.21.15.5:0/3214815060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0aa0009450 con 0x7f0aa815c920 2024-09-13T17:17:49.198 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:17:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 msgr2=0x7f0a8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40011e0 tx=0x7f0aa4007d30 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 msgr2=0x7f0aa8158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009eb0 tx=0x7f0aa0004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 shutdown_connections 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0a8c06ac00 0x7f0a8c06d0c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa815c920 0x7f0aa8158160 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0aa80d29b0 0x7f0aa81537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 --2- 172.21.15.5:0/3214815060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0aa80b6fa0 0x7f0aa8150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 >> 172.21.15.5:0/3214815060 conn(0x7f0aa8071c30 msgr2=0x7f0aa80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 shutdown_connections 2024-09-13T17:17:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.198+0000 7f0aafeb8640 1 -- 172.21.15.5:0/3214815060 wait complete. 2024-09-13T17:17:49.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:17:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.320+0000 7f2a46b4c640 1 Processor -- start 2024-09-13T17:17:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.320+0000 7f2a46b4c640 1 -- start start 2024-09-13T17:17:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a46b4c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a4015a880 0x7f2a400cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a46b4c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 0x7f2a400cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a46b4c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a400b2180 con 0x7f2a4015a4a0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a46b4c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400cdab0 con 0x7f2a4015a880 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a46b4c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b2420 con 0x7f2a400cb6c0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a448e8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a4015a4a0 0x7f2a400cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56612/0 (socket says 172.21.15.5:56612) 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a448e8640 1 -- 172.21.15.5:0/2258996632 learned_addr learned my addr 172.21.15.5:0/2258996632 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a3ffff640 1 --2- 172.21.15.5:0/2258996632 >> v2:172.21.15.179:3300/0 conn(0x7f2a4015a880 0x7f2a400cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a450e9640 1 --2- 172.21.15.5:0/2258996632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 0x7f2a400cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436466001 0 0) 0x7f2a400b2180 con 0x7f2a4015a4a0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a30003520 con 0x7f2a4015a4a0 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a450e9640 1 -- 172.21.15.5:0/2258996632 >> v2:172.21.15.179:3300/0 conn(0x7f2a4015a880 msgr2=0x7f2a400cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a450e9640 1 --2- 172.21.15.5:0/2258996632 >> v2:172.21.15.179:3300/0 conn(0x7f2a4015a880 0x7f2a400cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a450e9640 1 -- 172.21.15.5:0/2258996632 >> v1:172.21.15.5:6789/0 conn(0x7f2a4015a4a0 legacy=0x7f2a400cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934829932 0 0) 0x7f2a30003520 con 0x7f2a4015a4a0 2024-09-13T17:17:49.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.321+0000 7f2a450e9640 1 -- 172.21.15.5:0/2258996632 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400b2700 con 0x7f2a400cb6c0 2024-09-13T17:17:49.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.322+0000 7f2a450e9640 1 --2- 172.21.15.5:0/2258996632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 0x7f2a400cd570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009d90 tx=0x7f2a3802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb4bc5f26a5c178 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.322+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34001670 con 0x7f2a400cb6c0 2024-09-13T17:17:49.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3802d050 con 0x7f2a400cb6c0 2024-09-13T17:17:49.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a3f7fe640 1 -- 172.21.15.5:0/2258996632 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38007760 con 0x7f2a400cb6c0 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 -- 172.21.15.5:0/2258996632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 msgr2=0x7f2a400cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/2258996632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 0x7f2a400cd570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009d90 tx=0x7f2a3802a5f0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 -- 172.21.15.5:0/2258996632 shutdown_connections 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/2258996632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a400cb6c0 0x7f2a400cd570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/2258996632 >> v2:172.21.15.179:3300/0 conn(0x7f2a4015a880 0x7f2a400cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 -- 172.21.15.5:0/2258996632 >> 172.21.15.5:0/2258996632 conn(0x7f2a40066200 msgr2=0x7f2a40069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 -- 172.21.15.5:0/2258996632 shutdown_connections 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.323+0000 7f2a46b4c640 1 -- 172.21.15.5:0/2258996632 wait complete. 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.324+0000 7f2a46b4c640 1 Processor -- start 2024-09-13T17:17:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.324+0000 7f2a46b4c640 1 -- start start 2024-09-13T17:17:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a400cb6c0 0x7f2a40149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 0x7f2a400c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4014a500 con 0x7f2a4015a880 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c3e20 con 0x7f2a400cb6c0 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a46b4c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c4100 con 0x7f2a4015a4a0 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a450e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a450e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46196/0 (socket says 172.21.15.5:46196) 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a450e9640 1 -- 172.21.15.5:0/3014641170 learned_addr learned my addr 172.21.15.5:0/3014641170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.325+0000 7f2a448e8640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a400cb6c0 0x7f2a40149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a3ffff640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 0x7f2a400c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 -- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 msgr2=0x7f2a400c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 0x7f2a400c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 -- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a400cb6c0 msgr2=0x7f2a40149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a400cb6c0 0x7f2a40149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 -- 172.21.15.5:0/3014641170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38009a70 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a3ffff640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 0x7f2a400c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a450e9640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009d90 tx=0x7f2a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3803c830 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3803c990 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a400c43e0 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3803cd00 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.326+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a400c49a0 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.327+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400672f0 con 0x7f2a4015a880 2024-09-13T17:17:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.328+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a3802ad50 con 0x7f2a4015a880 2024-09-13T17:17:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.328+0000 7f2a3d7fa640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 0x7f2a2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.328+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2a380aa6c0 con 0x7f2a4015a880 2024-09-13T17:17:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.328+0000 7f2a448e8640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 0x7f2a2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.329+0000 7f2a448e8640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 0x7f2a2406d0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000f60 tx=0x7f2a34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.333+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a38075ab0 con 0x7f2a4015a880 2024-09-13T17:17:49.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.568+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2a400cd570 con 0x7f2a4015a880 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.569+0000 7f2a3d7fa640 1 -- 172.21.15.5:0/3014641170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2a3803ce60 con 0x7f2a4015a880 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.571 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:17:49.574 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:17:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:17:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:49.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:17:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:49.583 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:49.584 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:17:49.585 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 msgr2=0x7f2a2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 0x7f2a2406d0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000f60 tx=0x7f2a34009040 comp rx=0 tx=0).stop 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 msgr2=0x7f2a400c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009d90 tx=0x7f2a38004a40 comp rx=0 tx=0).stop 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 shutdown_connections 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2a2406ac00 0x7f2a2406d0c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a4015a880 0x7f2a400c4e40 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a4015a4a0 0x7f2a400c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 --2- 172.21.15.5:0/3014641170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a400cb6c0 0x7f2a40149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 >> 172.21.15.5:0/3014641170 conn(0x7f2a40066200 msgr2=0x7f2a40158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 shutdown_connections 2024-09-13T17:17:49.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.571+0000 7f2a46b4c640 1 -- 172.21.15.5:0/3014641170 wait complete. 2024-09-13T17:17:49.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.687+0000 7f3f08525640 1 Processor -- start 2024-09-13T17:17:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.687+0000 7f3f08525640 1 -- start start 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.688+0000 7f3f08525640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f0015c9f0 0x7f3f000b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.688+0000 7f3f08525640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0015cdd0 con 0x7f3f000cd630 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.688+0000 7f3f08525640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f000d3040 con 0x7f3f000b5820 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.688+0000 7f3f08525640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f000b8750 con 0x7f3f0015c9f0 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.688+0000 7f3f062c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f0015c9f0 0x7f3f000b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.689+0000 7f3f05ac0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f000cd630 0x7f3f000b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56614/0 (socket says 172.21.15.5:56614) 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.689+0000 7f3f05ac0640 1 -- 172.21.15.5:0/4287643832 learned_addr learned my addr 172.21.15.5:0/4287643832 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.689+0000 7f3f062c1640 1 -- 172.21.15.5:0/4287643832 >> v1:172.21.15.179:6789/0 conn(0x7f3f000b5820 legacy=0x7f3f000b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.689+0000 7f3f062c1640 1 -- 172.21.15.5:0/4287643832 >> v1:172.21.15.5:6789/0 conn(0x7f3f000cd630 legacy=0x7f3f000b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.689+0000 7f3f062c1640 1 -- 172.21.15.5:0/4287643832 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000cdb10 con 0x7f3f0015c9f0 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f062c1640 1 --2- 172.21.15.5:0/4287643832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0015c9f0 0x7f3f000b4170 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80097a0 tx=0x7f3ef802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f883b66fbc71dd6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f052bf640 1 -- 172.21.15.5:0/4287643832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8032440 con 0x7f3f0015c9f0 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f052bf640 1 -- 172.21.15.5:0/4287643832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef80325a0 con 0x7f3f0015c9f0 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f052bf640 1 -- 172.21.15.5:0/4287643832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8032930 con 0x7f3f0015c9f0 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 -- 172.21.15.5:0/4287643832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0015c9f0 msgr2=0x7f3f000b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 --2- 172.21.15.5:0/4287643832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0015c9f0 0x7f3f000b4170 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80097a0 tx=0x7f3ef802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 -- 172.21.15.5:0/4287643832 shutdown_connections 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 --2- 172.21.15.5:0/4287643832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0015c9f0 0x7f3f000b4170 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 -- 172.21.15.5:0/4287643832 >> 172.21.15.5:0/4287643832 conn(0x7f3f00071a20 msgr2=0x7f3f00071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 -- 172.21.15.5:0/4287643832 shutdown_connections 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.690+0000 7f3f08525640 1 -- 172.21.15.5:0/4287643832 wait complete. 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 Processor -- start 2024-09-13T17:17:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 -- start start 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f000cd630 0x7f3f00152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0015c9f0 0x7f3f0015a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000d2c20 con 0x7f3f000b5820 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f001542b0 con 0x7f3f000cd630 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f08525640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f00154590 con 0x7f3f0015c9f0 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f062c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f062c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46222/0 (socket says 172.21.15.5:46222) 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.692+0000 7f3f062c1640 1 -- 172.21.15.5:0/1119971548 learned_addr learned my addr 172.21.15.5:0/1119971548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f06ac2640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0015c9f0 0x7f3f0015a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f05ac0640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f000cd630 0x7f3f00152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 -- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0015c9f0 msgr2=0x7f3f0015a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0015c9f0 0x7f3f0015a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 -- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f000cd630 msgr2=0x7f3f00152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f000cd630 0x7f3f00152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 -- 172.21.15.5:0/1119971548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8009400 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f062c1640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000c00 tx=0x7f3ef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8030b80 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8030ce0 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef803d680 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f00154870 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.693+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f00154e30 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.694+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f000b5cd0 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.695+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ef8039040 con 0x7f3f000b5820 2024-09-13T17:17:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.695+0000 7f3efeffd640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.695+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3ef80a9d00 con 0x7f3f000b5820 2024-09-13T17:17:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.695+0000 7f3f05ac0640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.696+0000 7f3f05ac0640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3f000cb800 tx=0x7f3ef4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.699+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3ef80751a0 con 0x7f3f000b5820 2024-09-13T17:17:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.870+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f000d1100 con 0x7f3f000b5820 2024-09-13T17:17:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.871+0000 7f3efeffd640 1 -- 172.21.15.5:0/1119971548 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13027 (secure 0 0 0) 0x7f3ef80787c0 con 0x7f3f000b5820 2024-09-13T17:17:49.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:49.874 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:49.194228+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 msgr2=0x7f3eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3f000cb800 tx=0x7f3ef4009040 comp rx=0 tx=0).stop 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 msgr2=0x7f3f001522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000c00 tx=0x7f3ef80046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 shutdown_connections 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f0015c9f0 0x7f3f0015a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f000cd630 0x7f3f00152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 --2- 172.21.15.5:0/1119971548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f000b5820 0x7f3f001522e0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.873+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 >> 172.21.15.5:0/1119971548 conn(0x7f3f00071a20 msgr2=0x7f3f0015ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.874+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 shutdown_connections 2024-09-13T17:17:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.874+0000 7f3f08525640 1 -- 172.21.15.5:0/1119971548 wait complete. 2024-09-13T17:17:49.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:17:49.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:17:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.990+0000 7fbbd9311640 1 Processor -- start 2024-09-13T17:17:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.990+0000 7fbbd9311640 1 -- start start 2024-09-13T17:17:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd9311640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbbd415a690 0x7fbbd40abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd9311640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40cdaa0 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd9311640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40cce90 con 0x7fbbd406b5f0 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd9311640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40cd170 con 0x7fbbd415a690 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd27fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbbd40cb070 0x7fbbd406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56630/0 (socket says 172.21.15.5:56630) 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3980873711 learned_addr learned my addr 172.21.15.5:0/3980873711 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146530220 0 0) 0x7fbbd40cdaa0 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc0003520 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd2ffd640 1 --2- 172.21.15.5:0/3980873711 >> v2:172.21.15.179:3300/0 conn(0x7fbbd415a690 0x7fbbd40abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153717411 0 0) 0x7fbbc0003520 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 >> v2:172.21.15.179:3300/0 conn(0x7fbbd415a690 msgr2=0x7fbbd40abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 --2- 172.21.15.5:0/3980873711 >> v2:172.21.15.179:3300/0 conn(0x7fbbd415a690 0x7fbbd40abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 >> v1:172.21.15.179:6789/0 conn(0x7fbbd406b5f0 legacy=0x7fbbd40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.991+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40cd450 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fbbbc001670 con 0x7fbbd40cb070 2024-09-13T17:17:49.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 >> v1:172.21.15.5:6789/0 conn(0x7fbbd40cb070 legacy=0x7fbbd406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc0003970 0x7fbbc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 0x7fbbc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00052a0 0x7fbbc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40cd170 con 0x7fbbc00047c0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc000c170 con 0x7fbbc00052a0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc000c330 con 0x7fbbc0003970 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 0x7fbbc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd2ffd640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc0003970 0x7fbbc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd37fe640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00052a0 0x7fbbc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc0003970 msgr2=0x7fbbc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbc0003970 0x7fbbc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00052a0 msgr2=0x7fbbc000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00052a0 0x7fbbc000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3980873711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0003520 con 0x7fbbc00047c0 2024-09-13T17:17:49.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.992+0000 7fbbd37fe640 1 -- 172.21.15.5:0/3980873711 reap_dead start 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 0x7fbbc0004c40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c210 tx=0x7fbbc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbad8c794f31d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc005ad0 con 0x7fbbc00047c0 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc02d070 con 0x7fbbc00047c0 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd1ffb640 1 -- 172.21.15.5:0/3980873711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc007070 con 0x7fbbc00047c0 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd9311640 1 -- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 msgr2=0x7fbbc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.993+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 0x7fbbc0004c40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c210 tx=0x7fbbc00057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.994+0000 7fbbd9311640 1 -- 172.21.15.5:0/3980873711 shutdown_connections 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.994+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3980873711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbc00047c0 0x7fbbc0004c40 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.994+0000 7fbbd9311640 1 -- 172.21.15.5:0/3980873711 >> 172.21.15.5:0/3980873711 conn(0x7fbbd40cc570 msgr2=0x7fbbd4070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.994+0000 7fbbd9311640 1 -- 172.21.15.5:0/3980873711 shutdown_connections 2024-09-13T17:17:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.994+0000 7fbbd9311640 1 -- 172.21.15.5:0/3980873711 wait complete. 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.995+0000 7fbbd9311640 1 Processor -- start 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.995+0000 7fbbd9311640 1 -- start start 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00047c0 0x7fbbd4147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbd4099460 0x7fbbd40998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4099e20 con 0x7fbbd414a5d0 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd414b430 con 0x7fbbc00047c0 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd414af70 con 0x7fbbd4099460 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46242/0 (socket says 172.21.15.5:46242) 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3139276149 learned_addr learned my addr 172.21.15.5:0/3139276149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd2ffd640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00047c0 0x7fbbd4147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd37fe640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbd4099460 0x7fbbd40998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbd4099460 msgr2=0x7fbbd40998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbd4099460 0x7fbbd40998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00047c0 msgr2=0x7fbbd4147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00047c0 0x7fbbd4147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 -- 172.21.15.5:0/3139276149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4148c30 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd27fc640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc02ad00 tx=0x7fbbbc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc004ae0 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc004c60 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd409a040 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc007070 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.996+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd41488c0 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.998+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40672c0 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.998+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbbbc02f030 con 0x7fbbd414a5d0 2024-09-13T17:17:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.998+0000 7fbbcb7fe640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 0x7fbbb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.998+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbbbc0a8340 con 0x7fbbd414a5d0 2024-09-13T17:17:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.998+0000 7fbbd2ffd640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 0x7fbbb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:49.999+0000 7fbbd2ffd640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 0x7fbbb406d0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4068b70 tx=0x7fbbc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.003+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbbbc073830 con 0x7fbbd414a5d0 2024-09-13T17:17:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.171+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbd4148dc0 con 0x7fbbd414a5d0 2024-09-13T17:17:50.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.171+0000 7fbbcb7fe640 1 -- 172.21.15.5:0/3139276149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbbc076e50 con 0x7fbbd414a5d0 2024-09-13T17:17:50.174 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:17:50.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 msgr2=0x7fbbb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 0x7fbbb406d0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4068b70 tx=0x7fbbc4008040 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 msgr2=0x7fbbd414aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc02ad00 tx=0x7fbbbc001a00 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 shutdown_connections 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbd4099460 0x7fbbd40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbbb406ac00 0x7fbbb406d0c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbd414a5d0 0x7fbbd414aa30 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 --2- 172.21.15.5:0/3139276149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc00047c0 0x7fbbd4147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 >> 172.21.15.5:0/3139276149 conn(0x7fbbd40cc570 msgr2=0x7fbbd406ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 shutdown_connections 2024-09-13T17:17:50.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.173+0000 7fbbd9311640 1 -- 172.21.15.5:0/3139276149 wait complete. 2024-09-13T17:17:50.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:17:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.286+0000 7f6b03496640 1 Processor -- start 2024-09-13T17:17:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.286+0000 7f6b03496640 1 -- start start 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b03496640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6afc15c680 0x7f6afc0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b03496640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0ac5f0 con 0x7f6afc0ae270 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b03496640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0714c0 con 0x7f6afc0ad090 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b03496640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc071a80 con 0x7f6afc15c680 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b00a31640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6afc0ae270 0x7f6afc0ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56640/0 (socket says 172.21.15.5:56640) 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b00a31640 1 -- 172.21.15.5:0/2827944864 learned_addr learned my addr 172.21.15.5:0/2827944864 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302064928 0 0) 0x7f6afc0ac5f0 con 0x7f6afc0ae270 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6b01232640 1 --2- 172.21.15.5:0/2827944864 >> v2:172.21.15.179:3300/0 conn(0x7f6afc15c680 0x7f6afc0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae8003520 con 0x7f6afc0ae270 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1570771548 0 0) 0x7f6ae8003520 con 0x7f6afc0ae270 2024-09-13T17:17:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 >> v2:172.21.15.179:3300/0 conn(0x7f6afc15c680 msgr2=0x7f6afc0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 --2- 172.21.15.5:0/2827944864 >> v2:172.21.15.179:3300/0 conn(0x7f6afc15c680 0x7f6afc0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 >> v1:172.21.15.179:6789/0 conn(0x7f6afc0ad090 legacy=0x7f6afc0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0717a0 con 0x7f6afc0ae270 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f6aec001670 con 0x7f6afc0ae270 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 >> v1:172.21.15.5:6789/0 conn(0x7f6afc0ae270 legacy=0x7f6afc0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 0x7f6ae8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ae80047c0 0x7f6ae8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.287+0000 7f6af3fff640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8005180 0x7f6ae800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc071a80 con 0x7f6ae8003970 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae800c020 con 0x7f6ae8005180 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae800c1e0 con 0x7f6ae80047c0 2024-09-13T17:17:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 0x7f6ae8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b00a31640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ae80047c0 0x7f6ae8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01a33640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8005180 0x7f6ae800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 -- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ae80047c0 msgr2=0x7f6ae8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ae80047c0 0x7f6ae8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 -- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8005180 msgr2=0x7f6ae800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8005180 0x7f6ae800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01232640 1 -- 172.21.15.5:0/2827944864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8003520 con 0x7f6ae8003970 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01a33640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8005180 0x7f6ae800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.288+0000 7f6b01a33640 1 -- 172.21.15.5:0/2827944864 reap_dead start 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b01232640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 0x7f6ae8003d90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009ac0 tx=0x7f6ae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5ff1258c23ad29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8031400 con 0x7f6ae8003970 2024-09-13T17:17:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af802d050 con 0x7f6ae8003970 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6af3fff640 1 -- 172.21.15.5:0/2827944864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8031780 con 0x7f6ae8003970 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 -- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 msgr2=0x7f6ae8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 0x7f6ae8003d90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009ac0 tx=0x7f6ae80057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 -- 172.21.15.5:0/2827944864 shutdown_connections 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 --2- 172.21.15.5:0/2827944864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ae8003970 0x7f6ae8003d90 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 -- 172.21.15.5:0/2827944864 >> 172.21.15.5:0/2827944864 conn(0x7f6afc0cc610 msgr2=0x7f6afc070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.289+0000 7f6b03496640 1 -- 172.21.15.5:0/2827944864 shutdown_connections 2024-09-13T17:17:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.290+0000 7f6b03496640 1 -- 172.21.15.5:0/2827944864 wait complete. 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 Processor -- start 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 -- start start 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 0x7f6afc147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 0x7f6afc06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc158360 con 0x7f6afc150a20 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc157750 con 0x7f6ae8003970 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.291+0000 7f6b03496640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc157a30 con 0x7f6afc158d30 2024-09-13T17:17:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46264/0 (socket says 172.21.15.5:46264) 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 -- 172.21.15.5:0/3611376285 learned_addr learned my addr 172.21.15.5:0/3611376285 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 -- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 msgr2=0x7f6afc06d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b01a33640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 0x7f6afc06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b01232640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 0x7f6afc147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 0x7f6afc06d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 -- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 msgr2=0x7f6afc147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 0x7f6afc147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 -- 172.21.15.5:0/3611376285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc157d10 con 0x7f6afc150a20 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b01a33640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 0x7f6afc06d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b01232640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 0x7f6afc147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b00a31640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007290 tx=0x7f6aec007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec00fa00 con 0x7f6afc150a20 2024-09-13T17:17:50.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec00fb80 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc157ff0 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0133f0 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.292+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc1504d0 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.294+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc0adcf0 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.294+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6aec013550 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.294+0000 7f6af1ffb640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 0x7f6ae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.294+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6aec0894a0 con 0x7f6afc150a20 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.295+0000 7f6b01232640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 0x7f6ae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.295+0000 7f6b01232640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 0x7f6ae006d0c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6af8033000 tx=0x7f6af8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.299+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6aec054880 con 0x7f6afc150a20 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.470+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6afc06aaf0 con 0x7f6afc150a20 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.471+0000 7f6af1ffb640 1 -- 172.21.15.5:0/3611376285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6aec057ea0 con 0x7f6afc150a20 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:17:50.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:17:50.474 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:17:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 msgr2=0x7f6ae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 0x7f6ae006d0c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6af8033000 tx=0x7f6af8008030 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 msgr2=0x7f6afc1587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007290 tx=0x7f6aec007690 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 shutdown_connections 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc158d30 0x7f6afc06d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6ae006ac00 0x7f6ae006d0c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6afc150a20 0x7f6afc1587f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 --2- 172.21.15.5:0/3611376285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003970 0x7f6afc147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 >> 172.21.15.5:0/3611376285 conn(0x7f6afc0cc610 msgr2=0x7f6afc06b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 shutdown_connections 2024-09-13T17:17:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.473+0000 7f6b03496640 1 -- 172.21.15.5:0/3611376285 wait complete. 2024-09-13T17:17:50.486 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:17:50.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:17:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.589+0000 7f49c6bb5640 1 Processor -- start 2024-09-13T17:17:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.589+0000 7f49c6bb5640 1 -- start start 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c6bb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 0x7f49c00accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c6bb5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 0x7f49c006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c6bb5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b2d50 con 0x7f49c015c5d0 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c6bb5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c015c9b0 con 0x7f49c00ad210 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c6bb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00b2140 con 0x7f49c00b1cb0 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c4951640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49c015c5d0 0x7f49c006cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56652/0 (socket says 172.21.15.5:56652) 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c4951640 1 -- 172.21.15.5:0/1472790435 learned_addr learned my addr 172.21.15.5:0/1472790435 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bffff640 1 --2- 172.21.15.5:0/1472790435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 0x7f49c00accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49c5152640 1 --2- 172.21.15.5:0/1472790435 >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 0x7f49c006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456329982 0 0) 0x7f49c00b2d50 con 0x7f49c015c5d0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003520 con 0x7f49c015c5d0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516837706 0 0) 0x7f49b0003520 con 0x7f49c015c5d0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bffff640 1 -- 172.21.15.5:0/1472790435 >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 msgr2=0x7f49c006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.590+0000 7f49bffff640 1 --2- 172.21.15.5:0/1472790435 >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 0x7f49c006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.591+0000 7f49bffff640 1 -- 172.21.15.5:0/1472790435 >> v1:172.21.15.5:6789/0 conn(0x7f49c015c5d0 legacy=0x7f49c006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.591+0000 7f49bffff640 1 -- 172.21.15.5:0/1472790435 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00b2420 con 0x7f49c00b1cb0 2024-09-13T17:17:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.591+0000 7f49c5152640 1 --2- 172.21.15.5:0/1472790435 >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 0x7f49c006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.591+0000 7f49bffff640 1 --2- 172.21.15.5:0/1472790435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 0x7f49c00accd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097a0 tx=0x7f49ac02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1792d588f3ecc70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4001670 con 0x7f49c00b1cb0 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac02aba0 con 0x7f49c00b1cb0 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49bf7fe640 1 -- 172.21.15.5:0/1472790435 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac032440 con 0x7f49c00b1cb0 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 -- 172.21.15.5:0/1472790435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 msgr2=0x7f49c00accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/1472790435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 0x7f49c00accd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097a0 tx=0x7f49ac02a110 comp rx=0 tx=0).stop 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 -- 172.21.15.5:0/1472790435 shutdown_connections 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/1472790435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c00b1cb0 0x7f49c00accd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/1472790435 >> v2:172.21.15.179:3300/0 conn(0x7f49c00ad210 0x7f49c006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 -- 172.21.15.5:0/1472790435 >> 172.21.15.5:0/1472790435 conn(0x7f49c0070b70 msgr2=0x7f49c0070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 -- 172.21.15.5:0/1472790435 shutdown_connections 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.592+0000 7f49c6bb5640 1 -- 172.21.15.5:0/1472790435 wait complete. 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.593+0000 7f49c6bb5640 1 Processor -- start 2024-09-13T17:17:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.593+0000 7f49c6bb5640 1 -- start start 2024-09-13T17:17:50.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c015c5d0 0x7f49c0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 0x7f49c0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c014f920 con 0x7f49c01f31a0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c014fee0 con 0x7f49c01f4f30 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49c6bb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01f5370 con 0x7f49c015c5d0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46276/0 (socket says 172.21.15.5:46276) 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.594+0000 7f49bffff640 1 -- 172.21.15.5:0/2178288469 learned_addr learned my addr 172.21.15.5:0/2178288469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49c5152640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 0x7f49c0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49c4951640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c015c5d0 0x7f49c0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 -- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c015c5d0 msgr2=0x7f49c0151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c015c5d0 0x7f49c0151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 -- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 msgr2=0x7f49c0153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 0x7f49c0153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 -- 172.21.15.5:0/2178288469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8009a70 con 0x7f49c01f31a0 2024-09-13T17:17:50.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49c5152640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 0x7f49c0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bffff640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0098c0 tx=0x7f49ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac03b810 con 0x7f49c01f31a0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac03b970 con 0x7f49c01f31a0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac03bd00 con 0x7f49c01f31a0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac009400 con 0x7f49c01f31a0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.595+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0154aa0 con 0x7f49c01f31a0 2024-09-13T17:17:50.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.596+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0150070 con 0x7f49c01f31a0 2024-09-13T17:17:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.597+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49ac039040 con 0x7f49c01f31a0 2024-09-13T17:17:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.597+0000 7f49bd7fa640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 0x7f49a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.597+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f49ac0a9620 con 0x7f49c01f31a0 2024-09-13T17:17:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.597+0000 7f49c4951640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 0x7f49a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:50.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.598+0000 7f49c4951640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 0x7f49a406d0c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f49b4000f60 tx=0x7f49b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:50.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.601+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f49ac074aa0 con 0x7f49c01f31a0 2024-09-13T17:17:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:50.771+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49c006aee0 con 0x7f49c01f31a0 2024-09-13T17:17:51.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.209+0000 7f49bd7fa640 1 -- 172.21.15.5:0/2178288469 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7f49ac03be60 con 0x7f49c01f31a0 2024-09-13T17:17:51.211 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 msgr2=0x7f49a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 0x7f49a406d0c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f49b4000f60 tx=0x7f49b4009040 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 msgr2=0x7f49c01f49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0098c0 tx=0x7f49ac0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 shutdown_connections 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c01f4f30 0x7f49c0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f49a406ac00 0x7f49a406d0c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c01f31a0 0x7f49c01f49f0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 --2- 172.21.15.5:0/2178288469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c015c5d0 0x7f49c0151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 >> 172.21.15.5:0/2178288469 conn(0x7f49c0070b70 msgr2=0x7f49c00b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:51.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.212+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 shutdown_connections 2024-09-13T17:17:51.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.213+0000 7f49c6bb5640 1 -- 172.21.15.5:0/2178288469 wait complete. 2024-09-13T17:17:51.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:17:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.339+0000 7f8c99e8e640 1 Processor -- start 2024-09-13T17:17:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.339+0000 7f8c99e8e640 1 -- start start 2024-09-13T17:17:51.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c99e8e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c94065f30 0x7f8c940ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c99e8e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c94071e40 con 0x7f8c9415c840 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c99e8e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9415cc20 con 0x7f8c9406b5f0 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c99e8e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c94071880 con 0x7f8c94065f30 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c937fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c9415c840 0x7f8c9406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56658/0 (socket says 172.21.15.5:56658) 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c937fe640 1 -- 172.21.15.5:0/171771815 learned_addr learned my addr 172.21.15.5:0/171771815 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763076666 0 0) 0x7f8c94071e40 con 0x7f8c9415c840 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c7c003520 con 0x7f8c9415c840 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c93fff640 1 --2- 172.21.15.5:0/171771815 >> v2:172.21.15.179:3300/0 conn(0x7f8c94065f30 0x7f8c940ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3516662293 0 0) 0x7f8c7c003520 con 0x7f8c9415c840 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 >> v2:172.21.15.179:3300/0 conn(0x7f8c94065f30 msgr2=0x7f8c940ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 --2- 172.21.15.5:0/171771815 >> v2:172.21.15.179:3300/0 conn(0x7f8c94065f30 0x7f8c940ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 >> v1:172.21.15.179:6789/0 conn(0x7f8c9406b5f0 legacy=0x7f8c940ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94071b60 con 0x7f8c9415c840 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8c84001670 con 0x7f8c9415c840 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 >> v1:172.21.15.5:6789/0 conn(0x7f8c9415c840 legacy=0x7f8c9406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7c003970 0x7f8c7c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0047c0 0x7f8c7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 0x7f8c7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94071880 con 0x7f8c7c0052a0 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c00c1f0 con 0x7f8c7c0047c0 2024-09-13T17:17:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.340+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c00c3b0 con 0x7f8c7c003970 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 0x7f8c7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c937fe640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7c003970 0x7f8c7c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c92ffd640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0047c0 0x7f8c7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 -- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7c003970 msgr2=0x7f8c7c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c7c003970 0x7f8c7c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 -- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0047c0 msgr2=0x7f8c7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0047c0 0x7f8c7c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 -- 172.21.15.5:0/171771815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c003520 con 0x7f8c7c0052a0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.341+0000 7f8c93fff640 1 -- 172.21.15.5:0/171771815 reap_dead start 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c93fff640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 0x7f8c7c00b980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007330 tx=0x7f8c7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8aad73c0da488d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c003b90 con 0x7f8c7c0052a0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c003cf0 con 0x7f8c7c0052a0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c927fc640 1 -- 172.21.15.5:0/171771815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004260 con 0x7f8c7c0052a0 2024-09-13T17:17:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 -- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 msgr2=0x7f8c7c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 0x7f8c7c00b980 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007330 tx=0x7f8c7c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 -- 172.21.15.5:0/171771815 shutdown_connections 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/171771815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c7c0052a0 0x7f8c7c00b980 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 -- 172.21.15.5:0/171771815 >> 172.21.15.5:0/171771815 conn(0x7f8c940cc570 msgr2=0x7f8c94070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 -- 172.21.15.5:0/171771815 shutdown_connections 2024-09-13T17:17:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.342+0000 7f8c99e8e640 1 -- 172.21.15.5:0/171771815 wait complete. 2024-09-13T17:17:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.343+0000 7f8c99e8e640 1 Processor -- start 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 -- start start 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0052a0 0x7f8c941528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c94153a00 0x7f8c94153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941543c0 con 0x7f8c9415dac0 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94152e00 con 0x7f8c7c0052a0 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.344+0000 7f8c99e8e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415e830 con 0x7f8c94153a00 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46298/0 (socket says 172.21.15.5:46298) 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 -- 172.21.15.5:0/1753748415 learned_addr learned my addr 172.21.15.5:0/1753748415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c92ffd640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c94153a00 0x7f8c94153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c937fe640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0052a0 0x7f8c941528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 -- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c94153a00 msgr2=0x7f8c94153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c94153a00 0x7f8c94153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 -- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0052a0 msgr2=0x7f8c941528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0052a0 0x7f8c941528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 -- 172.21.15.5:0/1753748415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9415efb0 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c93fff640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02b070 tx=0x7f8c8c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c041640 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0417c0 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9415f290 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c041b70 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.345+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9415f850 con 0x7f8c9415dac0 2024-09-13T17:17:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.346+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940672c0 con 0x7f8c9415dac0 2024-09-13T17:17:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.347+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c8c036440 con 0x7f8c9415dac0 2024-09-13T17:17:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.347+0000 7f8c7bfff640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 0x7f8c8006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.347+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f8c8c0a95e0 con 0x7f8c9415dac0 2024-09-13T17:17:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.348+0000 7f8c937fe640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 0x7f8c8006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.348+0000 7f8c937fe640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 0x7f8c8006d0f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8c940ce100 tx=0x7f8c84000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.352+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8c8c074910 con 0x7f8c9415dac0 2024-09-13T17:17:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:51.524+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8c9415fa70 con 0x7f8c9415dac0 2024-09-13T17:17:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.219+0000 7f8c7bfff640 1 -- 172.21.15.5:0/1753748415 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8c8c077f30 con 0x7f8c9415dac0 2024-09-13T17:17:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:17:52.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 msgr2=0x7f8c8006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 0x7f8c8006d0f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8c940ce100 tx=0x7f8c84000f80 comp rx=0 tx=0).stop 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 msgr2=0x7f8c9415df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02b070 tx=0x7f8c8c004ab0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 shutdown_connections 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.226+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8c8006ac30 0x7f8c8006d0f0 secure :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8c940ce100 tx=0x7f8c84000f80 comp rx=0 tx=0).stop 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.227+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c9415dac0 0x7f8c9415df70 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.227+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c94153a00 0x7f8c94153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.227+0000 7f8c99e8e640 1 --2- 172.21.15.5:0/1753748415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c7c0052a0 0x7f8c941528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.227+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 >> 172.21.15.5:0/1753748415 conn(0x7f8c940cc570 msgr2=0x7f8c940b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.234+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 shutdown_connections 2024-09-13T17:17:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.234+0000 7f8c99e8e640 1 -- 172.21.15.5:0/1753748415 wait complete. 2024-09-13T17:17:52.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:17:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.361+0000 7fae41565640 1 Processor -- start 2024-09-13T17:17:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.361+0000 7fae41565640 1 -- start start 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae41565640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae3c1597d0 0x7fae3c13f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae41565640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c15a7d0 con 0x7fae3c0703e0 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae41565640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c159f30 con 0x7fae3c13f670 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae41565640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c13c740 con 0x7fae3c1597d0 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae3a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae3c1597d0 0x7fae3c13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae3affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae3c0703e0 0x7fae3c0707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56666/0 (socket says 172.21.15.5:56666) 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae3a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae3c1597d0 0x7fae3c13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46312/0 (socket says 172.21.15.5:46312) 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.362+0000 7fae3affd640 1 -- 172.21.15.5:0/3209921234 learned_addr learned my addr 172.21.15.5:0/3209921234 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.363+0000 7fae3a7fc640 1 -- 172.21.15.5:0/3209921234 >> v1:172.21.15.179:6789/0 conn(0x7fae3c13f670 legacy=0x7fae3c13cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.363+0000 7fae3a7fc640 1 -- 172.21.15.5:0/3209921234 >> v1:172.21.15.5:6789/0 conn(0x7fae3c0703e0 legacy=0x7fae3c0707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.363+0000 7fae39ffb640 1 -- 172.21.15.5:0/3209921234 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267689062 0 0) 0x7fae3c15a7d0 con 0x7fae3c0703e0 2024-09-13T17:17:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.363+0000 7fae3a7fc640 1 -- 172.21.15.5:0/3209921234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c15a210 con 0x7fae3c1597d0 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae3a7fc640 1 --2- 172.21.15.5:0/3209921234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c13f130 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fae240097a0 tx=0x7fae2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45dce27039e4210 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae39ffb640 1 -- 172.21.15.5:0/3209921234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24032440 con 0x7fae3c1597d0 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae39ffb640 1 -- 172.21.15.5:0/3209921234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240325a0 con 0x7fae3c1597d0 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae39ffb640 1 -- 172.21.15.5:0/3209921234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24032930 con 0x7fae3c1597d0 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 -- 172.21.15.5:0/3209921234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 msgr2=0x7fae3c13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 --2- 172.21.15.5:0/3209921234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c13f130 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fae240097a0 tx=0x7fae2402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 -- 172.21.15.5:0/3209921234 shutdown_connections 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 --2- 172.21.15.5:0/3209921234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c13f130 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 -- 172.21.15.5:0/3209921234 >> 172.21.15.5:0/3209921234 conn(0x7fae3c0b02f0 msgr2=0x7fae3c0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 -- 172.21.15.5:0/3209921234 shutdown_connections 2024-09-13T17:17:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.364+0000 7fae41565640 1 -- 172.21.15.5:0/3209921234 wait complete. 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 Processor -- start 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 -- start start 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0703e0 0x7fae3c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c13f670 0x7fae3c13be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1546c0 con 0x7fae3c1597d0 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1f2f60 con 0x7fae3c13f670 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.366+0000 7fae41565640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c154070 con 0x7fae3c0703e0 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46320/0 (socket says 172.21.15.5:46320) 2024-09-13T17:17:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 -- 172.21.15.5:0/2035838967 learned_addr learned my addr 172.21.15.5:0/2035838967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3a7fc640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c13f670 0x7fae3c13be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3affd640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0703e0 0x7fae3c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 -- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0703e0 msgr2=0x7fae3c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0703e0 0x7fae3c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 -- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c13f670 msgr2=0x7fae3c13be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c13f670 0x7fae3c13be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 -- 172.21.15.5:0/2035838967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009400 con 0x7fae3c1597d0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae3b7fe640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fae34001eb0 tx=0x7fae3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340052d0 con 0x7fae3c1597d0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34005430 con 0x7fae3c1597d0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c154350 con 0x7fae3c1597d0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34003810 con 0x7fae3c1597d0 2024-09-13T17:17:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.367+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c158960 con 0x7fae3c1597d0 2024-09-13T17:17:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.368+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0672f0 con 0x7fae3c1597d0 2024-09-13T17:17:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.369+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae34003970 con 0x7fae3c1597d0 2024-09-13T17:17:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.369+0000 7fae337fe640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 0x7fae1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.369+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fae34088940 con 0x7fae3c1597d0 2024-09-13T17:17:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.370+0000 7fae3affd640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 0x7fae1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.370+0000 7fae3affd640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 0x7fae1c06d0c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0012e0 tx=0x7fae2c004d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.374+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae34053af0 con 0x7fae3c1597d0 2024-09-13T17:17:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.579+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fae3c153ea0 con 0x7fae3c1597d0 2024-09-13T17:17:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.586+0000 7fae337fe640 1 -- 172.21.15.5:0/2035838967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7fae340170c0 con 0x7fae3c1597d0 2024-09-13T17:17:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 13 and data pool 14 2024-09-13T17:17:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 msgr2=0x7fae1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 0x7fae1c06d0c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0012e0 tx=0x7fae2c004d40 comp rx=0 tx=0).stop 2024-09-13T17:17:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 msgr2=0x7fae3c158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fae34001eb0 tx=0x7fae3400c890 comp rx=0 tx=0).stop 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 shutdown_connections 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae1c06ac00 0x7fae1c06d0c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3c1597d0 0x7fae3c158420 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae3c13f670 0x7fae3c13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 --2- 172.21.15.5:0/2035838967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae3c0703e0 0x7fae3c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.591+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 >> 172.21.15.5:0/2035838967 conn(0x7fae3c0b02f0 msgr2=0x7fae3c06c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.597+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 shutdown_connections 2024-09-13T17:17:52.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.600+0000 7fae41565640 1 -- 172.21.15.5:0/2035838967 wait complete. 2024-09-13T17:17:52.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.721+0000 7efc38d5a640 1 Processor -- start 2024-09-13T17:17:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.721+0000 7efc38d5a640 1 -- start start 2024-09-13T17:17:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc38d5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc340cb6c0 0x7efc340cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc38d5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340b2180 con 0x7efc3415a4a0 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc38d5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc340b2420 con 0x7efc3415a880 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc38d5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc340b2700 con 0x7efc340cb6c0 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc340cb6c0 0x7efc340cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc3259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc3415a4a0 0x7efc340cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56672/0 (socket says 172.21.15.5:56672) 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc3259c640 1 -- 172.21.15.5:0/1122319906 learned_addr learned my addr 172.21.15.5:0/1122319906 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.722+0000 7efc32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc340cb6c0 0x7efc340cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46324/0 (socket says 172.21.15.5:46324) 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.723+0000 7efc32d9d640 1 -- 172.21.15.5:0/1122319906 >> v1:172.21.15.179:6789/0 conn(0x7efc3415a880 legacy=0x7efc3415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.723+0000 7efc32d9d640 1 -- 172.21.15.5:0/1122319906 >> v1:172.21.15.5:6789/0 conn(0x7efc3415a4a0 legacy=0x7efc340cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.723+0000 7efc32d9d640 1 -- 172.21.15.5:0/1122319906 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc340ce330 con 0x7efc340cb6c0 2024-09-13T17:17:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.723+0000 7efc3159a640 1 -- 172.21.15.5:0/1122319906 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344176091 0 0) 0x7efc340b2180 con 0x7efc3415a4a0 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.723+0000 7efc32d9d640 1 --2- 172.21.15.5:0/1122319906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc340cdc50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7efc340ce580 tx=0x7efc2402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1583300459a70b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc3159a640 1 -- 172.21.15.5:0/1122319906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2402aea0 con 0x7efc340cb6c0 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc3159a640 1 -- 172.21.15.5:0/1122319906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2402d050 con 0x7efc340cb6c0 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc3159a640 1 -- 172.21.15.5:0/1122319906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24007960 con 0x7efc340cb6c0 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 -- 172.21.15.5:0/1122319906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 msgr2=0x7efc340cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 --2- 172.21.15.5:0/1122319906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc340cdc50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7efc340ce580 tx=0x7efc2402a6c0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 -- 172.21.15.5:0/1122319906 shutdown_connections 2024-09-13T17:17:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 --2- 172.21.15.5:0/1122319906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc340cdc50 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 -- 172.21.15.5:0/1122319906 >> 172.21.15.5:0/1122319906 conn(0x7efc34066200 msgr2=0x7efc34069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 -- 172.21.15.5:0/1122319906 shutdown_connections 2024-09-13T17:17:52.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.724+0000 7efc38d5a640 1 -- 172.21.15.5:0/1122319906 wait complete. 2024-09-13T17:17:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 Processor -- start 2024-09-13T17:17:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 -- start start 2024-09-13T17:17:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 0x7efc34152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 0x7efc3414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc341f02f0 con 0x7efc340cb6c0 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3414d650 con 0x7efc3415a880 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc38d5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3414d8c0 con 0x7efc3415a4a0 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.726+0000 7efc3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46336/0 (socket says 172.21.15.5:46336) 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 -- 172.21.15.5:0/2912331895 learned_addr learned my addr 172.21.15.5:0/2912331895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc32d9d640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 0x7efc3414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc31d9b640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 0x7efc34152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 -- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 msgr2=0x7efc34152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 0x7efc34152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 -- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 msgr2=0x7efc3414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 0x7efc3414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 -- 172.21.15.5:0/2912331895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009a70 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc32d9d640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 0x7efc3414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc31d9b640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 0x7efc34152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc3259c640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c4d0 tx=0x7efc2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0074e0 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c007660 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc34155990 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c004a20 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.727+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3414db80 con 0x7efc340cb6c0 2024-09-13T17:17:52.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.728+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc340672f0 con 0x7efc340cb6c0 2024-09-13T17:17:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.729+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc2c004b80 con 0x7efc340cb6c0 2024-09-13T17:17:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.729+0000 7efc2affd640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 0x7efc1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.729+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc2c088950 con 0x7efc340cb6c0 2024-09-13T17:17:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.730+0000 7efc31d9b640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 0x7efc1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.730+0000 7efc31d9b640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 0x7efc1406d0c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efc341eda90 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.734+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc2c0539e0 con 0x7efc340cb6c0 2024-09-13T17:17:52.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.907+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc340cdc50 con 0x7efc340cb6c0 2024-09-13T17:17:52.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.908+0000 7efc2affd640 1 -- 172.21.15.5:0/2912331895 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16694 (secure 0 0 0) 0x7efc2c018020 con 0x7efc340cb6c0 2024-09-13T17:17:52.911 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:52.911 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":94,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:52.581247+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 msgr2=0x7efc1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 0x7efc1406d0c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efc341eda90 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 msgr2=0x7efc3414d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c4d0 tx=0x7efc2c00c990 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 shutdown_connections 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc3415a880 0x7efc3414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc3415a4a0 0x7efc34152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efc1406ac00 0x7efc1406d0c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 --2- 172.21.15.5:0/2912331895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc340cb6c0 0x7efc3414d110 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 >> 172.21.15.5:0/2912331895 conn(0x7efc34066200 msgr2=0x7efc340ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 shutdown_connections 2024-09-13T17:17:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:52.910+0000 7efc38d5a640 1 -- 172.21.15.5:0/2912331895 wait complete. 2024-09-13T17:17:52.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.022+0000 7fc128853640 1 Processor -- start 2024-09-13T17:17:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.022+0000 7fc128853640 1 -- start start 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc124158c60 0x7fc1240703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 0x7fc12406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc12406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240cd260 con 0x7fc124158c60 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc124070d60 con 0x7fc124070920 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.023+0000 7fc128853640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cd6f0 con 0x7fc12406dd00 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc124158c60 0x7fc1240703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc124158c60 0x7fc1240703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46342/0 (socket says 172.21.15.5:46342) 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 -- 172.21.15.5:0/815464763 learned_addr learned my addr 172.21.15.5:0/815464763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc121d9b640 1 --2- 172.21.15.5:0/815464763 >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 0x7fc12406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc122d9d640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc12406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 -- 172.21.15.5:0/815464763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 msgr2=0x7fc12406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc12406c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 -- 172.21.15.5:0/815464763 >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 msgr2=0x7fc12406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 --2- 172.21.15.5:0/815464763 >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 0x7fc12406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc12259c640 1 -- 172.21.15.5:0/815464763 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240cc650 con 0x7fc124158c60 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc121d9b640 1 --2- 172.21.15.5:0/815464763 >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 0x7fc12406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.024+0000 7fc122d9d640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc12406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc12259c640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc1240703e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc12415c610 tx=0x7fc11402c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ca144f1ed3530 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc12159a640 1 -- 172.21.15.5:0/815464763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114032480 con 0x7fc124158c60 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc12159a640 1 -- 172.21.15.5:0/815464763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11402f030 con 0x7fc124158c60 2024-09-13T17:17:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc12159a640 1 -- 172.21.15.5:0/815464763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114032800 con 0x7fc124158c60 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 -- 172.21.15.5:0/815464763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 msgr2=0x7fc1240703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc1240703e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc12415c610 tx=0x7fc11402c670 comp rx=0 tx=0).stop 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 -- 172.21.15.5:0/815464763 shutdown_connections 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc12406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 --2- 172.21.15.5:0/815464763 >> v2:172.21.15.179:3300/0 conn(0x7fc124070920 0x7fc12406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 --2- 172.21.15.5:0/815464763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc1240703e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 -- 172.21.15.5:0/815464763 >> 172.21.15.5:0/815464763 conn(0x7fc124066200 msgr2=0x7fc124069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 -- 172.21.15.5:0/815464763 shutdown_connections 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.025+0000 7fc128853640 1 -- 172.21.15.5:0/815464763 wait complete. 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.027+0000 7fc128853640 1 Processor -- start 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.027+0000 7fc128853640 1 -- start start 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc1240aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc124070920 0x7fc1240c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240abf00 con 0x7fc124158c60 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240ac1e0 con 0x7fc124070920 2024-09-13T17:17:53.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240ac4c0 con 0x7fc12406dd00 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46346/0 (socket says 172.21.15.5:46346) 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 -- 172.21.15.5:0/3570850707 learned_addr learned my addr 172.21.15.5:0/3570850707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc121d9b640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc124070920 0x7fc1240c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc12259c640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc1240aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 -- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 msgr2=0x7fc1240aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc1240aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 -- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc124070920 msgr2=0x7fc1240c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc124070920 0x7fc1240c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 -- 172.21.15.5:0/3570850707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11400b760 con 0x7fc124158c60 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc12259c640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc1240aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:53.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc122d9d640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00cd10 tx=0x7fc11c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00f680 con 0x7fc124158c60 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00f800 con 0x7fc124158c60 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00fbb0 con 0x7fc124158c60 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1240ac7a0 con 0x7fc124158c60 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.028+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1240ab460 con 0x7fc124158c60 2024-09-13T17:17:53.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.029+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1240672f0 con 0x7fc124158c60 2024-09-13T17:17:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.030+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc11c00b040 con 0x7fc124158c60 2024-09-13T17:17:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.030+0000 7fc112ffd640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 0x7fc10406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.031+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc11c089e70 con 0x7fc124158c60 2024-09-13T17:17:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.031+0000 7fc12259c640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 0x7fc10406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.031+0000 7fc12259c640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 0x7fc10406d0f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc114037000 tx=0x7fc114030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.035+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc11c054e70 con 0x7fc124158c60 2024-09-13T17:17:53.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.206+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1240accc0 con 0x7fc124158c60 2024-09-13T17:17:53.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.207+0000 7fc112ffd640 1 -- 172.21.15.5:0/3570850707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fc1240accc0 con 0x7fc124158c60 2024-09-13T17:17:53.209 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:53.209 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":94,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:52.581247+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 msgr2=0x7fc10406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 0x7fc10406d0f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc114037000 tx=0x7fc114030000 comp rx=0 tx=0).stop 2024-09-13T17:17:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 msgr2=0x7fc124157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00cd10 tx=0x7fc11c00a650 comp rx=0 tx=0).stop 2024-09-13T17:17:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 shutdown_connections 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc10406ac30 0x7fc10406d0f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc124158c60 0x7fc124157010 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc124070920 0x7fc1240c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 --2- 172.21.15.5:0/3570850707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc12406dd00 0x7fc1240aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 >> 172.21.15.5:0/3570850707 conn(0x7fc124066200 msgr2=0x7fc1240b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 shutdown_connections 2024-09-13T17:17:53.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.209+0000 7fc128853640 1 -- 172.21.15.5:0/3570850707 wait complete. 2024-09-13T17:17:53.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:17:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 Processor -- start 2024-09-13T17:17:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 -- start start 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff00415c800 0x7ff0040d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0040d0e60 0x7ff0040cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0040d1f80 con 0x7ff0040cf500 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0040cf9b0 con 0x7ff00415c800 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.325+0000 7ff00a9ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040b8670 con 0x7ff0040d0e60 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff00415c800 0x7ff0040d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff00415c800 0x7ff0040d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46348/0 (socket says 172.21.15.5:46348) 2024-09-13T17:17:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 -- 172.21.15.5:0/3529131983 learned_addr learned my addr 172.21.15.5:0/3529131983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 -- 172.21.15.5:0/3529131983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0040d0e60 msgr2=0x7ff0040cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 --2- 172.21.15.5:0/3529131983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0040d0e60 0x7ff0040cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 -- 172.21.15.5:0/3529131983 >> v1:172.21.15.179:6789/0 conn(0x7ff0040cf500 legacy=0x7ff0040b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.326+0000 7ff003fff640 1 -- 172.21.15.5:0/3529131983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0040d2410 con 0x7ff00415c800 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff003fff640 1 --2- 172.21.15.5:0/3529131983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c800 0x7ff0040d0920 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ed63d8beb7ef47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff002ffd640 1 -- 172.21.15.5:0/3529131983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4032440 con 0x7ff00415c800 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff002ffd640 1 -- 172.21.15.5:0/3529131983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff40325a0 con 0x7ff00415c800 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff002ffd640 1 -- 172.21.15.5:0/3529131983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4032930 con 0x7ff00415c800 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 -- 172.21.15.5:0/3529131983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c800 msgr2=0x7ff0040d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/3529131983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c800 0x7ff0040d0920 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff402a230 comp rx=0 tx=0).stop 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 -- 172.21.15.5:0/3529131983 shutdown_connections 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/3529131983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0040d0e60 0x7ff0040cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/3529131983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c800 0x7ff0040d0920 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 -- 172.21.15.5:0/3529131983 >> 172.21.15.5:0/3529131983 conn(0x7ff00406b110 msgr2=0x7ff00406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 -- 172.21.15.5:0/3529131983 shutdown_connections 2024-09-13T17:17:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.327+0000 7ff00a9ce640 1 -- 172.21.15.5:0/3529131983 wait complete. 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.329+0000 7ff00a9ce640 1 Processor -- start 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.329+0000 7ff00a9ce640 1 -- start start 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.329+0000 7ff00a9ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.329+0000 7ff00a9ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 0x7ff0040c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 0x7ff0041f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040c9630 con 0x7ff0040cf500 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041589f0 con 0x7ff0040d0e60 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040c9b50 con 0x7ff00415c800 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46350/0 (socket says 172.21.15.5:46350) 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 -- 172.21.15.5:0/818601577 learned_addr learned my addr 172.21.15.5:0/818601577 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff008f6b640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 0x7ff0041f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff0037fe640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 0x7ff0040c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 -- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 msgr2=0x7ff0041f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 0x7ff0041f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 -- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 msgr2=0x7ff0040c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 0x7ff0040c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 -- 172.21.15.5:0/818601577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40094d0 con 0x7ff0040cf500 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff0037fe640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 0x7ff0040c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff008f6b640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 0x7ff0041f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff003fff640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4030b00 con 0x7ff0040cf500 2024-09-13T17:17:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4030c60 con 0x7ff0040cf500 2024-09-13T17:17:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0040c9e30 con 0x7ff0040cf500 2024-09-13T17:17:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff403b400 con 0x7ff0040cf500 2024-09-13T17:17:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.330+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff004158680 con 0x7ff0040cf500 2024-09-13T17:17:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.331+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0040672f0 con 0x7ff0040cf500 2024-09-13T17:17:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.332+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feff4039040 con 0x7ff0040cf500 2024-09-13T17:17:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.332+0000 7ff000ff9640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 0x7feff006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.332+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feff40a9da0 con 0x7ff0040cf500 2024-09-13T17:17:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.332+0000 7ff0037fe640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 0x7feff006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.333+0000 7ff0037fe640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 0x7feff006d0c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff00415e200 tx=0x7feff8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.336+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feff4074ed0 con 0x7ff0040cf500 2024-09-13T17:17:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.541+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0040b17d0 con 0x7ff0040cf500 2024-09-13T17:17:53.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.584+0000 7ff000ff9640 1 -- 172.21.15.5:0/818601577 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7feff40370b0 con 0x7ff0040cf500 2024-09-13T17:17:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 msgr2=0x7feff006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 0x7feff006d0c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff00415e200 tx=0x7feff8008040 comp rx=0 tx=0).stop 2024-09-13T17:17:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 msgr2=0x7ff004158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7feff4009870 tx=0x7feff40046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 shutdown_connections 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff00415c800 0x7ff0041f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0040d0e60 0x7ff0040c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feff006ac00 0x7feff006d0c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 --2- 172.21.15.5:0/818601577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040cf500 0x7ff004158e80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 >> 172.21.15.5:0/818601577 conn(0x7ff00406b110 msgr2=0x7ff00415e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 shutdown_connections 2024-09-13T17:17:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.587+0000 7ff00a9ce640 1 -- 172.21.15.5:0/818601577 wait complete. 2024-09-13T17:17:53.599 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:17:53.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:17:53.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.704+0000 7f42fea5a640 1 Processor -- start 2024-09-13T17:17:53.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.704+0000 7f42fea5a640 1 -- start start 2024-09-13T17:17:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42fea5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f81597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42fea5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80707c0 0x7f42f813f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42fea5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f815a7d0 con 0x7f42f813f670 2024-09-13T17:17:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42fea5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f813c740 con 0x7f42f80707c0 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42fea5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8159d10 con 0x7f42f80703e0 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80707c0 0x7f42f813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42f80707c0 0x7f42f813f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48132/0 (socket says 172.21.15.5:48132) 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 -- 172.21.15.5:0/1543609649 learned_addr learned my addr 172.21.15.5:0/1543609649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f7fff640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f81597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 -- 172.21.15.5:0/1543609649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 msgr2=0x7f42f81597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f81597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 -- 172.21.15.5:0/1543609649 >> v1:172.21.15.179:6789/0 conn(0x7f42f813f670 legacy=0x7f42f80b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.705+0000 7f42f77fe640 1 -- 172.21.15.5:0/1543609649 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8159f30 con 0x7f42f80707c0 2024-09-13T17:17:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.706+0000 7f42f77fe640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f813f130 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00bb40 tx=0x7f42ec02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e04f5b19743520 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.706+0000 7f42f6ffd640 1 -- 172.21.15.5:0/1543609649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec034620 con 0x7f42f80707c0 2024-09-13T17:17:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.706+0000 7f42f6ffd640 1 -- 172.21.15.5:0/1543609649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec034780 con 0x7f42f80707c0 2024-09-13T17:17:53.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.706+0000 7f42f6ffd640 1 -- 172.21.15.5:0/1543609649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec034b10 con 0x7f42f80707c0 2024-09-13T17:17:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 -- 172.21.15.5:0/1543609649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 msgr2=0x7f42f813f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f813f130 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00bb40 tx=0x7f42ec02c870 comp rx=0 tx=0).stop 2024-09-13T17:17:53.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 -- 172.21.15.5:0/1543609649 shutdown_connections 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f813f130 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1543609649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f81597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 -- 172.21.15.5:0/1543609649 >> 172.21.15.5:0/1543609649 conn(0x7f42f80b02f0 msgr2=0x7f42f80b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 -- 172.21.15.5:0/1543609649 shutdown_connections 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.707+0000 7f42fea5a640 1 -- 172.21.15.5:0/1543609649 wait complete. 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.708+0000 7f42fea5a640 1 Processor -- start 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.708+0000 7f42fea5a640 1 -- start start 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 0x7f42f81df670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81e0ba0 con 0x7f42f80707c0 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81ef5d0 con 0x7f42f813f670 2024-09-13T17:17:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fea5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8158a90 con 0x7f42f80703e0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48138/0 (socket says 172.21.15.5:48138) 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 -- 172.21.15.5:0/1427639626 learned_addr learned my addr 172.21.15.5:0/1427639626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f7fff640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fcff7640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 0x7f42f81df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 -- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 msgr2=0x7f42f8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f8153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 -- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 msgr2=0x7f42f81df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 0x7f42f81df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42f77fe640 1 -- 172.21.15.5:0/1427639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec00b770 con 0x7f42f80707c0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.709+0000 7f42fcff7640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 0x7f42f81df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42f77fe640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00bb40 tx=0x7f42ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec033c00 con 0x7f42f80707c0 2024-09-13T17:17:53.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec033d80 con 0x7f42f80707c0 2024-09-13T17:17:53.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f81584d0 con 0x7f42f80707c0 2024-09-13T17:17:53.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004260 con 0x7f42f80707c0 2024-09-13T17:17:53.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.710+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f81ef260 con 0x7f42f80707c0 2024-09-13T17:17:53.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.711+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80672f0 con 0x7f42f80707c0 2024-09-13T17:17:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.711+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f42ec032070 con 0x7f42f80707c0 2024-09-13T17:17:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.712+0000 7f42f4ff9640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 0x7f42e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.712+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f42ec0ac3a0 con 0x7f42f80707c0 2024-09-13T17:17:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.712+0000 7f42f7fff640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 0x7f42e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.713+0000 7f42f7fff640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 0x7f42e406d0c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f42f8156ef0 tx=0x7f42e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:53.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.716+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f42ec077580 con 0x7f42f80707c0 2024-09-13T17:17:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:53.922+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42f81ef420 con 0x7f42f80707c0 2024-09-13T17:17:54.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.588+0000 7f42f4ff9640 1 -- 172.21.15.5:0/1427639626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42ec07aba0 con 0x7f42f80707c0 2024-09-13T17:17:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 msgr2=0x7f42e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 0x7f42e406d0c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f42f8156ef0 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2024-09-13T17:17:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 msgr2=0x7f42f8157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00bb40 tx=0x7f42ec0046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 shutdown_connections 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f813f670 0x7f42f81df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f42e406ac00 0x7f42e406d0c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42f80707c0 0x7f42f8157b60 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 --2- 172.21.15.5:0/1427639626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42f80703e0 0x7f42f8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 >> 172.21.15.5:0/1427639626 conn(0x7f42f80b02f0 msgr2=0x7f42f80afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 shutdown_connections 2024-09-13T17:17:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.590+0000 7f42fea5a640 1 -- 172.21.15.5:0/1427639626 wait complete. 2024-09-13T17:17:54.605 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:17:54.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.710+0000 7ff7d43bc640 1 Processor -- start 2024-09-13T17:17:54.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.710+0000 7ff7d43bc640 1 -- start start 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.711+0000 7ff7d43bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.711+0000 7ff7d43bc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 0x7ff7cc0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.711+0000 7ff7d43bc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc15cdd0 con 0x7ff7cc0cd630 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.711+0000 7ff7d43bc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0b8750 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.711+0000 7ff7d43bc640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0d2c20 con 0x7ff7cc0b5820 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48148/0 (socket says 172.21.15.5:48148) 2024-09-13T17:17:54.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d1957640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7cc0cd630 0x7ff7cc0b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39922/0 (socket says 172.21.15.5:39922) 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 -- 172.21.15.5:0/2009537560 learned_addr learned my addr 172.21.15.5:0/2009537560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2959640 1 --2- 172.21.15.5:0/2009537560 >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 0x7ff7cc0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 -- 172.21.15.5:0/2009537560 >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 msgr2=0x7ff7cc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 --2- 172.21.15.5:0/2009537560 >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 0x7ff7cc0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 -- 172.21.15.5:0/2009537560 >> v1:172.21.15.5:6789/0 conn(0x7ff7cc0cd630 legacy=0x7ff7cc0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2158640 1 -- 172.21.15.5:0/2009537560 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0d3040 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d1156640 1 -- 172.21.15.5:0/2009537560 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073260587 0 0) 0x7ff7cc15cdd0 con 0x7ff7cc0cd630 2024-09-13T17:17:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.712+0000 7ff7d2959640 1 --2- 172.21.15.5:0/2009537560 >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 0x7ff7cc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d2158640 1 --2- 172.21.15.5:0/2009537560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c60b0 tx=0x7ff7c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4101c738b70d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d1156640 1 -- 172.21.15.5:0/2009537560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8032440 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d1156640 1 -- 172.21.15.5:0/2009537560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c80325a0 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d1156640 1 -- 172.21.15.5:0/2009537560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8032930 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2009537560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc15c9f0 msgr2=0x7ff7cc0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.713+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2009537560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c60b0 tx=0x7ff7c802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2009537560 shutdown_connections 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2009537560 >> v2:172.21.15.179:3300/0 conn(0x7ff7cc0b5820 0x7ff7cc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2009537560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc15c9f0 0x7ff7cc0b4170 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2009537560 >> 172.21.15.5:0/2009537560 conn(0x7ff7cc071a20 msgr2=0x7ff7cc071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2009537560 shutdown_connections 2024-09-13T17:17:54.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.714+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2009537560 wait complete. 2024-09-13T17:17:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.715+0000 7ff7d43bc640 1 Processor -- start 2024-09-13T17:17:54.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.715+0000 7ff7d43bc640 1 -- start start 2024-09-13T17:17:54.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 0x7ff7cc0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7cc15c9f0 0x7ff7cc144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc148950 con 0x7ff7cc0b5820 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15e800 con 0x7ff7cc0cd630 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d43bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15eae0 con 0x7ff7cc15c9f0 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48150/0 (socket says 172.21.15.5:48150) 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 -- 172.21.15.5:0/2095107113 learned_addr learned my addr 172.21.15.5:0/2095107113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2959640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7cc15c9f0 0x7ff7cc144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d1957640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 0x7ff7cc0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 -- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7cc15c9f0 msgr2=0x7ff7cc144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7cc15c9f0 0x7ff7cc144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 -- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 msgr2=0x7ff7cc0c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 0x7ff7cc0c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 -- 172.21.15.5:0/2095107113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80094d0 con 0x7ff7cc0b5820 2024-09-13T17:17:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d1957640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 0x7ff7cc0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7d2158640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.716+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8032440 con 0x7ff7cc0b5820 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.717+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c8030b80 con 0x7ff7cc0b5820 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.717+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc15edc0 con 0x7ff7cc0b5820 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.717+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c803d420 con 0x7ff7cc0b5820 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.717+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc15f380 con 0x7ff7cc0b5820 2024-09-13T17:17:54.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.718+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc15ec20 con 0x7ff7cc0b5820 2024-09-13T17:17:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.718+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7c8039040 con 0x7ff7cc0b5820 2024-09-13T17:17:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.719+0000 7ff7c2ffd640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 0x7ff7b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.719+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7c80aa1d0 con 0x7ff7cc0b5820 2024-09-13T17:17:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.719+0000 7ff7d1957640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 0x7ff7b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:54.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.719+0000 7ff7d1957640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 0x7ff7b006d0f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c5d90 tx=0x7ff7bc007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:54.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.723+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7cc15ec20 con 0x7ff7cc0b5820 2024-09-13T17:17:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.928+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7cc15ec20 con 0x7ff7cc0b5820 2024-09-13T17:17:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.929+0000 7ff7c2ffd640 1 -- 172.21.15.5:0/2095107113 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7ff7cc15ec20 con 0x7ff7cc0b5820 2024-09-13T17:17:54.931 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:54.932 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:17:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:17:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 msgr2=0x7ff7b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 0x7ff7b006d0f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c5d90 tx=0x7ff7bc007c10 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 msgr2=0x7ff7cc15de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c80046c0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 shutdown_connections 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7cc15c9f0 0x7ff7cc144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc0cd630 0x7ff7cc0c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7b006ac30 0x7ff7b006d0f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 --2- 172.21.15.5:0/2095107113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7cc0b5820 0x7ff7cc15de20 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 >> 172.21.15.5:0/2095107113 conn(0x7ff7cc071a20 msgr2=0x7ff7cc0d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 shutdown_connections 2024-09-13T17:17:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:54.931+0000 7ff7d43bc640 1 -- 172.21.15.5:0/2095107113 wait complete. 2024-09-13T17:17:54.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:17:55.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.043+0000 7f623262b640 1 Processor -- start 2024-09-13T17:17:55.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.043+0000 7f623262b640 1 -- start start 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.043+0000 7f623262b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f622c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f623262b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c15cdd0 con 0x7f622c0b5820 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f623262b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0d3040 con 0x7f622c0cd630 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f623262b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b8750 con 0x7f622c15c9f0 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f6230bc8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f622c0b5820 0x7f622c0b5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39926/0 (socket says 172.21.15.5:39926) 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f6230bc8640 1 -- 172.21.15.5:0/1752372248 learned_addr learned my addr 172.21.15.5:0/1752372248 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622bfff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f622c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866642241 0 0) 0x7f622c15cdd0 con 0x7f622c0b5820 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6218003520 con 0x7f622c0b5820 2024-09-13T17:17:55.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998806748 0 0) 0x7f6218003520 con 0x7f622c0b5820 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 msgr2=0x7f622c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f622c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 >> v1:172.21.15.179:6789/0 conn(0x7f622c0cd630 legacy=0x7f622c0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0cdb10 con 0x7f622c0b5820 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f62240019f0 con 0x7f622c0b5820 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 >> v1:172.21.15.5:6789/0 conn(0x7f622c0b5820 legacy=0x7f622c0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f62180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6218003f70 0x7f62180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6218004d00 0x7f6218005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b8750 con 0x7f6218003f70 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621800bb70 con 0x7f6218004d00 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621800bd30 con 0x7f622c15c9f0 2024-09-13T17:17:55.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.044+0000 7f6223fff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6218003f70 0x7f62180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6230bc8640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6218004d00 0x7f6218005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f622bfff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f62180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 -- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 msgr2=0x7f62180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f622c15c9f0 0x7f62180039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 -- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6218004d00 msgr2=0x7f6218005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6218004d00 0x7f6218005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 -- 172.21.15.5:0/1752372248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218003520 con 0x7f6218003f70 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.045+0000 7f6223fff640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6218003f70 0x7f62180047c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6214001750 tx=0x7f62180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87cf44705226013 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140052d0 con 0x7f6218003f70 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214005430 con 0x7f6218003f70 2024-09-13T17:17:55.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f622b7fe640 1 -- 172.21.15.5:0/1752372248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621402abe0 con 0x7f6218003f70 2024-09-13T17:17:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 -- 172.21.15.5:0/1752372248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6218003f70 msgr2=0x7f62180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 --2- 172.21.15.5:0/1752372248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6218003f70 0x7f62180047c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6214001750 tx=0x7f62180057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f6230bc8640 1 -- 172.21.15.5:0/1752372248 reap_dead start 2024-09-13T17:17:55.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 -- 172.21.15.5:0/1752372248 shutdown_connections 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 -- 172.21.15.5:0/1752372248 >> 172.21.15.5:0/1752372248 conn(0x7f622c071a20 msgr2=0x7f622c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 -- 172.21.15.5:0/1752372248 shutdown_connections 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.046+0000 7f623262b640 1 -- 172.21.15.5:0/1752372248 wait complete. 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 Processor -- start 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 -- start start 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6218003f70 0x7f622c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 0x7f622c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0d2c20 con 0x7f622c1f3520 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c153170 con 0x7f622c153bc0 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f623262b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0c7500 con 0x7f6218003f70 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f6223fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f6223fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48178/0 (socket says 172.21.15.5:48178) 2024-09-13T17:17:55.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.048+0000 7f6223fff640 1 -- 172.21.15.5:0/1694061169 learned_addr learned my addr 172.21.15.5:0/1694061169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f622bfff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6218003f70 0x7f622c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6230bc8640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 0x7f622c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 -- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6218003f70 msgr2=0x7f622c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6218003f70 0x7f622c0c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 -- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 msgr2=0x7f622c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 0x7f622c1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 -- 172.21.15.5:0/1694061169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0c77e0 con 0x7f622c1f3520 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6230bc8640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 0x7f622c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f6223fff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6214008fd0 tx=0x7f6214001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214007670 con 0x7f622c1f3520 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214007a30 con 0x7f622c1f3520 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214006a10 con 0x7f622c1f3520 2024-09-13T17:17:55.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c1533c0 con 0x7f622c1f3520 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.049+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c1f39a0 con 0x7f622c1f3520 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.050+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c0b5c70 con 0x7f622c1f3520 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.051+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6214006b70 con 0x7f622c1f3520 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.051+0000 7f62297fa640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.051+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62140a8d70 con 0x7f622c1f3520 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.051+0000 7f622bfff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.052+0000 7f622bfff640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f621c009a10 tx=0x7f621c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.056+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6214073e10 con 0x7f622c1f3520 2024-09-13T17:17:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.226+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f622c0b5c70 con 0x7f622c1f3520 2024-09-13T17:17:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.227+0000 7f62297fa640 1 -- 172.21.15.5:0/1694061169 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f6214042070 con 0x7f622c1f3520 2024-09-13T17:17:55.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:55.230 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 msgr2=0x7f620c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f621c009a10 tx=0x7f621c008040 comp rx=0 tx=0).stop 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 msgr2=0x7f622c0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6214008fd0 tx=0x7f6214001120 comp rx=0 tx=0).stop 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 shutdown_connections 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f622c153bc0 0x7f622c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f620c06ac00 0x7f620c06d0c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f622c1f3520 0x7f622c0b7140 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 --2- 172.21.15.5:0/1694061169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6218003f70 0x7f622c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 >> 172.21.15.5:0/1694061169 conn(0x7f622c071a20 msgr2=0x7f622c0c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 shutdown_connections 2024-09-13T17:17:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.229+0000 7f623262b640 1 -- 172.21.15.5:0/1694061169 wait complete. 2024-09-13T17:17:55.242 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:17:55.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:55.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.341+0000 7f001bd26640 1 Processor -- start 2024-09-13T17:17:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001bd26640 1 -- start start 2024-09-13T17:17:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001bd26640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00140cd630 0x7f00140b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001bd26640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001415cdd0 con 0x7f00140b5820 2024-09-13T17:17:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001bd26640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00140d3040 con 0x7f001415c9f0 2024-09-13T17:17:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001bd26640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00140b8750 con 0x7f00140cd630 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001a2c3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00140b5820 0x7f00140b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39940/0 (socket says 172.21.15.5:39940) 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.342+0000 7f001a2c3640 1 -- 172.21.15.5:0/2211934332 learned_addr learned my addr 172.21.15.5:0/2211934332 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f00192c1640 1 --2- 172.21.15.5:0/2211934332 >> v2:172.21.15.179:3300/0 conn(0x7f00140cd630 0x7f00140b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231894373 0 0) 0x7f001415cdd0 con 0x7f00140b5820 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efffc003520 con 0x7f00140b5820 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706636993 0 0) 0x7f00140d3040 con 0x7f001415c9f0 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001415cdd0 con 0x7f001415c9f0 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968238990 0 0) 0x7efffc003520 con 0x7f00140b5820 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f00192c1640 1 -- 172.21.15.5:0/2211934332 >> v1:172.21.15.179:6789/0 conn(0x7f001415c9f0 legacy=0x7f00140b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f00192c1640 1 -- 172.21.15.5:0/2211934332 >> v1:172.21.15.5:6789/0 conn(0x7f00140b5820 legacy=0x7f00140b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.343+0000 7f00192c1640 1 -- 172.21.15.5:0/2211934332 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140cdb10 con 0x7f00140cd630 2024-09-13T17:17:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.344+0000 7f00192c1640 1 --2- 172.21.15.5:0/2211934332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140b4880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f00080097a0 tx=0x7f000802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c1b2430035e6af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.344+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c001670 con 0x7f00140cd630 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.344+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000802abc0 con 0x7f00140cd630 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.344+0000 7f0018ac0640 1 -- 172.21.15.5:0/2211934332 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008032440 con 0x7f00140cd630 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 -- 172.21.15.5:0/2211934332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 msgr2=0x7f00140b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 --2- 172.21.15.5:0/2211934332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140b4880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f00080097a0 tx=0x7f000802a130 comp rx=0 tx=0).stop 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 -- 172.21.15.5:0/2211934332 shutdown_connections 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 --2- 172.21.15.5:0/2211934332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140b4880 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 -- 172.21.15.5:0/2211934332 >> 172.21.15.5:0/2211934332 conn(0x7f0014071a20 msgr2=0x7f0014071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 -- 172.21.15.5:0/2211934332 shutdown_connections 2024-09-13T17:17:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.345+0000 7f001bd26640 1 -- 172.21.15.5:0/2211934332 wait complete. 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.346+0000 7f001bd26640 1 Processor -- start 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.346+0000 7f001bd26640 1 -- start start 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00140b5820 0x7f00140b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00140d2c20 con 0x7f001415c9f0 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00140b2120 con 0x7f00140cd630 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001bd26640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00140c7460 con 0x7f00140b5820 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48182/0 (socket says 172.21.15.5:48182) 2024-09-13T17:17:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 -- 172.21.15.5:0/148390179 learned_addr learned my addr 172.21.15.5:0/148390179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f0019ac2640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00140b5820 0x7f00140b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f00192c1640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 -- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00140b5820 msgr2=0x7f00140b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00140b5820 0x7f00140b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 -- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 msgr2=0x7f00140c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 -- 172.21.15.5:0/148390179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009400 con 0x7f001415c9f0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.347+0000 7f001a2c3640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c730 tx=0x7f000c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.348+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c005ad0 con 0x7f001415c9f0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.348+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c005c30 con 0x7f001415c9f0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.348+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00ce70 con 0x7f001415c9f0 2024-09-13T17:17:55.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.348+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00140c7740 con 0x7f001415c9f0 2024-09-13T17:17:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.348+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00140b44b0 con 0x7f001415c9f0 2024-09-13T17:17:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.349+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00140ccb10 con 0x7f001415c9f0 2024-09-13T17:17:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.349+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f000c007070 con 0x7f001415c9f0 2024-09-13T17:17:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.350+0000 7f00127fc640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.350+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f000c088aa0 con 0x7f001415c9f0 2024-09-13T17:17:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.350+0000 7f0019ac2640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.350+0000 7f0019ac2640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 0x7f000006d0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0004001560 tx=0x7f0004009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.354+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f000c053bf0 con 0x7f001415c9f0 2024-09-13T17:17:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.521+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00140d2840 con 0x7f000006ac00 2024-09-13T17:17:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.529+0000 7f00127fc640 1 -- 172.21.15.5:0/148390179 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286309 (secure 0 0 0) 0x7f000400fa30 con 0x7f000006ac00 2024-09-13T17:17:55.534 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 msgr2=0x7f000006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 0x7f000006d0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0004001560 tx=0x7f0004009040 comp rx=0 tx=0).stop 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 msgr2=0x7f00140c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c730 tx=0x7f000c00cb30 comp rx=0 tx=0).stop 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 shutdown_connections 2024-09-13T17:17:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f000006ac00 0x7f000006d0c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001415c9f0 0x7f00140c6740 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00140cd630 0x7f00140c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 --2- 172.21.15.5:0/148390179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00140b5820 0x7f00140b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 >> 172.21.15.5:0/148390179 conn(0x7f0014071a20 msgr2=0x7f001415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 shutdown_connections 2024-09-13T17:17:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.532+0000 7f001bd26640 1 -- 172.21.15.5:0/148390179 wait complete. 2024-09-13T17:17:55.544 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-13T17:17:55.324213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246688,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728032,"statfs":{"total":773094113280,"available":772841504768,"internally_reserved":0,"allocated":10264576,"data_stored":5293248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109304"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223559+0000","last_change":"2024-09-13T17:17:52.223559+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223559+0000","last_undegraded":"2024-09-13T17:17:52.223559+0000","last_fullsized":"2024-09-13T17:17:52.223559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220817+0000","last_change":"2024-09-13T17:17:52.220817+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220817+0000","last_undegraded":"2024-09-13T17:17:52.220817+0000","last_fullsized":"2024-09-13T17:17:52.220817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223294+0000","last_change":"2024-09-13T17:17:52.223294+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223294+0000","last_undegraded":"2024-09-13T17:17:52.223294+0000","last_fullsized":"2024-09-13T17:17:52.223294+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224819+0000","last_change":"2024-09-13T17:17:52.224819+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224819+0000","last_undegraded":"2024-09-13T17:17:52.224819+0000","last_fullsized":"2024-09-13T17:17:52.224819+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226117+0000","last_change":"2024-09-13T17:17:52.226117+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226117+0000","last_undegraded":"2024-09-13T17:17:52.226117+0000","last_fullsized":"2024-09-13T17:17:52.226117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238846+0000","last_change":"2024-09-13T17:17:52.238846+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238846+0000","last_undegraded":"2024-09-13T17:17:52.238846+0000","last_fullsized":"2024-09-13T17:17:52.238846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224374+0000","last_change":"2024-09-13T17:17:52.224374+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224374+0000","last_undegraded":"2024-09-13T17:17:52.224374+0000","last_fullsized":"2024-09-13T17:17:52.224374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223755+0000","last_change":"2024-09-13T17:17:52.223755+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223755+0000","last_undegraded":"2024-09-13T17:17:52.223755+0000","last_fullsized":"2024-09-13T17:17:52.223755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223901+0000","last_change":"2024-09-13T17:17:52.223901+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223901+0000","last_undegraded":"2024-09-13T17:17:52.223901+0000","last_fullsized":"2024-09-13T17:17:52.223901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226238+0000","last_change":"2024-09-13T17:17:52.226238+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226238+0000","last_undegraded":"2024-09-13T17:17:52.226238+0000","last_fullsized":"2024-09-13T17:17:52.226238+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227220+0000","last_change":"2024-09-13T17:17:52.227220+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227220+0000","last_undegraded":"2024-09-13T17:17:52.227220+0000","last_fullsized":"2024-09-13T17:17:52.227220+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226530+0000","last_change":"2024-09-13T17:17:52.226530+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226530+0000","last_undegraded":"2024-09-13T17:17:52.226530+0000","last_fullsized":"2024-09-13T17:17:52.226530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223510+0000","last_change":"2024-09-13T17:17:52.223510+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223510+0000","last_undegraded":"2024-09-13T17:17:52.223510+0000","last_fullsized":"2024-09-13T17:17:52.223510+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225699+0000","last_change":"2024-09-13T17:17:52.225699+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225699+0000","last_undegraded":"2024-09-13T17:17:52.225699+0000","last_fullsized":"2024-09-13T17:17:52.225699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238879+0000","last_change":"2024-09-13T17:17:52.238879+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238879+0000","last_undegraded":"2024-09-13T17:17:52.238879+0000","last_fullsized":"2024-09-13T17:17:52.238879+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237608+0000","last_change":"2024-09-13T17:17:52.237608+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237608+0000","last_undegraded":"2024-09-13T17:17:52.237608+0000","last_fullsized":"2024-09-13T17:17:52.237608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224407+0000","last_change":"2024-09-13T17:17:52.224407+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224407+0000","last_undegraded":"2024-09-13T17:17:52.224407+0000","last_fullsized":"2024-09-13T17:17:52.224407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223435+0000","last_change":"2024-09-13T17:17:52.223435+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223435+0000","last_undegraded":"2024-09-13T17:17:52.223435+0000","last_fullsized":"2024-09-13T17:17:52.223435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224408+0000","last_change":"2024-09-13T17:17:52.224408+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224408+0000","last_undegraded":"2024-09-13T17:17:52.224408+0000","last_fullsized":"2024-09-13T17:17:52.224408+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222020+0000","last_change":"2024-09-13T17:17:52.222020+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222020+0000","last_undegraded":"2024-09-13T17:17:52.222020+0000","last_fullsized":"2024-09-13T17:17:52.222020+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222812+0000","last_change":"2024-09-13T17:17:52.222812+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222812+0000","last_undegraded":"2024-09-13T17:17:52.222812+0000","last_fullsized":"2024-09-13T17:17:52.222812+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225984+0000","last_change":"2024-09-13T17:17:52.225984+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225984+0000","last_undegraded":"2024-09-13T17:17:52.225984+0000","last_fullsized":"2024-09-13T17:17:52.225984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222635+0000","last_change":"2024-09-13T17:17:52.222635+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222635+0000","last_undegraded":"2024-09-13T17:17:52.222635+0000","last_fullsized":"2024-09-13T17:17:52.222635+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221752+0000","last_change":"2024-09-13T17:17:52.221752+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221752+0000","last_undegraded":"2024-09-13T17:17:52.221752+0000","last_fullsized":"2024-09-13T17:17:52.221752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224307+0000","last_change":"2024-09-13T17:17:52.224307+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224307+0000","last_undegraded":"2024-09-13T17:17:52.224307+0000","last_fullsized":"2024-09-13T17:17:52.224307+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230730+0000","last_change":"2024-09-13T17:17:52.230730+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230730+0000","last_undegraded":"2024-09-13T17:17:52.230730+0000","last_fullsized":"2024-09-13T17:17:52.230730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223983+0000","last_change":"2024-09-13T17:17:52.223983+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223983+0000","last_undegraded":"2024-09-13T17:17:52.223983+0000","last_fullsized":"2024-09-13T17:17:52.223983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225006+0000","last_change":"2024-09-13T17:17:52.225006+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225006+0000","last_undegraded":"2024-09-13T17:17:52.225006+0000","last_fullsized":"2024-09-13T17:17:52.225006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220654+0000","last_change":"2024-09-13T17:17:52.220654+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220654+0000","last_undegraded":"2024-09-13T17:17:52.220654+0000","last_fullsized":"2024-09-13T17:17:52.220654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221641+0000","last_change":"2024-09-13T17:17:52.221641+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221641+0000","last_undegraded":"2024-09-13T17:17:52.221641+0000","last_fullsized":"2024-09-13T17:17:52.221641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237400+0000","last_change":"2024-09-13T17:17:52.237400+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237400+0000","last_undegraded":"2024-09-13T17:17:52.237400+0000","last_fullsized":"2024-09-13T17:17:52.237400+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227897+0000","last_change":"2024-09-13T17:17:52.227897+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227897+0000","last_undegraded":"2024-09-13T17:17:52.227897+0000","last_fullsized":"2024-09-13T17:17:52.227897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.247521+0000","last_change":"2024-09-13T17:17:52.242530+0000","last_active":"2024-09-13T17:17:52.247521+0000","last_peered":"2024-09-13T17:17:52.247521+0000","last_clean":"2024-09-13T17:17:52.247521+0000","last_became_active":"2024-09-13T17:17:52.242237+0000","last_became_peered":"2024-09-13T17:17:52.242237+0000","last_unstale":"2024-09-13T17:17:52.247521+0000","last_undegraded":"2024-09-13T17:17:52.247521+0000","last_fullsized":"2024-09-13T17:17:52.247521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230433+0000","last_change":"2024-09-13T17:17:52.230433+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230433+0000","last_undegraded":"2024-09-13T17:17:52.230433+0000","last_fullsized":"2024-09-13T17:17:52.230433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237619+0000","last_change":"2024-09-13T17:17:52.234111+0000","last_active":"2024-09-13T17:17:52.237619+0000","last_peered":"2024-09-13T17:17:52.237619+0000","last_clean":"2024-09-13T17:17:52.237619+0000","last_became_active":"2024-09-13T17:17:52.233852+0000","last_became_peered":"2024-09-13T17:17:52.233852+0000","last_unstale":"2024-09-13T17:17:52.237619+0000","last_undegraded":"2024-09-13T17:17:52.237619+0000","last_fullsized":"2024-09-13T17:17:52.237619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225412+0000","last_change":"2024-09-13T17:17:52.225412+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225412+0000","last_undegraded":"2024-09-13T17:17:52.225412+0000","last_fullsized":"2024-09-13T17:17:52.225412+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239460+0000","last_change":"2024-09-13T17:17:52.234877+0000","last_active":"2024-09-13T17:17:52.239460+0000","last_peered":"2024-09-13T17:17:52.239460+0000","last_clean":"2024-09-13T17:17:52.239460+0000","last_became_active":"2024-09-13T17:17:52.234605+0000","last_became_peered":"2024-09-13T17:17:52.234605+0000","last_unstale":"2024-09-13T17:17:52.239460+0000","last_undegraded":"2024-09-13T17:17:52.239460+0000","last_fullsized":"2024-09-13T17:17:52.239460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:36.404134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.235170+0000","last_change":"2024-09-13T17:17:52.235170+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.235170+0000","last_undegraded":"2024-09-13T17:17:52.235170+0000","last_fullsized":"2024-09-13T17:17:52.235170+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237478+0000","last_change":"2024-09-13T17:17:52.233058+0000","last_active":"2024-09-13T17:17:52.237478+0000","last_peered":"2024-09-13T17:17:52.237478+0000","last_clean":"2024-09-13T17:17:52.237478+0000","last_became_active":"2024-09-13T17:17:52.232674+0000","last_became_peered":"2024-09-13T17:17:52.232674+0000","last_unstale":"2024-09-13T17:17:52.237478+0000","last_undegraded":"2024-09-13T17:17:52.237478+0000","last_fullsized":"2024-09-13T17:17:52.237478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223317+0000","last_change":"2024-09-13T17:17:52.223317+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223317+0000","last_undegraded":"2024-09-13T17:17:52.223317+0000","last_fullsized":"2024-09-13T17:17:52.223317+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237562+0000","last_change":"2024-09-13T17:17:52.232698+0000","last_active":"2024-09-13T17:17:52.237562+0000","last_peered":"2024-09-13T17:17:52.237562+0000","last_clean":"2024-09-13T17:17:52.237562+0000","last_became_active":"2024-09-13T17:17:52.232413+0000","last_became_peered":"2024-09-13T17:17:52.232413+0000","last_unstale":"2024-09-13T17:17:52.237562+0000","last_undegraded":"2024-09-13T17:17:52.237562+0000","last_fullsized":"2024-09-13T17:17:52.237562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:38.015314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225550+0000","last_change":"2024-09-13T17:17:52.225550+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225550+0000","last_undegraded":"2024-09-13T17:17:52.225550+0000","last_fullsized":"2024-09-13T17:17:52.225550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235498+0000","last_change":"2024-09-13T17:17:52.234541+0000","last_active":"2024-09-13T17:17:52.235498+0000","last_peered":"2024-09-13T17:17:52.235498+0000","last_clean":"2024-09-13T17:17:52.235498+0000","last_became_active":"2024-09-13T17:17:52.234284+0000","last_became_peered":"2024-09-13T17:17:52.234284+0000","last_unstale":"2024-09-13T17:17:52.235498+0000","last_undegraded":"2024-09-13T17:17:52.235498+0000","last_fullsized":"2024-09-13T17:17:52.235498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227437+0000","last_change":"2024-09-13T17:17:52.227437+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227437+0000","last_undegraded":"2024-09-13T17:17:52.227437+0000","last_fullsized":"2024-09-13T17:17:52.227437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236430+0000","last_change":"2024-09-13T17:17:52.234865+0000","last_active":"2024-09-13T17:17:52.236430+0000","last_peered":"2024-09-13T17:17:52.236430+0000","last_clean":"2024-09-13T17:17:52.236430+0000","last_became_active":"2024-09-13T17:17:52.234561+0000","last_became_peered":"2024-09-13T17:17:52.234561+0000","last_unstale":"2024-09-13T17:17:52.236430+0000","last_undegraded":"2024-09-13T17:17:52.236430+0000","last_fullsized":"2024-09-13T17:17:52.236430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:10.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226115+0000","last_change":"2024-09-13T17:17:52.226115+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226115+0000","last_undegraded":"2024-09-13T17:17:52.226115+0000","last_fullsized":"2024-09-13T17:17:52.226115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244881+0000","last_change":"2024-09-13T17:17:52.241484+0000","last_active":"2024-09-13T17:17:52.244881+0000","last_peered":"2024-09-13T17:17:52.244881+0000","last_clean":"2024-09-13T17:17:52.244881+0000","last_became_active":"2024-09-13T17:17:52.241306+0000","last_became_peered":"2024-09-13T17:17:52.241306+0000","last_unstale":"2024-09-13T17:17:52.244881+0000","last_undegraded":"2024-09-13T17:17:52.244881+0000","last_fullsized":"2024-09-13T17:17:52.244881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:09.998148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221461+0000","last_change":"2024-09-13T17:17:52.221461+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221461+0000","last_undegraded":"2024-09-13T17:17:52.221461+0000","last_fullsized":"2024-09-13T17:17:52.221461+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236626+0000","last_change":"2024-09-13T17:17:52.231485+0000","last_active":"2024-09-13T17:17:52.236626+0000","last_peered":"2024-09-13T17:17:52.236626+0000","last_clean":"2024-09-13T17:17:52.236626+0000","last_became_active":"2024-09-13T17:17:52.231207+0000","last_became_peered":"2024-09-13T17:17:52.231207+0000","last_unstale":"2024-09-13T17:17:52.236626+0000","last_undegraded":"2024-09-13T17:17:52.236626+0000","last_fullsized":"2024-09-13T17:17:52.236626+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226678+0000","last_change":"2024-09-13T17:17:52.226678+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226678+0000","last_undegraded":"2024-09-13T17:17:52.226678+0000","last_fullsized":"2024-09-13T17:17:52.226678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.234405+0000","last_change":"2024-09-13T17:17:52.232671+0000","last_active":"2024-09-13T17:17:52.234405+0000","last_peered":"2024-09-13T17:17:52.234405+0000","last_clean":"2024-09-13T17:17:52.234405+0000","last_became_active":"2024-09-13T17:17:52.232353+0000","last_became_peered":"2024-09-13T17:17:52.232353+0000","last_unstale":"2024-09-13T17:17:52.234405+0000","last_undegraded":"2024-09-13T17:17:52.234405+0000","last_fullsized":"2024-09-13T17:17:52.234405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242455+0000","last_change":"2024-09-13T17:17:52.236765+0000","last_active":"2024-09-13T17:17:52.242455+0000","last_peered":"2024-09-13T17:17:52.242455+0000","last_clean":"2024-09-13T17:17:52.242455+0000","last_became_active":"2024-09-13T17:17:52.236448+0000","last_became_peered":"2024-09-13T17:17:52.236448+0000","last_unstale":"2024-09-13T17:17:52.242455+0000","last_undegraded":"2024-09-13T17:17:52.242455+0000","last_fullsized":"2024-09-13T17:17:52.242455+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:21.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223735+0000","last_change":"2024-09-13T17:17:52.223735+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223735+0000","last_undegraded":"2024-09-13T17:17:52.223735+0000","last_fullsized":"2024-09-13T17:17:52.223735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241939+0000","last_change":"2024-09-13T17:17:52.241241+0000","last_active":"2024-09-13T17:17:52.241939+0000","last_peered":"2024-09-13T17:17:52.241939+0000","last_clean":"2024-09-13T17:17:52.241939+0000","last_became_active":"2024-09-13T17:17:52.240969+0000","last_became_peered":"2024-09-13T17:17:52.240969+0000","last_unstale":"2024-09-13T17:17:52.241939+0000","last_undegraded":"2024-09-13T17:17:52.241939+0000","last_fullsized":"2024-09-13T17:17:52.241939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:20.654650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222754+0000","last_change":"2024-09-13T17:17:52.222754+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222754+0000","last_undegraded":"2024-09-13T17:17:52.222754+0000","last_fullsized":"2024-09-13T17:17:52.222754+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244916+0000","last_change":"2024-09-13T17:17:52.241975+0000","last_active":"2024-09-13T17:17:52.244916+0000","last_peered":"2024-09-13T17:17:52.244916+0000","last_clean":"2024-09-13T17:17:52.244916+0000","last_became_active":"2024-09-13T17:17:52.241737+0000","last_became_peered":"2024-09-13T17:17:52.241737+0000","last_unstale":"2024-09-13T17:17:52.244916+0000","last_undegraded":"2024-09-13T17:17:52.244916+0000","last_fullsized":"2024-09-13T17:17:52.244916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:48.511892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221084+0000","last_change":"2024-09-13T17:17:52.221084+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221084+0000","last_undegraded":"2024-09-13T17:17:52.221084+0000","last_fullsized":"2024-09-13T17:17:52.221084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236386+0000","last_change":"2024-09-13T17:17:52.235364+0000","last_active":"2024-09-13T17:17:52.236386+0000","last_peered":"2024-09-13T17:17:52.236386+0000","last_clean":"2024-09-13T17:17:52.236386+0000","last_became_active":"2024-09-13T17:17:52.233817+0000","last_became_peered":"2024-09-13T17:17:52.233817+0000","last_unstale":"2024-09-13T17:17:52.236386+0000","last_undegraded":"2024-09-13T17:17:52.236386+0000","last_fullsized":"2024-09-13T17:17:52.236386+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:03.690380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.229524+0000","last_change":"2024-09-13T17:17:52.229524+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.229524+0000","last_undegraded":"2024-09-13T17:17:52.229524+0000","last_fullsized":"2024-09-13T17:17:52.229524+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240548+0000","last_change":"2024-09-13T17:17:52.239219+0000","last_active":"2024-09-13T17:17:52.240548+0000","last_peered":"2024-09-13T17:17:52.240548+0000","last_clean":"2024-09-13T17:17:52.240548+0000","last_became_active":"2024-09-13T17:17:52.238911+0000","last_became_peered":"2024-09-13T17:17:52.238911+0000","last_unstale":"2024-09-13T17:17:52.240548+0000","last_undegraded":"2024-09-13T17:17:52.240548+0000","last_fullsized":"2024-09-13T17:17:52.240548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228565+0000","last_change":"2024-09-13T17:17:52.228565+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228565+0000","last_undegraded":"2024-09-13T17:17:52.228565+0000","last_fullsized":"2024-09-13T17:17:52.228565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235502+0000","last_change":"2024-09-13T17:17:52.234905+0000","last_active":"2024-09-13T17:17:52.235502+0000","last_peered":"2024-09-13T17:17:52.235502+0000","last_clean":"2024-09-13T17:17:52.235502+0000","last_became_active":"2024-09-13T17:17:52.234585+0000","last_became_peered":"2024-09-13T17:17:52.234585+0000","last_unstale":"2024-09-13T17:17:52.235502+0000","last_undegraded":"2024-09-13T17:17:52.235502+0000","last_fullsized":"2024-09-13T17:17:52.235502+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226776+0000","last_change":"2024-09-13T17:17:52.226776+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226776+0000","last_undegraded":"2024-09-13T17:17:52.226776+0000","last_fullsized":"2024-09-13T17:17:52.226776+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241920+0000","last_change":"2024-09-13T17:17:52.235049+0000","last_active":"2024-09-13T17:17:52.241920+0000","last_peered":"2024-09-13T17:17:52.241920+0000","last_clean":"2024-09-13T17:17:52.241920+0000","last_became_active":"2024-09-13T17:17:52.234785+0000","last_became_peered":"2024-09-13T17:17:52.234785+0000","last_unstale":"2024-09-13T17:17:52.241920+0000","last_undegraded":"2024-09-13T17:17:52.241920+0000","last_fullsized":"2024-09-13T17:17:52.241920+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224276+0000","last_change":"2024-09-13T17:17:52.224276+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224276+0000","last_undegraded":"2024-09-13T17:17:52.224276+0000","last_fullsized":"2024-09-13T17:17:52.224276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237336+0000","last_change":"2024-09-13T17:17:52.233704+0000","last_active":"2024-09-13T17:17:52.237336+0000","last_peered":"2024-09-13T17:17:52.237336+0000","last_clean":"2024-09-13T17:17:52.237336+0000","last_became_active":"2024-09-13T17:17:52.233427+0000","last_became_peered":"2024-09-13T17:17:52.233427+0000","last_unstale":"2024-09-13T17:17:52.237336+0000","last_undegraded":"2024-09-13T17:17:52.237336+0000","last_fullsized":"2024-09-13T17:17:52.237336+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:24.347887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223871+0000","last_change":"2024-09-13T17:17:52.223871+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223871+0000","last_undegraded":"2024-09-13T17:17:52.223871+0000","last_fullsized":"2024-09-13T17:17:52.223871+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237573+0000","last_change":"2024-09-13T17:17:52.233308+0000","last_active":"2024-09-13T17:17:52.237573+0000","last_peered":"2024-09-13T17:17:52.237573+0000","last_clean":"2024-09-13T17:17:52.237573+0000","last_became_active":"2024-09-13T17:17:52.233057+0000","last_became_peered":"2024-09-13T17:17:52.233057+0000","last_unstale":"2024-09-13T17:17:52.237573+0000","last_undegraded":"2024-09-13T17:17:52.237573+0000","last_fullsized":"2024-09-13T17:17:52.237573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:52.681260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224342+0000","last_change":"2024-09-13T17:17:52.224342+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224342+0000","last_undegraded":"2024-09-13T17:17:52.224342+0000","last_fullsized":"2024-09-13T17:17:52.224342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232030+0000","last_change":"2024-09-13T17:17:52.226255+0000","last_active":"2024-09-13T17:17:52.232030+0000","last_peered":"2024-09-13T17:17:52.232030+0000","last_clean":"2024-09-13T17:17:52.232030+0000","last_became_active":"2024-09-13T17:17:52.225926+0000","last_became_peered":"2024-09-13T17:17:52.225926+0000","last_unstale":"2024-09-13T17:17:52.232030+0000","last_undegraded":"2024-09-13T17:17:52.232030+0000","last_fullsized":"2024-09-13T17:17:52.232030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:09.325792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221223+0000","last_change":"2024-09-13T17:17:52.221223+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221223+0000","last_undegraded":"2024-09-13T17:17:52.221223+0000","last_fullsized":"2024-09-13T17:17:52.221223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.238187+0000","last_change":"2024-09-13T17:17:52.236308+0000","last_active":"2024-09-13T17:17:52.238187+0000","last_peered":"2024-09-13T17:17:52.238187+0000","last_clean":"2024-09-13T17:17:52.238187+0000","last_became_active":"2024-09-13T17:17:52.236019+0000","last_became_peered":"2024-09-13T17:17:52.236019+0000","last_unstale":"2024-09-13T17:17:52.238187+0000","last_undegraded":"2024-09-13T17:17:52.238187+0000","last_fullsized":"2024-09-13T17:17:52.238187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222594+0000","last_change":"2024-09-13T17:17:52.222594+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222594+0000","last_undegraded":"2024-09-13T17:17:52.222594+0000","last_fullsized":"2024-09-13T17:17:52.222594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242384+0000","last_change":"2024-09-13T17:17:52.239876+0000","last_active":"2024-09-13T17:17:52.242384+0000","last_peered":"2024-09-13T17:17:52.242384+0000","last_clean":"2024-09-13T17:17:52.242384+0000","last_became_active":"2024-09-13T17:17:52.239592+0000","last_became_peered":"2024-09-13T17:17:52.239592+0000","last_unstale":"2024-09-13T17:17:52.242384+0000","last_undegraded":"2024-09-13T17:17:52.242384+0000","last_fullsized":"2024-09-13T17:17:52.242384+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222982+0000","last_change":"2024-09-13T17:17:52.222982+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222982+0000","last_undegraded":"2024-09-13T17:17:52.222982+0000","last_fullsized":"2024-09-13T17:17:52.222982+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240581+0000","last_change":"2024-09-13T17:17:52.238644+0000","last_active":"2024-09-13T17:17:52.240581+0000","last_peered":"2024-09-13T17:17:52.240581+0000","last_clean":"2024-09-13T17:17:52.240581+0000","last_became_active":"2024-09-13T17:17:52.238325+0000","last_became_peered":"2024-09-13T17:17:52.238325+0000","last_unstale":"2024-09-13T17:17:52.240581+0000","last_undegraded":"2024-09-13T17:17:52.240581+0000","last_fullsized":"2024-09-13T17:17:52.240581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:02.311277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227148+0000","last_change":"2024-09-13T17:17:52.227148+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227148+0000","last_undegraded":"2024-09-13T17:17:52.227148+0000","last_fullsized":"2024-09-13T17:17:52.227148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237322+0000","last_change":"2024-09-13T17:17:52.233210+0000","last_active":"2024-09-13T17:17:52.237322+0000","last_peered":"2024-09-13T17:17:52.237322+0000","last_clean":"2024-09-13T17:17:52.237322+0000","last_became_active":"2024-09-13T17:17:52.232940+0000","last_became_peered":"2024-09-13T17:17:52.232940+0000","last_unstale":"2024-09-13T17:17:52.237322+0000","last_undegraded":"2024-09-13T17:17:52.237322+0000","last_fullsized":"2024-09-13T17:17:52.237322+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:58.047973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223179+0000","last_change":"2024-09-13T17:17:52.223179+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223179+0000","last_undegraded":"2024-09-13T17:17:52.223179+0000","last_fullsized":"2024-09-13T17:17:52.223179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237599+0000","last_change":"2024-09-13T17:17:52.233412+0000","last_active":"2024-09-13T17:17:52.237599+0000","last_peered":"2024-09-13T17:17:52.237599+0000","last_clean":"2024-09-13T17:17:52.237599+0000","last_became_active":"2024-09-13T17:17:52.233154+0000","last_became_peered":"2024-09-13T17:17:52.233154+0000","last_unstale":"2024-09-13T17:17:52.237599+0000","last_undegraded":"2024-09-13T17:17:52.237599+0000","last_fullsized":"2024-09-13T17:17:52.237599+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:17.024663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223889+0000","last_change":"2024-09-13T17:17:52.223889+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223889+0000","last_undegraded":"2024-09-13T17:17:52.223889+0000","last_fullsized":"2024-09-13T17:17:52.223889+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242436+0000","last_change":"2024-09-13T17:17:52.236227+0000","last_active":"2024-09-13T17:17:52.242436+0000","last_peered":"2024-09-13T17:17:52.242436+0000","last_clean":"2024-09-13T17:17:52.242436+0000","last_became_active":"2024-09-13T17:17:52.235979+0000","last_became_peered":"2024-09-13T17:17:52.235979+0000","last_unstale":"2024-09-13T17:17:52.242436+0000","last_undegraded":"2024-09-13T17:17:52.242436+0000","last_fullsized":"2024-09-13T17:17:52.242436+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:41.421504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221320+0000","last_change":"2024-09-13T17:17:52.221320+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221320+0000","last_undegraded":"2024-09-13T17:17:52.221320+0000","last_fullsized":"2024-09-13T17:17:52.221320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237449+0000","last_change":"2024-09-13T17:17:52.232971+0000","last_active":"2024-09-13T17:17:52.237449+0000","last_peered":"2024-09-13T17:17:52.237449+0000","last_clean":"2024-09-13T17:17:52.237449+0000","last_became_active":"2024-09-13T17:17:52.232691+0000","last_became_peered":"2024-09-13T17:17:52.232691+0000","last_unstale":"2024-09-13T17:17:52.237449+0000","last_undegraded":"2024-09-13T17:17:52.237449+0000","last_fullsized":"2024-09-13T17:17:52.237449+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228094+0000","last_change":"2024-09-13T17:17:52.228094+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228094+0000","last_undegraded":"2024-09-13T17:17:52.228094+0000","last_fullsized":"2024-09-13T17:17:52.228094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235692+0000","last_change":"2024-09-13T17:17:52.232914+0000","last_active":"2024-09-13T17:17:52.235692+0000","last_peered":"2024-09-13T17:17:52.235692+0000","last_clean":"2024-09-13T17:17:52.235692+0000","last_became_active":"2024-09-13T17:17:52.232662+0000","last_became_peered":"2024-09-13T17:17:52.232662+0000","last_unstale":"2024-09-13T17:17:52.235692+0000","last_undegraded":"2024-09-13T17:17:52.235692+0000","last_fullsized":"2024-09-13T17:17:52.235692+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:16.955126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224252+0000","last_change":"2024-09-13T17:17:52.224252+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224252+0000","last_undegraded":"2024-09-13T17:17:52.224252+0000","last_fullsized":"2024-09-13T17:17:52.224252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232153+0000","last_change":"2024-09-13T17:17:52.228592+0000","last_active":"2024-09-13T17:17:52.232153+0000","last_peered":"2024-09-13T17:17:52.232153+0000","last_clean":"2024-09-13T17:17:52.232153+0000","last_became_active":"2024-09-13T17:17:52.228266+0000","last_became_peered":"2024-09-13T17:17:52.228266+0000","last_unstale":"2024-09-13T17:17:52.232153+0000","last_undegraded":"2024-09-13T17:17:52.232153+0000","last_fullsized":"2024-09-13T17:17:52.232153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.416745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224577+0000","last_change":"2024-09-13T17:17:52.224577+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224577+0000","last_undegraded":"2024-09-13T17:17:52.224577+0000","last_fullsized":"2024-09-13T17:17:52.224577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241880+0000","last_change":"2024-09-13T17:17:52.234917+0000","last_active":"2024-09-13T17:17:52.241880+0000","last_peered":"2024-09-13T17:17:52.241880+0000","last_clean":"2024-09-13T17:17:52.241880+0000","last_became_active":"2024-09-13T17:17:52.234638+0000","last_became_peered":"2024-09-13T17:17:52.234638+0000","last_unstale":"2024-09-13T17:17:52.241880+0000","last_undegraded":"2024-09-13T17:17:52.241880+0000","last_fullsized":"2024-09-13T17:17:52.241880+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222365+0000","last_change":"2024-09-13T17:17:52.222365+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222365+0000","last_undegraded":"2024-09-13T17:17:52.222365+0000","last_fullsized":"2024-09-13T17:17:52.222365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239519+0000","last_change":"2024-09-13T17:17:52.236289+0000","last_active":"2024-09-13T17:17:52.239519+0000","last_peered":"2024-09-13T17:17:52.239519+0000","last_clean":"2024-09-13T17:17:52.239519+0000","last_became_active":"2024-09-13T17:17:52.235980+0000","last_became_peered":"2024-09-13T17:17:52.235980+0000","last_unstale":"2024-09-13T17:17:52.239519+0000","last_undegraded":"2024-09-13T17:17:52.239519+0000","last_fullsized":"2024-09-13T17:17:52.239519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:17.661696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225579+0000","last_change":"2024-09-13T17:17:52.225579+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225579+0000","last_undegraded":"2024-09-13T17:17:52.225579+0000","last_fullsized":"2024-09-13T17:17:52.225579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235473+0000","last_change":"2024-09-13T17:17:52.234737+0000","last_active":"2024-09-13T17:17:52.235473+0000","last_peered":"2024-09-13T17:17:52.235473+0000","last_clean":"2024-09-13T17:17:52.235473+0000","last_became_active":"2024-09-13T17:17:52.234268+0000","last_became_peered":"2024-09-13T17:17:52.234268+0000","last_unstale":"2024-09-13T17:17:52.235473+0000","last_undegraded":"2024-09-13T17:17:52.235473+0000","last_fullsized":"2024-09-13T17:17:52.235473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:17:51.217617+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:51.217617+0000","last_peered":"2024-09-13T17:17:51.217617+0000","last_clean":"2024-09-13T17:17:51.217617+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:51.217617+0000","last_undegraded":"2024-09-13T17:17:51.217617+0000","last_fullsized":"2024-09-13T17:17:51.217617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.439}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.504},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.308},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.442}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:55.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.685+0000 7f69537b5640 1 Processor -- start 2024-09-13T17:17:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.685+0000 7f69537b5640 1 -- start start 2024-09-13T17:17:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f69537b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 0x7f694c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f69537b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15a880 0x7f694c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f69537b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694c0b2180 con 0x7f694c0cafb0 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f69537b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0cdab0 con 0x7f694c15a880 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f69537b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0b2420 con 0x7f694c15a4a0 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15a880 0x7f694c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f694c15a880 0x7f694c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48198/0 (socket says 172.21.15.5:48198) 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 -- 172.21.15.5:0/895753997 learned_addr learned my addr 172.21.15.5:0/895753997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6951551640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 0x7f694c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 -- 172.21.15.5:0/895753997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 msgr2=0x7f694c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 0x7f694c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 -- 172.21.15.5:0/895753997 >> v1:172.21.15.179:6789/0 conn(0x7f694c0cafb0 legacy=0x7f694c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6950d50640 1 -- 172.21.15.5:0/895753997 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0b2700 con 0x7f694c15a880 2024-09-13T17:17:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.686+0000 7f6951551640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 0x7f694c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.687+0000 7f6950d50640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15a880 0x7f694c0cd570 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f693c009870 tx=0x7f693c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b748e5cb48ac5885 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.687+0000 7f6943fff640 1 -- 172.21.15.5:0/895753997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032440 con 0x7f694c15a880 2024-09-13T17:17:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.687+0000 7f6943fff640 1 -- 172.21.15.5:0/895753997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c0325a0 con 0x7f694c15a880 2024-09-13T17:17:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.687+0000 7f6943fff640 1 -- 172.21.15.5:0/895753997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032930 con 0x7f694c15a880 2024-09-13T17:17:55.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.687+0000 7f69537b5640 1 -- 172.21.15.5:0/895753997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15a880 msgr2=0x7f694c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15a880 0x7f694c0cd570 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f693c009870 tx=0x7f693c02a270 comp rx=0 tx=0).stop 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 -- 172.21.15.5:0/895753997 shutdown_connections 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c15a880 0x7f694c0cd570 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 --2- 172.21.15.5:0/895753997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a4a0 0x7f694c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 -- 172.21.15.5:0/895753997 >> 172.21.15.5:0/895753997 conn(0x7f694c066200 msgr2=0x7f694c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 -- 172.21.15.5:0/895753997 shutdown_connections 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.688+0000 7f69537b5640 1 -- 172.21.15.5:0/895753997 wait complete. 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.689+0000 7f69537b5640 1 Processor -- start 2024-09-13T17:17:55.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.689+0000 7f69537b5640 1 -- start start 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c15a4a0 0x7f694c1f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 0x7f694c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0a8db0 con 0x7f694c0cafb0 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0a9610 con 0x7f694c15a4a0 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1f0aa0 con 0x7f694c15a880 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48212/0 (socket says 172.21.15.5:48212) 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 -- 172.21.15.5:0/2098181495 learned_addr learned my addr 172.21.15.5:0/2098181495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951d52640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 0x7f694c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 -- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 msgr2=0x7f694c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 0x7f694c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 -- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c15a4a0 msgr2=0x7f694c1f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6950d50640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c15a4a0 0x7f694c1f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c15a4a0 0x7f694c1f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 -- 172.21.15.5:0/2098181495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0094d0 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951d52640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 0x7f694c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6951551640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f694800e7e0 tx=0x7f694800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948004030 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948004190 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c0ad330 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.690+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948004520 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.691+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c0a8fc0 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.691+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c0672f0 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.692+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f694800c6d0 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.692+0000 7f6941ffb640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 0x7f693006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.692+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f69480891c0 con 0x7f694c0cafb0 2024-09-13T17:17:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.692+0000 7f6950d50640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 0x7f693006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.693+0000 7f6950d50640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 0x7f693006d0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f693c034000 tx=0x7f693c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:55.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.696+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6948054260 con 0x7f694c0cafb0 2024-09-13T17:17:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.864+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f694c0a9750 con 0x7f693006ac00 2024-09-13T17:17:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.872+0000 7f6941ffb640 1 -- 172.21.15.5:0/2098181495 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286309 (secure 0 0 0) 0x7f693c03b400 con 0x7f693006ac00 2024-09-13T17:17:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:55.878 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:55.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 msgr2=0x7f693006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 0x7f693006d0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f693c034000 tx=0x7f693c02e000 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 msgr2=0x7f694c1554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f694800e7e0 tx=0x7f694800eca0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 shutdown_connections 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f694c15a880 0x7f694c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c15a4a0 0x7f694c1f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f693006ac00 0x7f693006d0c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 --2- 172.21.15.5:0/2098181495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f694c0cafb0 0x7f694c1554d0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 >> 172.21.15.5:0/2098181495 conn(0x7f694c066200 msgr2=0x7f694c15ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 shutdown_connections 2024-09-13T17:17:55.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:55.875+0000 7f69537b5640 1 -- 172.21.15.5:0/2098181495 wait complete. 2024-09-13T17:17:55.888 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-13T17:17:55.324213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246688,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728032,"statfs":{"total":773094113280,"available":772841504768,"internally_reserved":0,"allocated":10264576,"data_stored":5293248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109304"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223559+0000","last_change":"2024-09-13T17:17:52.223559+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223559+0000","last_undegraded":"2024-09-13T17:17:52.223559+0000","last_fullsized":"2024-09-13T17:17:52.223559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220817+0000","last_change":"2024-09-13T17:17:52.220817+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220817+0000","last_undegraded":"2024-09-13T17:17:52.220817+0000","last_fullsized":"2024-09-13T17:17:52.220817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223294+0000","last_change":"2024-09-13T17:17:52.223294+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223294+0000","last_undegraded":"2024-09-13T17:17:52.223294+0000","last_fullsized":"2024-09-13T17:17:52.223294+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224819+0000","last_change":"2024-09-13T17:17:52.224819+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224819+0000","last_undegraded":"2024-09-13T17:17:52.224819+0000","last_fullsized":"2024-09-13T17:17:52.224819+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226117+0000","last_change":"2024-09-13T17:17:52.226117+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226117+0000","last_undegraded":"2024-09-13T17:17:52.226117+0000","last_fullsized":"2024-09-13T17:17:52.226117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238846+0000","last_change":"2024-09-13T17:17:52.238846+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238846+0000","last_undegraded":"2024-09-13T17:17:52.238846+0000","last_fullsized":"2024-09-13T17:17:52.238846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224374+0000","last_change":"2024-09-13T17:17:52.224374+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224374+0000","last_undegraded":"2024-09-13T17:17:52.224374+0000","last_fullsized":"2024-09-13T17:17:52.224374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223755+0000","last_change":"2024-09-13T17:17:52.223755+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223755+0000","last_undegraded":"2024-09-13T17:17:52.223755+0000","last_fullsized":"2024-09-13T17:17:52.223755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223901+0000","last_change":"2024-09-13T17:17:52.223901+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223901+0000","last_undegraded":"2024-09-13T17:17:52.223901+0000","last_fullsized":"2024-09-13T17:17:52.223901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226238+0000","last_change":"2024-09-13T17:17:52.226238+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226238+0000","last_undegraded":"2024-09-13T17:17:52.226238+0000","last_fullsized":"2024-09-13T17:17:52.226238+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227220+0000","last_change":"2024-09-13T17:17:52.227220+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227220+0000","last_undegraded":"2024-09-13T17:17:52.227220+0000","last_fullsized":"2024-09-13T17:17:52.227220+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226530+0000","last_change":"2024-09-13T17:17:52.226530+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226530+0000","last_undegraded":"2024-09-13T17:17:52.226530+0000","last_fullsized":"2024-09-13T17:17:52.226530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223510+0000","last_change":"2024-09-13T17:17:52.223510+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223510+0000","last_undegraded":"2024-09-13T17:17:52.223510+0000","last_fullsized":"2024-09-13T17:17:52.223510+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225699+0000","last_change":"2024-09-13T17:17:52.225699+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225699+0000","last_undegraded":"2024-09-13T17:17:52.225699+0000","last_fullsized":"2024-09-13T17:17:52.225699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238879+0000","last_change":"2024-09-13T17:17:52.238879+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238879+0000","last_undegraded":"2024-09-13T17:17:52.238879+0000","last_fullsized":"2024-09-13T17:17:52.238879+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237608+0000","last_change":"2024-09-13T17:17:52.237608+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237608+0000","last_undegraded":"2024-09-13T17:17:52.237608+0000","last_fullsized":"2024-09-13T17:17:52.237608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224407+0000","last_change":"2024-09-13T17:17:52.224407+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224407+0000","last_undegraded":"2024-09-13T17:17:52.224407+0000","last_fullsized":"2024-09-13T17:17:52.224407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223435+0000","last_change":"2024-09-13T17:17:52.223435+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223435+0000","last_undegraded":"2024-09-13T17:17:52.223435+0000","last_fullsized":"2024-09-13T17:17:52.223435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224408+0000","last_change":"2024-09-13T17:17:52.224408+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224408+0000","last_undegraded":"2024-09-13T17:17:52.224408+0000","last_fullsized":"2024-09-13T17:17:52.224408+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222020+0000","last_change":"2024-09-13T17:17:52.222020+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222020+0000","last_undegraded":"2024-09-13T17:17:52.222020+0000","last_fullsized":"2024-09-13T17:17:52.222020+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222812+0000","last_change":"2024-09-13T17:17:52.222812+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222812+0000","last_undegraded":"2024-09-13T17:17:52.222812+0000","last_fullsized":"2024-09-13T17:17:52.222812+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225984+0000","last_change":"2024-09-13T17:17:52.225984+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225984+0000","last_undegraded":"2024-09-13T17:17:52.225984+0000","last_fullsized":"2024-09-13T17:17:52.225984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222635+0000","last_change":"2024-09-13T17:17:52.222635+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222635+0000","last_undegraded":"2024-09-13T17:17:52.222635+0000","last_fullsized":"2024-09-13T17:17:52.222635+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221752+0000","last_change":"2024-09-13T17:17:52.221752+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221752+0000","last_undegraded":"2024-09-13T17:17:52.221752+0000","last_fullsized":"2024-09-13T17:17:52.221752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224307+0000","last_change":"2024-09-13T17:17:52.224307+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224307+0000","last_undegraded":"2024-09-13T17:17:52.224307+0000","last_fullsized":"2024-09-13T17:17:52.224307+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230730+0000","last_change":"2024-09-13T17:17:52.230730+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230730+0000","last_undegraded":"2024-09-13T17:17:52.230730+0000","last_fullsized":"2024-09-13T17:17:52.230730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223983+0000","last_change":"2024-09-13T17:17:52.223983+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223983+0000","last_undegraded":"2024-09-13T17:17:52.223983+0000","last_fullsized":"2024-09-13T17:17:52.223983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225006+0000","last_change":"2024-09-13T17:17:52.225006+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225006+0000","last_undegraded":"2024-09-13T17:17:52.225006+0000","last_fullsized":"2024-09-13T17:17:52.225006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220654+0000","last_change":"2024-09-13T17:17:52.220654+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220654+0000","last_undegraded":"2024-09-13T17:17:52.220654+0000","last_fullsized":"2024-09-13T17:17:52.220654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221641+0000","last_change":"2024-09-13T17:17:52.221641+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221641+0000","last_undegraded":"2024-09-13T17:17:52.221641+0000","last_fullsized":"2024-09-13T17:17:52.221641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237400+0000","last_change":"2024-09-13T17:17:52.237400+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237400+0000","last_undegraded":"2024-09-13T17:17:52.237400+0000","last_fullsized":"2024-09-13T17:17:52.237400+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227897+0000","last_change":"2024-09-13T17:17:52.227897+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227897+0000","last_undegraded":"2024-09-13T17:17:52.227897+0000","last_fullsized":"2024-09-13T17:17:52.227897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.247521+0000","last_change":"2024-09-13T17:17:52.242530+0000","last_active":"2024-09-13T17:17:52.247521+0000","last_peered":"2024-09-13T17:17:52.247521+0000","last_clean":"2024-09-13T17:17:52.247521+0000","last_became_active":"2024-09-13T17:17:52.242237+0000","last_became_peered":"2024-09-13T17:17:52.242237+0000","last_unstale":"2024-09-13T17:17:52.247521+0000","last_undegraded":"2024-09-13T17:17:52.247521+0000","last_fullsized":"2024-09-13T17:17:52.247521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230433+0000","last_change":"2024-09-13T17:17:52.230433+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230433+0000","last_undegraded":"2024-09-13T17:17:52.230433+0000","last_fullsized":"2024-09-13T17:17:52.230433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237619+0000","last_change":"2024-09-13T17:17:52.234111+0000","last_active":"2024-09-13T17:17:52.237619+0000","last_peered":"2024-09-13T17:17:52.237619+0000","last_clean":"2024-09-13T17:17:52.237619+0000","last_became_active":"2024-09-13T17:17:52.233852+0000","last_became_peered":"2024-09-13T17:17:52.233852+0000","last_unstale":"2024-09-13T17:17:52.237619+0000","last_undegraded":"2024-09-13T17:17:52.237619+0000","last_fullsized":"2024-09-13T17:17:52.237619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225412+0000","last_change":"2024-09-13T17:17:52.225412+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225412+0000","last_undegraded":"2024-09-13T17:17:52.225412+0000","last_fullsized":"2024-09-13T17:17:52.225412+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239460+0000","last_change":"2024-09-13T17:17:52.234877+0000","last_active":"2024-09-13T17:17:52.239460+0000","last_peered":"2024-09-13T17:17:52.239460+0000","last_clean":"2024-09-13T17:17:52.239460+0000","last_became_active":"2024-09-13T17:17:52.234605+0000","last_became_peered":"2024-09-13T17:17:52.234605+0000","last_unstale":"2024-09-13T17:17:52.239460+0000","last_undegraded":"2024-09-13T17:17:52.239460+0000","last_fullsized":"2024-09-13T17:17:52.239460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:36.404134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.235170+0000","last_change":"2024-09-13T17:17:52.235170+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.235170+0000","last_undegraded":"2024-09-13T17:17:52.235170+0000","last_fullsized":"2024-09-13T17:17:52.235170+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237478+0000","last_change":"2024-09-13T17:17:52.233058+0000","last_active":"2024-09-13T17:17:52.237478+0000","last_peered":"2024-09-13T17:17:52.237478+0000","last_clean":"2024-09-13T17:17:52.237478+0000","last_became_active":"2024-09-13T17:17:52.232674+0000","last_became_peered":"2024-09-13T17:17:52.232674+0000","last_unstale":"2024-09-13T17:17:52.237478+0000","last_undegraded":"2024-09-13T17:17:52.237478+0000","last_fullsized":"2024-09-13T17:17:52.237478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223317+0000","last_change":"2024-09-13T17:17:52.223317+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223317+0000","last_undegraded":"2024-09-13T17:17:52.223317+0000","last_fullsized":"2024-09-13T17:17:52.223317+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237562+0000","last_change":"2024-09-13T17:17:52.232698+0000","last_active":"2024-09-13T17:17:52.237562+0000","last_peered":"2024-09-13T17:17:52.237562+0000","last_clean":"2024-09-13T17:17:52.237562+0000","last_became_active":"2024-09-13T17:17:52.232413+0000","last_became_peered":"2024-09-13T17:17:52.232413+0000","last_unstale":"2024-09-13T17:17:52.237562+0000","last_undegraded":"2024-09-13T17:17:52.237562+0000","last_fullsized":"2024-09-13T17:17:52.237562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:38.015314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225550+0000","last_change":"2024-09-13T17:17:52.225550+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225550+0000","last_undegraded":"2024-09-13T17:17:52.225550+0000","last_fullsized":"2024-09-13T17:17:52.225550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235498+0000","last_change":"2024-09-13T17:17:52.234541+0000","last_active":"2024-09-13T17:17:52.235498+0000","last_peered":"2024-09-13T17:17:52.235498+0000","last_clean":"2024-09-13T17:17:52.235498+0000","last_became_active":"2024-09-13T17:17:52.234284+0000","last_became_peered":"2024-09-13T17:17:52.234284+0000","last_unstale":"2024-09-13T17:17:52.235498+0000","last_undegraded":"2024-09-13T17:17:52.235498+0000","last_fullsized":"2024-09-13T17:17:52.235498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227437+0000","last_change":"2024-09-13T17:17:52.227437+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227437+0000","last_undegraded":"2024-09-13T17:17:52.227437+0000","last_fullsized":"2024-09-13T17:17:52.227437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236430+0000","last_change":"2024-09-13T17:17:52.234865+0000","last_active":"2024-09-13T17:17:52.236430+0000","last_peered":"2024-09-13T17:17:52.236430+0000","last_clean":"2024-09-13T17:17:52.236430+0000","last_became_active":"2024-09-13T17:17:52.234561+0000","last_became_peered":"2024-09-13T17:17:52.234561+0000","last_unstale":"2024-09-13T17:17:52.236430+0000","last_undegraded":"2024-09-13T17:17:52.236430+0000","last_fullsized":"2024-09-13T17:17:52.236430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:10.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226115+0000","last_change":"2024-09-13T17:17:52.226115+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226115+0000","last_undegraded":"2024-09-13T17:17:52.226115+0000","last_fullsized":"2024-09-13T17:17:52.226115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244881+0000","last_change":"2024-09-13T17:17:52.241484+0000","last_active":"2024-09-13T17:17:52.244881+0000","last_peered":"2024-09-13T17:17:52.244881+0000","last_clean":"2024-09-13T17:17:52.244881+0000","last_became_active":"2024-09-13T17:17:52.241306+0000","last_became_peered":"2024-09-13T17:17:52.241306+0000","last_unstale":"2024-09-13T17:17:52.244881+0000","last_undegraded":"2024-09-13T17:17:52.244881+0000","last_fullsized":"2024-09-13T17:17:52.244881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:09.998148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221461+0000","last_change":"2024-09-13T17:17:52.221461+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221461+0000","last_undegraded":"2024-09-13T17:17:52.221461+0000","last_fullsized":"2024-09-13T17:17:52.221461+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236626+0000","last_change":"2024-09-13T17:17:52.231485+0000","last_active":"2024-09-13T17:17:52.236626+0000","last_peered":"2024-09-13T17:17:52.236626+0000","last_clean":"2024-09-13T17:17:52.236626+0000","last_became_active":"2024-09-13T17:17:52.231207+0000","last_became_peered":"2024-09-13T17:17:52.231207+0000","last_unstale":"2024-09-13T17:17:52.236626+0000","last_undegraded":"2024-09-13T17:17:52.236626+0000","last_fullsized":"2024-09-13T17:17:52.236626+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226678+0000","last_change":"2024-09-13T17:17:52.226678+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226678+0000","last_undegraded":"2024-09-13T17:17:52.226678+0000","last_fullsized":"2024-09-13T17:17:52.226678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.234405+0000","last_change":"2024-09-13T17:17:52.232671+0000","last_active":"2024-09-13T17:17:52.234405+0000","last_peered":"2024-09-13T17:17:52.234405+0000","last_clean":"2024-09-13T17:17:52.234405+0000","last_became_active":"2024-09-13T17:17:52.232353+0000","last_became_peered":"2024-09-13T17:17:52.232353+0000","last_unstale":"2024-09-13T17:17:52.234405+0000","last_undegraded":"2024-09-13T17:17:52.234405+0000","last_fullsized":"2024-09-13T17:17:52.234405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242455+0000","last_change":"2024-09-13T17:17:52.236765+0000","last_active":"2024-09-13T17:17:52.242455+0000","last_peered":"2024-09-13T17:17:52.242455+0000","last_clean":"2024-09-13T17:17:52.242455+0000","last_became_active":"2024-09-13T17:17:52.236448+0000","last_became_peered":"2024-09-13T17:17:52.236448+0000","last_unstale":"2024-09-13T17:17:52.242455+0000","last_undegraded":"2024-09-13T17:17:52.242455+0000","last_fullsized":"2024-09-13T17:17:52.242455+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:21.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223735+0000","last_change":"2024-09-13T17:17:52.223735+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223735+0000","last_undegraded":"2024-09-13T17:17:52.223735+0000","last_fullsized":"2024-09-13T17:17:52.223735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241939+0000","last_change":"2024-09-13T17:17:52.241241+0000","last_active":"2024-09-13T17:17:52.241939+0000","last_peered":"2024-09-13T17:17:52.241939+0000","last_clean":"2024-09-13T17:17:52.241939+0000","last_became_active":"2024-09-13T17:17:52.240969+0000","last_became_peered":"2024-09-13T17:17:52.240969+0000","last_unstale":"2024-09-13T17:17:52.241939+0000","last_undegraded":"2024-09-13T17:17:52.241939+0000","last_fullsized":"2024-09-13T17:17:52.241939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:20.654650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222754+0000","last_change":"2024-09-13T17:17:52.222754+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222754+0000","last_undegraded":"2024-09-13T17:17:52.222754+0000","last_fullsized":"2024-09-13T17:17:52.222754+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244916+0000","last_change":"2024-09-13T17:17:52.241975+0000","last_active":"2024-09-13T17:17:52.244916+0000","last_peered":"2024-09-13T17:17:52.244916+0000","last_clean":"2024-09-13T17:17:52.244916+0000","last_became_active":"2024-09-13T17:17:52.241737+0000","last_became_peered":"2024-09-13T17:17:52.241737+0000","last_unstale":"2024-09-13T17:17:52.244916+0000","last_undegraded":"2024-09-13T17:17:52.244916+0000","last_fullsized":"2024-09-13T17:17:52.244916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:48.511892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221084+0000","last_change":"2024-09-13T17:17:52.221084+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221084+0000","last_undegraded":"2024-09-13T17:17:52.221084+0000","last_fullsized":"2024-09-13T17:17:52.221084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236386+0000","last_change":"2024-09-13T17:17:52.235364+0000","last_active":"2024-09-13T17:17:52.236386+0000","last_peered":"2024-09-13T17:17:52.236386+0000","last_clean":"2024-09-13T17:17:52.236386+0000","last_became_active":"2024-09-13T17:17:52.233817+0000","last_became_peered":"2024-09-13T17:17:52.233817+0000","last_unstale":"2024-09-13T17:17:52.236386+0000","last_undegraded":"2024-09-13T17:17:52.236386+0000","last_fullsized":"2024-09-13T17:17:52.236386+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:03.690380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.229524+0000","last_change":"2024-09-13T17:17:52.229524+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.229524+0000","last_undegraded":"2024-09-13T17:17:52.229524+0000","last_fullsized":"2024-09-13T17:17:52.229524+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240548+0000","last_change":"2024-09-13T17:17:52.239219+0000","last_active":"2024-09-13T17:17:52.240548+0000","last_peered":"2024-09-13T17:17:52.240548+0000","last_clean":"2024-09-13T17:17:52.240548+0000","last_became_active":"2024-09-13T17:17:52.238911+0000","last_became_peered":"2024-09-13T17:17:52.238911+0000","last_unstale":"2024-09-13T17:17:52.240548+0000","last_undegraded":"2024-09-13T17:17:52.240548+0000","last_fullsized":"2024-09-13T17:17:52.240548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228565+0000","last_change":"2024-09-13T17:17:52.228565+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228565+0000","last_undegraded":"2024-09-13T17:17:52.228565+0000","last_fullsized":"2024-09-13T17:17:52.228565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235502+0000","last_change":"2024-09-13T17:17:52.234905+0000","last_active":"2024-09-13T17:17:52.235502+0000","last_peered":"2024-09-13T17:17:52.235502+0000","last_clean":"2024-09-13T17:17:52.235502+0000","last_became_active":"2024-09-13T17:17:52.234585+0000","last_became_peered":"2024-09-13T17:17:52.234585+0000","last_unstale":"2024-09-13T17:17:52.235502+0000","last_undegraded":"2024-09-13T17:17:52.235502+0000","last_fullsized":"2024-09-13T17:17:52.235502+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226776+0000","last_change":"2024-09-13T17:17:52.226776+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226776+0000","last_undegraded":"2024-09-13T17:17:52.226776+0000","last_fullsized":"2024-09-13T17:17:52.226776+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241920+0000","last_change":"2024-09-13T17:17:52.235049+0000","last_active":"2024-09-13T17:17:52.241920+0000","last_peered":"2024-09-13T17:17:52.241920+0000","last_clean":"2024-09-13T17:17:52.241920+0000","last_became_active":"2024-09-13T17:17:52.234785+0000","last_became_peered":"2024-09-13T17:17:52.234785+0000","last_unstale":"2024-09-13T17:17:52.241920+0000","last_undegraded":"2024-09-13T17:17:52.241920+0000","last_fullsized":"2024-09-13T17:17:52.241920+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224276+0000","last_change":"2024-09-13T17:17:52.224276+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224276+0000","last_undegraded":"2024-09-13T17:17:52.224276+0000","last_fullsized":"2024-09-13T17:17:52.224276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237336+0000","last_change":"2024-09-13T17:17:52.233704+0000","last_active":"2024-09-13T17:17:52.237336+0000","last_peered":"2024-09-13T17:17:52.237336+0000","last_clean":"2024-09-13T17:17:52.237336+0000","last_became_active":"2024-09-13T17:17:52.233427+0000","last_became_peered":"2024-09-13T17:17:52.233427+0000","last_unstale":"2024-09-13T17:17:52.237336+0000","last_undegraded":"2024-09-13T17:17:52.237336+0000","last_fullsized":"2024-09-13T17:17:52.237336+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:24.347887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223871+0000","last_change":"2024-09-13T17:17:52.223871+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223871+0000","last_undegraded":"2024-09-13T17:17:52.223871+0000","last_fullsized":"2024-09-13T17:17:52.223871+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237573+0000","last_change":"2024-09-13T17:17:52.233308+0000","last_active":"2024-09-13T17:17:52.237573+0000","last_peered":"2024-09-13T17:17:52.237573+0000","last_clean":"2024-09-13T17:17:52.237573+0000","last_became_active":"2024-09-13T17:17:52.233057+0000","last_became_peered":"2024-09-13T17:17:52.233057+0000","last_unstale":"2024-09-13T17:17:52.237573+0000","last_undegraded":"2024-09-13T17:17:52.237573+0000","last_fullsized":"2024-09-13T17:17:52.237573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:52.681260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224342+0000","last_change":"2024-09-13T17:17:52.224342+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224342+0000","last_undegraded":"2024-09-13T17:17:52.224342+0000","last_fullsized":"2024-09-13T17:17:52.224342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232030+0000","last_change":"2024-09-13T17:17:52.226255+0000","last_active":"2024-09-13T17:17:52.232030+0000","last_peered":"2024-09-13T17:17:52.232030+0000","last_clean":"2024-09-13T17:17:52.232030+0000","last_became_active":"2024-09-13T17:17:52.225926+0000","last_became_peered":"2024-09-13T17:17:52.225926+0000","last_unstale":"2024-09-13T17:17:52.232030+0000","last_undegraded":"2024-09-13T17:17:52.232030+0000","last_fullsized":"2024-09-13T17:17:52.232030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:09.325792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221223+0000","last_change":"2024-09-13T17:17:52.221223+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221223+0000","last_undegraded":"2024-09-13T17:17:52.221223+0000","last_fullsized":"2024-09-13T17:17:52.221223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.238187+0000","last_change":"2024-09-13T17:17:52.236308+0000","last_active":"2024-09-13T17:17:52.238187+0000","last_peered":"2024-09-13T17:17:52.238187+0000","last_clean":"2024-09-13T17:17:52.238187+0000","last_became_active":"2024-09-13T17:17:52.236019+0000","last_became_peered":"2024-09-13T17:17:52.236019+0000","last_unstale":"2024-09-13T17:17:52.238187+0000","last_undegraded":"2024-09-13T17:17:52.238187+0000","last_fullsized":"2024-09-13T17:17:52.238187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222594+0000","last_change":"2024-09-13T17:17:52.222594+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222594+0000","last_undegraded":"2024-09-13T17:17:52.222594+0000","last_fullsized":"2024-09-13T17:17:52.222594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242384+0000","last_change":"2024-09-13T17:17:52.239876+0000","last_active":"2024-09-13T17:17:52.242384+0000","last_peered":"2024-09-13T17:17:52.242384+0000","last_clean":"2024-09-13T17:17:52.242384+0000","last_became_active":"2024-09-13T17:17:52.239592+0000","last_became_peered":"2024-09-13T17:17:52.239592+0000","last_unstale":"2024-09-13T17:17:52.242384+0000","last_undegraded":"2024-09-13T17:17:52.242384+0000","last_fullsized":"2024-09-13T17:17:52.242384+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222982+0000","last_change":"2024-09-13T17:17:52.222982+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222982+0000","last_undegraded":"2024-09-13T17:17:52.222982+0000","last_fullsized":"2024-09-13T17:17:52.222982+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240581+0000","last_change":"2024-09-13T17:17:52.238644+0000","last_active":"2024-09-13T17:17:52.240581+0000","last_peered":"2024-09-13T17:17:52.240581+0000","last_clean":"2024-09-13T17:17:52.240581+0000","last_became_active":"2024-09-13T17:17:52.238325+0000","last_became_peered":"2024-09-13T17:17:52.238325+0000","last_unstale":"2024-09-13T17:17:52.240581+0000","last_undegraded":"2024-09-13T17:17:52.240581+0000","last_fullsized":"2024-09-13T17:17:52.240581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:02.311277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227148+0000","last_change":"2024-09-13T17:17:52.227148+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227148+0000","last_undegraded":"2024-09-13T17:17:52.227148+0000","last_fullsized":"2024-09-13T17:17:52.227148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237322+0000","last_change":"2024-09-13T17:17:52.233210+0000","last_active":"2024-09-13T17:17:52.237322+0000","last_peered":"2024-09-13T17:17:52.237322+0000","last_clean":"2024-09-13T17:17:52.237322+0000","last_became_active":"2024-09-13T17:17:52.232940+0000","last_became_peered":"2024-09-13T17:17:52.232940+0000","last_unstale":"2024-09-13T17:17:52.237322+0000","last_undegraded":"2024-09-13T17:17:52.237322+0000","last_fullsized":"2024-09-13T17:17:52.237322+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:58.047973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223179+0000","last_change":"2024-09-13T17:17:52.223179+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223179+0000","last_undegraded":"2024-09-13T17:17:52.223179+0000","last_fullsized":"2024-09-13T17:17:52.223179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237599+0000","last_change":"2024-09-13T17:17:52.233412+0000","last_active":"2024-09-13T17:17:52.237599+0000","last_peered":"2024-09-13T17:17:52.237599+0000","last_clean":"2024-09-13T17:17:52.237599+0000","last_became_active":"2024-09-13T17:17:52.233154+0000","last_became_peered":"2024-09-13T17:17:52.233154+0000","last_unstale":"2024-09-13T17:17:52.237599+0000","last_undegraded":"2024-09-13T17:17:52.237599+0000","last_fullsized":"2024-09-13T17:17:52.237599+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:17.024663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223889+0000","last_change":"2024-09-13T17:17:52.223889+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223889+0000","last_undegraded":"2024-09-13T17:17:52.223889+0000","last_fullsized":"2024-09-13T17:17:52.223889+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242436+0000","last_change":"2024-09-13T17:17:52.236227+0000","last_active":"2024-09-13T17:17:52.242436+0000","last_peered":"2024-09-13T17:17:52.242436+0000","last_clean":"2024-09-13T17:17:52.242436+0000","last_became_active":"2024-09-13T17:17:52.235979+0000","last_became_peered":"2024-09-13T17:17:52.235979+0000","last_unstale":"2024-09-13T17:17:52.242436+0000","last_undegraded":"2024-09-13T17:17:52.242436+0000","last_fullsized":"2024-09-13T17:17:52.242436+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:41.421504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221320+0000","last_change":"2024-09-13T17:17:52.221320+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221320+0000","last_undegraded":"2024-09-13T17:17:52.221320+0000","last_fullsized":"2024-09-13T17:17:52.221320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237449+0000","last_change":"2024-09-13T17:17:52.232971+0000","last_active":"2024-09-13T17:17:52.237449+0000","last_peered":"2024-09-13T17:17:52.237449+0000","last_clean":"2024-09-13T17:17:52.237449+0000","last_became_active":"2024-09-13T17:17:52.232691+0000","last_became_peered":"2024-09-13T17:17:52.232691+0000","last_unstale":"2024-09-13T17:17:52.237449+0000","last_undegraded":"2024-09-13T17:17:52.237449+0000","last_fullsized":"2024-09-13T17:17:52.237449+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228094+0000","last_change":"2024-09-13T17:17:52.228094+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228094+0000","last_undegraded":"2024-09-13T17:17:52.228094+0000","last_fullsized":"2024-09-13T17:17:52.228094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235692+0000","last_change":"2024-09-13T17:17:52.232914+0000","last_active":"2024-09-13T17:17:52.235692+0000","last_peered":"2024-09-13T17:17:52.235692+0000","last_clean":"2024-09-13T17:17:52.235692+0000","last_became_active":"2024-09-13T17:17:52.232662+0000","last_became_peered":"2024-09-13T17:17:52.232662+0000","last_unstale":"2024-09-13T17:17:52.235692+0000","last_undegraded":"2024-09-13T17:17:52.235692+0000","last_fullsized":"2024-09-13T17:17:52.235692+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:16.955126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224252+0000","last_change":"2024-09-13T17:17:52.224252+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224252+0000","last_undegraded":"2024-09-13T17:17:52.224252+0000","last_fullsized":"2024-09-13T17:17:52.224252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232153+0000","last_change":"2024-09-13T17:17:52.228592+0000","last_active":"2024-09-13T17:17:52.232153+0000","last_peered":"2024-09-13T17:17:52.232153+0000","last_clean":"2024-09-13T17:17:52.232153+0000","last_became_active":"2024-09-13T17:17:52.228266+0000","last_became_peered":"2024-09-13T17:17:52.228266+0000","last_unstale":"2024-09-13T17:17:52.232153+0000","last_undegraded":"2024-09-13T17:17:52.232153+0000","last_fullsized":"2024-09-13T17:17:52.232153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.416745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224577+0000","last_change":"2024-09-13T17:17:52.224577+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224577+0000","last_undegraded":"2024-09-13T17:17:52.224577+0000","last_fullsized":"2024-09-13T17:17:52.224577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241880+0000","last_change":"2024-09-13T17:17:52.234917+0000","last_active":"2024-09-13T17:17:52.241880+0000","last_peered":"2024-09-13T17:17:52.241880+0000","last_clean":"2024-09-13T17:17:52.241880+0000","last_became_active":"2024-09-13T17:17:52.234638+0000","last_became_peered":"2024-09-13T17:17:52.234638+0000","last_unstale":"2024-09-13T17:17:52.241880+0000","last_undegraded":"2024-09-13T17:17:52.241880+0000","last_fullsized":"2024-09-13T17:17:52.241880+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222365+0000","last_change":"2024-09-13T17:17:52.222365+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222365+0000","last_undegraded":"2024-09-13T17:17:52.222365+0000","last_fullsized":"2024-09-13T17:17:52.222365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239519+0000","last_change":"2024-09-13T17:17:52.236289+0000","last_active":"2024-09-13T17:17:52.239519+0000","last_peered":"2024-09-13T17:17:52.239519+0000","last_clean":"2024-09-13T17:17:52.239519+0000","last_became_active":"2024-09-13T17:17:52.235980+0000","last_became_peered":"2024-09-13T17:17:52.235980+0000","last_unstale":"2024-09-13T17:17:52.239519+0000","last_undegraded":"2024-09-13T17:17:52.239519+0000","last_fullsized":"2024-09-13T17:17:52.239519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:17.661696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225579+0000","last_change":"2024-09-13T17:17:52.225579+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225579+0000","last_undegraded":"2024-09-13T17:17:52.225579+0000","last_fullsized":"2024-09-13T17:17:52.225579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235473+0000","last_change":"2024-09-13T17:17:52.234737+0000","last_active":"2024-09-13T17:17:52.235473+0000","last_peered":"2024-09-13T17:17:52.235473+0000","last_clean":"2024-09-13T17:17:52.235473+0000","last_became_active":"2024-09-13T17:17:52.234268+0000","last_became_peered":"2024-09-13T17:17:52.234268+0000","last_unstale":"2024-09-13T17:17:52.235473+0000","last_undegraded":"2024-09-13T17:17:52.235473+0000","last_fullsized":"2024-09-13T17:17:52.235473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:17:51.217617+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:51.217617+0000","last_peered":"2024-09-13T17:17:51.217617+0000","last_clean":"2024-09-13T17:17:51.217617+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:51.217617+0000","last_undegraded":"2024-09-13T17:17:51.217617+0000","last_fullsized":"2024-09-13T17:17:51.217617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.439}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.504},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.308},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.442}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:55.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.027+0000 7f9d02c90640 1 Processor -- start 2024-09-13T17:17:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.027+0000 7f9d02c90640 1 -- start start 2024-09-13T17:17:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d02c90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc1592d0 0x7f9cfc06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d02c90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d02c90640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0b3150 con 0x7f9cfc0cdcb0 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d02c90640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc15cf00 con 0x7f9cfc1592d0 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d02c90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0b3430 con 0x7f9cfc0cb7b0 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d00a2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc1592d0 0x7f9cfc06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d00a2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc1592d0 0x7f9cfc06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48214/0 (socket says 172.21.15.5:48214) 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.028+0000 7f9d00a2c640 1 -- 172.21.15.5:0/3199354079 learned_addr learned my addr 172.21.15.5:0/3199354079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9cfbfff640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9d00a2c640 1 -- 172.21.15.5:0/3199354079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 msgr2=0x7f9cfc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9d00a2c640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9d00a2c640 1 -- 172.21.15.5:0/3199354079 >> v1:172.21.15.179:6789/0 conn(0x7f9cfc0cdcb0 legacy=0x7f9cfc15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9d00a2c640 1 -- 172.21.15.5:0/3199354079 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0b3710 con 0x7f9cfc1592d0 2024-09-13T17:17:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.029+0000 7f9d00a2c640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc06c440 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d150 tx=0x7f9cec02c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69b795e58103fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9cfb7fe640 1 -- 172.21.15.5:0/3199354079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec030050 con 0x7f9cfc1592d0 2024-09-13T17:17:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9cfb7fe640 1 -- 172.21.15.5:0/3199354079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec009600 con 0x7f9cfc1592d0 2024-09-13T17:17:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9cfb7fe640 1 -- 172.21.15.5:0/3199354079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec009990 con 0x7f9cfc1592d0 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 -- 172.21.15.5:0/3199354079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 msgr2=0x7f9cfc06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc06c440 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d150 tx=0x7f9cec02c840 comp rx=0 tx=0).stop 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 -- 172.21.15.5:0/3199354079 shutdown_connections 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3199354079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc06c440 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 -- 172.21.15.5:0/3199354079 >> 172.21.15.5:0/3199354079 conn(0x7f9cfc066200 msgr2=0x7f9cfc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 -- 172.21.15.5:0/3199354079 shutdown_connections 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.030+0000 7f9d02c90640 1 -- 172.21.15.5:0/3199354079 wait complete. 2024-09-13T17:17:56.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.031+0000 7f9d02c90640 1 Processor -- start 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.031+0000 7f9d02c90640 1 -- start start 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cfc0cdcb0 0x7f9cfc156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc157aa0 con 0x7f9cfc1592d0 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1432f0 con 0x7f9cfc0cdcb0 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d02c90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc142da0 con 0x7f9cfc0cb7b0 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.032+0000 7f9d0122d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48226/0 (socket says 172.21.15.5:48226) 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 -- 172.21.15.5:0/3412574079 learned_addr learned my addr 172.21.15.5:0/3412574079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d00a2c640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9cfbfff640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cfc0cdcb0 0x7f9cfc156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 -- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 msgr2=0x7f9cfc142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 -- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cfc0cdcb0 msgr2=0x7f9cfc156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cfc0cdcb0 0x7f9cfc156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 -- 172.21.15.5:0/3412574079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec00bd40 con 0x7f9cfc1592d0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d0122d640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c3e0 tx=0x7f9cf400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011790 con 0x7f9cfc1592d0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40118f0 con 0x7f9cfc1592d0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011ce0 con 0x7f9cfc1592d0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc156e20 con 0x7f9cfc1592d0 2024-09-13T17:17:56.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.033+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc1573e0 con 0x7f9cfc1592d0 2024-09-13T17:17:56.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.034+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc0672f0 con 0x7f9cfc1592d0 2024-09-13T17:17:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.035+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9cf401c460 con 0x7f9cfc1592d0 2024-09-13T17:17:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.035+0000 7f9cf97fa640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 0x7f9cdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.035+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9cf4089130 con 0x7f9cfc1592d0 2024-09-13T17:17:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.035+0000 7f9d00a2c640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 0x7f9cdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.036+0000 7f9d00a2c640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 0x7f9cdc06d0c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9cec036000 tx=0x7f9cec00b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.039+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9cf4054310 con 0x7f9cfc1592d0 2024-09-13T17:17:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.208+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cfc1596b0 con 0x7f9cdc06ac00 2024-09-13T17:17:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.216+0000 7f9cf97fa640 1 -- 172.21.15.5:0/3412574079 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286309 (secure 0 0 0) 0x7f9cec043070 con 0x7f9cdc06ac00 2024-09-13T17:17:56.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 msgr2=0x7f9cdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 0x7f9cdc06d0c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9cec036000 tx=0x7f9cec00b000 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 msgr2=0x7f9cfc156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c3e0 tx=0x7f9cf400c8a0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 shutdown_connections 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9cdc06ac00 0x7f9cdc06d0c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc1592d0 0x7f9cfc156750 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9cfc0cdcb0 0x7f9cfc156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 --2- 172.21.15.5:0/3412574079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9cfc0cb7b0 0x7f9cfc142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 >> 172.21.15.5:0/3412574079 conn(0x7f9cfc066200 msgr2=0x7f9cfc0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 shutdown_connections 2024-09-13T17:17:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.219+0000 7f9d02c90640 1 -- 172.21.15.5:0/3412574079 wait complete. 2024-09-13T17:17:56.232 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-13T17:17:55.324213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246688,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728032,"statfs":{"total":773094113280,"available":772841504768,"internally_reserved":0,"allocated":10264576,"data_stored":5293248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109304"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223559+0000","last_change":"2024-09-13T17:17:52.223559+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223559+0000","last_undegraded":"2024-09-13T17:17:52.223559+0000","last_fullsized":"2024-09-13T17:17:52.223559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220817+0000","last_change":"2024-09-13T17:17:52.220817+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220817+0000","last_undegraded":"2024-09-13T17:17:52.220817+0000","last_fullsized":"2024-09-13T17:17:52.220817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223294+0000","last_change":"2024-09-13T17:17:52.223294+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223294+0000","last_undegraded":"2024-09-13T17:17:52.223294+0000","last_fullsized":"2024-09-13T17:17:52.223294+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224819+0000","last_change":"2024-09-13T17:17:52.224819+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224819+0000","last_undegraded":"2024-09-13T17:17:52.224819+0000","last_fullsized":"2024-09-13T17:17:52.224819+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226117+0000","last_change":"2024-09-13T17:17:52.226117+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226117+0000","last_undegraded":"2024-09-13T17:17:52.226117+0000","last_fullsized":"2024-09-13T17:17:52.226117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238846+0000","last_change":"2024-09-13T17:17:52.238846+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238846+0000","last_undegraded":"2024-09-13T17:17:52.238846+0000","last_fullsized":"2024-09-13T17:17:52.238846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224374+0000","last_change":"2024-09-13T17:17:52.224374+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224374+0000","last_undegraded":"2024-09-13T17:17:52.224374+0000","last_fullsized":"2024-09-13T17:17:52.224374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223755+0000","last_change":"2024-09-13T17:17:52.223755+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223755+0000","last_undegraded":"2024-09-13T17:17:52.223755+0000","last_fullsized":"2024-09-13T17:17:52.223755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223901+0000","last_change":"2024-09-13T17:17:52.223901+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223901+0000","last_undegraded":"2024-09-13T17:17:52.223901+0000","last_fullsized":"2024-09-13T17:17:52.223901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226238+0000","last_change":"2024-09-13T17:17:52.226238+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226238+0000","last_undegraded":"2024-09-13T17:17:52.226238+0000","last_fullsized":"2024-09-13T17:17:52.226238+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227220+0000","last_change":"2024-09-13T17:17:52.227220+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227220+0000","last_undegraded":"2024-09-13T17:17:52.227220+0000","last_fullsized":"2024-09-13T17:17:52.227220+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226530+0000","last_change":"2024-09-13T17:17:52.226530+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226530+0000","last_undegraded":"2024-09-13T17:17:52.226530+0000","last_fullsized":"2024-09-13T17:17:52.226530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223510+0000","last_change":"2024-09-13T17:17:52.223510+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223510+0000","last_undegraded":"2024-09-13T17:17:52.223510+0000","last_fullsized":"2024-09-13T17:17:52.223510+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225699+0000","last_change":"2024-09-13T17:17:52.225699+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225699+0000","last_undegraded":"2024-09-13T17:17:52.225699+0000","last_fullsized":"2024-09-13T17:17:52.225699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238879+0000","last_change":"2024-09-13T17:17:52.238879+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238879+0000","last_undegraded":"2024-09-13T17:17:52.238879+0000","last_fullsized":"2024-09-13T17:17:52.238879+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237608+0000","last_change":"2024-09-13T17:17:52.237608+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237608+0000","last_undegraded":"2024-09-13T17:17:52.237608+0000","last_fullsized":"2024-09-13T17:17:52.237608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224407+0000","last_change":"2024-09-13T17:17:52.224407+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224407+0000","last_undegraded":"2024-09-13T17:17:52.224407+0000","last_fullsized":"2024-09-13T17:17:52.224407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223435+0000","last_change":"2024-09-13T17:17:52.223435+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223435+0000","last_undegraded":"2024-09-13T17:17:52.223435+0000","last_fullsized":"2024-09-13T17:17:52.223435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224408+0000","last_change":"2024-09-13T17:17:52.224408+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224408+0000","last_undegraded":"2024-09-13T17:17:52.224408+0000","last_fullsized":"2024-09-13T17:17:52.224408+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222020+0000","last_change":"2024-09-13T17:17:52.222020+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222020+0000","last_undegraded":"2024-09-13T17:17:52.222020+0000","last_fullsized":"2024-09-13T17:17:52.222020+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222812+0000","last_change":"2024-09-13T17:17:52.222812+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222812+0000","last_undegraded":"2024-09-13T17:17:52.222812+0000","last_fullsized":"2024-09-13T17:17:52.222812+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225984+0000","last_change":"2024-09-13T17:17:52.225984+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225984+0000","last_undegraded":"2024-09-13T17:17:52.225984+0000","last_fullsized":"2024-09-13T17:17:52.225984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222635+0000","last_change":"2024-09-13T17:17:52.222635+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222635+0000","last_undegraded":"2024-09-13T17:17:52.222635+0000","last_fullsized":"2024-09-13T17:17:52.222635+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221752+0000","last_change":"2024-09-13T17:17:52.221752+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221752+0000","last_undegraded":"2024-09-13T17:17:52.221752+0000","last_fullsized":"2024-09-13T17:17:52.221752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224307+0000","last_change":"2024-09-13T17:17:52.224307+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224307+0000","last_undegraded":"2024-09-13T17:17:52.224307+0000","last_fullsized":"2024-09-13T17:17:52.224307+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230730+0000","last_change":"2024-09-13T17:17:52.230730+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230730+0000","last_undegraded":"2024-09-13T17:17:52.230730+0000","last_fullsized":"2024-09-13T17:17:52.230730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223983+0000","last_change":"2024-09-13T17:17:52.223983+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223983+0000","last_undegraded":"2024-09-13T17:17:52.223983+0000","last_fullsized":"2024-09-13T17:17:52.223983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225006+0000","last_change":"2024-09-13T17:17:52.225006+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225006+0000","last_undegraded":"2024-09-13T17:17:52.225006+0000","last_fullsized":"2024-09-13T17:17:52.225006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220654+0000","last_change":"2024-09-13T17:17:52.220654+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220654+0000","last_undegraded":"2024-09-13T17:17:52.220654+0000","last_fullsized":"2024-09-13T17:17:52.220654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221641+0000","last_change":"2024-09-13T17:17:52.221641+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221641+0000","last_undegraded":"2024-09-13T17:17:52.221641+0000","last_fullsized":"2024-09-13T17:17:52.221641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237400+0000","last_change":"2024-09-13T17:17:52.237400+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237400+0000","last_undegraded":"2024-09-13T17:17:52.237400+0000","last_fullsized":"2024-09-13T17:17:52.237400+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227897+0000","last_change":"2024-09-13T17:17:52.227897+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227897+0000","last_undegraded":"2024-09-13T17:17:52.227897+0000","last_fullsized":"2024-09-13T17:17:52.227897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.247521+0000","last_change":"2024-09-13T17:17:52.242530+0000","last_active":"2024-09-13T17:17:52.247521+0000","last_peered":"2024-09-13T17:17:52.247521+0000","last_clean":"2024-09-13T17:17:52.247521+0000","last_became_active":"2024-09-13T17:17:52.242237+0000","last_became_peered":"2024-09-13T17:17:52.242237+0000","last_unstale":"2024-09-13T17:17:52.247521+0000","last_undegraded":"2024-09-13T17:17:52.247521+0000","last_fullsized":"2024-09-13T17:17:52.247521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230433+0000","last_change":"2024-09-13T17:17:52.230433+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230433+0000","last_undegraded":"2024-09-13T17:17:52.230433+0000","last_fullsized":"2024-09-13T17:17:52.230433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237619+0000","last_change":"2024-09-13T17:17:52.234111+0000","last_active":"2024-09-13T17:17:52.237619+0000","last_peered":"2024-09-13T17:17:52.237619+0000","last_clean":"2024-09-13T17:17:52.237619+0000","last_became_active":"2024-09-13T17:17:52.233852+0000","last_became_peered":"2024-09-13T17:17:52.233852+0000","last_unstale":"2024-09-13T17:17:52.237619+0000","last_undegraded":"2024-09-13T17:17:52.237619+0000","last_fullsized":"2024-09-13T17:17:52.237619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225412+0000","last_change":"2024-09-13T17:17:52.225412+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225412+0000","last_undegraded":"2024-09-13T17:17:52.225412+0000","last_fullsized":"2024-09-13T17:17:52.225412+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239460+0000","last_change":"2024-09-13T17:17:52.234877+0000","last_active":"2024-09-13T17:17:52.239460+0000","last_peered":"2024-09-13T17:17:52.239460+0000","last_clean":"2024-09-13T17:17:52.239460+0000","last_became_active":"2024-09-13T17:17:52.234605+0000","last_became_peered":"2024-09-13T17:17:52.234605+0000","last_unstale":"2024-09-13T17:17:52.239460+0000","last_undegraded":"2024-09-13T17:17:52.239460+0000","last_fullsized":"2024-09-13T17:17:52.239460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:36.404134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.235170+0000","last_change":"2024-09-13T17:17:52.235170+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.235170+0000","last_undegraded":"2024-09-13T17:17:52.235170+0000","last_fullsized":"2024-09-13T17:17:52.235170+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237478+0000","last_change":"2024-09-13T17:17:52.233058+0000","last_active":"2024-09-13T17:17:52.237478+0000","last_peered":"2024-09-13T17:17:52.237478+0000","last_clean":"2024-09-13T17:17:52.237478+0000","last_became_active":"2024-09-13T17:17:52.232674+0000","last_became_peered":"2024-09-13T17:17:52.232674+0000","last_unstale":"2024-09-13T17:17:52.237478+0000","last_undegraded":"2024-09-13T17:17:52.237478+0000","last_fullsized":"2024-09-13T17:17:52.237478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223317+0000","last_change":"2024-09-13T17:17:52.223317+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223317+0000","last_undegraded":"2024-09-13T17:17:52.223317+0000","last_fullsized":"2024-09-13T17:17:52.223317+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237562+0000","last_change":"2024-09-13T17:17:52.232698+0000","last_active":"2024-09-13T17:17:52.237562+0000","last_peered":"2024-09-13T17:17:52.237562+0000","last_clean":"2024-09-13T17:17:52.237562+0000","last_became_active":"2024-09-13T17:17:52.232413+0000","last_became_peered":"2024-09-13T17:17:52.232413+0000","last_unstale":"2024-09-13T17:17:52.237562+0000","last_undegraded":"2024-09-13T17:17:52.237562+0000","last_fullsized":"2024-09-13T17:17:52.237562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:38.015314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225550+0000","last_change":"2024-09-13T17:17:52.225550+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225550+0000","last_undegraded":"2024-09-13T17:17:52.225550+0000","last_fullsized":"2024-09-13T17:17:52.225550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235498+0000","last_change":"2024-09-13T17:17:52.234541+0000","last_active":"2024-09-13T17:17:52.235498+0000","last_peered":"2024-09-13T17:17:52.235498+0000","last_clean":"2024-09-13T17:17:52.235498+0000","last_became_active":"2024-09-13T17:17:52.234284+0000","last_became_peered":"2024-09-13T17:17:52.234284+0000","last_unstale":"2024-09-13T17:17:52.235498+0000","last_undegraded":"2024-09-13T17:17:52.235498+0000","last_fullsized":"2024-09-13T17:17:52.235498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227437+0000","last_change":"2024-09-13T17:17:52.227437+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227437+0000","last_undegraded":"2024-09-13T17:17:52.227437+0000","last_fullsized":"2024-09-13T17:17:52.227437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236430+0000","last_change":"2024-09-13T17:17:52.234865+0000","last_active":"2024-09-13T17:17:52.236430+0000","last_peered":"2024-09-13T17:17:52.236430+0000","last_clean":"2024-09-13T17:17:52.236430+0000","last_became_active":"2024-09-13T17:17:52.234561+0000","last_became_peered":"2024-09-13T17:17:52.234561+0000","last_unstale":"2024-09-13T17:17:52.236430+0000","last_undegraded":"2024-09-13T17:17:52.236430+0000","last_fullsized":"2024-09-13T17:17:52.236430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:10.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226115+0000","last_change":"2024-09-13T17:17:52.226115+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226115+0000","last_undegraded":"2024-09-13T17:17:52.226115+0000","last_fullsized":"2024-09-13T17:17:52.226115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244881+0000","last_change":"2024-09-13T17:17:52.241484+0000","last_active":"2024-09-13T17:17:52.244881+0000","last_peered":"2024-09-13T17:17:52.244881+0000","last_clean":"2024-09-13T17:17:52.244881+0000","last_became_active":"2024-09-13T17:17:52.241306+0000","last_became_peered":"2024-09-13T17:17:52.241306+0000","last_unstale":"2024-09-13T17:17:52.244881+0000","last_undegraded":"2024-09-13T17:17:52.244881+0000","last_fullsized":"2024-09-13T17:17:52.244881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:09.998148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221461+0000","last_change":"2024-09-13T17:17:52.221461+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221461+0000","last_undegraded":"2024-09-13T17:17:52.221461+0000","last_fullsized":"2024-09-13T17:17:52.221461+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236626+0000","last_change":"2024-09-13T17:17:52.231485+0000","last_active":"2024-09-13T17:17:52.236626+0000","last_peered":"2024-09-13T17:17:52.236626+0000","last_clean":"2024-09-13T17:17:52.236626+0000","last_became_active":"2024-09-13T17:17:52.231207+0000","last_became_peered":"2024-09-13T17:17:52.231207+0000","last_unstale":"2024-09-13T17:17:52.236626+0000","last_undegraded":"2024-09-13T17:17:52.236626+0000","last_fullsized":"2024-09-13T17:17:52.236626+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226678+0000","last_change":"2024-09-13T17:17:52.226678+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226678+0000","last_undegraded":"2024-09-13T17:17:52.226678+0000","last_fullsized":"2024-09-13T17:17:52.226678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.234405+0000","last_change":"2024-09-13T17:17:52.232671+0000","last_active":"2024-09-13T17:17:52.234405+0000","last_peered":"2024-09-13T17:17:52.234405+0000","last_clean":"2024-09-13T17:17:52.234405+0000","last_became_active":"2024-09-13T17:17:52.232353+0000","last_became_peered":"2024-09-13T17:17:52.232353+0000","last_unstale":"2024-09-13T17:17:52.234405+0000","last_undegraded":"2024-09-13T17:17:52.234405+0000","last_fullsized":"2024-09-13T17:17:52.234405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242455+0000","last_change":"2024-09-13T17:17:52.236765+0000","last_active":"2024-09-13T17:17:52.242455+0000","last_peered":"2024-09-13T17:17:52.242455+0000","last_clean":"2024-09-13T17:17:52.242455+0000","last_became_active":"2024-09-13T17:17:52.236448+0000","last_became_peered":"2024-09-13T17:17:52.236448+0000","last_unstale":"2024-09-13T17:17:52.242455+0000","last_undegraded":"2024-09-13T17:17:52.242455+0000","last_fullsized":"2024-09-13T17:17:52.242455+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:21.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223735+0000","last_change":"2024-09-13T17:17:52.223735+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223735+0000","last_undegraded":"2024-09-13T17:17:52.223735+0000","last_fullsized":"2024-09-13T17:17:52.223735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241939+0000","last_change":"2024-09-13T17:17:52.241241+0000","last_active":"2024-09-13T17:17:52.241939+0000","last_peered":"2024-09-13T17:17:52.241939+0000","last_clean":"2024-09-13T17:17:52.241939+0000","last_became_active":"2024-09-13T17:17:52.240969+0000","last_became_peered":"2024-09-13T17:17:52.240969+0000","last_unstale":"2024-09-13T17:17:52.241939+0000","last_undegraded":"2024-09-13T17:17:52.241939+0000","last_fullsized":"2024-09-13T17:17:52.241939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:20.654650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222754+0000","last_change":"2024-09-13T17:17:52.222754+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222754+0000","last_undegraded":"2024-09-13T17:17:52.222754+0000","last_fullsized":"2024-09-13T17:17:52.222754+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244916+0000","last_change":"2024-09-13T17:17:52.241975+0000","last_active":"2024-09-13T17:17:52.244916+0000","last_peered":"2024-09-13T17:17:52.244916+0000","last_clean":"2024-09-13T17:17:52.244916+0000","last_became_active":"2024-09-13T17:17:52.241737+0000","last_became_peered":"2024-09-13T17:17:52.241737+0000","last_unstale":"2024-09-13T17:17:52.244916+0000","last_undegraded":"2024-09-13T17:17:52.244916+0000","last_fullsized":"2024-09-13T17:17:52.244916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:48.511892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221084+0000","last_change":"2024-09-13T17:17:52.221084+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221084+0000","last_undegraded":"2024-09-13T17:17:52.221084+0000","last_fullsized":"2024-09-13T17:17:52.221084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236386+0000","last_change":"2024-09-13T17:17:52.235364+0000","last_active":"2024-09-13T17:17:52.236386+0000","last_peered":"2024-09-13T17:17:52.236386+0000","last_clean":"2024-09-13T17:17:52.236386+0000","last_became_active":"2024-09-13T17:17:52.233817+0000","last_became_peered":"2024-09-13T17:17:52.233817+0000","last_unstale":"2024-09-13T17:17:52.236386+0000","last_undegraded":"2024-09-13T17:17:52.236386+0000","last_fullsized":"2024-09-13T17:17:52.236386+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:03.690380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.229524+0000","last_change":"2024-09-13T17:17:52.229524+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.229524+0000","last_undegraded":"2024-09-13T17:17:52.229524+0000","last_fullsized":"2024-09-13T17:17:52.229524+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240548+0000","last_change":"2024-09-13T17:17:52.239219+0000","last_active":"2024-09-13T17:17:52.240548+0000","last_peered":"2024-09-13T17:17:52.240548+0000","last_clean":"2024-09-13T17:17:52.240548+0000","last_became_active":"2024-09-13T17:17:52.238911+0000","last_became_peered":"2024-09-13T17:17:52.238911+0000","last_unstale":"2024-09-13T17:17:52.240548+0000","last_undegraded":"2024-09-13T17:17:52.240548+0000","last_fullsized":"2024-09-13T17:17:52.240548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228565+0000","last_change":"2024-09-13T17:17:52.228565+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228565+0000","last_undegraded":"2024-09-13T17:17:52.228565+0000","last_fullsized":"2024-09-13T17:17:52.228565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235502+0000","last_change":"2024-09-13T17:17:52.234905+0000","last_active":"2024-09-13T17:17:52.235502+0000","last_peered":"2024-09-13T17:17:52.235502+0000","last_clean":"2024-09-13T17:17:52.235502+0000","last_became_active":"2024-09-13T17:17:52.234585+0000","last_became_peered":"2024-09-13T17:17:52.234585+0000","last_unstale":"2024-09-13T17:17:52.235502+0000","last_undegraded":"2024-09-13T17:17:52.235502+0000","last_fullsized":"2024-09-13T17:17:52.235502+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226776+0000","last_change":"2024-09-13T17:17:52.226776+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226776+0000","last_undegraded":"2024-09-13T17:17:52.226776+0000","last_fullsized":"2024-09-13T17:17:52.226776+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241920+0000","last_change":"2024-09-13T17:17:52.235049+0000","last_active":"2024-09-13T17:17:52.241920+0000","last_peered":"2024-09-13T17:17:52.241920+0000","last_clean":"2024-09-13T17:17:52.241920+0000","last_became_active":"2024-09-13T17:17:52.234785+0000","last_became_peered":"2024-09-13T17:17:52.234785+0000","last_unstale":"2024-09-13T17:17:52.241920+0000","last_undegraded":"2024-09-13T17:17:52.241920+0000","last_fullsized":"2024-09-13T17:17:52.241920+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224276+0000","last_change":"2024-09-13T17:17:52.224276+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224276+0000","last_undegraded":"2024-09-13T17:17:52.224276+0000","last_fullsized":"2024-09-13T17:17:52.224276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237336+0000","last_change":"2024-09-13T17:17:52.233704+0000","last_active":"2024-09-13T17:17:52.237336+0000","last_peered":"2024-09-13T17:17:52.237336+0000","last_clean":"2024-09-13T17:17:52.237336+0000","last_became_active":"2024-09-13T17:17:52.233427+0000","last_became_peered":"2024-09-13T17:17:52.233427+0000","last_unstale":"2024-09-13T17:17:52.237336+0000","last_undegraded":"2024-09-13T17:17:52.237336+0000","last_fullsized":"2024-09-13T17:17:52.237336+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:24.347887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223871+0000","last_change":"2024-09-13T17:17:52.223871+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223871+0000","last_undegraded":"2024-09-13T17:17:52.223871+0000","last_fullsized":"2024-09-13T17:17:52.223871+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237573+0000","last_change":"2024-09-13T17:17:52.233308+0000","last_active":"2024-09-13T17:17:52.237573+0000","last_peered":"2024-09-13T17:17:52.237573+0000","last_clean":"2024-09-13T17:17:52.237573+0000","last_became_active":"2024-09-13T17:17:52.233057+0000","last_became_peered":"2024-09-13T17:17:52.233057+0000","last_unstale":"2024-09-13T17:17:52.237573+0000","last_undegraded":"2024-09-13T17:17:52.237573+0000","last_fullsized":"2024-09-13T17:17:52.237573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:52.681260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224342+0000","last_change":"2024-09-13T17:17:52.224342+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224342+0000","last_undegraded":"2024-09-13T17:17:52.224342+0000","last_fullsized":"2024-09-13T17:17:52.224342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232030+0000","last_change":"2024-09-13T17:17:52.226255+0000","last_active":"2024-09-13T17:17:52.232030+0000","last_peered":"2024-09-13T17:17:52.232030+0000","last_clean":"2024-09-13T17:17:52.232030+0000","last_became_active":"2024-09-13T17:17:52.225926+0000","last_became_peered":"2024-09-13T17:17:52.225926+0000","last_unstale":"2024-09-13T17:17:52.232030+0000","last_undegraded":"2024-09-13T17:17:52.232030+0000","last_fullsized":"2024-09-13T17:17:52.232030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:09.325792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221223+0000","last_change":"2024-09-13T17:17:52.221223+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221223+0000","last_undegraded":"2024-09-13T17:17:52.221223+0000","last_fullsized":"2024-09-13T17:17:52.221223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.238187+0000","last_change":"2024-09-13T17:17:52.236308+0000","last_active":"2024-09-13T17:17:52.238187+0000","last_peered":"2024-09-13T17:17:52.238187+0000","last_clean":"2024-09-13T17:17:52.238187+0000","last_became_active":"2024-09-13T17:17:52.236019+0000","last_became_peered":"2024-09-13T17:17:52.236019+0000","last_unstale":"2024-09-13T17:17:52.238187+0000","last_undegraded":"2024-09-13T17:17:52.238187+0000","last_fullsized":"2024-09-13T17:17:52.238187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222594+0000","last_change":"2024-09-13T17:17:52.222594+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222594+0000","last_undegraded":"2024-09-13T17:17:52.222594+0000","last_fullsized":"2024-09-13T17:17:52.222594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242384+0000","last_change":"2024-09-13T17:17:52.239876+0000","last_active":"2024-09-13T17:17:52.242384+0000","last_peered":"2024-09-13T17:17:52.242384+0000","last_clean":"2024-09-13T17:17:52.242384+0000","last_became_active":"2024-09-13T17:17:52.239592+0000","last_became_peered":"2024-09-13T17:17:52.239592+0000","last_unstale":"2024-09-13T17:17:52.242384+0000","last_undegraded":"2024-09-13T17:17:52.242384+0000","last_fullsized":"2024-09-13T17:17:52.242384+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222982+0000","last_change":"2024-09-13T17:17:52.222982+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222982+0000","last_undegraded":"2024-09-13T17:17:52.222982+0000","last_fullsized":"2024-09-13T17:17:52.222982+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240581+0000","last_change":"2024-09-13T17:17:52.238644+0000","last_active":"2024-09-13T17:17:52.240581+0000","last_peered":"2024-09-13T17:17:52.240581+0000","last_clean":"2024-09-13T17:17:52.240581+0000","last_became_active":"2024-09-13T17:17:52.238325+0000","last_became_peered":"2024-09-13T17:17:52.238325+0000","last_unstale":"2024-09-13T17:17:52.240581+0000","last_undegraded":"2024-09-13T17:17:52.240581+0000","last_fullsized":"2024-09-13T17:17:52.240581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:02.311277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227148+0000","last_change":"2024-09-13T17:17:52.227148+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227148+0000","last_undegraded":"2024-09-13T17:17:52.227148+0000","last_fullsized":"2024-09-13T17:17:52.227148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237322+0000","last_change":"2024-09-13T17:17:52.233210+0000","last_active":"2024-09-13T17:17:52.237322+0000","last_peered":"2024-09-13T17:17:52.237322+0000","last_clean":"2024-09-13T17:17:52.237322+0000","last_became_active":"2024-09-13T17:17:52.232940+0000","last_became_peered":"2024-09-13T17:17:52.232940+0000","last_unstale":"2024-09-13T17:17:52.237322+0000","last_undegraded":"2024-09-13T17:17:52.237322+0000","last_fullsized":"2024-09-13T17:17:52.237322+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:58.047973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223179+0000","last_change":"2024-09-13T17:17:52.223179+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223179+0000","last_undegraded":"2024-09-13T17:17:52.223179+0000","last_fullsized":"2024-09-13T17:17:52.223179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237599+0000","last_change":"2024-09-13T17:17:52.233412+0000","last_active":"2024-09-13T17:17:52.237599+0000","last_peered":"2024-09-13T17:17:52.237599+0000","last_clean":"2024-09-13T17:17:52.237599+0000","last_became_active":"2024-09-13T17:17:52.233154+0000","last_became_peered":"2024-09-13T17:17:52.233154+0000","last_unstale":"2024-09-13T17:17:52.237599+0000","last_undegraded":"2024-09-13T17:17:52.237599+0000","last_fullsized":"2024-09-13T17:17:52.237599+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:17.024663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223889+0000","last_change":"2024-09-13T17:17:52.223889+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223889+0000","last_undegraded":"2024-09-13T17:17:52.223889+0000","last_fullsized":"2024-09-13T17:17:52.223889+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242436+0000","last_change":"2024-09-13T17:17:52.236227+0000","last_active":"2024-09-13T17:17:52.242436+0000","last_peered":"2024-09-13T17:17:52.242436+0000","last_clean":"2024-09-13T17:17:52.242436+0000","last_became_active":"2024-09-13T17:17:52.235979+0000","last_became_peered":"2024-09-13T17:17:52.235979+0000","last_unstale":"2024-09-13T17:17:52.242436+0000","last_undegraded":"2024-09-13T17:17:52.242436+0000","last_fullsized":"2024-09-13T17:17:52.242436+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:41.421504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221320+0000","last_change":"2024-09-13T17:17:52.221320+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221320+0000","last_undegraded":"2024-09-13T17:17:52.221320+0000","last_fullsized":"2024-09-13T17:17:52.221320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237449+0000","last_change":"2024-09-13T17:17:52.232971+0000","last_active":"2024-09-13T17:17:52.237449+0000","last_peered":"2024-09-13T17:17:52.237449+0000","last_clean":"2024-09-13T17:17:52.237449+0000","last_became_active":"2024-09-13T17:17:52.232691+0000","last_became_peered":"2024-09-13T17:17:52.232691+0000","last_unstale":"2024-09-13T17:17:52.237449+0000","last_undegraded":"2024-09-13T17:17:52.237449+0000","last_fullsized":"2024-09-13T17:17:52.237449+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228094+0000","last_change":"2024-09-13T17:17:52.228094+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228094+0000","last_undegraded":"2024-09-13T17:17:52.228094+0000","last_fullsized":"2024-09-13T17:17:52.228094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235692+0000","last_change":"2024-09-13T17:17:52.232914+0000","last_active":"2024-09-13T17:17:52.235692+0000","last_peered":"2024-09-13T17:17:52.235692+0000","last_clean":"2024-09-13T17:17:52.235692+0000","last_became_active":"2024-09-13T17:17:52.232662+0000","last_became_peered":"2024-09-13T17:17:52.232662+0000","last_unstale":"2024-09-13T17:17:52.235692+0000","last_undegraded":"2024-09-13T17:17:52.235692+0000","last_fullsized":"2024-09-13T17:17:52.235692+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:16.955126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224252+0000","last_change":"2024-09-13T17:17:52.224252+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224252+0000","last_undegraded":"2024-09-13T17:17:52.224252+0000","last_fullsized":"2024-09-13T17:17:52.224252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232153+0000","last_change":"2024-09-13T17:17:52.228592+0000","last_active":"2024-09-13T17:17:52.232153+0000","last_peered":"2024-09-13T17:17:52.232153+0000","last_clean":"2024-09-13T17:17:52.232153+0000","last_became_active":"2024-09-13T17:17:52.228266+0000","last_became_peered":"2024-09-13T17:17:52.228266+0000","last_unstale":"2024-09-13T17:17:52.232153+0000","last_undegraded":"2024-09-13T17:17:52.232153+0000","last_fullsized":"2024-09-13T17:17:52.232153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.416745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224577+0000","last_change":"2024-09-13T17:17:52.224577+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224577+0000","last_undegraded":"2024-09-13T17:17:52.224577+0000","last_fullsized":"2024-09-13T17:17:52.224577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241880+0000","last_change":"2024-09-13T17:17:52.234917+0000","last_active":"2024-09-13T17:17:52.241880+0000","last_peered":"2024-09-13T17:17:52.241880+0000","last_clean":"2024-09-13T17:17:52.241880+0000","last_became_active":"2024-09-13T17:17:52.234638+0000","last_became_peered":"2024-09-13T17:17:52.234638+0000","last_unstale":"2024-09-13T17:17:52.241880+0000","last_undegraded":"2024-09-13T17:17:52.241880+0000","last_fullsized":"2024-09-13T17:17:52.241880+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222365+0000","last_change":"2024-09-13T17:17:52.222365+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222365+0000","last_undegraded":"2024-09-13T17:17:52.222365+0000","last_fullsized":"2024-09-13T17:17:52.222365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239519+0000","last_change":"2024-09-13T17:17:52.236289+0000","last_active":"2024-09-13T17:17:52.239519+0000","last_peered":"2024-09-13T17:17:52.239519+0000","last_clean":"2024-09-13T17:17:52.239519+0000","last_became_active":"2024-09-13T17:17:52.235980+0000","last_became_peered":"2024-09-13T17:17:52.235980+0000","last_unstale":"2024-09-13T17:17:52.239519+0000","last_undegraded":"2024-09-13T17:17:52.239519+0000","last_fullsized":"2024-09-13T17:17:52.239519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:17.661696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225579+0000","last_change":"2024-09-13T17:17:52.225579+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225579+0000","last_undegraded":"2024-09-13T17:17:52.225579+0000","last_fullsized":"2024-09-13T17:17:52.225579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235473+0000","last_change":"2024-09-13T17:17:52.234737+0000","last_active":"2024-09-13T17:17:52.235473+0000","last_peered":"2024-09-13T17:17:52.235473+0000","last_clean":"2024-09-13T17:17:52.235473+0000","last_became_active":"2024-09-13T17:17:52.234268+0000","last_became_peered":"2024-09-13T17:17:52.234268+0000","last_unstale":"2024-09-13T17:17:52.235473+0000","last_undegraded":"2024-09-13T17:17:52.235473+0000","last_fullsized":"2024-09-13T17:17:52.235473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:17:51.217617+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:51.217617+0000","last_peered":"2024-09-13T17:17:51.217617+0000","last_clean":"2024-09-13T17:17:51.217617+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:51.217617+0000","last_undegraded":"2024-09-13T17:17:51.217617+0000","last_fullsized":"2024-09-13T17:17:51.217617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.439}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.504},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.308},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.442}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223559+0000', 'last_change': '2024-09-13T17:17:52.223559+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223559+0000', 'last_undegraded': '2024-09-13T17:17:52.223559+0000', 'last_fullsized': '2024-09-13T17:17:52.223559+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.220817+0000', 'last_change': '2024-09-13T17:17:52.220817+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.220817+0000', 'last_undegraded': '2024-09-13T17:17:52.220817+0000', 'last_fullsized': '2024-09-13T17:17:52.220817+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2024-09-13T17:17:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223294+0000', 'last_change': '2024-09-13T17:17:52.223294+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223294+0000', 'last_undegraded': '2024-09-13T17:17:52.223294+0000', 'last_fullsized': '2024-09-13T17:17:52.223294+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224819+0000', 'last_change': '2024-09-13T17:17:52.224819+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224819+0000', 'last_undegraded': '2024-09-13T17:17:52.224819+0000', 'last_fullsized': '2024-09-13T17:17:52.224819+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226117+0000', 'last_change': '2024-09-13T17:17:52.226117+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226117+0000', 'last_undegraded': '2024-09-13T17:17:52.226117+0000', 'last_fullsized': '2024-09-13T17:17:52.226117+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.238846+0000', 'last_change': '2024-09-13T17:17:52.238846+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.238846+0000', 'last_undegraded': '2024-09-13T17:17:52.238846+0000', 'last_fullsized': '2024-09-13T17:17:52.238846+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224374+0000', 'last_change': '2024-09-13T17:17:52.224374+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224374+0000', 'last_undegraded': '2024-09-13T17:17:52.224374+0000', 'last_fullsized': '2024-09-13T17:17:52.224374+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:17:56.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223755+0000', 'last_change': '2024-09-13T17:17:52.223755+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223755+0000', 'last_undegraded': '2024-09-13T17:17:52.223755+0000', 'last_fullsized': '2024-09-13T17:17:52.223755+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223901+0000', 'last_change': '2024-09-13T17:17:52.223901+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223901+0000', 'last_undegraded': '2024-09-13T17:17:52.223901+0000', 'last_fullsized': '2024-09-13T17:17:52.223901+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226238+0000', 'last_change': '2024-09-13T17:17:52.226238+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226238+0000', 'last_undegraded': '2024-09-13T17:17:52.226238+0000', 'last_fullsized': '2024-09-13T17:17:52.226238+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223899+0000', 'last_change': '2024-09-13T17:17:52.223899+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223899+0000', 'last_undegraded': '2024-09-13T17:17:52.223899+0000', 'last_fullsized': '2024-09-13T17:17:52.223899+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.227220+0000', 'last_change': '2024-09-13T17:17:52.227220+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.227220+0000', 'last_undegraded': '2024-09-13T17:17:52.227220+0000', 'last_fullsized': '2024-09-13T17:17:52.227220+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226530+0000', 'last_change': '2024-09-13T17:17:52.226530+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226530+0000', 'last_undegraded': '2024-09-13T17:17:52.226530+0000', 'last_fullsized': '2024-09-13T17:17:52.226530+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223510+0000', 'last_change': '2024-09-13T17:17:52.223510+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223510+0000', 'last_undegraded': '2024-09-13T17:17:52.223510+0000', 'last_fullsized': '2024-09-13T17:17:52.223510+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225699+0000', 'last_change': '2024-09-13T17:17:52.225699+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225699+0000', 'last_undegraded': '2024-09-13T17:17:52.225699+0000', 'last_fullsized': '2024-09-13T17:17:52.225699+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.238879+0000', 'last_change': '2024-09-13T17:17:52.238879+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.238879+0000', 'last_undegraded': '2024-09-13T17:17:52.238879+0000', 'last_fullsized': '2024-09-13T17:17:52.238879+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2024-09-13T17:17:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.237608+0000', 'last_change': '2024-09-13T17:17:52.237608+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.237608+0000', 'last_undegraded': '2024-09-13T17:17:52.237608+0000', 'last_fullsized': '2024-09-13T17:17:52.237608+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224407+0000', 'last_change': '2024-09-13T17:17:52.224407+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224407+0000', 'last_undegraded': '2024-09-13T17:17:52.224407+0000', 'last_fullsized': '2024-09-13T17:17:52.224407+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223435+0000', 'last_change': '2024-09-13T17:17:52.223435+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223435+0000', 'last_undegraded': '2024-09-13T17:17:52.223435+0000', 'last_fullsized': '2024-09-13T17:17:52.223435+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224408+0000', 'last_change': '2024-09-13T17:17:52.224408+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224408+0000', 'last_undegraded': '2024-09-13T17:17:52.224408+0000', 'last_fullsized': '2024-09-13T17:17:52.224408+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222020+0000', 'last_change': '2024-09-13T17:17:52.222020+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222020+0000', 'last_undegraded': '2024-09-13T17:17:52.222020+0000', 'last_fullsized': '2024-09-13T17:17:52.222020+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2024-09-13T17:17:56.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222812+0000', 'last_change': '2024-09-13T17:17:52.222812+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222812+0000', 'last_undegraded': '2024-09-13T17:17:52.222812+0000', 'last_fullsized': '2024-09-13T17:17:52.222812+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225984+0000', 'last_change': '2024-09-13T17:17:52.225984+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225984+0000', 'last_undegraded': '2024-09-13T17:17:52.225984+0000', 'last_fullsized': '2024-09-13T17:17:52.225984+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222635+0000', 'last_change': '2024-09-13T17:17:52.222635+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222635+0000', 'last_undegraded': '2024-09-13T17:17:52.222635+0000', 'last_fullsized': '2024-09-13T17:17:52.222635+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221752+0000', 'last_change': '2024-09-13T17:17:52.221752+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221752+0000', 'last_undegraded': '2024-09-13T17:17:52.221752+0000', 'last_fullsized': '2024-09-13T17:17:52.221752+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224307+0000', 'last_change': '2024-09-13T17:17:52.224307+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224307+0000', 'last_undegraded': '2024-09-13T17:17:52.224307+0000', 'last_fullsized': '2024-09-13T17:17:52.224307+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.230730+0000', 'last_change': '2024-09-13T17:17:52.230730+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.230730+0000', 'last_undegraded': '2024-09-13T17:17:52.230730+0000', 'last_fullsized': '2024-09-13T17:17:52.230730+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223983+0000', 'last_change': '2024-09-13T17:17:52.223983+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223983+0000', 'last_undegraded': '2024-09-13T17:17:52.223983+0000', 'last_fullsized': '2024-09-13T17:17:52.223983+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225006+0000', 'last_change': '2024-09-13T17:17:52.225006+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225006+0000', 'last_undegraded': '2024-09-13T17:17:52.225006+0000', 'last_fullsized': '2024-09-13T17:17:52.225006+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.220654+0000', 'last_change': '2024-09-13T17:17:52.220654+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.220654+0000', 'last_undegraded': '2024-09-13T17:17:52.220654+0000', 'last_fullsized': '2024-09-13T17:17:52.220654+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2024-09-13T17:17:56.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221641+0000', 'last_change': '2024-09-13T17:17:52.221641+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221641+0000', 'last_undegraded': '2024-09-13T17:17:52.221641+0000', 'last_fullsized': '2024-09-13T17:17:52.221641+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.237400+0000', 'last_change': '2024-09-13T17:17:52.237400+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.237400+0000', 'last_undegraded': '2024-09-13T17:17:52.237400+0000', 'last_fullsized': '2024-09-13T17:17:52.237400+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.227897+0000', 'last_change': '2024-09-13T17:17:52.227897+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.227897+0000', 'last_undegraded': '2024-09-13T17:17:52.227897+0000', 'last_fullsized': '2024-09-13T17:17:52.227897+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.230433+0000', 'last_change': '2024-09-13T17:17:52.230433+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.230433+0000', 'last_undegraded': '2024-09-13T17:17:52.230433+0000', 'last_fullsized': '2024-09-13T17:17:52.230433+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225412+0000', 'last_change': '2024-09-13T17:17:52.225412+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225412+0000', 'last_undegraded': '2024-09-13T17:17:52.225412+0000', 'last_fullsized': '2024-09-13T17:17:52.225412+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2024-09-13T17:17:56.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.235170+0000', 'last_change': '2024-09-13T17:17:52.235170+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.235170+0000', 'last_undegraded': '2024-09-13T17:17:52.235170+0000', 'last_fullsized': '2024-09-13T17:17:52.235170+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223317+0000', 'last_change': '2024-09-13T17:17:52.223317+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223317+0000', 'last_undegraded': '2024-09-13T17:17:52.223317+0000', 'last_fullsized': '2024-09-13T17:17:52.223317+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225550+0000', 'last_change': '2024-09-13T17:17:52.225550+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225550+0000', 'last_undegraded': '2024-09-13T17:17:52.225550+0000', 'last_fullsized': '2024-09-13T17:17:52.225550+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.227437+0000', 'last_change': '2024-09-13T17:17:52.227437+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.227437+0000', 'last_undegraded': '2024-09-13T17:17:52.227437+0000', 'last_fullsized': '2024-09-13T17:17:52.227437+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226115+0000', 'last_change': '2024-09-13T17:17:52.226115+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226115+0000', 'last_undegraded': '2024-09-13T17:17:52.226115+0000', 'last_fullsized': '2024-09-13T17:17:52.226115+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221461+0000', 'last_change': '2024-09-13T17:17:52.221461+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221461+0000', 'last_undegraded': '2024-09-13T17:17:52.221461+0000', 'last_fullsized': '2024-09-13T17:17:52.221461+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226678+0000', 'last_change': '2024-09-13T17:17:52.226678+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226678+0000', 'last_undegraded': '2024-09-13T17:17:52.226678+0000', 'last_fullsized': '2024-09-13T17:17:52.226678+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223899+0000', 'last_change': '2024-09-13T17:17:52.223899+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223899+0000', 'last_undegraded': '2024-09-13T17:17:52.223899+0000', 'last_fullsized': '2024-09-13T17:17:52.223899+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223735+0000', 'last_change': '2024-09-13T17:17:52.223735+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223735+0000', 'last_undegraded': '2024-09-13T17:17:52.223735+0000', 'last_fullsized': '2024-09-13T17:17:52.223735+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-09-13T17:17:56.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222754+0000', 'last_change': '2024-09-13T17:17:52.222754+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222754+0000', 'last_undegraded': '2024-09-13T17:17:52.222754+0000', 'last_fullsized': '2024-09-13T17:17:52.222754+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221084+0000', 'last_change': '2024-09-13T17:17:52.221084+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221084+0000', 'last_undegraded': '2024-09-13T17:17:52.221084+0000', 'last_fullsized': '2024-09-13T17:17:52.221084+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.229524+0000', 'last_change': '2024-09-13T17:17:52.229524+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.229524+0000', 'last_undegraded': '2024-09-13T17:17:52.229524+0000', 'last_fullsized': '2024-09-13T17:17:52.229524+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.228565+0000', 'last_change': '2024-09-13T17:17:52.228565+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.228565+0000', 'last_undegraded': '2024-09-13T17:17:52.228565+0000', 'last_fullsized': '2024-09-13T17:17:52.228565+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.226776+0000', 'last_change': '2024-09-13T17:17:52.226776+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.226776+0000', 'last_undegraded': '2024-09-13T17:17:52.226776+0000', 'last_fullsized': '2024-09-13T17:17:52.226776+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2024-09-13T17:17:56.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224276+0000', 'last_change': '2024-09-13T17:17:52.224276+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224276+0000', 'last_undegraded': '2024-09-13T17:17:52.224276+0000', 'last_fullsized': '2024-09-13T17:17:52.224276+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223871+0000', 'last_change': '2024-09-13T17:17:52.223871+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223871+0000', 'last_undegraded': '2024-09-13T17:17:52.223871+0000', 'last_fullsized': '2024-09-13T17:17:52.223871+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224342+0000', 'last_change': '2024-09-13T17:17:52.224342+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224342+0000', 'last_undegraded': '2024-09-13T17:17:52.224342+0000', 'last_fullsized': '2024-09-13T17:17:52.224342+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221223+0000', 'last_change': '2024-09-13T17:17:52.221223+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221223+0000', 'last_undegraded': '2024-09-13T17:17:52.221223+0000', 'last_fullsized': '2024-09-13T17:17:52.221223+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222594+0000', 'last_change': '2024-09-13T17:17:52.222594+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222594+0000', 'last_undegraded': '2024-09-13T17:17:52.222594+0000', 'last_fullsized': '2024-09-13T17:17:52.222594+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2024-09-13T17:17:56.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222982+0000', 'last_change': '2024-09-13T17:17:52.222982+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222982+0000', 'last_undegraded': '2024-09-13T17:17:52.222982+0000', 'last_fullsized': '2024-09-13T17:17:52.222982+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.227148+0000', 'last_change': '2024-09-13T17:17:52.227148+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.227148+0000', 'last_undegraded': '2024-09-13T17:17:52.227148+0000', 'last_fullsized': '2024-09-13T17:17:52.227148+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223179+0000', 'last_change': '2024-09-13T17:17:52.223179+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223179+0000', 'last_undegraded': '2024-09-13T17:17:52.223179+0000', 'last_fullsized': '2024-09-13T17:17:52.223179+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.223889+0000', 'last_change': '2024-09-13T17:17:52.223889+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.223889+0000', 'last_undegraded': '2024-09-13T17:17:52.223889+0000', 'last_fullsized': '2024-09-13T17:17:52.223889+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.221320+0000', 'last_change': '2024-09-13T17:17:52.221320+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.221320+0000', 'last_undegraded': '2024-09-13T17:17:52.221320+0000', 'last_fullsized': '2024-09-13T17:17:52.221320+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2024-09-13T17:17:56.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.228094+0000', 'last_change': '2024-09-13T17:17:52.228094+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.228094+0000', 'last_undegraded': '2024-09-13T17:17:52.228094+0000', 'last_fullsized': '2024-09-13T17:17:52.228094+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224252+0000', 'last_change': '2024-09-13T17:17:52.224252+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224252+0000', 'last_undegraded': '2024-09-13T17:17:52.224252+0000', 'last_fullsized': '2024-09-13T17:17:52.224252+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.224577+0000', 'last_change': '2024-09-13T17:17:52.224577+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.224577+0000', 'last_undegraded': '2024-09-13T17:17:52.224577+0000', 'last_fullsized': '2024-09-13T17:17:52.224577+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.222365+0000', 'last_change': '2024-09-13T17:17:52.222365+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.222365+0000', 'last_undegraded': '2024-09-13T17:17:52.222365+0000', 'last_fullsized': '2024-09-13T17:17:52.222365+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2024-09-13T17:17:56.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 93, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:17:52.225579+0000', 'last_change': '2024-09-13T17:17:52.225579+0000', 'last_active': '2024-09-13T17:17:52.209996+0000', 'last_peered': '2024-09-13T17:17:52.209996+0000', 'last_clean': '2024-09-13T17:17:52.209996+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:17:52.225579+0000', 'last_undegraded': '2024-09-13T17:17:52.225579+0000', 'last_fullsized': '2024-09-13T17:17:52.225579+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'last_clean_scrub_stamp': '2024-09-13T17:17:52.209996+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:17:56.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:17:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 Processor -- start 2024-09-13T17:17:56.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 -- start start 2024-09-13T17:17:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e88167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880d07b0 con 0x7f1e8815c6b0 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880d0a90 con 0x7f1e880cf640 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.371+0000 7f1e8e441640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880d0d70 con 0x7f1e880b6980 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e87fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e8815c6b0 0x7f1e880d1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39952/0 (socket says 172.21.15.5:39952) 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e87fff640 1 -- 172.21.15.5:0/1888799075 learned_addr learned my addr 172.21.15.5:0/1888799075 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e88167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616646340 0 0) 0x7f1e880d07b0 con 0x7f1e8815c6b0 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e74003520 con 0x7f1e8815c6b0 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248932068 0 0) 0x7f1e880d0a90 con 0x7f1e880cf640 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e880d07b0 con 0x7f1e880cf640 2024-09-13T17:17:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983776005 0 0) 0x7f1e74003520 con 0x7f1e8815c6b0 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 msgr2=0x7f1e88167280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e88167280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 >> v1:172.21.15.179:6789/0 conn(0x7f1e880cf640 legacy=0x7f1e880cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880d1050 con 0x7f1e8815c6b0 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f1e78001670 con 0x7f1e8815c6b0 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e88167280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 >> v1:172.21.15.5:6789/0 conn(0x7f1e8815c6b0 legacy=0x7f1e880d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e74003b30 0x7f1e74003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74004d00 0x7f1e74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880d0d70 con 0x7f1e74004d00 2024-09-13T17:17:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7400ba30 con 0x7f1e74003b30 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7400bba0 con 0x7f1e880b6980 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74004d00 0x7f1e74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.372+0000 7f1e7ffff640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 -- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 msgr2=0x7f1e740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 -- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e74003b30 msgr2=0x7f1e74003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e74003b30 0x7f1e74003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 -- 172.21.15.5:0/1888799075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009a70 con 0x7f1e74004d00 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e7ffff640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e880b6980 0x7f1e740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74004d00 0x7f1e74005180 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e320 tx=0x7f1e740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4ef59d8c835829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.373+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80003b90 con 0x7f1e74004d00 2024-09-13T17:17:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000f040 con 0x7f1e74004d00 2024-09-13T17:17:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e877fe640 1 -- 172.21.15.5:0/1888799075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80004020 con 0x7f1e74004d00 2024-09-13T17:17:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 -- 172.21.15.5:0/1888799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74004d00 msgr2=0x7f1e74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 --2- 172.21.15.5:0/1888799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e74004d00 0x7f1e74005180 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e320 tx=0x7f1e740057f0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8c9de640 1 -- 172.21.15.5:0/1888799075 reap_dead start 2024-09-13T17:17:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 -- 172.21.15.5:0/1888799075 shutdown_connections 2024-09-13T17:17:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 -- 172.21.15.5:0/1888799075 >> 172.21.15.5:0/1888799075 conn(0x7f1e88071a20 msgr2=0x7f1e88071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 -- 172.21.15.5:0/1888799075 shutdown_connections 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.374+0000 7f1e8e441640 1 -- 172.21.15.5:0/1888799075 wait complete. 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.375+0000 7f1e8e441640 1 Processor -- start 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.375+0000 7f1e8e441640 1 -- start start 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e74004d00 0x7f1e880c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e881475a0 0x7f1e88147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c82c0 con 0x7f1e8814d1f0 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c9ab0 con 0x7f1e881475a0 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8e441640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880c9d90 con 0x7f1e74004d00 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48254/0 (socket says 172.21.15.5:48254) 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e7ffff640 1 -- 172.21.15.5:0/2776644607 learned_addr learned my addr 172.21.15.5:0/2776644607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e8c9de640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e881475a0 0x7f1e88147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.376+0000 7f1e87fff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e74004d00 0x7f1e880c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 -- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e74004d00 msgr2=0x7f1e880c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e74004d00 0x7f1e880c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 -- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e881475a0 msgr2=0x7f1e88147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e881475a0 0x7f1e88147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 -- 172.21.15.5:0/2776644607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880c7ee0 con 0x7f1e8814d1f0 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e7ffff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e780 tx=0x7f1e7000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70017070 con 0x7f1e8814d1f0 2024-09-13T17:17:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e700050d0 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e880c7bd0 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70005240 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.377+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e88147f70 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.378+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880c8400 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.378+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e70007020 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.379+0000 7f1e857fa640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 0x7f1e6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.379+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e70088c20 con 0x7f1e8814d1f0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.379+0000 7f1e87fff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 0x7f1e6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.380+0000 7f1e87fff640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 0x7f1e6806d0c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e780017a0 tx=0x7f1e780015d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.383+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e880c8400 con 0x7f1e8814d1f0 2024-09-13T17:17:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.618+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1e880c8400 con 0x7f1e8814d1f0 2024-09-13T17:17:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.619+0000 7f1e857fa640 1 -- 172.21.15.5:0/2776644607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1194 (secure 0 0 0) 0x7f1e880c8400 con 0x7f1e8814d1f0 2024-09-13T17:17:56.621 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:56.621 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":305,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247581,"num_in_osds":8,"osd_in_since":1726247573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":252608512,"bytes_avail":772841504768,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":42,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7722}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-13T17:17:09.313320+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:17:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 msgr2=0x7f1e6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 0x7f1e6806d0c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e780017a0 tx=0x7f1e780015d0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 msgr2=0x7f1e8815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000e780 tx=0x7f1e7000ec40 comp rx=0 tx=0).stop 2024-09-13T17:17:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 shutdown_connections 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e881475a0 0x7f1e88147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1e6806ac00 0x7f1e6806d0c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8814d1f0 0x7f1e8815fa30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 --2- 172.21.15.5:0/2776644607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e74004d00 0x7f1e880c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 >> 172.21.15.5:0/2776644607 conn(0x7f1e88071a20 msgr2=0x7f1e880731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 shutdown_connections 2024-09-13T17:17:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.621+0000 7f1e8e441640 1 -- 172.21.15.5:0/2776644607 wait complete. 2024-09-13T17:17:56.634 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:17:56.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:17:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.733+0000 7f3c09765640 1 Processor -- start 2024-09-13T17:17:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.733+0000 7f3c09765640 1 -- start start 2024-09-13T17:17:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.734+0000 7f3c09765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.734+0000 7f3c09765640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c040b5820 0x7f3c040b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.734+0000 7f3c09765640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0415cdd0 con 0x7f3c0415c9f0 2024-09-13T17:17:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.734+0000 7f3c09765640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040b8750 con 0x7f3c040b5820 2024-09-13T17:17:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.734+0000 7f3c09765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040d2c20 con 0x7f3c040cd630 2024-09-13T17:17:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c027fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c037fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c040b5820 0x7f3c040b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c027fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:44380/0 (socket says 172.21.15.5:44380) 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c027fc640 1 -- 172.21.15.5:0/560706331 learned_addr learned my addr 172.21.15.5:0/560706331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c02ffd640 1 --1- 172.21.15.5:0/560706331 >> v1:172.21.15.179:6789/0 conn(0x7f3c0415c9f0 0x7f3c040b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:34668/0 (socket says 172.21.15.5:34668) 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c037fe640 1 -- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 msgr2=0x7f3c040b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c037fe640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c037fe640 1 -- 172.21.15.5:0/560706331 >> v1:172.21.15.179:6789/0 conn(0x7f3c0415c9f0 legacy=0x7f3c040b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c037fe640 1 -- 172.21.15.5:0/560706331 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040d3040 con 0x7f3c040b5820 2024-09-13T17:17:56.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.735+0000 7f3c027fc640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.736+0000 7f3c037fe640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c040b5820 0x7f3c040b5c70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0097d0 tx=0x7f3bfc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a627e47c73281d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.736+0000 7f3c01ffb640 1 -- 172.21.15.5:0/560706331 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc02ae40 con 0x7f3c040b5820 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.736+0000 7f3c01ffb640 1 -- 172.21.15.5:0/560706331 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc032440 con 0x7f3c040b5820 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.736+0000 7f3c01ffb640 1 -- 172.21.15.5:0/560706331 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0327d0 con 0x7f3c040b5820 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 -- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c040b5820 msgr2=0x7f3c040b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c040b5820 0x7f3c040b5c70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc0097d0 tx=0x7f3bfc02a130 comp rx=0 tx=0).stop 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 -- 172.21.15.5:0/560706331 shutdown_connections 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c040b5820 0x7f3c040b5c70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 --2- 172.21.15.5:0/560706331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c040b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 -- 172.21.15.5:0/560706331 >> 172.21.15.5:0/560706331 conn(0x7f3c04071a20 msgr2=0x7f3c04071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 -- 172.21.15.5:0/560706331 shutdown_connections 2024-09-13T17:17:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.737+0000 7f3c09765640 1 -- 172.21.15.5:0/560706331 wait complete. 2024-09-13T17:17:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.738+0000 7f3c09765640 1 Processor -- start 2024-09-13T17:17:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.738+0000 7f3c09765640 1 -- start start 2024-09-13T17:17:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c0414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0415c9f0 0x7f3c0414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040b4a10 con 0x7f3c040b5820 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414c680 con 0x7f3c0415c9f0 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c09765640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414c960 con 0x7f3c040cd630 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48270/0 (socket says 172.21.15.5:48270) 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 -- 172.21.15.5:0/1342679758 learned_addr learned my addr 172.21.15.5:0/1342679758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c027fc640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c0414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c037fe640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0415c9f0 0x7f3c0414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 -- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 msgr2=0x7f3c0414b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c0414b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 -- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0415c9f0 msgr2=0x7f3c0414be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0415c9f0 0x7f3c0414be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.739+0000 7f3c02ffd640 1 -- 172.21.15.5:0/1342679758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0094d0 con 0x7f3c040b5820 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c7a0 tx=0x7f3bf400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400a640 con 0x7f3c040b5820 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf400a7a0 con 0x7f3c040b5820 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc009400 con 0x7f3c040b5820 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400ab10 con 0x7f3c040b5820 2024-09-13T17:17:56.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.740+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0414cf20 con 0x7f3c040b5820 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.741+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c040b1e70 con 0x7f3c040b5820 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.741+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bf400ac70 con 0x7f3c040b5820 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.742+0000 7f3bfb7fe640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 0x7f3be406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.742+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3bf4088b70 con 0x7f3c040b5820 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.742+0000 7f3c027fc640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 0x7f3be406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.743+0000 7f3c027fc640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 0x7f3be406d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3c040aad30 tx=0x7f3bec009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.746+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bf4053cb0 con 0x7f3c040b5820 2024-09-13T17:17:56.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.913+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c040d2560 con 0x7f3be406ac00 2024-09-13T17:17:56.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.921+0000 7f3bfb7fe640 1 -- 172.21.15.5:0/1342679758 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286309 (secure 0 0 0) 0x7f3bec0099e0 con 0x7f3be406ac00 2024-09-13T17:17:56.926 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:17:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.923+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 msgr2=0x7f3be406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 0x7f3be406d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3c040aad30 tx=0x7f3bec009240 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 msgr2=0x7f3c040a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c7a0 tx=0x7f3bf400cc60 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 shutdown_connections 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0415c9f0 0x7f3c0414be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c040cd630 0x7f3c0414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3be406ac00 0x7f3be406d0c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 --2- 172.21.15.5:0/1342679758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c040b5820 0x7f3c040a9370 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 >> 172.21.15.5:0/1342679758 conn(0x7f3c04071a20 msgr2=0x7f3c0415cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 shutdown_connections 2024-09-13T17:17:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:17:56.924+0000 7f3c09765640 1 -- 172.21.15.5:0/1342679758 wait complete. 2024-09-13T17:17:56.936 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-13T17:17:55.324213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246688,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754728032,"statfs":{"total":773094113280,"available":772841504768,"internally_reserved":0,"allocated":10264576,"data_stored":5293248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109304"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223559+0000","last_change":"2024-09-13T17:17:52.223559+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223559+0000","last_undegraded":"2024-09-13T17:17:52.223559+0000","last_fullsized":"2024-09-13T17:17:52.223559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220817+0000","last_change":"2024-09-13T17:17:52.220817+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220817+0000","last_undegraded":"2024-09-13T17:17:52.220817+0000","last_fullsized":"2024-09-13T17:17:52.220817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223294+0000","last_change":"2024-09-13T17:17:52.223294+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223294+0000","last_undegraded":"2024-09-13T17:17:52.223294+0000","last_fullsized":"2024-09-13T17:17:52.223294+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224819+0000","last_change":"2024-09-13T17:17:52.224819+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224819+0000","last_undegraded":"2024-09-13T17:17:52.224819+0000","last_fullsized":"2024-09-13T17:17:52.224819+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226117+0000","last_change":"2024-09-13T17:17:52.226117+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226117+0000","last_undegraded":"2024-09-13T17:17:52.226117+0000","last_fullsized":"2024-09-13T17:17:52.226117+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238846+0000","last_change":"2024-09-13T17:17:52.238846+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238846+0000","last_undegraded":"2024-09-13T17:17:52.238846+0000","last_fullsized":"2024-09-13T17:17:52.238846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224374+0000","last_change":"2024-09-13T17:17:52.224374+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224374+0000","last_undegraded":"2024-09-13T17:17:52.224374+0000","last_fullsized":"2024-09-13T17:17:52.224374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223755+0000","last_change":"2024-09-13T17:17:52.223755+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223755+0000","last_undegraded":"2024-09-13T17:17:52.223755+0000","last_fullsized":"2024-09-13T17:17:52.223755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223901+0000","last_change":"2024-09-13T17:17:52.223901+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223901+0000","last_undegraded":"2024-09-13T17:17:52.223901+0000","last_fullsized":"2024-09-13T17:17:52.223901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226238+0000","last_change":"2024-09-13T17:17:52.226238+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226238+0000","last_undegraded":"2024-09-13T17:17:52.226238+0000","last_fullsized":"2024-09-13T17:17:52.226238+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227220+0000","last_change":"2024-09-13T17:17:52.227220+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227220+0000","last_undegraded":"2024-09-13T17:17:52.227220+0000","last_fullsized":"2024-09-13T17:17:52.227220+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226530+0000","last_change":"2024-09-13T17:17:52.226530+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226530+0000","last_undegraded":"2024-09-13T17:17:52.226530+0000","last_fullsized":"2024-09-13T17:17:52.226530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223510+0000","last_change":"2024-09-13T17:17:52.223510+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223510+0000","last_undegraded":"2024-09-13T17:17:52.223510+0000","last_fullsized":"2024-09-13T17:17:52.223510+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225699+0000","last_change":"2024-09-13T17:17:52.225699+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225699+0000","last_undegraded":"2024-09-13T17:17:52.225699+0000","last_fullsized":"2024-09-13T17:17:52.225699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.238879+0000","last_change":"2024-09-13T17:17:52.238879+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.238879+0000","last_undegraded":"2024-09-13T17:17:52.238879+0000","last_fullsized":"2024-09-13T17:17:52.238879+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237608+0000","last_change":"2024-09-13T17:17:52.237608+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237608+0000","last_undegraded":"2024-09-13T17:17:52.237608+0000","last_fullsized":"2024-09-13T17:17:52.237608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224407+0000","last_change":"2024-09-13T17:17:52.224407+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224407+0000","last_undegraded":"2024-09-13T17:17:52.224407+0000","last_fullsized":"2024-09-13T17:17:52.224407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223435+0000","last_change":"2024-09-13T17:17:52.223435+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223435+0000","last_undegraded":"2024-09-13T17:17:52.223435+0000","last_fullsized":"2024-09-13T17:17:52.223435+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224408+0000","last_change":"2024-09-13T17:17:52.224408+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224408+0000","last_undegraded":"2024-09-13T17:17:52.224408+0000","last_fullsized":"2024-09-13T17:17:52.224408+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222020+0000","last_change":"2024-09-13T17:17:52.222020+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222020+0000","last_undegraded":"2024-09-13T17:17:52.222020+0000","last_fullsized":"2024-09-13T17:17:52.222020+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222812+0000","last_change":"2024-09-13T17:17:52.222812+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222812+0000","last_undegraded":"2024-09-13T17:17:52.222812+0000","last_fullsized":"2024-09-13T17:17:52.222812+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225984+0000","last_change":"2024-09-13T17:17:52.225984+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225984+0000","last_undegraded":"2024-09-13T17:17:52.225984+0000","last_fullsized":"2024-09-13T17:17:52.225984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222635+0000","last_change":"2024-09-13T17:17:52.222635+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222635+0000","last_undegraded":"2024-09-13T17:17:52.222635+0000","last_fullsized":"2024-09-13T17:17:52.222635+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221752+0000","last_change":"2024-09-13T17:17:52.221752+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221752+0000","last_undegraded":"2024-09-13T17:17:52.221752+0000","last_fullsized":"2024-09-13T17:17:52.221752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224307+0000","last_change":"2024-09-13T17:17:52.224307+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224307+0000","last_undegraded":"2024-09-13T17:17:52.224307+0000","last_fullsized":"2024-09-13T17:17:52.224307+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230730+0000","last_change":"2024-09-13T17:17:52.230730+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230730+0000","last_undegraded":"2024-09-13T17:17:52.230730+0000","last_fullsized":"2024-09-13T17:17:52.230730+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223983+0000","last_change":"2024-09-13T17:17:52.223983+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223983+0000","last_undegraded":"2024-09-13T17:17:52.223983+0000","last_fullsized":"2024-09-13T17:17:52.223983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225006+0000","last_change":"2024-09-13T17:17:52.225006+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225006+0000","last_undegraded":"2024-09-13T17:17:52.225006+0000","last_fullsized":"2024-09-13T17:17:52.225006+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.220654+0000","last_change":"2024-09-13T17:17:52.220654+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.220654+0000","last_undegraded":"2024-09-13T17:17:52.220654+0000","last_fullsized":"2024-09-13T17:17:52.220654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221641+0000","last_change":"2024-09-13T17:17:52.221641+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221641+0000","last_undegraded":"2024-09-13T17:17:52.221641+0000","last_fullsized":"2024-09-13T17:17:52.221641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.237400+0000","last_change":"2024-09-13T17:17:52.237400+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.237400+0000","last_undegraded":"2024-09-13T17:17:52.237400+0000","last_fullsized":"2024-09-13T17:17:52.237400+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227897+0000","last_change":"2024-09-13T17:17:52.227897+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227897+0000","last_undegraded":"2024-09-13T17:17:52.227897+0000","last_fullsized":"2024-09-13T17:17:52.227897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.247521+0000","last_change":"2024-09-13T17:17:52.242530+0000","last_active":"2024-09-13T17:17:52.247521+0000","last_peered":"2024-09-13T17:17:52.247521+0000","last_clean":"2024-09-13T17:17:52.247521+0000","last_became_active":"2024-09-13T17:17:52.242237+0000","last_became_peered":"2024-09-13T17:17:52.242237+0000","last_unstale":"2024-09-13T17:17:52.247521+0000","last_undegraded":"2024-09-13T17:17:52.247521+0000","last_fullsized":"2024-09-13T17:17:52.247521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.230433+0000","last_change":"2024-09-13T17:17:52.230433+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.230433+0000","last_undegraded":"2024-09-13T17:17:52.230433+0000","last_fullsized":"2024-09-13T17:17:52.230433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237619+0000","last_change":"2024-09-13T17:17:52.234111+0000","last_active":"2024-09-13T17:17:52.237619+0000","last_peered":"2024-09-13T17:17:52.237619+0000","last_clean":"2024-09-13T17:17:52.237619+0000","last_became_active":"2024-09-13T17:17:52.233852+0000","last_became_peered":"2024-09-13T17:17:52.233852+0000","last_unstale":"2024-09-13T17:17:52.237619+0000","last_undegraded":"2024-09-13T17:17:52.237619+0000","last_fullsized":"2024-09-13T17:17:52.237619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225412+0000","last_change":"2024-09-13T17:17:52.225412+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225412+0000","last_undegraded":"2024-09-13T17:17:52.225412+0000","last_fullsized":"2024-09-13T17:17:52.225412+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239460+0000","last_change":"2024-09-13T17:17:52.234877+0000","last_active":"2024-09-13T17:17:52.239460+0000","last_peered":"2024-09-13T17:17:52.239460+0000","last_clean":"2024-09-13T17:17:52.239460+0000","last_became_active":"2024-09-13T17:17:52.234605+0000","last_became_peered":"2024-09-13T17:17:52.234605+0000","last_unstale":"2024-09-13T17:17:52.239460+0000","last_undegraded":"2024-09-13T17:17:52.239460+0000","last_fullsized":"2024-09-13T17:17:52.239460+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:36.404134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.235170+0000","last_change":"2024-09-13T17:17:52.235170+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.235170+0000","last_undegraded":"2024-09-13T17:17:52.235170+0000","last_fullsized":"2024-09-13T17:17:52.235170+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237478+0000","last_change":"2024-09-13T17:17:52.233058+0000","last_active":"2024-09-13T17:17:52.237478+0000","last_peered":"2024-09-13T17:17:52.237478+0000","last_clean":"2024-09-13T17:17:52.237478+0000","last_became_active":"2024-09-13T17:17:52.232674+0000","last_became_peered":"2024-09-13T17:17:52.232674+0000","last_unstale":"2024-09-13T17:17:52.237478+0000","last_undegraded":"2024-09-13T17:17:52.237478+0000","last_fullsized":"2024-09-13T17:17:52.237478+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223317+0000","last_change":"2024-09-13T17:17:52.223317+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223317+0000","last_undegraded":"2024-09-13T17:17:52.223317+0000","last_fullsized":"2024-09-13T17:17:52.223317+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237562+0000","last_change":"2024-09-13T17:17:52.232698+0000","last_active":"2024-09-13T17:17:52.237562+0000","last_peered":"2024-09-13T17:17:52.237562+0000","last_clean":"2024-09-13T17:17:52.237562+0000","last_became_active":"2024-09-13T17:17:52.232413+0000","last_became_peered":"2024-09-13T17:17:52.232413+0000","last_unstale":"2024-09-13T17:17:52.237562+0000","last_undegraded":"2024-09-13T17:17:52.237562+0000","last_fullsized":"2024-09-13T17:17:52.237562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:38.015314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225550+0000","last_change":"2024-09-13T17:17:52.225550+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225550+0000","last_undegraded":"2024-09-13T17:17:52.225550+0000","last_fullsized":"2024-09-13T17:17:52.225550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235498+0000","last_change":"2024-09-13T17:17:52.234541+0000","last_active":"2024-09-13T17:17:52.235498+0000","last_peered":"2024-09-13T17:17:52.235498+0000","last_clean":"2024-09-13T17:17:52.235498+0000","last_became_active":"2024-09-13T17:17:52.234284+0000","last_became_peered":"2024-09-13T17:17:52.234284+0000","last_unstale":"2024-09-13T17:17:52.235498+0000","last_undegraded":"2024-09-13T17:17:52.235498+0000","last_fullsized":"2024-09-13T17:17:52.235498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227437+0000","last_change":"2024-09-13T17:17:52.227437+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227437+0000","last_undegraded":"2024-09-13T17:17:52.227437+0000","last_fullsized":"2024-09-13T17:17:52.227437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236430+0000","last_change":"2024-09-13T17:17:52.234865+0000","last_active":"2024-09-13T17:17:52.236430+0000","last_peered":"2024-09-13T17:17:52.236430+0000","last_clean":"2024-09-13T17:17:52.236430+0000","last_became_active":"2024-09-13T17:17:52.234561+0000","last_became_peered":"2024-09-13T17:17:52.234561+0000","last_unstale":"2024-09-13T17:17:52.236430+0000","last_undegraded":"2024-09-13T17:17:52.236430+0000","last_fullsized":"2024-09-13T17:17:52.236430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:10.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226115+0000","last_change":"2024-09-13T17:17:52.226115+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226115+0000","last_undegraded":"2024-09-13T17:17:52.226115+0000","last_fullsized":"2024-09-13T17:17:52.226115+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244881+0000","last_change":"2024-09-13T17:17:52.241484+0000","last_active":"2024-09-13T17:17:52.244881+0000","last_peered":"2024-09-13T17:17:52.244881+0000","last_clean":"2024-09-13T17:17:52.244881+0000","last_became_active":"2024-09-13T17:17:52.241306+0000","last_became_peered":"2024-09-13T17:17:52.241306+0000","last_unstale":"2024-09-13T17:17:52.244881+0000","last_undegraded":"2024-09-13T17:17:52.244881+0000","last_fullsized":"2024-09-13T17:17:52.244881+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:09.998148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221461+0000","last_change":"2024-09-13T17:17:52.221461+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221461+0000","last_undegraded":"2024-09-13T17:17:52.221461+0000","last_fullsized":"2024-09-13T17:17:52.221461+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236626+0000","last_change":"2024-09-13T17:17:52.231485+0000","last_active":"2024-09-13T17:17:52.236626+0000","last_peered":"2024-09-13T17:17:52.236626+0000","last_clean":"2024-09-13T17:17:52.236626+0000","last_became_active":"2024-09-13T17:17:52.231207+0000","last_became_peered":"2024-09-13T17:17:52.231207+0000","last_unstale":"2024-09-13T17:17:52.236626+0000","last_undegraded":"2024-09-13T17:17:52.236626+0000","last_fullsized":"2024-09-13T17:17:52.236626+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226678+0000","last_change":"2024-09-13T17:17:52.226678+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226678+0000","last_undegraded":"2024-09-13T17:17:52.226678+0000","last_fullsized":"2024-09-13T17:17:52.226678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.234405+0000","last_change":"2024-09-13T17:17:52.232671+0000","last_active":"2024-09-13T17:17:52.234405+0000","last_peered":"2024-09-13T17:17:52.234405+0000","last_clean":"2024-09-13T17:17:52.234405+0000","last_became_active":"2024-09-13T17:17:52.232353+0000","last_became_peered":"2024-09-13T17:17:52.232353+0000","last_unstale":"2024-09-13T17:17:52.234405+0000","last_undegraded":"2024-09-13T17:17:52.234405+0000","last_fullsized":"2024-09-13T17:17:52.234405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223899+0000","last_change":"2024-09-13T17:17:52.223899+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223899+0000","last_undegraded":"2024-09-13T17:17:52.223899+0000","last_fullsized":"2024-09-13T17:17:52.223899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242455+0000","last_change":"2024-09-13T17:17:52.236765+0000","last_active":"2024-09-13T17:17:52.242455+0000","last_peered":"2024-09-13T17:17:52.242455+0000","last_clean":"2024-09-13T17:17:52.242455+0000","last_became_active":"2024-09-13T17:17:52.236448+0000","last_became_peered":"2024-09-13T17:17:52.236448+0000","last_unstale":"2024-09-13T17:17:52.242455+0000","last_undegraded":"2024-09-13T17:17:52.242455+0000","last_fullsized":"2024-09-13T17:17:52.242455+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:21.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223735+0000","last_change":"2024-09-13T17:17:52.223735+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223735+0000","last_undegraded":"2024-09-13T17:17:52.223735+0000","last_fullsized":"2024-09-13T17:17:52.223735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241939+0000","last_change":"2024-09-13T17:17:52.241241+0000","last_active":"2024-09-13T17:17:52.241939+0000","last_peered":"2024-09-13T17:17:52.241939+0000","last_clean":"2024-09-13T17:17:52.241939+0000","last_became_active":"2024-09-13T17:17:52.240969+0000","last_became_peered":"2024-09-13T17:17:52.240969+0000","last_unstale":"2024-09-13T17:17:52.241939+0000","last_undegraded":"2024-09-13T17:17:52.241939+0000","last_fullsized":"2024-09-13T17:17:52.241939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:20.654650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222754+0000","last_change":"2024-09-13T17:17:52.222754+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222754+0000","last_undegraded":"2024-09-13T17:17:52.222754+0000","last_fullsized":"2024-09-13T17:17:52.222754+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.244916+0000","last_change":"2024-09-13T17:17:52.241975+0000","last_active":"2024-09-13T17:17:52.244916+0000","last_peered":"2024-09-13T17:17:52.244916+0000","last_clean":"2024-09-13T17:17:52.244916+0000","last_became_active":"2024-09-13T17:17:52.241737+0000","last_became_peered":"2024-09-13T17:17:52.241737+0000","last_unstale":"2024-09-13T17:17:52.244916+0000","last_undegraded":"2024-09-13T17:17:52.244916+0000","last_fullsized":"2024-09-13T17:17:52.244916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:48.511892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221084+0000","last_change":"2024-09-13T17:17:52.221084+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221084+0000","last_undegraded":"2024-09-13T17:17:52.221084+0000","last_fullsized":"2024-09-13T17:17:52.221084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.236386+0000","last_change":"2024-09-13T17:17:52.235364+0000","last_active":"2024-09-13T17:17:52.236386+0000","last_peered":"2024-09-13T17:17:52.236386+0000","last_clean":"2024-09-13T17:17:52.236386+0000","last_became_active":"2024-09-13T17:17:52.233817+0000","last_became_peered":"2024-09-13T17:17:52.233817+0000","last_unstale":"2024-09-13T17:17:52.236386+0000","last_undegraded":"2024-09-13T17:17:52.236386+0000","last_fullsized":"2024-09-13T17:17:52.236386+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:03.690380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.229524+0000","last_change":"2024-09-13T17:17:52.229524+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.229524+0000","last_undegraded":"2024-09-13T17:17:52.229524+0000","last_fullsized":"2024-09-13T17:17:52.229524+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240548+0000","last_change":"2024-09-13T17:17:52.239219+0000","last_active":"2024-09-13T17:17:52.240548+0000","last_peered":"2024-09-13T17:17:52.240548+0000","last_clean":"2024-09-13T17:17:52.240548+0000","last_became_active":"2024-09-13T17:17:52.238911+0000","last_became_peered":"2024-09-13T17:17:52.238911+0000","last_unstale":"2024-09-13T17:17:52.240548+0000","last_undegraded":"2024-09-13T17:17:52.240548+0000","last_fullsized":"2024-09-13T17:17:52.240548+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228565+0000","last_change":"2024-09-13T17:17:52.228565+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228565+0000","last_undegraded":"2024-09-13T17:17:52.228565+0000","last_fullsized":"2024-09-13T17:17:52.228565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235502+0000","last_change":"2024-09-13T17:17:52.234905+0000","last_active":"2024-09-13T17:17:52.235502+0000","last_peered":"2024-09-13T17:17:52.235502+0000","last_clean":"2024-09-13T17:17:52.235502+0000","last_became_active":"2024-09-13T17:17:52.234585+0000","last_became_peered":"2024-09-13T17:17:52.234585+0000","last_unstale":"2024-09-13T17:17:52.235502+0000","last_undegraded":"2024-09-13T17:17:52.235502+0000","last_fullsized":"2024-09-13T17:17:52.235502+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.226776+0000","last_change":"2024-09-13T17:17:52.226776+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.226776+0000","last_undegraded":"2024-09-13T17:17:52.226776+0000","last_fullsized":"2024-09-13T17:17:52.226776+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241920+0000","last_change":"2024-09-13T17:17:52.235049+0000","last_active":"2024-09-13T17:17:52.241920+0000","last_peered":"2024-09-13T17:17:52.241920+0000","last_clean":"2024-09-13T17:17:52.241920+0000","last_became_active":"2024-09-13T17:17:52.234785+0000","last_became_peered":"2024-09-13T17:17:52.234785+0000","last_unstale":"2024-09-13T17:17:52.241920+0000","last_undegraded":"2024-09-13T17:17:52.241920+0000","last_fullsized":"2024-09-13T17:17:52.241920+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224276+0000","last_change":"2024-09-13T17:17:52.224276+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224276+0000","last_undegraded":"2024-09-13T17:17:52.224276+0000","last_fullsized":"2024-09-13T17:17:52.224276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237336+0000","last_change":"2024-09-13T17:17:52.233704+0000","last_active":"2024-09-13T17:17:52.237336+0000","last_peered":"2024-09-13T17:17:52.237336+0000","last_clean":"2024-09-13T17:17:52.237336+0000","last_became_active":"2024-09-13T17:17:52.233427+0000","last_became_peered":"2024-09-13T17:17:52.233427+0000","last_unstale":"2024-09-13T17:17:52.237336+0000","last_undegraded":"2024-09-13T17:17:52.237336+0000","last_fullsized":"2024-09-13T17:17:52.237336+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:24.347887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223871+0000","last_change":"2024-09-13T17:17:52.223871+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223871+0000","last_undegraded":"2024-09-13T17:17:52.223871+0000","last_fullsized":"2024-09-13T17:17:52.223871+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237573+0000","last_change":"2024-09-13T17:17:52.233308+0000","last_active":"2024-09-13T17:17:52.237573+0000","last_peered":"2024-09-13T17:17:52.237573+0000","last_clean":"2024-09-13T17:17:52.237573+0000","last_became_active":"2024-09-13T17:17:52.233057+0000","last_became_peered":"2024-09-13T17:17:52.233057+0000","last_unstale":"2024-09-13T17:17:52.237573+0000","last_undegraded":"2024-09-13T17:17:52.237573+0000","last_fullsized":"2024-09-13T17:17:52.237573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:52.681260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224342+0000","last_change":"2024-09-13T17:17:52.224342+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224342+0000","last_undegraded":"2024-09-13T17:17:52.224342+0000","last_fullsized":"2024-09-13T17:17:52.224342+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232030+0000","last_change":"2024-09-13T17:17:52.226255+0000","last_active":"2024-09-13T17:17:52.232030+0000","last_peered":"2024-09-13T17:17:52.232030+0000","last_clean":"2024-09-13T17:17:52.232030+0000","last_became_active":"2024-09-13T17:17:52.225926+0000","last_became_peered":"2024-09-13T17:17:52.225926+0000","last_unstale":"2024-09-13T17:17:52.232030+0000","last_undegraded":"2024-09-13T17:17:52.232030+0000","last_fullsized":"2024-09-13T17:17:52.232030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:09.325792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221223+0000","last_change":"2024-09-13T17:17:52.221223+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221223+0000","last_undegraded":"2024-09-13T17:17:52.221223+0000","last_fullsized":"2024-09-13T17:17:52.221223+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.238187+0000","last_change":"2024-09-13T17:17:52.236308+0000","last_active":"2024-09-13T17:17:52.238187+0000","last_peered":"2024-09-13T17:17:52.238187+0000","last_clean":"2024-09-13T17:17:52.238187+0000","last_became_active":"2024-09-13T17:17:52.236019+0000","last_became_peered":"2024-09-13T17:17:52.236019+0000","last_unstale":"2024-09-13T17:17:52.238187+0000","last_undegraded":"2024-09-13T17:17:52.238187+0000","last_fullsized":"2024-09-13T17:17:52.238187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222594+0000","last_change":"2024-09-13T17:17:52.222594+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222594+0000","last_undegraded":"2024-09-13T17:17:52.222594+0000","last_fullsized":"2024-09-13T17:17:52.222594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242384+0000","last_change":"2024-09-13T17:17:52.239876+0000","last_active":"2024-09-13T17:17:52.242384+0000","last_peered":"2024-09-13T17:17:52.242384+0000","last_clean":"2024-09-13T17:17:52.242384+0000","last_became_active":"2024-09-13T17:17:52.239592+0000","last_became_peered":"2024-09-13T17:17:52.239592+0000","last_unstale":"2024-09-13T17:17:52.242384+0000","last_undegraded":"2024-09-13T17:17:52.242384+0000","last_fullsized":"2024-09-13T17:17:52.242384+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222982+0000","last_change":"2024-09-13T17:17:52.222982+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222982+0000","last_undegraded":"2024-09-13T17:17:52.222982+0000","last_fullsized":"2024-09-13T17:17:52.222982+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.240581+0000","last_change":"2024-09-13T17:17:52.238644+0000","last_active":"2024-09-13T17:17:52.240581+0000","last_peered":"2024-09-13T17:17:52.240581+0000","last_clean":"2024-09-13T17:17:52.240581+0000","last_became_active":"2024-09-13T17:17:52.238325+0000","last_became_peered":"2024-09-13T17:17:52.238325+0000","last_unstale":"2024-09-13T17:17:52.240581+0000","last_undegraded":"2024-09-13T17:17:52.240581+0000","last_fullsized":"2024-09-13T17:17:52.240581+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:02.311277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.227148+0000","last_change":"2024-09-13T17:17:52.227148+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.227148+0000","last_undegraded":"2024-09-13T17:17:52.227148+0000","last_fullsized":"2024-09-13T17:17:52.227148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237322+0000","last_change":"2024-09-13T17:17:52.233210+0000","last_active":"2024-09-13T17:17:52.237322+0000","last_peered":"2024-09-13T17:17:52.237322+0000","last_clean":"2024-09-13T17:17:52.237322+0000","last_became_active":"2024-09-13T17:17:52.232940+0000","last_became_peered":"2024-09-13T17:17:52.232940+0000","last_unstale":"2024-09-13T17:17:52.237322+0000","last_undegraded":"2024-09-13T17:17:52.237322+0000","last_fullsized":"2024-09-13T17:17:52.237322+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:58.047973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223179+0000","last_change":"2024-09-13T17:17:52.223179+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223179+0000","last_undegraded":"2024-09-13T17:17:52.223179+0000","last_fullsized":"2024-09-13T17:17:52.223179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237599+0000","last_change":"2024-09-13T17:17:52.233412+0000","last_active":"2024-09-13T17:17:52.237599+0000","last_peered":"2024-09-13T17:17:52.237599+0000","last_clean":"2024-09-13T17:17:52.237599+0000","last_became_active":"2024-09-13T17:17:52.233154+0000","last_became_peered":"2024-09-13T17:17:52.233154+0000","last_unstale":"2024-09-13T17:17:52.237599+0000","last_undegraded":"2024-09-13T17:17:52.237599+0000","last_fullsized":"2024-09-13T17:17:52.237599+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:17.024663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.223889+0000","last_change":"2024-09-13T17:17:52.223889+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.223889+0000","last_undegraded":"2024-09-13T17:17:52.223889+0000","last_fullsized":"2024-09-13T17:17:52.223889+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.242436+0000","last_change":"2024-09-13T17:17:52.236227+0000","last_active":"2024-09-13T17:17:52.242436+0000","last_peered":"2024-09-13T17:17:52.242436+0000","last_clean":"2024-09-13T17:17:52.242436+0000","last_became_active":"2024-09-13T17:17:52.235979+0000","last_became_peered":"2024-09-13T17:17:52.235979+0000","last_unstale":"2024-09-13T17:17:52.242436+0000","last_undegraded":"2024-09-13T17:17:52.242436+0000","last_fullsized":"2024-09-13T17:17:52.242436+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:41.421504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.221320+0000","last_change":"2024-09-13T17:17:52.221320+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.221320+0000","last_undegraded":"2024-09-13T17:17:52.221320+0000","last_fullsized":"2024-09-13T17:17:52.221320+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.237449+0000","last_change":"2024-09-13T17:17:52.232971+0000","last_active":"2024-09-13T17:17:52.237449+0000","last_peered":"2024-09-13T17:17:52.237449+0000","last_clean":"2024-09-13T17:17:52.237449+0000","last_became_active":"2024-09-13T17:17:52.232691+0000","last_became_peered":"2024-09-13T17:17:52.232691+0000","last_unstale":"2024-09-13T17:17:52.237449+0000","last_undegraded":"2024-09-13T17:17:52.237449+0000","last_fullsized":"2024-09-13T17:17:52.237449+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.228094+0000","last_change":"2024-09-13T17:17:52.228094+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.228094+0000","last_undegraded":"2024-09-13T17:17:52.228094+0000","last_fullsized":"2024-09-13T17:17:52.228094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235692+0000","last_change":"2024-09-13T17:17:52.232914+0000","last_active":"2024-09-13T17:17:52.235692+0000","last_peered":"2024-09-13T17:17:52.235692+0000","last_clean":"2024-09-13T17:17:52.235692+0000","last_became_active":"2024-09-13T17:17:52.232662+0000","last_became_peered":"2024-09-13T17:17:52.232662+0000","last_unstale":"2024-09-13T17:17:52.235692+0000","last_undegraded":"2024-09-13T17:17:52.235692+0000","last_fullsized":"2024-09-13T17:17:52.235692+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:16.955126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224252+0000","last_change":"2024-09-13T17:17:52.224252+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224252+0000","last_undegraded":"2024-09-13T17:17:52.224252+0000","last_fullsized":"2024-09-13T17:17:52.224252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.232153+0000","last_change":"2024-09-13T17:17:52.228592+0000","last_active":"2024-09-13T17:17:52.232153+0000","last_peered":"2024-09-13T17:17:52.232153+0000","last_clean":"2024-09-13T17:17:52.232153+0000","last_became_active":"2024-09-13T17:17:52.228266+0000","last_became_peered":"2024-09-13T17:17:52.228266+0000","last_unstale":"2024-09-13T17:17:52.232153+0000","last_undegraded":"2024-09-13T17:17:52.232153+0000","last_fullsized":"2024-09-13T17:17:52.232153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.416745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.224577+0000","last_change":"2024-09-13T17:17:52.224577+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.224577+0000","last_undegraded":"2024-09-13T17:17:52.224577+0000","last_fullsized":"2024-09-13T17:17:52.224577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.241880+0000","last_change":"2024-09-13T17:17:52.234917+0000","last_active":"2024-09-13T17:17:52.241880+0000","last_peered":"2024-09-13T17:17:52.241880+0000","last_clean":"2024-09-13T17:17:52.241880+0000","last_became_active":"2024-09-13T17:17:52.234638+0000","last_became_peered":"2024-09-13T17:17:52.234638+0000","last_unstale":"2024-09-13T17:17:52.241880+0000","last_undegraded":"2024-09-13T17:17:52.241880+0000","last_fullsized":"2024-09-13T17:17:52.241880+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.222365+0000","last_change":"2024-09-13T17:17:52.222365+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.222365+0000","last_undegraded":"2024-09-13T17:17:52.222365+0000","last_fullsized":"2024-09-13T17:17:52.222365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.239519+0000","last_change":"2024-09-13T17:17:52.236289+0000","last_active":"2024-09-13T17:17:52.239519+0000","last_peered":"2024-09-13T17:17:52.239519+0000","last_clean":"2024-09-13T17:17:52.239519+0000","last_became_active":"2024-09-13T17:17:52.235980+0000","last_became_peered":"2024-09-13T17:17:52.235980+0000","last_unstale":"2024-09-13T17:17:52.239519+0000","last_undegraded":"2024-09-13T17:17:52.239519+0000","last_fullsized":"2024-09-13T17:17:52.239519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:17.661696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":93,"state":"creating+peering","last_fresh":"2024-09-13T17:17:52.225579+0000","last_change":"2024-09-13T17:17:52.225579+0000","last_active":"2024-09-13T17:17:52.209996+0000","last_peered":"2024-09-13T17:17:52.209996+0000","last_clean":"2024-09-13T17:17:52.209996+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:17:52.225579+0000","last_undegraded":"2024-09-13T17:17:52.225579+0000","last_fullsized":"2024-09-13T17:17:52.225579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.235473+0000","last_change":"2024-09-13T17:17:52.234737+0000","last_active":"2024-09-13T17:17:52.235473+0000","last_peered":"2024-09-13T17:17:52.235473+0000","last_clean":"2024-09-13T17:17:52.235473+0000","last_became_active":"2024-09-13T17:17:52.234268+0000","last_became_peered":"2024-09-13T17:17:52.234268+0000","last_unstale":"2024-09-13T17:17:52.235473+0000","last_undegraded":"2024-09-13T17:17:52.235473+0000","last_fullsized":"2024-09-13T17:17:52.235473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:17:51.217617+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:51.217617+0000","last_peered":"2024-09-13T17:17:51.217617+0000","last_clean":"2024-09-13T17:17:51.217617+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:51.217617+0000","last_undegraded":"2024-09-13T17:17:51.217617+0000","last_fullsized":"2024-09-13T17:17:51.217617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.629}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.439}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.504},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.308},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.442}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.497}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1134592,"data_stored":514064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1728512,"data_stored":1104432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:17:58.490 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-09-13T17:17:58.489+0000 7f895ce3d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:17:59.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.056+0000 7f175a9f4640 1 Processor -- start 2024-09-13T17:18:00.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.056+0000 7f175a9f4640 1 -- start start 2024-09-13T17:18:00.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f175a9f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175414fa80 0x7f1754159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f175a9f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f175406d730 0x7f175406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f175a9f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175406e1d0 con 0x7f1754070b20 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f175a9f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175406e4b0 con 0x7f175406d730 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f175a9f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1754159350 con 0x7f175414fa80 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f175406d730 0x7f175406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f175406d730 0x7f175406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48280/0 (socket says 172.21.15.5:48280) 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 -- 172.21.15.5:0/3944979989 learned_addr learned my addr 172.21.15.5:0/3944979989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f1758f91640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1754070b20 0x7f17540b1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39968/0 (socket says 172.21.15.5:39968) 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f1753fff640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175414fa80 0x7f1754159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 -- 172.21.15.5:0/3944979989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175414fa80 msgr2=0x7f1754159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175414fa80 0x7f1754159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 -- 172.21.15.5:0/3944979989 >> v1:172.21.15.5:6789/0 conn(0x7f1754070b20 legacy=0x7f17540b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f17537fe640 1 -- 172.21.15.5:0/3944979989 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754159630 con 0x7f175406d730 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.057+0000 7f1752ffd640 1 -- 172.21.15.5:0/3944979989 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928397795 0 0) 0x7f175406e1d0 con 0x7f1754070b20 2024-09-13T17:18:00.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.058+0000 7f17537fe640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f175406d730 0x7f175406db70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1748009870 tx=0x7f174802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7864d7be67aeed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.058+0000 7f1752ffd640 1 -- 172.21.15.5:0/3944979989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748032440 con 0x7f175406d730 2024-09-13T17:18:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.058+0000 7f1752ffd640 1 -- 172.21.15.5:0/3944979989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17480325a0 con 0x7f175406d730 2024-09-13T17:18:00.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.058+0000 7f1752ffd640 1 -- 172.21.15.5:0/3944979989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748032930 con 0x7f175406d730 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 -- 172.21.15.5:0/3944979989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f175406d730 msgr2=0x7f175406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f175406d730 0x7f175406db70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f1748009870 tx=0x7f174802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 -- 172.21.15.5:0/3944979989 shutdown_connections 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f175406d730 0x7f175406db70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 --2- 172.21.15.5:0/3944979989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175414fa80 0x7f1754159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 -- 172.21.15.5:0/3944979989 >> 172.21.15.5:0/3944979989 conn(0x7f17540b3fd0 msgr2=0x7f1754069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 -- 172.21.15.5:0/3944979989 shutdown_connections 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.059+0000 7f175a9f4640 1 -- 172.21.15.5:0/3944979989 wait complete. 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.060+0000 7f175a9f4640 1 Processor -- start 2024-09-13T17:18:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 -- start start 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 0x7f1754144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 0x7f17541455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175414b7d0 con 0x7f1754070b20 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175414ba70 con 0x7f175414fa80 2024-09-13T17:18:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f175a9f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175414bd50 con 0x7f175406d730 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f17537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f17537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48294/0 (socket says 172.21.15.5:48294) 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f17537fe640 1 -- 172.21.15.5:0/1184591669 learned_addr learned my addr 172.21.15.5:0/1184591669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.061+0000 7f1753fff640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 0x7f1754144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1758f91640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 0x7f17541455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 -- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 msgr2=0x7f1754144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 0x7f1754144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 -- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 msgr2=0x7f17541455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 0x7f17541455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 -- 172.21.15.5:0/1184591669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480094d0 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1753fff640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 0x7f1754144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1758f91640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 0x7f17541455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f17537fe640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f17480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748032440 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748030b80 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175414c030 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174803d440 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.062+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175414c5f0 con 0x7f1754070b20 2024-09-13T17:18:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.063+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175414be90 con 0x7f1754070b20 2024-09-13T17:18:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.064+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1748039040 con 0x7f1754070b20 2024-09-13T17:18:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.064+0000 7f1750ff9640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 0x7f174006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.064+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f17480a9fc0 con 0x7f1754070b20 2024-09-13T17:18:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.065+0000 7f1753fff640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 0x7f174006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.065+0000 7f1753fff640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 0x7f174006d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1754158de0 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.069+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f17480dd9c0 con 0x7f1754070b20 2024-09-13T17:18:00.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.238+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17540ad940 con 0x7f174006ac00 2024-09-13T17:18:00.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.246+0000 7f1750ff9640 1 -- 172.21.15.5:0/1184591669 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289234 (secure 0 0 0) 0x7f17540ad940 con 0x7f174006ac00 2024-09-13T17:18:00.250 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:00.252 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 msgr2=0x7f174006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 0x7f174006d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1754158de0 tx=0x7f1744008040 comp rx=0 tx=0).stop 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 msgr2=0x7f175414b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f17480046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 shutdown_connections 2024-09-13T17:18:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f175414fa80 0x7f17541455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f174006ac00 0x7f174006d0c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1754070b20 0x7f175414b290 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 --2- 172.21.15.5:0/1184591669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f175406d730 0x7f1754144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 >> 172.21.15.5:0/1184591669 conn(0x7f17540b3fd0 msgr2=0x7f1754069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 shutdown_connections 2024-09-13T17:18:00.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.249+0000 7f175a9f4640 1 -- 172.21.15.5:0/1184591669 wait complete. 2024-09-13T17:18:00.261 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-13T17:17:59.325327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247064,"kb_used_data":10376,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754727656,"statfs":{"total":773094113280,"available":772841119744,"internally_reserved":0,"allocated":10625024,"data_stored":5460452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":242208313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.106727"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.608750+0000","last_change":"2024-09-13T17:17:52.601664+0000","last_active":"2024-09-13T17:17:52.608750+0000","last_peered":"2024-09-13T17:17:52.608750+0000","last_clean":"2024-09-13T17:17:52.608750+0000","last_became_active":"2024-09-13T17:17:52.601003+0000","last_became_peered":"2024-09-13T17:17:52.601003+0000","last_unstale":"2024-09-13T17:17:52.608750+0000","last_undegraded":"2024-09-13T17:17:52.608750+0000","last_fullsized":"2024-09-13T17:17:52.608750+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.508488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604252+0000","last_change":"2024-09-13T17:17:52.596238+0000","last_active":"2024-09-13T17:17:52.604252+0000","last_peered":"2024-09-13T17:17:52.604252+0000","last_clean":"2024-09-13T17:17:52.604252+0000","last_became_active":"2024-09-13T17:17:52.595969+0000","last_became_peered":"2024-09-13T17:17:52.595969+0000","last_unstale":"2024-09-13T17:17:52.604252+0000","last_undegraded":"2024-09-13T17:17:52.604252+0000","last_fullsized":"2024-09-13T17:17:52.604252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.609201+0000","last_change":"2024-09-13T17:17:52.604982+0000","last_active":"2024-09-13T17:17:52.609201+0000","last_peered":"2024-09-13T17:17:52.609201+0000","last_clean":"2024-09-13T17:17:52.609201+0000","last_became_active":"2024-09-13T17:17:52.604725+0000","last_became_peered":"2024-09-13T17:17:52.604725+0000","last_unstale":"2024-09-13T17:17:52.609201+0000","last_undegraded":"2024-09-13T17:17:52.609201+0000","last_fullsized":"2024-09-13T17:17:52.609201+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:38.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613987+0000","last_change":"2024-09-13T17:17:52.612974+0000","last_active":"2024-09-13T17:17:52.613987+0000","last_peered":"2024-09-13T17:17:52.613987+0000","last_clean":"2024-09-13T17:17:52.613987+0000","last_became_active":"2024-09-13T17:17:52.612696+0000","last_became_peered":"2024-09-13T17:17:52.612696+0000","last_unstale":"2024-09-13T17:17:52.613987+0000","last_undegraded":"2024-09-13T17:17:52.613987+0000","last_fullsized":"2024-09-13T17:17:52.613987+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:50.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.614101+0000","last_change":"2024-09-13T17:17:52.613216+0000","last_active":"2024-09-13T17:17:52.614101+0000","last_peered":"2024-09-13T17:17:52.614101+0000","last_clean":"2024-09-13T17:17:52.614101+0000","last_became_active":"2024-09-13T17:17:52.612953+0000","last_became_peered":"2024-09-13T17:17:52.612953+0000","last_unstale":"2024-09-13T17:17:52.614101+0000","last_undegraded":"2024-09-13T17:17:52.614101+0000","last_fullsized":"2024-09-13T17:17:52.614101+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.600809+0000","last_change":"2024-09-13T17:17:52.598219+0000","last_active":"2024-09-13T17:17:52.600809+0000","last_peered":"2024-09-13T17:17:52.600809+0000","last_clean":"2024-09-13T17:17:52.600809+0000","last_became_active":"2024-09-13T17:17:52.597976+0000","last_became_peered":"2024-09-13T17:17:52.597976+0000","last_unstale":"2024-09-13T17:17:52.600809+0000","last_undegraded":"2024-09-13T17:17:52.600809+0000","last_fullsized":"2024-09-13T17:17:52.600809+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:28.494681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.609965+0000","last_change":"2024-09-13T17:17:52.606866+0000","last_active":"2024-09-13T17:17:52.609965+0000","last_peered":"2024-09-13T17:17:52.609965+0000","last_clean":"2024-09-13T17:17:52.609965+0000","last_became_active":"2024-09-13T17:17:52.606569+0000","last_became_peered":"2024-09-13T17:17:52.606569+0000","last_unstale":"2024-09-13T17:17:52.609965+0000","last_undegraded":"2024-09-13T17:17:52.609965+0000","last_fullsized":"2024-09-13T17:17:52.609965+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613619+0000","last_change":"2024-09-13T17:17:52.612652+0000","last_active":"2024-09-13T17:17:52.613619+0000","last_peered":"2024-09-13T17:17:52.613619+0000","last_clean":"2024-09-13T17:17:52.613619+0000","last_became_active":"2024-09-13T17:17:52.612340+0000","last_became_peered":"2024-09-13T17:17:52.612340+0000","last_unstale":"2024-09-13T17:17:52.613619+0000","last_undegraded":"2024-09-13T17:17:52.613619+0000","last_fullsized":"2024-09-13T17:17:52.613619+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:37.684803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613652+0000","last_change":"2024-09-13T17:17:52.606100+0000","last_active":"2024-09-13T17:17:52.613652+0000","last_peered":"2024-09-13T17:17:52.613652+0000","last_clean":"2024-09-13T17:17:52.613652+0000","last_became_active":"2024-09-13T17:17:52.605439+0000","last_became_peered":"2024-09-13T17:17:52.605439+0000","last_unstale":"2024-09-13T17:17:52.613652+0000","last_undegraded":"2024-09-13T17:17:52.613652+0000","last_fullsized":"2024-09-13T17:17:52.613652+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.606893+0000","last_change":"2024-09-13T17:17:52.606044+0000","last_active":"2024-09-13T17:17:52.606893+0000","last_peered":"2024-09-13T17:17:52.606893+0000","last_clean":"2024-09-13T17:17:52.606893+0000","last_became_active":"2024-09-13T17:17:52.605769+0000","last_became_peered":"2024-09-13T17:17:52.605769+0000","last_unstale":"2024-09-13T17:17:52.606893+0000","last_undegraded":"2024-09-13T17:17:52.606893+0000","last_fullsized":"2024-09-13T17:17:52.606893+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:34.921103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.614077+0000","last_change":"2024-09-13T17:17:52.611565+0000","last_active":"2024-09-13T17:17:52.614077+0000","last_peered":"2024-09-13T17:17:52.614077+0000","last_clean":"2024-09-13T17:17:52.614077+0000","last_became_active":"2024-09-13T17:17:52.611288+0000","last_became_peered":"2024-09-13T17:17:52.611288+0000","last_unstale":"2024-09-13T17:17:52.614077+0000","last_undegraded":"2024-09-13T17:17:52.614077+0000","last_fullsized":"2024-09-13T17:17:52.614077+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.599763+0000","last_change":"2024-09-13T17:17:52.595697+0000","last_active":"2024-09-13T17:17:52.599763+0000","last_peered":"2024-09-13T17:17:52.599763+0000","last_clean":"2024-09-13T17:17:52.599763+0000","last_became_active":"2024-09-13T17:17:52.595440+0000","last_became_peered":"2024-09-13T17:17:52.595440+0000","last_unstale":"2024-09-13T17:17:52.599763+0000","last_undegraded":"2024-09-13T17:17:52.599763+0000","last_fullsized":"2024-09-13T17:17:52.599763+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:35.614749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613784+0000","last_change":"2024-09-13T17:17:52.612658+0000","last_active":"2024-09-13T17:17:52.613784+0000","last_peered":"2024-09-13T17:17:52.613784+0000","last_clean":"2024-09-13T17:17:52.613784+0000","last_became_active":"2024-09-13T17:17:52.612308+0000","last_became_peered":"2024-09-13T17:17:52.612308+0000","last_unstale":"2024-09-13T17:17:52.613784+0000","last_undegraded":"2024-09-13T17:17:52.613784+0000","last_fullsized":"2024-09-13T17:17:52.613784+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:15.100354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613783+0000","last_change":"2024-09-13T17:17:52.606998+0000","last_active":"2024-09-13T17:17:52.613783+0000","last_peered":"2024-09-13T17:17:52.613783+0000","last_clean":"2024-09-13T17:17:52.613783+0000","last_became_active":"2024-09-13T17:17:52.606740+0000","last_became_peered":"2024-09-13T17:17:52.606740+0000","last_unstale":"2024-09-13T17:17:52.613783+0000","last_undegraded":"2024-09-13T17:17:52.613783+0000","last_fullsized":"2024-09-13T17:17:52.613783+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604533+0000","last_change":"2024-09-13T17:17:52.600060+0000","last_active":"2024-09-13T17:17:52.604533+0000","last_peered":"2024-09-13T17:17:52.604533+0000","last_clean":"2024-09-13T17:17:52.604533+0000","last_became_active":"2024-09-13T17:17:52.599793+0000","last_became_peered":"2024-09-13T17:17:52.599793+0000","last_unstale":"2024-09-13T17:17:52.604533+0000","last_undegraded":"2024-09-13T17:17:52.604533+0000","last_fullsized":"2024-09-13T17:17:52.604533+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.600851+0000","last_change":"2024-09-13T17:17:52.596560+0000","last_active":"2024-09-13T17:17:52.600851+0000","last_peered":"2024-09-13T17:17:52.600851+0000","last_clean":"2024-09-13T17:17:52.600851+0000","last_became_active":"2024-09-13T17:17:52.596317+0000","last_became_peered":"2024-09-13T17:17:52.596317+0000","last_unstale":"2024-09-13T17:17:52.600851+0000","last_undegraded":"2024-09-13T17:17:52.600851+0000","last_fullsized":"2024-09-13T17:17:52.600851+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:18.473951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.603355+0000","last_change":"2024-09-13T17:17:52.598281+0000","last_active":"2024-09-13T17:17:52.603355+0000","last_peered":"2024-09-13T17:17:52.603355+0000","last_clean":"2024-09-13T17:17:52.603355+0000","last_became_active":"2024-09-13T17:17:52.597364+0000","last_became_peered":"2024-09-13T17:17:52.597364+0000","last_unstale":"2024-09-13T17:17:52.603355+0000","last_undegraded":"2024-09-13T17:17:52.603355+0000","last_fullsized":"2024-09-13T17:17:52.603355+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:27.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.603234+0000","last_change":"2024-09-13T17:17:52.597634+0000","last_active":"2024-09-13T17:17:52.603234+0000","last_peered":"2024-09-13T17:17:52.603234+0000","last_clean":"2024-09-13T17:17:52.603234+0000","last_became_active":"2024-09-13T17:17:52.597380+0000","last_became_peered":"2024-09-13T17:17:52.597380+0000","last_unstale":"2024-09-13T17:17:52.603234+0000","last_undegraded":"2024-09-13T17:17:52.603234+0000","last_fullsized":"2024-09-13T17:17:52.603234+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.179345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613971+0000","last_change":"2024-09-13T17:17:52.608997+0000","last_active":"2024-09-13T17:17:52.613971+0000","last_peered":"2024-09-13T17:17:52.613971+0000","last_clean":"2024-09-13T17:17:52.613971+0000","last_became_active":"2024-09-13T17:17:52.606341+0000","last_became_peered":"2024-09-13T17:17:52.606341+0000","last_unstale":"2024-09-13T17:17:52.613971+0000","last_undegraded":"2024-09-13T17:17:52.613971+0000","last_fullsized":"2024-09-13T17:17:52.613971+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604732+0000","last_change":"2024-09-13T17:17:52.603457+0000","last_active":"2024-09-13T17:17:52.604732+0000","last_peered":"2024-09-13T17:17:52.604732+0000","last_clean":"2024-09-13T17:17:52.604732+0000","last_became_active":"2024-09-13T17:17:52.603221+0000","last_became_peered":"2024-09-13T17:17:52.603221+0000","last_unstale":"2024-09-13T17:17:52.604732+0000","last_undegraded":"2024-09-13T17:17:52.604732+0000","last_fullsized":"2024-09-13T17:17:52.604732+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613978+0000","last_change":"2024-09-13T17:17:52.609331+0000","last_active":"2024-09-13T17:17:52.613978+0000","last_peered":"2024-09-13T17:17:52.613978+0000","last_clean":"2024-09-13T17:17:52.613978+0000","last_became_active":"2024-09-13T17:17:52.609026+0000","last_became_peered":"2024-09-13T17:17:52.609026+0000","last_unstale":"2024-09-13T17:17:52.613978+0000","last_undegraded":"2024-09-13T17:17:52.613978+0000","last_fullsized":"2024-09-13T17:17:52.613978+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613764+0000","last_change":"2024-09-13T17:17:52.606270+0000","last_active":"2024-09-13T17:17:52.613764+0000","last_peered":"2024-09-13T17:17:52.613764+0000","last_clean":"2024-09-13T17:17:52.613764+0000","last_became_active":"2024-09-13T17:17:52.606011+0000","last_became_peered":"2024-09-13T17:17:52.606011+0000","last_unstale":"2024-09-13T17:17:52.613764+0000","last_undegraded":"2024-09-13T17:17:52.613764+0000","last_fullsized":"2024-09-13T17:17:52.613764+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:16.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613293+0000","last_change":"2024-09-13T17:17:52.607271+0000","last_active":"2024-09-13T17:17:52.613293+0000","last_peered":"2024-09-13T17:17:52.613293+0000","last_clean":"2024-09-13T17:17:52.613293+0000","last_became_active":"2024-09-13T17:17:52.606948+0000","last_became_peered":"2024-09-13T17:17:52.606948+0000","last_unstale":"2024-09-13T17:17:52.613293+0000","last_undegraded":"2024-09-13T17:17:52.613293+0000","last_fullsized":"2024-09-13T17:17:52.613293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:25.356622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.609214+0000","last_change":"2024-09-13T17:17:52.604513+0000","last_active":"2024-09-13T17:17:52.609214+0000","last_peered":"2024-09-13T17:17:52.609214+0000","last_clean":"2024-09-13T17:17:52.609214+0000","last_became_active":"2024-09-13T17:17:52.604257+0000","last_became_peered":"2024-09-13T17:17:52.604257+0000","last_unstale":"2024-09-13T17:17:52.609214+0000","last_undegraded":"2024-09-13T17:17:52.609214+0000","last_fullsized":"2024-09-13T17:17:52.609214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:56.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.610020+0000","last_change":"2024-09-13T17:17:52.608943+0000","last_active":"2024-09-13T17:17:52.610020+0000","last_peered":"2024-09-13T17:17:52.610020+0000","last_clean":"2024-09-13T17:17:52.610020+0000","last_became_active":"2024-09-13T17:17:52.608655+0000","last_became_peered":"2024-09-13T17:17:52.608655+0000","last_unstale":"2024-09-13T17:17:52.610020+0000","last_undegraded":"2024-09-13T17:17:52.610020+0000","last_fullsized":"2024-09-13T17:17:52.610020+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612144+0000","last_change":"2024-09-13T17:17:52.605063+0000","last_active":"2024-09-13T17:17:52.612144+0000","last_peered":"2024-09-13T17:17:52.612144+0000","last_clean":"2024-09-13T17:17:52.612144+0000","last_became_active":"2024-09-13T17:17:52.604758+0000","last_became_peered":"2024-09-13T17:17:52.604758+0000","last_unstale":"2024-09-13T17:17:52.612144+0000","last_undegraded":"2024-09-13T17:17:52.612144+0000","last_fullsized":"2024-09-13T17:17:52.612144+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612755+0000","last_change":"2024-09-13T17:17:52.610543+0000","last_active":"2024-09-13T17:17:52.612755+0000","last_peered":"2024-09-13T17:17:52.612755+0000","last_clean":"2024-09-13T17:17:52.612755+0000","last_became_active":"2024-09-13T17:17:52.610295+0000","last_became_peered":"2024-09-13T17:17:52.610295+0000","last_unstale":"2024-09-13T17:17:52.612755+0000","last_undegraded":"2024-09-13T17:17:52.612755+0000","last_fullsized":"2024-09-13T17:17:52.612755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:09.335585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604713+0000","last_change":"2024-09-13T17:17:52.602472+0000","last_active":"2024-09-13T17:17:52.604713+0000","last_peered":"2024-09-13T17:17:52.604713+0000","last_clean":"2024-09-13T17:17:52.604713+0000","last_became_active":"2024-09-13T17:17:52.602197+0000","last_became_peered":"2024-09-13T17:17:52.602197+0000","last_unstale":"2024-09-13T17:17:52.604713+0000","last_undegraded":"2024-09-13T17:17:52.604713+0000","last_fullsized":"2024-09-13T17:17:52.604713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:24.880110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613687+0000","last_change":"2024-09-13T17:17:52.610851+0000","last_active":"2024-09-13T17:17:52.613687+0000","last_peered":"2024-09-13T17:17:52.613687+0000","last_clean":"2024-09-13T17:17:52.613687+0000","last_became_active":"2024-09-13T17:17:52.610585+0000","last_became_peered":"2024-09-13T17:17:52.610585+0000","last_unstale":"2024-09-13T17:17:52.613687+0000","last_undegraded":"2024-09-13T17:17:52.613687+0000","last_fullsized":"2024-09-13T17:17:52.613687+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:57.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605886+0000","last_change":"2024-09-13T17:17:52.602227+0000","last_active":"2024-09-13T17:17:52.605886+0000","last_peered":"2024-09-13T17:17:52.605886+0000","last_clean":"2024-09-13T17:17:52.605886+0000","last_became_active":"2024-09-13T17:17:52.601808+0000","last_became_peered":"2024-09-13T17:17:52.601808+0000","last_unstale":"2024-09-13T17:17:52.605886+0000","last_undegraded":"2024-09-13T17:17:52.605886+0000","last_fullsized":"2024-09-13T17:17:52.605886+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.608494+0000","last_change":"2024-09-13T17:17:52.607224+0000","last_active":"2024-09-13T17:17:52.608494+0000","last_peered":"2024-09-13T17:17:52.608494+0000","last_clean":"2024-09-13T17:17:52.608494+0000","last_became_active":"2024-09-13T17:17:52.606944+0000","last_became_peered":"2024-09-13T17:17:52.606944+0000","last_unstale":"2024-09-13T17:17:52.608494+0000","last_undegraded":"2024-09-13T17:17:52.608494+0000","last_fullsized":"2024-09-13T17:17:52.608494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:48.368029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.597697+0000","last_change":"2024-09-13T17:17:52.594729+0000","last_active":"2024-09-13T17:17:52.597697+0000","last_peered":"2024-09-13T17:17:52.597697+0000","last_clean":"2024-09-13T17:17:52.597697+0000","last_became_active":"2024-09-13T17:17:52.594476+0000","last_became_peered":"2024-09-13T17:17:52.594476+0000","last_unstale":"2024-09-13T17:17:52.597697+0000","last_undegraded":"2024-09-13T17:17:52.597697+0000","last_fullsized":"2024-09-13T17:17:52.597697+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:20.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611215+0000","last_change":"2024-09-13T17:17:52.605741+0000","last_active":"2024-09-13T17:17:52.611215+0000","last_peered":"2024-09-13T17:17:52.611215+0000","last_clean":"2024-09-13T17:17:52.611215+0000","last_became_active":"2024-09-13T17:17:52.605481+0000","last_became_peered":"2024-09-13T17:17:52.605481+0000","last_unstale":"2024-09-13T17:17:52.611215+0000","last_undegraded":"2024-09-13T17:17:52.611215+0000","last_fullsized":"2024-09-13T17:17:52.611215+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:05.004475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612308+0000","last_change":"2024-09-13T17:17:52.242530+0000","last_active":"2024-09-13T17:17:52.612308+0000","last_peered":"2024-09-13T17:17:52.612308+0000","last_clean":"2024-09-13T17:17:52.612308+0000","last_became_active":"2024-09-13T17:17:52.242237+0000","last_became_peered":"2024-09-13T17:17:52.242237+0000","last_unstale":"2024-09-13T17:17:52.612308+0000","last_undegraded":"2024-09-13T17:17:52.612308+0000","last_fullsized":"2024-09-13T17:17:52.612308+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605338+0000","last_change":"2024-09-13T17:17:52.600315+0000","last_active":"2024-09-13T17:17:52.605338+0000","last_peered":"2024-09-13T17:17:52.605338+0000","last_clean":"2024-09-13T17:17:52.605338+0000","last_became_active":"2024-09-13T17:17:52.600083+0000","last_became_peered":"2024-09-13T17:17:52.600083+0000","last_unstale":"2024-09-13T17:17:52.605338+0000","last_undegraded":"2024-09-13T17:17:52.605338+0000","last_fullsized":"2024-09-13T17:17:52.605338+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:43.185413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612875+0000","last_change":"2024-09-13T17:17:52.234111+0000","last_active":"2024-09-13T17:17:52.612875+0000","last_peered":"2024-09-13T17:17:52.612875+0000","last_clean":"2024-09-13T17:17:52.612875+0000","last_became_active":"2024-09-13T17:17:52.233852+0000","last_became_peered":"2024-09-13T17:17:52.233852+0000","last_unstale":"2024-09-13T17:17:52.612875+0000","last_undegraded":"2024-09-13T17:17:52.612875+0000","last_fullsized":"2024-09-13T17:17:52.612875+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:43.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.609751+0000","last_change":"2024-09-13T17:17:52.604833+0000","last_active":"2024-09-13T17:17:52.609751+0000","last_peered":"2024-09-13T17:17:52.609751+0000","last_clean":"2024-09-13T17:17:52.609751+0000","last_became_active":"2024-09-13T17:17:52.604500+0000","last_became_peered":"2024-09-13T17:17:52.604500+0000","last_unstale":"2024-09-13T17:17:52.609751+0000","last_undegraded":"2024-09-13T17:17:52.609751+0000","last_fullsized":"2024-09-13T17:17:52.609751+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:29.654715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605416+0000","last_change":"2024-09-13T17:17:52.234877+0000","last_active":"2024-09-13T17:17:52.605416+0000","last_peered":"2024-09-13T17:17:52.605416+0000","last_clean":"2024-09-13T17:17:52.605416+0000","last_became_active":"2024-09-13T17:17:52.234605+0000","last_became_peered":"2024-09-13T17:17:52.234605+0000","last_unstale":"2024-09-13T17:17:52.605416+0000","last_undegraded":"2024-09-13T17:17:52.605416+0000","last_fullsized":"2024-09-13T17:17:52.605416+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:36.404134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.603373+0000","last_change":"2024-09-13T17:17:52.598381+0000","last_active":"2024-09-13T17:17:52.603373+0000","last_peered":"2024-09-13T17:17:52.603373+0000","last_clean":"2024-09-13T17:17:52.603373+0000","last_became_active":"2024-09-13T17:17:52.598028+0000","last_became_peered":"2024-09-13T17:17:52.598028+0000","last_unstale":"2024-09-13T17:17:52.603373+0000","last_undegraded":"2024-09-13T17:17:52.603373+0000","last_fullsized":"2024-09-13T17:17:52.603373+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:12.638802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.607100+0000","last_change":"2024-09-13T17:17:52.233058+0000","last_active":"2024-09-13T17:17:52.607100+0000","last_peered":"2024-09-13T17:17:52.607100+0000","last_clean":"2024-09-13T17:17:52.607100+0000","last_became_active":"2024-09-13T17:17:52.232674+0000","last_became_peered":"2024-09-13T17:17:52.232674+0000","last_unstale":"2024-09-13T17:17:52.607100+0000","last_undegraded":"2024-09-13T17:17:52.607100+0000","last_fullsized":"2024-09-13T17:17:52.607100+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.610469+0000","last_change":"2024-09-13T17:17:52.604236+0000","last_active":"2024-09-13T17:17:52.610469+0000","last_peered":"2024-09-13T17:17:52.610469+0000","last_clean":"2024-09-13T17:17:52.610469+0000","last_became_active":"2024-09-13T17:17:52.603979+0000","last_became_peered":"2024-09-13T17:17:52.603979+0000","last_unstale":"2024-09-13T17:17:52.610469+0000","last_undegraded":"2024-09-13T17:17:52.610469+0000","last_fullsized":"2024-09-13T17:17:52.610469+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.603590+0000","last_change":"2024-09-13T17:17:52.232698+0000","last_active":"2024-09-13T17:17:52.603590+0000","last_peered":"2024-09-13T17:17:52.603590+0000","last_clean":"2024-09-13T17:17:52.603590+0000","last_became_active":"2024-09-13T17:17:52.232413+0000","last_became_peered":"2024-09-13T17:17:52.232413+0000","last_unstale":"2024-09-13T17:17:52.603590+0000","last_undegraded":"2024-09-13T17:17:52.603590+0000","last_fullsized":"2024-09-13T17:17:52.603590+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:38.015314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612389+0000","last_change":"2024-09-13T17:17:52.598960+0000","last_active":"2024-09-13T17:17:52.612389+0000","last_peered":"2024-09-13T17:17:52.612389+0000","last_clean":"2024-09-13T17:17:52.612389+0000","last_became_active":"2024-09-13T17:17:52.598608+0000","last_became_peered":"2024-09-13T17:17:52.598608+0000","last_unstale":"2024-09-13T17:17:52.612389+0000","last_undegraded":"2024-09-13T17:17:52.612389+0000","last_fullsized":"2024-09-13T17:17:52.612389+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611156+0000","last_change":"2024-09-13T17:17:52.234541+0000","last_active":"2024-09-13T17:17:52.611156+0000","last_peered":"2024-09-13T17:17:52.611156+0000","last_clean":"2024-09-13T17:17:52.611156+0000","last_became_active":"2024-09-13T17:17:52.234284+0000","last_became_peered":"2024-09-13T17:17:52.234284+0000","last_unstale":"2024-09-13T17:17:52.611156+0000","last_undegraded":"2024-09-13T17:17:52.611156+0000","last_fullsized":"2024-09-13T17:17:52.611156+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.600791+0000","last_change":"2024-09-13T17:17:52.597731+0000","last_active":"2024-09-13T17:17:52.600791+0000","last_peered":"2024-09-13T17:17:52.600791+0000","last_clean":"2024-09-13T17:17:52.600791+0000","last_became_active":"2024-09-13T17:17:52.597449+0000","last_became_peered":"2024-09-13T17:17:52.597449+0000","last_unstale":"2024-09-13T17:17:52.600791+0000","last_undegraded":"2024-09-13T17:17:52.600791+0000","last_fullsized":"2024-09-13T17:17:52.600791+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:31.842033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.590791+0000","last_change":"2024-09-13T17:17:52.234865+0000","last_active":"2024-09-13T17:17:52.590791+0000","last_peered":"2024-09-13T17:17:52.590791+0000","last_clean":"2024-09-13T17:17:52.590791+0000","last_became_active":"2024-09-13T17:17:52.234561+0000","last_became_peered":"2024-09-13T17:17:52.234561+0000","last_unstale":"2024-09-13T17:17:52.590791+0000","last_undegraded":"2024-09-13T17:17:52.590791+0000","last_fullsized":"2024-09-13T17:17:52.590791+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:10.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.603707+0000","last_change":"2024-09-13T17:17:52.601972+0000","last_active":"2024-09-13T17:17:52.603707+0000","last_peered":"2024-09-13T17:17:52.603707+0000","last_clean":"2024-09-13T17:17:52.603707+0000","last_became_active":"2024-09-13T17:17:52.601684+0000","last_became_peered":"2024-09-13T17:17:52.601684+0000","last_unstale":"2024-09-13T17:17:52.603707+0000","last_undegraded":"2024-09-13T17:17:52.603707+0000","last_fullsized":"2024-09-13T17:17:52.603707+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:07.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604566+0000","last_change":"2024-09-13T17:17:52.241484+0000","last_active":"2024-09-13T17:17:52.604566+0000","last_peered":"2024-09-13T17:17:52.604566+0000","last_clean":"2024-09-13T17:17:52.604566+0000","last_became_active":"2024-09-13T17:17:52.241306+0000","last_became_peered":"2024-09-13T17:17:52.241306+0000","last_unstale":"2024-09-13T17:17:52.604566+0000","last_undegraded":"2024-09-13T17:17:52.604566+0000","last_fullsized":"2024-09-13T17:17:52.604566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:09.998148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605935+0000","last_change":"2024-09-13T17:17:52.600979+0000","last_active":"2024-09-13T17:17:52.605935+0000","last_peered":"2024-09-13T17:17:52.605935+0000","last_clean":"2024-09-13T17:17:52.605935+0000","last_became_active":"2024-09-13T17:17:52.600639+0000","last_became_peered":"2024-09-13T17:17:52.600639+0000","last_unstale":"2024-09-13T17:17:52.605935+0000","last_undegraded":"2024-09-13T17:17:52.605935+0000","last_fullsized":"2024-09-13T17:17:52.605935+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:38.916070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.591116+0000","last_change":"2024-09-13T17:17:52.231485+0000","last_active":"2024-09-13T17:17:52.591116+0000","last_peered":"2024-09-13T17:17:52.591116+0000","last_clean":"2024-09-13T17:17:52.591116+0000","last_became_active":"2024-09-13T17:17:52.231207+0000","last_became_peered":"2024-09-13T17:17:52.231207+0000","last_unstale":"2024-09-13T17:17:52.591116+0000","last_undegraded":"2024-09-13T17:17:52.591116+0000","last_fullsized":"2024-09-13T17:17:52.591116+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613712+0000","last_change":"2024-09-13T17:17:52.611070+0000","last_active":"2024-09-13T17:17:52.613712+0000","last_peered":"2024-09-13T17:17:52.613712+0000","last_clean":"2024-09-13T17:17:52.613712+0000","last_became_active":"2024-09-13T17:17:52.610787+0000","last_became_peered":"2024-09-13T17:17:52.610787+0000","last_unstale":"2024-09-13T17:17:52.613712+0000","last_undegraded":"2024-09-13T17:17:52.613712+0000","last_fullsized":"2024-09-13T17:17:52.613712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.589982+0000","last_change":"2024-09-13T17:17:52.232671+0000","last_active":"2024-09-13T17:17:52.589982+0000","last_peered":"2024-09-13T17:17:52.589982+0000","last_clean":"2024-09-13T17:17:52.589982+0000","last_became_active":"2024-09-13T17:17:52.232353+0000","last_became_peered":"2024-09-13T17:17:52.232353+0000","last_unstale":"2024-09-13T17:17:52.589982+0000","last_undegraded":"2024-09-13T17:17:52.589982+0000","last_fullsized":"2024-09-13T17:17:52.589982+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605741+0000","last_change":"2024-09-13T17:17:52.599125+0000","last_active":"2024-09-13T17:17:52.605741+0000","last_peered":"2024-09-13T17:17:52.605741+0000","last_clean":"2024-09-13T17:17:52.605741+0000","last_became_active":"2024-09-13T17:17:52.598875+0000","last_became_peered":"2024-09-13T17:17:52.598875+0000","last_unstale":"2024-09-13T17:17:52.605741+0000","last_undegraded":"2024-09-13T17:17:52.605741+0000","last_fullsized":"2024-09-13T17:17:52.605741+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:14.507713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611865+0000","last_change":"2024-09-13T17:17:52.236765+0000","last_active":"2024-09-13T17:17:52.611865+0000","last_peered":"2024-09-13T17:17:52.611865+0000","last_clean":"2024-09-13T17:17:52.611865+0000","last_became_active":"2024-09-13T17:17:52.236448+0000","last_became_peered":"2024-09-13T17:17:52.236448+0000","last_unstale":"2024-09-13T17:17:52.611865+0000","last_undegraded":"2024-09-13T17:17:52.611865+0000","last_fullsized":"2024-09-13T17:17:52.611865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:21.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.610439+0000","last_change":"2024-09-13T17:17:52.605372+0000","last_active":"2024-09-13T17:17:52.610439+0000","last_peered":"2024-09-13T17:17:52.610439+0000","last_clean":"2024-09-13T17:17:52.610439+0000","last_became_active":"2024-09-13T17:17:52.605106+0000","last_became_peered":"2024-09-13T17:17:52.605106+0000","last_unstale":"2024-09-13T17:17:52.610439+0000","last_undegraded":"2024-09-13T17:17:52.610439+0000","last_fullsized":"2024-09-13T17:17:52.610439+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:59.056708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.615760+0000","last_change":"2024-09-13T17:17:52.241241+0000","last_active":"2024-09-13T17:17:52.615760+0000","last_peered":"2024-09-13T17:17:52.615760+0000","last_clean":"2024-09-13T17:17:52.615760+0000","last_became_active":"2024-09-13T17:17:52.240969+0000","last_became_peered":"2024-09-13T17:17:52.240969+0000","last_unstale":"2024-09-13T17:17:52.615760+0000","last_undegraded":"2024-09-13T17:17:52.615760+0000","last_fullsized":"2024-09-13T17:17:52.615760+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:20.654650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613969+0000","last_change":"2024-09-13T17:17:52.612674+0000","last_active":"2024-09-13T17:17:52.613969+0000","last_peered":"2024-09-13T17:17:52.613969+0000","last_clean":"2024-09-13T17:17:52.613969+0000","last_became_active":"2024-09-13T17:17:52.612341+0000","last_became_peered":"2024-09-13T17:17:52.612341+0000","last_unstale":"2024-09-13T17:17:52.613969+0000","last_undegraded":"2024-09-13T17:17:52.613969+0000","last_fullsized":"2024-09-13T17:17:52.613969+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:51.683231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612772+0000","last_change":"2024-09-13T17:17:52.241975+0000","last_active":"2024-09-13T17:17:52.612772+0000","last_peered":"2024-09-13T17:17:52.612772+0000","last_clean":"2024-09-13T17:17:52.612772+0000","last_became_active":"2024-09-13T17:17:52.241737+0000","last_became_peered":"2024-09-13T17:17:52.241737+0000","last_unstale":"2024-09-13T17:17:52.612772+0000","last_undegraded":"2024-09-13T17:17:52.612772+0000","last_fullsized":"2024-09-13T17:17:52.612772+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:48.511892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613994+0000","last_change":"2024-09-13T17:17:52.608982+0000","last_active":"2024-09-13T17:17:52.613994+0000","last_peered":"2024-09-13T17:17:52.613994+0000","last_clean":"2024-09-13T17:17:52.613994+0000","last_became_active":"2024-09-13T17:17:52.608576+0000","last_became_peered":"2024-09-13T17:17:52.608576+0000","last_unstale":"2024-09-13T17:17:52.613994+0000","last_undegraded":"2024-09-13T17:17:52.613994+0000","last_fullsized":"2024-09-13T17:17:52.613994+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:53.034445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.585408+0000","last_change":"2024-09-13T17:17:52.235364+0000","last_active":"2024-09-13T17:17:52.585408+0000","last_peered":"2024-09-13T17:17:52.585408+0000","last_clean":"2024-09-13T17:17:52.585408+0000","last_became_active":"2024-09-13T17:17:52.233817+0000","last_became_peered":"2024-09-13T17:17:52.233817+0000","last_unstale":"2024-09-13T17:17:52.585408+0000","last_undegraded":"2024-09-13T17:17:52.585408+0000","last_fullsized":"2024-09-13T17:17:52.585408+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:03.690380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.608627+0000","last_change":"2024-09-13T17:17:52.606772+0000","last_active":"2024-09-13T17:17:52.608627+0000","last_peered":"2024-09-13T17:17:52.608627+0000","last_clean":"2024-09-13T17:17:52.608627+0000","last_became_active":"2024-09-13T17:17:52.606216+0000","last_became_peered":"2024-09-13T17:17:52.606216+0000","last_unstale":"2024-09-13T17:17:52.608627+0000","last_undegraded":"2024-09-13T17:17:52.608627+0000","last_fullsized":"2024-09-13T17:17:52.608627+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:04.812771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.589840+0000","last_change":"2024-09-13T17:17:52.239219+0000","last_active":"2024-09-13T17:17:52.589840+0000","last_peered":"2024-09-13T17:17:52.589840+0000","last_clean":"2024-09-13T17:17:52.589840+0000","last_became_active":"2024-09-13T17:17:52.238911+0000","last_became_peered":"2024-09-13T17:17:52.238911+0000","last_unstale":"2024-09-13T17:17:52.589840+0000","last_undegraded":"2024-09-13T17:17:52.589840+0000","last_fullsized":"2024-09-13T17:17:52.589840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.606922+0000","last_change":"2024-09-13T17:17:52.605947+0000","last_active":"2024-09-13T17:17:52.606922+0000","last_peered":"2024-09-13T17:17:52.606922+0000","last_clean":"2024-09-13T17:17:52.606922+0000","last_became_active":"2024-09-13T17:17:52.605687+0000","last_became_peered":"2024-09-13T17:17:52.605687+0000","last_unstale":"2024-09-13T17:17:52.606922+0000","last_undegraded":"2024-09-13T17:17:52.606922+0000","last_fullsized":"2024-09-13T17:17:52.606922+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:39.136913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613411+0000","last_change":"2024-09-13T17:17:52.234905+0000","last_active":"2024-09-13T17:17:52.613411+0000","last_peered":"2024-09-13T17:17:52.613411+0000","last_clean":"2024-09-13T17:17:52.613411+0000","last_became_active":"2024-09-13T17:17:52.234585+0000","last_became_peered":"2024-09-13T17:17:52.234585+0000","last_unstale":"2024-09-13T17:17:52.613411+0000","last_undegraded":"2024-09-13T17:17:52.613411+0000","last_fullsized":"2024-09-13T17:17:52.613411+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:43.209931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611196+0000","last_change":"2024-09-13T17:17:52.605715+0000","last_active":"2024-09-13T17:17:52.611196+0000","last_peered":"2024-09-13T17:17:52.611196+0000","last_clean":"2024-09-13T17:17:52.611196+0000","last_became_active":"2024-09-13T17:17:52.605444+0000","last_became_peered":"2024-09-13T17:17:52.605444+0000","last_unstale":"2024-09-13T17:17:52.611196+0000","last_undegraded":"2024-09-13T17:17:52.611196+0000","last_fullsized":"2024-09-13T17:17:52.611196+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:29.759930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.608068+0000","last_change":"2024-09-13T17:17:52.235049+0000","last_active":"2024-09-13T17:17:52.608068+0000","last_peered":"2024-09-13T17:17:52.608068+0000","last_clean":"2024-09-13T17:17:52.608068+0000","last_became_active":"2024-09-13T17:17:52.234785+0000","last_became_peered":"2024-09-13T17:17:52.234785+0000","last_unstale":"2024-09-13T17:17:52.608068+0000","last_undegraded":"2024-09-13T17:17:52.608068+0000","last_fullsized":"2024-09-13T17:17:52.608068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:25.921038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613286+0000","last_change":"2024-09-13T17:17:52.608484+0000","last_active":"2024-09-13T17:17:52.613286+0000","last_peered":"2024-09-13T17:17:52.613286+0000","last_clean":"2024-09-13T17:17:52.613286+0000","last_became_active":"2024-09-13T17:17:52.607783+0000","last_became_peered":"2024-09-13T17:17:52.607783+0000","last_unstale":"2024-09-13T17:17:52.613286+0000","last_undegraded":"2024-09-13T17:17:52.613286+0000","last_fullsized":"2024-09-13T17:17:52.613286+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:04.962686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.606132+0000","last_change":"2024-09-13T17:17:52.233704+0000","last_active":"2024-09-13T17:17:52.606132+0000","last_peered":"2024-09-13T17:17:52.606132+0000","last_clean":"2024-09-13T17:17:52.606132+0000","last_became_active":"2024-09-13T17:17:52.233427+0000","last_became_peered":"2024-09-13T17:17:52.233427+0000","last_unstale":"2024-09-13T17:17:52.606132+0000","last_undegraded":"2024-09-13T17:17:52.606132+0000","last_fullsized":"2024-09-13T17:17:52.606132+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:24.347887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612120+0000","last_change":"2024-09-13T17:17:52.603521+0000","last_active":"2024-09-13T17:17:52.612120+0000","last_peered":"2024-09-13T17:17:52.612120+0000","last_clean":"2024-09-13T17:17:52.612120+0000","last_became_active":"2024-09-13T17:17:52.603215+0000","last_became_peered":"2024-09-13T17:17:52.603215+0000","last_unstale":"2024-09-13T17:17:52.612120+0000","last_undegraded":"2024-09-13T17:17:52.612120+0000","last_fullsized":"2024-09-13T17:17:52.612120+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.609192+0000","last_change":"2024-09-13T17:17:52.233308+0000","last_active":"2024-09-13T17:17:52.609192+0000","last_peered":"2024-09-13T17:17:52.609192+0000","last_clean":"2024-09-13T17:17:52.609192+0000","last_became_active":"2024-09-13T17:17:52.233057+0000","last_became_peered":"2024-09-13T17:17:52.233057+0000","last_unstale":"2024-09-13T17:17:52.609192+0000","last_undegraded":"2024-09-13T17:17:52.609192+0000","last_fullsized":"2024-09-13T17:17:52.609192+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:52.681260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.602231+0000","last_change":"2024-09-13T17:17:52.598929+0000","last_active":"2024-09-13T17:17:52.602231+0000","last_peered":"2024-09-13T17:17:52.602231+0000","last_clean":"2024-09-13T17:17:52.602231+0000","last_became_active":"2024-09-13T17:17:52.598328+0000","last_became_peered":"2024-09-13T17:17:52.598328+0000","last_unstale":"2024-09-13T17:17:52.602231+0000","last_undegraded":"2024-09-13T17:17:52.602231+0000","last_fullsized":"2024-09-13T17:17:52.602231+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:11.535791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604362+0000","last_change":"2024-09-13T17:17:52.226255+0000","last_active":"2024-09-13T17:17:52.604362+0000","last_peered":"2024-09-13T17:17:52.604362+0000","last_clean":"2024-09-13T17:17:52.604362+0000","last_became_active":"2024-09-13T17:17:52.225926+0000","last_became_peered":"2024-09-13T17:17:52.225926+0000","last_unstale":"2024-09-13T17:17:52.604362+0000","last_undegraded":"2024-09-13T17:17:52.604362+0000","last_fullsized":"2024-09-13T17:17:52.604362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:09.325792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604528+0000","last_change":"2024-09-13T17:17:52.597322+0000","last_active":"2024-09-13T17:17:52.604528+0000","last_peered":"2024-09-13T17:17:52.604528+0000","last_clean":"2024-09-13T17:17:52.604528+0000","last_became_active":"2024-09-13T17:17:52.596996+0000","last_became_peered":"2024-09-13T17:17:52.596996+0000","last_unstale":"2024-09-13T17:17:52.604528+0000","last_undegraded":"2024-09-13T17:17:52.604528+0000","last_fullsized":"2024-09-13T17:17:52.604528+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:11.006883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.589130+0000","last_change":"2024-09-13T17:17:52.236308+0000","last_active":"2024-09-13T17:17:52.589130+0000","last_peered":"2024-09-13T17:17:52.589130+0000","last_clean":"2024-09-13T17:17:52.589130+0000","last_became_active":"2024-09-13T17:17:52.236019+0000","last_became_peered":"2024-09-13T17:17:52.236019+0000","last_unstale":"2024-09-13T17:17:52.589130+0000","last_undegraded":"2024-09-13T17:17:52.589130+0000","last_fullsized":"2024-09-13T17:17:52.589130+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:00.298944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.607387+0000","last_change":"2024-09-13T17:17:52.605634+0000","last_active":"2024-09-13T17:17:52.607387+0000","last_peered":"2024-09-13T17:17:52.607387+0000","last_clean":"2024-09-13T17:17:52.607387+0000","last_became_active":"2024-09-13T17:17:52.605364+0000","last_became_peered":"2024-09-13T17:17:52.605364+0000","last_unstale":"2024-09-13T17:17:52.607387+0000","last_undegraded":"2024-09-13T17:17:52.607387+0000","last_fullsized":"2024-09-13T17:17:52.607387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:49.520627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.591431+0000","last_change":"2024-09-13T17:17:52.239876+0000","last_active":"2024-09-13T17:17:52.591431+0000","last_peered":"2024-09-13T17:17:52.591431+0000","last_clean":"2024-09-13T17:17:52.591431+0000","last_became_active":"2024-09-13T17:17:52.239592+0000","last_became_peered":"2024-09-13T17:17:52.239592+0000","last_unstale":"2024-09-13T17:17:52.591431+0000","last_undegraded":"2024-09-13T17:17:52.591431+0000","last_fullsized":"2024-09-13T17:17:52.591431+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:25.304560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.602301+0000","last_change":"2024-09-13T17:17:52.599738+0000","last_active":"2024-09-13T17:17:52.602301+0000","last_peered":"2024-09-13T17:17:52.602301+0000","last_clean":"2024-09-13T17:17:52.602301+0000","last_became_active":"2024-09-13T17:17:52.599501+0000","last_became_peered":"2024-09-13T17:17:52.599501+0000","last_unstale":"2024-09-13T17:17:52.602301+0000","last_undegraded":"2024-09-13T17:17:52.602301+0000","last_fullsized":"2024-09-13T17:17:52.602301+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:34.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.588980+0000","last_change":"2024-09-13T17:17:52.238644+0000","last_active":"2024-09-13T17:17:52.588980+0000","last_peered":"2024-09-13T17:17:52.588980+0000","last_clean":"2024-09-13T17:17:52.588980+0000","last_became_active":"2024-09-13T17:17:52.238325+0000","last_became_peered":"2024-09-13T17:17:52.238325+0000","last_unstale":"2024-09-13T17:17:52.588980+0000","last_undegraded":"2024-09-13T17:17:52.588980+0000","last_fullsized":"2024-09-13T17:17:52.588980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:02.311277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613323+0000","last_change":"2024-09-13T17:17:52.607431+0000","last_active":"2024-09-13T17:17:52.613323+0000","last_peered":"2024-09-13T17:17:52.613323+0000","last_clean":"2024-09-13T17:17:52.613323+0000","last_became_active":"2024-09-13T17:17:52.607124+0000","last_became_peered":"2024-09-13T17:17:52.607124+0000","last_unstale":"2024-09-13T17:17:52.613323+0000","last_undegraded":"2024-09-13T17:17:52.613323+0000","last_fullsized":"2024-09-13T17:17:52.613323+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:18.670431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612916+0000","last_change":"2024-09-13T17:17:52.233210+0000","last_active":"2024-09-13T17:17:52.612916+0000","last_peered":"2024-09-13T17:17:52.612916+0000","last_clean":"2024-09-13T17:17:52.612916+0000","last_became_active":"2024-09-13T17:17:52.232940+0000","last_became_peered":"2024-09-13T17:17:52.232940+0000","last_unstale":"2024-09-13T17:17:52.612916+0000","last_undegraded":"2024-09-13T17:17:52.612916+0000","last_fullsized":"2024-09-13T17:17:52.612916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:58.047973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611404+0000","last_change":"2024-09-13T17:17:52.610315+0000","last_active":"2024-09-13T17:17:52.611404+0000","last_peered":"2024-09-13T17:17:52.611404+0000","last_clean":"2024-09-13T17:17:52.611404+0000","last_became_active":"2024-09-13T17:17:52.610046+0000","last_became_peered":"2024-09-13T17:17:52.610046+0000","last_unstale":"2024-09-13T17:17:52.611404+0000","last_undegraded":"2024-09-13T17:17:52.611404+0000","last_fullsized":"2024-09-13T17:17:52.611404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:38.688726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.597884+0000","last_change":"2024-09-13T17:17:52.233412+0000","last_active":"2024-09-13T17:17:52.597884+0000","last_peered":"2024-09-13T17:17:52.597884+0000","last_clean":"2024-09-13T17:17:52.597884+0000","last_became_active":"2024-09-13T17:17:52.233154+0000","last_became_peered":"2024-09-13T17:17:52.233154+0000","last_unstale":"2024-09-13T17:17:52.597884+0000","last_undegraded":"2024-09-13T17:17:52.597884+0000","last_fullsized":"2024-09-13T17:17:52.597884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:17.024663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.605836+0000","last_change":"2024-09-13T17:17:52.600921+0000","last_active":"2024-09-13T17:17:52.605836+0000","last_peered":"2024-09-13T17:17:52.605836+0000","last_clean":"2024-09-13T17:17:52.605836+0000","last_became_active":"2024-09-13T17:17:52.600669+0000","last_became_peered":"2024-09-13T17:17:52.600669+0000","last_unstale":"2024-09-13T17:17:52.605836+0000","last_undegraded":"2024-09-13T17:17:52.605836+0000","last_fullsized":"2024-09-13T17:17:52.605836+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:05.740674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.599228+0000","last_change":"2024-09-13T17:17:52.236227+0000","last_active":"2024-09-13T17:17:52.599228+0000","last_peered":"2024-09-13T17:17:52.599228+0000","last_clean":"2024-09-13T17:17:52.599228+0000","last_became_active":"2024-09-13T17:17:52.235979+0000","last_became_peered":"2024-09-13T17:17:52.235979+0000","last_unstale":"2024-09-13T17:17:52.599228+0000","last_undegraded":"2024-09-13T17:17:52.599228+0000","last_fullsized":"2024-09-13T17:17:52.599228+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:41.421504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604764+0000","last_change":"2024-09-13T17:17:52.602630+0000","last_active":"2024-09-13T17:17:52.604764+0000","last_peered":"2024-09-13T17:17:52.604764+0000","last_clean":"2024-09-13T17:17:52.604764+0000","last_became_active":"2024-09-13T17:17:52.602374+0000","last_became_peered":"2024-09-13T17:17:52.602374+0000","last_unstale":"2024-09-13T17:17:52.604764+0000","last_undegraded":"2024-09-13T17:17:52.604764+0000","last_fullsized":"2024-09-13T17:17:52.604764+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:57.820935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.593430+0000","last_change":"2024-09-13T17:17:52.232971+0000","last_active":"2024-09-13T17:17:52.593430+0000","last_peered":"2024-09-13T17:17:52.593430+0000","last_clean":"2024-09-13T17:17:52.593430+0000","last_became_active":"2024-09-13T17:17:52.232691+0000","last_became_peered":"2024-09-13T17:17:52.232691+0000","last_unstale":"2024-09-13T17:17:52.593430+0000","last_undegraded":"2024-09-13T17:17:52.593430+0000","last_fullsized":"2024-09-13T17:17:52.593430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.599852+0000","last_change":"2024-09-13T17:17:52.593210+0000","last_active":"2024-09-13T17:17:52.599852+0000","last_peered":"2024-09-13T17:17:52.599852+0000","last_clean":"2024-09-13T17:17:52.599852+0000","last_became_active":"2024-09-13T17:17:52.592965+0000","last_became_peered":"2024-09-13T17:17:52.592965+0000","last_unstale":"2024-09-13T17:17:52.599852+0000","last_undegraded":"2024-09-13T17:17:52.599852+0000","last_fullsized":"2024-09-13T17:17:52.599852+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:45.757883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.586606+0000","last_change":"2024-09-13T17:17:52.232914+0000","last_active":"2024-09-13T17:17:52.586606+0000","last_peered":"2024-09-13T17:17:52.586606+0000","last_clean":"2024-09-13T17:17:52.586606+0000","last_became_active":"2024-09-13T17:17:52.232662+0000","last_became_peered":"2024-09-13T17:17:52.232662+0000","last_unstale":"2024-09-13T17:17:52.586606+0000","last_undegraded":"2024-09-13T17:17:52.586606+0000","last_fullsized":"2024-09-13T17:17:52.586606+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:16.955126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.611487+0000","last_change":"2024-09-13T17:17:52.608068+0000","last_active":"2024-09-13T17:17:52.611487+0000","last_peered":"2024-09-13T17:17:52.611487+0000","last_clean":"2024-09-13T17:17:52.611487+0000","last_became_active":"2024-09-13T17:17:52.607577+0000","last_became_peered":"2024-09-13T17:17:52.607577+0000","last_unstale":"2024-09-13T17:17:52.611487+0000","last_undegraded":"2024-09-13T17:17:52.611487+0000","last_fullsized":"2024-09-13T17:17:52.611487+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.942716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.590357+0000","last_change":"2024-09-13T17:17:52.228592+0000","last_active":"2024-09-13T17:17:52.590357+0000","last_peered":"2024-09-13T17:17:52.590357+0000","last_clean":"2024-09-13T17:17:52.590357+0000","last_became_active":"2024-09-13T17:17:52.228266+0000","last_became_peered":"2024-09-13T17:17:52.228266+0000","last_unstale":"2024-09-13T17:17:52.590357+0000","last_undegraded":"2024-09-13T17:17:52.590357+0000","last_fullsized":"2024-09-13T17:17:52.590357+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.416745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.612489+0000","last_change":"2024-09-13T17:17:52.602989+0000","last_active":"2024-09-13T17:17:52.612489+0000","last_peered":"2024-09-13T17:17:52.612489+0000","last_clean":"2024-09-13T17:17:52.612489+0000","last_became_active":"2024-09-13T17:17:52.602593+0000","last_became_peered":"2024-09-13T17:17:52.602593+0000","last_unstale":"2024-09-13T17:17:52.612489+0000","last_undegraded":"2024-09-13T17:17:52.612489+0000","last_fullsized":"2024-09-13T17:17:52.612489+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:37.412869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.593177+0000","last_change":"2024-09-13T17:17:52.234917+0000","last_active":"2024-09-13T17:17:52.593177+0000","last_peered":"2024-09-13T17:17:52.593177+0000","last_clean":"2024-09-13T17:17:52.593177+0000","last_became_active":"2024-09-13T17:17:52.234638+0000","last_became_peered":"2024-09-13T17:17:52.234638+0000","last_unstale":"2024-09-13T17:17:52.593177+0000","last_undegraded":"2024-09-13T17:17:52.593177+0000","last_fullsized":"2024-09-13T17:17:52.593177+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:38.377663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.602261+0000","last_change":"2024-09-13T17:17:52.599181+0000","last_active":"2024-09-13T17:17:52.602261+0000","last_peered":"2024-09-13T17:17:52.602261+0000","last_clean":"2024-09-13T17:17:52.602261+0000","last_became_active":"2024-09-13T17:17:52.597558+0000","last_became_peered":"2024-09-13T17:17:52.597558+0000","last_unstale":"2024-09-13T17:17:52.602261+0000","last_undegraded":"2024-09-13T17:17:52.602261+0000","last_fullsized":"2024-09-13T17:17:52.602261+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:05.352104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604685+0000","last_change":"2024-09-13T17:17:52.236289+0000","last_active":"2024-09-13T17:17:52.604685+0000","last_peered":"2024-09-13T17:17:52.604685+0000","last_clean":"2024-09-13T17:17:52.604685+0000","last_became_active":"2024-09-13T17:17:52.235980+0000","last_became_peered":"2024-09-13T17:17:52.235980+0000","last_unstale":"2024-09-13T17:17:52.604685+0000","last_undegraded":"2024-09-13T17:17:52.604685+0000","last_fullsized":"2024-09-13T17:17:52.604685+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:17.661696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.613646+0000","last_change":"2024-09-13T17:17:52.610402+0000","last_active":"2024-09-13T17:17:52.613646+0000","last_peered":"2024-09-13T17:17:52.613646+0000","last_clean":"2024-09-13T17:17:52.613646+0000","last_became_active":"2024-09-13T17:17:52.610159+0000","last_became_peered":"2024-09-13T17:17:52.610159+0000","last_unstale":"2024-09-13T17:17:52.613646+0000","last_undegraded":"2024-09-13T17:17:52.613646+0000","last_fullsized":"2024-09-13T17:17:52.613646+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:52.209996+0000","last_clean_scrub_stamp":"2024-09-13T17:17:52.209996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:11.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.594541+0000","last_change":"2024-09-13T17:17:52.234737+0000","last_active":"2024-09-13T17:17:52.594541+0000","last_peered":"2024-09-13T17:17:52.594541+0000","last_clean":"2024-09-13T17:17:52.594541+0000","last_became_active":"2024-09-13T17:17:52.234268+0000","last_became_peered":"2024-09-13T17:17:52.234268+0000","last_unstale":"2024-09-13T17:17:52.594541+0000","last_undegraded":"2024-09-13T17:17:52.594541+0000","last_fullsized":"2024-09-13T17:17:52.594541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:17:51.201261+0000","last_clean_scrub_stamp":"2024-09-13T17:17:51.201261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:21.291155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":231,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:17:52.604785+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:17:52.604785+0000","last_peered":"2024-09-13T17:17:52.604785+0000","last_clean":"2024-09-13T17:17:52.604785+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:17:52.604785+0000","last_undegraded":"2024-09-13T17:17:52.604785+0000","last_fullsized":"2024-09-13T17:17:52.604785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1773568,"data_stored":1124798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.48499999999999999},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52300000000000002,"15min":0.51200000000000001},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.35199999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.35299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67700000000000005,"5min":0.878,"15min":0.878},"last":0.40000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":536542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.249,"15min":0.249},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68999999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.56899999999999995},"min":{"1min":0.40100000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73599999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44}]},{"osd":3,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:17:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1171456,"data_stored":534374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69999999999999996,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.504},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65000000000000002,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.74199999999999999,"5min":1.173,"15min":1.173},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44700000000000001,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68999999999999995,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":1.008,"15min":1.008},"last":0.44700000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71099999999999997,"5min":1.085,"15min":1.085},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.60899999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66500000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1179648,"data_stored":534534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":1.034,"15min":1.034},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66500000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.436,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.438}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.51900000000000002},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.57699999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.53600000000000003,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63900000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.503},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.377,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1171456,"data_stored":534374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34699999999999998,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.437,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35099999999999998,"15min":0.34399999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.502,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.26100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.372,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.41799999999999998,"5min":1.458,"15min":1.458},"last":0.249},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.438},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.55100000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.39700000000000002,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.499,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.31},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41199999999999998,"15min":0.433},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51300000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.46600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58999999999999997,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":1.226,"15min":1.226},"last":0.59699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1171456,"data_stored":534374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.20999999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56699999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.245}]},{"osd":1,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.375,"15min":0.379},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.222,"15min":0.222},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.313},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85799999999999998,"5min":0.871,"15min":0.871},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1175552,"data_stored":534444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51600000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.379,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":1.159,"15min":1.159},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.317},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":1.081,"15min":1.081},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42899999999999999,"15min":0.438},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.625,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":1.286,"15min":1.286},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89000000000000001,"5min":1.254,"15min":1.254},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1789952,"data_stored":1127012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.48399999999999999,"15min":0.41399999999999998},"min":{"1min":0.246,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48599999999999999,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.25900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51900000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.50800000000000001,"15min":0.442},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.379,"15min":0.38},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51800000000000002,"15min":0.434},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59399999999999997,"5min":14.262,"15min":14.262},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.52500000000000002,"15min":0.45100000000000001},"min":{"1min":0.31,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.379}]},{"osd":4,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.41099999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83099999999999996,"5min":3.956,"15min":3.956},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.998,"15min":0.998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81299999999999994,"5min":4.069,"15min":4.069},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.626,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":4.04,"15min":4.04},"last":0.499},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.48199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.748,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.626},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.879,"15min":0.879},"last":0.63},{"interface":"front","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79600000000000004,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:00.266 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:18:00.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:18:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.410+0000 7f27ba2a3640 1 Processor -- start 2024-09-13T17:18:00.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.410+0000 7f27ba2a3640 1 -- start start 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27ba2a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f27b40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27ba2a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b415ad50 con 0x7f27b40cc840 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27ba2a3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b40cae40 con 0x7f27b4143ea0 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27ba2a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40cbca0 con 0x7f27b415a910 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27b8840640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27b40cc840 0x7f27b406c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39980/0 (socket says 172.21.15.5:39980) 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27b8840640 1 -- 172.21.15.5:0/2420219337 learned_addr learned my addr 172.21.15.5:0/2420219337 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807449586 0 0) 0x7f27b415ad50 con 0x7f27b40cc840 2024-09-13T17:18:00.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27b37fe640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f27b40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.411+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f279c003520 con 0x7f27b40cc840 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130567879 0 0) 0x7f279c003520 con 0x7f27b40cc840 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 msgr2=0x7f27b40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f27b40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 >> v1:172.21.15.179:6789/0 conn(0x7f27b4143ea0 legacy=0x7f27b40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4144280 con 0x7f27b40cc840 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f27ac0019f0 con 0x7f27b40cc840 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 >> v1:172.21.15.5:6789/0 conn(0x7f27b40cc840 legacy=0x7f27b406c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c0039a0 0x7f279c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c004350 0x7f279c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f279c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40cbca0 con 0x7f279c004350 2024-09-13T17:18:00.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c00b980 con 0x7f279c0039a0 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c00bb40 con 0x7f27b415a910 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c004350 0x7f279c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b3fff640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c0039a0 0x7f279c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b8840640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f279c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 -- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 msgr2=0x7f279c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f279c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 -- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c0039a0 msgr2=0x7f279c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c0039a0 0x7f279c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b37fe640 1 -- 172.21.15.5:0/2420219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c003520 con 0x7f279c004350 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b8840640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27b415a910 0x7f279c005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:00.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.412+0000 7f27b3fff640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c0039a0 0x7f279c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27b37fe640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c004350 0x7f279c004820 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009a90 tx=0x7f279c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532e4da9bd21cd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8031400 con 0x7f279c004350 2024-09-13T17:18:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a802d050 con 0x7f279c004350 2024-09-13T17:18:00.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27b2ffd640 1 -- 172.21.15.5:0/2420219337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80317a0 con 0x7f279c004350 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27ba2a3640 1 -- 172.21.15.5:0/2420219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c004350 msgr2=0x7f279c004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/2420219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c004350 0x7f279c004820 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009a90 tx=0x7f279c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27b8840640 1 -- 172.21.15.5:0/2420219337 reap_dead start 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27ba2a3640 1 -- 172.21.15.5:0/2420219337 shutdown_connections 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.413+0000 7f27ba2a3640 1 -- 172.21.15.5:0/2420219337 >> 172.21.15.5:0/2420219337 conn(0x7f27b4069ed0 msgr2=0x7f27b406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.414+0000 7f27ba2a3640 1 -- 172.21.15.5:0/2420219337 shutdown_connections 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.414+0000 7f27ba2a3640 1 -- 172.21.15.5:0/2420219337 wait complete. 2024-09-13T17:18:00.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.415+0000 7f27ba2a3640 1 Processor -- start 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.415+0000 7f27ba2a3640 1 -- start start 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c004350 0x7f27b41ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27b4141020 0x7f27b41414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41419e0 con 0x7f27b413e5c0 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b413c4b0 con 0x7f27b4141020 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b413c790 con 0x7f279c004350 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48320/0 (socket says 172.21.15.5:48320) 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 -- 172.21.15.5:0/1395260361 learned_addr learned my addr 172.21.15.5:0/1395260361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b3fff640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c004350 0x7f27b41ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b8840640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27b4141020 0x7f27b41414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 -- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c004350 msgr2=0x7f27b41ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c004350 0x7f27b41ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 -- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27b4141020 msgr2=0x7f27b41414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27b4141020 0x7f27b41414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 -- 172.21.15.5:0/1395260361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b413ca70 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b37fe640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a803a600 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a803a780 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a803ab30 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b413cd50 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.416+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b413d310 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.417+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b40cccf0 con 0x7f27b413e5c0 2024-09-13T17:18:00.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.418+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27a8038040 con 0x7f27b413e5c0 2024-09-13T17:18:00.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.419+0000 7f27b0ff9640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.419+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27a80a96d0 con 0x7f27b413e5c0 2024-09-13T17:18:00.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.419+0000 7f27b3fff640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.419+0000 7f27b3fff640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f27a4007fd0 tx=0x7f27a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.423+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27a8074790 con 0x7f27b413e5c0 2024-09-13T17:18:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.666+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f27b41419e0 con 0x7f27b413e5c0 2024-09-13T17:18:00.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.669+0000 7f27b0ff9640 1 -- 172.21.15.5:0/1395260361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f27a80360e0 con 0x7f27b413e5c0 2024-09-13T17:18:00.670 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 msgr2=0x7f27a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f27a4007fd0 tx=0x7f27a4009040 comp rx=0 tx=0).stop 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 msgr2=0x7f27b413ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8004730 comp rx=0 tx=0).stop 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 shutdown_connections 2024-09-13T17:18:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27b4141020 0x7f27b41414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27b413e5c0 0x7f27b413ea20 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 --2- 172.21.15.5:0/1395260361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c004350 0x7f27b41ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 >> 172.21.15.5:0/1395260361 conn(0x7f27b4069ed0 msgr2=0x7f27b40ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 shutdown_connections 2024-09-13T17:18:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.672+0000 7f27ba2a3640 1 -- 172.21.15.5:0/1395260361 wait complete. 2024-09-13T17:18:00.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.784+0000 7f3f9d890640 1 Processor -- start 2024-09-13T17:18:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.784+0000 7f3f9d890640 1 -- start start 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f9d890640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f9806b5f0 0x7f3f980ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f9d890640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f98151720 0x7f3f980ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f9d890640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980ac780 con 0x7f3f98151340 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f9d890640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9806ca00 con 0x7f3f98151720 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f9d890640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980ac570 con 0x7f3f9806b5f0 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f96ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f98151340 0x7f3f9806aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39996/0 (socket says 172.21.15.5:39996) 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f96ffd640 1 -- 172.21.15.5:0/810567218 learned_addr learned my addr 172.21.15.5:0/810567218 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f977fe640 1 --2- 172.21.15.5:0/810567218 >> v2:172.21.15.5:3300/0 conn(0x7f3f98151720 0x7f3f980ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.785+0000 7f3f95ffb640 1 -- 172.21.15.5:0/810567218 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048552646 0 0) 0x7f3f980ac780 con 0x7f3f98151340 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f95ffb640 1 -- 172.21.15.5:0/810567218 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f80003520 con 0x7f3f98151340 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f967fc640 1 --2- 172.21.15.5:0/810567218 >> v2:172.21.15.179:3300/0 conn(0x7f3f9806b5f0 0x7f3f980ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f977fe640 1 -- 172.21.15.5:0/810567218 >> v2:172.21.15.179:3300/0 conn(0x7f3f9806b5f0 msgr2=0x7f3f980ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:00.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f977fe640 1 --2- 172.21.15.5:0/810567218 >> v2:172.21.15.179:3300/0 conn(0x7f3f9806b5f0 0x7f3f980ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f977fe640 1 -- 172.21.15.5:0/810567218 >> v1:172.21.15.5:6789/0 conn(0x7f3f98151340 legacy=0x7f3f9806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f977fe640 1 -- 172.21.15.5:0/810567218 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980aca60 con 0x7f3f98151720 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f977fe640 1 --2- 172.21.15.5:0/810567218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f980ccd20 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3f9809d0e0 tx=0x7f3f9002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9502d406855301c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.786+0000 7f3f95ffb640 1 -- 172.21.15.5:0/810567218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90007740 con 0x7f3f98151720 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f95ffb640 1 -- 172.21.15.5:0/810567218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9002d050 con 0x7f3f98151720 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f95ffb640 1 -- 172.21.15.5:0/810567218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90007ac0 con 0x7f3f98151720 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 -- 172.21.15.5:0/810567218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 msgr2=0x7f3f980ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 --2- 172.21.15.5:0/810567218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f980ccd20 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3f9809d0e0 tx=0x7f3f9002a710 comp rx=0 tx=0).stop 2024-09-13T17:18:00.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 -- 172.21.15.5:0/810567218 shutdown_connections 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 --2- 172.21.15.5:0/810567218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f980ccd20 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 --2- 172.21.15.5:0/810567218 >> v2:172.21.15.179:3300/0 conn(0x7f3f9806b5f0 0x7f3f980ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 -- 172.21.15.5:0/810567218 >> 172.21.15.5:0/810567218 conn(0x7f3f980cc610 msgr2=0x7f3f98070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 -- 172.21.15.5:0/810567218 shutdown_connections 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.787+0000 7f3f9d890640 1 -- 172.21.15.5:0/810567218 wait complete. 2024-09-13T17:18:00.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.788+0000 7f3f9d890640 1 Processor -- start 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.788+0000 7f3f9d890640 1 -- start start 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f9806b5f0 0x7f3f981491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f98151340 0x7f3f98148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98153820 con 0x7f3f98151720 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98152f10 con 0x7f3f98151340 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f9d890640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98148fd0 con 0x7f3f9806b5f0 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48332/0 (socket says 172.21.15.5:48332) 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f977fe640 1 -- 172.21.15.5:0/3496929054 learned_addr learned my addr 172.21.15.5:0/3496929054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f96ffd640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f9806b5f0 0x7f3f981491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.789+0000 7f3f967fc640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f98151340 0x7f3f98148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 -- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f9806b5f0 msgr2=0x7f3f981491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f9806b5f0 0x7f3f981491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 -- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f98151340 msgr2=0x7f3f98148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f98151340 0x7f3f98148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 -- 172.21.15.5:0/3496929054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009a70 con 0x7f3f98151720 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f977fe640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009e50 tx=0x7f3f90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9003b820 con 0x7f3f98151720 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9003b980 con 0x7f3f98151720 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98152940 con 0x7f3f98151720 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9003bcf0 con 0x7f3f98151720 2024-09-13T17:18:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.790+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98153440 con 0x7f3f98151720 2024-09-13T17:18:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.791+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98153960 con 0x7f3f98151720 2024-09-13T17:18:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.791+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f90031400 con 0x7f3f98151720 2024-09-13T17:18:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.792+0000 7f3f7ffff640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 0x7f3f8406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.792+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f900aac10 con 0x7f3f98151720 2024-09-13T17:18:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.792+0000 7f3f96ffd640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 0x7f3f8406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.793+0000 7f3f96ffd640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 0x7f3f8406d0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f880011e0 tx=0x7f3f88007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:00.796+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f98153960 con 0x7f3f98151720 2024-09-13T17:18:01.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.001+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f98153960 con 0x7f3f98151720 2024-09-13T17:18:01.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.001+0000 7f3f7ffff640 1 -- 172.21.15.5:0/3496929054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f3f98153960 con 0x7f3f98151720 2024-09-13T17:18:01.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:01.003 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 msgr2=0x7f3f8406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 0x7f3f8406d0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f880011e0 tx=0x7f3f88007d30 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 msgr2=0x7f3f9814d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009e50 tx=0x7f3f90004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 shutdown_connections 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3f8406ac30 0x7f3f8406d0f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f98151720 0x7f3f9814d7b0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f98151340 0x7f3f98148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 --2- 172.21.15.5:0/3496929054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f9806b5f0 0x7f3f981491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 >> 172.21.15.5:0/3496929054 conn(0x7f3f980cc610 msgr2=0x7f3f98069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 shutdown_connections 2024-09-13T17:18:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.003+0000 7f3f9d890640 1 -- 172.21.15.5:0/3496929054 wait complete. 2024-09-13T17:18:01.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:17:52.581549+0000', 'modified': '2024-09-13T17:17:54.587066+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7722}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7722': {'gid': 7722, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6833/2901929120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 2901929120}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 2901929120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:01.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:18:01.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:18:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.523+0000 7f84ef7e2640 1 Processor -- start 2024-09-13T17:18:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.523+0000 7f84ef7e2640 1 -- start start 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ef7e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e815a4a0 0x7f84e80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ef7e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84e8070a80 0x7f84e80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ef7e2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80cd730 con 0x7f84e80cc980 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ef7e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80a74b0 con 0x7f84e8070a80 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ef7e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815a880 con 0x7f84e815a4a0 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84edd7f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84e8070a80 0x7f84e80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ecd7d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84e80cc980 0x7f84e8070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40002/0 (socket says 172.21.15.5:40002) 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84ecd7d640 1 -- 172.21.15.5:0/3855503630 learned_addr learned my addr 172.21.15.5:0/3855503630 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.524+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3855503630 >> v2:172.21.15.5:3300/0 conn(0x7f84e8070a80 0x7f84e80b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48344/0 (socket says 172.21.15.5:48344) 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84ed57e640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e815a4a0 0x7f84e80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84edd7f640 1 -- 172.21.15.5:0/3855503630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e815a4a0 msgr2=0x7f84e80cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e815a4a0 0x7f84e80cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84edd7f640 1 -- 172.21.15.5:0/3855503630 >> v1:172.21.15.5:6789/0 conn(0x7f84e80cc980 legacy=0x7f84e8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84edd7f640 1 -- 172.21.15.5:0/3855503630 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80cce90 con 0x7f84e8070a80 2024-09-13T17:18:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84e7fff640 1 -- 172.21.15.5:0/3855503630 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451284210 0 0) 0x7f84e80cd730 con 0x7f84e80cc980 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e80b1c20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097a0 tx=0x7f84e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2f479d155268cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.525+0000 7f84e7fff640 1 -- 172.21.15.5:0/3855503630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0032440 con 0x7f84e8070a80 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84e7fff640 1 -- 172.21.15.5:0/3855503630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e00325a0 con 0x7f84e8070a80 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84e7fff640 1 -- 172.21.15.5:0/3855503630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0032930 con 0x7f84e8070a80 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 -- 172.21.15.5:0/3855503630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 msgr2=0x7f84e80b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e80b1c20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097a0 tx=0x7f84e002a210 comp rx=0 tx=0).stop 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 -- 172.21.15.5:0/3855503630 shutdown_connections 2024-09-13T17:18:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e80b1c20 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/3855503630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e815a4a0 0x7f84e80cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 -- 172.21.15.5:0/3855503630 >> 172.21.15.5:0/3855503630 conn(0x7f84e806a500 msgr2=0x7f84e80b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 -- 172.21.15.5:0/3855503630 shutdown_connections 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.526+0000 7f84ef7e2640 1 -- 172.21.15.5:0/3855503630 wait complete. 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.527+0000 7f84ef7e2640 1 Processor -- start 2024-09-13T17:18:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.527+0000 7f84ef7e2640 1 -- start start 2024-09-13T17:18:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 0x7f84e814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e815a4a0 0x7f84e8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81503d0 con 0x7f84e8070a80 2024-09-13T17:18:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e814edf0 con 0x7f84e815a4a0 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ef7e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e814f0d0 con 0x7f84e80cc980 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48350/0 (socket says 172.21.15.5:48350) 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.528+0000 7f84ed57e640 1 -- 172.21.15.5:0/2654698552 learned_addr learned my addr 172.21.15.5:0/2654698552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 0x7f84e814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 -- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 msgr2=0x7f84e814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84edd7f640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e815a4a0 0x7f84e8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 0x7f84e814fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 -- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e815a4a0 msgr2=0x7f84e8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e815a4a0 0x7f84e8153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 -- 172.21.15.5:0/2654698552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009400 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 0x7f84e814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f84d8007e40 tx=0x7f84d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84e5ffb640 1 -- 172.21.15.5:0/2654698552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8014620 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84e5ffb640 1 -- 172.21.15.5:0/2654698552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d800ee90 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e814f3b0 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84e5ffb640 1 -- 172.21.15.5:0/2654698552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80149c0 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.529+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e814f970 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.531+0000 7f84e5ffb640 1 -- 172.21.15.5:0/2654698552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f84d8014b20 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.531+0000 7f84e5ffb640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 0x7f84d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.531+0000 7f84e5ffb640 1 -- 172.21.15.5:0/2654698552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84d8089e00 con 0x7f84e8070a80 2024-09-13T17:18:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.531+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 0x7f84d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.532+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 0x7f84d406d0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f84e80b4730 tx=0x7f84dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.532+0000 7f84f25d9740 1 Processor -- start 2024-09-13T17:18:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.532+0000 7f84f25d9740 1 -- start start 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abb8860 0x55f94ac08570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac08ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ab157c0 con 0x55f94abbb0a0 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ab24b70 con 0x55f94abe2550 2024-09-13T17:18:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94ab22300 con 0x55f94abb8860 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48366/0 (socket says 172.21.15.5:48366) 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 -- 172.21.15.5:0/1572142765 learned_addr learned my addr 172.21.15.5:0/1572142765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abb8860 0x55f94ac08570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84edd7f640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac08ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 -- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abb8860 msgr2=0x55f94ac08570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abb8860 0x55f94ac08570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 -- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 msgr2=0x55f94ac08ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac08ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 -- 172.21.15.5:0/1572142765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f94aaaa4b0 con 0x55f94abbb0a0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84edd7f640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac08ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.533+0000 7f84ed57e640 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f84d8060a20 tx=0x7f84d8011320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35e3ea5b379f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84ceffd640 1 -- 172.21.15.5:0/1572142765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d805c990 con 0x55f94abbb0a0 2024-09-13T17:18:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84ceffd640 1 -- 172.21.15.5:0/1572142765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8060f50 con 0x55f94abbb0a0 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84ceffd640 1 -- 172.21.15.5:0/1572142765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8055270 con 0x55f94abbb0a0 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 -- 172.21.15.5:0/1572142765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 msgr2=0x55f94abbb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f84d8060a20 tx=0x7f84d8011320 comp rx=0 tx=0).stop 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 -- 172.21.15.5:0/1572142765 shutdown_connections 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac08ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abb8860 0x55f94ac08570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 --2- 172.21.15.5:0/1572142765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abbb480 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 -- 172.21.15.5:0/1572142765 >> 172.21.15.5:0/1572142765 conn(0x55f94abb77d0 msgr2=0x55f94abffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 -- 172.21.15.5:0/1572142765 shutdown_connections 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.534+0000 7f84f25d9740 1 -- 172.21.15.5:0/1572142765 wait complete. 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.535+0000 7f84f25d9740 1 -- start start 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.535+0000 7f84f25d9740 1 Processor -- start 2024-09-13T17:18:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abe6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abe4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ab1dbf0 con 0x55f94abe2550 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94aadc250 con 0x55f94abbb0a0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94aadbef0 con 0x55f94abe3cb0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84f25d9740 10 client.0 _ll_register_callbacks cb 0x55f94ab0e740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48380/0 (socket says 172.21.15.5:48380) 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 -- 172.21.15.5:0/575177389 learned_addr learned my addr 172.21.15.5:0/575177389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ed57e640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abe6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84edd7f640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abe4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 -- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 msgr2=0x55f94abe4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abe4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 -- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 msgr2=0x55f94abe6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abe6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 -- 172.21.15.5:0/575177389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e814f970 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84edd7f640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abe4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005a70 tx=0x7f84dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c8ed8ae7a32434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.536+0000 7f84c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00de70 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84dc021bd0 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f94a8113c0 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84dc021d90 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 10 client.7899 fetch_fsmap learned FSMap version 42 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55f94ab1c270 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f94a8113c0 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f84dc012410 con 0x55f94abe2550 2024-09-13T17:18:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 10 client.7899 fetch_fsmap finished waiting for FSMap version 42 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 10 client.7899 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 20 client.7899 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94ac05ba0 0x55f94ac05f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 4 client.7899 mds_command: new command op to 7722 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 --> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f94a8226c0 con 0x55f94ac05ba0 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.537+0000 7f84ed57e640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94ac05ba0 0x55f94ac05f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84c7fff640 10 client.7899 ms_handle_connect on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84ed57e640 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94ac05ba0 0x55f94ac05f80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417f2e0d8355822f server_cookie=c677a6c918f26d2b in_seq=0 out_seq=0 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84c7fff640 1 -- 172.21.15.5:0/575177389 <== mds.0 v2:172.21.15.5:6832/2901929120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f94a8226c0 con 0x55f94ac05ba0 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84c7fff640 10 client.7899 handle_command_reply: tid=0 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 client.7899 shutdown 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 msgr2=0x55f94abdfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005a70 tx=0x7f84dc000ed0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 shutdown_connections 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94ac05ba0 0x55f94ac05f80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abe4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe2550 0x55f94abdfe70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84c7fff640 0 client.7899 ms_handle_reset on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 --2- 172.21.15.5:0/575177389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abe6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.538+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 >> 172.21.15.5:0/575177389 conn(0x55f94abb8860 msgr2=0x55f94abff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.539+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 shutdown_connections 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.539+0000 7f84f25d9740 1 -- 172.21.15.5:0/575177389 wait complete. 2024-09-13T17:18:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.539+0000 7f84f25d9740 20 client.7899 trim_cache size 0 max 16384 2024-09-13T17:18:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 Processor -- start 2024-09-13T17:18:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 -- start start 2024-09-13T17:18:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abb69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 0x55f94ac048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94aaa1460 con 0x55f94abe3cb0 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94abb9ea0 con 0x55f94abbb0a0 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94abe6470 con 0x55f94abe2550 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84edd7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84edd7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48392/0 (socket says 172.21.15.5:48392) 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.554+0000 7f84edd7f640 1 -- 172.21.15.5:0/3294658815 learned_addr learned my addr 172.21.15.5:0/3294658815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84ed57e640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abb69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 0x55f94ac048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 -- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 msgr2=0x55f94ac048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 0x55f94ac048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 -- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 msgr2=0x55f94abb69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abb69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 -- 172.21.15.5:0/3294658815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f94aabe5f0 con 0x55f94abe3cb0 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 0x55f94ac048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84ed57e640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abb69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84edd7f640 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098c0 tx=0x7f84e002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc99c07cb1f57060 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84cf7fe640 1 -- 172.21.15.5:0/3294658815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0032a50 con 0x55f94abe3cb0 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84cf7fe640 1 -- 172.21.15.5:0/3294658815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0032bd0 con 0x55f94abe3cb0 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84cf7fe640 1 -- 172.21.15.5:0/3294658815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e003c440 con 0x55f94abe3cb0 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84f25d9740 1 -- 172.21.15.5:0/3294658815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 msgr2=0x55f94abfdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.555+0000 7f84f25d9740 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098c0 tx=0x7f84e002c000 comp rx=0 tx=0).stop 2024-09-13T17:18:01.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 -- 172.21.15.5:0/3294658815 shutdown_connections 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abe3cb0 0x55f94abfdcd0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe2550 0x55f94ac048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 --2- 172.21.15.5:0/3294658815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abbb0a0 0x55f94abb69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 -- 172.21.15.5:0/3294658815 >> 172.21.15.5:0/3294658815 conn(0x55f94abb8860 msgr2=0x55f94abb94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 -- 172.21.15.5:0/3294658815 shutdown_connections 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 -- 172.21.15.5:0/3294658815 wait complete. 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 -- start start 2024-09-13T17:18:01.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.556+0000 7f84f25d9740 1 Processor -- start 2024-09-13T17:18:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac69780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abb6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94abe3b30 con 0x55f94abbb0a0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ac6b570 con 0x55f94abe2550 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94abe2cd0 con 0x55f94abe3cb0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84f25d9740 10 client.0 _ll_register_callbacks cb 0x7f84d8054ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84ed57e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48404/0 (socket says 172.21.15.5:48404) 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84ed57e640 1 -- 172.21.15.5:0/2625860331 learned_addr learned my addr 172.21.15.5:0/2625860331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84edd7f640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abb6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.557+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac69780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 -- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 msgr2=0x55f94abb6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abb6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 -- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 msgr2=0x55f94ac69780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac69780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 -- 172.21.15.5:0/2625860331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80cce90 con 0x55f94abbb0a0 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac69780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84ed57e640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f84d8088240 tx=0x7f84d8016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a226476875b0065 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8056f00 con 0x55f94abbb0a0 2024-09-13T17:18:01.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84d8055270 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84d8060f50 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84d8055430 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 10 client.7905 fetch_fsmap learned FSMap version 42 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55f94aae3d00 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8060f50 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f84d8058050 con 0x55f94abbb0a0 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 10 client.7905 fetch_fsmap finished waiting for FSMap version 42 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 10 client.7905 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 20 client.7905 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94abdce90 0x55f94abdd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 4 client.7905 mds_command: new command op to 7722 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.558+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 --> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f94a875d10 con 0x55f94abdce90 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94abdce90 0x55f94abdd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84c7fff640 10 client.7905 ms_handle_connect on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84ecd7d640 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94abdce90 0x55f94abdd270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdaf96e82f0abe3 server_cookie=b2b754c5f96297be in_seq=0 out_seq=0 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84c7fff640 1 -- 172.21.15.5:0/2625860331 <== mds.0 v2:172.21.15.5:6832/2901929120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f94a875d10 con 0x55f94abdce90 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84c7fff640 10 client.7905 handle_command_reply: tid=0 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 client.7905 shutdown 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 msgr2=0x55f94abfbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f84d8088240 tx=0x7f84d8016070 comp rx=0 tx=0).stop 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 shutdown_connections 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x55f94abdce90 0x55f94abdd270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f94abe3cb0 0x55f94abb6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f94abe2550 0x55f94ac69780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84c7fff640 0 client.7905 ms_handle_reset on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 --2- 172.21.15.5:0/2625860331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f94abbb0a0 0x55f94abfbb30 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 >> 172.21.15.5:0/2625860331 conn(0x55f94abb8860 msgr2=0x55f94abe0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 shutdown_connections 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.559+0000 7f84f25d9740 1 -- 172.21.15.5:0/2625860331 wait complete. 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84f25d9740 20 client.7905 trim_cache size 0 max 16384 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:18:01.569 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7722, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 8.976471664, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 42, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 95, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 95, 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.388832024999999 2024-09-13T17:18:01.570 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 msgr2=0x7f84d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 0x7f84d406d0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f84e80b4730 tx=0x7f84dc009040 comp rx=0 tx=0).stop 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 msgr2=0x7f84e814cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f84d8007e40 tx=0x7f84d800e4b0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 shutdown_connections 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84e815a4a0 0x7f84e8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84e80cc980 0x7f84e814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f84d406ac00 0x7f84d406d0c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 --2- 172.21.15.5:0/2654698552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84e8070a80 0x7f84e814cce0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 >> 172.21.15.5:0/2654698552 conn(0x7f84e806a500 msgr2=0x7f84e815e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 shutdown_connections 2024-09-13T17:18:01.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.560+0000 7f84ef7e2640 1 -- 172.21.15.5:0/2654698552 wait complete. 2024-09-13T17:18:01.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.674+0000 7f92f390f640 1 Processor -- start 2024-09-13T17:18:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.674+0000 7f92f390f640 1 -- start start 2024-09-13T17:18:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f390f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92ec0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f390f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec070cf0 con 0x7f92ec15a4a0 2024-09-13T17:18:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f390f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0cd730 con 0x7f92ec0b1c20 2024-09-13T17:18:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f390f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0a74b0 con 0x7f92ec070370 2024-09-13T17:18:01.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f16ab640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92ec15a4a0 0x7f92ec0cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40008/0 (socket says 172.21.15.5:40008) 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.675+0000 7f92f16ab640 1 -- 172.21.15.5:0/310880436 learned_addr learned my addr 172.21.15.5:0/310880436 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997115190 0 0) 0x7f92ec070cf0 con 0x7f92ec15a4a0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f0eaa640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92ec0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d4003520 con 0x7f92ec15a4a0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535905010 0 0) 0x7f92d4003520 con 0x7f92ec15a4a0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 msgr2=0x7f92ec0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92ec0707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 >> v1:172.21.15.179:6789/0 conn(0x7f92ec0b1c20 legacy=0x7f92ec0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec15a880 con 0x7f92ec15a4a0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f92dc0019f0 con 0x7f92ec15a4a0 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 >> v1:172.21.15.5:6789/0 conn(0x7f92ec15a4a0 legacy=0x7f92ec0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d40039a0 0x7f92d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40047c0 0x7f92d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0a74b0 con 0x7f92d40039a0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d400baf0 con 0x7f92d40047c0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d400bcb0 con 0x7f92ec070370 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d40039a0 0x7f92d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f1eac640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f0eaa640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40047c0 0x7f92d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 -- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 msgr2=0x7f92d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 -- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40047c0 msgr2=0x7f92d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40047c0 0x7f92d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f16ab640 1 -- 172.21.15.5:0/310880436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4003520 con 0x7f92d40039a0 2024-09-13T17:18:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f1eac640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec070370 0x7f92d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.676+0000 7f92f0eaa640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40047c0 0x7f92d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.677+0000 7f92f16ab640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d40039a0 0x7f92d4003dc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00a7f0 tx=0x7f92d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c18364aa2c88190 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.677+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc02b9f0 con 0x7f92d40039a0 2024-09-13T17:18:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.677+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc02bb50 con 0x7f92d40039a0 2024-09-13T17:18:01.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.677+0000 7f92ebfff640 1 -- 172.21.15.5:0/310880436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc034470 con 0x7f92d40039a0 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 -- 172.21.15.5:0/310880436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d40039a0 msgr2=0x7f92d4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 --2- 172.21.15.5:0/310880436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d40039a0 0x7f92d4003dc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00a7f0 tx=0x7f92d40057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f1eac640 1 -- 172.21.15.5:0/310880436 reap_dead start 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 -- 172.21.15.5:0/310880436 shutdown_connections 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 -- 172.21.15.5:0/310880436 >> 172.21.15.5:0/310880436 conn(0x7f92ec06a500 msgr2=0x7f92ec0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 -- 172.21.15.5:0/310880436 shutdown_connections 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.678+0000 7f92f390f640 1 -- 172.21.15.5:0/310880436 wait complete. 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.679+0000 7f92f390f640 1 Processor -- start 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.679+0000 7f92f390f640 1 -- start start 2024-09-13T17:18:01.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40039a0 0x7f92ec0abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec0c3780 0x7f92ec1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec153ef0 con 0x7f92ec152860 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c3c00 con 0x7f92d40039a0 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f390f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec06c550 con 0x7f92ec0c3780 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48412/0 (socket says 172.21.15.5:48412) 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 -- 172.21.15.5:0/3117843860 learned_addr learned my addr 172.21.15.5:0/3117843860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f0eaa640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec0c3780 0x7f92ec1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f16ab640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40039a0 0x7f92ec0abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 -- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec0c3780 msgr2=0x7f92ec1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec0c3780 0x7f92ec1539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 -- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40039a0 msgr2=0x7f92ec0abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40039a0 0x7f92ec0abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 -- 172.21.15.5:0/3117843860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec154130 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.680+0000 7f92f1eac640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06abc0 tx=0x7f92e400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.681+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e400eee0 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.681+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40052e0 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.681+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec06c810 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.681+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40035f0 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.681+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec152d10 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.682+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec06c350 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.682+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92e4007020 con 0x7f92ec152860 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.683+0000 7f92e9ffb640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 0x7f92d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:01.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.683+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92e4088570 con 0x7f92ec152860 2024-09-13T17:18:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.683+0000 7f92f16ab640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 0x7f92d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.684+0000 7f92f16ab640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 0x7f92d806d0f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f92dc033000 tx=0x7f92dc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.687+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f92e4053750 con 0x7f92ec152860 2024-09-13T17:18:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.902+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92ec0aed10 con 0x7f92ec152860 2024-09-13T17:18:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.902+0000 7f92e9ffb640 1 -- 172.21.15.5:0/3117843860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f92e4056d70 con 0x7f92ec152860 2024-09-13T17:18:01.904 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 msgr2=0x7f92d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 0x7f92d806d0f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f92dc033000 tx=0x7f92dc02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 msgr2=0x7f92ec0c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f92ec06abc0 tx=0x7f92e400e820 comp rx=0 tx=0).stop 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 shutdown_connections 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f92d806ac30 0x7f92d806d0f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92ec152860 0x7f92ec0c3f30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92ec0c3780 0x7f92ec1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 --2- 172.21.15.5:0/3117843860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92d40039a0 0x7f92ec0abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 >> 172.21.15.5:0/3117843860 conn(0x7f92ec06a500 msgr2=0x7f92ec0ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 shutdown_connections 2024-09-13T17:18:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:01.905+0000 7f92f390f640 1 -- 172.21.15.5:0/3117843860 wait complete. 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:18:01.917 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:18:01.918 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:01.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:01.918 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:18:01.934 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:18:01.934 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:18:01.934 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:18:01.934 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.934 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-09-13T17:18:01.935 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:01.936 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:01.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:01.937 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:18:01.999 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:18:02.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.001 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:18:02.057 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:18:02.057 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:18:02.057 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:18:02.058 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:18:02.058 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:18:02.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:18:02.058 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:18:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.147 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:18:02.163 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:18:02.163 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:18:02.163 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:18:02.229 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:18:02.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:02.229 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:02.285 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:02.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:02.285 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:02.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:02.407 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:02.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:02.471 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:02.473 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:02.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.473 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:02.529 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:18:02.529 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:18:02.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:02.597 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:02.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:02.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:18:02.655+0000 7f785f882480 -1 init, newargv = 0x561bacd39300 newargc=15 2024-09-13T17:18:02.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[69587]: starting ceph client 2024-09-13T17:18:02.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[69587]: starting fuse 2024-09-13T17:18:02.666 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:02.667 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:02.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:02.668 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:02.724 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:18:02.724 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:18:02.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:18:02.724 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:18:02.724 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:18:02.725 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:18:02.726 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:18:02.840 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.69587.asok 2024-09-13T17:18:03.027 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.69587.asok 2024-09-13T17:18:03.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.69587.asok status 2024-09-13T17:18:03.164 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:03.164 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:18:03.164 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:18:03.164 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:18:03.164 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "69587", 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7917, 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 7917 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:03.165 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 815500854 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 815500854 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.7917 192.168.0.1:0/815500854", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/815500854", 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:18:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 42, 2024-09-13T17:18:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 95, 2024-09-13T17:18:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:18:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:18:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:18:03.167 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:03.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.173 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:18:03.173 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:03.189 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:18:03.189 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:03.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:03.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.397+0000 7fe8c359e640 1 Processor -- start 2024-09-13T17:18:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.397+0000 7fe8c359e640 1 -- start start 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c359e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 0x7fe8c4099460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c359e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c406e640 con 0x7fe8c40999a0 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c359e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c40cfa20 con 0x7fe8c415c5a0 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c406cff0 con 0x7fe8c406f480 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c259c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 0x7fe8c4099460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c1d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe8c40999a0 0x7fe8c406ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:48580/0 (socket says 172.21.15.5:48580) 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c1d9b640 1 -- 172.21.15.5:0/2343440040 learned_addr learned my addr 172.21.15.5:0/2343440040 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.398+0000 7fe8c2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:60488/0 (socket says 172.21.15.5:60488) 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.399+0000 7fe8c2d9d640 1 -- 172.21.15.5:0/2343440040 >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 msgr2=0x7fe8c4099460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:03.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.399+0000 7fe8c2d9d640 1 --2- 172.21.15.5:0/2343440040 >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 0x7fe8c4099460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.399+0000 7fe8c2d9d640 1 -- 172.21.15.5:0/2343440040 >> v1:172.21.15.179:6789/0 conn(0x7fe8c40999a0 legacy=0x7fe8c406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.399+0000 7fe8c2d9d640 1 -- 172.21.15.5:0/2343440040 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40ce980 con 0x7fe8c406f480 2024-09-13T17:18:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.399+0000 7fe8c259c640 1 --2- 172.21.15.5:0/2343440040 >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 0x7fe8c4099460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c2d9d640 1 --2- 172.21.15.5:0/2343440040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009d90 tx=0x7fe8bc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603d6eff41903dac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c159a640 1 -- 172.21.15.5:0/2343440040 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc007740 con 0x7fe8c406f480 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c159a640 1 -- 172.21.15.5:0/2343440040 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc02d050 con 0x7fe8c406f480 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c159a640 1 -- 172.21.15.5:0/2343440040 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc007ac0 con 0x7fe8c406f480 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 -- 172.21.15.5:0/2343440040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 msgr2=0x7fe8c4166610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2343440040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009d90 tx=0x7fe8bc02a660 comp rx=0 tx=0).stop 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 -- 172.21.15.5:0/2343440040 shutdown_connections 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2343440040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c406f480 0x7fe8c4166610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2343440040 >> v2:172.21.15.179:3300/0 conn(0x7fe8c415c5a0 0x7fe8c4099460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 -- 172.21.15.5:0/2343440040 >> 172.21.15.5:0/2343440040 conn(0x7fe8c40d0300 msgr2=0x7fe8c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 -- 172.21.15.5:0/2343440040 shutdown_connections 2024-09-13T17:18:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.400+0000 7fe8c359e640 1 -- 172.21.15.5:0/2343440040 wait complete. 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.402+0000 7fe8c359e640 1 Processor -- start 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.402+0000 7fe8c359e640 1 -- start start 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.402+0000 7fe8c359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c40999a0 0x7fe8c415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c415c5a0 0x7fe8c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40b3b40 con 0x7fe8c406f480 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40b46c0 con 0x7fe8c415c5a0 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40b4b50 con 0x7fe8c40999a0 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39016/0 (socket says 172.21.15.5:39016) 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 -- 172.21.15.5:0/2485246345 learned_addr learned my addr 172.21.15.5:0/2485246345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c2d9d640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c415c5a0 0x7fe8c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c1d9b640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c40999a0 0x7fe8c415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 -- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c40999a0 msgr2=0x7fe8c415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c40999a0 0x7fe8c415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 -- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c415c5a0 msgr2=0x7fe8c415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c415c5a0 0x7fe8c415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 -- 172.21.15.5:0/2485246345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009400 con 0x7fe8c406f480 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c259c640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400e990 tx=0x7fe8b400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400c9e0 con 0x7fe8c406f480 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400cb40 con 0x7fe8c406f480 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc009a70 con 0x7fe8c406f480 2024-09-13T17:18:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400ced0 con 0x7fe8c406f480 2024-09-13T17:18:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.403+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c40b4070 con 0x7fe8c406f480 2024-09-13T17:18:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.405+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c40ce680 con 0x7fe8c406f480 2024-09-13T17:18:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.405+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8b4013470 con 0x7fe8c406f480 2024-09-13T17:18:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.405+0000 7fe8b2ffd640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 0x7fe8a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.406+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8b40895f0 con 0x7fe8c406f480 2024-09-13T17:18:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.406+0000 7fe8c1d9b640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 0x7fe8a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.406+0000 7fe8c1d9b640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 0x7fe8a406d0c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40c6e90 tx=0x7fe8b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.410+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8b40547d0 con 0x7fe8c406f480 2024-09-13T17:18:03.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.615+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe8c40b6280 con 0x7fe8c406f480 2024-09-13T17:18:03.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.615+0000 7fe8b2ffd640 1 -- 172.21.15.5:0/2485246345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe8b4057df0 con 0x7fe8c406f480 2024-09-13T17:18:03.616 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 msgr2=0x7fe8a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 0x7fe8a406d0c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40c6e90 tx=0x7fe8b8009040 comp rx=0 tx=0).stop 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 msgr2=0x7fe8c41f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400e990 tx=0x7fe8b400ee50 comp rx=0 tx=0).stop 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 shutdown_connections 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c415c5a0 0x7fe8c415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c40999a0 0x7fe8c415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe8a406ac00 0x7fe8a406d0c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 --2- 172.21.15.5:0/2485246345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8c406f480 0x7fe8c41f2790 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 >> 172.21.15.5:0/2485246345 conn(0x7fe8c40d0300 msgr2=0x7fe8c40afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 shutdown_connections 2024-09-13T17:18:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:03.617+0000 7fe8c359e640 1 -- 172.21.15.5:0/2485246345 wait complete. 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:18:03.629 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:03.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.630 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:18:03.650 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:18:03.650 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:18:03.650 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:18:03.650 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.650 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42412sec preferred_lft 42412sec 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:03.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.653 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:18:03.718 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:18:03.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.719 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:18:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:18:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:18:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:18:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:18:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:18:03.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:18:03.778 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:18:03.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.867 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:18:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:18:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:18:03.883 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:03.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:03.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:18:03.949 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:18:03.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:03.949 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:04.004 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:04.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:04.005 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:04.060 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:18:04.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:04.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:04.190 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:04.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:04.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:04.192 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:18:04.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:18:04.248 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:18:04.291 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:18:04.315 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:04.315 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:04.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:18:04.370+0000 7f47c240d480 -1 init, newargv = 0x563402ed9340 newargc=15 2024-09-13T17:18:04.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[47587]: starting ceph client 2024-09-13T17:18:04.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[47587]: starting fuse 2024-09-13T17:18:04.382 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:04.383 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:04.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:04.384 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:18:04.439 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:18:04.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:18:04.440 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:18:04.441 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:18:04.442 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:18:04.442 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:18:04.442 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:04.442 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:18:04.442 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:18:04.553 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.47587.asok 2024-09-13T17:18:04.739 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.47587.asok 2024-09-13T17:18:04.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:04.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.47587.asok status 2024-09-13T17:18:04.873 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:18:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:18:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:18:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:18:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "47587", 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 6578, 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 6578 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1063603695 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 1063603695 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.6578 192.168.0.1:0/1063603695", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/1063603695", 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:18:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 42, 2024-09-13T17:18:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 95, 2024-09-13T17:18:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:18:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:18:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:18:04.876 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:18:04.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:04.881 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:18:04.882 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:04.898 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:18:04.898 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:04.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:04.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:04.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:04.963 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:04.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.136+0000 7f31bb672640 1 Processor -- start 2024-09-13T17:18:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.137+0000 7f31bb672640 1 -- start start 2024-09-13T17:18:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31bb672640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b41674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31bb672640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b415cdd0 con 0x7f31b40cd630 2024-09-13T17:18:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31bb672640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40d3040 con 0x7f31b415c9f0 2024-09-13T17:18:05.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31bb672640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b8750 con 0x7f31b40b6830 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b8c0d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f31b40cd630 0x7f31b40b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57438/0 (socket says 172.21.15.5:57438) 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b8c0d640 1 -- 172.21.15.5:0/4229655402 learned_addr learned my addr 172.21.15.5:0/4229655402 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b9c0f640 1 --2- 172.21.15.5:0/4229655402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b41674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659445293 0 0) 0x7f31b415cdd0 con 0x7f31b40cd630 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0003520 con 0x7f31b40cd630 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434709122 0 0) 0x7f31b40d3040 con 0x7f31b415c9f0 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b415cdd0 con 0x7f31b415c9f0 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b9c0f640 1 -- 172.21.15.5:0/4229655402 >> v1:172.21.15.179:6789/0 conn(0x7f31b415c9f0 legacy=0x7f31b40b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b9c0f640 1 -- 172.21.15.5:0/4229655402 >> v1:172.21.15.5:6789/0 conn(0x7f31b40cd630 legacy=0x7f31b40b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.138+0000 7f31b9c0f640 1 -- 172.21.15.5:0/4229655402 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40b4f90 con 0x7f31b40b6830 2024-09-13T17:18:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.139+0000 7f31b9c0f640 1 --2- 172.21.15.5:0/4229655402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b41674a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009dc0 tx=0x7f31ac02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711869242edd8ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.139+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac007740 con 0x7f31b40b6830 2024-09-13T17:18:05.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.139+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac02d050 con 0x7f31b40b6830 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.139+0000 7f31abfff640 1 -- 172.21.15.5:0/4229655402 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac007aa0 con 0x7f31b40b6830 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 -- 172.21.15.5:0/4229655402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 msgr2=0x7f31b41674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 --2- 172.21.15.5:0/4229655402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b41674a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009dc0 tx=0x7f31ac02a640 comp rx=0 tx=0).stop 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 -- 172.21.15.5:0/4229655402 shutdown_connections 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 --2- 172.21.15.5:0/4229655402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b41674a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 -- 172.21.15.5:0/4229655402 >> 172.21.15.5:0/4229655402 conn(0x7f31b4071a20 msgr2=0x7f31b4071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 -- 172.21.15.5:0/4229655402 shutdown_connections 2024-09-13T17:18:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.140+0000 7f31bb672640 1 -- 172.21.15.5:0/4229655402 wait complete. 2024-09-13T17:18:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.141+0000 7f31bb672640 1 Processor -- start 2024-09-13T17:18:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.141+0000 7f31bb672640 1 -- start start 2024-09-13T17:18:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31b40cd630 0x7f31b4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40d2c20 con 0x7f31b415c9f0 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b415bc60 con 0x7f31b40cd630 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31bb672640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40c6330 con 0x7f31b40b6830 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39022/0 (socket says 172.21.15.5:39022) 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 -- 172.21.15.5:0/3677539197 learned_addr learned my addr 172.21.15.5:0/3677539197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b8c0d640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31b40cd630 0x7f31b4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b940e640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 -- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 msgr2=0x7f31b414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 -- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31b40cd630 msgr2=0x7f31b4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31b40cd630 0x7f31b4151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 -- 172.21.15.5:0/3677539197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009a70 con 0x7f31b415c9f0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b940e640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.142+0000 7f31b9c0f640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f31ac02ac30 tx=0x7f31ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.143+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac03c830 con 0x7f31b415c9f0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.143+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac03c990 con 0x7f31b415c9f0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.143+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac03cd20 con 0x7f31b415c9f0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.143+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b415b980 con 0x7f31b415c9f0 2024-09-13T17:18:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.143+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40c68b0 con 0x7f31b415c9f0 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.144+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b40b1d90 con 0x7f31b415c9f0 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.144+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f31ac031400 con 0x7f31b415c9f0 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.145+0000 7f31a9ffb640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 0x7f319806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.145+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f31ac0aaec0 con 0x7f31b415c9f0 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.145+0000 7f31b940e640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 0x7f319806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.146+0000 7f31b940e640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 0x7f319806d0c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f31b4066ef0 tx=0x7f31b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.149+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f31ac076110 con 0x7f31b415c9f0 2024-09-13T17:18:05.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.321+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b414d4d0 con 0x7f31b415c9f0 2024-09-13T17:18:05.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.322+0000 7f31a9ffb640 1 -- 172.21.15.5:0/3677539197 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f31ac040090 con 0x7f31b415c9f0 2024-09-13T17:18:05.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:05.324 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:05.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 msgr2=0x7f319806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 0x7f319806d0c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f31b4066ef0 tx=0x7f31b0009040 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 msgr2=0x7f31b4152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f31ac02ac30 tx=0x7f31ac004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 shutdown_connections 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f319806ac00 0x7f319806d0c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31b415c9f0 0x7f31b4152040 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31b40cd630 0x7f31b4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 --2- 172.21.15.5:0/3677539197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31b40b6830 0x7f31b414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 >> 172.21.15.5:0/3677539197 conn(0x7f31b4071a20 msgr2=0x7f31b40b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 shutdown_connections 2024-09-13T17:18:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.324+0000 7f31bb672640 1 -- 172.21.15.5:0/3677539197 wait complete. 2024-09-13T17:18:05.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:50.803411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:51.556188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:05.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.440+0000 7f46f8b95640 1 Processor -- start 2024-09-13T17:18:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.440+0000 7f46f8b95640 1 -- start start 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f8b95640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46f415c470 0x7f46f40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f8b95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 0x7f46f40cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f8b95640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f40ad2b0 con 0x7f46f40acda0 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f8b95640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40ad590 con 0x7f46f415c470 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f8b95640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40ad870 con 0x7f46f406a5e0 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46f415c470 0x7f46f40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46f415c470 0x7f46f40b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39034/0 (socket says 172.21.15.5:39034) 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f259c640 1 -- 172.21.15.5:0/2647051363 learned_addr learned my addr 172.21.15.5:0/2647051363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.441+0000 7f46f2d9d640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 0x7f46f40cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f259c640 1 -- 172.21.15.5:0/2647051363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 msgr2=0x7f46f40cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:05.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f259c640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 0x7f46f40cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f259c640 1 -- 172.21.15.5:0/2647051363 >> v1:172.21.15.179:6789/0 conn(0x7f46f40acda0 legacy=0x7f46f4069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f259c640 1 -- 172.21.15.5:0/2647051363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40adb50 con 0x7f46f415c470 2024-09-13T17:18:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f2d9d640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 0x7f46f40cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f259c640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f415c470 0x7f46f40b0340 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009870 tx=0x7f46e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fa60906dcb2bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.442+0000 7f46f159a640 1 -- 172.21.15.5:0/2647051363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4032440 con 0x7f46f415c470 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f159a640 1 -- 172.21.15.5:0/2647051363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40325a0 con 0x7f46f415c470 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f159a640 1 -- 172.21.15.5:0/2647051363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4032930 con 0x7f46f415c470 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 -- 172.21.15.5:0/2647051363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f415c470 msgr2=0x7f46f40b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f415c470 0x7f46f40b0340 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009870 tx=0x7f46e402a270 comp rx=0 tx=0).stop 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 -- 172.21.15.5:0/2647051363 shutdown_connections 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f406a5e0 0x7f46f40cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 --2- 172.21.15.5:0/2647051363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f415c470 0x7f46f40b0340 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 -- 172.21.15.5:0/2647051363 >> 172.21.15.5:0/2647051363 conn(0x7f46f4071970 msgr2=0x7f46f4098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 -- 172.21.15.5:0/2647051363 shutdown_connections 2024-09-13T17:18:05.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.443+0000 7f46f8b95640 1 -- 172.21.15.5:0/2647051363 wait complete. 2024-09-13T17:18:05.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 Processor -- start 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 -- start start 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f40acda0 0x7f46f40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46f415c470 0x7f46f415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f415ac70 con 0x7f46f406a5e0 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f415a060 con 0x7f46f415c470 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f8b95640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f415a340 con 0x7f46f40acda0 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.445+0000 7f46f259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39050/0 (socket says 172.21.15.5:39050) 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 -- 172.21.15.5:0/1015297896 learned_addr learned my addr 172.21.15.5:0/1015297896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f2d9d640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46f415c470 0x7f46f415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f1d9b640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f40acda0 0x7f46f40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 -- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f40acda0 msgr2=0x7f46f40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f40acda0 0x7f46f40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 -- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46f415c470 msgr2=0x7f46f415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46f415c470 0x7f46f415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 -- 172.21.15.5:0/1015297896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40094d0 con 0x7f46f406a5e0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f259c640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4032440 con 0x7f46f406a5e0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4030b80 con 0x7f46f406a5e0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f415a620 con 0x7f46f406a5e0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e403d440 con 0x7f46f406a5e0 2024-09-13T17:18:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.446+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f4159d50 con 0x7f46f406a5e0 2024-09-13T17:18:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.447+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f40cd180 con 0x7f46f406a5e0 2024-09-13T17:18:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.448+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46e4039040 con 0x7f46f406a5e0 2024-09-13T17:18:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.448+0000 7f46e2ffd640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 0x7f46d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.448+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f46e40a9f00 con 0x7f46f406a5e0 2024-09-13T17:18:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.448+0000 7f46f1d9b640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 0x7f46d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.449+0000 7f46f1d9b640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 0x7f46d406d0f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f46f406ee50 tx=0x7f46e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.452+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f46e4074fd0 con 0x7f46f406a5e0 2024-09-13T17:18:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.625+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46f415a480 con 0x7f46f406a5e0 2024-09-13T17:18:05.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.625+0000 7f46e2ffd640 1 -- 172.21.15.5:0/1015297896 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46f415a480 con 0x7f46f406a5e0 2024-09-13T17:18:05.626 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 msgr2=0x7f46d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 0x7f46d406d0f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f46f406ee50 tx=0x7f46e8009040 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 msgr2=0x7f46f4159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e40046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 shutdown_connections 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46f415c470 0x7f46f415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46f40acda0 0x7f46f40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f46d406ac30 0x7f46d406d0f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 --2- 172.21.15.5:0/1015297896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46f406a5e0 0x7f46f4159810 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 >> 172.21.15.5:0/1015297896 conn(0x7f46f4071970 msgr2=0x7f46f40aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.627+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 shutdown_connections 2024-09-13T17:18:05.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.628+0000 7f46f8b95640 1 -- 172.21.15.5:0/1015297896 wait complete. 2024-09-13T17:18:05.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.743+0000 7fabcfd3e640 1 Processor -- start 2024-09-13T17:18:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.743+0000 7fabcfd3e640 1 -- start start 2024-09-13T17:18:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcfd3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabc80b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcfd3e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabc806a5e0 0x7fabc80cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcfd3e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80ad2b0 con 0x7fabc80acda0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcfd3e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80ad590 con 0x7fabc806a5e0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcfd3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80ad870 con 0x7fabc815c470 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcd2d9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabc80acda0 0x7fabc8069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57444/0 (socket says 172.21.15.5:57444) 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.744+0000 7fabcd2d9640 1 -- 172.21.15.5:0/1622134298 learned_addr learned my addr 172.21.15.5:0/1622134298 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabce2db640 1 --2- 172.21.15.5:0/1622134298 >> v2:172.21.15.179:3300/0 conn(0x7fabc806a5e0 0x7fabc80cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762963887 0 0) 0x7fabc80ad2b0 con 0x7fabc80acda0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabc80b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb4003520 con 0x7fabc80acda0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457036265 0 0) 0x7fabb4003520 con 0x7fabc80acda0 2024-09-13T17:18:05.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 msgr2=0x7fabc80b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabc80b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 >> v2:172.21.15.179:3300/0 conn(0x7fabc806a5e0 msgr2=0x7fabc80cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 --2- 172.21.15.5:0/1622134298 >> v2:172.21.15.179:3300/0 conn(0x7fabc806a5e0 0x7fabc80cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80adb50 con 0x7fabc80acda0 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fabb8001670 con 0x7fabc80acda0 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 >> v1:172.21.15.5:6789/0 conn(0x7fabc80acda0 legacy=0x7fabc8069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabb4003970 0x7fabb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabb4004d00 0x7fabb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80ad590 con 0x7fabb4003970 2024-09-13T17:18:05.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80ad870 con 0x7fabb4004d00 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb400b980 con 0x7fabc815c470 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabb4003970 0x7fabb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcd2d9640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabce2db640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabb4004d00 0x7fabb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 -- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 msgr2=0x7fabb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabc815c470 0x7fabb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 -- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabb4004d00 msgr2=0x7fabb4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabb4004d00 0x7fabb4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabcdada640 1 -- 172.21.15.5:0/1622134298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4003520 con 0x7fabb4003970 2024-09-13T17:18:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.745+0000 7fabce2db640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabb4004d00 0x7fabb4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.746+0000 7fabcdada640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabb4003970 0x7fabb4003d90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ac0 tx=0x7fabb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84db8261bb2de881 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.746+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4031400 con 0x7fabb4003970 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.746+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc402d050 con 0x7fabb4003970 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.746+0000 7fabccad8640 1 -- 172.21.15.5:0/1622134298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4031780 con 0x7fabb4003970 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 -- 172.21.15.5:0/1622134298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabb4003970 msgr2=0x7fabb4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/1622134298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabb4003970 0x7fabb4003d90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ac0 tx=0x7fabb40057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabce2db640 1 -- 172.21.15.5:0/1622134298 reap_dead start 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 -- 172.21.15.5:0/1622134298 shutdown_connections 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 -- 172.21.15.5:0/1622134298 >> 172.21.15.5:0/1622134298 conn(0x7fabc8071970 msgr2=0x7fabc8098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 -- 172.21.15.5:0/1622134298 shutdown_connections 2024-09-13T17:18:05.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.747+0000 7fabcfd3e640 1 -- 172.21.15.5:0/1622134298 wait complete. 2024-09-13T17:18:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.748+0000 7fabcfd3e640 1 Processor -- start 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.748+0000 7fabcfd3e640 1 -- start start 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 0x7fabc815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc815c9d0 0x7fabc809bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc815dae0 con 0x7fabc81592b0 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc815ced0 con 0x7fabc815c9d0 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcfd3e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc815d1b0 con 0x7fabb4003970 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39060/0 (socket says 172.21.15.5:39060) 2024-09-13T17:18:05.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 -- 172.21.15.5:0/2278555010 learned_addr learned my addr 172.21.15.5:0/2278555010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcdada640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 0x7fabc815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabce2db640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc815c9d0 0x7fabc809bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 -- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 msgr2=0x7fabc815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 0x7fabc815df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 -- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc815c9d0 msgr2=0x7fabc809bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc815c9d0 0x7fabc809bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcd2d9640 1 -- 172.21.15.5:0/2278555010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc815d490 con 0x7fabc81592b0 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.749+0000 7fabcdada640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 0x7fabc815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabcd2d9640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fabb800e840 tx=0x7fabb800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800c8d0 con 0x7fabc81592b0 2024-09-13T17:18:05.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800ca50 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc815d770 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800ce00 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.750+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc8158cf0 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.751+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc80ad2b0 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.751+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabb801d460 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.752+0000 7fabbe7fc640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 0x7fabac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.752+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fabb80895a0 con 0x7fabc81592b0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.752+0000 7fabcdada640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 0x7fabac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:05.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.753+0000 7fabcdada640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 0x7fabac06d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fabc4033000 tx=0x7fabc4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:05.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.756+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabb8054510 con 0x7fabc81592b0 2024-09-13T17:18:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.927+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabc80af010 con 0x7fabc81592b0 2024-09-13T17:18:05.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.927+0000 7fabbe7fc640 1 -- 172.21.15.5:0/2278555010 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabb8057b30 con 0x7fabc81592b0 2024-09-13T17:18:05.929 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 msgr2=0x7fabac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 0x7fabac06d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fabc4033000 tx=0x7fabc4008030 comp rx=0 tx=0).stop 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 msgr2=0x7fabc81584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fabb800e840 tx=0x7fabb800ed00 comp rx=0 tx=0).stop 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 shutdown_connections 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc815c9d0 0x7fabc809bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabac06ac30 0x7fabac06d0f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabc81592b0 0x7fabc81584e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 --2- 172.21.15.5:0/2278555010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabb4003970 0x7fabc815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 >> 172.21.15.5:0/2278555010 conn(0x7fabc8071970 msgr2=0x7fabc80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 shutdown_connections 2024-09-13T17:18:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:05.929+0000 7fabcfd3e640 1 -- 172.21.15.5:0/2278555010 wait complete. 2024-09-13T17:18:05.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.045+0000 7f2079fb5640 1 Processor -- start 2024-09-13T17:18:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.045+0000 7f2079fb5640 1 -- start start 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2079fb5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f207406e360 0x7f20740cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2079fb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f2074159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2079fb5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20740b21e0 con 0x7f207406df80 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2079fb5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740b24c0 con 0x7f207406e360 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2079fb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740b27a0 con 0x7f2074159860 2024-09-13T17:18:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f20737fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f207406df80 0x7f20740b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57450/0 (socket says 172.21.15.5:57450) 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f20737fe640 1 -- 172.21.15.5:0/222502681 learned_addr learned my addr 172.21.15.5:0/222502681 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2072ffd640 1 --2- 172.21.15.5:0/222502681 >> v2:172.21.15.179:3300/0 conn(0x7f207406e360 0x7f20740cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750957089 0 0) 0x7f20740b21e0 con 0x7f207406df80 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f2073fff640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f2074159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.046+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c003520 con 0x7f207406df80 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088499849 0 0) 0x7f205c003520 con 0x7f207406df80 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 msgr2=0x7f2074159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f2074159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 >> v2:172.21.15.179:3300/0 conn(0x7f207406e360 msgr2=0x7f20740cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 --2- 172.21.15.5:0/222502681 >> v2:172.21.15.179:3300/0 conn(0x7f207406e360 0x7f20740cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740b2a80 con 0x7f207406df80 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f2064001670 con 0x7f207406df80 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f2072ffd640 1 --2- 172.21.15.5:0/222502681 >> v2:172.21.15.179:3300/0 conn(0x7f207406e360 0x7f20740cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 >> v1:172.21.15.5:6789/0 conn(0x7f207406df80 legacy=0x7f20740b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f205c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f205c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f205c004d00 0x7f205c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740b24c0 con 0x7f205c003970 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740b27a0 con 0x7f205c004d00 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c00db90 con 0x7f2074159860 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f205c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f2072ffd640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f205c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f2073fff640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f205c004d00 0x7f205c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 -- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 msgr2=0x7f205c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2074159860 0x7f205c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 -- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f205c004d00 msgr2=0x7f205c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f205c004d00 0x7f205c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f20737fe640 1 -- 172.21.15.5:0/222502681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c003520 con 0x7f205c003970 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.047+0000 7f2073fff640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f205c004d00 0x7f205c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.048+0000 7f20737fe640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f205c003d90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f206400c240 tx=0x7f205c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8bb8778bcad2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.048+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206402e070 con 0x7f205c003970 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.048+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20640058d0 con 0x7f205c003970 2024-09-13T17:18:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.048+0000 7f20727fc640 1 -- 172.21.15.5:0/222502681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064005cc0 con 0x7f205c003970 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 -- 172.21.15.5:0/222502681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 msgr2=0x7f205c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 --2- 172.21.15.5:0/222502681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f205c003d90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f206400c240 tx=0x7f205c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2073fff640 1 -- 172.21.15.5:0/222502681 reap_dead start 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 -- 172.21.15.5:0/222502681 shutdown_connections 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 -- 172.21.15.5:0/222502681 >> 172.21.15.5:0/222502681 conn(0x7f2074069ed0 msgr2=0x7f207406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 -- 172.21.15.5:0/222502681 shutdown_connections 2024-09-13T17:18:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.049+0000 7f2079fb5640 1 -- 172.21.15.5:0/222502681 wait complete. 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.050+0000 7f2079fb5640 1 Processor -- start 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.050+0000 7f2079fb5640 1 -- start start 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20740ad770 0x7f20740cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20740cd7b0 0x7f20740aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740cdc60 con 0x7f205c003970 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740ac6d0 con 0x7f20740ad770 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2079fb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740ac9b0 con 0x7f20740cd7b0 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39078/0 (socket says 172.21.15.5:39078) 2024-09-13T17:18:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 -- 172.21.15.5:0/3452373485 learned_addr learned my addr 172.21.15.5:0/3452373485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2073fff640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20740cd7b0 0x7f20740aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f2072ffd640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20740ad770 0x7f20740cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 -- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20740cd7b0 msgr2=0x7f20740aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20740cd7b0 0x7f20740aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 -- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20740ad770 msgr2=0x7f20740cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20740ad770 0x7f20740cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.051+0000 7f20737fe640 1 -- 172.21.15.5:0/3452373485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740acc90 con 0x7f205c003970 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f20737fe640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f206400c240 tx=0x7f2064001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064000ed0 con 0x7f205c003970 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20640076b0 con 0x7f205c003970 2024-09-13T17:18:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20740acf70 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064033660 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.052+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2074150740 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.053+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20741508d0 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.053+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20640337c0 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.054+0000 7f205bfff640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 0x7f206006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.054+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20640a9a50 con 0x7f205c003970 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.054+0000 7f2072ffd640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 0x7f206006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.055+0000 7f2072ffd640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 0x7f206006d0c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f20740c3ca0 tx=0x7f2068009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.058+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2064074c30 con 0x7f205c003970 2024-09-13T17:18:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.231+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20741508d0 con 0x7f205c003970 2024-09-13T17:18:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.231+0000 7f205bfff640 1 -- 172.21.15.5:0/3452373485 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2064078250 con 0x7f205c003970 2024-09-13T17:18:06.233 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 msgr2=0x7f206006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 0x7f206006d0c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f20740c3ca0 tx=0x7f2068009190 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 msgr2=0x7f2074150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f206400c240 tx=0x7f2064001a00 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 shutdown_connections 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20740cd7b0 0x7f20740aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20740ad770 0x7f20740cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f206006ac00 0x7f206006d0c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 --2- 172.21.15.5:0/3452373485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f205c003970 0x7f2074150200 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.233+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 >> 172.21.15.5:0/3452373485 conn(0x7f2074069ed0 msgr2=0x7f20740af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.234+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 shutdown_connections 2024-09-13T17:18:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.234+0000 7f2079fb5640 1 -- 172.21.15.5:0/3452373485 wait complete. 2024-09-13T17:18:06.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.346+0000 7f59a85bc640 1 Processor -- start 2024-09-13T17:18:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.346+0000 7f59a85bc640 1 -- start start 2024-09-13T17:18:06.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.347+0000 7f59a85bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a00b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.347+0000 7f59a85bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a0070e60 0x7f59a006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.347+0000 7f59a85bc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a006dc60 con 0x7f59a006a690 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.347+0000 7f59a85bc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a006aad0 con 0x7f59a0070e60 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.347+0000 7f59a85bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b3440 con 0x7f59a015c840 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a0070e60 0x7f59a006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59a0070e60 0x7f59a006e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39092/0 (socket says 172.21.15.5:39092) 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 -- 172.21.15.5:0/2170583439 learned_addr learned my addr 172.21.15.5:0/2170583439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6358640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a00b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 -- 172.21.15.5:0/2170583439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 msgr2=0x7f59a00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a00b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 -- 172.21.15.5:0/2170583439 >> v1:172.21.15.179:6789/0 conn(0x7f59a006a690 legacy=0x7f59a0070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6b59640 1 -- 172.21.15.5:0/2170583439 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a006d610 con 0x7f59a0070e60 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.348+0000 7f59a6358640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a00b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:06.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a6b59640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a0070e60 0x7f59a006e0f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecf29726a18fa72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a5356640 1 -- 172.21.15.5:0/2170583439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998032440 con 0x7f59a0070e60 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a5356640 1 -- 172.21.15.5:0/2170583439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59980325a0 con 0x7f59a0070e60 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a5356640 1 -- 172.21.15.5:0/2170583439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998032930 con 0x7f59a0070e60 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 -- 172.21.15.5:0/2170583439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a0070e60 msgr2=0x7f59a006e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a0070e60 0x7f59a006e0f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802a250 comp rx=0 tx=0).stop 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 -- 172.21.15.5:0/2170583439 shutdown_connections 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a0070e60 0x7f59a006e0f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2170583439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a00b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.349+0000 7f59a85bc640 1 -- 172.21.15.5:0/2170583439 >> 172.21.15.5:0/2170583439 conn(0x7f59a00b0c80 msgr2=0x7f59a0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.350+0000 7f59a85bc640 1 -- 172.21.15.5:0/2170583439 shutdown_connections 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.350+0000 7f59a85bc640 1 -- 172.21.15.5:0/2170583439 wait complete. 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.351+0000 7f59a85bc640 1 Processor -- start 2024-09-13T17:18:06.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.351+0000 7f59a85bc640 1 -- start start 2024-09-13T17:18:06.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.351+0000 7f59a85bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.351+0000 7f59a85bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 0x7f59a015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a006e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01f5490 con 0x7f59a006a690 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a015c070 con 0x7f59a0070e60 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01548c0 con 0x7f59a015c840 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39108/0 (socket says 172.21.15.5:39108) 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 -- 172.21.15.5:0/2669679342 learned_addr learned my addr 172.21.15.5:0/2669679342 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6b59640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a006e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a5b57640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 0x7f59a015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 -- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 msgr2=0x7f59a006e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a006e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 -- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 msgr2=0x7f59a015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 0x7f59a015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 -- 172.21.15.5:0/2669679342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980094d0 con 0x7f59a006a690 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a5b57640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 0x7f59a015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:06.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a6358640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5990007ef0 tx=0x7f599000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990003b90 con 0x7f59a006a690 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000f040 con 0x7f59a006a690 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000de80 con 0x7f59a006a690 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a0154ba0 con 0x7f59a006a690 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.352+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0154e80 con 0x7f59a006a690 2024-09-13T17:18:06.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.353+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a00672c0 con 0x7f59a006a690 2024-09-13T17:18:06.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.354+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5990004030 con 0x7f59a006a690 2024-09-13T17:18:06.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.354+0000 7f599effd640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 0x7f598c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.354+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5990089750 con 0x7f59a006a690 2024-09-13T17:18:06.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.354+0000 7f59a5b57640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 0x7f598c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.355+0000 7f59a5b57640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 0x7f598c06d0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5994007fd0 tx=0x7f5994009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.359+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f59900548a0 con 0x7f59a006a690 2024-09-13T17:18:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.541+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59a006d230 con 0x7f59a006a690 2024-09-13T17:18:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.541+0000 7f599effd640 1 -- 172.21.15.5:0/2669679342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5990057ec0 con 0x7f59a006a690 2024-09-13T17:18:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 msgr2=0x7f598c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 0x7f598c06d0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5994007fd0 tx=0x7f5994009040 comp rx=0 tx=0).stop 2024-09-13T17:18:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 msgr2=0x7f59a01541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5990007ef0 tx=0x7f599000d4a0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 shutdown_connections 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59a015c840 0x7f59a006e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59a0070e60 0x7f59a015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f598c06ac00 0x7f598c06d0c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 --2- 172.21.15.5:0/2669679342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59a006a690 0x7f59a01541e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 >> 172.21.15.5:0/2669679342 conn(0x7f59a00b0c80 msgr2=0x7f59a0157670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 shutdown_connections 2024-09-13T17:18:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.543+0000 7f59a85bc640 1 -- 172.21.15.5:0/2669679342 wait complete. 2024-09-13T17:18:06.555 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:06.555 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:06.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.713+0000 7fd2c8745640 1 Processor -- start 2024-09-13T17:18:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.713+0000 7fd2c8745640 1 -- start start 2024-09-13T17:18:06.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c8745640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2c015a880 0x7fd2c00cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c8745640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c00cb6c0 0x7fd2c00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c8745640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00b2180 con 0x7fd2c015a4a0 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c8745640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00cdab0 con 0x7fd2c015a880 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c8745640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00b2420 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2c015a880 0x7fd2c00cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2c015a880 0x7fd2c00cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39112/0 (socket says 172.21.15.5:39112) 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 -- 172.21.15.5:0/260671651 learned_addr learned my addr 172.21.15.5:0/260671651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c64e1640 1 --1- 172.21.15.5:0/260671651 >> v1:172.21.15.5:6789/0 conn(0x7fd2c015a4a0 0x7fd2c00cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57462/0 (socket says 172.21.15.5:57462) 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c6ce2640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c00cb6c0 0x7fd2c00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 -- 172.21.15.5:0/260671651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c00cb6c0 msgr2=0x7fd2c00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c00cb6c0 0x7fd2c00cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 -- 172.21.15.5:0/260671651 >> v1:172.21.15.5:6789/0 conn(0x7fd2c015a4a0 legacy=0x7fd2c00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.714+0000 7fd2c5ce0640 1 -- 172.21.15.5:0/260671651 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00b2700 con 0x7fd2c015a880 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.715+0000 7fd2c5ce0640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c015a880 0x7fd2c00cdc50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ea05a5348d23cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.715+0000 7fd2c54df640 1 -- 172.21.15.5:0/260671651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b402adf0 con 0x7fd2c015a880 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.715+0000 7fd2c54df640 1 -- 172.21.15.5:0/260671651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4032440 con 0x7fd2c015a880 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.715+0000 7fd2c54df640 1 -- 172.21.15.5:0/260671651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40327d0 con 0x7fd2c015a880 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 -- 172.21.15.5:0/260671651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c015a880 msgr2=0x7fd2c00cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c015a880 0x7fd2c00cdc50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b402a160 comp rx=0 tx=0).stop 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 -- 172.21.15.5:0/260671651 shutdown_connections 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c00cb6c0 0x7fd2c00cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 --2- 172.21.15.5:0/260671651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c015a880 0x7fd2c00cdc50 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 -- 172.21.15.5:0/260671651 >> 172.21.15.5:0/260671651 conn(0x7fd2c0066200 msgr2=0x7fd2c0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 -- 172.21.15.5:0/260671651 shutdown_connections 2024-09-13T17:18:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.716+0000 7fd2c8745640 1 -- 172.21.15.5:0/260671651 wait complete. 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.717+0000 7fd2c8745640 1 Processor -- start 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.717+0000 7fd2c8745640 1 -- start start 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2c015a4a0 0x7fd2c00c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c015a880 0x7fd2c00c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c01487d0 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c01574e0 con 0x7fd2c015a4a0 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c8745640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0147df0 con 0x7fd2c015a880 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39118/0 (socket says 172.21.15.5:39118) 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 -- 172.21.15.5:0/708144796 learned_addr learned my addr 172.21.15.5:0/708144796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c6ce2640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c015a880 0x7fd2c00c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 -- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c015a880 msgr2=0x7fd2c00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c5ce0640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2c015a4a0 0x7fd2c00c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c015a880 0x7fd2c00c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 -- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2c015a4a0 msgr2=0x7fd2c00c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2c015a4a0 0x7fd2c00c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.718+0000 7fd2c64e1640 1 -- 172.21.15.5:0/708144796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b40094d0 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2c64e1640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000cb50 tx=0x7fd2b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0004d60 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b000ce50 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00ad620 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b000ad80 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.719+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c0148110 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.720+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c00672f0 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.720+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd2b00070d0 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.721+0000 7fd2beffd640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 0x7fd2ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.721+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd2b0088e30 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.721+0000 7fd2c5ce0640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 0x7fd2ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:06.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.722+0000 7fd2c5ce0640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 0x7fd2ac06d0c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4034000 tx=0x7fd2b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.725+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd2b0053ec0 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.896+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2c00ad620 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.897+0000 7fd2beffd640 1 -- 172.21.15.5:0/708144796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7fd2c00ad620 con 0x7fd2c00cb6c0 2024-09-13T17:18:06.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:06.899 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 msgr2=0x7fd2ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 0x7fd2ac06d0c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4034000 tx=0x7fd2b402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 msgr2=0x7fd2c01478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000cb50 tx=0x7fd2b000a430 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 shutdown_connections 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2c015a880 0x7fd2c00c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2c015a4a0 0x7fd2c00c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd2ac06ac00 0x7fd2ac06d0c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 --2- 172.21.15.5:0/708144796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2c00cb6c0 0x7fd2c01478b0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 >> 172.21.15.5:0/708144796 conn(0x7fd2c0066200 msgr2=0x7fd2c0158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 shutdown_connections 2024-09-13T17:18:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:06.899+0000 7fd2c8745640 1 -- 172.21.15.5:0/708144796 wait complete. 2024-09-13T17:18:06.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:50.803411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:51.556188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:06.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:07.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.015+0000 7fca084e5640 1 Processor -- start 2024-09-13T17:18:07.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.015+0000 7fca084e5640 1 -- start start 2024-09-13T17:18:07.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca084e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 0x7fca000b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca084e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca084e5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca000ad2b0 con 0x7fca0006a410 2024-09-13T17:18:07.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca084e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0006a8a0 con 0x7fca0015c470 2024-09-13T17:18:07.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca084e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca000ad590 con 0x7fca000acda0 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca05a80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca06281640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 0x7fca000b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.016+0000 7fca06a82640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fca0006a410 0x7fca000aec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:48614/0 (socket says 172.21.15.5:48614) 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca06a82640 1 -- 172.21.15.5:0/4033913168 learned_addr learned my addr 172.21.15.5:0/4033913168 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca05a80640 1 -- 172.21.15.5:0/4033913168 >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 msgr2=0x7fca000b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca05a80640 1 --2- 172.21.15.5:0/4033913168 >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 0x7fca000b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca05a80640 1 -- 172.21.15.5:0/4033913168 >> v1:172.21.15.179:6789/0 conn(0x7fca0006a410 legacy=0x7fca000aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca05a80640 1 -- 172.21.15.5:0/4033913168 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000ad870 con 0x7fca000acda0 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.017+0000 7fca06281640 1 --2- 172.21.15.5:0/4033913168 >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 0x7fca000b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca05a80640 1 --2- 172.21.15.5:0/4033913168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00069ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00097a0 tx=0x7fc9f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f1eed239282e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca0527f640 1 -- 172.21.15.5:0/4033913168 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0032440 con 0x7fca000acda0 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca0527f640 1 -- 172.21.15.5:0/4033913168 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f00325a0 con 0x7fca000acda0 2024-09-13T17:18:07.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca0527f640 1 -- 172.21.15.5:0/4033913168 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0032930 con 0x7fca000acda0 2024-09-13T17:18:07.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca084e5640 1 -- 172.21.15.5:0/4033913168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 msgr2=0x7fca00069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.018+0000 7fca084e5640 1 --2- 172.21.15.5:0/4033913168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00069ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00097a0 tx=0x7fc9f002a180 comp rx=0 tx=0).stop 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 -- 172.21.15.5:0/4033913168 shutdown_connections 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 --2- 172.21.15.5:0/4033913168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00069ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 --2- 172.21.15.5:0/4033913168 >> v2:172.21.15.179:3300/0 conn(0x7fca0015c470 0x7fca000b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 -- 172.21.15.5:0/4033913168 >> 172.21.15.5:0/4033913168 conn(0x7fca00071970 msgr2=0x7fca00098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 -- 172.21.15.5:0/4033913168 shutdown_connections 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.019+0000 7fca084e5640 1 -- 172.21.15.5:0/4033913168 wait complete. 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 Processor -- start 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 -- start start 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 0x7fca001e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001487d0 con 0x7fca0015c470 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00148320 con 0x7fca0006a410 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.020+0000 7fca084e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca00148a40 con 0x7fca000acda0 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39124/0 (socket says 172.21.15.5:39124) 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 -- 172.21.15.5:0/2031870287 learned_addr learned my addr 172.21.15.5:0/2031870287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06281640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 0x7fca001e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca05a80640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 -- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 msgr2=0x7fca00147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 -- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 msgr2=0x7fca001e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 0x7fca001e4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 -- 172.21.15.5:0/2031870287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009400 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06281640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 0x7fca001e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca06a82640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cbc0 tx=0x7fc9f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800ad40 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f8012400 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f0009400 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800aea0 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.021+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca00149000 con 0x7fca0015c470 2024-09-13T17:18:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.022+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca000cd180 con 0x7fca0015c470 2024-09-13T17:18:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.023+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9f8007070 con 0x7fca0015c470 2024-09-13T17:18:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.023+0000 7fc9f6ffd640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 0x7fc9e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.023+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9f8089290 con 0x7fca0015c470 2024-09-13T17:18:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.024+0000 7fca06281640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 0x7fc9e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.024+0000 7fca06281640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 0x7fc9e406d0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009fd0 tx=0x7fc9fc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.028+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc9f8054470 con 0x7fca0015c470 2024-09-13T17:18:07.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.196+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca0015fe00 con 0x7fca0015c470 2024-09-13T17:18:07.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.196+0000 7fc9f6ffd640 1 -- 172.21.15.5:0/2031870287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9f8057a90 con 0x7fca0015c470 2024-09-13T17:18:07.197 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 msgr2=0x7fc9e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 0x7fc9e406d0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009fd0 tx=0x7fc9fc009190 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 msgr2=0x7fca00158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cbc0 tx=0x7fc9f800a430 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 shutdown_connections 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc9e406ac00 0x7fc9e406d0c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca0015c470 0x7fca00158940 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca000acda0 0x7fca00147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 --2- 172.21.15.5:0/2031870287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca0006a410 0x7fca001e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 >> 172.21.15.5:0/2031870287 conn(0x7fca00071970 msgr2=0x7fca0006e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 shutdown_connections 2024-09-13T17:18:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.198+0000 7fca084e5640 1 -- 172.21.15.5:0/2031870287 wait complete. 2024-09-13T17:18:07.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.314+0000 7f0c6cd1f640 1 Processor -- start 2024-09-13T17:18:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.314+0000 7f0c6cd1f640 1 -- start start 2024-09-13T17:18:07.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6cd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 0x7f0c680adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6cd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c680cc840 0x7f0c6806c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6cd1f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6815ad50 con 0x7f0c68143ea0 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6cd1f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680cae40 con 0x7f0c680cc840 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6cd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680cbca0 con 0x7f0c6815a910 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c66d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c680cc840 0x7f0c6806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0c68143ea0 0x7f0c680cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57472/0 (socket says 172.21.15.5:57472) 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6659c640 1 -- 172.21.15.5:0/50600146 learned_addr learned my addr 172.21.15.5:0/50600146 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c65d9b640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 0x7f0c680adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c66d9d640 1 -- 172.21.15.5:0/50600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 msgr2=0x7f0c680adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c66d9d640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 0x7f0c680adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c66d9d640 1 -- 172.21.15.5:0/50600146 >> v1:172.21.15.5:6789/0 conn(0x7f0c68143ea0 legacy=0x7f0c680cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c66d9d640 1 -- 172.21.15.5:0/50600146 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68144280 con 0x7f0c680cc840 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c6559a640 1 -- 172.21.15.5:0/50600146 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831733373 0 0) 0x7f0c6815ad50 con 0x7f0c68143ea0 2024-09-13T17:18:07.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.315+0000 7f0c65d9b640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 0x7f0c680adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.316+0000 7f0c66d9d640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c680cc840 0x7f0c6806c370 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009d90 tx=0x7f0c6002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3d7b43f3db3764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.316+0000 7f0c6559a640 1 -- 172.21.15.5:0/50600146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60007740 con 0x7f0c680cc840 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.316+0000 7f0c6559a640 1 -- 172.21.15.5:0/50600146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6002d050 con 0x7f0c680cc840 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.316+0000 7f0c6559a640 1 -- 172.21.15.5:0/50600146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60007ac0 con 0x7f0c680cc840 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/50600146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c680cc840 msgr2=0x7f0c6806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c680cc840 0x7f0c6806c370 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009d90 tx=0x7f0c6002a660 comp rx=0 tx=0).stop 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/50600146 shutdown_connections 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c680cc840 0x7f0c6806c370 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/50600146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c6815a910 0x7f0c680adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/50600146 >> 172.21.15.5:0/50600146 conn(0x7f0c68069ed0 msgr2=0x7f0c6806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/50600146 shutdown_connections 2024-09-13T17:18:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.317+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/50600146 wait complete. 2024-09-13T17:18:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.318+0000 7f0c6cd1f640 1 Processor -- start 2024-09-13T17:18:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.318+0000 7f0c6cd1f640 1 -- start start 2024-09-13T17:18:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 0x7f0c68138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c68143ea0 0x7f0c6813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6814da70 con 0x7f0c6815a910 2024-09-13T17:18:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6814dd50 con 0x7f0c680cc840 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6cd1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6814e030 con 0x7f0c68143ea0 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39130/0 (socket says 172.21.15.5:39130) 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 -- 172.21.15.5:0/140429333 learned_addr learned my addr 172.21.15.5:0/140429333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6659c640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 0x7f0c68138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c65d9b640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c68143ea0 0x7f0c6813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 -- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c68143ea0 msgr2=0x7f0c6813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c68143ea0 0x7f0c6813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 -- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 msgr2=0x7f0c68138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 0x7f0c68138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 -- 172.21.15.5:0/140429333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60009a70 con 0x7f0c6815a910 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c6659c640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 0x7f0c68138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.319+0000 7f0c66d9d640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009d90 tx=0x7f0c60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.320+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60003b90 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.320+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c60003cf0 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.320+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6814e310 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.320+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60031970 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.320+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6813c3c0 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.321+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6814e830 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.321+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c60031ad0 con 0x7f0c6815a910 2024-09-13T17:18:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.322+0000 7f0c56ffd640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 0x7f0c4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.322+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c600aa4c0 con 0x7f0c6815a910 2024-09-13T17:18:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.322+0000 7f0c6659c640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 0x7f0c4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.323+0000 7f0c6659c640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 0x7f0c4806d0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000f60 tx=0x7f0c58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.326+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c6814e830 con 0x7f0c6815a910 2024-09-13T17:18:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.496+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c6814e830 con 0x7f0c6815a910 2024-09-13T17:18:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.496+0000 7f0c56ffd640 1 -- 172.21.15.5:0/140429333 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c6814e830 con 0x7f0c6815a910 2024-09-13T17:18:07.498 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 msgr2=0x7f0c4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 0x7f0c4806d0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000f60 tx=0x7f0c58009040 comp rx=0 tx=0).stop 2024-09-13T17:18:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 msgr2=0x7f0c6806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009d90 tx=0x7f0c60004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 shutdown_connections 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0c4806ac00 0x7f0c4806d0c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6815a910 0x7f0c6806d160 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c68143ea0 0x7f0c6813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 --2- 172.21.15.5:0/140429333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c680cc840 0x7f0c68138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 >> 172.21.15.5:0/140429333 conn(0x7f0c68069ed0 msgr2=0x7f0c6806c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 shutdown_connections 2024-09-13T17:18:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.499+0000 7f0c6cd1f640 1 -- 172.21.15.5:0/140429333 wait complete. 2024-09-13T17:18:07.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.614+0000 7f41c9c41640 1 Processor -- start 2024-09-13T17:18:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.614+0000 7f41c9c41640 1 -- start start 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c9c41640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c415c840 0x7f41c40ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c9c41640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c9c41640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c406b880 con 0x7f41c406b420 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c9c41640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c4071e40 con 0x7f41c415c840 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c9c41640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c415cc20 con 0x7f41c4065f30 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.615+0000 7f41c37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c415c840 0x7f41c40ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41c415c840 0x7f41c40ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:52260/0 (socket says 172.21.15.5:52260) 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 -- 172.21.15.5:0/1596174410 learned_addr learned my addr 172.21.15.5:0/1596174410 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 -- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 msgr2=0x7f41c406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 --2- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 -- 172.21.15.5:0/1596174410 >> v1:172.21.15.179:6789/0 conn(0x7f41c406b420 legacy=0x7f41c4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c37fe640 1 -- 172.21.15.5:0/1596174410 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4071880 con 0x7f41c415c840 2024-09-13T17:18:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.616+0000 7f41c27fc640 1 -- 172.21.15.5:0/1596174410 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778524366 0 0) 0x7f41c406b880 con 0x7f41c406b420 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c37fe640 1 --2- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c415c840 0x7f41c40ae380 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009870 tx=0x7f41b402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=235c1df75bf6b5f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c27fc640 1 -- 172.21.15.5:0/1596174410 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b402ae80 con 0x7f41c415c840 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c27fc640 1 -- 172.21.15.5:0/1596174410 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4032440 con 0x7f41c415c840 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c27fc640 1 -- 172.21.15.5:0/1596174410 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b40327b0 con 0x7f41c415c840 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 -- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c415c840 msgr2=0x7f41c40ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 --2- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c415c840 0x7f41c40ae380 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009870 tx=0x7f41b402a130 comp rx=0 tx=0).stop 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 -- 172.21.15.5:0/1596174410 shutdown_connections 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 --2- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 --2- 172.21.15.5:0/1596174410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c415c840 0x7f41c40ae380 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.617+0000 7f41c9c41640 1 -- 172.21.15.5:0/1596174410 >> 172.21.15.5:0/1596174410 conn(0x7f41c40cc570 msgr2=0x7f41c4070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.618+0000 7f41c9c41640 1 -- 172.21.15.5:0/1596174410 shutdown_connections 2024-09-13T17:18:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.618+0000 7f41c9c41640 1 -- 172.21.15.5:0/1596174410 wait complete. 2024-09-13T17:18:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.619+0000 7f41c9c41640 1 Processor -- start 2024-09-13T17:18:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.619+0000 7f41c9c41640 1 -- start start 2024-09-13T17:18:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.619+0000 7f41c9c41640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c4148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c9c41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c406b420 0x7f41c414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c9c41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c9c41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c4148bd0 con 0x7f41c415c840 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c9c41640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c4149da0 con 0x7f41c406b420 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c9c41640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c414a080 con 0x7f41c4065f30 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39138/0 (socket says 172.21.15.5:39138) 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 -- 172.21.15.5:0/3847139325 learned_addr learned my addr 172.21.15.5:0/3847139325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c2ffd640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c406b420 0x7f41c414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c37fe640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c4148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 -- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 msgr2=0x7f41c4148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c4148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 -- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c406b420 msgr2=0x7f41c414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c406b420 0x7f41c414bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 -- 172.21.15.5:0/3847139325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40094d0 con 0x7f41c415c840 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41c3fff640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c780 tx=0x7f41bc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.620+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc003b70 con 0x7f41c415c840 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.621+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc003cd0 con 0x7f41c415c840 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.621+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c414a360 con 0x7f41c415c840 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.621+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc005270 con 0x7f41c415c840 2024-09-13T17:18:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.621+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c414c3c0 con 0x7f41c415c840 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.622+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40672c0 con 0x7f41c415c840 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.622+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41bc0053d0 con 0x7f41c415c840 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.622+0000 7f41abfff640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 0x7f41b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.623+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41bc089260 con 0x7f41c415c840 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.623+0000 7f41c37fe640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 0x7f41b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.623+0000 7f41c37fe640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 0x7f41b006d0c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f41b4034000 tx=0x7f41b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.627+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41bc054310 con 0x7f41c415c840 2024-09-13T17:18:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.799+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41c414c5e0 con 0x7f41c415c840 2024-09-13T17:18:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.800+0000 7f41abfff640 1 -- 172.21.15.5:0/3847139325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41bc057930 con 0x7f41c415c840 2024-09-13T17:18:07.801 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 msgr2=0x7f41b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 0x7f41b006d0c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f41b4034000 tx=0x7f41b402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 msgr2=0x7f41c414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c780 tx=0x7f41bc00cb80 comp rx=0 tx=0).stop 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 shutdown_connections 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41b006ac00 0x7f41b006d0c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41c415c840 0x7f41c414e2e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c406b420 0x7f41c414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 --2- 172.21.15.5:0/3847139325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c4065f30 0x7f41c4148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 >> 172.21.15.5:0/3847139325 conn(0x7f41c40cc570 msgr2=0x7f41c40ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 shutdown_connections 2024-09-13T17:18:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.802+0000 7f41c9c41640 1 -- 172.21.15.5:0/3847139325 wait complete. 2024-09-13T17:18:07.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.916+0000 7fbe5eb76640 1 Processor -- start 2024-09-13T17:18:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.916+0000 7fbe5eb76640 1 -- start start 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5eb76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe58163800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5eb76640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580b3180 con 0x7fbe58158ad0 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5eb76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580b3420 con 0x7fbe580b1660 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5eb76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806e730 con 0x7fbe58070a80 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5c912640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe58158ad0 0x7fbe5806e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57474/0 (socket says 172.21.15.5:57474) 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5c912640 1 -- 172.21.15.5:0/3215571911 learned_addr learned my addr 172.21.15.5:0/3215571911 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe58163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748766718 0 0) 0x7fbe580b3180 con 0x7fbe58158ad0 2024-09-13T17:18:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe48003440 con 0x7fbe58158ad0 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179161709 0 0) 0x7fbe48003440 con 0x7fbe58158ad0 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 msgr2=0x7fbe58163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe58163800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 >> v1:172.21.15.179:6789/0 conn(0x7fbe580b1660 legacy=0x7fbe58070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580b3700 con 0x7fbe58158ad0 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fbe4c001670 con 0x7fbe58158ad0 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.917+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 >> v1:172.21.15.5:6789/0 conn(0x7fbe58158ad0 legacy=0x7fbe5806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe48003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe48003fd0 0x7fbe4800a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe4800af30 0x7fbe4800d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800dbb0 con 0x7fbe4800af30 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800dd20 con 0x7fbe48003fd0 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4800dee0 con 0x7fbe58070a80 2024-09-13T17:18:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe4800af30 0x7fbe4800d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5c912640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe48003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe57fff640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe48003fd0 0x7fbe4800a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 -- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 msgr2=0x7fbe48003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe58070a80 0x7fbe48003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 -- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe48003fd0 msgr2=0x7fbe4800a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe48003fd0 0x7fbe4800a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.918+0000 7fbe5d113640 1 -- 172.21.15.5:0/3215571911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48003440 con 0x7fbe4800af30 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe4800af30 0x7fbe4800d3a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fbe5815c720 tx=0x7fbe480036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be20f16e511425a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50032640 con 0x7fbe4800af30 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000f040 con 0x7fbe4800af30 2024-09-13T17:18:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe577fe640 1 -- 172.21.15.5:0/3215571911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500329a0 con 0x7fbe4800af30 2024-09-13T17:18:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3215571911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe4800af30 msgr2=0x7fbe4800d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3215571911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe4800af30 0x7fbe4800d3a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fbe5815c720 tx=0x7fbe480036f0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5d113640 1 -- 172.21.15.5:0/3215571911 reap_dead start 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3215571911 shutdown_connections 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3215571911 >> 172.21.15.5:0/3215571911 conn(0x7fbe5806a500 msgr2=0x7fbe580b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.919+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3215571911 shutdown_connections 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.920+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3215571911 wait complete. 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.921+0000 7fbe5eb76640 1 Processor -- start 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.921+0000 7fbe5eb76640 1 -- start start 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe4800af30 0x7fbe581522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe5815a520 0x7fbe5815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5813ebe0 con 0x7fbe58140a90 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815bb80 con 0x7fbe5815a520 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58141450 con 0x7fbe4800af30 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39150/0 (socket says 172.21.15.5:39150) 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 -- 172.21.15.5:0/3356981773 learned_addr learned my addr 172.21.15.5:0/3356981773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5d113640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe5815a520 0x7fbe5815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5c912640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe4800af30 0x7fbe581522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 -- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe4800af30 msgr2=0x7fbe581522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe4800af30 0x7fbe581522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 -- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe5815a520 msgr2=0x7fbe5815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe5815a520 0x7fbe5815a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 -- 172.21.15.5:0/3356981773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5815b2e0 con 0x7fbe58140a90 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe57fff640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400f8b0 tx=0x7fbe4400fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44001550 con 0x7fbe58140a90 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440052e0 con 0x7fbe58140a90 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5815b5c0 con 0x7fbe58140a90 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400d970 con 0x7fbe58140a90 2024-09-13T17:18:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.922+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5815aee0 con 0x7fbe58140a90 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.923+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5815b070 con 0x7fbe58140a90 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.924+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe4400dad0 con 0x7fbe58140a90 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.924+0000 7fbe557fa640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 0x7fbe3c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.925+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbe44089580 con 0x7fbe58140a90 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.925+0000 7fbe5c912640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 0x7fbe3c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.925+0000 7fbe5c912640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 0x7fbe3c06d0f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007d00 tx=0x7fbe4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:07.929+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe44054620 con 0x7fbe58140a90 2024-09-13T17:18:08.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.110+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe580b41e0 con 0x7fbe58140a90 2024-09-13T17:18:08.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.111+0000 7fbe557fa640 1 -- 172.21.15.5:0/3356981773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe44057c40 con 0x7fbe58140a90 2024-09-13T17:18:08.112 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.112+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 msgr2=0x7fbe3c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.112+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 0x7fbe3c06d0f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007d00 tx=0x7fbe4c009040 comp rx=0 tx=0).stop 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.112+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 msgr2=0x7fbe58140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.112+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400f8b0 tx=0x7fbe4400fd70 comp rx=0 tx=0).stop 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 shutdown_connections 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe5815a520 0x7fbe5815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe3c06ac30 0x7fbe3c06d0f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe58140a90 0x7fbe58140f10 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 --2- 172.21.15.5:0/3356981773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe4800af30 0x7fbe581522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 >> 172.21.15.5:0/3356981773 conn(0x7fbe5806a500 msgr2=0x7fbe5814ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 shutdown_connections 2024-09-13T17:18:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.113+0000 7fbe5eb76640 1 -- 172.21.15.5:0/3356981773 wait complete. 2024-09-13T17:18:08.125 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:18:08.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:08.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:08.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[69587]: fuse finished with error 0 and tester_r 0 2024-09-13T17:18:08.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:08.249 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:18:08.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:08.250 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:18:08.266 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:08.266 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:08.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.406+0000 7fc884090640 1 Processor -- start 2024-09-13T17:18:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.406+0000 7fc884090640 1 -- start start 2024-09-13T17:18:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc87c15a4a0 0x7fc87c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a880 0x7fc87c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc87c0cafb0 0x7fc87c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c0cb9a0 con 0x7fc87c15a4a0 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c0cdab0 con 0x7fc87c0cafb0 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc884090640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0b2180 con 0x7fc87c15a880 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc87c15a4a0 0x7fc87c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc87c15a4a0 0x7fc87c0cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39164/0 (socket says 172.21.15.5:39164) 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 -- 172.21.15.5:0/3826726403 learned_addr learned my addr 172.21.15.5:0/3826726403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 -- 172.21.15.5:0/3826726403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a880 msgr2=0x7fc87c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3826726403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a880 0x7fc87c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 -- 172.21.15.5:0/3826726403 >> v2:172.21.15.179:3300/0 conn(0x7fc87c0cafb0 msgr2=0x7fc87c0cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3826726403 >> v2:172.21.15.179:3300/0 conn(0x7fc87c0cafb0 0x7fc87c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.407+0000 7fc881e2c640 1 -- 172.21.15.5:0/3826726403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0b2420 con 0x7fc87c15a4a0 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3826726403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a4a0 0x7fc87c0cdc50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0cc7e0 tx=0x7fc87802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32f1cebe76eebcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc880e2a640 1 -- 172.21.15.5:0/3826726403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878032440 con 0x7fc87c15a4a0 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc880e2a640 1 -- 172.21.15.5:0/3826726403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780325a0 con 0x7fc87c15a4a0 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc880e2a640 1 -- 172.21.15.5:0/3826726403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878032930 con 0x7fc87c15a4a0 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc884090640 1 -- 172.21.15.5:0/3826726403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a4a0 msgr2=0x7fc87c0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.408+0000 7fc884090640 1 --2- 172.21.15.5:0/3826726403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a4a0 0x7fc87c0cdc50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0cc7e0 tx=0x7fc87802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 -- 172.21.15.5:0/3826726403 shutdown_connections 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 --2- 172.21.15.5:0/3826726403 >> v2:172.21.15.179:3300/0 conn(0x7fc87c0cafb0 0x7fc87c0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 --2- 172.21.15.5:0/3826726403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a880 0x7fc87c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 --2- 172.21.15.5:0/3826726403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a4a0 0x7fc87c0cdc50 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 -- 172.21.15.5:0/3826726403 >> 172.21.15.5:0/3826726403 conn(0x7fc87c066200 msgr2=0x7fc87c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 -- 172.21.15.5:0/3826726403 shutdown_connections 2024-09-13T17:18:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.409+0000 7fc884090640 1 -- 172.21.15.5:0/3826726403 wait complete. 2024-09-13T17:18:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.410+0000 7fc884090640 1 Processor -- start 2024-09-13T17:18:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.410+0000 7fc884090640 1 -- start start 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc87c0cafb0 0x7fc87c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a4a0 0x7fc87c1f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1f3e40 con 0x7fc87c15a880 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1f1020 con 0x7fc87c0cafb0 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1533b0 con 0x7fc87c15a4a0 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39178/0 (socket says 172.21.15.5:39178) 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 -- 172.21.15.5:0/3487066132 learned_addr learned my addr 172.21.15.5:0/3487066132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88162b640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a4a0 0x7fc87c1f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc87c0cafb0 0x7fc87c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 -- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a4a0 msgr2=0x7fc87c1f0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a4a0 0x7fc87c1f0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 -- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc87c0cafb0 msgr2=0x7fc87c152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc87c0cafb0 0x7fc87c152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 -- 172.21.15.5:0/3487066132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780094d0 con 0x7fc87c15a880 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc88262d640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b970 tx=0x7fc87400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400cb40 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87400ccc0 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c1f37f0 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874014680 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.411+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c150c10 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.412+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0672f0 con 0x7fc87c15a880 2024-09-13T17:18:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.413+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc874007370 con 0x7fc87c15a880 2024-09-13T17:18:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.413+0000 7fc8727fc640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 0x7fc86006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.414+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc8740894c0 con 0x7fc87c15a880 2024-09-13T17:18:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.414+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 0x7fc86006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.414+0000 7fc881e2c640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 0x7fc86006d0c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc878034000 tx=0x7fc87802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.418+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc8740544c0 con 0x7fc87c15a880 2024-09-13T17:18:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.588+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc87c1f3650 con 0x7fc87c15a880 2024-09-13T17:18:08.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.589+0000 7fc8727fc640 1 -- 172.21.15.5:0/3487066132 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7fc87c1f3650 con 0x7fc87c15a880 2024-09-13T17:18:08.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:08.591 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 msgr2=0x7fc86006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 0x7fc86006d0c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc878034000 tx=0x7fc87802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 msgr2=0x7fc87c1506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b970 tx=0x7fc87400be30 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 shutdown_connections 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc86006ac00 0x7fc86006d0c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c15a880 0x7fc87c1506d0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc87c15a4a0 0x7fc87c1f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 --2- 172.21.15.5:0/3487066132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc87c0cafb0 0x7fc87c152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 >> 172.21.15.5:0/3487066132 conn(0x7fc87c066200 msgr2=0x7fc87c15cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 shutdown_connections 2024-09-13T17:18:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.591+0000 7fc884090640 1 -- 172.21.15.5:0/3487066132 wait complete. 2024-09-13T17:18:08.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:50.803411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:51.556188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:08.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.709+0000 7fc175ae5640 1 Processor -- start 2024-09-13T17:18:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.709+0000 7fc175ae5640 1 -- start start 2024-09-13T17:18:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc175ae5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc17015a910 0x7fc1700adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc175ae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1700cc840 0x7fc17006c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc175ae5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17015ad50 con 0x7fc170143ea0 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc175ae5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700cae40 con 0x7fc17015a910 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc175ae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700cbca0 con 0x7fc1700cc840 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc17015a910 0x7fc1700adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc170143ea0 0x7fc1700cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57480/0 (socket says 172.21.15.5:57480) 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16f7fe640 1 -- 172.21.15.5:0/40479418 learned_addr learned my addr 172.21.15.5:0/40479418 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16ffff640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1700cc840 0x7fc17006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16effd640 1 -- 172.21.15.5:0/40479418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1700cc840 msgr2=0x7fc17006c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16effd640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1700cc840 0x7fc17006c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16effd640 1 -- 172.21.15.5:0/40479418 >> v1:172.21.15.5:6789/0 conn(0x7fc170143ea0 legacy=0x7fc1700cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16e7fc640 1 -- 172.21.15.5:0/40479418 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572348634 0 0) 0x7fc17015ad50 con 0x7fc170143ea0 2024-09-13T17:18:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.710+0000 7fc16effd640 1 -- 172.21.15.5:0/40479418 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170144280 con 0x7fc17015a910 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.711+0000 7fc16effd640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17015a910 0x7fc1700adb60 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097a0 tx=0x7fc16402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1d2026d1e1acfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.711+0000 7fc16e7fc640 1 -- 172.21.15.5:0/40479418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164032440 con 0x7fc17015a910 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.711+0000 7fc16e7fc640 1 -- 172.21.15.5:0/40479418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640325a0 con 0x7fc17015a910 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.711+0000 7fc16e7fc640 1 -- 172.21.15.5:0/40479418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164032930 con 0x7fc17015a910 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 -- 172.21.15.5:0/40479418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17015a910 msgr2=0x7fc1700adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17015a910 0x7fc1700adb60 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097a0 tx=0x7fc16402a180 comp rx=0 tx=0).stop 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 -- 172.21.15.5:0/40479418 shutdown_connections 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1700cc840 0x7fc17006c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 --2- 172.21.15.5:0/40479418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc17015a910 0x7fc1700adb60 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 -- 172.21.15.5:0/40479418 >> 172.21.15.5:0/40479418 conn(0x7fc170069ed0 msgr2=0x7fc17006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 -- 172.21.15.5:0/40479418 shutdown_connections 2024-09-13T17:18:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.712+0000 7fc175ae5640 1 -- 172.21.15.5:0/40479418 wait complete. 2024-09-13T17:18:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.713+0000 7fc175ae5640 1 Processor -- start 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.713+0000 7fc175ae5640 1 -- start start 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 0x7fc1700b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc17015a910 0x7fc170159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700ac470 con 0x7fc1700cc840 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700ab8c0 con 0x7fc17015a910 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc175ae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700abad0 con 0x7fc170143ea0 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39186/0 (socket says 172.21.15.5:39186) 2024-09-13T17:18:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 -- 172.21.15.5:0/2413995401 learned_addr learned my addr 172.21.15.5:0/2413995401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16effd640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 0x7fc1700b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16ffff640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc17015a910 0x7fc170159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 -- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 msgr2=0x7fc1700b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 0x7fc1700b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 -- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc17015a910 msgr2=0x7fc170159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc17015a910 0x7fc170159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16f7fe640 1 -- 172.21.15.5:0/2413995401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009400 con 0x7fc1700cc840 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.714+0000 7fc16effd640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 0x7fc1700b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc16f7fe640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c430 tx=0x7fc16000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600074e0 con 0x7fc1700cc840 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160007660 con 0x7fc1700cc840 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1700abdb0 con 0x7fc1700cc840 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160004a20 con 0x7fc1700cc840 2024-09-13T17:18:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.715+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17013c340 con 0x7fc1700cc840 2024-09-13T17:18:08.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.716+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700cccd0 con 0x7fc1700cc840 2024-09-13T17:18:08.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.716+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc160004b80 con 0x7fc1700cc840 2024-09-13T17:18:08.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.717+0000 7fc157fff640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 0x7fc15c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:08.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.717+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1600891f0 con 0x7fc1700cc840 2024-09-13T17:18:08.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.717+0000 7fc16effd640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 0x7fc15c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:08.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.718+0000 7fc16effd640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 0x7fc15c06d0f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc164034000 tx=0x7fc16402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:08.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.721+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc160054320 con 0x7fc1700cc840 2024-09-13T17:18:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.892+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc17006d2b0 con 0x7fc1700cc840 2024-09-13T17:18:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.892+0000 7fc157fff640 1 -- 172.21.15.5:0/2413995401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc160057940 con 0x7fc1700cc840 2024-09-13T17:18:08.894 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 msgr2=0x7fc15c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 0x7fc15c06d0f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc164034000 tx=0x7fc16402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 msgr2=0x7fc17013be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c430 tx=0x7fc16000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 shutdown_connections 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc17015a910 0x7fc170159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc170143ea0 0x7fc1700b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc15c06ac30 0x7fc15c06d0f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 --2- 172.21.15.5:0/2413995401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1700cc840 0x7fc17013be00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.894+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 >> 172.21.15.5:0/2413995401 conn(0x7fc170069ed0 msgr2=0x7fc17006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.895+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 shutdown_connections 2024-09-13T17:18:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:08.895+0000 7fc175ae5640 1 -- 172.21.15.5:0/2413995401 wait complete. 2024-09-13T17:18:08.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.010+0000 7f45caf9c640 1 Processor -- start 2024-09-13T17:18:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.010+0000 7f45caf9c640 1 -- start start 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45caf9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45caf9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 0x7f45c40ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45caf9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4071e40 con 0x7f45c4065f30 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45caf9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c415cc20 con 0x7f45c415c840 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45caf9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4071880 con 0x7f45c406b5f0 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c8d38640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c9539640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 0x7f45c40ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c8d38640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:52302/0 (socket says 172.21.15.5:52302) 2024-09-13T17:18:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c8d38640 1 -- 172.21.15.5:0/3593928648 learned_addr learned my addr 172.21.15.5:0/3593928648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c3fff640 1 --1- 172.21.15.5:0/3593928648 >> v1:172.21.15.179:6789/0 conn(0x7f45c4065f30 0x7f45c406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:48626/0 (socket says 172.21.15.5:48626) 2024-09-13T17:18:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c9539640 1 -- 172.21.15.5:0/3593928648 >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 msgr2=0x7f45c40ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c9539640 1 --2- 172.21.15.5:0/3593928648 >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c9539640 1 -- 172.21.15.5:0/3593928648 >> v1:172.21.15.179:6789/0 conn(0x7f45c4065f30 legacy=0x7f45c406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c37fe640 1 -- 172.21.15.5:0/3593928648 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599853126 0 0) 0x7f45c4071e40 con 0x7f45c4065f30 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c9539640 1 -- 172.21.15.5:0/3593928648 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4071b60 con 0x7f45c406b5f0 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.011+0000 7f45c8d38640 1 --2- 172.21.15.5:0/3593928648 >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.012+0000 7f45c9539640 1 --2- 172.21.15.5:0/3593928648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 0x7f45c40ac6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc02a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2290502ad6bd9289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.012+0000 7f45c37fe640 1 -- 172.21.15.5:0/3593928648 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc007740 con 0x7f45c406b5f0 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.012+0000 7f45c37fe640 1 -- 172.21.15.5:0/3593928648 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc02d050 con 0x7f45c406b5f0 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.012+0000 7f45c37fe640 1 -- 172.21.15.5:0/3593928648 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc007ac0 con 0x7f45c406b5f0 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 -- 172.21.15.5:0/3593928648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 msgr2=0x7f45c40ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3593928648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 0x7f45c40ac6c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc02a530 comp rx=0 tx=0).stop 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 -- 172.21.15.5:0/3593928648 shutdown_connections 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3593928648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c406b5f0 0x7f45c40ac6c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3593928648 >> v2:172.21.15.179:3300/0 conn(0x7f45c415c840 0x7f45c40ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 -- 172.21.15.5:0/3593928648 >> 172.21.15.5:0/3593928648 conn(0x7f45c40cc570 msgr2=0x7f45c4070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 -- 172.21.15.5:0/3593928648 shutdown_connections 2024-09-13T17:18:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.013+0000 7f45caf9c640 1 -- 172.21.15.5:0/3593928648 wait complete. 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.014+0000 7f45caf9c640 1 Processor -- start 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.014+0000 7f45caf9c640 1 -- start start 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 0x7f45c415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c406b5f0 0x7f45c4150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41546e0 con 0x7f45c415c840 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c415b4b0 con 0x7f45c406b5f0 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45caf9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4154020 con 0x7f45c4065f30 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45c9539640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45c9539640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39190/0 (socket says 172.21.15.5:39190) 2024-09-13T17:18:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45c9539640 1 -- 172.21.15.5:0/3664340720 learned_addr learned my addr 172.21.15.5:0/3664340720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45c3fff640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c406b5f0 0x7f45c4150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.015+0000 7f45c8d38640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 0x7f45c415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 -- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 msgr2=0x7f45c415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 0x7f45c415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 -- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c406b5f0 msgr2=0x7f45c4150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c406b5f0 0x7f45c4150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 -- 172.21.15.5:0/3664340720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094d0 con 0x7f45c415c840 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c8d38640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 0x7f45c415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c9539640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc003b90 con 0x7f45c415c840 2024-09-13T17:18:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc009a70 con 0x7f45c415c840 2024-09-13T17:18:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc003cf0 con 0x7f45c415c840 2024-09-13T17:18:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc03c930 con 0x7f45c415c840 2024-09-13T17:18:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.016+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4153d00 con 0x7f45c415c840 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.017+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4154820 con 0x7f45c415c840 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.018+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45bc02ad50 con 0x7f45c415c840 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.018+0000 7f45c17fa640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 0x7f45a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.018+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45bc0aa2b0 con 0x7f45c415c840 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.018+0000 7f45c8d38640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 0x7f45a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.019+0000 7f45c8d38640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 0x7f45a406d0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f45c41e61c0 tx=0x7f45b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.023+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45c4154820 con 0x7f45c415c840 2024-09-13T17:18:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.194+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45c4154820 con 0x7f45c415c840 2024-09-13T17:18:09.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.194+0000 7f45c17fa640 1 -- 172.21.15.5:0/3664340720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45c4154820 con 0x7f45c415c840 2024-09-13T17:18:09.195 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:09.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 msgr2=0x7f45a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 0x7f45a406d0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f45c41e61c0 tx=0x7f45b4008040 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 msgr2=0x7f45c41e6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 shutdown_connections 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f45a406ac00 0x7f45a406d0c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c415c840 0x7f45c41e6690 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45c406b5f0 0x7f45c4150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 --2- 172.21.15.5:0/3664340720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45c4065f30 0x7f45c415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 >> 172.21.15.5:0/3664340720 conn(0x7f45c40cc570 msgr2=0x7f45c40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 shutdown_connections 2024-09-13T17:18:09.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.196+0000 7f45caf9c640 1 -- 172.21.15.5:0/3664340720 wait complete. 2024-09-13T17:18:09.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.311+0000 7f0d3e5a0640 1 Processor -- start 2024-09-13T17:18:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.312+0000 7f0d3e5a0640 1 -- start start 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.312+0000 7f0d3e5a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d380cd820 0x7f0d380cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.312+0000 7f0d3e5a0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380cdc70 con 0x7f0d380ced40 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.312+0000 7f0d3e5a0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380cded0 con 0x7f0d3815c5f0 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.312+0000 7f0d3e5a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380d0550 con 0x7f0d380cd820 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3cd9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d380ced40 0x7f0d380cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57490/0 (socket says 172.21.15.5:57490) 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3cd9d640 1 -- 172.21.15.5:0/2740548487 learned_addr learned my addr 172.21.15.5:0/2740548487 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d380cd820 0x7f0d380cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036373992 0 0) 0x7f0d380cdc70 con 0x7f0d380ced40 2024-09-13T17:18:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d24003520 con 0x7f0d380ced40 2024-09-13T17:18:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139666452 0 0) 0x7f0d380cded0 con 0x7f0d3815c5f0 2024-09-13T17:18:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d380cdc70 con 0x7f0d3815c5f0 2024-09-13T17:18:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782682427 0 0) 0x7f0d24003520 con 0x7f0d380ced40 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d380cd820 msgr2=0x7f0d380cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d380cd820 0x7f0d380cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 >> v1:172.21.15.179:6789/0 conn(0x7f0d3815c5f0 legacy=0x7f0d3806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380ce1b0 con 0x7f0d380ced40 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0d28001690 con 0x7f0d380ced40 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 >> v1:172.21.15.5:6789/0 conn(0x7f0d380ced40 legacy=0x7f0d380cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24003b30 0x7f0d24003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d24005180 0x7f0d2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380d0550 con 0x7f0d24005180 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400bf70 con 0x7f0d240047c0 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400c130 con 0x7f0d24003b30 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d380cd820 0x7f0d380cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3d59e640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24003b30 0x7f0d24003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d24005180 0x7f0d2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.313+0000 7f0d3cd9d640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24003b30 msgr2=0x7f0d24003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24003b30 0x7f0d24003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d240047c0 msgr2=0x7f0d24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/2740548487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24003520 con 0x7f0d24005180 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.314+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d24005180 0x7f0d2400b980 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0d380cdc00 tx=0x7f0d240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fc1d10ffc27c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30003c50 con 0x7f0d24005180 2024-09-13T17:18:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000f040 con 0x7f0d24005180 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d2ffff640 1 -- 172.21.15.5:0/2740548487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30004030 con 0x7f0d24005180 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/2740548487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d24005180 msgr2=0x7f0d2400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/2740548487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d24005180 0x7f0d2400b980 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f0d380cdc00 tx=0x7f0d240057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/2740548487 reap_dead start 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/2740548487 shutdown_connections 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/2740548487 >> 172.21.15.5:0/2740548487 conn(0x7f0d38089fe0 msgr2=0x7f0d380d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/2740548487 shutdown_connections 2024-09-13T17:18:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.315+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/2740548487 wait complete. 2024-09-13T17:18:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.316+0000 7f0d3e5a0640 1 Processor -- start 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.316+0000 7f0d3e5a0640 1 -- start start 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24005180 0x7f0d38155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d380ca620 0x7f0d38156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380cbcf0 con 0x7f0d380caaa0 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38155d60 con 0x7f0d380ca620 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3e5a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380cb070 con 0x7f0d24005180 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3dd9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3dd9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39218/0 (socket says 172.21.15.5:39218) 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/379387345 learned_addr learned my addr 172.21.15.5:0/379387345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3d59e640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24005180 0x7f0d38155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.317+0000 7f0d3cd9d640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d380ca620 0x7f0d38156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24005180 msgr2=0x7f0d38155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24005180 0x7f0d38155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d380ca620 msgr2=0x7f0d38156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d380ca620 0x7f0d38156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 -- 172.21.15.5:0/379387345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380cb350 con 0x7f0d380caaa0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3dd9f640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0d3002aeb0 tx=0x7f0d30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300047c0 con 0x7f0d380caaa0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3003c420 con 0x7f0d380caaa0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380cb630 con 0x7f0d380caaa0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3003c7d0 con 0x7f0d380caaa0 2024-09-13T17:18:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.318+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d381582b0 con 0x7f0d380caaa0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.319+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380cbe30 con 0x7f0d380caaa0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.320+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d3002f070 con 0x7f0d380caaa0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.320+0000 7f0d2dffb640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 0x7f0d1c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.320+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0d300a9b00 con 0x7f0d380caaa0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.320+0000 7f0d3d59e640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 0x7f0d1c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.321+0000 7f0d3d59e640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 0x7f0d1c06d0f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0d380b5500 tx=0x7f0d34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.324+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0d380cbe30 con 0x7f0d380caaa0 2024-09-13T17:18:09.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.494+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d380cbe30 con 0x7f0d380caaa0 2024-09-13T17:18:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.495+0000 7f0d2dffb640 1 -- 172.21.15.5:0/379387345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d30036020 con 0x7f0d380caaa0 2024-09-13T17:18:09.496 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 msgr2=0x7f0d1c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 0x7f0d1c06d0f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0d380b5500 tx=0x7f0d34009040 comp rx=0 tx=0).stop 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 msgr2=0x7f0d381566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0d3002aeb0 tx=0x7f0d30009750 comp rx=0 tx=0).stop 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 shutdown_connections 2024-09-13T17:18:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0d1c06ac30 0x7f0d1c06d0f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d380caaa0 0x7f0d381566c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d380ca620 0x7f0d38156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 --2- 172.21.15.5:0/379387345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d24005180 0x7f0d38155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 >> 172.21.15.5:0/379387345 conn(0x7f0d38089fe0 msgr2=0x7f0d380cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 shutdown_connections 2024-09-13T17:18:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.497+0000 7f0d3e5a0640 1 -- 172.21.15.5:0/379387345 wait complete. 2024-09-13T17:18:09.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:09.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.609+0000 7fa867de9640 1 Processor -- start 2024-09-13T17:18:09.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.609+0000 7fa867de9640 1 -- start start 2024-09-13T17:18:09.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa867de9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 0x7fa86006e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa867de9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa867de9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600b3180 con 0x7fa8600b1660 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa867de9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600b3420 con 0x7fa860158ad0 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa867de9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b3700 con 0x7fa860070a80 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa866386640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa865b85640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 0x7fa86006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa866386640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:60788/0 (socket says 172.21.15.5:60788) 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa866386640 1 -- 172.21.15.5:0/2863649309 learned_addr learned my addr 172.21.15.5:0/2863649309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa865b85640 1 --2- 172.21.15.5:0/2863649309 >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 0x7fa86006e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:52340/0 (socket says 172.21.15.5:52340) 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.610+0000 7fa864b83640 1 -- 172.21.15.5:0/2863649309 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190298301 0 0) 0x7fa8600b3180 con 0x7fa8600b1660 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa864b83640 1 -- 172.21.15.5:0/2863649309 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003520 con 0x7fa8600b1660 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa866386640 1 -- 172.21.15.5:0/2863649309 >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 msgr2=0x7fa86006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa866386640 1 --2- 172.21.15.5:0/2863649309 >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 0x7fa86006e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa866386640 1 -- 172.21.15.5:0/2863649309 >> v1:172.21.15.179:6789/0 conn(0x7fa8600b1660 legacy=0x7fa860070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa866386640 1 -- 172.21.15.5:0/2863649309 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b39e0 con 0x7fa860070a80 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.611+0000 7fa866386640 1 --2- 172.21.15.5:0/2863649309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa858009e50 tx=0x7fa85802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7556cc7cd5bcd3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa864b83640 1 -- 172.21.15.5:0/2863649309 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858031600 con 0x7fa860070a80 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa864b83640 1 -- 172.21.15.5:0/2863649309 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85802d050 con 0x7fa860070a80 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa864b83640 1 -- 172.21.15.5:0/2863649309 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858031960 con 0x7fa860070a80 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 -- 172.21.15.5:0/2863649309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 msgr2=0x7fa86006c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 --2- 172.21.15.5:0/2863649309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa858009e50 tx=0x7fa85802a710 comp rx=0 tx=0).stop 2024-09-13T17:18:09.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 -- 172.21.15.5:0/2863649309 shutdown_connections 2024-09-13T17:18:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 --2- 172.21.15.5:0/2863649309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860070a80 0x7fa86006c3d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 --2- 172.21.15.5:0/2863649309 >> v2:172.21.15.179:3300/0 conn(0x7fa860158ad0 0x7fa86006e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 -- 172.21.15.5:0/2863649309 >> 172.21.15.5:0/2863649309 conn(0x7fa86006a500 msgr2=0x7fa8600b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 -- 172.21.15.5:0/2863649309 shutdown_connections 2024-09-13T17:18:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.612+0000 7fa867de9640 1 -- 172.21.15.5:0/2863649309 wait complete. 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.613+0000 7fa867de9640 1 Processor -- start 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.613+0000 7fa867de9640 1 -- start start 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 0x7fa860150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 0x7fa8600cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860151770 con 0x7fa860070a80 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860153ce0 con 0x7fa8600b1660 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa867de9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860149680 con 0x7fa860158ad0 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa865b85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa865b85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39234/0 (socket says 172.21.15.5:39234) 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa865b85640 1 -- 172.21.15.5:0/1006892209 learned_addr learned my addr 172.21.15.5:0/1006892209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa866386640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 0x7fa8600cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.614+0000 7fa865384640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 0x7fa860150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 -- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 msgr2=0x7fa8600cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 0x7fa8600cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 -- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 msgr2=0x7fa860150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 0x7fa860150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 -- 172.21.15.5:0/1006892209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009b30 con 0x7fa860070a80 2024-09-13T17:18:09.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa866386640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 0x7fa8600cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865384640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 0x7fa860150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa865b85640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e870 tx=0x7fa85c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0094f0 con 0x7fa860070a80 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c00c940 con 0x7fa860070a80 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860151490 con 0x7fa860070a80 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00ccf0 con 0x7fa860070a80 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.615+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601541d0 con 0x7fa860070a80 2024-09-13T17:18:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.616+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86006db80 con 0x7fa860070a80 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.617+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa85c013470 con 0x7fa860070a80 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.617+0000 7fa8567fc640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 0x7fa84406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.617+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa85c0894f0 con 0x7fa860070a80 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.617+0000 7fa865384640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 0x7fa84406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.618+0000 7fa865384640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 0x7fa84406d0c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa860149630 tx=0x7fa850009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.621+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa85c054620 con 0x7fa860070a80 2024-09-13T17:18:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.804+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8600b41e0 con 0x7fa860070a80 2024-09-13T17:18:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.805+0000 7fa8567fc640 1 -- 172.21.15.5:0/1006892209 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa85c057c40 con 0x7fa860070a80 2024-09-13T17:18:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 msgr2=0x7fa84406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 0x7fa84406d0c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa860149630 tx=0x7fa850009040 comp rx=0 tx=0).stop 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 msgr2=0x7fa8601490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e870 tx=0x7fa85c00ed30 comp rx=0 tx=0).stop 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 shutdown_connections 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa860158ad0 0x7fa8600cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8600b1660 0x7fa860150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa84406ac00 0x7fa84406d0c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 --2- 172.21.15.5:0/1006892209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa860070a80 0x7fa8601490f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 >> 172.21.15.5:0/1006892209 conn(0x7fa86006a500 msgr2=0x7fa8600afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 shutdown_connections 2024-09-13T17:18:09.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.807+0000 7fa867de9640 1 -- 172.21.15.5:0/1006892209 wait complete. 2024-09-13T17:18:09.819 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:09.820 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:09.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.939+0000 7f90eafae640 1 Processor -- start 2024-09-13T17:18:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.939+0000 7f90eafae640 1 -- start start 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90eafae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90e41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90eafae640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90e406dcd0 0x7f90e406e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90eafae640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e406e660 con 0x7f90e41592d0 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90eafae640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e406c440 con 0x7f90e406dcd0 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90eafae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40b3450 con 0x7f90e40b2d00 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90e8d4a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90e41592d0 0x7f90e40cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57502/0 (socket says 172.21.15.5:57502) 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.940+0000 7f90e8d4a640 1 -- 172.21.15.5:0/3662085342 learned_addr learned my addr 172.21.15.5:0/3662085342 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:09.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071632087 0 0) 0x7f90cc001110 con 0x7f90e41592d0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d0003520 con 0x7f90e41592d0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> v2:172.21.15.179:3300/0 conn(0x7f90e406dcd0 0x7f90e406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e3fff640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90e41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2627301461 0 0) 0x7f90d0003520 con 0x7f90e41592d0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 msgr2=0x7f90e41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90e41596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 >> v2:172.21.15.179:3300/0 conn(0x7f90e406dcd0 msgr2=0x7f90e406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 --2- 172.21.15.5:0/3662085342 >> v2:172.21.15.179:3300/0 conn(0x7f90e406dcd0 0x7f90e406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40b3730 con 0x7f90e41592d0 2024-09-13T17:18:09.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f90cc001800 con 0x7f90e41592d0 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> v2:172.21.15.179:3300/0 conn(0x7f90e406dcd0 0x7f90e406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 >> v1:172.21.15.5:6789/0 conn(0x7f90e41592d0 legacy=0x7f90e40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90d0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d0003fa0 0x7f90d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e406c440 con 0x7f90d0004d00 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40b3450 con 0x7f90d0003fa0 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000dd50 con 0x7f90e40b2d00 2024-09-13T17:18:09.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e8d4a640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90d0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.941+0000 7f90e3fff640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d0003fa0 0x7f90d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 -- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 msgr2=0x7f90d0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b2d00 0x7f90d0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 -- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d0003fa0 msgr2=0x7f90d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90d0003fa0 0x7f90d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 -- 172.21.15.5:0/3662085342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0003520 con 0x7f90d0004d00 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e954b640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90d0005180 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0098a0 tx=0x7f90d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8fd7943ce76881 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc02ad20 con 0x7f90d0004d00 2024-09-13T17:18:09.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc02ae80 con 0x7f90d0004d00 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.942+0000 7f90e37fe640 1 -- 172.21.15.5:0/3662085342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004250 con 0x7f90d0004d00 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 -- 172.21.15.5:0/3662085342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 msgr2=0x7f90d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 --2- 172.21.15.5:0/3662085342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90d0005180 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0098a0 tx=0x7f90d00057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90e954b640 1 -- 172.21.15.5:0/3662085342 reap_dead start 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 -- 172.21.15.5:0/3662085342 shutdown_connections 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 -- 172.21.15.5:0/3662085342 >> 172.21.15.5:0/3662085342 conn(0x7f90e4066200 msgr2=0x7f90e4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 -- 172.21.15.5:0/3662085342 shutdown_connections 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.943+0000 7f90eafae640 1 -- 172.21.15.5:0/3662085342 wait complete. 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.944+0000 7f90eafae640 1 Processor -- start 2024-09-13T17:18:09.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.944+0000 7f90eafae640 1 -- start start 2024-09-13T17:18:09.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e4150eb0 0x7f90e40c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40c7f20 0x7f90e4152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41524f0 con 0x7f90d0004d00 2024-09-13T17:18:09.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41518e0 con 0x7f90e4150eb0 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90eafae640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4151bc0 con 0x7f90e40c7f20 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39254/0 (socket says 172.21.15.5:39254) 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 -- 172.21.15.5:0/3656683337 learned_addr learned my addr 172.21.15.5:0/3656683337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e954b640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40c7f20 0x7f90e4152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 -- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40c7f20 msgr2=0x7f90e4152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40c7f20 0x7f90e4152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 -- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e4150eb0 msgr2=0x7f90e40c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.945+0000 7f90e8d4a640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e4150eb0 0x7f90e40c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90e8d4a640 1 -- 172.21.15.5:0/3656683337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4151ea0 con 0x7f90d0004d00 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90e8d4a640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f90cc007310 tx=0x7f90cc0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00fa50 con 0x7f90d0004d00 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc00fbf0 con 0x7f90d0004d00 2024-09-13T17:18:09.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4152180 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0133f0 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.946+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e41e26c0 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.947+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e40672f0 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.947+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90cc013550 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.948+0000 7f90e17fa640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 0x7f90c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.948+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f90cc089540 con 0x7f90d0004d00 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.948+0000 7f90e3fff640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 0x7f90c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.949+0000 7f90e3fff640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 0x7f90c406d0c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90e41e1d60 tx=0x7f90d4009b20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:09.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:09.952+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90cc054670 con 0x7f90d0004d00 2024-09-13T17:18:10.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.122+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e406e660 con 0x7f90d0004d00 2024-09-13T17:18:10.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.124+0000 7f90e17fa640 1 -- 172.21.15.5:0/3656683337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f90e406e660 con 0x7f90d0004d00 2024-09-13T17:18:10.125 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:10.125 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.125+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 msgr2=0x7f90c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.125+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 0x7f90c406d0c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90e41e1d60 tx=0x7f90d4009b20 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 msgr2=0x7f90e414d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f90cc007310 tx=0x7f90cc0077d0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 shutdown_connections 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40c7f20 0x7f90e4152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e4150eb0 0x7f90e40c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90c406ac00 0x7f90c406d0c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 --2- 172.21.15.5:0/3656683337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d0004d00 0x7f90e414d110 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 >> 172.21.15.5:0/3656683337 conn(0x7f90e4066200 msgr2=0x7f90e40afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 shutdown_connections 2024-09-13T17:18:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.126+0000 7f90eafae640 1 -- 172.21.15.5:0/3656683337 wait complete. 2024-09-13T17:18:10.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:50.803411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:51.556188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:10.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.241+0000 7f33e2108640 1 Processor -- start 2024-09-13T17:18:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.241+0000 7f33e2108640 1 -- start start 2024-09-13T17:18:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33e2108640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33dc0acda0 0x7f33dc069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33e2108640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc0ad2b0 con 0x7f33dc06a410 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33e2108640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc0ad590 con 0x7f33dc15c470 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33e2108640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc06a8a0 con 0x7f33dc0acda0 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33daffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33dc0acda0 0x7f33dc069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33dbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33dc06a410 0x7f33dc0cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57506/0 (socket says 172.21.15.5:57506) 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.242+0000 7f33dbfff640 1 -- 172.21.15.5:0/557931854 learned_addr learned my addr 172.21.15.5:0/557931854 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.243+0000 7f33daffd640 1 -- 172.21.15.5:0/557931854 >> v1:172.21.15.179:6789/0 conn(0x7f33dc15c470 legacy=0x7f33dc0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.243+0000 7f33da7fc640 1 -- 172.21.15.5:0/557931854 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228192802 0 0) 0x7f33dc0ad2b0 con 0x7f33dc06a410 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.243+0000 7f33daffd640 1 -- 172.21.15.5:0/557931854 >> v1:172.21.15.5:6789/0 conn(0x7f33dc06a410 legacy=0x7f33dc0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.243+0000 7f33daffd640 1 -- 172.21.15.5:0/557931854 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0ad870 con 0x7f33dc0acda0 2024-09-13T17:18:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.243+0000 7f33daffd640 1 --2- 172.21.15.5:0/557931854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc0acda0 0x7f33dc069ed0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f33d00097a0 tx=0x7f33d002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1f0ae7178f0490 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33da7fc640 1 -- 172.21.15.5:0/557931854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0032440 con 0x7f33dc0acda0 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33da7fc640 1 -- 172.21.15.5:0/557931854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00325a0 con 0x7f33dc0acda0 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33da7fc640 1 -- 172.21.15.5:0/557931854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0032930 con 0x7f33dc0acda0 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 -- 172.21.15.5:0/557931854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc0acda0 msgr2=0x7f33dc069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 --2- 172.21.15.5:0/557931854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc0acda0 0x7f33dc069ed0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f33d00097a0 tx=0x7f33d002a230 comp rx=0 tx=0).stop 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 -- 172.21.15.5:0/557931854 shutdown_connections 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 --2- 172.21.15.5:0/557931854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc0acda0 0x7f33dc069ed0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 -- 172.21.15.5:0/557931854 >> 172.21.15.5:0/557931854 conn(0x7f33dc071970 msgr2=0x7f33dc098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 -- 172.21.15.5:0/557931854 shutdown_connections 2024-09-13T17:18:10.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.244+0000 7f33e2108640 1 -- 172.21.15.5:0/557931854 wait complete. 2024-09-13T17:18:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.245+0000 7f33e2108640 1 Processor -- start 2024-09-13T17:18:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 -- start start 2024-09-13T17:18:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc0acda0 0x7f33dc1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 0x7f33dc06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc15f430 con 0x7f33dc06a410 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc15e540 con 0x7f33dc15c470 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33e2108640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc15e820 con 0x7f33dc0acda0 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39278/0 (socket says 172.21.15.5:39278) 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.246+0000 7f33db7fe640 1 -- 172.21.15.5:0/792169385 learned_addr learned my addr 172.21.15.5:0/792169385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33dbfff640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 0x7f33dc06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33daffd640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc0acda0 0x7f33dc1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 -- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc0acda0 msgr2=0x7f33dc1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc0acda0 0x7f33dc1f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 -- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 msgr2=0x7f33dc06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 0x7f33dc06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 -- 172.21.15.5:0/792169385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0009400 con 0x7f33dc06a410 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33dbfff640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 0x7f33dc06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33db7fe640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00c400 tx=0x7f33cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0052d0 con 0x7f33dc06a410 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc005430 con 0x7f33dc06a410 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc15eb00 con 0x7f33dc06a410 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003830 con 0x7f33dc06a410 2024-09-13T17:18:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.247+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc15f0c0 con 0x7f33dc06a410 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.248+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc15fe00 con 0x7f33dc06a410 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.249+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33cc003990 con 0x7f33dc06a410 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.249+0000 7f33c3fff640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 0x7f33c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.249+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33cc088a40 con 0x7f33dc06a410 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.249+0000 7f33daffd640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 0x7f33c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.250+0000 7f33daffd640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 0x7f33c806d0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f33d0034000 tx=0x7f33d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.254+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33cc08ae60 con 0x7f33dc06a410 2024-09-13T17:18:10.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.424+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33dc066dd0 con 0x7f33dc06a410 2024-09-13T17:18:10.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.424+0000 7f33c3fff640 1 -- 172.21.15.5:0/792169385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33cc0170a0 con 0x7f33dc06a410 2024-09-13T17:18:10.425 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 msgr2=0x7f33c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 0x7f33c806d0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f33d0034000 tx=0x7f33d002e000 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 msgr2=0x7f33dc147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00c400 tx=0x7f33cc00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 shutdown_connections 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33dc15c470 0x7f33dc06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33dc0acda0 0x7f33dc1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f33c806ac00 0x7f33c806d0c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 --2- 172.21.15.5:0/792169385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33dc06a410 0x7f33dc147c50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 >> 172.21.15.5:0/792169385 conn(0x7f33dc071970 msgr2=0x7f33dc158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.426+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 shutdown_connections 2024-09-13T17:18:10.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.427+0000 7f33e2108640 1 -- 172.21.15.5:0/792169385 wait complete. 2024-09-13T17:18:10.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.542+0000 7fc3f2e72640 1 Processor -- start 2024-09-13T17:18:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.542+0000 7fc3f2e72640 1 -- start start 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f2e72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 0x7fc3ec0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f2e72640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3ec159860 0x7fc3ec159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f2e72640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0b37c0 con 0x7fc3ec06e360 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f2e72640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0cbed0 con 0x7fc3ec159860 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f2e72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0b21e0 con 0x7fc3ec06df80 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3ec159860 0x7fc3ec159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3ebfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3ec06e360 0x7fc3ec0cb7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57508/0 (socket says 172.21.15.5:57508) 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3ec159860 0x7fc3ec159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39284/0 (socket says 172.21.15.5:39284) 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3ebfff640 1 -- 172.21.15.5:0/1400584963 learned_addr learned my addr 172.21.15.5:0/1400584963 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 -- 172.21.15.5:0/1400584963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 msgr2=0x7fc3ec0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f0c0e640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 0x7fc3ec0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 0x7fc3ec0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 -- 172.21.15.5:0/1400584963 >> v1:172.21.15.5:6789/0 conn(0x7fc3ec06e360 legacy=0x7fc3ec0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3eb7fe640 1 -- 172.21.15.5:0/1400584963 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171923170 0 0) 0x7fc3ec0b37c0 con 0x7fc3ec06e360 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f140f640 1 -- 172.21.15.5:0/1400584963 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0b24c0 con 0x7fc3ec159860 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.543+0000 7fc3f0c0e640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 0x7fc3ec0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.544+0000 7fc3f140f640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec159860 0x7fc3ec159cf0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009d90 tx=0x7fc3e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac000865bc511b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.544+0000 7fc3eb7fe640 1 -- 172.21.15.5:0/1400584963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4007740 con 0x7fc3ec159860 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.544+0000 7fc3eb7fe640 1 -- 172.21.15.5:0/1400584963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e402d050 con 0x7fc3ec159860 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.544+0000 7fc3eb7fe640 1 -- 172.21.15.5:0/1400584963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4007ac0 con 0x7fc3ec159860 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 -- 172.21.15.5:0/1400584963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec159860 msgr2=0x7fc3ec159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec159860 0x7fc3ec159cf0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009d90 tx=0x7fc3e402a660 comp rx=0 tx=0).stop 2024-09-13T17:18:10.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 -- 172.21.15.5:0/1400584963 shutdown_connections 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec159860 0x7fc3ec159cf0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/1400584963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06df80 0x7fc3ec0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 -- 172.21.15.5:0/1400584963 >> 172.21.15.5:0/1400584963 conn(0x7fc3ec069ed0 msgr2=0x7fc3ec06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 -- 172.21.15.5:0/1400584963 shutdown_connections 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.545+0000 7fc3f2e72640 1 -- 172.21.15.5:0/1400584963 wait complete. 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.546+0000 7fc3f2e72640 1 Processor -- start 2024-09-13T17:18:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.546+0000 7fc3f2e72640 1 -- start start 2024-09-13T17:18:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06e360 0x7fc3ec14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 0x7fc3ec0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0c7cb0 con 0x7fc3ec06df80 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0adc40 con 0x7fc3ec159860 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f2e72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0c4a50 con 0x7fc3ec06e360 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39288/0 (socket says 172.21.15.5:39288) 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 -- 172.21.15.5:0/3689211657 learned_addr learned my addr 172.21.15.5:0/3689211657 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3ebfff640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06e360 0x7fc3ec14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f140f640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 0x7fc3ec0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 -- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06e360 msgr2=0x7fc3ec14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06e360 0x7fc3ec14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 -- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 msgr2=0x7fc3ec0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 0x7fc3ec0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f0c0e640 1 -- 172.21.15.5:0/3689211657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009a70 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.547+0000 7fc3f140f640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 0x7fc3ec0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3f0c0e640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c7f0 tx=0x7fc3e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0007820 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0007980 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0007cf0 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec0aae00 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.548+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec0ab3c0 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.549+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec0ab550 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.549+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3e00113f0 con 0x7fc3ec06df80 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.550+0000 7fc3e97fa640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 0x7fc3d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.550+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3e0089700 con 0x7fc3ec06df80 2024-09-13T17:18:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.550+0000 7fc3ebfff640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 0x7fc3d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.551+0000 7fc3ebfff640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 0x7fc3d006d0c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c5080 tx=0x7fc3d8007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.554+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc3e0054850 con 0x7fc3ec06df80 2024-09-13T17:18:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.726+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3ec06c400 con 0x7fc3ec06df80 2024-09-13T17:18:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.726+0000 7fc3e97fa640 1 -- 172.21.15.5:0/3689211657 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3e0057e70 con 0x7fc3ec06df80 2024-09-13T17:18:10.727 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 msgr2=0x7fc3d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 0x7fc3d006d0c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c5080 tx=0x7fc3d8007de0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 msgr2=0x7fc3ec0c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c7f0 tx=0x7fc3e000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 shutdown_connections 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3ec159860 0x7fc3ec0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3ec06e360 0x7fc3ec14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc3d006ac00 0x7fc3d006d0c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 --2- 172.21.15.5:0/3689211657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec06df80 0x7fc3ec0c7770 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 >> 172.21.15.5:0/3689211657 conn(0x7fc3ec069ed0 msgr2=0x7fc3ec155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 shutdown_connections 2024-09-13T17:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.728+0000 7fc3f2e72640 1 -- 172.21.15.5:0/3689211657 wait complete. 2024-09-13T17:18:10.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 Processor -- start 2024-09-13T17:18:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 -- start start 2024-09-13T17:18:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12815c760 0x7ff1280cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d20c0 0x7ff1280cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1280d34d0 con 0x7ff1280d1b00 2024-09-13T17:18:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1280cddb0 con 0x7ff12815c760 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.845+0000 7ff12cae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280b5700 con 0x7ff1280d20c0 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12815c760 0x7ff1280cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12815c760 0x7ff1280cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39304/0 (socket says 172.21.15.5:39304) 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 -- 172.21.15.5:0/683330009 learned_addr learned my addr 172.21.15.5:0/683330009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff11ffff640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d20c0 0x7ff1280cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 -- 172.21.15.5:0/683330009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d20c0 msgr2=0x7ff1280cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d20c0 0x7ff1280cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 -- 172.21.15.5:0/683330009 >> v1:172.21.15.179:6789/0 conn(0x7ff1280d1b00 legacy=0x7ff1280b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.846+0000 7ff12659c640 1 -- 172.21.15.5:0/683330009 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280d2950 con 0x7ff12815c760 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12659c640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12815c760 0x7ff1280cf640 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7ff118009870 tx=0x7ff11802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f29feb8bf7d1091 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff125d9b640 1 -- 172.21.15.5:0/683330009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11802ae90 con 0x7ff12815c760 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff125d9b640 1 -- 172.21.15.5:0/683330009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118032440 con 0x7ff12815c760 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff125d9b640 1 -- 172.21.15.5:0/683330009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180327d0 con 0x7ff12815c760 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 -- 172.21.15.5:0/683330009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12815c760 msgr2=0x7ff1280cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12815c760 0x7ff1280cf640 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7ff118009870 tx=0x7ff11802a180 comp rx=0 tx=0).stop 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 -- 172.21.15.5:0/683330009 shutdown_connections 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d20c0 0x7ff1280cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 --2- 172.21.15.5:0/683330009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12815c760 0x7ff1280cf640 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 -- 172.21.15.5:0/683330009 >> 172.21.15.5:0/683330009 conn(0x7ff128071a20 msgr2=0x7ff128071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 -- 172.21.15.5:0/683330009 shutdown_connections 2024-09-13T17:18:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.847+0000 7ff12cae5640 1 -- 172.21.15.5:0/683330009 wait complete. 2024-09-13T17:18:10.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.849+0000 7ff12cae5640 1 Processor -- start 2024-09-13T17:18:10.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.849+0000 7ff12cae5640 1 -- start start 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.849+0000 7ff12cae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d1b00 0x7ff1280c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.849+0000 7ff12cae5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.849+0000 7ff12cae5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff12815c760 0x7ff1281520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12cae5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff128159910 con 0x7ff1280d20c0 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12cae5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff128152620 con 0x7ff12815c760 2024-09-13T17:18:10.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12cae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1280c7ac0 con 0x7ff1280d1b00 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39320/0 (socket says 172.21.15.5:39320) 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 -- 172.21.15.5:0/2228025989 learned_addr learned my addr 172.21.15.5:0/2228025989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12659c640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d1b00 0x7ff1280c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff126d9d640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff12815c760 0x7ff1281520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 -- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d1b00 msgr2=0x7ff1280c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d1b00 0x7ff1280c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 -- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff12815c760 msgr2=0x7ff1281520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff12815c760 0x7ff1281520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 -- 172.21.15.5:0/2228025989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180094d0 con 0x7ff1280d20c0 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11ffff640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c7f0 tx=0x7ff11000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110004220 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1100043a0 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110007860 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1280c7da0 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.850+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1280c8360 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.851+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1280d2580 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.852+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff1100079c0 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.852+0000 7ff11effd640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 0x7ff10806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.852+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff110089290 con 0x7ff1280d20c0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.852+0000 7ff12659c640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 0x7ff10806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:10.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.853+0000 7ff12659c640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 0x7ff10806d0c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff118034000 tx=0x7ff11802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:10.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:10.856+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff110054330 con 0x7ff1280d20c0 2024-09-13T17:18:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.026+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff128073770 con 0x7ff1280d20c0 2024-09-13T17:18:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.027+0000 7ff11effd640 1 -- 172.21.15.5:0/2228025989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff110057950 con 0x7ff1280d20c0 2024-09-13T17:18:11.028 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 msgr2=0x7ff10806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 0x7ff10806d0c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff118034000 tx=0x7ff11802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 msgr2=0x7ff1281593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c7f0 tx=0x7ff11000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 shutdown_connections 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff12815c760 0x7ff1281520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff10806ac00 0x7ff10806d0c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1280d20c0 0x7ff1281593d0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 --2- 172.21.15.5:0/2228025989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1280d1b00 0x7ff1280c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 >> 172.21.15.5:0/2228025989 conn(0x7ff128071a20 msgr2=0x7ff1280b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 shutdown_connections 2024-09-13T17:18:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.029+0000 7ff12cae5640 1 -- 172.21.15.5:0/2228025989 wait complete. 2024-09-13T17:18:11.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.143+0000 7f803ce32640 1 Processor -- start 2024-09-13T17:18:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.143+0000 7f803ce32640 1 -- start start 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803ce32640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f803815c540 0x7f803806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803ce32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f80380ad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803ce32640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803806de70 con 0x7f80380abd90 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803ce32640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803806e150 con 0x7f803815c540 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803ce32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803806e430 con 0x7f80380cb1c0 2024-09-13T17:18:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f8036d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80380abd90 0x7f80380b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57518/0 (socket says 172.21.15.5:57518) 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f8036d9d640 1 -- 172.21.15.5:0/913572966 learned_addr learned my addr 172.21.15.5:0/913572966 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834607800 0 0) 0x7f803806de70 con 0x7f80380abd90 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f8035d9b640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f80380ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803659c640 1 --2- 172.21.15.5:0/913572966 >> v2:172.21.15.179:3300/0 conn(0x7f803815c540 0x7f803806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.144+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8020003520 con 0x7f80380abd90 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1783006695 0 0) 0x7f8020003520 con 0x7f80380abd90 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 msgr2=0x7f80380ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f80380ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 >> v2:172.21.15.179:3300/0 conn(0x7f803815c540 msgr2=0x7f803806ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 --2- 172.21.15.5:0/913572966 >> v2:172.21.15.179:3300/0 conn(0x7f803815c540 0x7f803806ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803806e710 con 0x7f80380abd90 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f80300019f0 con 0x7f80380abd90 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 >> v1:172.21.15.5:6789/0 conn(0x7f80380abd90 legacy=0x7f80380b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200047c0 0x7f8020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f8020005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803806e150 con 0x7f80200047c0 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803806e430 con 0x7f8020003970 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802000b980 con 0x7f80380cb1c0 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200047c0 0x7f8020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f803659c640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8036d9d640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f8020005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 -- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 msgr2=0x7f8020005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80380cb1c0 0x7f8020005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 -- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8020003970 msgr2=0x7f8020003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.145+0000 7f8035d9b640 1 -- 172.21.15.5:0/913572966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020003520 con 0x7f80200047c0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f8035d9b640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200047c0 0x7f8020004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f802c009a90 tx=0x7f80200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf627a135702d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c031400 con 0x7f80200047c0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c02d050 con 0x7f80200047c0 2024-09-13T17:18:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f803559a640 1 -- 172.21.15.5:0/913572966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c031780 con 0x7f80200047c0 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f803ce32640 1 -- 172.21.15.5:0/913572966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200047c0 msgr2=0x7f8020004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.146+0000 7f803ce32640 1 --2- 172.21.15.5:0/913572966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200047c0 0x7f8020004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f802c009a90 tx=0x7f80200057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.147+0000 7f8036d9d640 1 -- 172.21.15.5:0/913572966 reap_dead start 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.147+0000 7f803ce32640 1 -- 172.21.15.5:0/913572966 shutdown_connections 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.147+0000 7f803ce32640 1 -- 172.21.15.5:0/913572966 >> 172.21.15.5:0/913572966 conn(0x7f80380719e0 msgr2=0x7f8038069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.147+0000 7f803ce32640 1 -- 172.21.15.5:0/913572966 shutdown_connections 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.147+0000 7f803ce32640 1 -- 172.21.15.5:0/913572966 wait complete. 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.148+0000 7f803ce32640 1 Processor -- start 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.148+0000 7f803ce32640 1 -- start start 2024-09-13T17:18:11.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80200047c0 0x7f8038155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80381f2e60 0x7f8038156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038159320 con 0x7f8038157090 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038157510 con 0x7f80200047c0 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803ce32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8038158730 con 0x7f80381f2e60 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39346/0 (socket says 172.21.15.5:39346) 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 -- 172.21.15.5:0/1599075655 learned_addr learned my addr 172.21.15.5:0/1599075655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:11.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8035d9b640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80381f2e60 0x7f8038156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f803659c640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80200047c0 0x7f8038155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 -- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80381f2e60 msgr2=0x7f8038156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80381f2e60 0x7f8038156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 -- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80200047c0 msgr2=0x7f8038155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80200047c0 0x7f8038155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 -- 172.21.15.5:0/1599075655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8038158980 con 0x7f8038157090 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.149+0000 7f8036d9d640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f80380caed0 tx=0x7f803000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.150+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000aca0 con 0x7f8038157090 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.150+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000ae20 con 0x7f8038157090 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.150+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038158c60 con 0x7f8038157090 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.150+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030013630 con 0x7f8038157090 2024-09-13T17:18:11.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.150+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80381f32c0 con 0x7f8038157090 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.151+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8038159460 con 0x7f8038157090 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.151+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8030013790 con 0x7f8038157090 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.152+0000 7f8026ffd640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 0x7f801806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.152+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8030089db0 con 0x7f8038157090 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.152+0000 7f803659c640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 0x7f801806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.152+0000 7f803659c640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 0x7f801806d0f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8028009bc0 tx=0x7f8028009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:11.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.156+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8038159460 con 0x7f8038157090 2024-09-13T17:18:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.338+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8038159460 con 0x7f8038157090 2024-09-13T17:18:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.338+0000 7f8026ffd640 1 -- 172.21.15.5:0/1599075655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8038159460 con 0x7f8038157090 2024-09-13T17:18:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 msgr2=0x7f801806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 0x7f801806d0f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8028009bc0 tx=0x7f8028009190 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 msgr2=0x7f803815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f80380caed0 tx=0x7f803000a6a0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 shutdown_connections 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f801806ac30 0x7f801806d0f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8038157090 0x7f803815afe0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80381f2e60 0x7f8038156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 --2- 172.21.15.5:0/1599075655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80200047c0 0x7f8038155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 >> 172.21.15.5:0/1599075655 conn(0x7f80380719e0 msgr2=0x7f80380af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 shutdown_connections 2024-09-13T17:18:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:11.340+0000 7f803ce32640 1 -- 172.21.15.5:0/1599075655 wait complete. 2024-09-13T17:18:11.352 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:18:11.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:11.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:11.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[47587]: fuse finished with error 0 and tester_r 0 2024-09-13T17:18:11.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:12.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:18:12.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:18:17.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:18:17.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:17.486 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:18:17.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.619+0000 7f4b036f7640 1 Processor -- start 2024-09-13T17:18:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.620+0000 7f4b036f7640 1 -- start start 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.620+0000 7f4b036f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4afc15c9f0 0x7f4afc0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.620+0000 7f4b036f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b036f7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc15cdd0 con 0x7f4afc0cd630 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b036f7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc0b8750 con 0x7f4afc15c9f0 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b036f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0d2c20 con 0x7f4afc0b5820 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4afc15c9f0 0x7f4afc0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4afc15c9f0 0x7f4afc0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51618/0 (socket says 172.21.15.5:51618) 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 -- 172.21.15.5:0/1362468140 learned_addr learned my addr 172.21.15.5:0/1362468140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01c94640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 -- 172.21.15.5:0/1362468140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 msgr2=0x7f4afc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 -- 172.21.15.5:0/1362468140 >> v1:172.21.15.179:6789/0 conn(0x7f4afc0cd630 legacy=0x7f4afc0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01493640 1 -- 172.21.15.5:0/1362468140 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0d3040 con 0x7f4afc15c9f0 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.621+0000 7f4b01c94640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.622+0000 7f4b01493640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc0b4170 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009870 tx=0x7f4af802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5441023e9ef1fe96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.622+0000 7f4af3fff640 1 -- 172.21.15.5:0/1362468140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8032440 con 0x7f4afc15c9f0 2024-09-13T17:18:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.622+0000 7f4af3fff640 1 -- 172.21.15.5:0/1362468140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af80325a0 con 0x7f4afc15c9f0 2024-09-13T17:18:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.622+0000 7f4af3fff640 1 -- 172.21.15.5:0/1362468140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8032930 con 0x7f4afc15c9f0 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 -- 172.21.15.5:0/1362468140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 msgr2=0x7f4afc0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc0b4170 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009870 tx=0x7f4af802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 -- 172.21.15.5:0/1362468140 shutdown_connections 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 --2- 172.21.15.5:0/1362468140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc0b4170 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 -- 172.21.15.5:0/1362468140 >> 172.21.15.5:0/1362468140 conn(0x7f4afc071a20 msgr2=0x7f4afc071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 -- 172.21.15.5:0/1362468140 shutdown_connections 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.623+0000 7f4b036f7640 1 -- 172.21.15.5:0/1362468140 wait complete. 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.624+0000 7f4b036f7640 1 Processor -- start 2024-09-13T17:18:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.624+0000 7f4b036f7640 1 -- start start 2024-09-13T17:18:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 0x7f4afc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0b3120 con 0x7f4afc15c9f0 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0b3330 con 0x7f4afc0cd630 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b036f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0b3610 con 0x7f4afc0b5820 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51622/0 (socket says 172.21.15.5:51622) 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 -- 172.21.15.5:0/2372367583 learned_addr learned my addr 172.21.15.5:0/2372367583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01493640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b00c92640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 0x7f4afc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 -- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 msgr2=0x7f4afc0c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 -- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 msgr2=0x7f4afc0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 0x7f4afc0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 -- 172.21.15.5:0/2372367583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80094d0 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b00c92640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 0x7f4afc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.625+0000 7f4b01c94640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007ef0 tx=0x7f4af400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.626+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4003b90 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.626+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400f040 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.626+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc0c7310 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.626+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400de80 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.626+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc0c78d0 con 0x7f4afc15c9f0 2024-09-13T17:18:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.627+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc0b1e70 con 0x7f4afc15c9f0 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.627+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4af4004030 con 0x7f4afc15c9f0 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.628+0000 7f4af1ffb640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 0x7f4ae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.628+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4af4089700 con 0x7f4afc15c9f0 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.628+0000 7f4b01493640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 0x7f4ae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.629+0000 7f4b01493640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 0x7f4ae006d0c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4af8034000 tx=0x7f4af802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.632+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4af4054850 con 0x7f4afc15c9f0 2024-09-13T17:18:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.839+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4afc0c7a90 con 0x7f4afc15c9f0 2024-09-13T17:18:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.839+0000 7f4af1ffb640 1 -- 172.21.15.5:0/2372367583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f4af4057e70 con 0x7f4afc15c9f0 2024-09-13T17:18:17.841 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:17.841 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 msgr2=0x7f4ae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 0x7f4ae006d0c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4af8034000 tx=0x7f4af802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 msgr2=0x7f4afc15d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007ef0 tx=0x7f4af400d4a0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 shutdown_connections 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4ae006ac00 0x7f4ae006d0c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc15c9f0 0x7f4afc15d6e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4afc0cd630 0x7f4afc0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 --2- 172.21.15.5:0/2372367583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4afc0b5820 0x7f4afc0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 >> 172.21.15.5:0/2372367583 conn(0x7f4afc071a20 msgr2=0x7f4afc15b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 shutdown_connections 2024-09-13T17:18:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.841+0000 7f4b036f7640 1 -- 172.21.15.5:0/2372367583 wait complete. 2024-09-13T17:18:17.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2024-09-13T17:18:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.955+0000 7f5ed226b640 1 Processor -- start 2024-09-13T17:18:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 -- start start 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 0x7f5ecc06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc1598c0 con 0x7f5ecc157060 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0ce290 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.956+0000 7f5ed226b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0cbda0 con 0x7f5ecc0cb620 2024-09-13T17:18:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51624/0 (socket says 172.21.15.5:51624) 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1830862329 learned_addr learned my addr 172.21.15.5:0/1830862329 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ed0808640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 0x7f5ecc06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1830862329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 msgr2=0x7f5ecc06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 0x7f5ecc06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1830862329 >> v1:172.21.15.179:6789/0 conn(0x7f5ecc157060 legacy=0x7f5ecc0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1830862329 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc15a8e0 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.957+0000 7f5ed0808640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 0x7f5ecc06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.958+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009870 tx=0x7f5eb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd7ca38e11032 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.958+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/1830862329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4032440 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.958+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/1830862329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb40325a0 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.958+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/1830862329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4032930 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 -- 172.21.15.5:0/1830862329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc0b2da0 msgr2=0x7f5ecc0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009870 tx=0x7f5eb402a270 comp rx=0 tx=0).stop 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 -- 172.21.15.5:0/1830862329 shutdown_connections 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0cb620 0x7f5ecc06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 --2- 172.21.15.5:0/1830862329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc0b2da0 0x7f5ecc0cb0e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 -- 172.21.15.5:0/1830862329 >> 172.21.15.5:0/1830862329 conn(0x7f5ecc0b0180 msgr2=0x7f5ecc0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 -- 172.21.15.5:0/1830862329 shutdown_connections 2024-09-13T17:18:17.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.959+0000 7f5ed226b640 1 -- 172.21.15.5:0/1830862329 wait complete. 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.960+0000 7f5ed226b640 1 Processor -- start 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.960+0000 7f5ed226b640 1 -- start start 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 0x7f5ecc0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 0x7f5ecc14ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14d370 con 0x7f5ecc157060 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c4e20 con 0x7f5ecc0cb620 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0afe70 con 0x7f5ecc0b2da0 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51634/0 (socket says 172.21.15.5:51634) 2024-09-13T17:18:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 -- 172.21.15.5:0/3719394353 learned_addr learned my addr 172.21.15.5:0/3719394353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 0x7f5ecc0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 0x7f5ecc14ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 -- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 msgr2=0x7f5ecc0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 0x7f5ecc0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 -- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 msgr2=0x7f5ecc14ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 0x7f5ecc14ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 -- 172.21.15.5:0/3719394353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40094d0 con 0x7f5ecc157060 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 0x7f5ecc0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 0x7f5ecc14ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed0808640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4007f50 tx=0x7f5ec400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ec97fa640 1 -- 172.21.15.5:0/3719394353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003b90 con 0x7f5ecc157060 2024-09-13T17:18:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ec97fa640 1 -- 172.21.15.5:0/3719394353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec400f040 con 0x7f5ecc157060 2024-09-13T17:18:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc0c4210 con 0x7f5ecc157060 2024-09-13T17:18:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.961+0000 7f5ec97fa640 1 -- 172.21.15.5:0/3719394353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400dec0 con 0x7f5ecc157060 2024-09-13T17:18:17.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.962+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0c47d0 con 0x7f5ecc157060 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.963+0000 7f5ec97fa640 1 -- 172.21.15.5:0/3719394353 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ec4004030 con 0x7f5ecc157060 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.963+0000 7f5ec97fa640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 0x7f5eac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.963+0000 7f5ec97fa640 1 -- 172.21.15.5:0/3719394353 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5ec4089790 con 0x7f5ecc157060 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.964+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 0x7f5eac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.964+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 0x7f5eac06d0f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000f60 tx=0x7f5ebc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 Processor -- start 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 -- start start 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 0x56134eb41ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134ea63cc0 con 0x56134eb205d0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134ea61450 con 0x56134eb40e70 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56134ea5cd40 con 0x56134eb415b0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed0808640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed0808640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51642/0 (socket says 172.21.15.5:51642) 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.965+0000 7f5ed0808640 1 -- 172.21.15.5:0/2436037661 learned_addr learned my addr 172.21.15.5:0/2436037661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 0x56134eb41ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 -- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 msgr2=0x56134eb41990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb41990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 -- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 msgr2=0x56134eb41ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 0x56134eb41ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 -- 172.21.15.5:0/2436037661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134ea24620 con 0x56134eb205d0 2024-09-13T17:18:17.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 0x56134eb41ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ed0808640 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4004000 tx=0x7f5ec4058dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2956135cff0241b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ec1ffb640 1 -- 172.21.15.5:0/2436037661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4060970 con 0x56134eb205d0 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ec1ffb640 1 -- 172.21.15.5:0/2436037661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40566c0 con 0x56134eb205d0 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.966+0000 7f5ec1ffb640 1 -- 172.21.15.5:0/2436037661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4054c90 con 0x56134eb205d0 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- 172.21.15.5:0/2436037661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 msgr2=0x56134eb20a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4004000 tx=0x7f5ec4058dc0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- 172.21.15.5:0/2436037661 shutdown_connections 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb205d0 0x56134eb20a50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb40e70 0x56134eb41ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 --2- 172.21.15.5:0/2436037661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- 172.21.15.5:0/2436037661 >> 172.21.15.5:0/2436037661 conn(0x56134eaf7910 msgr2=0x56134eb3fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- 172.21.15.5:0/2436037661 shutdown_connections 2024-09-13T17:18:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- 172.21.15.5:0/2436037661 wait complete. 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 -- start start 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.967+0000 7f5ed506c740 1 Processor -- start 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eaf5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134ea1b180 con 0x56134eb40e70 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134e735430 con 0x56134eaf5590 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56134e9e05e0 con 0x56134eb415b0 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed506c740 10 client.0 _ll_register_callbacks cb 0x56134ea4caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51656/0 (socket says 172.21.15.5:51656) 2024-09-13T17:18:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ecbfff640 1 -- 172.21.15.5:0/3118842391 learned_addr learned my addr 172.21.15.5:0/3118842391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eaf5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.968+0000 7f5ed0808640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb1f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 -- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 msgr2=0x56134eaf5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eaf5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 -- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 msgr2=0x56134eb1f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb1f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 -- 172.21.15.5:0/3118842391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0c47d0 con 0x56134eb40e70 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eaf5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed0808640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb1f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00ea30 tx=0x7f5ebc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1913f1b4755ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc005480 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5ebc003d80 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56134ea86b80 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ebc013420 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 10 client.8061 fetch_fsmap learned FSMap version 42 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x56134ea5b3c0 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56134ea86b80 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5ebc013580 con 0x56134eb40e70 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 10 client.8061 fetch_fsmap finished waiting for FSMap version 42 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 10 client.8061 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 20 client.8061 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eb24d80 0x56134eb25160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 4 client.8061 mds_command: new command op to 7722 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.969+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 --> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56134ea4f1f0 con 0x56134eb24d80 2024-09-13T17:18:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eb24d80 0x56134eb25160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eb24d80 0x56134eb25160 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c41f405aaf16370 server_cookie=794bee686af4285f in_seq=0 out_seq=0 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5eaaffd640 10 client.8061 ms_handle_connect on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3118842391 <== mds.0 v2:172.21.15.5:6832/2901929120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56134ea4f1f0 con 0x56134eb24d80 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5eaaffd640 10 client.8061 handle_command_reply: tid=0 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.970+0000 7f5ed506c740 1 client.8061 shutdown 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 msgr2=0x56134eb37980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00ea30 tx=0x7f5ebc000ed0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 shutdown_connections 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eb24d80 0x56134eb25160 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb1f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eaf5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5eaaffd640 0 client.8061 ms_handle_reset on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 --2- 172.21.15.5:0/3118842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eb37980 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 >> 172.21.15.5:0/3118842391 conn(0x56134eb205d0 msgr2=0x56134eaf6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 shutdown_connections 2024-09-13T17:18:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 1 -- 172.21.15.5:0/3118842391 wait complete. 2024-09-13T17:18:17.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.971+0000 7f5ed506c740 20 client.8061 trim_cache size 0 max 16384 2024-09-13T17:18:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.986+0000 7f5ed506c740 1 Processor -- start 2024-09-13T17:18:17.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.986+0000 7f5ed506c740 1 -- start start 2024-09-13T17:18:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb40e70 0x56134eaf48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb415b0 0x56134eaf4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134eb52320 con 0x56134eaf5590 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134eb3d330 con 0x56134eb415b0 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56134eaf4700 con 0x56134eb40e70 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51668/0 (socket says 172.21.15.5:51668) 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 -- 172.21.15.5:0/988415509 learned_addr learned my addr 172.21.15.5:0/988415509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 -- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb40e70 msgr2=0x56134eaf48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb40e70 0x56134eaf48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 -- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb415b0 msgr2=0x56134eaf4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb415b0 0x56134eaf4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 -- 172.21.15.5:0/988415509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134e9fd770 con 0x56134eaf5590 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0013e0 tx=0x7f5ebc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76f3813cfdbefaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ec27fc640 1 -- 172.21.15.5:0/988415509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc005390 con 0x56134eaf5590 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ec27fc640 1 -- 172.21.15.5:0/988415509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc003d80 con 0x56134eaf5590 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.987+0000 7f5ec27fc640 1 -- 172.21.15.5:0/988415509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc013a40 con 0x56134eaf5590 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- 172.21.15.5:0/988415509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 msgr2=0x56134eb36e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0013e0 tx=0x7f5ebc01f000 comp rx=0 tx=0).stop 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- 172.21.15.5:0/988415509 shutdown_connections 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eb415b0 0x56134eaf4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb40e70 0x56134eaf48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 --2- 172.21.15.5:0/988415509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eaf5590 0x56134eb36e20 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- 172.21.15.5:0/988415509 >> 172.21.15.5:0/988415509 conn(0x56134eb205d0 msgr2=0x56134eb37780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:17.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- 172.21.15.5:0/988415509 shutdown_connections 2024-09-13T17:18:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- 172.21.15.5:0/988415509 wait complete. 2024-09-13T17:18:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.988+0000 7f5ed506c740 1 -- start start 2024-09-13T17:18:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 Processor -- start 2024-09-13T17:18:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb3e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb8f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134eb914c0 con 0x56134eb40e70 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134eb37b20 con 0x56134eaf5590 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56134eb36f30 con 0x56134eb415b0 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ed506c740 10 client.0 _ll_register_callbacks cb 0x7f5ec4054940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51680/0 (socket says 172.21.15.5:51680) 2024-09-13T17:18:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.989+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1337294613 learned_addr learned my addr 172.21.15.5:0/1337294613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 msgr2=0x56134eb8f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb8f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 msgr2=0x56134eb3e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb3e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb3e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 -- 172.21.15.5:0/1337294613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56134ea5b3c0 con 0x56134eb40e70 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ec3fff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5eb402a860 tx=0x7f5eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f99490912e4f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5eaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4045b80 con 0x56134eb40e70 2024-09-13T17:18:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5eb4045ce0 con 0x56134eb40e70 2024-09-13T17:18:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ec40566c0 con 0x56134eb40e70 2024-09-13T17:18:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb4045ea0 con 0x56134eb40e70 2024-09-13T17:18:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ed506c740 10 client.8067 fetch_fsmap learned FSMap version 42 2024-09-13T17:18:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.990+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x56134ea22e80 con 0x56134eb40e70 2024-09-13T17:18:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40566c0 con 0x56134eb40e70 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5eb40453a0 con 0x56134eb40e70 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 10 client.8067 fetch_fsmap finished waiting for FSMap version 42 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 10 client.8067 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 20 client.8067 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eaf4910 0x56134eaf4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 4 client.8067 mds_command: new command op to 7722 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 --> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x56134e7504e0 con 0x56134eaf4910 2024-09-13T17:18:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eaf4910 0x56134eaf4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 10 client.8067 ms_handle_connect on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eaf4910 0x56134eaf4d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb5dcc89a8eca69 server_cookie=ffb0fdd6fb123d8f in_seq=0 out_seq=0 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 1 -- 172.21.15.5:0/1337294613 <== mds.0 v2:172.21.15.5:6832/2901929120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56134e7504e0 con 0x56134eaf4910 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 10 client.8067 handle_command_reply: tid=0 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 client.8067 shutdown 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 msgr2=0x56134eaf6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5eb402a860 tx=0x7f5eb40046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 shutdown_connections 2024-09-13T17:18:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:6832/2901929120,v1:172.21.15.5:6833/2901929120] conn(0x56134eaf4910 0x56134eaf4d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56134eb415b0 0x56134eb8f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56134eb40e70 0x56134eaf6b70 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 --2- 172.21.15.5:0/1337294613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56134eaf5590 0x56134eb3e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5eaaffd640 0 client.8067 ms_handle_reset on v2:172.21.15.5:6832/2901929120 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.991+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 >> 172.21.15.5:0/1337294613 conn(0x56134eb205d0 msgr2=0x56134eb3f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 shutdown_connections 2024-09-13T17:18:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed506c740 1 -- 172.21.15.5:0/1337294613 wait complete. 2024-09-13T17:18:18.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed506c740 20 client.8067 trim_cache size 0 max 16384 2024-09-13T17:18:18.003 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-13T17:18:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 msgr2=0x7f5eac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 0x7f5eac06d0f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000f60 tx=0x7f5ebc009040 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 msgr2=0x7f5ecc0af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4007f50 tx=0x7f5ec400d560 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 shutdown_connections 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5eac06ac30 0x7f5eac06d0f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ecc157060 0x7f5ecc0af930 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ecc0cb620 0x7f5ecc14ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 --2- 172.21.15.5:0/3719394353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ecc0b2da0 0x7f5ecc0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 >> 172.21.15.5:0/3719394353 conn(0x7f5ecc0b0180 msgr2=0x7f5ecc0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 shutdown_connections 2024-09-13T17:18:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:17.992+0000 7f5ed226b640 1 -- 172.21.15.5:0/3719394353 wait complete. 2024-09-13T17:18:18.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T17:18:18.124 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-13T17:18:18.124 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T17:18:18.125 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:18:18.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:18:18.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:18:18.210 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:18:18.210 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:18.210 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:18.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:18:18.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:18:18.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:18.227 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:18:18.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:18:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T17:18:18.283 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:18.283 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:18.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:18:18.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:18:18.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:18.302 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:18:18.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:18:18.361 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T17:18:18.361 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:18.361 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:18.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:18:18.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:18:18.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:18.377 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:18:18.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:18:18.432 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:18:18.433 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:18.433 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:18.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:18:18.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:18:18.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:18.451 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:18:18.512 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:18:18.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:18:18.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:18.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.615+0000 7f3948545640 1 Processor -- start 2024-09-13T17:18:18.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.615+0000 7f3948545640 1 -- start start 2024-09-13T17:18:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3948545640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f394015a880 0x7f39400cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3948545640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f39400cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3948545640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400b2180 con 0x7f394015a4a0 2024-09-13T17:18:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3948545640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400cdab0 con 0x7f394015a880 2024-09-13T17:18:18.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3948545640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b2420 con 0x7f39400cb6c0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39462e1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f394015a4a0 0x7f39400cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51200/0 (socket says 172.21.15.5:51200) 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39462e1640 1 -- 172.21.15.5:0/4175923326 learned_addr learned my addr 172.21.15.5:0/4175923326 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3945ae0640 1 --2- 172.21.15.5:0/4175923326 >> v2:172.21.15.179:3300/0 conn(0x7f394015a880 0x7f39400cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f3946ae2640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f39400cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331635126 0 0) 0x7f39400b2180 con 0x7f394015a4a0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392c003520 con 0x7f394015a4a0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3223820897 0 0) 0x7f392c003520 con 0x7f394015a4a0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 msgr2=0x7f39400cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f39400cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 >> v2:172.21.15.179:3300/0 conn(0x7f394015a880 msgr2=0x7f39400cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 --2- 172.21.15.5:0/4175923326 >> v2:172.21.15.179:3300/0 conn(0x7f394015a880 0x7f39400cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400b2700 con 0x7f394015a4a0 2024-09-13T17:18:18.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f393c001670 con 0x7f394015a4a0 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 >> v1:172.21.15.5:6789/0 conn(0x7f394015a4a0 legacy=0x7f39400cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f392c003970 0x7f392c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f392c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f392c004d00 0x7f392c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400cdab0 con 0x7f392c004d00 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b2420 con 0x7f392c003970 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.616+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c00b980 con 0x7f39400cb6c0 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f392c004d00 0x7f392c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f39462e1640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f392c003970 0x7f392c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3945ae0640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f392c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 -- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 msgr2=0x7f392c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39400cb6c0 0x7f392c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 -- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f392c003970 msgr2=0x7f392c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f392c003970 0x7f392c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.617+0000 7f3946ae2640 1 -- 172.21.15.5:0/4175923326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c003520 con 0x7f392c004d00 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3946ae2640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f392c004d00 0x7f392c005180 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f3938009fc0 tx=0x7f392c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e57cb4a926939fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938031640 con 0x7f392c004d00 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393802d070 con 0x7f392c004d00 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f39452df640 1 -- 172.21.15.5:0/4175923326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380319e0 con 0x7f392c004d00 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 -- 172.21.15.5:0/4175923326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f392c004d00 msgr2=0x7f392c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 --2- 172.21.15.5:0/4175923326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f392c004d00 0x7f392c005180 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f3938009fc0 tx=0x7f392c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3946ae2640 1 -- 172.21.15.5:0/4175923326 reap_dead start 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 -- 172.21.15.5:0/4175923326 shutdown_connections 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 -- 172.21.15.5:0/4175923326 >> 172.21.15.5:0/4175923326 conn(0x7f3940066200 msgr2=0x7f3940069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 -- 172.21.15.5:0/4175923326 shutdown_connections 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.618+0000 7f3948545640 1 -- 172.21.15.5:0/4175923326 wait complete. 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 Processor -- start 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 -- start start 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 0x7f3940154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3940155b60 0x7f39400ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394014e510 con 0x7f39401471d0 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940155fe0 con 0x7f3940155b60 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3948545640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39401545b0 con 0x7f392c004d00 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3945ae0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3945ae0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51696/0 (socket says 172.21.15.5:51696) 2024-09-13T17:18:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.620+0000 7f3945ae0640 1 -- 172.21.15.5:0/1916255995 learned_addr learned my addr 172.21.15.5:0/1916255995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f39462e1640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 0x7f3940154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3946ae2640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3940155b60 0x7f39400ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 -- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 msgr2=0x7f3940154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 0x7f3940154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 -- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3940155b60 msgr2=0x7f39400ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3940155b60 0x7f39400ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 -- 172.21.15.5:0/1916255995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400ac5f0 con 0x7f39401471d0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f39462e1640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 0x7f3940154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3945ae0640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3930011980 tx=0x7f3930011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930004240 con 0x7f39401471d0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39300043a0 con 0x7f39401471d0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3940147630 con 0x7f39401471d0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000fa80 con 0x7f39401471d0 2024-09-13T17:18:18.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.621+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940153f60 con 0x7f39401471d0 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.622+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39400672f0 con 0x7f39401471d0 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.623+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f393000fbe0 con 0x7f39401471d0 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.623+0000 7f3936ffd640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 0x7f392406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.623+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3930089bb0 con 0x7f39401471d0 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.623+0000 7f39462e1640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 0x7f392406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.624+0000 7f39462e1640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 0x7f392406d0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.627+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3930054ce0 con 0x7f39401471d0 2024-09-13T17:18:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.833+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39400cdc50 con 0x7f39401471d0 2024-09-13T17:18:18.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.834+0000 7f3936ffd640 1 -- 172.21.15.5:0/1916255995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f3930023090 con 0x7f39401471d0 2024-09-13T17:18:18.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:18.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:18.836 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 msgr2=0x7f392406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 0x7f392406d0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 msgr2=0x7f3940155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3930011980 tx=0x7f3930011e40 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 shutdown_connections 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3940155b60 0x7f39400ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f392406ac00 0x7f392406d0c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39401471d0 0x7f3940155620 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 --2- 172.21.15.5:0/1916255995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f392c004d00 0x7f3940154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 >> 172.21.15.5:0/1916255995 conn(0x7f3940066200 msgr2=0x7f394015ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 shutdown_connections 2024-09-13T17:18:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.836+0000 7f3948545640 1 -- 172.21.15.5:0/1916255995 wait complete. 2024-09-13T17:18:18.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.949+0000 7f3f0bede640 1 Processor -- start 2024-09-13T17:18:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.949+0000 7f3f0bede640 1 -- start start 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0bede640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3f0406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0bede640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040b3150 con 0x7f3f040cdcb0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0bede640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040b3430 con 0x7f3f041592d0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0bede640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0415cf00 con 0x7f3f040cb7b0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0a47b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f040cdcb0 0x7f3f0415d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51216/0 (socket says 172.21.15.5:51216) 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.950+0000 7f3f0a47b640 1 -- 172.21.15.5:0/1806388550 learned_addr learned my addr 172.21.15.5:0/1806388550 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411131996 0 0) 0x7f3f040b3150 con 0x7f3f040cdcb0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3f0406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0003520 con 0x7f3f040cdcb0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099981507 0 0) 0x7f3ef0003520 con 0x7f3f040cdcb0 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 msgr2=0x7f3f0406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3f0406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 >> v1:172.21.15.179:6789/0 conn(0x7f3f041592d0 legacy=0x7f3f0406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040b3710 con 0x7f3f040cdcb0 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f3efc0019f0 con 0x7f3f040cdcb0 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 >> v1:172.21.15.5:6789/0 conn(0x7f3f040cdcb0 legacy=0x7f3f0415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3ef00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef0003f20 0x7f3ef00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef0004d00 0x7f3ef0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef000bb10 con 0x7f3ef0003f20 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef000bc50 con 0x7f3ef0004d00 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef000be10 con 0x7f3f040cb7b0 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef0003f20 0x7f3ef00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09c7a640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3ef00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f0a47b640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef0004d00 0x7f3ef0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 -- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 msgr2=0x7f3ef00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f040cb7b0 0x7f3ef00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 -- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef0004d00 msgr2=0x7f3ef0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:18.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ef0004d00 0x7f3ef0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.951+0000 7f3f09479640 1 -- 172.21.15.5:0/1806388550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040b3710 con 0x7f3ef0003f20 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.952+0000 7f3f09479640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef0003f20 0x7f3ef00047c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009a90 tx=0x7f3ef00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1155f4dc01930a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.952+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4031400 con 0x7f3ef0003f20 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.952+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef402d050 con 0x7f3ef0003f20 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.952+0000 7f3f08c78640 1 -- 172.21.15.5:0/1806388550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40317a0 con 0x7f3ef0003f20 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 -- 172.21.15.5:0/1806388550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef0003f20 msgr2=0x7f3ef00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 --2- 172.21.15.5:0/1806388550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef0003f20 0x7f3ef00047c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009a90 tx=0x7f3ef00057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0a47b640 1 -- 172.21.15.5:0/1806388550 reap_dead start 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 -- 172.21.15.5:0/1806388550 shutdown_connections 2024-09-13T17:18:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 -- 172.21.15.5:0/1806388550 >> 172.21.15.5:0/1806388550 conn(0x7f3f04066200 msgr2=0x7f3f04069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 -- 172.21.15.5:0/1806388550 shutdown_connections 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.953+0000 7f3f0bede640 1 -- 172.21.15.5:0/1806388550 wait complete. 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.954+0000 7f3f0bede640 1 Processor -- start 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.954+0000 7f3f0bede640 1 -- start start 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef0003f20 0x7f3f0414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f040a74b0 0x7f3f040a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040aa660 con 0x7f3f040a9ca0 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040a8b80 con 0x7f3f040a74b0 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0bede640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040a9010 con 0x7f3ef0003f20 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0a47b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0a47b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51716/0 (socket says 172.21.15.5:51716) 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f0a47b640 1 -- 172.21.15.5:0/2143379928 learned_addr learned my addr 172.21.15.5:0/2143379928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f09c7a640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef0003f20 0x7f3f0414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.955+0000 7f3f09479640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f040a74b0 0x7f3f040a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 -- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef0003f20 msgr2=0x7f3f0414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef0003f20 0x7f3f0414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 -- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f040a74b0 msgr2=0x7f3f040a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f040a74b0 0x7f3f040a7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 -- 172.21.15.5:0/2143379928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040a7f70 con 0x7f3f040a9ca0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0a47b640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ce160 tx=0x7f3efc00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00ac90 con 0x7f3f040a9ca0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00adf0 con 0x7f3f040a9ca0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc013630 con 0x7f3f040a9ca0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f040a8250 con 0x7f3f040a9ca0 2024-09-13T17:18:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.956+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f040a8810 con 0x7f3f040a9ca0 2024-09-13T17:18:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.957+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f040a89d0 con 0x7f3f040a9ca0 2024-09-13T17:18:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.957+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3efc013790 con 0x7f3f040a9ca0 2024-09-13T17:18:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.958+0000 7f3efa7fc640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 0x7f3ee806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.958+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3efc089a70 con 0x7f3f040a9ca0 2024-09-13T17:18:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.958+0000 7f3f09c7a640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 0x7f3ee806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.959+0000 7f3f09c7a640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 0x7f3ee806d0f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:18.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:18.962+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3efc054b10 con 0x7f3f040a9ca0 2024-09-13T17:18:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.132+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f040672f0 con 0x7f3f040a9ca0 2024-09-13T17:18:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.133+0000 7f3efa7fc640 1 -- 172.21.15.5:0/2143379928 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f3efc058130 con 0x7f3f040a9ca0 2024-09-13T17:18:19.134 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:19.134 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 msgr2=0x7f3ee806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 0x7f3ee806d0f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2024-09-13T17:18:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 msgr2=0x7f3f040aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ce160 tx=0x7f3efc00a6e0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 shutdown_connections 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3ee806ac30 0x7f3ee806d0f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f040a9ca0 0x7f3f040aa120 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f040a74b0 0x7f3f040a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 --2- 172.21.15.5:0/2143379928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef0003f20 0x7f3f0414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 >> 172.21.15.5:0/2143379928 conn(0x7f3f04066200 msgr2=0x7f3f04070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 shutdown_connections 2024-09-13T17:18:19.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.135+0000 7f3f0bede640 1 -- 172.21.15.5:0/2143379928 wait complete. 2024-09-13T17:18:19.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:17:50.803411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:17:51.556188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:19.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.251+0000 7f4896a73640 1 Processor -- start 2024-09-13T17:18:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.251+0000 7f4896a73640 1 -- start start 2024-09-13T17:18:19.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4896a73640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f489006df80 0x7f48900b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4896a73640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900b37c0 con 0x7f4890159860 2024-09-13T17:18:19.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4896a73640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900b21e0 con 0x7f489006e360 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4896a73640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900cbed0 con 0x7f489006df80 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f489480f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f489006df80 0x7f48900b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4895010640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4890159860 0x7f4890159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51224/0 (socket says 172.21.15.5:51224) 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f4895010640 1 -- 172.21.15.5:0/2672237396 learned_addr learned my addr 172.21.15.5:0/2672237396 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f489480f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f489006df80 0x7f48900b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51726/0 (socket says 172.21.15.5:51726) 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f489480f640 1 -- 172.21.15.5:0/2672237396 >> v1:172.21.15.179:6789/0 conn(0x7f489006e360 legacy=0x7f48900cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f489480f640 1 -- 172.21.15.5:0/2672237396 >> v1:172.21.15.5:6789/0 conn(0x7f4890159860 legacy=0x7f4890159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f489480f640 1 -- 172.21.15.5:0/2672237396 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900b24c0 con 0x7f489006df80 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.252+0000 7f488f7fe640 1 -- 172.21.15.5:0/2672237396 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228387727 0 0) 0x7f48900b37c0 con 0x7f4890159860 2024-09-13T17:18:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.253+0000 7f489480f640 1 --2- 172.21.15.5:0/2672237396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f48900b3280 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4880009dc0 tx=0x7f488002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ac6b4a86c2476 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.253+0000 7f488f7fe640 1 -- 172.21.15.5:0/2672237396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880007740 con 0x7f489006df80 2024-09-13T17:18:19.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.253+0000 7f488f7fe640 1 -- 172.21.15.5:0/2672237396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488002d050 con 0x7f489006df80 2024-09-13T17:18:19.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.253+0000 7f488f7fe640 1 -- 172.21.15.5:0/2672237396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880007ac0 con 0x7f489006df80 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 -- 172.21.15.5:0/2672237396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 msgr2=0x7f48900b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 --2- 172.21.15.5:0/2672237396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f48900b3280 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4880009dc0 tx=0x7f488002a6d0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 -- 172.21.15.5:0/2672237396 shutdown_connections 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 --2- 172.21.15.5:0/2672237396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f48900b3280 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 -- 172.21.15.5:0/2672237396 >> 172.21.15.5:0/2672237396 conn(0x7f4890069ed0 msgr2=0x7f489006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 -- 172.21.15.5:0/2672237396 shutdown_connections 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.254+0000 7f4896a73640 1 -- 172.21.15.5:0/2672237396 wait complete. 2024-09-13T17:18:19.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.255+0000 7f4896a73640 1 Processor -- start 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.255+0000 7f4896a73640 1 -- start start 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489006e360 0x7f48901551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4890159860 0x7f4890146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901565e0 con 0x7f489006df80 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901556e0 con 0x7f4890159860 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f4896a73640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890155960 con 0x7f489006e360 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51740/0 (socket says 172.21.15.5:51740) 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 -- 172.21.15.5:0/2308514765 learned_addr learned my addr 172.21.15.5:0/2308514765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 -- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489006e360 msgr2=0x7f48901551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489006e360 0x7f48901551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 -- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4890159860 msgr2=0x7f4890146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4890159860 0x7f4890146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.256+0000 7f489480f640 1 -- 172.21.15.5:0/2308514765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009a70 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f489480f640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4880009ee0 tx=0x7f4880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880003b90 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880003cf0 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4890155c40 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800319f0 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.257+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890156200 con 0x7f489006df80 2024-09-13T17:18:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.258+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4890156720 con 0x7f489006df80 2024-09-13T17:18:19.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.258+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4880031b50 con 0x7f489006df80 2024-09-13T17:18:19.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.259+0000 7f488d7fa640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 0x7f487006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.259+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f48800aad50 con 0x7f489006df80 2024-09-13T17:18:19.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.259+0000 7f488ffff640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 0x7f487006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.260+0000 7f488ffff640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 0x7f487006d0c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f489006db80 tx=0x7f4878006ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.263+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4890156720 con 0x7f489006df80 2024-09-13T17:18:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.438+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48900674e0 con 0x7f489006df80 2024-09-13T17:18:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.438+0000 7f488d7fa640 1 -- 172.21.15.5:0/2308514765 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48800400a0 con 0x7f489006df80 2024-09-13T17:18:19.440 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.440+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 msgr2=0x7f487006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.440+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 0x7f487006d0c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f489006db80 tx=0x7f4878006ba0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.440+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 msgr2=0x7f4890156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.440+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4880009ee0 tx=0x7f4880004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 shutdown_connections 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4890159860 0x7f4890146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f489006e360 0x7f48901551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f487006ac00 0x7f487006d0c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 --2- 172.21.15.5:0/2308514765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f489006df80 0x7f4890156a00 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 >> 172.21.15.5:0/2308514765 conn(0x7f4890069ed0 msgr2=0x7f489014e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 shutdown_connections 2024-09-13T17:18:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.441+0000 7f4896a73640 1 -- 172.21.15.5:0/2308514765 wait complete. 2024-09-13T17:18:19.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.556+0000 7f34699bc640 1 Processor -- start 2024-09-13T17:18:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.556+0000 7f34699bc640 1 -- start start 2024-09-13T17:18:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f34699bc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34640ccf40 0x7f346415a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f34699bc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346406c780 con 0x7f34640716d0 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f34699bc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640cd320 con 0x7f346406cef0 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f34699bc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346406e650 con 0x7f34640ccf40 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34640ccf40 0x7f346415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f34640ccf40 0x7f346415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51752/0 (socket says 172.21.15.5:51752) 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 -- 172.21.15.5:0/1493286755 learned_addr learned my addr 172.21.15.5:0/1493286755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f34627fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34640716d0 0x7f346415b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51240/0 (socket says 172.21.15.5:51240) 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 -- 172.21.15.5:0/1493286755 >> v1:172.21.15.179:6789/0 conn(0x7f346406cef0 legacy=0x7f3464070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 -- 172.21.15.5:0/1493286755 >> v1:172.21.15.5:6789/0 conn(0x7f34640716d0 legacy=0x7f346415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.557+0000 7f3462ffd640 1 -- 172.21.15.5:0/1493286755 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415ae40 con 0x7f34640ccf40 2024-09-13T17:18:19.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.558+0000 7f3462ffd640 1 --2- 172.21.15.5:0/1493286755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640ccf40 0x7f346415a900 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3454009e50 tx=0x7f345402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1722ba85757c9479 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.558+0000 7f3461ffb640 1 -- 172.21.15.5:0/1493286755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454031600 con 0x7f34640ccf40 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.558+0000 7f3461ffb640 1 -- 172.21.15.5:0/1493286755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345402d050 con 0x7f34640ccf40 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.558+0000 7f3461ffb640 1 -- 172.21.15.5:0/1493286755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454031980 con 0x7f34640ccf40 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 -- 172.21.15.5:0/1493286755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640ccf40 msgr2=0x7f346415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 --2- 172.21.15.5:0/1493286755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640ccf40 0x7f346415a900 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f3454009e50 tx=0x7f345402a6d0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 -- 172.21.15.5:0/1493286755 shutdown_connections 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 --2- 172.21.15.5:0/1493286755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640ccf40 0x7f346415a900 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 -- 172.21.15.5:0/1493286755 >> 172.21.15.5:0/1493286755 conn(0x7f3464069ed0 msgr2=0x7f346406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 -- 172.21.15.5:0/1493286755 shutdown_connections 2024-09-13T17:18:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.559+0000 7f34699bc640 1 -- 172.21.15.5:0/1493286755 wait complete. 2024-09-13T17:18:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.560+0000 7f34699bc640 1 Processor -- start 2024-09-13T17:18:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.560+0000 7f34699bc640 1 -- start start 2024-09-13T17:18:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 0x7f346414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34640ccf40 0x7f34641558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640b1f40 con 0x7f34640716d0 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3464157fb0 con 0x7f34640ccf40 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34699bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3464155f30 con 0x7f346406cef0 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51764/0 (socket says 172.21.15.5:51764) 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 -- 172.21.15.5:0/2951790755 learned_addr learned my addr 172.21.15.5:0/2951790755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f3462ffd640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 0x7f346414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34637fe640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34640ccf40 0x7f34641558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 -- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 msgr2=0x7f346414c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 0x7f346414c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 -- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34640ccf40 msgr2=0x7f34641558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34640ccf40 0x7f34641558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.561+0000 7f34627fc640 1 -- 172.21.15.5:0/2951790755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454009b30 con 0x7f34640716d0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f3462ffd640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 0x7f346414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f34627fc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c4d0 tx=0x7f344c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c007480 con 0x7f34640716d0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0075e0 con 0x7f34640716d0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3464156210 con 0x7f34640716d0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0049e0 con 0x7f34640716d0 2024-09-13T17:18:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.562+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34640b2190 con 0x7f34640716d0 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.563+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3464156730 con 0x7f34640716d0 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.563+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f344c004b40 con 0x7f34640716d0 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.564+0000 7f345bfff640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.564+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f344c088610 con 0x7f34640716d0 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.564+0000 7f3462ffd640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.565+0000 7f3462ffd640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 0x7f344406d0c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3454033000 tx=0x7f3454009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.568+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f344c0536d0 con 0x7f34640716d0 2024-09-13T17:18:19.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.739+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34640b23b0 con 0x7f34640716d0 2024-09-13T17:18:19.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.739+0000 7f345bfff640 1 -- 172.21.15.5:0/2951790755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f344c018020 con 0x7f34640716d0 2024-09-13T17:18:19.741 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 msgr2=0x7f344406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 0x7f344406d0c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3454033000 tx=0x7f3454009000 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 msgr2=0x7f3464155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c4d0 tx=0x7f344c00c990 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 shutdown_connections 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34640ccf40 0x7f34641558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34640716d0 0x7f3464155390 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 --2- 172.21.15.5:0/2951790755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f346406cef0 0x7f346414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 >> 172.21.15.5:0/2951790755 conn(0x7f3464069ed0 msgr2=0x7f34640ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 shutdown_connections 2024-09-13T17:18:19.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.741+0000 7f34699bc640 1 -- 172.21.15.5:0/2951790755 wait complete. 2024-09-13T17:18:19.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:19.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.857+0000 7f55438aa640 1 Processor -- start 2024-09-13T17:18:19.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.857+0000 7f55438aa640 1 -- start start 2024-09-13T17:18:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f55438aa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 0x7f553c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f55438aa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f553c159860 0x7f553c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f55438aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c0b21e0 con 0x7f553c06df80 2024-09-13T17:18:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f55438aa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c0b24c0 con 0x7f553c159860 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f55438aa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c0b27a0 con 0x7f553c06e360 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f553c159860 0x7f553c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f553c159860 0x7f553c159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51772/0 (socket says 172.21.15.5:51772) 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 -- 172.21.15.5:0/3276371057 learned_addr learned my addr 172.21.15.5:0/3276371057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5540e45640 1 --2- 172.21.15.5:0/3276371057 >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 0x7f553c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 -- 172.21.15.5:0/3276371057 >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 msgr2=0x7f553c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 --2- 172.21.15.5:0/3276371057 >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 0x7f553c0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 -- 172.21.15.5:0/3276371057 >> v1:172.21.15.179:6789/0 conn(0x7f553c06df80 legacy=0x7f553c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5541e47640 1 -- 172.21.15.5:0/3276371057 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0b2a80 con 0x7f553c159860 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.858+0000 7f5540e45640 1 --2- 172.21.15.5:0/3276371057 >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 0x7f553c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.859+0000 7f5541e47640 1 --2- 172.21.15.5:0/3276371057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c159c90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e50 tx=0x7f553402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b8c3f295af691b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.859+0000 7f5533fff640 1 -- 172.21.15.5:0/3276371057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534031600 con 0x7f553c159860 2024-09-13T17:18:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.859+0000 7f5533fff640 1 -- 172.21.15.5:0/3276371057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553402d050 con 0x7f553c159860 2024-09-13T17:18:19.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.859+0000 7f5533fff640 1 -- 172.21.15.5:0/3276371057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534031980 con 0x7f553c159860 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 -- 172.21.15.5:0/3276371057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 msgr2=0x7f553c159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 --2- 172.21.15.5:0/3276371057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c159c90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e50 tx=0x7f553402a710 comp rx=0 tx=0).stop 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 -- 172.21.15.5:0/3276371057 shutdown_connections 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 --2- 172.21.15.5:0/3276371057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c159c90 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 --2- 172.21.15.5:0/3276371057 >> v2:172.21.15.179:3300/0 conn(0x7f553c06e360 0x7f553c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 -- 172.21.15.5:0/3276371057 >> 172.21.15.5:0/3276371057 conn(0x7f553c069ed0 msgr2=0x7f553c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 -- 172.21.15.5:0/3276371057 shutdown_connections 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.860+0000 7f55438aa640 1 -- 172.21.15.5:0/3276371057 wait complete. 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.861+0000 7f55438aa640 1 Processor -- start 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.861+0000 7f55438aa640 1 -- start start 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 0x7f553c147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553c06e360 0x7f553c166450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c166990 con 0x7f553c159860 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1653b0 con 0x7f553c06e360 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f55438aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c165690 con 0x7f553c06df80 2024-09-13T17:18:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51782/0 (socket says 172.21.15.5:51782) 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 -- 172.21.15.5:0/2335823782 learned_addr learned my addr 172.21.15.5:0/2335823782 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541646640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 0x7f553c147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5540e45640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553c06e360 0x7f553c166450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 -- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 msgr2=0x7f553c147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 0x7f553c147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 -- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553c06e360 msgr2=0x7f553c166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553c06e360 0x7f553c166450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 -- 172.21.15.5:0/2335823782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009b30 con 0x7f553c159860 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541646640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 0x7f553c147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.862+0000 7f5541e47640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5534034040 tx=0x7f5534004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.863+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553403d860 con 0x7f553c159860 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.863+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553403d9e0 con 0x7f553c159860 2024-09-13T17:18:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.863+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c165970 con 0x7f553c159860 2024-09-13T17:18:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.863+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553403dd90 con 0x7f553c159860 2024-09-13T17:18:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.863+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c165f30 con 0x7f553c159860 2024-09-13T17:18:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.864+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0674e0 con 0x7f553c159860 2024-09-13T17:18:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.864+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f553403b400 con 0x7f553c159860 2024-09-13T17:18:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.865+0000 7f5531ffb640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 0x7f552006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.865+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f55340aa3c0 con 0x7f553c159860 2024-09-13T17:18:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.865+0000 7f5541646640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 0x7f552006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.866+0000 7f5541646640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 0x7f552006d0f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5538003eb0 tx=0x7f5538009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:19.869+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5534075450 con 0x7f553c159860 2024-09-13T17:18:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.041+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f553c0cb7c0 con 0x7f553c159860 2024-09-13T17:18:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.041+0000 7f5531ffb640 1 -- 172.21.15.5:0/2335823782 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f553407de60 con 0x7f553c159860 2024-09-13T17:18:20.042 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 msgr2=0x7f552006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 0x7f552006d0f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5538003eb0 tx=0x7f5538009040 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 msgr2=0x7f553c0ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5534034040 tx=0x7f5534004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 shutdown_connections 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f552006ac30 0x7f552006d0f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c159860 0x7f553c0ac950 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f553c06e360 0x7f553c166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 --2- 172.21.15.5:0/2335823782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f553c06df80 0x7f553c147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 >> 172.21.15.5:0/2335823782 conn(0x7f553c069ed0 msgr2=0x7f553c0aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.043+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 shutdown_connections 2024-09-13T17:18:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.044+0000 7f55438aa640 1 -- 172.21.15.5:0/2335823782 wait complete. 2024-09-13T17:18:20.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.156+0000 7f7db357d640 1 Processor -- start 2024-09-13T17:18:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 -- start start 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 0x7f7dac0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dac0b5820 0x7f7dac0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac15cdd0 con 0x7f7dac0cd630 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0b8750 con 0x7f7dac0b5820 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.157+0000 7f7db357d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0d2c20 con 0x7f7dac15c9f0 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1b1a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dac0b5820 0x7f7dac0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db0b18640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7dac0cd630 0x7f7dac0b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51254/0 (socket says 172.21.15.5:51254) 2024-09-13T17:18:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db0b18640 1 -- 172.21.15.5:0/4013784471 learned_addr learned my addr 172.21.15.5:0/4013784471 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1319640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 0x7f7dac0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1b1a640 1 -- 172.21.15.5:0/4013784471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 msgr2=0x7f7dac0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1b1a640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 0x7f7dac0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1b1a640 1 -- 172.21.15.5:0/4013784471 >> v1:172.21.15.5:6789/0 conn(0x7f7dac0cd630 legacy=0x7f7dac0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7dabfff640 1 -- 172.21.15.5:0/4013784471 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249181601 0 0) 0x7f7dac15cdd0 con 0x7f7dac0cd630 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1b1a640 1 -- 172.21.15.5:0/4013784471 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0d3040 con 0x7f7dac0b5820 2024-09-13T17:18:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.158+0000 7f7db1319640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 0x7f7dac0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db1b1a640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0b5820 0x7f7dac0b5c70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097d0 tx=0x7f7da402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1398a40ec6bcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7dabfff640 1 -- 172.21.15.5:0/4013784471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da402ae40 con 0x7f7dac0b5820 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7dabfff640 1 -- 172.21.15.5:0/4013784471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4032440 con 0x7f7dac0b5820 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7dabfff640 1 -- 172.21.15.5:0/4013784471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da40327d0 con 0x7f7dac0b5820 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 -- 172.21.15.5:0/4013784471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0b5820 msgr2=0x7f7dac0b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0b5820 0x7f7dac0b5c70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097d0 tx=0x7f7da402a130 comp rx=0 tx=0).stop 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 -- 172.21.15.5:0/4013784471 shutdown_connections 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac0b5820 0x7f7dac0b5c70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 --2- 172.21.15.5:0/4013784471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac15c9f0 0x7f7dac0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.159+0000 7f7db357d640 1 -- 172.21.15.5:0/4013784471 >> 172.21.15.5:0/4013784471 conn(0x7f7dac071a20 msgr2=0x7f7dac071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.160+0000 7f7db357d640 1 -- 172.21.15.5:0/4013784471 shutdown_connections 2024-09-13T17:18:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.160+0000 7f7db357d640 1 -- 172.21.15.5:0/4013784471 wait complete. 2024-09-13T17:18:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.161+0000 7f7db357d640 1 Processor -- start 2024-09-13T17:18:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.161+0000 7f7db357d640 1 -- start start 2024-09-13T17:18:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.161+0000 7f7db357d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 0x7f7dac1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.161+0000 7f7db357d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 0x7f7dac14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.161+0000 7f7db357d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db357d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac14cef0 con 0x7f7dac15c9f0 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db357d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac14c2e0 con 0x7f7dac0b5820 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db357d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac14c5c0 con 0x7f7dac0cd630 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51810/0 (socket says 172.21.15.5:51810) 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 -- 172.21.15.5:0/2500873636 learned_addr learned my addr 172.21.15.5:0/2500873636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db0b18640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 0x7f7dac14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1319640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 0x7f7dac1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 -- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 msgr2=0x7f7dac14b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 0x7f7dac14b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 -- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 msgr2=0x7f7dac1f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 0x7f7dac1f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 -- 172.21.15.5:0/2500873636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4009400 con 0x7f7dac15c9f0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db0b18640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 0x7f7dac14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1319640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 0x7f7dac1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db1b1a640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097d0 tx=0x7f7da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4004230 con 0x7f7dac15c9f0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4004390 con 0x7f7dac15c9f0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac14c8a0 con 0x7f7dac15c9f0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.162+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da403c8e0 con 0x7f7dac15c9f0 2024-09-13T17:18:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.163+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac14e5e0 con 0x7f7dac15c9f0 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.164+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac14d060 con 0x7f7dac15c9f0 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.164+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7da4039050 con 0x7f7dac15c9f0 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.164+0000 7f7da9ffb640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 0x7f7d9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.165+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7da40a9e40 con 0x7f7dac15c9f0 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.165+0000 7f7db1319640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 0x7f7d9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.165+0000 7f7db1319640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 0x7f7d9806d0c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0044f0 tx=0x7f7d9c003a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.169+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7da4074f70 con 0x7f7dac15c9f0 2024-09-13T17:18:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.374+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dac0b1d90 con 0x7f7dac15c9f0 2024-09-13T17:18:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.374+0000 7f7da9ffb640 1 -- 172.21.15.5:0/2500873636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f7da404b020 con 0x7f7dac15c9f0 2024-09-13T17:18:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:20.375 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:20.376 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:20.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 msgr2=0x7f7d9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 0x7f7d9806d0c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0044f0 tx=0x7f7d9c003a30 comp rx=0 tx=0).stop 2024-09-13T17:18:20.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 msgr2=0x7f7dac14bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097d0 tx=0x7f7da40046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 shutdown_connections 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d9806ac00 0x7f7d9806d0c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dac15c9f0 0x7f7dac14bcb0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7dac0cd630 0x7f7dac14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 --2- 172.21.15.5:0/2500873636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7dac0b5820 0x7f7dac1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 >> 172.21.15.5:0/2500873636 conn(0x7f7dac071a20 msgr2=0x7f7dac0cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 shutdown_connections 2024-09-13T17:18:20.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.376+0000 7f7db357d640 1 -- 172.21.15.5:0/2500873636 wait complete. 2024-09-13T17:18:20.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.488+0000 7f8282e80640 1 Processor -- start 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.488+0000 7f8282e80640 1 -- start start 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f8282e80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f827c1592d0 0x7f827c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f8282e80640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f827c06e370 0x7f827c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f8282e80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0b3150 con 0x7f827c0cb7b0 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f8282e80640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c15cf00 con 0x7f827c06e370 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f8282e80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c0b3430 con 0x7f827c1592d0 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.489+0000 7f828141d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f827c06e370 0x7f827c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f827c06e370 0x7f827c15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51824/0 (socket says 172.21.15.5:51824) 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 -- 172.21.15.5:0/3958141652 learned_addr learned my addr 172.21.15.5:0/3958141652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:20.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f8280c1c640 1 --2- 172.21.15.5:0/3958141652 >> v2:172.21.15.179:3300/0 conn(0x7f827c1592d0 0x7f827c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 -- 172.21.15.5:0/3958141652 >> v2:172.21.15.179:3300/0 conn(0x7f827c1592d0 msgr2=0x7f827c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 --2- 172.21.15.5:0/3958141652 >> v2:172.21.15.179:3300/0 conn(0x7f827c1592d0 0x7f827c06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 -- 172.21.15.5:0/3958141652 >> v1:172.21.15.179:6789/0 conn(0x7f827c0cb7b0 legacy=0x7f827c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.490+0000 7f828141d640 1 -- 172.21.15.5:0/3958141652 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0b3710 con 0x7f827c06e370 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f828141d640 1 --2- 172.21.15.5:0/3958141652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c06e370 0x7f827c15d350 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ce560 tx=0x7f826402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2b1ff673d5c5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f827b7fe640 1 -- 172.21.15.5:0/3958141652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82640326f0 con 0x7f827c06e370 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f827b7fe640 1 -- 172.21.15.5:0/3958141652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8264032850 con 0x7f827c06e370 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f827b7fe640 1 -- 172.21.15.5:0/3958141652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264032be0 con 0x7f827c06e370 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 -- 172.21.15.5:0/3958141652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c06e370 msgr2=0x7f827c15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 --2- 172.21.15.5:0/3958141652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c06e370 0x7f827c15d350 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ce560 tx=0x7f826402c830 comp rx=0 tx=0).stop 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 -- 172.21.15.5:0/3958141652 shutdown_connections 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 --2- 172.21.15.5:0/3958141652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c06e370 0x7f827c15d350 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 --2- 172.21.15.5:0/3958141652 >> v2:172.21.15.179:3300/0 conn(0x7f827c1592d0 0x7f827c06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 -- 172.21.15.5:0/3958141652 >> 172.21.15.5:0/3958141652 conn(0x7f827c066200 msgr2=0x7f827c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 -- 172.21.15.5:0/3958141652 shutdown_connections 2024-09-13T17:18:20.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.491+0000 7f8282e80640 1 -- 172.21.15.5:0/3958141652 wait complete. 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.492+0000 7f8282e80640 1 Processor -- start 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 -- start start 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 0x7f827c14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f827c0cb7b0 0x7f827c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c15b3e0 con 0x7f827c1592d0 2024-09-13T17:18:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c1564c0 con 0x7f827c06e370 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.493+0000 7f8282e80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c14e520 con 0x7f827c0cb7b0 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51838/0 (socket says 172.21.15.5:51838) 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 -- 172.21.15.5:0/495252249 learned_addr learned my addr 172.21.15.5:0/495252249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f8280c1c640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 0x7f827c14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f827bfff640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f827c0cb7b0 0x7f827c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 -- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f827c0cb7b0 msgr2=0x7f827c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f827c0cb7b0 0x7f827c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 -- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 msgr2=0x7f827c14dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 0x7f827c14dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 -- 172.21.15.5:0/495252249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826400b770 con 0x7f827c1592d0 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f8280c1c640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 0x7f827c14dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f828141d640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f826400b2c0 tx=0x7f8264004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264040680 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82640407e0 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264040b90 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c15a7d0 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.494+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c15ad90 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.495+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c0672f0 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.496+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8264040cf0 con 0x7f827c1592d0 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.496+0000 7f82797fa640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 0x7f825c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.496+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82640aa790 con 0x7f827c1592d0 2024-09-13T17:18:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.496+0000 7f8280c1c640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 0x7f825c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.497+0000 7f8280c1c640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 0x7f825c06d0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.500+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8264075a20 con 0x7f827c1592d0 2024-09-13T17:18:20.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.671+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f827c156630 con 0x7f827c1592d0 2024-09-13T17:18:20.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.673+0000 7f82797fa640 1 -- 172.21.15.5:0/495252249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f827c156630 con 0x7f827c1592d0 2024-09-13T17:18:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:20.674 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 msgr2=0x7f825c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 0x7f825c06d0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274008040 comp rx=0 tx=0).stop 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 msgr2=0x7f827c14fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f826400b2c0 tx=0x7f8264004730 comp rx=0 tx=0).stop 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 shutdown_connections 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f825c06ac30 0x7f825c06d0f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f827c1592d0 0x7f827c14fd30 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f827c0cb7b0 0x7f827c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 --2- 172.21.15.5:0/495252249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f827c06e370 0x7f827c14dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 >> 172.21.15.5:0/495252249 conn(0x7f827c066200 msgr2=0x7f827c153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 shutdown_connections 2024-09-13T17:18:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.675+0000 7f8282e80640 1 -- 172.21.15.5:0/495252249 wait complete. 2024-09-13T17:18:20.687 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:18:20.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.788+0000 7f9812c3d640 1 Processor -- start 2024-09-13T17:18:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 -- start start 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f980c15c9f0 0x7f980c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f980c0b5820 0x7f980c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c15cdd0 con 0x7f980c0cd630 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0b8750 con 0x7f980c0b5820 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f9812c3d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0d2c20 con 0x7f980c15c9f0 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f98111da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f980c0b5820 0x7f980c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.789+0000 7f98111da640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f980c0b5820 0x7f980c0b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51848/0 (socket says 172.21.15.5:51848) 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 -- 172.21.15.5:0/442369921 learned_addr learned my addr 172.21.15.5:0/442369921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98109d9640 1 --2- 172.21.15.5:0/442369921 >> v2:172.21.15.179:3300/0 conn(0x7f980c15c9f0 0x7f980c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 -- 172.21.15.5:0/442369921 >> v2:172.21.15.179:3300/0 conn(0x7f980c15c9f0 msgr2=0x7f980c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 --2- 172.21.15.5:0/442369921 >> v2:172.21.15.179:3300/0 conn(0x7f980c15c9f0 0x7f980c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 -- 172.21.15.5:0/442369921 >> v1:172.21.15.179:6789/0 conn(0x7f980c0cd630 legacy=0x7f980c0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 -- 172.21.15.5:0/442369921 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0d3040 con 0x7f980c0b5820 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.790+0000 7f98111da640 1 --2- 172.21.15.5:0/442369921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c0b5820 0x7f980c0b5cd0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b52e0 tx=0x7f980402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b571abf79df1e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f980b7fe640 1 -- 172.21.15.5:0/442369921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804032440 con 0x7f980c0b5820 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f980b7fe640 1 -- 172.21.15.5:0/442369921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98040325a0 con 0x7f980c0b5820 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f980b7fe640 1 -- 172.21.15.5:0/442369921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804032930 con 0x7f980c0b5820 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 -- 172.21.15.5:0/442369921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c0b5820 msgr2=0x7f980c0b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 --2- 172.21.15.5:0/442369921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c0b5820 0x7f980c0b5cd0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b52e0 tx=0x7f980402a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 -- 172.21.15.5:0/442369921 shutdown_connections 2024-09-13T17:18:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 --2- 172.21.15.5:0/442369921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c0b5820 0x7f980c0b5cd0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 --2- 172.21.15.5:0/442369921 >> v2:172.21.15.179:3300/0 conn(0x7f980c15c9f0 0x7f980c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 -- 172.21.15.5:0/442369921 >> 172.21.15.5:0/442369921 conn(0x7f980c071a20 msgr2=0x7f980c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 -- 172.21.15.5:0/442369921 shutdown_connections 2024-09-13T17:18:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.791+0000 7f9812c3d640 1 -- 172.21.15.5:0/442369921 wait complete. 2024-09-13T17:18:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 Processor -- start 2024-09-13T17:18:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 -- start start 2024-09-13T17:18:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 0x7f980c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f980c0cd630 0x7f980c0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c159a00 con 0x7f980c15c9f0 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c159810 con 0x7f980c0b5820 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.793+0000 7f9812c3d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0b30a0 con 0x7f980c0cd630 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51862/0 (socket says 172.21.15.5:51862) 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 -- 172.21.15.5:0/376638042 learned_addr learned my addr 172.21.15.5:0/376638042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f980bfff640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f980c0cd630 0x7f980c0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98109d9640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 0x7f980c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 -- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f980c0cd630 msgr2=0x7f980c0b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f980c0cd630 0x7f980c0b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 -- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 msgr2=0x7f980c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 0x7f980c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 -- 172.21.15.5:0/376638042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040094d0 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98109d9640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 0x7f980c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98111da640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f98040090b0 tx=0x7f98040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804032440 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804030b80 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0ca6c0 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980403d420 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.794+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0cac80 con 0x7f980c15c9f0 2024-09-13T17:18:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.795+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c0b1e20 con 0x7f980c15c9f0 2024-09-13T17:18:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.796+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9804039040 con 0x7f980c15c9f0 2024-09-13T17:18:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.796+0000 7f98097fa640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 0x7f97ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.797+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98040aa070 con 0x7f980c15c9f0 2024-09-13T17:18:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.797+0000 7f98109d9640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 0x7f97ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.797+0000 7f98109d9640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 0x7f97ec06d0c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009a80 tx=0x7f97fc0039d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:20.801+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98040dd9c0 con 0x7f980c15c9f0 2024-09-13T17:18:21.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.008+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f980c066dd0 con 0x7f980c15c9f0 2024-09-13T17:18:21.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.009+0000 7f98097fa640 1 -- 172.21.15.5:0/376638042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f980404b090 con 0x7f980c15c9f0 2024-09-13T17:18:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:21.010 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:21.010 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 msgr2=0x7f97ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 0x7f97ec06d0c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009a80 tx=0x7f97fc0039d0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 msgr2=0x7f980c155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f98040090b0 tx=0x7f98040046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 shutdown_connections 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f97ec06ac00 0x7f97ec06d0c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f980c15c9f0 0x7f980c155730 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f980c0cd630 0x7f980c0b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 --2- 172.21.15.5:0/376638042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f980c0b5820 0x7f980c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 >> 172.21.15.5:0/376638042 conn(0x7f980c071a20 msgr2=0x7f980c15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 shutdown_connections 2024-09-13T17:18:21.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.011+0000 7f9812c3d640 1 -- 172.21.15.5:0/376638042 wait complete. 2024-09-13T17:18:21.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.123+0000 7f83a6e19640 1 Processor -- start 2024-09-13T17:18:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.123+0000 7f83a6e19640 1 -- start start 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a6e19640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83a00ae940 0x7f83a0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a6e19640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00add50 con 0x7f83a015c700 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a6e19640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00ac5a0 con 0x7f83a00b4120 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a6e19640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a00ac390 con 0x7f83a00ae940 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a4bb5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f83a015c700 0x7f83a00ad640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51262/0 (socket says 172.21.15.5:51262) 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a4bb5640 1 -- 172.21.15.5:0/2224640212 learned_addr learned my addr 172.21.15.5:0/2224640212 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f83a53b6640 1 --2- 172.21.15.5:0/2224640212 >> v2:172.21.15.179:3300/0 conn(0x7f83a00ae940 0x7f83a0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f839f7fe640 1 -- 172.21.15.5:0/2224640212 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563734116 0 0) 0x7f83a00add50 con 0x7f83a015c700 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.124+0000 7f839f7fe640 1 -- 172.21.15.5:0/2224640212 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c003520 con 0x7f83a015c700 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.125+0000 7f83a53b6640 1 -- 172.21.15.5:0/2224640212 >> v1:172.21.15.179:6789/0 conn(0x7f83a00b4120 legacy=0x7f83a00ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.125+0000 7f83a53b6640 1 -- 172.21.15.5:0/2224640212 >> v1:172.21.15.5:6789/0 conn(0x7f83a015c700 legacy=0x7f83a00ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.125+0000 7f83a53b6640 1 -- 172.21.15.5:0/2224640212 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00ac880 con 0x7f83a00ae940 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.125+0000 7f83a53b6640 1 --2- 172.21.15.5:0/2224640212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00ae940 0x7f83a0069ed0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83980097a0 tx=0x7f839802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd89454c885318c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f839f7fe640 1 -- 172.21.15.5:0/2224640212 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398032440 con 0x7f83a00ae940 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f839f7fe640 1 -- 172.21.15.5:0/2224640212 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83980325a0 con 0x7f83a00ae940 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f839f7fe640 1 -- 172.21.15.5:0/2224640212 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398032930 con 0x7f83a00ae940 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 -- 172.21.15.5:0/2224640212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00ae940 msgr2=0x7f83a0069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 --2- 172.21.15.5:0/2224640212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00ae940 0x7f83a0069ed0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83980097a0 tx=0x7f839802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 -- 172.21.15.5:0/2224640212 shutdown_connections 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 --2- 172.21.15.5:0/2224640212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00ae940 0x7f83a0069ed0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 -- 172.21.15.5:0/2224640212 >> 172.21.15.5:0/2224640212 conn(0x7f83a00b5040 msgr2=0x7f83a0098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 -- 172.21.15.5:0/2224640212 shutdown_connections 2024-09-13T17:18:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.126+0000 7f83a6e19640 1 -- 172.21.15.5:0/2224640212 wait complete. 2024-09-13T17:18:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.127+0000 7f83a6e19640 1 Processor -- start 2024-09-13T17:18:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.127+0000 7f83a6e19640 1 -- start start 2024-09-13T17:18:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00b4120 0x7f83a00994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a0154ab0 0x7f83a00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0155650 con 0x7f83a015c700 2024-09-13T17:18:21.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a009a320 con 0x7f83a00b4120 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f83a6e19640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a015ccf0 con 0x7f83a0154ab0 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f839ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f839ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51870/0 (socket says 172.21.15.5:51870) 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.128+0000 7f839ffff640 1 -- 172.21.15.5:0/1910124553 learned_addr learned my addr 172.21.15.5:0/1910124553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f83a4bb5640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00b4120 0x7f83a00994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f83a53b6640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a0154ab0 0x7f83a00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 -- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a0154ab0 msgr2=0x7f83a00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a0154ab0 0x7f83a00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 -- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00b4120 msgr2=0x7f83a00994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00b4120 0x7f83a00994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 -- 172.21.15.5:0/1910124553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009400 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839ffff640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f838800c480 tx=0x7f838800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880052d0 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388005430 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a0099a80 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388012870 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.129+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a009a040 con 0x7f83a015c700 2024-09-13T17:18:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.130+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a00b4ca0 con 0x7f83a015c700 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.131+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83880129d0 con 0x7f83a015c700 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.131+0000 7f839d7fa640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 0x7f838006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.131+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8388088fa0 con 0x7f83a015c700 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.131+0000 7f83a4bb5640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 0x7f838006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.132+0000 7f83a4bb5640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 0x7f838006d0f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8390001560 tx=0x7f8390009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.135+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83880bc9c0 con 0x7f83a015c700 2024-09-13T17:18:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.339+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a00cf2f0 con 0x7f83a015c700 2024-09-13T17:18:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.340+0000 7f839d7fa640 1 -- 172.21.15.5:0/1910124553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f83880540d0 con 0x7f83a015c700 2024-09-13T17:18:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:21.341 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:17:52.581549+0000","modified":"2024-09-13T17:17:54.587066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7722},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7722":{"gid":7722,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/2901929120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2901929120},{"type":"v1","addr":"172.21.15.5:6833","nonce":2901929120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T17:18:21.342 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-09-13T17:18:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 msgr2=0x7f838006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 0x7f838006d0f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8390001560 tx=0x7f8390009040 comp rx=0 tx=0).stop 2024-09-13T17:18:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 msgr2=0x7f83a006eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f838800c480 tx=0x7f838800c940 comp rx=0 tx=0).stop 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 shutdown_connections 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a0154ab0 0x7f83a00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f838006ac30 0x7f838006d0f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83a015c700 0x7f83a006eea0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 --2- 172.21.15.5:0/1910124553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a00b4120 0x7f83a00994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 >> 172.21.15.5:0/1910124553 conn(0x7f83a00b5040 msgr2=0x7f83a00af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 shutdown_connections 2024-09-13T17:18:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.342+0000 7f83a6e19640 1 -- 172.21.15.5:0/1910124553 wait complete. 2024-09-13T17:18:21.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.455+0000 7f55e31a0640 1 Processor -- start 2024-09-13T17:18:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.455+0000 7f55e31a0640 1 -- start start 2024-09-13T17:18:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e31a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e31a0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55dc0cdac0 0x7f55dc06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e31a0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0ca090 con 0x7f55dc0b2c10 2024-09-13T17:18:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e31a0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc06e050 con 0x7f55dc0cdac0 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e31a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0ca2c0 con 0x7f55dc06dc70 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55dc0cdac0 0x7f55dc06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55dc0cdac0 0x7f55dc06c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51884/0 (socket says 172.21.15.5:51884) 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 -- 172.21.15.5:0/753173477 learned_addr learned my addr 172.21.15.5:0/753173477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e219e640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 -- 172.21.15.5:0/753173477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 msgr2=0x7f55dc0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 -- 172.21.15.5:0/753173477 >> v1:172.21.15.179:6789/0 conn(0x7f55dc0b2c10 legacy=0x7f55dc0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.456+0000 7f55e299f640 1 -- 172.21.15.5:0/753173477 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0ca5a0 con 0x7f55dc0cdac0 2024-09-13T17:18:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.457+0000 7f55e299f640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc06c030 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009e50 tx=0x7f55d402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad87d93aad77662 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.457+0000 7f55e119c640 1 -- 172.21.15.5:0/753173477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4031600 con 0x7f55dc0cdac0 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.457+0000 7f55e119c640 1 -- 172.21.15.5:0/753173477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d402d050 con 0x7f55dc0cdac0 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.457+0000 7f55e119c640 1 -- 172.21.15.5:0/753173477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4031980 con 0x7f55dc0cdac0 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.457+0000 7f55e31a0640 1 -- 172.21.15.5:0/753173477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 msgr2=0x7f55dc06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc06c030 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009e50 tx=0x7f55d402a7a0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 -- 172.21.15.5:0/753173477 shutdown_connections 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc06c030 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 --2- 172.21.15.5:0/753173477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 -- 172.21.15.5:0/753173477 >> 172.21.15.5:0/753173477 conn(0x7f55dc06a0b0 msgr2=0x7f55dc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 -- 172.21.15.5:0/753173477 shutdown_connections 2024-09-13T17:18:21.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.458+0000 7f55e31a0640 1 -- 172.21.15.5:0/753173477 wait complete. 2024-09-13T17:18:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.459+0000 7f55e31a0640 1 Processor -- start 2024-09-13T17:18:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.459+0000 7f55e31a0640 1 -- start start 2024-09-13T17:18:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55dc0b2c10 0x7f55dc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0aca10 con 0x7f55dc0cdac0 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15bb40 con 0x7f55dc0b2c10 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e31a0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0ab1e0 con 0x7f55dc06dc70 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51888/0 (socket says 172.21.15.5:51888) 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 -- 172.21.15.5:0/528555446 learned_addr learned my addr 172.21.15.5:0/528555446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e219e640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e199d640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55dc0b2c10 0x7f55dc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 -- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 msgr2=0x7f55dc1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 -- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55dc0b2c10 msgr2=0x7f55dc15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55dc0b2c10 0x7f55dc15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 -- 172.21.15.5:0/528555446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009b30 con 0x7f55dc0cdac0 2024-09-13T17:18:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.460+0000 7f55e299f640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f55d4034040 tx=0x7f55d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.461+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d403c890 con 0x7f55dc0cdac0 2024-09-13T17:18:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.461+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d403c9f0 con 0x7f55dc0cdac0 2024-09-13T17:18:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.461+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc141a40 con 0x7f55dc0cdac0 2024-09-13T17:18:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.461+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d403cde0 con 0x7f55dc0cdac0 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.461+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc142000 con 0x7f55dc0cdac0 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.462+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc0cb360 con 0x7f55dc0cdac0 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.462+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55d4038040 con 0x7f55dc0cdac0 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.463+0000 7f55d2ffd640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.463+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f55d40aa2f0 con 0x7f55dc0cdac0 2024-09-13T17:18:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.463+0000 7f55e219e640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.463+0000 7f55e219e640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 0x7f55c006d0c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009b40 tx=0x7f55d8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.467+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55d4075470 con 0x7f55dc0cdac0 2024-09-13T17:18:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.639+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55dc06d390 con 0x7f55dc0cdac0 2024-09-13T17:18:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.640+0000 7f55d2ffd640 1 -- 172.21.15.5:0/528555446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f55d4036090 con 0x7f55dc0cdac0 2024-09-13T17:18:21.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:21.642 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":95,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:17:53.583463+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:17:50.803411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T17:17:51.556188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 msgr2=0x7f55c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 0x7f55c006d0c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009b40 tx=0x7f55d8009190 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 msgr2=0x7f55dc15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f55d4034040 tx=0x7f55d4004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 shutdown_connections 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55dc0cdac0 0x7f55dc15a030 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55dc0b2c10 0x7f55dc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 --2- 172.21.15.5:0/528555446 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55dc06dc70 0x7f55dc1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 >> 172.21.15.5:0/528555446 conn(0x7f55dc06a0b0 msgr2=0x7f55dc070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 shutdown_connections 2024-09-13T17:18:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.642+0000 7f55e31a0640 1 -- 172.21.15.5:0/528555446 wait complete. 2024-09-13T17:18:21.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:18:21.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.756+0000 7ff039220640 1 Processor -- start 2024-09-13T17:18:21.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.756+0000 7ff039220640 1 -- start start 2024-09-13T17:18:21.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff039220640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03415c920 0x7ff0340d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff039220640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff039220640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0340b5ab0 con 0x7ff0340d27e0 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff039220640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0340d1b70 con 0x7ff03415c920 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff039220640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340d2c50 con 0x7ff0340d09f0 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff032d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03415c920 0x7ff0340d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff032d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff03415c920 0x7ff0340d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51896/0 (socket says 172.21.15.5:51896) 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff032d9d640 1 -- 172.21.15.5:0/500265349 learned_addr learned my addr 172.21.15.5:0/500265349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:21.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.757+0000 7ff03359e640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff032d9d640 1 -- 172.21.15.5:0/500265349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 msgr2=0x7ff0340b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff032d9d640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff032d9d640 1 -- 172.21.15.5:0/500265349 >> v1:172.21.15.5:6789/0 conn(0x7ff0340d27e0 legacy=0x7ff0340d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff032d9d640 1 -- 172.21.15.5:0/500265349 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340d0ff0 con 0x7ff03415c920 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff032d9d640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340d22a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0098a0 tx=0x7ff02c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ab9b489212b011 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff031d9b640 1 -- 172.21.15.5:0/500265349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c032440 con 0x7ff03415c920 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff031d9b640 1 -- 172.21.15.5:0/500265349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0325a0 con 0x7ff03415c920 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.758+0000 7ff031d9b640 1 -- 172.21.15.5:0/500265349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c032930 con 0x7ff03415c920 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 -- 172.21.15.5:0/500265349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 msgr2=0x7ff0340d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340d22a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0098a0 tx=0x7ff02c02a200 comp rx=0 tx=0).stop 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 -- 172.21.15.5:0/500265349 shutdown_connections 2024-09-13T17:18:21.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 --2- 172.21.15.5:0/500265349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340d22a0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 -- 172.21.15.5:0/500265349 >> 172.21.15.5:0/500265349 conn(0x7ff034071c30 msgr2=0x7ff03406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 -- 172.21.15.5:0/500265349 shutdown_connections 2024-09-13T17:18:21.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.759+0000 7ff039220640 1 -- 172.21.15.5:0/500265349 wait complete. 2024-09-13T17:18:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 Processor -- start 2024-09-13T17:18:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 -- start start 2024-09-13T17:18:21.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0340d27e0 0x7ff0340b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034159cc0 con 0x7ff03415c920 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034158d60 con 0x7ff0340d27e0 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff039220640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff034159040 con 0x7ff0340d09f0 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.761+0000 7ff03359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51900/0 (socket says 172.21.15.5:51900) 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 -- 172.21.15.5:0/3223423149 learned_addr learned my addr 172.21.15.5:0/3223423149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff032d9d640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03259c640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0340d27e0 0x7ff0340b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 -- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 msgr2=0x7ff0340b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 -- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0340d27e0 msgr2=0x7ff0340b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0340d27e0 0x7ff0340b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 -- 172.21.15.5:0/3223423149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094d0 con 0x7ff03415c920 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff03359e640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff024007e60 tx=0x7ff02400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024014420 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0240145a0 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024014950 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff034159320 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.762+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0341598e0 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.763+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0340672f0 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.764+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff024014ab0 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.764+0000 7ff02b7fe640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.764+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff024089de0 con 0x7ff03415c920 2024-09-13T17:18:21.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.764+0000 7ff032d9d640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:21.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.765+0000 7ff032d9d640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 0x7ff01406d0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:21.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.768+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff024054e90 con 0x7ff03415c920 2024-09-13T17:18:21.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.974+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff034159b00 con 0x7ff03415c920 2024-09-13T17:18:21.975 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:18:21.974+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:18:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.981+0000 7ff02b7fe640 1 -- 172.21.15.5:0/3223423149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff0240584b0 con 0x7ff03415c920 2024-09-13T17:18:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:18:21.984 INFO:tasks.ceph.mds.a.smithi005.stderr: -1210> 2024-09-13T17:17:58.489+0000 7f895ce3d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:18:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 msgr2=0x7ff01406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 0x7ff01406d0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 msgr2=0x7ff0340cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff024007e60 tx=0x7ff02400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 shutdown_connections 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff01406ac00 0x7ff01406d0c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff03415c920 0x7ff0340cbd30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0340d27e0 0x7ff0340b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 --2- 172.21.15.5:0/3223423149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0340d09f0 0x7ff0340b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 >> 172.21.15.5:0/3223423149 conn(0x7ff034071c30 msgr2=0x7ff0340d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 shutdown_connections 2024-09-13T17:18:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:21.984+0000 7ff039220640 1 -- 172.21.15.5:0/3223423149 wait complete. 2024-09-13T17:18:21.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:18:22.014 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:18:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.102+0000 7f0154832640 1 Processor -- start 2024-09-13T17:18:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.102+0000 7f0154832640 1 -- start start 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.103+0000 7f0154832640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f015015c800 0x7f01500d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.103+0000 7f0154832640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01500b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.103+0000 7f0154832640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500d1f80 con 0x7f01500d0e60 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.103+0000 7f0154832640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500b8670 con 0x7f015015c800 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.103+0000 7f0154832640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500d2410 con 0x7f01500cf6d0 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01500d0e60 0x7f01500cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51284/0 (socket says 172.21.15.5:51284) 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014dd9b640 1 -- 172.21.15.5:0/1031067394 learned_addr learned my addr 172.21.15.5:0/1031067394 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014ed9d640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01500b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014e59c640 1 --2- 172.21.15.5:0/1031067394 >> v2:172.21.15.179:3300/0 conn(0x7f015015c800 0x7f01500d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891051909 0 0) 0x7f01500d1f80 con 0x7f01500d0e60 2024-09-13T17:18:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003520 con 0x7f01500d0e60 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2905090345 0 0) 0x7f0138003520 con 0x7f01500d0e60 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 msgr2=0x7f01500b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01500b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 >> v2:172.21.15.179:3300/0 conn(0x7f015015c800 msgr2=0x7f01500d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 --2- 172.21.15.5:0/1031067394 >> v2:172.21.15.179:3300/0 conn(0x7f015015c800 0x7f01500d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500d1370 con 0x7f01500d0e60 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0144001670 con 0x7f01500d0e60 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 >> v1:172.21.15.5:6789/0 conn(0x7f01500d0e60 legacy=0x7f01500cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f0138003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0138004d00 0x7f0138005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b8670 con 0x7f0138003970 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500d2410 con 0x7f0138004d00 2024-09-13T17:18:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013800b980 con 0x7f01500cf6d0 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014e59c640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f0138003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.104+0000 7f014dd9b640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014ed9d640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0138004d00 0x7f0138005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 -- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 msgr2=0x7f01380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cf6d0 0x7f01380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 -- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0138004d00 msgr2=0x7f0138005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0138004d00 0x7f0138005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 -- 172.21.15.5:0/1031067394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138003520 con 0x7f0138003970 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.105+0000 7f014e59c640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f0138003d90 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0140009ac0 tx=0x7f01380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434aeda2cb45efb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140031400 con 0x7f0138003970 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014002d050 con 0x7f0138003970 2024-09-13T17:18:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f014d59a640 1 -- 172.21.15.5:0/1031067394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140031780 con 0x7f0138003970 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 -- 172.21.15.5:0/1031067394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 msgr2=0x7f0138003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 --2- 172.21.15.5:0/1031067394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f0138003d90 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0140009ac0 tx=0x7f01380057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f014ed9d640 1 -- 172.21.15.5:0/1031067394 reap_dead start 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 -- 172.21.15.5:0/1031067394 shutdown_connections 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 -- 172.21.15.5:0/1031067394 >> 172.21.15.5:0/1031067394 conn(0x7f015006b110 msgr2=0x7f015006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 -- 172.21.15.5:0/1031067394 shutdown_connections 2024-09-13T17:18:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.106+0000 7f0154832640 1 -- 172.21.15.5:0/1031067394 wait complete. 2024-09-13T17:18:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 Processor -- start 2024-09-13T17:18:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 -- start start 2024-09-13T17:18:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0150154df0 0x7f01500cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cd370 0x7f01501585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500cd7f0 con 0x7f0138003970 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500c9390 con 0x7f0150154df0 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f0154832640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0150157380 con 0x7f01500cd370 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f014e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f014e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51940/0 (socket says 172.21.15.5:51940) 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.108+0000 7f014e59c640 1 -- 172.21.15.5:0/2392475967 learned_addr learned my addr 172.21.15.5:0/2392475967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014dd9b640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0150154df0 0x7f01500cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 -- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cd370 msgr2=0x7f01501585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014ed9d640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cd370 0x7f01501585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cd370 0x7f01501585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 -- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0150154df0 msgr2=0x7f01500cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0150154df0 0x7f01500cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 -- 172.21.15.5:0/2392475967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150157660 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f014e59c640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0140034040 tx=0x7f0140004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140003bb0 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140003d10 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0150157940 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140044650 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.109+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0150155d30 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.110+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01500672f0 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.111+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0140038070 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.111+0000 7f013effd640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 0x7f013006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.111+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f01400a90e0 con 0x7f0138003970 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.111+0000 7f014dd9b640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 0x7f013006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.112+0000 7f014dd9b640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 0x7f013006d0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f01501f5870 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.116+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01400741b0 con 0x7f0138003970 2024-09-13T17:18:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.328+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01500c6000 con 0x7f0138003970 2024-09-13T17:18:22.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.983+0000 7f013effd640 1 -- 172.21.15.5:0/2392475967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f01400777d0 con 0x7f0138003970 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 msgr2=0x7f013006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 0x7f013006d0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f01501f5870 tx=0x7f0144009040 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 msgr2=0x7f01500c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0140034040 tx=0x7f0140004730 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 shutdown_connections 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01500cd370 0x7f01501585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0150154df0 0x7f01500cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f013006ac30 0x7f013006d0f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 --2- 172.21.15.5:0/2392475967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0138003970 0x7f01500c8e50 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:22.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.985+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 >> 172.21.15.5:0/2392475967 conn(0x7f015006b110 msgr2=0x7f015015efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:22.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.986+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 shutdown_connections 2024-09-13T17:18:22.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:22.986+0000 7f0154832640 1 -- 172.21.15.5:0/2392475967 wait complete. 2024-09-13T17:18:23.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:18:23.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.153+0000 7f2478133640 1 Processor -- start 2024-09-13T17:18:23.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 -- start start 2024-09-13T17:18:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f247015c760 0x7f24700cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 0x7f24700cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24700d34d0 con 0x7f24700d1b00 2024-09-13T17:18:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700cddb0 con 0x7f247015c760 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2478133640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700b5700 con 0x7f24700d20c0 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2475ecf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f247015c760 0x7f24700cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2475ecf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f247015c760 0x7f24700cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51954/0 (socket says 172.21.15.5:51954) 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.154+0000 7f2475ecf640 1 -- 172.21.15.5:0/3984178568 learned_addr learned my addr 172.21.15.5:0/3984178568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f24756ce640 1 --2- 172.21.15.5:0/3984178568 >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 0x7f24700cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f2475ecf640 1 -- 172.21.15.5:0/3984178568 >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 msgr2=0x7f24700cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f2475ecf640 1 --2- 172.21.15.5:0/3984178568 >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 0x7f24700cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f2475ecf640 1 -- 172.21.15.5:0/3984178568 >> v1:172.21.15.179:6789/0 conn(0x7f24700d1b00 legacy=0x7f24700b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f2475ecf640 1 -- 172.21.15.5:0/3984178568 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700d2950 con 0x7f247015c760 2024-09-13T17:18:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.155+0000 7f24756ce640 1 --2- 172.21.15.5:0/3984178568 >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 0x7f24700cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2475ecf640 1 --2- 172.21.15.5:0/3984178568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24700cf640 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f24701600c0 tx=0x7f246002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abe8c489cdef9b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2474ecd640 1 -- 172.21.15.5:0/3984178568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460031600 con 0x7f247015c760 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2474ecd640 1 -- 172.21.15.5:0/3984178568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246002d050 con 0x7f247015c760 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2474ecd640 1 -- 172.21.15.5:0/3984178568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460031980 con 0x7f247015c760 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 -- 172.21.15.5:0/3984178568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 msgr2=0x7f24700cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 --2- 172.21.15.5:0/3984178568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24700cf640 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f24701600c0 tx=0x7f246002a660 comp rx=0 tx=0).stop 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 -- 172.21.15.5:0/3984178568 shutdown_connections 2024-09-13T17:18:23.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 --2- 172.21.15.5:0/3984178568 >> v2:172.21.15.179:3300/0 conn(0x7f24700d20c0 0x7f24700cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 --2- 172.21.15.5:0/3984178568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24700cf640 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 -- 172.21.15.5:0/3984178568 >> 172.21.15.5:0/3984178568 conn(0x7f2470071a20 msgr2=0x7f2470071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:23.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 -- 172.21.15.5:0/3984178568 shutdown_connections 2024-09-13T17:18:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.156+0000 7f2478133640 1 -- 172.21.15.5:0/3984178568 wait complete. 2024-09-13T17:18:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 Processor -- start 2024-09-13T17:18:23.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 -- start start 2024-09-13T17:18:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24700d1b00 0x7f24701583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24700d20c0 0x7f24700c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c7730 con 0x7f247015c760 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c79d0 con 0x7f24700d20c0 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f2478133640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c7cb0 con 0x7f24700d1b00 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.158+0000 7f24766d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51956/0 (socket says 172.21.15.5:51956) 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 -- 172.21.15.5:0/525118936 learned_addr learned my addr 172.21.15.5:0/525118936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24756ce640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24700d20c0 0x7f24700c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f2475ecf640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24700d1b00 0x7f24701583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 -- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24700d1b00 msgr2=0x7f24701583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24700d1b00 0x7f24701583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 -- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24700d20c0 msgr2=0x7f24700c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24700d20c0 0x7f24700c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 -- 172.21.15.5:0/525118936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009b30 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f24766d0640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f246800c410 tx=0x7f246800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468011790 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680118f0 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700c7f90 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468011ce0 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.159+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700c8550 con 0x7f247015c760 2024-09-13T17:18:23.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.160+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700c8740 con 0x7f247015c760 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.161+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f246801c460 con 0x7f247015c760 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.161+0000 7f246e7fc640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 0x7f245c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.162+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f2468089150 con 0x7f247015c760 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.162+0000 7f2475ecf640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 0x7f245c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.162+0000 7f2475ecf640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 0x7f245c06d0f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2460033000 tx=0x7f2460009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:23.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.166+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2468054220 con 0x7f247015c760 2024-09-13T17:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.339+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24700d2580 con 0x7f247015c760 2024-09-13T17:18:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.985+0000 7f246e7fc640 1 -- 172.21.15.5:0/525118936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2468057840 con 0x7f247015c760 2024-09-13T17:18:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:18:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 msgr2=0x7f245c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 0x7f245c06d0f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2460033000 tx=0x7f2460009000 comp rx=0 tx=0).stop 2024-09-13T17:18:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 msgr2=0x7f24701565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f246800c410 tx=0x7f246800c8d0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 shutdown_connections 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f245c06ac30 0x7f245c06d0f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247015c760 0x7f24701565b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24700d20c0 0x7f24700c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 --2- 172.21.15.5:0/525118936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24700d1b00 0x7f24701583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 >> 172.21.15.5:0/525118936 conn(0x7f2470071a20 msgr2=0x7f24700ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 shutdown_connections 2024-09-13T17:18:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:23.990+0000 7f2478133640 1 -- 172.21.15.5:0/525118936 wait complete. 2024-09-13T17:18:24.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:18:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.118+0000 7f756732c640 1 Processor -- start 2024-09-13T17:18:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.118+0000 7f756732c640 1 -- start start 2024-09-13T17:18:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f756732c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7560160b90 0x7f756006c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f756732c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f756732c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75600adf60 con 0x7f75600cd940 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f756732c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75600adc80 con 0x7f7560160b90 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f756732c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756006e0d0 con 0x7f75600b14f0 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f75650c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7560160b90 0x7f756006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f75658c9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75600cd940 0x7f7560164580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55828/0 (socket says 172.21.15.5:55828) 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.119+0000 7f75658c9640 1 -- 172.21.15.5:0/1295510809 learned_addr learned my addr 172.21.15.5:0/1295510809 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75648c7640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f7557fff640 1 -- 172.21.15.5:0/1295510809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411777726 0 0) 0x7f75600adf60 con 0x7f75600cd940 2024-09-13T17:18:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f7557fff640 1 -- 172.21.15.5:0/1295510809 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f754c003520 con 0x7f75600cd940 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75650c8640 1 -- 172.21.15.5:0/1295510809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 msgr2=0x7f756006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75650c8640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756006c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75650c8640 1 -- 172.21.15.5:0/1295510809 >> v1:172.21.15.5:6789/0 conn(0x7f75600cd940 legacy=0x7f7560164580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75650c8640 1 -- 172.21.15.5:0/1295510809 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756006e3b0 con 0x7f7560160b90 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75648c7640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.120+0000 7f75650c8640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7560160b90 0x7f756006c370 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f755c009d90 tx=0x7f755c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a520719f57187b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f7557fff640 1 -- 172.21.15.5:0/1295510809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c031600 con 0x7f7560160b90 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f7557fff640 1 -- 172.21.15.5:0/1295510809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c02d050 con 0x7f7560160b90 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f7557fff640 1 -- 172.21.15.5:0/1295510809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c031980 con 0x7f7560160b90 2024-09-13T17:18:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 -- 172.21.15.5:0/1295510809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7560160b90 msgr2=0x7f756006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7560160b90 0x7f756006c370 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f755c009d90 tx=0x7f755c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 -- 172.21.15.5:0/1295510809 shutdown_connections 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 --2- 172.21.15.5:0/1295510809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7560160b90 0x7f756006c370 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 -- 172.21.15.5:0/1295510809 >> 172.21.15.5:0/1295510809 conn(0x7f7560069ed0 msgr2=0x7f756006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 -- 172.21.15.5:0/1295510809 shutdown_connections 2024-09-13T17:18:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.121+0000 7f756732c640 1 -- 172.21.15.5:0/1295510809 wait complete. 2024-09-13T17:18:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 Processor -- start 2024-09-13T17:18:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 -- start start 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560160b90 0x7f75601488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560149470 con 0x7f75600cd940 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560161540 con 0x7f7560160b90 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f756732c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7560161820 con 0x7f75600b14f0 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f75648c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f75648c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60920/0 (socket says 172.21.15.5:60920) 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.123+0000 7f75648c7640 1 -- 172.21.15.5:0/181888057 learned_addr learned my addr 172.21.15.5:0/181888057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 -- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 msgr2=0x7f756015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75650c8640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75658c9640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560160b90 0x7f75601488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 -- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560160b90 msgr2=0x7f75601488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560160b90 0x7f75601488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 -- 172.21.15.5:0/181888057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c009a70 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f75648c7640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f755000e810 tx=0x7f755000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000c6d0 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000c830 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7560161b00 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000cbe0 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.124+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7560157d10 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.125+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756006d170 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.126+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f755000cd40 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.126+0000 7f7555ffb640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 0x7f754406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.126+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f7550089060 con 0x7f75600cd940 2024-09-13T17:18:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.127+0000 7f75650c8640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 0x7f754406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.127+0000 7f75650c8640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 0x7f754406d0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f755c034000 tx=0x7f755c033040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.130+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75500542f0 con 0x7f75600cd940 2024-09-13T17:18:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.304+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f756006aa50 con 0x7f75600cd940 2024-09-13T17:18:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.992+0000 7f7555ffb640 1 -- 172.21.15.5:0/181888057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7550057910 con 0x7f75600cd940 2024-09-13T17:18:24.993 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:18:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 msgr2=0x7f754406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 0x7f754406d0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f755c034000 tx=0x7f755c033040 comp rx=0 tx=0).stop 2024-09-13T17:18:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 msgr2=0x7f7560157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:24.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f755000e810 tx=0x7f755000ecd0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 shutdown_connections 2024-09-13T17:18:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560160b90 0x7f75601488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f754406ac00 0x7f754406d0c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600cd940 0x7f7560157680 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:24.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 --2- 172.21.15.5:0/181888057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600b14f0 0x7f756015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.996+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 >> 172.21.15.5:0/181888057 conn(0x7f7560069ed0 msgr2=0x7f75600b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.997+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 shutdown_connections 2024-09-13T17:18:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:24.997+0000 7f756732c640 1 -- 172.21.15.5:0/181888057 wait complete. 2024-09-13T17:18:25.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:18:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.118+0000 7fc683bb5640 1 Processor -- start 2024-09-13T17:18:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.118+0000 7fc683bb5640 1 -- start start 2024-09-13T17:18:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc683bb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc683bb5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc67c0703e0 0x7fc67c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc683bb5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0cbf70 con 0x7fc67c0cb510 2024-09-13T17:18:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc683bb5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c070d30 con 0x7fc67c0703e0 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc683bb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0cb9b0 con 0x7fc67c143800 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc682152640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc67c0703e0 0x7fc67c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc681150640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc67c0cb510 0x7fc67c15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55830/0 (socket says 172.21.15.5:55830) 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc681150640 1 -- 172.21.15.5:0/243294440 learned_addr learned my addr 172.21.15.5:0/243294440 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc681951640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc682152640 1 -- 172.21.15.5:0/243294440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 msgr2=0x7fc67c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc682152640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc682152640 1 -- 172.21.15.5:0/243294440 >> v1:172.21.15.5:6789/0 conn(0x7fc67c0cb510 legacy=0x7fc67c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc68094f640 1 -- 172.21.15.5:0/243294440 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145496420 0 0) 0x7fc67c0cbf70 con 0x7fc67c0cb510 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.119+0000 7fc682152640 1 -- 172.21.15.5:0/243294440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0cbc90 con 0x7fc67c0703e0 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.120+0000 7fc682152640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c0707f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc674009d90 tx=0x7fc67402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237ebde49dcf7942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.120+0000 7fc68094f640 1 -- 172.21.15.5:0/243294440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674007740 con 0x7fc67c0703e0 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.120+0000 7fc68094f640 1 -- 172.21.15.5:0/243294440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67402d050 con 0x7fc67c0703e0 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.120+0000 7fc68094f640 1 -- 172.21.15.5:0/243294440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674007ac0 con 0x7fc67c0703e0 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.120+0000 7fc683bb5640 1 -- 172.21.15.5:0/243294440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 msgr2=0x7fc67c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c0707f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc674009d90 tx=0x7fc67402a530 comp rx=0 tx=0).stop 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 -- 172.21.15.5:0/243294440 shutdown_connections 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c0707f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 --2- 172.21.15.5:0/243294440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 -- 172.21.15.5:0/243294440 >> 172.21.15.5:0/243294440 conn(0x7fc67c0b02f0 msgr2=0x7fc67c0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 -- 172.21.15.5:0/243294440 shutdown_connections 2024-09-13T17:18:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.121+0000 7fc683bb5640 1 -- 172.21.15.5:0/243294440 wait complete. 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.122+0000 7fc683bb5640 1 Processor -- start 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.122+0000 7fc683bb5640 1 -- start start 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 0x7fc67c135da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c15a5e0 con 0x7fc67c0703e0 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c06d3c0 con 0x7fc67c0cb510 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc683bb5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c06c740 con 0x7fc67c143800 2024-09-13T17:18:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60940/0 (socket says 172.21.15.5:60940) 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 -- 172.21.15.5:0/27282867 learned_addr learned my addr 172.21.15.5:0/27282867 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc682152640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681150640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 0x7fc67c135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 -- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 msgr2=0x7fc67c140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 -- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 msgr2=0x7fc67c135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 0x7fc67c135da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 -- 172.21.15.5:0/27282867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009a70 con 0x7fc67c0703e0 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681150640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 0x7fc67c135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc681951640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc67800d5f0 tx=0x7fc67800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780125f0 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.123+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678012750 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.124+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678012b00 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.124+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c06ca20 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.124+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c06cfe0 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.125+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0672f0 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.125+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc678012c60 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.126+0000 7fc6727fc640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 0x7fc66006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.126+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc678089600 con 0x7fc67c0703e0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.126+0000 7fc681150640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 0x7fc66006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.126+0000 7fc681150640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 0x7fc66006d0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c51c0 tx=0x7fc66c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.130+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6780549a0 con 0x7fc67c0703e0 2024-09-13T17:18:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.302+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc67c144050 con 0x7fc67c0703e0 2024-09-13T17:18:25.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.306+0000 7fc6727fc640 1 -- 172.21.15.5:0/27282867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc678057fc0 con 0x7fc67c0703e0 2024-09-13T17:18:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 msgr2=0x7fc66006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 0x7fc66006d0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c51c0 tx=0x7fc66c009040 comp rx=0 tx=0).stop 2024-09-13T17:18:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 msgr2=0x7fc67c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc67800d5f0 tx=0x7fc67800dab0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 shutdown_connections 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc67c143800 0x7fc67c140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c0cb510 0x7fc67c135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc66006ac30 0x7fc66006d0f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.307+0000 7fc683bb5640 1 --2- 172.21.15.5:0/27282867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc67c0703e0 0x7fc67c06c160 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.308+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 >> 172.21.15.5:0/27282867 conn(0x7fc67c0b02f0 msgr2=0x7fc67c0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.308+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 shutdown_connections 2024-09-13T17:18:25.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.308+0000 7fc683bb5640 1 -- 172.21.15.5:0/27282867 wait complete. 2024-09-13T17:18:25.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-13T17:18:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.419+0000 7fa36bbce640 1 Processor -- start 2024-09-13T17:18:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 -- start start 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3640cd630 0x7fa3640b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 0x7fa3640b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36415cdd0 con 0x7fa36415c9f0 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640b8750 con 0x7fa3640cd630 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36bbce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640d2c20 con 0x7fa3640b5820 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36996a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa36415c9f0 0x7fa3640b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55842/0 (socket says 172.21.15.5:55842) 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa36996a640 1 -- 172.21.15.5:0/3907992020 learned_addr learned my addr 172.21.15.5:0/3907992020 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.420+0000 7fa369169640 1 --2- 172.21.15.5:0/3907992020 >> v2:172.21.15.5:3300/0 conn(0x7fa3640cd630 0x7fa3640b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa368968640 1 -- 172.21.15.5:0/3907992020 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319752719 0 0) 0x7fa36415cdd0 con 0x7fa36415c9f0 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa368968640 1 -- 172.21.15.5:0/3907992020 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa34c003520 con 0x7fa36415c9f0 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa36a16b640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 0x7fa3640b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa369169640 1 -- 172.21.15.5:0/3907992020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 msgr2=0x7fa3640b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa369169640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 0x7fa3640b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa369169640 1 -- 172.21.15.5:0/3907992020 >> v1:172.21.15.5:6789/0 conn(0x7fa36415c9f0 legacy=0x7fa3640b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa369169640 1 -- 172.21.15.5:0/3907992020 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640d3040 con 0x7fa3640cd630 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.421+0000 7fa36a16b640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 0x7fa3640b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa369169640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3640cd630 0x7fa3640b4880 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa3580097a0 tx=0x7fa35802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f538401cc69df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa368968640 1 -- 172.21.15.5:0/3907992020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35802ae50 con 0x7fa3640cd630 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa368968640 1 -- 172.21.15.5:0/3907992020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358032440 con 0x7fa3640cd630 2024-09-13T17:18:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa368968640 1 -- 172.21.15.5:0/3907992020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580327d0 con 0x7fa3640cd630 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 -- 172.21.15.5:0/3907992020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3640cd630 msgr2=0x7fa3640b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3640cd630 0x7fa3640b4880 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa3580097a0 tx=0x7fa35802a100 comp rx=0 tx=0).stop 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 -- 172.21.15.5:0/3907992020 shutdown_connections 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640b5820 0x7fa3640b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 --2- 172.21.15.5:0/3907992020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3640cd630 0x7fa3640b4880 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 -- 172.21.15.5:0/3907992020 >> 172.21.15.5:0/3907992020 conn(0x7fa364071a20 msgr2=0x7fa364071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 -- 172.21.15.5:0/3907992020 shutdown_connections 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.422+0000 7fa36bbce640 1 -- 172.21.15.5:0/3907992020 wait complete. 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 Processor -- start 2024-09-13T17:18:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 -- start start 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 0x7fa364147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640cd630 0x7fa3641f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364148e40 con 0x7fa36415c9f0 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36415e0c0 con 0x7fa3640b5820 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.424+0000 7fa36bbce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3641f6270 con 0x7fa3640cd630 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60950/0 (socket says 172.21.15.5:60950) 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 -- 172.21.15.5:0/302586406 learned_addr learned my addr 172.21.15.5:0/302586406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa369169640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640cd630 0x7fa3641f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36996a640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 0x7fa364147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 -- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640cd630 msgr2=0x7fa3641f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640cd630 0x7fa3641f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 -- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 msgr2=0x7fa364147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 0x7fa364147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 -- 172.21.15.5:0/302586406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009400 con 0x7fa36415c9f0 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36996a640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 0x7fa364147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36a16b640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c820 tx=0x7fa35c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c007a30 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c007b90 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00ce10 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3641485a0 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.425+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364148b60 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.426+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36415de20 con 0x7fa36415c9f0 2024-09-13T17:18:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.427+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa35c0113f0 con 0x7fa36415c9f0 2024-09-13T17:18:25.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.427+0000 7fa3627fc640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:25.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.427+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa35c089210 con 0x7fa36415c9f0 2024-09-13T17:18:25.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.428+0000 7fa36996a640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:25.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.428+0000 7fa36996a640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 0x7fa35006d0c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa354001560 tx=0x7fa354009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:25.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.431+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa36415de20 con 0x7fa36415c9f0 2024-09-13T17:18:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.667+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7fa36415e200 con 0x7fa36415c9f0 2024-09-13T17:18:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.993+0000 7fa3627fc640 1 -- 172.21.15.5:0/302586406 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v291) v1 ==== 145+0+0 (secure 0 0 0) 0x7fa36415e200 con 0x7fa36415c9f0 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 msgr2=0x7fa35006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 0x7fa35006d0c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa354001560 tx=0x7fa354009040 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 msgr2=0x7fa3640b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c820 tx=0x7fa35c00cce0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 shutdown_connections 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35006ac00 0x7fa35006d0c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa36415c9f0 0x7fa3640b2080 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3640cd630 0x7fa3641f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 --2- 172.21.15.5:0/302586406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3640b5820 0x7fa364147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:25.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 >> 172.21.15.5:0/302586406 conn(0x7fa364071a20 msgr2=0x7fa3640b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 shutdown_connections 2024-09-13T17:18:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:25.995+0000 7fa36bbce640 1 -- 172.21.15.5:0/302586406 wait complete. 2024-09-13T17:18:26.008 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-13T17:18:26.008 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2024-09-13T17:18:26.008 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-13T17:18:26.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:26.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.110+0000 7ff8ccc44640 1 Processor -- start 2024-09-13T17:18:26.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.110+0000 7ff8ccc44640 1 -- start start 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8ccc44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8ccc44640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff8c815a880 0x7ff8c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8ccc44640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c80b2180 con 0x7ff8c80cafb0 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8ccc44640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c80cdab0 con 0x7ff8c815a880 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8ccc44640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80b2420 con 0x7ff8c815a4a0 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8c5d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff8c815a880 0x7ff8c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8c659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:47448/0 (socket says 172.21.15.5:47448) 2024-09-13T17:18:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.111+0000 7ff8c659c640 1 -- 172.21.15.5:0/3033491482 learned_addr learned my addr 172.21.15.5:0/3033491482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.112+0000 7ff8c659c640 1 -- 172.21.15.5:0/3033491482 >> v2:172.21.15.179:3300/0 conn(0x7ff8c815a880 msgr2=0x7ff8c80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.112+0000 7ff8c659c640 1 --2- 172.21.15.5:0/3033491482 >> v2:172.21.15.179:3300/0 conn(0x7ff8c815a880 0x7ff8c80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.112+0000 7ff8c659c640 1 -- 172.21.15.5:0/3033491482 >> v1:172.21.15.179:6789/0 conn(0x7ff8c80cafb0 legacy=0x7ff8c80703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.112+0000 7ff8c659c640 1 -- 172.21.15.5:0/3033491482 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80b2700 con 0x7ff8c815a4a0 2024-09-13T17:18:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8c659c640 1 --2- 172.21.15.5:0/3033491482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009e50 tx=0x7ff8b802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d805e811777a3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8c559a640 1 -- 172.21.15.5:0/3033491482 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8031600 con 0x7ff8c815a4a0 2024-09-13T17:18:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8c559a640 1 -- 172.21.15.5:0/3033491482 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b802d050 con 0x7ff8c815a4a0 2024-09-13T17:18:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8c559a640 1 -- 172.21.15.5:0/3033491482 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8031980 con 0x7ff8c815a4a0 2024-09-13T17:18:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 -- 172.21.15.5:0/3033491482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 msgr2=0x7ff8c80cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/3033491482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009e50 tx=0x7ff8b802a710 comp rx=0 tx=0).stop 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 -- 172.21.15.5:0/3033491482 shutdown_connections 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/3033491482 >> v2:172.21.15.179:3300/0 conn(0x7ff8c815a880 0x7ff8c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/3033491482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c80cdc50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 -- 172.21.15.5:0/3033491482 >> 172.21.15.5:0/3033491482 conn(0x7ff8c8066200 msgr2=0x7ff8c8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 -- 172.21.15.5:0/3033491482 shutdown_connections 2024-09-13T17:18:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.113+0000 7ff8ccc44640 1 -- 172.21.15.5:0/3033491482 wait complete. 2024-09-13T17:18:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 Processor -- start 2024-09-13T17:18:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 -- start start 2024-09-13T17:18:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8c80cafb0 0x7ff8c80aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c806c440 con 0x7ff8c815a880 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c806dd00 con 0x7ff8c80cafb0 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8ccc44640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8153340 con 0x7ff8c815a4a0 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.115+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60966/0 (socket says 172.21.15.5:60966) 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 -- 172.21.15.5:0/640849946 learned_addr learned my addr 172.21.15.5:0/640849946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c5d9b640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c659c640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8c80cafb0 0x7ff8c80aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 -- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 msgr2=0x7ff8c8152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c8152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 -- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8c80cafb0 msgr2=0x7ff8c80aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8c80cafb0 0x7ff8c80aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 -- 172.21.15.5:0/640849946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009b30 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8c6d9d640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0001eb0 tx=0x7ff8c000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00052d0 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c0005430 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c806dfa0 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0003810 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.116+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c806c690 con 0x7ff8c815a880 2024-09-13T17:18:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.117+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c806e4c0 con 0x7ff8c815a880 2024-09-13T17:18:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.118+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8c0003970 con 0x7ff8c815a880 2024-09-13T17:18:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.118+0000 7ff8beffd640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 0x7ff8a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.118+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff8c00886e0 con 0x7ff8c815a880 2024-09-13T17:18:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.119+0000 7ff8c659c640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 0x7ff8a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.119+0000 7ff8c659c640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 0x7ff8a806d0c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8033000 tx=0x7ff8b8009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.123+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff8c0053a90 con 0x7ff8c815a880 2024-09-13T17:18:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.298+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8c80672f0 con 0x7ff8c815a880 2024-09-13T17:18:26.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.299+0000 7ff8beffd640 1 -- 172.21.15.5:0/640849946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+13154 (secure 0 0 0) 0x7ff8c00570b0 con 0x7ff8c815a880 2024-09-13T17:18:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:26.301 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:24.989691+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/2901929120":"2024-09-14T17:18:21.975049+0000","172.21.15.5:6832/2901929120":"2024-09-14T17:18:21.975049+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.301+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 msgr2=0x7ff8a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.301+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 0x7ff8a806d0c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8033000 tx=0x7ff8b8009000 comp rx=0 tx=0).stop 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.301+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 msgr2=0x7ff8c81569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.301+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0001eb0 tx=0x7ff8c000c890 comp rx=0 tx=0).stop 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 shutdown_connections 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8a806ac00 0x7ff8a806d0c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8c815a880 0x7ff8c81569e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8c815a4a0 0x7ff8c8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 --2- 172.21.15.5:0/640849946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8c80cafb0 0x7ff8c80aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 >> 172.21.15.5:0/640849946 conn(0x7ff8c8066200 msgr2=0x7ff8c80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 shutdown_connections 2024-09-13T17:18:26.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.302+0000 7ff8ccc44640 1 -- 172.21.15.5:0/640849946 wait complete. 2024-09-13T17:18:26.314 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:26.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:26.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.417+0000 7fd5e398a640 1 Processor -- start 2024-09-13T17:18:26.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.417+0000 7fd5e398a640 1 -- start start 2024-09-13T17:18:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e398a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5dc15c760 0x7fd5dc0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e398a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e398a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0d34d0 con 0x7fd5dc0d20c0 2024-09-13T17:18:26.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e398a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0cddb0 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e398a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b5700 con 0x7fd5dc15c760 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e1f27640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e1f27640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60974/0 (socket says 172.21.15.5:60974) 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.418+0000 7fd5e1f27640 1 -- 172.21.15.5:0/3202011119 learned_addr learned my addr 172.21.15.5:0/3202011119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.419+0000 7fd5e1f27640 1 -- 172.21.15.5:0/3202011119 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc15c760 msgr2=0x7fd5dc0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.419+0000 7fd5e1f27640 1 --2- 172.21.15.5:0/3202011119 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc15c760 0x7fd5dc0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.419+0000 7fd5e1f27640 1 -- 172.21.15.5:0/3202011119 >> v1:172.21.15.179:6789/0 conn(0x7fd5dc0d20c0 legacy=0x7fd5dc0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.419+0000 7fd5e1f27640 1 -- 172.21.15.5:0/3202011119 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0d2950 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.419+0000 7fd5e1f27640 1 --2- 172.21.15.5:0/3202011119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06c110 tx=0x7fd5cc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2ea6a858c5294a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5dbfff640 1 -- 172.21.15.5:0/3202011119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc031600 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5dbfff640 1 -- 172.21.15.5:0/3202011119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02d050 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5dbfff640 1 -- 172.21.15.5:0/3202011119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc031980 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 -- 172.21.15.5:0/3202011119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc0d1b00 msgr2=0x7fd5dc0cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 --2- 172.21.15.5:0/3202011119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06c110 tx=0x7fd5cc02a660 comp rx=0 tx=0).stop 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 -- 172.21.15.5:0/3202011119 shutdown_connections 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 --2- 172.21.15.5:0/3202011119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc0d1b00 0x7fd5dc0cfb80 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 --2- 172.21.15.5:0/3202011119 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc15c760 0x7fd5dc0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 -- 172.21.15.5:0/3202011119 >> 172.21.15.5:0/3202011119 conn(0x7fd5dc071a20 msgr2=0x7fd5dc071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 -- 172.21.15.5:0/3202011119 shutdown_connections 2024-09-13T17:18:26.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.420+0000 7fd5e398a640 1 -- 172.21.15.5:0/3202011119 wait complete. 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.421+0000 7fd5e398a640 1 Processor -- start 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.421+0000 7fd5e398a640 1 -- start start 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 0x7fd5dc145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0d20c0 0x7fd5dc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c80a0 con 0x7fd5dc15c760 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c71f0 con 0x7fd5dc0d20c0 2024-09-13T17:18:26.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e398a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c7490 con 0x7fd5dc0d1b00 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e1f27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e1f27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60988/0 (socket says 172.21.15.5:60988) 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.422+0000 7fd5e1f27640 1 -- 172.21.15.5:0/2050496047 learned_addr learned my addr 172.21.15.5:0/2050496047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1726640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 0x7fd5dc145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 -- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 msgr2=0x7fd5dc145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e0f25640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0d20c0 0x7fd5dc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 0x7fd5dc145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 -- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0d20c0 msgr2=0x7fd5dc0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0d20c0 0x7fd5dc0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 -- 172.21.15.5:0/2050496047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009b30 con 0x7fd5dc15c760 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1726640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 0x7fd5dc145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e1f27640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc03b820 con 0x7fd5dc15c760 2024-09-13T17:18:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc03b9a0 con 0x7fd5dc15c760 2024-09-13T17:18:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0c7770 con 0x7fd5dc15c760 2024-09-13T17:18:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc03bd50 con 0x7fd5dc15c760 2024-09-13T17:18:26.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.423+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0c7d30 con 0x7fd5dc15c760 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.424+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc0c8210 con 0x7fd5dc15c760 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.425+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5cc038050 con 0x7fd5dc15c760 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.425+0000 7fd5d9ffb640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 0x7fd5c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.425+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd5cc02ae40 con 0x7fd5dc15c760 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.425+0000 7fd5e1726640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 0x7fd5c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.426+0000 7fd5e1726640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 0x7fd5c806d0f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400a870 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.429+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5cc0750a0 con 0x7fd5dc15c760 2024-09-13T17:18:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.600+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5dc0d2580 con 0x7fd5dc15c760 2024-09-13T17:18:26.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.600+0000 7fd5d9ffb640 1 -- 172.21.15.5:0/2050496047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5cc04b0a0 con 0x7fd5dc15c760 2024-09-13T17:18:26.601 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:26.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 msgr2=0x7fd5c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 0x7fd5c806d0f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400a870 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 msgr2=0x7fd5dc158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 shutdown_connections 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd5c806ac30 0x7fd5c806d0f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5dc15c760 0x7fd5dc158fa0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc0d20c0 0x7fd5dc0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 --2- 172.21.15.5:0/2050496047 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0d1b00 0x7fd5dc145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 >> 172.21.15.5:0/2050496047 conn(0x7fd5dc071a20 msgr2=0x7fd5dc0b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 shutdown_connections 2024-09-13T17:18:26.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.602+0000 7fd5e398a640 1 -- 172.21.15.5:0/2050496047 wait complete. 2024-09-13T17:18:26.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-13T17:18:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.715+0000 7f4521f18640 1 Processor -- start 2024-09-13T17:18:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.715+0000 7f4521f18640 1 -- start start 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f4521f18640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f451c15c680 0x7f451c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f4521f18640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f451c0ad090 0x7f451c0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f4521f18640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0ad9e0 con 0x7f451c0ae270 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f4521f18640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c071a80 con 0x7f451c0ad090 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f4521f18640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0ac5f0 con 0x7f451c15c680 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f451c0ad090 0x7f451c0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f451c0ae270 0x7f451c0ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55850/0 (socket says 172.21.15.5:55850) 2024-09-13T17:18:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451affd640 1 -- 172.21.15.5:0/2544793959 learned_addr learned my addr 172.21.15.5:0/2544793959 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451b7fe640 1 --2- 172.21.15.5:0/2544793959 >> v2:172.21.15.179:3300/0 conn(0x7f451c15c680 0x7f451c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451bfff640 1 -- 172.21.15.5:0/2544793959 >> v2:172.21.15.179:3300/0 conn(0x7f451c15c680 msgr2=0x7f451c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451bfff640 1 --2- 172.21.15.5:0/2544793959 >> v2:172.21.15.179:3300/0 conn(0x7f451c15c680 0x7f451c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451bfff640 1 -- 172.21.15.5:0/2544793959 >> v1:172.21.15.5:6789/0 conn(0x7f451c0ae270 legacy=0x7f451c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451bfff640 1 -- 172.21.15.5:0/2544793959 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0714c0 con 0x7f451c0ad090 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.716+0000 7f451a7fc640 1 -- 172.21.15.5:0/2544793959 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543568219 0 0) 0x7f451c0ad9e0 con 0x7f451c0ae270 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.717+0000 7f451bfff640 1 --2- 172.21.15.5:0/2544793959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c0ad090 0x7f451c0ad4a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f451c070840 tx=0x7f451402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911f7fed1193a1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.717+0000 7f451a7fc640 1 -- 172.21.15.5:0/2544793959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451402aea0 con 0x7f451c0ad090 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.717+0000 7f451a7fc640 1 -- 172.21.15.5:0/2544793959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451402d050 con 0x7f451c0ad090 2024-09-13T17:18:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.717+0000 7f451a7fc640 1 -- 172.21.15.5:0/2544793959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514007960 con 0x7f451c0ad090 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 -- 172.21.15.5:0/2544793959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c0ad090 msgr2=0x7f451c0ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 --2- 172.21.15.5:0/2544793959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c0ad090 0x7f451c0ad4a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f451c070840 tx=0x7f451402a680 comp rx=0 tx=0).stop 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 -- 172.21.15.5:0/2544793959 shutdown_connections 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 --2- 172.21.15.5:0/2544793959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c0ad090 0x7f451c0ad4a0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 --2- 172.21.15.5:0/2544793959 >> v2:172.21.15.179:3300/0 conn(0x7f451c15c680 0x7f451c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 -- 172.21.15.5:0/2544793959 >> 172.21.15.5:0/2544793959 conn(0x7f451c0cc610 msgr2=0x7f451c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 -- 172.21.15.5:0/2544793959 shutdown_connections 2024-09-13T17:18:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.718+0000 7f4521f18640 1 -- 172.21.15.5:0/2544793959 wait complete. 2024-09-13T17:18:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.719+0000 7f4521f18640 1 Processor -- start 2024-09-13T17:18:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.719+0000 7f4521f18640 1 -- start start 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 0x7f451c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f451c0ae270 0x7f451c1f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c156a60 con 0x7f451c15c680 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c156d40 con 0x7f451c0ad090 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f4521f18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c157020 con 0x7f451c0ae270 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32772/0 (socket says 172.21.15.5:32772) 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 -- 172.21.15.5:0/44950971 learned_addr learned my addr 172.21.15.5:0/44950971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451affd640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f451c0ae270 0x7f451c1f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451b7fe640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 0x7f451c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 -- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f451c0ae270 msgr2=0x7f451c1f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f451c0ae270 0x7f451c1f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 -- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 msgr2=0x7f451c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 0x7f451c156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 -- 172.21.15.5:0/44950971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009a70 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451b7fe640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 0x7f451c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.720+0000 7f451bfff640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f451402ac70 tx=0x7f4514004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.721+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451403c830 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.721+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451403c990 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.721+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451403cd00 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.721+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c157300 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.721+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c155cb0 con 0x7f451c15c680 2024-09-13T17:18:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.722+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c157820 con 0x7f451c15c680 2024-09-13T17:18:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.722+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4514031400 con 0x7f451c15c680 2024-09-13T17:18:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.723+0000 7f4503fff640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 0x7f450806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.723+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f45140aad50 con 0x7f451c15c680 2024-09-13T17:18:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.723+0000 7f451b7fe640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 0x7f450806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.723+0000 7f451b7fe640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 0x7f450806d0c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.727+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f451c157820 con 0x7f451c15c680 2024-09-13T17:18:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.964+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f451c157820 con 0x7f451c15c680 2024-09-13T17:18:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.994+0000 7f4503fff640 1 -- 172.21.15.5:0/44950971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v292) v1 ==== 148+0+0 (secure 0 0 0) 0x7f451c157820 con 0x7f451c15c680 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 msgr2=0x7f450806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 0x7f450806d0c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c008040 comp rx=0 tx=0).stop 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 msgr2=0x7f451c1f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f451402ac70 tx=0x7f4514004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 shutdown_connections 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f450806ac00 0x7f450806d0c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451c15c680 0x7f451c1f2290 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f451c0ae270 0x7f451c1f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 --2- 172.21.15.5:0/44950971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f451c0ad090 0x7f451c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.996+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 >> 172.21.15.5:0/44950971 conn(0x7f451c0cc610 msgr2=0x7f451c0afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.997+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 shutdown_connections 2024-09-13T17:18:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:26.997+0000 7f4521f18640 1 -- 172.21.15.5:0/44950971 wait complete. 2024-09-13T17:18:27.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:18:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.115+0000 7fe12f45a640 1 Processor -- start 2024-09-13T17:18:27.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 -- start start 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1280b1cb0 0x7fe1280accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1280ad210 0x7fe12806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1280b2d50 con 0x7fe12815c5d0 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12815c9b0 con 0x7fe1280ad210 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.116+0000 7fe12f45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b2140 con 0x7fe1280b1cb0 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1280ad210 0x7fe12806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1280ad210 0x7fe12806aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32778/0 (socket says 172.21.15.5:32778) 2024-09-13T17:18:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 -- 172.21.15.5:0/3542577091 learned_addr learned my addr 172.21.15.5:0/3542577091 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 -- 172.21.15.5:0/3542577091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1280b1cb0 msgr2=0x7fe1280accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 --2- 172.21.15.5:0/3542577091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1280b1cb0 0x7fe1280accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 -- 172.21.15.5:0/3542577091 >> v1:172.21.15.179:6789/0 conn(0x7fe12815c5d0 legacy=0x7fe12806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.117+0000 7fe12d9f7640 1 -- 172.21.15.5:0/3542577091 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280b2420 con 0x7fe1280ad210 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12d9f7640 1 --2- 172.21.15.5:0/3542577091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1280ad210 0x7fe12806aee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e50 tx=0x7fe12002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6585fbe868a43971 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe11ffff640 1 -- 172.21.15.5:0/3542577091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12002aea0 con 0x7fe1280ad210 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe11ffff640 1 -- 172.21.15.5:0/3542577091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12002d050 con 0x7fe1280ad210 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe11ffff640 1 -- 172.21.15.5:0/3542577091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120031820 con 0x7fe1280ad210 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 -- 172.21.15.5:0/3542577091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1280ad210 msgr2=0x7fe12806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 --2- 172.21.15.5:0/3542577091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1280ad210 0x7fe12806aee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e50 tx=0x7fe12002a6c0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 -- 172.21.15.5:0/3542577091 shutdown_connections 2024-09-13T17:18:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 --2- 172.21.15.5:0/3542577091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1280ad210 0x7fe12806aee0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 --2- 172.21.15.5:0/3542577091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1280b1cb0 0x7fe1280accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 -- 172.21.15.5:0/3542577091 >> 172.21.15.5:0/3542577091 conn(0x7fe128070b70 msgr2=0x7fe128070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 -- 172.21.15.5:0/3542577091 shutdown_connections 2024-09-13T17:18:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.118+0000 7fe12f45a640 1 -- 172.21.15.5:0/3542577091 wait complete. 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 Processor -- start 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 -- start start 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12815c5d0 0x7fe128153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1281f1b50 0x7fe128159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281524e0 con 0x7fe128151b20 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12814df70 con 0x7fe1281f1b50 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12f45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12815a5a0 con 0x7fe12815c5d0 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12d9f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.120+0000 7fe12d9f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32784/0 (socket says 172.21.15.5:32784) 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 -- 172.21.15.5:0/4249832731 learned_addr learned my addr 172.21.15.5:0/4249832731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d1f6640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12815c5d0 0x7fe128153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12c9f5640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1281f1b50 0x7fe128159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 -- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12815c5d0 msgr2=0x7fe128153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12815c5d0 0x7fe128153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 -- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1281f1b50 msgr2=0x7fe128159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1281f1b50 0x7fe128159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 -- 172.21.15.5:0/4249832731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009b30 con 0x7fe128151b20 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12d9f7640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe120034040 tx=0x7fe120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12003b820 con 0x7fe128151b20 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12003b9a0 con 0x7fe128151b20 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12815a880 con 0x7fe128151b20 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12003bd90 con 0x7fe128151b20 2024-09-13T17:18:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.121+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12815ae40 con 0x7fe128151b20 2024-09-13T17:18:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.122+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12806aee0 con 0x7fe128151b20 2024-09-13T17:18:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.123+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe120038050 con 0x7fe128151b20 2024-09-13T17:18:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.123+0000 7fe11dffb640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 0x7fe10c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.123+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe1200a9bc0 con 0x7fe128151b20 2024-09-13T17:18:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.124+0000 7fe12d1f6640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 0x7fe10c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.124+0000 7fe12d1f6640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 0x7fe10c06d0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe124007fd0 tx=0x7fe124009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.128+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe1200750b0 con 0x7fe128151b20 2024-09-13T17:18:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.298+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe12806da20 con 0x7fe128151b20 2024-09-13T17:18:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.302+0000 7fe11dffb640 1 -- 172.21.15.5:0/4249832731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe12004b0c0 con 0x7fe128151b20 2024-09-13T17:18:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 msgr2=0x7fe10c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 0x7fe10c06d0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe124007fd0 tx=0x7fe124009040 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 msgr2=0x7fe128151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe120034040 tx=0x7fe120004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 shutdown_connections 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe10c06ac00 0x7fe10c06d0c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128151b20 0x7fe128151fa0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1281f1b50 0x7fe128159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 --2- 172.21.15.5:0/4249832731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe12815c5d0 0x7fe128153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 >> 172.21.15.5:0/4249832731 conn(0x7fe128070b70 msgr2=0x7fe1281573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 shutdown_connections 2024-09-13T17:18:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.304+0000 7fe12f45a640 1 -- 172.21.15.5:0/4249832731 wait complete. 2024-09-13T17:18:27.316 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:18:27.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:18:27.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:18:27.399 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:18:27.399 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:27.399 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:27.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:18:27.415 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:27.415 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:27.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:18:27.457 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:27.457 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:27.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:18:27.473 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:27.474 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:27.514 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:18:27.514 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:18:27.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.615+0000 7fc17d525640 1 Processor -- start 2024-09-13T17:18:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 -- start start 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1780b29d0 0x7fc1780cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b2db0 0x7fc1780cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc178161500 con 0x7fc1780b3950 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc178162180 con 0x7fc1780b29d0 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.616+0000 7fc17d525640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1781617e0 con 0x7fc1780b2db0 2024-09-13T17:18:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1780b29d0 0x7fc1780cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1780b29d0 0x7fc1780cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32786/0 (socket says 172.21.15.5:32786) 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 -- 172.21.15.5:0/4108927390 learned_addr learned my addr 172.21.15.5:0/4108927390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc1777fe640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b2db0 0x7fc1780cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 -- 172.21.15.5:0/4108927390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b2db0 msgr2=0x7fc1780cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b2db0 0x7fc1780cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 -- 172.21.15.5:0/4108927390 >> v1:172.21.15.179:6789/0 conn(0x7fc1780b3950 legacy=0x7fc1780b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.617+0000 7fc176ffd640 1 -- 172.21.15.5:0/4108927390 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178161ac0 con 0x7fc1780b29d0 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc176ffd640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1780cdf90 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098a0 tx=0x7fc16802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5b0a8528b574f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc175ffb640 1 -- 172.21.15.5:0/4108927390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168032440 con 0x7fc1780b29d0 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc175ffb640 1 -- 172.21.15.5:0/4108927390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1680325a0 con 0x7fc1780b29d0 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc175ffb640 1 -- 172.21.15.5:0/4108927390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168032930 con 0x7fc1780b29d0 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 -- 172.21.15.5:0/4108927390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 msgr2=0x7fc1780cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1780cdf90 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098a0 tx=0x7fc16802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 -- 172.21.15.5:0/4108927390 shutdown_connections 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b2db0 0x7fc1780cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 --2- 172.21.15.5:0/4108927390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1780cdf90 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 -- 172.21.15.5:0/4108927390 >> 172.21.15.5:0/4108927390 conn(0x7fc178066200 msgr2=0x7fc178069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 -- 172.21.15.5:0/4108927390 shutdown_connections 2024-09-13T17:18:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.618+0000 7fc17d525640 1 -- 172.21.15.5:0/4108927390 wait complete. 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 Processor -- start 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 -- start start 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1780b2db0 0x7fc1780a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b3950 0x7fc1780acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780a7e50 con 0x7fc1780b29d0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780a8080 con 0x7fc1780b2db0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.620+0000 7fc17d525640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780a8360 con 0x7fc1780b3950 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32792/0 (socket says 172.21.15.5:32792) 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 -- 172.21.15.5:0/2282489758 learned_addr learned my addr 172.21.15.5:0/2282489758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc1767fc640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1780b2db0 0x7fc1780a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc1777fe640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b3950 0x7fc1780acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 -- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b3950 msgr2=0x7fc1780acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b3950 0x7fc1780acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 -- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1780b2db0 msgr2=0x7fc1780a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1780b2db0 0x7fc1780a7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 -- 172.21.15.5:0/2282489758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680094d0 con 0x7fc1780b29d0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc176ffd640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098a0 tx=0x7fc1680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168032440 con 0x7fc1780b29d0 2024-09-13T17:18:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168004230 con 0x7fc1780b29d0 2024-09-13T17:18:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1780a8640 con 0x7fc1780b29d0 2024-09-13T17:18:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168030900 con 0x7fc1780b29d0 2024-09-13T17:18:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.621+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1780a8c00 con 0x7fc1780b29d0 2024-09-13T17:18:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.622+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1780672f0 con 0x7fc1780b29d0 2024-09-13T17:18:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.623+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc168039040 con 0x7fc1780b29d0 2024-09-13T17:18:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.623+0000 7fc15f7fe640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 0x7fc16406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.623+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc1680a9aa0 con 0x7fc1780b29d0 2024-09-13T17:18:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.623+0000 7fc1767fc640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 0x7fc16406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.624+0000 7fc1767fc640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 0x7fc16406d0f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.627+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc168074e30 con 0x7fc1780b29d0 2024-09-13T17:18:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.834+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1780cb000 con 0x7fc1780b29d0 2024-09-13T17:18:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.834+0000 7fc15f7fe640 1 -- 172.21.15.5:0/2282489758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc168037de0 con 0x7fc1780b29d0 2024-09-13T17:18:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:27.836 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3112592372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3112592372},{"type":"v1","addr":"172.21.15.5:6835","nonce":3112592372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3704164606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3704164606},{"type":"v1","addr":"172.21.15.179:6836","nonce":3704164606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":7141,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2396282387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2396282387},{"type":"v1","addr":"172.21.15.179:6837","nonce":2396282387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":8151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2888756832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2888756832},{"type":"v1","addr":"172.21.15.5:6833","nonce":2888756832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2024-09-13T17:18:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-09-13T17:18:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 msgr2=0x7fc16406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 0x7fc16406d0f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 msgr2=0x7fc1781fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc1680098a0 tx=0x7fc1680046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 shutdown_connections 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1780b3950 0x7fc1780acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1780b2db0 0x7fc1780a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc16406ac30 0x7fc16406d0f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 --2- 172.21.15.5:0/2282489758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1780b29d0 0x7fc1781fa580 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 >> 172.21.15.5:0/2282489758 conn(0x7fc178066200 msgr2=0x7fc178069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 shutdown_connections 2024-09-13T17:18:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:27.836+0000 7fc17d525640 1 -- 172.21.15.5:0/2282489758 wait complete. 2024-09-13T17:18:27.849 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:18:27.849 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:18:27.849 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:18:27.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:27.850 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:18:27.850 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:18:27.850 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:18:27.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:27.850 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:18:27.851 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:18:27.851 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:18:27.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:27.851 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:18:27.851 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:18:27.852 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:18:27.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:27.859 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:18:27.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:18:27.860 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:18:27.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:18:27.866 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:18:27.866 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:18:27.866 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:18:27.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:18:27.905 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:18:27.905 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:27.906 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:18:27.906 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:27.908 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:18:27.909 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:27.909 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:18:27.909 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:27.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:18:27.979 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:18:27.981 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:18:27.994 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:18:27.995 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:18:28.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.021+0000 7f62b8eec640 1 Processor -- start 2024-09-13T17:18:28.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.021+0000 7f62b8eec640 1 -- start start 2024-09-13T17:18:28.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62b415c920 0x7f62b40d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62b40d27e0 0x7f62b40d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 0x7f62b40cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40d1b70 con 0x7f62b415c920 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40d2c50 con 0x7f62b40d27e0 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b8eec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40b5ab0 con 0x7f62b40d0820 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62b415c920 0x7f62b40d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62b415c920 0x7f62b40d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32812/0 (socket says 172.21.15.5:32812) 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 -- 172.21.15.5:0/755123916 learned_addr learned my addr 172.21.15.5:0/755123916 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62abfff640 1 --2- 172.21.15.5:0/755123916 >> v2:172.21.15.179:3300/0 conn(0x7f62b40d27e0 0x7f62b40d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b2d9d640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 0x7f62b40cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 -- 172.21.15.5:0/755123916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 msgr2=0x7f62b40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:28.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 0x7f62b40cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 -- 172.21.15.5:0/755123916 >> v2:172.21.15.179:3300/0 conn(0x7f62b40d27e0 msgr2=0x7f62b40d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:28.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 --2- 172.21.15.5:0/755123916 >> v2:172.21.15.179:3300/0 conn(0x7f62b40d27e0 0x7f62b40d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b259c640 1 -- 172.21.15.5:0/755123916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40d0ff0 con 0x7f62b415c920 2024-09-13T17:18:28.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.022+0000 7f62b2d9d640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 0x7f62b40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:28.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.023+0000 7f62b259c640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415c920 0x7f62b40d22a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d3290 tx=0x7f62a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a162c369b08e2bba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:28.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.023+0000 7f62b1d9b640 1 -- 172.21.15.5:0/755123916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a402ae90 con 0x7f62b415c920 2024-09-13T17:18:28.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.023+0000 7f62b1d9b640 1 -- 172.21.15.5:0/755123916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4032440 con 0x7f62b415c920 2024-09-13T17:18:28.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.023+0000 7f62b1d9b640 1 -- 172.21.15.5:0/755123916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40327d0 con 0x7f62b415c920 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 -- 172.21.15.5:0/755123916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415c920 msgr2=0x7f62b40d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415c920 0x7f62b40d22a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d3290 tx=0x7f62a402a180 comp rx=0 tx=0).stop 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 -- 172.21.15.5:0/755123916 shutdown_connections 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b40d0820 0x7f62b40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 --2- 172.21.15.5:0/755123916 >> v2:172.21.15.179:3300/0 conn(0x7f62b40d27e0 0x7f62b40d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 --2- 172.21.15.5:0/755123916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b415c920 0x7f62b40d22a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 -- 172.21.15.5:0/755123916 >> 172.21.15.5:0/755123916 conn(0x7f62b4071c30 msgr2=0x7f62b406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 -- 172.21.15.5:0/755123916 shutdown_connections 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.024+0000 7f62b8eec640 1 -- 172.21.15.5:0/755123916 wait complete. 2024-09-13T17:18:28.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.025+0000 7f62b8eec640 1 Processor -- start 2024-09-13T17:18:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.025+0000 7f62b8eec640 1 -- start start 2024-09-13T17:18:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b40d27e0 0x7f62b40a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b415c920 0x7f62b41f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40aa4c0 con 0x7f62b40d0820 2024-09-13T17:18:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40a9940 con 0x7f62b40d27e0 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b8eec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40a9c20 con 0x7f62b415c920 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32828/0 (socket says 172.21.15.5:32828) 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 -- 172.21.15.5:0/133527593 learned_addr learned my addr 172.21.15.5:0/133527593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b2d9d640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b415c920 0x7f62b41f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62abfff640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b40d27e0 0x7f62b40a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 -- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b415c920 msgr2=0x7f62b41f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b415c920 0x7f62b41f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 -- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b40d27e0 msgr2=0x7f62b40a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b40d27e0 0x7f62b40a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 -- 172.21.15.5:0/133527593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40094d0 con 0x7f62b40d0820 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.026+0000 7f62b259c640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.027+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a403d830 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.027+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a403d990 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40a9f00 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.027+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a403dd40 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b40a9630 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.028+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b40672f0 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.028+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f62a4039040 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.029+0000 7f62aaffd640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 0x7f629406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.029+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f62a40a9b90 con 0x7f62b40d0820 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.029+0000 7f62abfff640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 0x7f629406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.029+0000 7f62abfff640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 0x7f629406d0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d0110 tx=0x7f629c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:28.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.033+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f62a4074fe0 con 0x7f62b40d0820 2024-09-13T17:18:28.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:28.215+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f62b40d0c70 con 0x7f62b40d0820 2024-09-13T17:18:29.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.025+0000 7f62aaffd640 1 -- 172.21.15.5:0/133527593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f62a4078600 con 0x7f62b40d0820 2024-09-13T17:18:29.027 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 msgr2=0x7f629406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 0x7f629406d0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d0110 tx=0x7f629c009190 comp rx=0 tx=0).stop 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 msgr2=0x7f62b40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000c00 tx=0x7f62a40046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 shutdown_connections 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62b415c920 0x7f62b41f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b40d27e0 0x7f62b40a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f629406ac00 0x7f629406d0c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 --2- 172.21.15.5:0/133527593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62b40d0820 0x7f62b40ccb90 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 >> 172.21.15.5:0/133527593 conn(0x7f62b4071c30 msgr2=0x7f62b415eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 shutdown_connections 2024-09-13T17:18:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.027+0000 7f62b8eec640 1 -- 172.21.15.5:0/133527593 wait complete. 2024-09-13T17:18:29.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:18:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.147+0000 7fc840b65640 1 Processor -- start 2024-09-13T17:18:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.147+0000 7fc840b65640 1 -- start start 2024-09-13T17:18:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.148+0000 7fc840b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.148+0000 7fc840b65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc83c0cd630 0x7fc83c0b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.148+0000 7fc840b65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c15cdd0 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.148+0000 7fc840b65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0b8750 con 0x7fc83c0cd630 2024-09-13T17:18:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.148+0000 7fc840b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0b5040 con 0x7fc83c15c9f0 2024-09-13T17:18:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc83a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc839d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc83c0cd630 0x7fc83c0b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc83a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:47584/0 (socket says 172.21.15.5:47584) 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc83a59c640 1 -- 172.21.15.5:0/1740812737 learned_addr learned my addr 172.21.15.5:0/1740812737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc83ad9d640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc83c0b4bf0 0x7fc83c0d09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:52484/0 (socket says 172.21.15.5:52484) 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc839d9b640 1 -- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 msgr2=0x7fc83c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc839d9b640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc839d9b640 1 -- 172.21.15.5:0/1740812737 >> v1:172.21.15.179:6789/0 conn(0x7fc83c0b4bf0 legacy=0x7fc83c0d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc839d9b640 1 -- 172.21.15.5:0/1740812737 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0d3040 con 0x7fc83c0cd630 2024-09-13T17:18:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.149+0000 7fc83a59c640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.150+0000 7fc839d9b640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c0cd630 0x7fc83c0b46b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6667b4f22b93d53d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.150+0000 7fc83959a640 1 -- 172.21.15.5:0/1740812737 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82402ae40 con 0x7fc83c0cd630 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.150+0000 7fc83959a640 1 -- 172.21.15.5:0/1740812737 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824032440 con 0x7fc83c0cd630 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.150+0000 7fc83959a640 1 -- 172.21.15.5:0/1740812737 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240327d0 con 0x7fc83c0cd630 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 -- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c0cd630 msgr2=0x7fc83c0b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c0cd630 0x7fc83c0b46b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402a130 comp rx=0 tx=0).stop 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 -- 172.21.15.5:0/1740812737 shutdown_connections 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c0cd630 0x7fc83c0b46b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 --2- 172.21.15.5:0/1740812737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c15c9f0 0x7fc83c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 -- 172.21.15.5:0/1740812737 >> 172.21.15.5:0/1740812737 conn(0x7fc83c071a20 msgr2=0x7fc83c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 -- 172.21.15.5:0/1740812737 shutdown_connections 2024-09-13T17:18:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.151+0000 7fc840b65640 1 -- 172.21.15.5:0/1740812737 wait complete. 2024-09-13T17:18:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.152+0000 7fc840b65640 1 Processor -- start 2024-09-13T17:18:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.152+0000 7fc840b65640 1 -- start start 2024-09-13T17:18:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c0cd630 0x7fc83c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c15c9f0 0x7fc83c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0d2c20 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15ecb0 con 0x7fc83c15c9f0 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc840b65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f6bc0 con 0x7fc83c0cd630 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc83a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc83a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32834/0 (socket says 172.21.15.5:32834) 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc83a59c640 1 -- 172.21.15.5:0/3673150741 learned_addr learned my addr 172.21.15.5:0/3673150741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc83ad9d640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c15c9f0 0x7fc83c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.153+0000 7fc839d9b640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c0cd630 0x7fc83c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 -- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c0cd630 msgr2=0x7fc83c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c0cd630 0x7fc83c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 -- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c15c9f0 msgr2=0x7fc83c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c15c9f0 0x7fc83c0b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 -- 172.21.15.5:0/3673150741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009b30 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc83a59c640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00efc0 tx=0x7fc82c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ce60 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc824009400 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c014680 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.154+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1f6290 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.155+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0b1e70 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.156+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc82c0147e0 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.156+0000 7fc832ffd640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 0x7fc81c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.156+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc82c089900 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.156+0000 7fc839d9b640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 0x7fc81c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.157+0000 7fc839d9b640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 0x7fc81c06d0f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc824034000 tx=0x7fc82402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.160+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc82c054d10 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.397+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc83c156650 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.397+0000 7fc832ffd640 1 -- 172.21.15.5:0/3673150741 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc82c058330 con 0x7fc83c0b4bf0 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmOS4eGhAAZGvJPzqtXRDQTGztkgX4dg==", 2024-09-13T17:18:29.400 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm+WgkJhAAKJlo6o2dmLRdApJAjr3Tzg==", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmAFBgIRAA59uhQuHAK//wrVwOxuv79w==", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmmB4iLRAApAPLTdZ6kwfQtcE50+nfNQ==", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBwcuRm9czcFRAA8MPffIXn1gY1XnADzD1EQg==", 2024-09-13T17:18:29.403 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBzcuRmwHoUFBAAXr3ybRrq59khy1uFbjOzSA==", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.404 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB2cuRmzm0wEhAAmZ2Wvhk8YYZ8EFIGZ/Bj2w==", 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-09-13T17:18:29.405 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB5cuRm3vAQERAApW6oCP7JLfQnWUpbfwTFlA==", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQB/cuRmNjKCFRAAYfWGwOnl+XXAuonPF4z3Nw==", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCCcuRmjJ3gExAAGGUlPcTfSJtFSGv7C6OfIQ==", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCFcuRmY/efERAAziQDhZQtdl7Thj4r+jXyHQ==", 2024-09-13T17:18:29.407 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQCIcuRmz2b9DhAAQYlI+/oMBivD/F7O0rx5vg==", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmC6lFMRAAnSRQduKFeQQRdOv4n0B/4Q==", 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-09-13T17:18:29.409 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmJIAiOhAAvHMO+1kSwbVL3TF1zktOaA==", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRm8mn2NhAA1pELquWNeFWJ9mcHA5ezPg==", 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.410 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBvcuRmaVUgBBAAQImh5mnPxNvQkTWS6SPfMQ==", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-09-13T17:18:29.411 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBtcuRmFLKoORAA+aEICPyRK/OTw8979b1SSQ==", 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmke/WFhAAc8Rz4zxa95up2ZQ7z+EN5A==", 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-09-13T17:18:29.413 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBucuRmQnsoExAAnmkdnsNtjANHf4xIuYtH4g==", 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:18:29.414 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 msgr2=0x7fc81c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 0x7fc81c06d0f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc824034000 tx=0x7fc82402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 msgr2=0x7fc83c152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00efc0 tx=0x7fc82c00c490 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 shutdown_connections 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc83c15c9f0 0x7fc83c0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc83c0cd630 0x7fc83c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc81c06ac30 0x7fc81c06d0f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 --2- 172.21.15.5:0/3673150741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc83c0b4bf0 0x7fc83c152720 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 >> 172.21.15.5:0/3673150741 conn(0x7fc83c071a20 msgr2=0x7fc83c071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 shutdown_connections 2024-09-13T17:18:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.400+0000 7fc840b65640 1 -- 172.21.15.5:0/3673150741 wait complete. 2024-09-13T17:18:29.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.516+0000 7fa8cc1f4640 1 Processor -- start 2024-09-13T17:18:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.516+0000 7fa8cc1f4640 1 -- start start 2024-09-13T17:18:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8cc1f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8cc1f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c415cdd0 con 0x7fa8c40b5820 2024-09-13T17:18:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8cc1f4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40d3040 con 0x7fa8c40cd630 2024-09-13T17:18:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8cc1f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40b8750 con 0x7fa8c415c9f0 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8ca791640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa8c40b5820 0x7fa8c40b5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55874/0 (socket says 172.21.15.5:55874) 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.517+0000 7fa8ca791640 1 -- 172.21.15.5:0/3525795270 learned_addr learned my addr 172.21.15.5:0/3525795270 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c9f90640 1 --2- 172.21.15.5:0/3525795270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309397800 0 0) 0x7fa8c415cdd0 con 0x7fa8c40b5820 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac003520 con 0x7fa8c40b5820 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939549979 0 0) 0x7fa8c40d3040 con 0x7fa8c40cd630 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c415cdd0 con 0x7fa8c40cd630 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c9f90640 1 -- 172.21.15.5:0/3525795270 >> v1:172.21.15.179:6789/0 conn(0x7fa8c40cd630 legacy=0x7fa8c40b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914806400 0 0) 0x7fa8ac003520 con 0x7fa8c40b5820 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c9f90640 1 -- 172.21.15.5:0/3525795270 >> v1:172.21.15.5:6789/0 conn(0x7fa8c40b5820 legacy=0x7fa8c40b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.518+0000 7fa8c9f90640 1 -- 172.21.15.5:0/3525795270 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c40cdb10 con 0x7fa8c415c9f0 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8c9f90640 1 --2- 172.21.15.5:0/3525795270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b4170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009dc0 tx=0x7fa8b402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c18ff40a9d9d354 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc001670 con 0x7fa8c415c9f0 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b402d050 con 0x7fa8c415c9f0 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8c8f8e640 1 -- 172.21.15.5:0/3525795270 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4007740 con 0x7fa8c415c9f0 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/3525795270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 msgr2=0x7fa8c40b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.519+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/3525795270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b4170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009dc0 tx=0x7fa8b402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.520+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/3525795270 shutdown_connections 2024-09-13T17:18:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.520+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/3525795270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b4170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.520+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/3525795270 >> 172.21.15.5:0/3525795270 conn(0x7fa8c4071a20 msgr2=0x7fa8c4071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.520+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/3525795270 shutdown_connections 2024-09-13T17:18:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.520+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/3525795270 wait complete. 2024-09-13T17:18:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.521+0000 7fa8cc1f4640 1 Processor -- start 2024-09-13T17:18:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.521+0000 7fa8cc1f4640 1 -- start start 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 0x7fa8c4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40d2c20 con 0x7fa8c40b5820 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40c68b0 con 0x7fa8c40cd630 2024-09-13T17:18:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41f5e10 con 0x7fa8c415c9f0 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32836/0 (socket says 172.21.15.5:32836) 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 -- 172.21.15.5:0/1964540170 learned_addr learned my addr 172.21.15.5:0/1964540170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8ca791640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c978f640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 0x7fa8c4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 -- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 msgr2=0x7fa8c40b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 -- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 msgr2=0x7fa8c4152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 0x7fa8c4152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 -- 172.21.15.5:0/1964540170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009a70 con 0x7fa8c40b5820 2024-09-13T17:18:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c978f640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 0x7fa8c4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c9f90640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402abc0 tx=0x7fa8b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b403b820 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b403b980 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.522+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c41f3430 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.523+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b403bcf0 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.523+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c41f3150 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.524+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c40c69f0 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.524+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8b4031400 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.524+0000 7fa8c27fc640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 0x7fa8b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.524+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa8b40aa9e0 con 0x7fa8c40b5820 2024-09-13T17:18:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.525+0000 7fa8c978f640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 0x7fa8b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.525+0000 7fa8c978f640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 0x7fa8b006d0c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa8c415a1a0 tx=0x7fa8b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.528+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8c40c69f0 con 0x7fa8c40b5820 2024-09-13T17:18:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.700+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c40c69f0 con 0x7fa8c40b5820 2024-09-13T17:18:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.701+0000 7fa8c27fc640 1 -- 172.21.15.5:0/1964540170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13028 (secure 0 0 0) 0x7fa8c40c69f0 con 0x7fa8c40b5820 2024-09-13T17:18:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:29.703 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":103,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:29.024242+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:29.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 msgr2=0x7fa8b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 0x7fa8b006d0c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa8c415a1a0 tx=0x7fa8b8009040 comp rx=0 tx=0).stop 2024-09-13T17:18:29.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 msgr2=0x7fa8c40c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402abc0 tx=0x7fa8b4004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 shutdown_connections 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8c415c9f0 0x7fa8c40b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8c40cd630 0x7fa8c4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8b006ac00 0x7fa8b006d0c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 --2- 172.21.15.5:0/1964540170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8c40b5820 0x7fa8c40c6cd0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 >> 172.21.15.5:0/1964540170 conn(0x7fa8c4071a20 msgr2=0x7fa8c415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 shutdown_connections 2024-09-13T17:18:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.703+0000 7fa8cc1f4640 1 -- 172.21.15.5:0/1964540170 wait complete. 2024-09-13T17:18:29.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:29.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.818+0000 7f7239e5a640 1 Processor -- start 2024-09-13T17:18:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.818+0000 7f7239e5a640 1 -- start start 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7239e5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f723406e360 0x7f72340cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7239e5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72340b21e0 con 0x7f7234159860 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7239e5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72340b24c0 con 0x7f723406df80 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7239e5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72340b27a0 con 0x7f723406e360 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7233fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7234159860 0x7f7234159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55878/0 (socket says 172.21.15.5:55878) 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7233fff640 1 -- 172.21.15.5:0/1643889241 learned_addr learned my addr 172.21.15.5:0/1643889241 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f7232ffd640 1 --2- 172.21.15.5:0/1643889241 >> v2:172.21.15.179:3300/0 conn(0x7f723406e360 0x7f72340cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f72327fc640 1 -- 172.21.15.5:0/1643889241 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107776447 0 0) 0x7f72340b21e0 con 0x7f7234159860 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.819+0000 7f72327fc640 1 -- 172.21.15.5:0/1643889241 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f721c003520 con 0x7f7234159860 2024-09-13T17:18:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.820+0000 7f7232ffd640 1 -- 172.21.15.5:0/1643889241 >> v1:172.21.15.179:6789/0 conn(0x7f723406df80 legacy=0x7f72340b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.820+0000 7f7232ffd640 1 -- 172.21.15.5:0/1643889241 >> v1:172.21.15.5:6789/0 conn(0x7f7234159860 legacy=0x7f7234159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.820+0000 7f7232ffd640 1 -- 172.21.15.5:0/1643889241 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340b2a80 con 0x7f723406e360 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.820+0000 7f7232ffd640 1 --2- 172.21.15.5:0/1643889241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406e360 0x7f72340cb7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72280097d0 tx=0x7f722802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8cbf17f07d309 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f72327fc640 1 -- 172.21.15.5:0/1643889241 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228032440 con 0x7f723406e360 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f72327fc640 1 -- 172.21.15.5:0/1643889241 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280325a0 con 0x7f723406e360 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f72327fc640 1 -- 172.21.15.5:0/1643889241 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228032930 con 0x7f723406e360 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 -- 172.21.15.5:0/1643889241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406e360 msgr2=0x7f72340cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 --2- 172.21.15.5:0/1643889241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406e360 0x7f72340cb7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72280097d0 tx=0x7f722802a270 comp rx=0 tx=0).stop 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 -- 172.21.15.5:0/1643889241 shutdown_connections 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 --2- 172.21.15.5:0/1643889241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406e360 0x7f72340cb7c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 -- 172.21.15.5:0/1643889241 >> 172.21.15.5:0/1643889241 conn(0x7f7234069ed0 msgr2=0x7f723406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:29.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 -- 172.21.15.5:0/1643889241 shutdown_connections 2024-09-13T17:18:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.821+0000 7f7239e5a640 1 -- 172.21.15.5:0/1643889241 wait complete. 2024-09-13T17:18:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.822+0000 7f7239e5a640 1 Processor -- start 2024-09-13T17:18:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.822+0000 7f7239e5a640 1 -- start start 2024-09-13T17:18:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 0x7f723414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 0x7f723413f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723414f3f0 con 0x7f723406e360 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723413ebb0 con 0x7f723406df80 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7239e5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723413bfc0 con 0x7f7234159860 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7232ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7232ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32848/0 (socket says 172.21.15.5:32848) 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.823+0000 7f7232ffd640 1 -- 172.21.15.5:0/2715866300 learned_addr learned my addr 172.21.15.5:0/2715866300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7233fff640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 0x7f723413f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f72337fe640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 0x7f723414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 -- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 msgr2=0x7f723413f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 0x7f723413f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 -- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 msgr2=0x7f723414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 0x7f723414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 -- 172.21.15.5:0/2715866300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228009400 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7233fff640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 0x7f723413f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f72337fe640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 0x7f723414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7232ffd640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7228035040 tx=0x7f72280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228030b80 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228032e90 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723413c2a0 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228006e10 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.824+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723413c860 con 0x7f723406e360 2024-09-13T17:18:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.825+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72340b21e0 con 0x7f723406e360 2024-09-13T17:18:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.826+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7228039040 con 0x7f723406e360 2024-09-13T17:18:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.826+0000 7f721bfff640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 0x7f722006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.826+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f72280a9ce0 con 0x7f723406e360 2024-09-13T17:18:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.826+0000 7f72337fe640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 0x7f722006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.827+0000 7f72337fe640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 0x7f722006d0c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7224000f60 tx=0x7f7224009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:29.830+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7228075160 con 0x7f723406e360 2024-09-13T17:18:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.002+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72340674e0 con 0x7f723406e360 2024-09-13T17:18:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.002+0000 7f721bfff640 1 -- 172.21.15.5:0/2715866300 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72280370a0 con 0x7f723406e360 2024-09-13T17:18:30.004 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 msgr2=0x7f722006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 0x7f722006d0c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7224000f60 tx=0x7f7224009040 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 msgr2=0x7f723413e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7228035040 tx=0x7f72280046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 shutdown_connections 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7234159860 0x7f723413f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f722006ac00 0x7f722006d0c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f723406e360 0x7f723413e670 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 --2- 172.21.15.5:0/2715866300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f723406df80 0x7f723414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 >> 172.21.15.5:0/2715866300 conn(0x7f7234069ed0 msgr2=0x7f72341588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 shutdown_connections 2024-09-13T17:18:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.004+0000 7f7239e5a640 1 -- 172.21.15.5:0/2715866300 wait complete. 2024-09-13T17:18:30.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:18:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.117+0000 7f305ee96640 1 Processor -- start 2024-09-13T17:18:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.117+0000 7f305ee96640 1 -- start start 2024-09-13T17:18:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305ee96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f305806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305ee96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f305806e370 0x7f305815d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305ee96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580b3150 con 0x7f30580cb7b0 2024-09-13T17:18:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305ee96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305815cf00 con 0x7f305806e370 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305ee96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b3430 con 0x7f30581592d0 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f305806e370 0x7f305815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f305806e370 0x7f305815d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32850/0 (socket says 172.21.15.5:32850) 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 -- 172.21.15.5:0/3183710668 learned_addr learned my addr 172.21.15.5:0/3183710668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305cc32640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f305806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 -- 172.21.15.5:0/3183710668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 msgr2=0x7f305806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f305806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 -- 172.21.15.5:0/3183710668 >> v1:172.21.15.179:6789/0 conn(0x7f30580cb7b0 legacy=0x7f305806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.118+0000 7f305d433640 1 -- 172.21.15.5:0/3183710668 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580b3710 con 0x7f305806e370 2024-09-13T17:18:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.119+0000 7f305d433640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305806e370 0x7f305815d350 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3050009e50 tx=0x7f305002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fee2bce5b441a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.119+0000 7f30577fe640 1 -- 172.21.15.5:0/3183710668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305002aea0 con 0x7f305806e370 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.119+0000 7f30577fe640 1 -- 172.21.15.5:0/3183710668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305002d050 con 0x7f305806e370 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.119+0000 7f30577fe640 1 -- 172.21.15.5:0/3183710668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050031820 con 0x7f305806e370 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 -- 172.21.15.5:0/3183710668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305806e370 msgr2=0x7f305815d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305806e370 0x7f305815d350 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3050009e50 tx=0x7f305002a680 comp rx=0 tx=0).stop 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 -- 172.21.15.5:0/3183710668 shutdown_connections 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305806e370 0x7f305815d350 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 --2- 172.21.15.5:0/3183710668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f305806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 -- 172.21.15.5:0/3183710668 >> 172.21.15.5:0/3183710668 conn(0x7f3058066200 msgr2=0x7f3058069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 -- 172.21.15.5:0/3183710668 shutdown_connections 2024-09-13T17:18:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.120+0000 7f305ee96640 1 -- 172.21.15.5:0/3183710668 wait complete. 2024-09-13T17:18:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.121+0000 7f305ee96640 1 Processor -- start 2024-09-13T17:18:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.121+0000 7f305ee96640 1 -- start start 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806e370 0x7f3058148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f30580b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305814bb40 con 0x7f30580cb7b0 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305814af30 con 0x7f305806e370 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305ee96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305814b210 con 0x7f30581592d0 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32866/0 (socket says 172.21.15.5:32866) 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 -- 172.21.15.5:0/2672494842 learned_addr learned my addr 172.21.15.5:0/2672494842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305d433640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f30580b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f305cc32640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806e370 0x7f3058148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 -- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 msgr2=0x7f30580b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f30580b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 -- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806e370 msgr2=0x7f3058148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806e370 0x7f3058148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.122+0000 7f3057fff640 1 -- 172.21.15.5:0/2672494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009b30 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f3057fff640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f304400c400 tx=0x7f304400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440052d0 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044005430 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305814b4f0 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044003830 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.123+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058149290 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.124+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580672f0 con 0x7f30580cb7b0 2024-09-13T17:18:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.124+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3044003990 con 0x7f30580cb7b0 2024-09-13T17:18:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.125+0000 7f30557fa640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 0x7f303c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.125+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f30440886d0 con 0x7f30580cb7b0 2024-09-13T17:18:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.125+0000 7f305cc32640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 0x7f303c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.125+0000 7f305cc32640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 0x7f303c06d0f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3058149700 tx=0x7f304c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.129+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3044053ad0 con 0x7f30580cb7b0 2024-09-13T17:18:30.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.305+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f30580cdcb0 con 0x7f30580cb7b0 2024-09-13T17:18:30.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.305+0000 7f30557fa640 1 -- 172.21.15.5:0/2672494842 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7f30440570f0 con 0x7f30580cb7b0 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:30.308 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.307+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 msgr2=0x7f303c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 0x7f303c06d0f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3058149700 tx=0x7f304c009190 comp rx=0 tx=0).stop 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 msgr2=0x7f305814a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f304400c400 tx=0x7f304400c8c0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 shutdown_connections 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30581592d0 0x7f30580b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f303c06ac30 0x7f303c06d0f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30580cb7b0 0x7f305814a4c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 --2- 172.21.15.5:0/2672494842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f305806e370 0x7f3058148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 >> 172.21.15.5:0/2672494842 conn(0x7f3058066200 msgr2=0x7f305814c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 shutdown_connections 2024-09-13T17:18:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.308+0000 7f305ee96640 1 -- 172.21.15.5:0/2672494842 wait complete. 2024-09-13T17:18:30.321 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:18:30.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:18:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.424+0000 7f08a5072640 1 Processor -- start 2024-09-13T17:18:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.424+0000 7f08a5072640 1 -- start start 2024-09-13T17:18:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f08a5072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f08a5072640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 0x7f08a013f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f08a5072640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a015a7d0 con 0x7f08a013f670 2024-09-13T17:18:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f08a5072640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a013c740 con 0x7f08a00707c0 2024-09-13T17:18:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f08a5072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0159d10 con 0x7f08a00703e0 2024-09-13T17:18:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f089ed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f089e59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 0x7f08a013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f089ed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:47652/0 (socket says 172.21.15.5:47652) 2024-09-13T17:18:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f089ed9d640 1 -- 172.21.15.5:0/3884281244 learned_addr learned my addr 172.21.15.5:0/3884281244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.425+0000 7f089f59e640 1 --1- 172.21.15.5:0/3884281244 >> v1:172.21.15.179:6789/0 conn(0x7f08a013f670 0x7f08a00b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:52520/0 (socket says 172.21.15.5:52520) 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089ed9d640 1 -- 172.21.15.5:0/3884281244 >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 msgr2=0x7f08a013f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089ed9d640 1 --2- 172.21.15.5:0/3884281244 >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 0x7f08a013f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089ed9d640 1 -- 172.21.15.5:0/3884281244 >> v1:172.21.15.179:6789/0 conn(0x7f08a013f670 legacy=0x7f08a00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089ed9d640 1 -- 172.21.15.5:0/3884281244 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0159f30 con 0x7f08a00703e0 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089e59c640 1 --2- 172.21.15.5:0/3884281244 >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 0x7f08a013f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.426+0000 7f089ed9d640 1 --2- 172.21.15.5:0/3884281244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f089000d150 tx=0x7f089002c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9472629f71b5161 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f089dd9b640 1 -- 172.21.15.5:0/3884281244 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890009600 con 0x7f08a00703e0 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f089dd9b640 1 -- 172.21.15.5:0/3884281244 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0890009760 con 0x7f08a00703e0 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f089dd9b640 1 -- 172.21.15.5:0/3884281244 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890009af0 con 0x7f08a00703e0 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 -- 172.21.15.5:0/3884281244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 msgr2=0x7f08a01597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 --2- 172.21.15.5:0/3884281244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f089000d150 tx=0x7f089002c890 comp rx=0 tx=0).stop 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 -- 172.21.15.5:0/3884281244 shutdown_connections 2024-09-13T17:18:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 --2- 172.21.15.5:0/3884281244 >> v2:172.21.15.179:3300/0 conn(0x7f08a00707c0 0x7f08a013f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 --2- 172.21.15.5:0/3884281244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a01597d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 -- 172.21.15.5:0/3884281244 >> 172.21.15.5:0/3884281244 conn(0x7f08a00b02f0 msgr2=0x7f08a00b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 -- 172.21.15.5:0/3884281244 shutdown_connections 2024-09-13T17:18:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.427+0000 7f08a5072640 1 -- 172.21.15.5:0/3884281244 wait complete. 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.429+0000 7f08a5072640 1 Processor -- start 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.429+0000 7f08a5072640 1 -- start start 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a0156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a013f670 0x7f08a0138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0137f30 con 0x7f08a00707c0 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0138210 con 0x7f08a013f670 2024-09-13T17:18:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08a5072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01384f0 con 0x7f08a00703e0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32870/0 (socket says 172.21.15.5:32870) 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 -- 172.21.15.5:0/1292631633 learned_addr learned my addr 172.21.15.5:0/1292631633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089f59e640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a013f670 0x7f08a0138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089ed9d640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a0156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 -- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 msgr2=0x7f08a0156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a0156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 -- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a013f670 msgr2=0x7f08a0138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a013f670 0x7f08a0138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 -- 172.21.15.5:0/1292631633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888009400 con 0x7f08a00707c0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f089e59c640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f088800ebb0 tx=0x7f088800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.430+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800eeb0 con 0x7f08a00707c0 2024-09-13T17:18:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.431+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800cc30 con 0x7f08a00707c0 2024-09-13T17:18:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.431+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089000bd40 con 0x7f08a00707c0 2024-09-13T17:18:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.431+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888013470 con 0x7f08a00707c0 2024-09-13T17:18:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.431+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a0138ab0 con 0x7f08a00707c0 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.432+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a00672f0 con 0x7f08a00707c0 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.432+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08880135d0 con 0x7f08a00707c0 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.432+0000 7f08977fe640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 0x7f088006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.433+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0888089300 con 0x7f08a00707c0 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.433+0000 7f089ed9d640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 0x7f088006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.433+0000 7f089ed9d640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 0x7f088006d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f089000d150 tx=0x7f089000b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.437+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0888054830 con 0x7f08a00707c0 2024-09-13T17:18:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:30.606+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f08a01597d0 con 0x7f08a00707c0 2024-09-13T17:18:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.032+0000 7f08977fe640 1 -- 172.21.15.5:0/1292631633 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0888087e60 con 0x7f08a00707c0 2024-09-13T17:18:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 msgr2=0x7f088006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 0x7f088006d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f089000d150 tx=0x7f089000b000 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 msgr2=0x7f08a0137140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f088800ebb0 tx=0x7f088800c520 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 shutdown_connections 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a013f670 0x7f08a0138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f088006ac00 0x7f088006d0c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08a00707c0 0x7f08a0137140 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 --2- 172.21.15.5:0/1292631633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a00703e0 0x7f08a0156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 >> 172.21.15.5:0/1292631633 conn(0x7f08a00b02f0 msgr2=0x7f08a013ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 shutdown_connections 2024-09-13T17:18:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.035+0000 7f08a5072640 1 -- 172.21.15.5:0/1292631633 wait complete. 2024-09-13T17:18:31.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:18:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.160+0000 7f8dd2d83640 1 Processor -- start 2024-09-13T17:18:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.160+0000 7f8dd2d83640 1 -- start start 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dd2d83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dcc098ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dd2d83640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc0ceac0 con 0x7f8dcc099740 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dd2d83640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc0cc390 con 0x7f8dcc15a610 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dd2d83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc099420 con 0x7f8dcc098a50 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8dcc099740 0x7f8dcc0cb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55884/0 (socket says 172.21.15.5:55884) 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcbfff640 1 -- 172.21.15.5:0/2489756320 learned_addr learned my addr 172.21.15.5:0/2489756320 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415080011 0 0) 0x7f8dcc0ceac0 con 0x7f8dcc099740 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dbc003520 con 0x7f8dcc099740 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dcc098ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627557301 0 0) 0x7f8dbc003520 con 0x7f8dcc099740 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 msgr2=0x7f8dcc098ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dcc098ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 >> v1:172.21.15.179:6789/0 conn(0x7f8dcc15a610 legacy=0x7f8dcc0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0ce190 con 0x7f8dcc099740 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8db8001670 con 0x7f8dcc099740 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.161+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 >> v1:172.21.15.5:6789/0 conn(0x7f8dcc099740 legacy=0x7f8dcc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc0039a0 0x7f8dbc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dbc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc004d00 0x7f8dbc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc099420 con 0x7f8dbc004d00 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc00bb90 con 0x7f8dbc0039a0 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc00bd50 con 0x7f8dcc098a50 2024-09-13T17:18:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc004d00 0x7f8dbc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dcbfff640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dbc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd0b1f640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc0039a0 0x7f8dbc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 -- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 msgr2=0x7f8dbc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dcc098a50 0x7f8dbc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 -- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc0039a0 msgr2=0x7f8dbc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc0039a0 0x7f8dbc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd1320640 1 -- 172.21.15.5:0/2489756320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc003520 con 0x7f8dbc004d00 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.162+0000 7f8dd0b1f640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc0039a0 0x7f8dbc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc004d00 0x7f8dbc005160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009fc0 tx=0x7f8dbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b32ad6deb8ddaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031640 con 0x7f8dbc004d00 2024-09-13T17:18:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc402d070 con 0x7f8dbc004d00 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dcb7fe640 1 -- 172.21.15.5:0/2489756320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40319e0 con 0x7f8dbc004d00 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2489756320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc004d00 msgr2=0x7f8dbc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2489756320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc004d00 0x7f8dbc005160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009fc0 tx=0x7f8dbc0057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd1320640 1 -- 172.21.15.5:0/2489756320 reap_dead start 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2489756320 shutdown_connections 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2489756320 >> 172.21.15.5:0/2489756320 conn(0x7f8dcc0d0520 msgr2=0x7f8dcc0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2489756320 shutdown_connections 2024-09-13T17:18:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.163+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2489756320 wait complete. 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.165+0000 7f8dd2d83640 1 Processor -- start 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.165+0000 7f8dd2d83640 1 -- start start 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc004d00 0x7f8dcc0b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dcc06c840 0x7f8dcc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc15be60 con 0x7f8dcc15d440 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc15c140 con 0x7f8dcc06c840 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc15c420 con 0x7f8dbc004d00 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32884/0 (socket says 172.21.15.5:32884) 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 -- 172.21.15.5:0/2942813438 learned_addr learned my addr 172.21.15.5:0/2942813438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dcbfff640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dcc06c840 0x7f8dcc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd0b1f640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc004d00 0x7f8dcc0b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 -- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc004d00 msgr2=0x7f8dcc0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc004d00 0x7f8dcc0b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 -- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dcc06c840 msgr2=0x7f8dcc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dcc06c840 0x7f8dcc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 -- 172.21.15.5:0/2942813438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc15c700 con 0x7f8dcc15d440 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd1320640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4033040 tx=0x7f8dc4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031d50 con 0x7f8dcc15d440 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4040070 con 0x7f8dcc15d440 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc15c9e0 con 0x7f8dcc15d440 2024-09-13T17:18:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4003bb0 con 0x7f8dcc15d440 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.166+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc0b50e0 con 0x7f8dcc15d440 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.167+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc0b52d0 con 0x7f8dcc15d440 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.168+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8dc4042070 con 0x7f8dcc15d440 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.169+0000 7f8dc97fa640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 0x7f8db006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.169+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f8dc40aa4f0 con 0x7f8dcc15d440 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.169+0000 7f8dd0b1f640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 0x7f8db006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.169+0000 7f8dd0b1f640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 0x7f8db006d0f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001670 tx=0x7f8dc0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.173+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8dc4075780 con 0x7f8dcc15d440 2024-09-13T17:18:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:31.345+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8dcc0cfa80 con 0x7f8dcc15d440 2024-09-13T17:18:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.035+0000 7f8dc97fa640 1 -- 172.21.15.5:0/2942813438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8dc404a0d0 con 0x7f8dcc15d440 2024-09-13T17:18:32.039 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-13T17:18:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.050+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 msgr2=0x7f8db006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.050+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 0x7f8db006d0f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0001670 tx=0x7f8dc0009040 comp rx=0 tx=0).stop 2024-09-13T17:18:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.050+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 msgr2=0x7f8dcc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.050+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4033040 tx=0x7f8dc4009750 comp rx=0 tx=0).stop 2024-09-13T17:18:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 shutdown_connections 2024-09-13T17:18:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8db006ac30 0x7f8db006d0f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dcc15d440 0x7f8dcc0c96a0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dcc06c840 0x7f8dcc15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 --2- 172.21.15.5:0/2942813438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc004d00 0x7f8dcc0b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.053+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 >> 172.21.15.5:0/2942813438 conn(0x7f8dcc0d0520 msgr2=0x7f8dcc0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.054+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 shutdown_connections 2024-09-13T17:18:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.055+0000 7f8dd2d83640 1 -- 172.21.15.5:0/2942813438 wait complete. 2024-09-13T17:18:32.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:18:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.180+0000 7f0996b7d640 1 Processor -- start 2024-09-13T17:18:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.180+0000 7f0996b7d640 1 -- start start 2024-09-13T17:18:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0996b7d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f09900ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0996b7d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09900cb120 0x7f09900cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0996b7d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09900d13b0 con 0x7f09900997a0 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0996b7d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900ce750 con 0x7f09900cb120 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0996b7d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099015add0 con 0x7f0990098a50 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09900cb120 0x7f09900cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09900cb120 0x7f09900cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32900/0 (socket says 172.21.15.5:32900) 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 -- 172.21.15.5:0/2546635087 learned_addr learned my addr 172.21.15.5:0/2546635087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f0994919640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f09900ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 -- 172.21.15.5:0/2546635087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 msgr2=0x7f09900ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f09900ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 -- 172.21.15.5:0/2546635087 >> v1:172.21.15.179:6789/0 conn(0x7f09900997a0 legacy=0x7f0990098e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f099511a640 1 -- 172.21.15.5:0/2546635087 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099015b0b0 con 0x7f09900cb120 2024-09-13T17:18:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.181+0000 7f098f7fe640 1 -- 172.21.15.5:0/2546635087 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357886959 0 0) 0x7f09900d13b0 con 0x7f09900997a0 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.182+0000 7f099511a640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f09900cb5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0988009e50 tx=0x7f098802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07ac725b7687324 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.182+0000 7f098f7fe640 1 -- 172.21.15.5:0/2546635087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988031600 con 0x7f09900cb120 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.182+0000 7f098f7fe640 1 -- 172.21.15.5:0/2546635087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098802d050 con 0x7f09900cb120 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.182+0000 7f098f7fe640 1 -- 172.21.15.5:0/2546635087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988031980 con 0x7f09900cb120 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 -- 172.21.15.5:0/2546635087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 msgr2=0x7f09900cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f09900cb5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0988009e50 tx=0x7f098802a7a0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 -- 172.21.15.5:0/2546635087 shutdown_connections 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f09900cb5d0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 --2- 172.21.15.5:0/2546635087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f09900ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 -- 172.21.15.5:0/2546635087 >> 172.21.15.5:0/2546635087 conn(0x7f09900d04c0 msgr2=0x7f09900d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 -- 172.21.15.5:0/2546635087 shutdown_connections 2024-09-13T17:18:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.183+0000 7f0996b7d640 1 -- 172.21.15.5:0/2546635087 wait complete. 2024-09-13T17:18:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.184+0000 7f0996b7d640 1 Processor -- start 2024-09-13T17:18:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.184+0000 7f0996b7d640 1 -- start start 2024-09-13T17:18:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f0990158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09900997a0 0x7f0990149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099014afe0 con 0x7f09900cb120 2024-09-13T17:18:32.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099014c620 con 0x7f09900997a0 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0996b7d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099014b400 con 0x7f0990098a50 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32912/0 (socket says 172.21.15.5:32912) 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 -- 172.21.15.5:0/196992203 learned_addr learned my addr 172.21.15.5:0/196992203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f098ffff640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09900997a0 0x7f0990149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f0994919640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f0990158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 -- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 msgr2=0x7f0990158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f0990158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 -- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09900997a0 msgr2=0x7f0990149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09900997a0 0x7f0990149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.185+0000 7f099511a640 1 -- 172.21.15.5:0/196992203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009b30 con 0x7f09900cb120 2024-09-13T17:18:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f099511a640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0988009e50 tx=0x7f0988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098803c890 con 0x7f09900cb120 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098803c9f0 con 0x7f09900cb120 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099014a360 con 0x7f09900cb120 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098803cda0 con 0x7f09900cb120 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.186+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099014a920 con 0x7f09900cb120 2024-09-13T17:18:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.187+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099014b120 con 0x7f09900cb120 2024-09-13T17:18:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.187+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0988038040 con 0x7f09900cb120 2024-09-13T17:18:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.188+0000 7f098d7fa640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 0x7f097406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.188+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f09880aa2d0 con 0x7f09900cb120 2024-09-13T17:18:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.188+0000 7f0994919640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 0x7f097406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.189+0000 7f0994919640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 0x7f097406d0c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0984009b40 tx=0x7f0984009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.192+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f099014b120 con 0x7f09900cb120 2024-09-13T17:18:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.400+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f099014b120 con 0x7f09900cb120 2024-09-13T17:18:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.406+0000 7f098d7fa640 1 -- 172.21.15.5:0/196992203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7f099014b120 con 0x7f09900cb120 2024-09-13T17:18:32.409 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 15 and data pool 16 2024-09-13T17:18:32.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.411+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 msgr2=0x7f097406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.411+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 0x7f097406d0c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0984009b40 tx=0x7f0984009190 comp rx=0 tx=0).stop 2024-09-13T17:18:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.411+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 msgr2=0x7f0990149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.411+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f0988009e50 tx=0x7f0988004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 shutdown_connections 2024-09-13T17:18:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f097406ac00 0x7f097406d0c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09900cb120 0x7f0990149b40 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09900997a0 0x7f0990149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 --2- 172.21.15.5:0/196992203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0990098a50 0x7f0990158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.418+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 >> 172.21.15.5:0/196992203 conn(0x7f09900d04c0 msgr2=0x7f09900b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.420+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 shutdown_connections 2024-09-13T17:18:32.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.420+0000 7f0996b7d640 1 -- 172.21.15.5:0/196992203 wait complete. 2024-09-13T17:18:32.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.541+0000 7f929508f640 1 Processor -- start 2024-09-13T17:18:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.541+0000 7f929508f640 1 -- start start 2024-09-13T17:18:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f929508f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92900cb7b0 0x7f929006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f929508f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92900b3150 con 0x7f92901592d0 2024-09-13T17:18:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f929508f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92900b3430 con 0x7f92900cdcb0 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f929508f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929015cf00 con 0x7f92900cb7b0 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92900cb7b0 0x7f929006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92900cb7b0 0x7f929006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32924/0 (socket says 172.21.15.5:32924) 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f928ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92901592d0 0x7f929006c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55900/0 (socket says 172.21.15.5:55900) 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 -- 172.21.15.5:0/46988150 learned_addr learned my addr 172.21.15.5:0/46988150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 -- 172.21.15.5:0/46988150 >> v1:172.21.15.179:6789/0 conn(0x7f92900cdcb0 legacy=0x7f929015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 -- 172.21.15.5:0/46988150 >> v1:172.21.15.5:6789/0 conn(0x7f92901592d0 legacy=0x7f929006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f9287fff640 1 -- 172.21.15.5:0/46988150 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900b3710 con 0x7f92900cb7b0 2024-09-13T17:18:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.542+0000 7f928e59c640 1 -- 172.21.15.5:0/46988150 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882806304 0 0) 0x7f92900b3150 con 0x7f92901592d0 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.543+0000 7f9287fff640 1 --2- 172.21.15.5:0/46988150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f929006dc60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9278009870 tx=0x7f927802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b13b8d00b468b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.543+0000 7f928e59c640 1 -- 172.21.15.5:0/46988150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927802ae90 con 0x7f92900cb7b0 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.543+0000 7f928e59c640 1 -- 172.21.15.5:0/46988150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278032440 con 0x7f92900cb7b0 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.543+0000 7f928e59c640 1 -- 172.21.15.5:0/46988150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780327d0 con 0x7f92900cb7b0 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 -- 172.21.15.5:0/46988150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 msgr2=0x7f929006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 --2- 172.21.15.5:0/46988150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f929006dc60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9278009870 tx=0x7f927802a180 comp rx=0 tx=0).stop 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 -- 172.21.15.5:0/46988150 shutdown_connections 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 --2- 172.21.15.5:0/46988150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f929006dc60 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 -- 172.21.15.5:0/46988150 >> 172.21.15.5:0/46988150 conn(0x7f9290066200 msgr2=0x7f9290069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 -- 172.21.15.5:0/46988150 shutdown_connections 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.544+0000 7f929508f640 1 -- 172.21.15.5:0/46988150 wait complete. 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.545+0000 7f929508f640 1 Processor -- start 2024-09-13T17:18:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.545+0000 7f929508f640 1 -- start start 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92900cdcb0 0x7f92900ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92901592d0 0x7f929014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900ac990 con 0x7f92900cb7b0 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901500a0 con 0x7f92900cdcb0 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f929508f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900abd80 con 0x7f92901592d0 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32938/0 (socket says 172.21.15.5:32938) 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 -- 172.21.15.5:0/3000527220 learned_addr learned my addr 172.21.15.5:0/3000527220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f9287fff640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92900cdcb0 0x7f92900ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928f59e640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92901592d0 0x7f929014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 -- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92901592d0 msgr2=0x7f929014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92901592d0 0x7f929014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 -- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92900cdcb0 msgr2=0x7f92900ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92900cdcb0 0x7f92900ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.546+0000 7f928ed9d640 1 -- 172.21.15.5:0/3000527220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780094d0 con 0x7f92900cb7b0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f928ed9d640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f928000c430 tx=0x7f928000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800074e0 con 0x7f92900cb7b0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280007660 con 0x7f92900cb7b0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92900ac060 con 0x7f92900cb7b0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280004a20 con 0x7f92900cb7b0 2024-09-13T17:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.547+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92900ac620 con 0x7f92900cb7b0 2024-09-13T17:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.548+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900672f0 con 0x7f92900cb7b0 2024-09-13T17:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.548+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9280004b80 con 0x7f92900cb7b0 2024-09-13T17:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.549+0000 7f92877fe640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 0x7f927006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.549+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9280089140 con 0x7f92900cb7b0 2024-09-13T17:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.549+0000 7f9287fff640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 0x7f927006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.550+0000 7f9287fff640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 0x7f927006d0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9278034000 tx=0x7f927802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.553+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9280054320 con 0x7f92900cb7b0 2024-09-13T17:18:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.728+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92900ccaa0 con 0x7f92900cb7b0 2024-09-13T17:18:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.730+0000 7f92877fe640 1 -- 172.21.15.5:0/3000527220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f9280057940 con 0x7f92900cb7b0 2024-09-13T17:18:32.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:32.732 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":106,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:32.402858+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 msgr2=0x7f927006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 0x7f927006d0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9278034000 tx=0x7f927802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 msgr2=0x7f92900cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f928000c430 tx=0x7f928000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 shutdown_connections 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92901592d0 0x7f929014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92900cdcb0 0x7f92900ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f927006ac00 0x7f927006d0c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 --2- 172.21.15.5:0/3000527220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92900cb7b0 0x7f92900cb200 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 >> 172.21.15.5:0/3000527220 conn(0x7f9290066200 msgr2=0x7f929006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 shutdown_connections 2024-09-13T17:18:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.732+0000 7f929508f640 1 -- 172.21.15.5:0/3000527220 wait complete. 2024-09-13T17:18:32.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.844+0000 7f7d3875e640 1 Processor -- start 2024-09-13T17:18:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.844+0000 7f7d3875e640 1 -- start start 2024-09-13T17:18:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d3875e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d30151340 0x7f7d300ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d3875e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151720 0x7f7d3006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d3875e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300ac780 con 0x7f7d3006b420 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d3875e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3006b8b0 con 0x7f7d30151340 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d3875e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3006ca00 con 0x7f7d30151720 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d30151340 0x7f7d300ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d30151340 0x7f7d300ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32940/0 (socket says 172.21.15.5:32940) 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 -- 172.21.15.5:0/2220177944 learned_addr learned my addr 172.21.15.5:0/2220177944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d35cf9640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151720 0x7f7d3006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 -- 172.21.15.5:0/2220177944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151720 msgr2=0x7f7d3006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151720 0x7f7d3006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 -- 172.21.15.5:0/2220177944 >> v1:172.21.15.179:6789/0 conn(0x7f7d3006b420 legacy=0x7f7d3015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.845+0000 7f7d364fa640 1 -- 172.21.15.5:0/2220177944 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300aca60 con 0x7f7d30151340 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.846+0000 7f7d364fa640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151340 0x7f7d300ac030 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009870 tx=0x7f7d2c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3111d55ecf580018 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.846+0000 7f7d354f8640 1 -- 172.21.15.5:0/2220177944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c032640 con 0x7f7d30151340 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.846+0000 7f7d354f8640 1 -- 172.21.15.5:0/2220177944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0327a0 con 0x7f7d30151340 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.846+0000 7f7d354f8640 1 -- 172.21.15.5:0/2220177944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c032b30 con 0x7f7d30151340 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 -- 172.21.15.5:0/2220177944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151340 msgr2=0x7f7d300ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151340 0x7f7d300ac030 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009870 tx=0x7f7d2c02a300 comp rx=0 tx=0).stop 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 -- 172.21.15.5:0/2220177944 shutdown_connections 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151720 0x7f7d3006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 --2- 172.21.15.5:0/2220177944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151340 0x7f7d300ac030 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 -- 172.21.15.5:0/2220177944 >> 172.21.15.5:0/2220177944 conn(0x7f7d300cc610 msgr2=0x7f7d30070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 -- 172.21.15.5:0/2220177944 shutdown_connections 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.847+0000 7f7d3875e640 1 -- 172.21.15.5:0/2220177944 wait complete. 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.848+0000 7f7d3875e640 1 Processor -- start 2024-09-13T17:18:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.848+0000 7f7d3875e640 1 -- start start 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3006b420 0x7f7d301f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151340 0x7f7d30153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30153ea0 con 0x7f7d30151720 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301f06d0 con 0x7f7d3006b420 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d3875e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301f09b0 con 0x7f7d30151340 2024-09-13T17:18:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32946/0 (socket says 172.21.15.5:32946) 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 -- 172.21.15.5:0/3043390605 learned_addr learned my addr 172.21.15.5:0/3043390605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d364fa640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3006b420 0x7f7d301f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d35cf9640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151340 0x7f7d30153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 -- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151340 msgr2=0x7f7d30153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151340 0x7f7d30153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 -- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3006b420 msgr2=0x7f7d301f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3006b420 0x7f7d301f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 -- 172.21.15.5:0/3043390605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c0094d0 con 0x7f7d30151720 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.849+0000 7f7d36cfb640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c7a0 tx=0x7f7d2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.850+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28003b70 con 0x7f7d30151720 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.850+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28003cf0 con 0x7f7d30151720 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.850+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d301f0c90 con 0x7f7d30151720 2024-09-13T17:18:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.850+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28003ea0 con 0x7f7d30151720 2024-09-13T17:18:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.850+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301f0330 con 0x7f7d30151720 2024-09-13T17:18:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.851+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3006aee0 con 0x7f7d30151720 2024-09-13T17:18:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.851+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d2800aa90 con 0x7f7d30151720 2024-09-13T17:18:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.852+0000 7f7d26ffd640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 0x7f7d1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.852+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7d28089300 con 0x7f7d30151720 2024-09-13T17:18:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.852+0000 7f7d364fa640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 0x7f7d1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.853+0000 7f7d364fa640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 0x7f7d1406d0f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c034000 tx=0x7f7d2c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:32.856+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7d280543a0 con 0x7f7d30151720 2024-09-13T17:18:33.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.027+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d30070c10 con 0x7f7d30151720 2024-09-13T17:18:33.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.028+0000 7f7d26ffd640 1 -- 172.21.15.5:0/3043390605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f7d280579c0 con 0x7f7d30151720 2024-09-13T17:18:33.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:33.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":106,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:32.402858+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:33.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 msgr2=0x7f7d1406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 0x7f7d1406d0f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c034000 tx=0x7f7d2c02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 msgr2=0x7f7d30144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c7a0 tx=0x7f7d2800cc60 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 shutdown_connections 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7d1406ac30 0x7f7d1406d0f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d30151720 0x7f7d30144c80 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d30151340 0x7f7d30153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 --2- 172.21.15.5:0/3043390605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3006b420 0x7f7d301f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 >> 172.21.15.5:0/3043390605 conn(0x7f7d300cc610 msgr2=0x7f7d30071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:33.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 shutdown_connections 2024-09-13T17:18:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.030+0000 7f7d3875e640 1 -- 172.21.15.5:0/3043390605 wait complete. 2024-09-13T17:18:33.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:18:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.147+0000 7fabf131f640 1 Processor -- start 2024-09-13T17:18:33.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.147+0000 7fabf131f640 1 -- start start 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.147+0000 7fabf131f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabec0d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.147+0000 7fabf131f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabec0cf6d0 0x7fabec0b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabf131f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0d1f80 con 0x7fabec0d0e60 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabf131f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec0b8670 con 0x7fabec0cf6d0 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabf131f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0d2410 con 0x7fabec15c800 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabea7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabec0d0e60 0x7fabec0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55906/0 (socket says 172.21.15.5:55906) 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabea7fc640 1 -- 172.21.15.5:0/401812203 learned_addr learned my addr 172.21.15.5:0/401812203 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabeaffd640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabec0d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/401812203 >> v2:172.21.15.179:3300/0 conn(0x7fabec0cf6d0 0x7fabec0b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197543309 0 0) 0x7fabec0d1f80 con 0x7fabec0d0e60 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd4003520 con 0x7fabec0d0e60 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 64510419 0 0) 0x7fabd4003520 con 0x7fabec0d0e60 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 msgr2=0x7fabec0d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabec0d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 >> v2:172.21.15.179:3300/0 conn(0x7fabec0cf6d0 msgr2=0x7fabec0b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 --2- 172.21.15.5:0/401812203 >> v2:172.21.15.179:3300/0 conn(0x7fabec0cf6d0 0x7fabec0b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0d1370 con 0x7fabec0d0e60 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fabe0001670 con 0x7fabec0d0e60 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 >> v1:172.21.15.5:6789/0 conn(0x7fabec0d0e60 legacy=0x7fabec0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd4003970 0x7fabd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40047c0 0x7fabd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0b8670 con 0x7fabd4003970 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0d2410 con 0x7fabd40047c0 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd400b980 con 0x7fabec15c800 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.148+0000 7fabeaffd640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd4003970 0x7fabd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabea7fc640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40047c0 0x7fabd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 -- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 msgr2=0x7fabd4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabd4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 -- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40047c0 msgr2=0x7fabd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40047c0 0x7fabd4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 -- 172.21.15.5:0/401812203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4003520 con 0x7fabd4003970 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec15c800 0x7fabd4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabea7fc640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40047c0 0x7fabd4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:33.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.149+0000 7fabeaffd640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd4003970 0x7fabd4003d90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009ac0 tx=0x7fabd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dae595cac39de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc031400 con 0x7fabd4003970 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc02d050 con 0x7fabd4003970 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabe9ffb640 1 -- 172.21.15.5:0/401812203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc031780 con 0x7fabd4003970 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 -- 172.21.15.5:0/401812203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd4003970 msgr2=0x7fabd4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 --2- 172.21.15.5:0/401812203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd4003970 0x7fabd4003d90 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009ac0 tx=0x7fabd40057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabeb7fe640 1 -- 172.21.15.5:0/401812203 reap_dead start 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 -- 172.21.15.5:0/401812203 shutdown_connections 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 -- 172.21.15.5:0/401812203 >> 172.21.15.5:0/401812203 conn(0x7fabec06b110 msgr2=0x7fabec06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 -- 172.21.15.5:0/401812203 shutdown_connections 2024-09-13T17:18:33.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.150+0000 7fabf131f640 1 -- 172.21.15.5:0/401812203 wait complete. 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 Processor -- start 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 -- start start 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd4003970 0x7fabec1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 0x7fabec1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0b4440 con 0x7fabec0b3a80 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec154500 con 0x7fabd4003970 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabf131f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec156ac0 con 0x7fabec156590 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabeb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32966/0 (socket says 172.21.15.5:32966) 2024-09-13T17:18:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.152+0000 7fabeb7fe640 1 -- 172.21.15.5:0/664137668 learned_addr learned my addr 172.21.15.5:0/664137668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabea7fc640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 0x7fabec1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeaffd640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd4003970 0x7fabec1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 -- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 msgr2=0x7fabec1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 0x7fabec1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 -- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd4003970 msgr2=0x7fabec1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd4003970 0x7fabec1f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 -- 172.21.15.5:0/664137668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec156da0 con 0x7fabec0b3a80 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabea7fc640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 0x7fabec1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabeb7fe640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cffe0 tx=0x7fabe4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe401b070 con 0x7fabec0b3a80 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400f040 con 0x7fabec0b3a80 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec157080 con 0x7fabec0b3a80 2024-09-13T17:18:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400e050 con 0x7fabec0b3a80 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.153+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec157640 con 0x7fabec0b3a80 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.154+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec0672f0 con 0x7fabec0b3a80 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.155+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabe4015440 con 0x7fabec0b3a80 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.155+0000 7fabd37fe640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 0x7fabd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.155+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fabe40898f0 con 0x7fabec0b3a80 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.156+0000 7fabeaffd640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 0x7fabd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.156+0000 7fabeaffd640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 0x7fabd806d0f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabdc033000 tx=0x7fabdc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.160+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabe4054990 con 0x7fabec0b3a80 2024-09-13T17:18:33.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.367+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fabec0d0920 con 0x7fabec0b3a80 2024-09-13T17:18:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.416+0000 7fabd37fe640 1 -- 172.21.15.5:0/664137668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fabe4057fb0 con 0x7fabec0b3a80 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 msgr2=0x7fabd806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 0x7fabd806d0f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabdc033000 tx=0x7fabdc008030 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 msgr2=0x7fabec0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cffe0 tx=0x7fabe4009f90 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 shutdown_connections 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabd806ac30 0x7fabd806d0f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0b3a80 0x7fabec0b3f00 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabec156590 0x7fabec1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 --2- 172.21.15.5:0/664137668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd4003970 0x7fabec1f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.418+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 >> 172.21.15.5:0/664137668 conn(0x7fabec06b110 msgr2=0x7fabec0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.419+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 shutdown_connections 2024-09-13T17:18:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.419+0000 7fabf131f640 1 -- 172.21.15.5:0/664137668 wait complete. 2024-09-13T17:18:33.431 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:18:33.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:18:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.534+0000 7fb1853ed640 1 Processor -- start 2024-09-13T17:18:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.534+0000 7fb1853ed640 1 -- start start 2024-09-13T17:18:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb1853ed640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb18015f990 0x7fb18006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb1853ed640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18006e2d0 con 0x7fb1800ad2c0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb1853ed640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18006e5b0 con 0x7fb1800abfd0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb1853ed640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18006ef50 con 0x7fb18015f990 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17e7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1800ad2c0 0x7fb1800ab8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33732/0 (socket says 172.21.15.5:33732) 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17e7fc640 1 -- 172.21.15.5:0/1161707663 learned_addr learned my addr 172.21.15.5:0/1161707663 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17effd640 1 --2- 172.21.15.5:0/1161707663 >> v2:172.21.15.179:3300/0 conn(0x7fb18015f990 0x7fb18006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005280908 0 0) 0x7fb18006e2d0 con 0x7fb1800ad2c0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb168003520 con 0x7fb1800ad2c0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376791690 0 0) 0x7fb18006e5b0 con 0x7fb1800abfd0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18006e2d0 con 0x7fb1800abfd0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2064513076 0 0) 0x7fb168003520 con 0x7fb1800ad2c0 2024-09-13T17:18:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 >> v2:172.21.15.179:3300/0 conn(0x7fb18015f990 msgr2=0x7fb18006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 --2- 172.21.15.5:0/1161707663 >> v2:172.21.15.179:3300/0 conn(0x7fb18015f990 0x7fb18006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 >> v1:172.21.15.179:6789/0 conn(0x7fb1800abfd0 legacy=0x7fb1800b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18006e890 con 0x7fb1800ad2c0 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb174001670 con 0x7fb1800ad2c0 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.535+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 >> v1:172.21.15.5:6789/0 conn(0x7fb1800ad2c0 legacy=0x7fb1800ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb168003b00 0x7fb168003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 0x7fb168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680051f0 0x7fb16800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18006ef50 con 0x7fb1680047c0 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16800c150 con 0x7fb168003b00 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16800c310 con 0x7fb1680051f0 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 0x7fb168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17effd640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb168003b00 0x7fb168003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17f7fe640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680051f0 0x7fb16800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 -- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680051f0 msgr2=0x7fb16800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680051f0 0x7fb16800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 -- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb168003b00 msgr2=0x7fb168003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb168003b00 0x7fb168003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17e7fc640 1 -- 172.21.15.5:0/1161707663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168003520 con 0x7fb1680047c0 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.536+0000 7fb17f7fe640 1 -- 172.21.15.5:0/1161707663 reap_dead start 2024-09-13T17:18:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 0x7fb168004c40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb174007fd0 tx=0x7fb1680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05e55f7c14583ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174005ad0 con 0x7fb1680047c0 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17402d070 con 0x7fb1680047c0 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb17dffb640 1 -- 172.21.15.5:0/1161707663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174007070 con 0x7fb1680047c0 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 -- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 msgr2=0x7fb168004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 0x7fb168004c40 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb174007fd0 tx=0x7fb1680057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 -- 172.21.15.5:0/1161707663 shutdown_connections 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 --2- 172.21.15.5:0/1161707663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1680047c0 0x7fb168004c40 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 -- 172.21.15.5:0/1161707663 >> 172.21.15.5:0/1161707663 conn(0x7fb180069ed0 msgr2=0x7fb18006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 -- 172.21.15.5:0/1161707663 shutdown_connections 2024-09-13T17:18:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.537+0000 7fb1853ed640 1 -- 172.21.15.5:0/1161707663 wait complete. 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 Processor -- start 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 -- start start 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680047c0 0x7fb1801516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1801f2510 0x7fb1801f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180151be0 con 0x7fb18015e5d0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18015d250 con 0x7fb1801f2510 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.539+0000 7fb1853ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18015d530 con 0x7fb1680047c0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59626/0 (socket says 172.21.15.5:59626) 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 -- 172.21.15.5:0/3947753450 learned_addr learned my addr 172.21.15.5:0/3947753450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17f7fe640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1801f2510 0x7fb1801f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17effd640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680047c0 0x7fb1801516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 -- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680047c0 msgr2=0x7fb1801516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680047c0 0x7fb1801516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 -- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1801f2510 msgr2=0x7fb1801f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1801f2510 0x7fb1801f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 -- 172.21.15.5:0/3947753450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18015d810 con 0x7fb18015e5d0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb17e7fc640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb17402ac90 tx=0x7fb174001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740049e0 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174004b40 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18015daf0 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174007070 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.540+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18015e0b0 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.541+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800672c0 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.542+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb17402f030 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.542+0000 7fb1677fe640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 0x7fb16c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.543+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb1740a8ad0 con 0x7fb18015e5d0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.543+0000 7fb17effd640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 0x7fb16c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:33.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.543+0000 7fb17effd640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 0x7fb16c06d0c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb1800684e0 tx=0x7fb170009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.547+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb174073ba0 con 0x7fb18015e5d0 2024-09-13T17:18:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:33.756+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1800672c0 con 0x7fb18015e5d0 2024-09-13T17:18:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.419+0000 7fb1677fe640 1 -- 172.21.15.5:0/3947753450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1740771c0 con 0x7fb18015e5d0 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 msgr2=0x7fb16c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 0x7fb16c06d0c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb1800684e0 tx=0x7fb170009190 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 msgr2=0x7fb18014f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb17402ac90 tx=0x7fb174001980 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 shutdown_connections 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1801f2510 0x7fb1801f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb16c06ac00 0x7fb16c06d0c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb18015e5d0 0x7fb18014f860 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 --2- 172.21.15.5:0/3947753450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680047c0 0x7fb1801516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.421+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 >> 172.21.15.5:0/3947753450 conn(0x7fb180069ed0 msgr2=0x7fb1800af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.422+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 shutdown_connections 2024-09-13T17:18:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.422+0000 7fb1853ed640 1 -- 172.21.15.5:0/3947753450 wait complete. 2024-09-13T17:18:34.436 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:18:34.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 Processor -- start 2024-09-13T17:18:34.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 -- start start 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fba1815c9f0 0x7fba180b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1815cdd0 con 0x7fba180cd630 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180d3040 con 0x7fba180b5820 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.541+0000 7fba1f176640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180b8750 con 0x7fba1815c9f0 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba17fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fba180cd630 0x7fba180b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33740/0 (socket says 172.21.15.5:33740) 2024-09-13T17:18:34.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba17fff640 1 -- 172.21.15.5:0/1939871525 learned_addr learned my addr 172.21.15.5:0/1939871525 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba1cf12640 1 --2- 172.21.15.5:0/1939871525 >> v2:172.21.15.179:3300/0 conn(0x7fba1815c9f0 0x7fba180b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128078933 0 0) 0x7fba1815cdd0 con 0x7fba180cd630 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba08003520 con 0x7fba180cd630 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba1cf12640 1 -- 172.21.15.5:0/1939871525 >> v1:172.21.15.179:6789/0 conn(0x7fba180b5820 legacy=0x7fba180b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba1cf12640 1 -- 172.21.15.5:0/1939871525 >> v1:172.21.15.5:6789/0 conn(0x7fba180cd630 legacy=0x7fba180b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599857805 0 0) 0x7fba08003520 con 0x7fba180cd630 2024-09-13T17:18:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.542+0000 7fba1cf12640 1 -- 172.21.15.5:0/1939871525 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180cdb10 con 0x7fba1815c9f0 2024-09-13T17:18:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.543+0000 7fba1cf12640 1 --2- 172.21.15.5:0/1939871525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b4170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0097a0 tx=0x7fba0c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395e54ad5a9a00cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.543+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04001670 con 0x7fba1815c9f0 2024-09-13T17:18:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.543+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c02abc0 con 0x7fba1815c9f0 2024-09-13T17:18:34.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.543+0000 7fba177fe640 1 -- 172.21.15.5:0/1939871525 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c032440 con 0x7fba1815c9f0 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 -- 172.21.15.5:0/1939871525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 msgr2=0x7fba180b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 --2- 172.21.15.5:0/1939871525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b4170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0097a0 tx=0x7fba0c02a130 comp rx=0 tx=0).stop 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 -- 172.21.15.5:0/1939871525 shutdown_connections 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 --2- 172.21.15.5:0/1939871525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b4170 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 -- 172.21.15.5:0/1939871525 >> 172.21.15.5:0/1939871525 conn(0x7fba18071a20 msgr2=0x7fba18071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 -- 172.21.15.5:0/1939871525 shutdown_connections 2024-09-13T17:18:34.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.544+0000 7fba1f176640 1 -- 172.21.15.5:0/1939871525 wait complete. 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.545+0000 7fba1f176640 1 Processor -- start 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.545+0000 7fba1f176640 1 -- start start 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba180b5820 0x7fba181528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180d2c20 con 0x7fba180cd630 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180b4100 con 0x7fba1815c9f0 2024-09-13T17:18:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1f176640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180b43e0 con 0x7fba180b5820 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59642/0 (socket says 172.21.15.5:59642) 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 -- 172.21.15.5:0/2905409904 learned_addr learned my addr 172.21.15.5:0/2905409904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1cf12640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba180b5820 0x7fba181528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba1d713640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 -- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba180b5820 msgr2=0x7fba181528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba180b5820 0x7fba181528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 -- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 msgr2=0x7fba180b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 -- 172.21.15.5:0/2905409904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c009400 con 0x7fba180cd630 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.546+0000 7fba17fff640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fba040017a0 tx=0x7fba0400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.547+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04005ad0 con 0x7fba180cd630 2024-09-13T17:18:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.547+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba04005c30 con 0x7fba180cd630 2024-09-13T17:18:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.547+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba180b46c0 con 0x7fba180cd630 2024-09-13T17:18:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.547+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04007070 con 0x7fba180cd630 2024-09-13T17:18:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.547+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba180b4c80 con 0x7fba180cd630 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.548+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba180b4e70 con 0x7fba180cd630 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.548+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba040071d0 con 0x7fba180cd630 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.549+0000 7fba157fa640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 0x7fb9fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.549+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fba04088ad0 con 0x7fba180cd630 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.549+0000 7fba1cf12640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 0x7fb9fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.549+0000 7fba1cf12640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 0x7fb9fc06d0f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fba0c034000 tx=0x7fba0c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.553+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fba04053b00 con 0x7fba180cd630 2024-09-13T17:18:34.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.761+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba180b5cd0 con 0x7fba180cd630 2024-09-13T17:18:34.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.761+0000 7fba157fa640 1 -- 172.21.15.5:0/2905409904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fba04057120 con 0x7fba180cd630 2024-09-13T17:18:34.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:34.764 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2137139495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2137139495},{"type":"v1","addr":"172.21.15.179:6837","nonce":2137139495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1886354202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1886354202},{"type":"v1","addr":"172.21.15.5:6835","nonce":1886354202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3557899480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3557899480},{"type":"v1","addr":"172.21.15.179:6836","nonce":3557899480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:34.417093+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1677867267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1677867267},{"type":"v1","addr":"172.21.15.5:6833","nonce":1677867267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:34.764 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 48 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 msgr2=0x7fb9fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 0x7fb9fc06d0f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fba0c034000 tx=0x7fba0c02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 msgr2=0x7fba180b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fba040017a0 tx=0x7fba0400cbe0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 shutdown_connections 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba1815c9f0 0x7fba180b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb9fc06ac30 0x7fb9fc06d0f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba180cd630 0x7fba180b3790 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 --2- 172.21.15.5:0/2905409904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba180b5820 0x7fba181528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 >> 172.21.15.5:0/2905409904 conn(0x7fba18071a20 msgr2=0x7fba180ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 shutdown_connections 2024-09-13T17:18:34.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.763+0000 7fba1f176640 1 -- 172.21.15.5:0/2905409904 wait complete. 2024-09-13T17:18:34.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.875+0000 7fbe48612640 1 Processor -- start 2024-09-13T17:18:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.875+0000 7fbe48612640 1 -- start start 2024-09-13T17:18:34.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe48612640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe4006ded0 0x7fbe401636f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe48612640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400cd260 con 0x7fbe40158c60 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe48612640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400cd6f0 con 0x7fbe40070af0 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe48612640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400cc650 con 0x7fbe4006ded0 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe463ae640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe40158c60 0x7fbe400703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33754/0 (socket says 172.21.15.5:33754) 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe463ae640 1 -- 172.21.15.5:0/788248031 learned_addr learned my addr 172.21.15.5:0/788248031 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.876+0000 7fbe46baf640 1 --2- 172.21.15.5:0/788248031 >> v2:172.21.15.179:3300/0 conn(0x7fbe4006ded0 0x7fbe401636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392242924 0 0) 0x7fbe400cd260 con 0x7fbe40158c60 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe28003520 con 0x7fbe40158c60 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815164746 0 0) 0x7fbe400cd6f0 con 0x7fbe40070af0 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe400cd260 con 0x7fbe40070af0 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe46baf640 1 -- 172.21.15.5:0/788248031 >> v1:172.21.15.179:6789/0 conn(0x7fbe40070af0 legacy=0x7fbe4006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe46baf640 1 -- 172.21.15.5:0/788248031 >> v1:172.21.15.5:6789/0 conn(0x7fbe40158c60 legacy=0x7fbe400703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.877+0000 7fbe46baf640 1 -- 172.21.15.5:0/788248031 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400cc930 con 0x7fbe4006ded0 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe46baf640 1 --2- 172.21.15.5:0/788248031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe401636f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800a940 tx=0x7fbe3802b5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab44f50dcb7ba3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38030510 con 0x7fbe4006ded0 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3802e050 con 0x7fbe4006ded0 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe453ac640 1 -- 172.21.15.5:0/788248031 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38030870 con 0x7fbe4006ded0 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe48612640 1 -- 172.21.15.5:0/788248031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 msgr2=0x7fbe401636f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe48612640 1 --2- 172.21.15.5:0/788248031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe401636f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800a940 tx=0x7fbe3802b5e0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe48612640 1 -- 172.21.15.5:0/788248031 shutdown_connections 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe48612640 1 --2- 172.21.15.5:0/788248031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe401636f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.878+0000 7fbe48612640 1 -- 172.21.15.5:0/788248031 >> 172.21.15.5:0/788248031 conn(0x7fbe40066200 msgr2=0x7fbe40069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.879+0000 7fbe48612640 1 -- 172.21.15.5:0/788248031 shutdown_connections 2024-09-13T17:18:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.879+0000 7fbe48612640 1 -- 172.21.15.5:0/788248031 wait complete. 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.880+0000 7fbe48612640 1 Processor -- start 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.880+0000 7fbe48612640 1 -- start start 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.880+0000 7fbe48612640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe400a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.880+0000 7fbe48612640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe40158c60 0x7fbe40153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401f1010 con 0x7fbe40070af0 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401f1ee0 con 0x7fbe4006ded0 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe401f1260 con 0x7fbe40158c60 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59656/0 (socket says 172.21.15.5:59656) 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 -- 172.21.15.5:0/357641015 learned_addr learned my addr 172.21.15.5:0/357641015 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe463ae640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe400a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe46baf640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe40158c60 0x7fbe40153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 -- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe40158c60 msgr2=0x7fbe40153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe40158c60 0x7fbe40153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 -- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 msgr2=0x7fbe400a8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe400a8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 -- 172.21.15.5:0/357641015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3800a5a0 con 0x7fbe40070af0 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe45bad640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c530 tx=0x7fbe3400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340052d0 con 0x7fbe40070af0 2024-09-13T17:18:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe34005450 con 0x7fbe40070af0 2024-09-13T17:18:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe401f1540 con 0x7fbe40070af0 2024-09-13T17:18:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34012870 con 0x7fbe40070af0 2024-09-13T17:18:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.881+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe401f1b00 con 0x7fbe40070af0 2024-09-13T17:18:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.882+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe400672f0 con 0x7fbe40070af0 2024-09-13T17:18:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.883+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe340129d0 con 0x7fbe40070af0 2024-09-13T17:18:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.883+0000 7fbe3effd640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 0x7fbe2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.883+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbe34088eb0 con 0x7fbe40070af0 2024-09-13T17:18:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.884+0000 7fbe463ae640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 0x7fbe2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.884+0000 7fbe463ae640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 0x7fbe2c06d0c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbe30001560 tx=0x7fbe300019f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:34.888+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe34054010 con 0x7fbe40070af0 2024-09-13T17:18:35.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.060+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe400a8e70 con 0x7fbe40070af0 2024-09-13T17:18:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.061+0000 7fbe3effd640 1 -- 172.21.15.5:0/357641015 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fbe400a8e70 con 0x7fbe40070af0 2024-09-13T17:18:35.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:35.063 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:33.404731+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:35.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 msgr2=0x7fbe2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 0x7fbe2c06d0c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbe30001560 tx=0x7fbe300019f0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 msgr2=0x7fbe4014ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c530 tx=0x7fbe3400c9f0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 shutdown_connections 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe40158c60 0x7fbe40153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbe2c06ac00 0x7fbe2c06d0c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe40070af0 0x7fbe4014ee50 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 --2- 172.21.15.5:0/357641015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe4006ded0 0x7fbe400a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 >> 172.21.15.5:0/357641015 conn(0x7fbe40066200 msgr2=0x7fbe40157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 shutdown_connections 2024-09-13T17:18:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.063+0000 7fbe48612640 1 -- 172.21.15.5:0/357641015 wait complete. 2024-09-13T17:18:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:18:35.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:35.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.176+0000 7f1e0f345640 1 Processor -- start 2024-09-13T17:18:35.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.176+0000 7f1e0f345640 1 -- start start 2024-09-13T17:18:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e08145f20 0x7f1e080b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1e0806dfe0 0x7f1e080b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e080b43f0 0x7f1e080ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080b2990 con 0x7f1e080b43f0 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0806db50 con 0x7f1e0806dfe0 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0f345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0806d540 con 0x7f1e08145f20 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e080b43f0 0x7f1e080ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e080b43f0 0x7f1e080ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59658/0 (socket says 172.21.15.5:59658) 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 -- 172.21.15.5:0/2381287363 learned_addr learned my addr 172.21.15.5:0/2381287363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d0e1640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e08145f20 0x7f1e080b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0c8e0640 1 --2- 172.21.15.5:0/2381287363 >> v2:172.21.15.179:3300/0 conn(0x7f1e0806dfe0 0x7f1e080b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 -- 172.21.15.5:0/2381287363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e08145f20 msgr2=0x7f1e080b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e08145f20 0x7f1e080b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 -- 172.21.15.5:0/2381287363 >> v2:172.21.15.179:3300/0 conn(0x7f1e0806dfe0 msgr2=0x7f1e080b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 --2- 172.21.15.5:0/2381287363 >> v2:172.21.15.179:3300/0 conn(0x7f1e0806dfe0 0x7f1e080b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.177+0000 7f1e0d8e2640 1 -- 172.21.15.5:0/2381287363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0806ee60 con 0x7f1e080b43f0 2024-09-13T17:18:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.178+0000 7f1e0d8e2640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e080b43f0 0x7f1e080ac430 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1e080d04c0 tx=0x7f1e0002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856796d31221e660 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.178+0000 7f1dfbfff640 1 -- 172.21.15.5:0/2381287363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00031600 con 0x7f1e080b43f0 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.178+0000 7f1dfbfff640 1 -- 172.21.15.5:0/2381287363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0002d050 con 0x7f1e080b43f0 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.178+0000 7f1dfbfff640 1 -- 172.21.15.5:0/2381287363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00031980 con 0x7f1e080b43f0 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 -- 172.21.15.5:0/2381287363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e080b43f0 msgr2=0x7f1e080ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e080b43f0 0x7f1e080ac430 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1e080d04c0 tx=0x7f1e0002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 -- 172.21.15.5:0/2381287363 shutdown_connections 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e080b43f0 0x7f1e080ac430 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 --2- 172.21.15.5:0/2381287363 >> v2:172.21.15.179:3300/0 conn(0x7f1e0806dfe0 0x7f1e080b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 --2- 172.21.15.5:0/2381287363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e08145f20 0x7f1e080b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 -- 172.21.15.5:0/2381287363 >> 172.21.15.5:0/2381287363 conn(0x7f1e080b50e0 msgr2=0x7f1e08098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 -- 172.21.15.5:0/2381287363 shutdown_connections 2024-09-13T17:18:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.179+0000 7f1e0f345640 1 -- 172.21.15.5:0/2381287363 wait complete. 2024-09-13T17:18:35.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.180+0000 7f1e0f345640 1 Processor -- start 2024-09-13T17:18:35.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.180+0000 7f1e0f345640 1 -- start start 2024-09-13T17:18:35.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e080b43f0 0x7f1e08142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e08145f20 0x7f1e0815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809bbc0 con 0x7f1e0806dfe0 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809bea0 con 0x7f1e08145f20 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0f345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809c180 con 0x7f1e080b43f0 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59662/0 (socket says 172.21.15.5:59662) 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 -- 172.21.15.5:0/1305415558 learned_addr learned my addr 172.21.15.5:0/1305415558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 -- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e080b43f0 msgr2=0x7f1e08142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e080b43f0 0x7f1e08142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 -- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e08145f20 msgr2=0x7f1e0815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e08145f20 0x7f1e0815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 -- 172.21.15.5:0/1305415558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009b30 con 0x7f1e0806dfe0 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1e0d0e1640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400e9b0 tx=0x7f1e0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.181+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04009670 con 0x7f1e0806dfe0 2024-09-13T17:18:35.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.182+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0400c9a0 con 0x7f1e0806dfe0 2024-09-13T17:18:35.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.182+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0809c460 con 0x7f1e0806dfe0 2024-09-13T17:18:35.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.182+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400cd50 con 0x7f1e0806dfe0 2024-09-13T17:18:35.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.182+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0809d1a0 con 0x7f1e0806dfe0 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.183+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e08098f80 con 0x7f1e0806dfe0 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.183+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e04013470 con 0x7f1e0806dfe0 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.184+0000 7f1df9ffb640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 0x7f1dec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.184+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e04089730 con 0x7f1e0806dfe0 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.184+0000 7f1e0c8e0640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 0x7f1dec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.185+0000 7f1e0c8e0640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 0x7f1dec06d0c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc006a90 tx=0x7f1dfc006a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.188+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e040547d0 con 0x7f1e0806dfe0 2024-09-13T17:18:35.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.355+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e0809c010 con 0x7f1dec06ac00 2024-09-13T17:18:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.363+0000 7f1df9ffb640 1 -- 172.21.15.5:0/1305415558 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286996 (secure 0 0 0) 0x7f1e0809c010 con 0x7f1dec06ac00 2024-09-13T17:18:35.369 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:35.370 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 msgr2=0x7f1dec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 0x7f1dec06d0c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc006a90 tx=0x7f1dfc006a20 comp rx=0 tx=0).stop 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 msgr2=0x7f1e0809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400e9b0 tx=0x7f1e0400ee70 comp rx=0 tx=0).stop 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 shutdown_connections 2024-09-13T17:18:35.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e08145f20 0x7f1e0815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e080b43f0 0x7f1e08142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1dec06ac00 0x7f1dec06d0c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 --2- 172.21.15.5:0/1305415558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e0806dfe0 0x7f1e0809cc60 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 >> 172.21.15.5:0/1305415558 conn(0x7f1e080b50e0 msgr2=0x7f1e080b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 shutdown_connections 2024-09-13T17:18:35.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.367+0000 7f1e0f345640 1 -- 172.21.15.5:0/1305415558 wait complete. 2024-09-13T17:18:35.380 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-13T17:18:35.333915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252004,"kb_used_data":11252,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754722716,"statfs":{"total":773094113280,"available":772836061184,"internally_reserved":0,"allocated":11522048,"data_stored":5878683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301395"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043061+0000","last_change":"2024-09-13T17:18:32.043061+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043061+0000","last_undegraded":"2024-09-13T17:18:32.043061+0000","last_fullsized":"2024-09-13T17:18:32.043061+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046688+0000","last_change":"2024-09-13T17:18:32.046688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046688+0000","last_undegraded":"2024-09-13T17:18:32.046688+0000","last_fullsized":"2024-09-13T17:18:32.046688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042635+0000","last_change":"2024-09-13T17:18:32.042635+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042635+0000","last_undegraded":"2024-09-13T17:18:32.042635+0000","last_fullsized":"2024-09-13T17:18:32.042635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041129+0000","last_change":"2024-09-13T17:18:32.041129+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041129+0000","last_undegraded":"2024-09-13T17:18:32.041129+0000","last_fullsized":"2024-09-13T17:18:32.041129+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048167+0000","last_change":"2024-09-13T17:18:32.048167+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048167+0000","last_undegraded":"2024-09-13T17:18:32.048167+0000","last_fullsized":"2024-09-13T17:18:32.048167+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046342+0000","last_change":"2024-09-13T17:18:32.046342+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046342+0000","last_undegraded":"2024-09-13T17:18:32.046342+0000","last_fullsized":"2024-09-13T17:18:32.046342+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043353+0000","last_change":"2024-09-13T17:18:32.043353+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043353+0000","last_undegraded":"2024-09-13T17:18:32.043353+0000","last_fullsized":"2024-09-13T17:18:32.043353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.049247+0000","last_change":"2024-09-13T17:18:32.049247+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.049247+0000","last_undegraded":"2024-09-13T17:18:32.049247+0000","last_fullsized":"2024-09-13T17:18:32.049247+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044253+0000","last_change":"2024-09-13T17:18:32.044253+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044253+0000","last_undegraded":"2024-09-13T17:18:32.044253+0000","last_fullsized":"2024-09-13T17:18:32.044253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045481+0000","last_change":"2024-09-13T17:18:32.045481+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045481+0000","last_undegraded":"2024-09-13T17:18:32.045481+0000","last_fullsized":"2024-09-13T17:18:32.045481+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037743+0000","last_change":"2024-09-13T17:18:32.037743+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037743+0000","last_undegraded":"2024-09-13T17:18:32.037743+0000","last_fullsized":"2024-09-13T17:18:32.037743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041268+0000","last_change":"2024-09-13T17:18:32.041268+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041268+0000","last_undegraded":"2024-09-13T17:18:32.041268+0000","last_fullsized":"2024-09-13T17:18:32.041268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041006+0000","last_change":"2024-09-13T17:18:32.041006+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041006+0000","last_undegraded":"2024-09-13T17:18:32.041006+0000","last_fullsized":"2024-09-13T17:18:32.041006+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043934+0000","last_change":"2024-09-13T17:18:32.043934+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043934+0000","last_undegraded":"2024-09-13T17:18:32.043934+0000","last_fullsized":"2024-09-13T17:18:32.043934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042527+0000","last_change":"2024-09-13T17:18:32.042527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042527+0000","last_undegraded":"2024-09-13T17:18:32.042527+0000","last_fullsized":"2024-09-13T17:18:32.042527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042901+0000","last_change":"2024-09-13T17:18:32.042901+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042901+0000","last_undegraded":"2024-09-13T17:18:32.042901+0000","last_fullsized":"2024-09-13T17:18:32.042901+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042179+0000","last_change":"2024-09-13T17:18:32.042179+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042179+0000","last_undegraded":"2024-09-13T17:18:32.042179+0000","last_fullsized":"2024-09-13T17:18:32.042179+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045113+0000","last_change":"2024-09-13T17:18:32.045113+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045113+0000","last_undegraded":"2024-09-13T17:18:32.045113+0000","last_fullsized":"2024-09-13T17:18:32.045113+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041691+0000","last_change":"2024-09-13T17:18:32.041691+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041691+0000","last_undegraded":"2024-09-13T17:18:32.041691+0000","last_fullsized":"2024-09-13T17:18:32.041691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040846+0000","last_change":"2024-09-13T17:18:32.040846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040846+0000","last_undegraded":"2024-09-13T17:18:32.040846+0000","last_fullsized":"2024-09-13T17:18:32.040846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048698+0000","last_change":"2024-09-13T17:18:32.048698+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048698+0000","last_undegraded":"2024-09-13T17:18:32.048698+0000","last_fullsized":"2024-09-13T17:18:32.048698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045424+0000","last_change":"2024-09-13T17:18:32.045424+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045424+0000","last_undegraded":"2024-09-13T17:18:32.045424+0000","last_fullsized":"2024-09-13T17:18:32.045424+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041209+0000","last_change":"2024-09-13T17:18:32.041209+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041209+0000","last_undegraded":"2024-09-13T17:18:32.041209+0000","last_fullsized":"2024-09-13T17:18:32.041209+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044393+0000","last_change":"2024-09-13T17:18:32.044393+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044393+0000","last_undegraded":"2024-09-13T17:18:32.044393+0000","last_fullsized":"2024-09-13T17:18:32.044393+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039846+0000","last_change":"2024-09-13T17:18:32.039846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039846+0000","last_undegraded":"2024-09-13T17:18:32.039846+0000","last_fullsized":"2024-09-13T17:18:32.039846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041710+0000","last_change":"2024-09-13T17:18:32.041710+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041710+0000","last_undegraded":"2024-09-13T17:18:32.041710+0000","last_fullsized":"2024-09-13T17:18:32.041710+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036999+0000","last_change":"2024-09-13T17:18:32.036999+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036999+0000","last_undegraded":"2024-09-13T17:18:32.036999+0000","last_fullsized":"2024-09-13T17:18:32.036999+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043016+0000","last_change":"2024-09-13T17:18:32.043016+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043016+0000","last_undegraded":"2024-09-13T17:18:32.043016+0000","last_fullsized":"2024-09-13T17:18:32.043016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048157+0000","last_change":"2024-09-13T17:18:32.048157+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048157+0000","last_undegraded":"2024-09-13T17:18:32.048157+0000","last_fullsized":"2024-09-13T17:18:32.048157+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039890+0000","last_change":"2024-09-13T17:18:32.039890+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039890+0000","last_undegraded":"2024-09-13T17:18:32.039890+0000","last_fullsized":"2024-09-13T17:18:32.039890+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042841+0000","last_change":"2024-09-13T17:18:32.042841+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042841+0000","last_undegraded":"2024-09-13T17:18:32.042841+0000","last_fullsized":"2024-09-13T17:18:32.042841+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047688+0000","last_change":"2024-09-13T17:18:32.047688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047688+0000","last_undegraded":"2024-09-13T17:18:32.047688+0000","last_fullsized":"2024-09-13T17:18:32.047688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039023+0000","last_change":"2024-09-13T17:18:32.039023+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039023+0000","last_undegraded":"2024-09-13T17:18:32.039023+0000","last_fullsized":"2024-09-13T17:18:32.039023+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055137+0000","last_change":"2024-09-13T17:18:32.053380+0000","last_active":"2024-09-13T17:18:32.055137+0000","last_peered":"2024-09-13T17:18:32.055137+0000","last_clean":"2024-09-13T17:18:32.055137+0000","last_became_active":"2024-09-13T17:18:32.053093+0000","last_became_peered":"2024-09-13T17:18:32.053093+0000","last_unstale":"2024-09-13T17:18:32.055137+0000","last_undegraded":"2024-09-13T17:18:32.055137+0000","last_fullsized":"2024-09-13T17:18:32.055137+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:19.522901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043214+0000","last_change":"2024-09-13T17:18:32.043214+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043214+0000","last_undegraded":"2024-09-13T17:18:32.043214+0000","last_fullsized":"2024-09-13T17:18:32.043214+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048640+0000","last_change":"2024-09-13T17:18:32.046895+0000","last_active":"2024-09-13T17:18:32.048640+0000","last_peered":"2024-09-13T17:18:32.048640+0000","last_clean":"2024-09-13T17:18:32.048640+0000","last_became_active":"2024-09-13T17:18:32.046631+0000","last_became_peered":"2024-09-13T17:18:32.046631+0000","last_unstale":"2024-09-13T17:18:32.048640+0000","last_undegraded":"2024-09-13T17:18:32.048640+0000","last_fullsized":"2024-09-13T17:18:32.048640+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:50.355643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039405+0000","last_change":"2024-09-13T17:18:32.039405+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039405+0000","last_undegraded":"2024-09-13T17:18:32.039405+0000","last_fullsized":"2024-09-13T17:18:32.039405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048432+0000","last_change":"2024-09-13T17:18:32.046706+0000","last_active":"2024-09-13T17:18:32.048432+0000","last_peered":"2024-09-13T17:18:32.048432+0000","last_clean":"2024-09-13T17:18:32.048432+0000","last_became_active":"2024-09-13T17:18:32.046095+0000","last_became_peered":"2024-09-13T17:18:32.046095+0000","last_unstale":"2024-09-13T17:18:32.048432+0000","last_undegraded":"2024-09-13T17:18:32.048432+0000","last_fullsized":"2024-09-13T17:18:32.048432+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037211+0000","last_change":"2024-09-13T17:18:32.037211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037211+0000","last_undegraded":"2024-09-13T17:18:32.037211+0000","last_fullsized":"2024-09-13T17:18:32.037211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059236+0000","last_change":"2024-09-13T17:18:32.058586+0000","last_active":"2024-09-13T17:18:32.059236+0000","last_peered":"2024-09-13T17:18:32.059236+0000","last_clean":"2024-09-13T17:18:32.059236+0000","last_became_active":"2024-09-13T17:18:32.058270+0000","last_became_peered":"2024-09-13T17:18:32.058270+0000","last_unstale":"2024-09-13T17:18:32.059236+0000","last_undegraded":"2024-09-13T17:18:32.059236+0000","last_fullsized":"2024-09-13T17:18:32.059236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040619+0000","last_change":"2024-09-13T17:18:32.040619+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040619+0000","last_undegraded":"2024-09-13T17:18:32.040619+0000","last_fullsized":"2024-09-13T17:18:32.040619+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057811+0000","last_change":"2024-09-13T17:18:32.055699+0000","last_active":"2024-09-13T17:18:32.057811+0000","last_peered":"2024-09-13T17:18:32.057811+0000","last_clean":"2024-09-13T17:18:32.057811+0000","last_became_active":"2024-09-13T17:18:32.055400+0000","last_became_peered":"2024-09-13T17:18:32.055400+0000","last_unstale":"2024-09-13T17:18:32.057811+0000","last_undegraded":"2024-09-13T17:18:32.057811+0000","last_fullsized":"2024-09-13T17:18:32.057811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038949+0000","last_change":"2024-09-13T17:18:32.038949+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038949+0000","last_undegraded":"2024-09-13T17:18:32.038949+0000","last_fullsized":"2024-09-13T17:18:32.038949+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.044529+0000","last_change":"2024-09-13T17:18:32.043559+0000","last_active":"2024-09-13T17:18:32.044529+0000","last_peered":"2024-09-13T17:18:32.044529+0000","last_clean":"2024-09-13T17:18:32.044529+0000","last_became_active":"2024-09-13T17:18:32.043256+0000","last_became_peered":"2024-09-13T17:18:32.043256+0000","last_unstale":"2024-09-13T17:18:32.044529+0000","last_undegraded":"2024-09-13T17:18:32.044529+0000","last_fullsized":"2024-09-13T17:18:32.044529+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044020+0000","last_change":"2024-09-13T17:18:32.044020+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044020+0000","last_undegraded":"2024-09-13T17:18:32.044020+0000","last_fullsized":"2024-09-13T17:18:32.044020+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057566+0000","last_change":"2024-09-13T17:18:32.051660+0000","last_active":"2024-09-13T17:18:32.057566+0000","last_peered":"2024-09-13T17:18:32.057566+0000","last_clean":"2024-09-13T17:18:32.057566+0000","last_became_active":"2024-09-13T17:18:32.051389+0000","last_became_peered":"2024-09-13T17:18:32.051389+0000","last_unstale":"2024-09-13T17:18:32.057566+0000","last_undegraded":"2024-09-13T17:18:32.057566+0000","last_fullsized":"2024-09-13T17:18:32.057566+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041287+0000","last_change":"2024-09-13T17:18:32.041287+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041287+0000","last_undegraded":"2024-09-13T17:18:32.041287+0000","last_fullsized":"2024-09-13T17:18:32.041287+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057567+0000","last_change":"2024-09-13T17:18:32.056515+0000","last_active":"2024-09-13T17:18:32.057567+0000","last_peered":"2024-09-13T17:18:32.057567+0000","last_clean":"2024-09-13T17:18:32.057567+0000","last_became_active":"2024-09-13T17:18:32.056248+0000","last_became_peered":"2024-09-13T17:18:32.056248+0000","last_unstale":"2024-09-13T17:18:32.057567+0000","last_undegraded":"2024-09-13T17:18:32.057567+0000","last_fullsized":"2024-09-13T17:18:32.057567+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:56.745772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039552+0000","last_change":"2024-09-13T17:18:32.039552+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039552+0000","last_undegraded":"2024-09-13T17:18:32.039552+0000","last_fullsized":"2024-09-13T17:18:32.039552+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057613+0000","last_change":"2024-09-13T17:18:32.051852+0000","last_active":"2024-09-13T17:18:32.057613+0000","last_peered":"2024-09-13T17:18:32.057613+0000","last_clean":"2024-09-13T17:18:32.057613+0000","last_became_active":"2024-09-13T17:18:32.051491+0000","last_became_peered":"2024-09-13T17:18:32.051491+0000","last_unstale":"2024-09-13T17:18:32.057613+0000","last_undegraded":"2024-09-13T17:18:32.057613+0000","last_fullsized":"2024-09-13T17:18:32.057613+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.758976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046527+0000","last_change":"2024-09-13T17:18:32.046527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046527+0000","last_undegraded":"2024-09-13T17:18:32.046527+0000","last_fullsized":"2024-09-13T17:18:32.046527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053636+0000","last_change":"2024-09-13T17:18:32.052318+0000","last_active":"2024-09-13T17:18:32.053636+0000","last_peered":"2024-09-13T17:18:32.053636+0000","last_clean":"2024-09-13T17:18:32.053636+0000","last_became_active":"2024-09-13T17:18:32.052032+0000","last_became_peered":"2024-09-13T17:18:32.052032+0000","last_unstale":"2024-09-13T17:18:32.053636+0000","last_undegraded":"2024-09-13T17:18:32.053636+0000","last_fullsized":"2024-09-13T17:18:32.053636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:31.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043751+0000","last_change":"2024-09-13T17:18:32.043751+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043751+0000","last_undegraded":"2024-09-13T17:18:32.043751+0000","last_fullsized":"2024-09-13T17:18:32.043751+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057207+0000","last_change":"2024-09-13T17:18:32.052462+0000","last_active":"2024-09-13T17:18:32.057207+0000","last_peered":"2024-09-13T17:18:32.057207+0000","last_clean":"2024-09-13T17:18:32.057207+0000","last_became_active":"2024-09-13T17:18:32.052178+0000","last_became_peered":"2024-09-13T17:18:32.052178+0000","last_unstale":"2024-09-13T17:18:32.057207+0000","last_undegraded":"2024-09-13T17:18:32.057207+0000","last_fullsized":"2024-09-13T17:18:32.057207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047325+0000","last_change":"2024-09-13T17:18:32.047325+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047325+0000","last_undegraded":"2024-09-13T17:18:32.047325+0000","last_fullsized":"2024-09-13T17:18:32.047325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057828+0000","last_change":"2024-09-13T17:18:32.052090+0000","last_active":"2024-09-13T17:18:32.057828+0000","last_peered":"2024-09-13T17:18:32.057828+0000","last_clean":"2024-09-13T17:18:32.057828+0000","last_became_active":"2024-09-13T17:18:32.051825+0000","last_became_peered":"2024-09-13T17:18:32.051825+0000","last_unstale":"2024-09-13T17:18:32.057828+0000","last_undegraded":"2024-09-13T17:18:32.057828+0000","last_fullsized":"2024-09-13T17:18:32.057828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:03.796734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037448+0000","last_change":"2024-09-13T17:18:32.037448+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037448+0000","last_undegraded":"2024-09-13T17:18:32.037448+0000","last_fullsized":"2024-09-13T17:18:32.037448+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055849+0000","last_change":"2024-09-13T17:18:32.054701+0000","last_active":"2024-09-13T17:18:32.055849+0000","last_peered":"2024-09-13T17:18:32.055849+0000","last_clean":"2024-09-13T17:18:32.055849+0000","last_became_active":"2024-09-13T17:18:32.054402+0000","last_became_peered":"2024-09-13T17:18:32.054402+0000","last_unstale":"2024-09-13T17:18:32.055849+0000","last_undegraded":"2024-09-13T17:18:32.055849+0000","last_fullsized":"2024-09-13T17:18:32.055849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044082+0000","last_change":"2024-09-13T17:18:32.044082+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044082+0000","last_undegraded":"2024-09-13T17:18:32.044082+0000","last_fullsized":"2024-09-13T17:18:32.044082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053111+0000","last_change":"2024-09-13T17:18:32.049352+0000","last_active":"2024-09-13T17:18:32.053111+0000","last_peered":"2024-09-13T17:18:32.053111+0000","last_clean":"2024-09-13T17:18:32.053111+0000","last_became_active":"2024-09-13T17:18:32.049083+0000","last_became_peered":"2024-09-13T17:18:32.049083+0000","last_unstale":"2024-09-13T17:18:32.053111+0000","last_undegraded":"2024-09-13T17:18:32.053111+0000","last_fullsized":"2024-09-13T17:18:32.053111+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:10.146181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044211+0000","last_change":"2024-09-13T17:18:32.044211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044211+0000","last_undegraded":"2024-09-13T17:18:32.044211+0000","last_fullsized":"2024-09-13T17:18:32.044211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.056366+0000","last_change":"2024-09-13T17:18:32.055502+0000","last_active":"2024-09-13T17:18:32.056366+0000","last_peered":"2024-09-13T17:18:32.056366+0000","last_clean":"2024-09-13T17:18:32.056366+0000","last_became_active":"2024-09-13T17:18:32.055221+0000","last_became_peered":"2024-09-13T17:18:32.055221+0000","last_unstale":"2024-09-13T17:18:32.056366+0000","last_undegraded":"2024-09-13T17:18:32.056366+0000","last_fullsized":"2024-09-13T17:18:32.056366+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:47.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040235+0000","last_change":"2024-09-13T17:18:32.040235+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040235+0000","last_undegraded":"2024-09-13T17:18:32.040235+0000","last_fullsized":"2024-09-13T17:18:32.040235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051391+0000","last_change":"2024-09-13T17:18:32.049724+0000","last_active":"2024-09-13T17:18:32.051391+0000","last_peered":"2024-09-13T17:18:32.051391+0000","last_clean":"2024-09-13T17:18:32.051391+0000","last_became_active":"2024-09-13T17:18:32.048989+0000","last_became_peered":"2024-09-13T17:18:32.048989+0000","last_unstale":"2024-09-13T17:18:32.051391+0000","last_undegraded":"2024-09-13T17:18:32.051391+0000","last_fullsized":"2024-09-13T17:18:32.051391+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.692313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044695+0000","last_change":"2024-09-13T17:18:32.044695+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044695+0000","last_undegraded":"2024-09-13T17:18:32.044695+0000","last_fullsized":"2024-09-13T17:18:32.044695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055101+0000","last_change":"2024-09-13T17:18:32.047867+0000","last_active":"2024-09-13T17:18:32.055101+0000","last_peered":"2024-09-13T17:18:32.055101+0000","last_clean":"2024-09-13T17:18:32.055101+0000","last_became_active":"2024-09-13T17:18:32.047515+0000","last_became_peered":"2024-09-13T17:18:32.047515+0000","last_unstale":"2024-09-13T17:18:32.055101+0000","last_undegraded":"2024-09-13T17:18:32.055101+0000","last_fullsized":"2024-09-13T17:18:32.055101+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044878+0000","last_change":"2024-09-13T17:18:32.044878+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044878+0000","last_undegraded":"2024-09-13T17:18:32.044878+0000","last_fullsized":"2024-09-13T17:18:32.044878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057271+0000","last_change":"2024-09-13T17:18:32.053603+0000","last_active":"2024-09-13T17:18:32.057271+0000","last_peered":"2024-09-13T17:18:32.057271+0000","last_clean":"2024-09-13T17:18:32.057271+0000","last_became_active":"2024-09-13T17:18:32.053322+0000","last_became_peered":"2024-09-13T17:18:32.053322+0000","last_unstale":"2024-09-13T17:18:32.057271+0000","last_undegraded":"2024-09-13T17:18:32.057271+0000","last_fullsized":"2024-09-13T17:18:32.057271+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047763+0000","last_change":"2024-09-13T17:18:32.047763+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047763+0000","last_undegraded":"2024-09-13T17:18:32.047763+0000","last_fullsized":"2024-09-13T17:18:32.047763+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.050959+0000","last_change":"2024-09-13T17:18:32.049980+0000","last_active":"2024-09-13T17:18:32.050959+0000","last_peered":"2024-09-13T17:18:32.050959+0000","last_clean":"2024-09-13T17:18:32.050959+0000","last_became_active":"2024-09-13T17:18:32.049675+0000","last_became_peered":"2024-09-13T17:18:32.049675+0000","last_unstale":"2024-09-13T17:18:32.050959+0000","last_undegraded":"2024-09-13T17:18:32.050959+0000","last_fullsized":"2024-09-13T17:18:32.050959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040144+0000","last_change":"2024-09-13T17:18:32.040144+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040144+0000","last_undegraded":"2024-09-13T17:18:32.040144+0000","last_fullsized":"2024-09-13T17:18:32.040144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.052474+0000","last_change":"2024-09-13T17:18:32.051684+0000","last_active":"2024-09-13T17:18:32.052474+0000","last_peered":"2024-09-13T17:18:32.052474+0000","last_clean":"2024-09-13T17:18:32.052474+0000","last_became_active":"2024-09-13T17:18:32.051408+0000","last_became_peered":"2024-09-13T17:18:32.051408+0000","last_unstale":"2024-09-13T17:18:32.052474+0000","last_undegraded":"2024-09-13T17:18:32.052474+0000","last_fullsized":"2024-09-13T17:18:32.052474+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:24.762568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040723+0000","last_change":"2024-09-13T17:18:32.040723+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040723+0000","last_undegraded":"2024-09-13T17:18:32.040723+0000","last_fullsized":"2024-09-13T17:18:32.040723+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048678+0000","last_change":"2024-09-13T17:18:32.045340+0000","last_active":"2024-09-13T17:18:32.048678+0000","last_peered":"2024-09-13T17:18:32.048678+0000","last_clean":"2024-09-13T17:18:32.048678+0000","last_became_active":"2024-09-13T17:18:32.045082+0000","last_became_peered":"2024-09-13T17:18:32.045082+0000","last_unstale":"2024-09-13T17:18:32.048678+0000","last_undegraded":"2024-09-13T17:18:32.048678+0000","last_fullsized":"2024-09-13T17:18:32.048678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.968862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040860+0000","last_change":"2024-09-13T17:18:32.040860+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040860+0000","last_undegraded":"2024-09-13T17:18:32.040860+0000","last_fullsized":"2024-09-13T17:18:32.040860+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.058085+0000","last_change":"2024-09-13T17:18:32.055416+0000","last_active":"2024-09-13T17:18:32.058085+0000","last_peered":"2024-09-13T17:18:32.058085+0000","last_clean":"2024-09-13T17:18:32.058085+0000","last_became_active":"2024-09-13T17:18:32.055170+0000","last_became_peered":"2024-09-13T17:18:32.055170+0000","last_unstale":"2024-09-13T17:18:32.058085+0000","last_undegraded":"2024-09-13T17:18:32.058085+0000","last_fullsized":"2024-09-13T17:18:32.058085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046923+0000","last_change":"2024-09-13T17:18:32.046923+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046923+0000","last_undegraded":"2024-09-13T17:18:32.046923+0000","last_fullsized":"2024-09-13T17:18:32.046923+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049505+0000","last_change":"2024-09-13T17:18:32.048620+0000","last_active":"2024-09-13T17:18:32.049505+0000","last_peered":"2024-09-13T17:18:32.049505+0000","last_clean":"2024-09-13T17:18:32.049505+0000","last_became_active":"2024-09-13T17:18:32.048322+0000","last_became_peered":"2024-09-13T17:18:32.048322+0000","last_unstale":"2024-09-13T17:18:32.049505+0000","last_undegraded":"2024-09-13T17:18:32.049505+0000","last_fullsized":"2024-09-13T17:18:32.049505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.661885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041509+0000","last_change":"2024-09-13T17:18:32.041509+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041509+0000","last_undegraded":"2024-09-13T17:18:32.041509+0000","last_fullsized":"2024-09-13T17:18:32.041509+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055304+0000","last_change":"2024-09-13T17:18:32.054556+0000","last_active":"2024-09-13T17:18:32.055304+0000","last_peered":"2024-09-13T17:18:32.055304+0000","last_clean":"2024-09-13T17:18:32.055304+0000","last_became_active":"2024-09-13T17:18:32.054202+0000","last_became_peered":"2024-09-13T17:18:32.054202+0000","last_unstale":"2024-09-13T17:18:32.055304+0000","last_undegraded":"2024-09-13T17:18:32.055304+0000","last_fullsized":"2024-09-13T17:18:32.055304+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039865+0000","last_change":"2024-09-13T17:18:32.039865+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039865+0000","last_undegraded":"2024-09-13T17:18:32.039865+0000","last_fullsized":"2024-09-13T17:18:32.039865+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049468+0000","last_change":"2024-09-13T17:18:32.044430+0000","last_active":"2024-09-13T17:18:32.049468+0000","last_peered":"2024-09-13T17:18:32.049468+0000","last_clean":"2024-09-13T17:18:32.049468+0000","last_became_active":"2024-09-13T17:18:32.044134+0000","last_became_peered":"2024-09-13T17:18:32.044134+0000","last_unstale":"2024-09-13T17:18:32.049468+0000","last_undegraded":"2024-09-13T17:18:32.049468+0000","last_fullsized":"2024-09-13T17:18:32.049468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:10.753053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040487+0000","last_change":"2024-09-13T17:18:32.040487+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040487+0000","last_undegraded":"2024-09-13T17:18:32.040487+0000","last_fullsized":"2024-09-13T17:18:32.040487+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057520+0000","last_change":"2024-09-13T17:18:32.053192+0000","last_active":"2024-09-13T17:18:32.057520+0000","last_peered":"2024-09-13T17:18:32.057520+0000","last_clean":"2024-09-13T17:18:32.057520+0000","last_became_active":"2024-09-13T17:18:32.052993+0000","last_became_peered":"2024-09-13T17:18:32.052993+0000","last_unstale":"2024-09-13T17:18:32.057520+0000","last_undegraded":"2024-09-13T17:18:32.057520+0000","last_fullsized":"2024-09-13T17:18:32.057520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038221+0000","last_change":"2024-09-13T17:18:32.038221+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038221+0000","last_undegraded":"2024-09-13T17:18:32.038221+0000","last_fullsized":"2024-09-13T17:18:32.038221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059254+0000","last_change":"2024-09-13T17:18:32.058647+0000","last_active":"2024-09-13T17:18:32.059254+0000","last_peered":"2024-09-13T17:18:32.059254+0000","last_clean":"2024-09-13T17:18:32.059254+0000","last_became_active":"2024-09-13T17:18:32.058335+0000","last_became_peered":"2024-09-13T17:18:32.058335+0000","last_unstale":"2024-09-13T17:18:32.059254+0000","last_undegraded":"2024-09-13T17:18:32.059254+0000","last_fullsized":"2024-09-13T17:18:32.059254+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:52.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046286+0000","last_change":"2024-09-13T17:18:32.046286+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046286+0000","last_undegraded":"2024-09-13T17:18:32.046286+0000","last_fullsized":"2024-09-13T17:18:32.046286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051328+0000","last_change":"2024-09-13T17:18:32.049134+0000","last_active":"2024-09-13T17:18:32.051328+0000","last_peered":"2024-09-13T17:18:32.051328+0000","last_clean":"2024-09-13T17:18:32.051328+0000","last_became_active":"2024-09-13T17:18:32.048872+0000","last_became_peered":"2024-09-13T17:18:32.048872+0000","last_unstale":"2024-09-13T17:18:32.051328+0000","last_undegraded":"2024-09-13T17:18:32.051328+0000","last_fullsized":"2024-09-13T17:18:32.051328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:12.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047194+0000","last_change":"2024-09-13T17:18:32.047194+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047194+0000","last_undegraded":"2024-09-13T17:18:32.047194+0000","last_fullsized":"2024-09-13T17:18:32.047194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059186+0000","last_change":"2024-09-13T17:18:32.058217+0000","last_active":"2024-09-13T17:18:32.059186+0000","last_peered":"2024-09-13T17:18:32.059186+0000","last_clean":"2024-09-13T17:18:32.059186+0000","last_became_active":"2024-09-13T17:18:32.057860+0000","last_became_peered":"2024-09-13T17:18:32.057860+0000","last_unstale":"2024-09-13T17:18:32.059186+0000","last_undegraded":"2024-09-13T17:18:32.059186+0000","last_fullsized":"2024-09-13T17:18:32.059186+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:44.171955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043425+0000","last_change":"2024-09-13T17:18:32.043425+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043425+0000","last_undegraded":"2024-09-13T17:18:32.043425+0000","last_fullsized":"2024-09-13T17:18:32.043425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055334+0000","last_change":"2024-09-13T17:18:32.050290+0000","last_active":"2024-09-13T17:18:32.055334+0000","last_peered":"2024-09-13T17:18:32.055334+0000","last_clean":"2024-09-13T17:18:32.055334+0000","last_became_active":"2024-09-13T17:18:32.050038+0000","last_became_peered":"2024-09-13T17:18:32.050038+0000","last_unstale":"2024-09-13T17:18:32.055334+0000","last_undegraded":"2024-09-13T17:18:32.055334+0000","last_fullsized":"2024-09-13T17:18:32.055334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038329+0000","last_change":"2024-09-13T17:18:32.038329+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038329+0000","last_undegraded":"2024-09-13T17:18:32.038329+0000","last_fullsized":"2024-09-13T17:18:32.038329+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059156+0000","last_change":"2024-09-13T17:18:32.058246+0000","last_active":"2024-09-13T17:18:32.059156+0000","last_peered":"2024-09-13T17:18:32.059156+0000","last_clean":"2024-09-13T17:18:32.059156+0000","last_became_active":"2024-09-13T17:18:32.057888+0000","last_became_peered":"2024-09-13T17:18:32.057888+0000","last_unstale":"2024-09-13T17:18:32.059156+0000","last_undegraded":"2024-09-13T17:18:32.059156+0000","last_fullsized":"2024-09-13T17:18:32.059156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:37.515238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036938+0000","last_change":"2024-09-13T17:18:32.036938+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036938+0000","last_undegraded":"2024-09-13T17:18:32.036938+0000","last_fullsized":"2024-09-13T17:18:32.036938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049480+0000","last_change":"2024-09-13T17:18:32.047953+0000","last_active":"2024-09-13T17:18:32.049480+0000","last_peered":"2024-09-13T17:18:32.049480+0000","last_clean":"2024-09-13T17:18:32.049480+0000","last_became_active":"2024-09-13T17:18:32.047691+0000","last_became_peered":"2024-09-13T17:18:32.047691+0000","last_unstale":"2024-09-13T17:18:32.049480+0000","last_undegraded":"2024-09-13T17:18:32.049480+0000","last_fullsized":"2024-09-13T17:18:32.049480+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:05.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-13T17:18:31.041688+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:18:31.041688+0000","last_peered":"2024-09-13T17:18:31.041688+0000","last_clean":"2024-09-13T17:18:31.041688+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:18:31.041688+0000","last_undegraded":"2024-09-13T17:18:31.041688+0000","last_fullsized":"2024-09-13T17:18:31.041688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1896448,"data_stored":1183382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70799999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":1.165,"15min":1.165},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":1.216,"15min":1.216},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76800000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":1.234,"15min":1.234},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.878,"15min":0.878},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67800000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69299999999999995,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70099999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.66600000000000004,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.378},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73799999999999999,"5min":1.173,"15min":1.173},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":1.008,"15min":1.008},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":1.085,"15min":1.085},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.47699999999999998},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.50700000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":1.034,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72699999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.622},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33300000000000002,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63400000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.245,"5min":0.214,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":1.458,"15min":1.458},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.23699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.437}]},{"osd":5,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88100000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.81000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":1.226,"15min":1.226},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32600000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.42499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.51000000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35799999999999998,"15min":0.36599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39900000000000002,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53100000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":0.871,"15min":0.871},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.39400000000000002},"min":{"1min":0.252,"5min":0.223,"15min":0.223},"max":{"1min":0.56999999999999995,"5min":1.159,"15min":1.159},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.40500000000000003},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50800000000000001,"5min":1.081,"15min":1.081},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.45500000000000002,"5min":1.286,"15min":1.286},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.752,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73099999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.254,"15min":1.254},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1884160,"data_stored":1176787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54800000000000004,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.501,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61499999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.51600000000000001,"15min":0.433},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":14.262,"15min":14.262},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.33900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58999999999999997,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.98499999999999999,"5min":3.956,"15min":3.956},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":0.998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":4.069,"15min":4.069},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.026,"5min":4.04,"15min":4.04},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93500000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:35.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.520+0000 7f533dc9c640 1 Processor -- start 2024-09-13T17:18:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.520+0000 7f533dc9c640 1 -- start start 2024-09-13T17:18:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f533dc9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f533815c9f0 0x7f53380b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f533dc9c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53380b5820 0x7f53380b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f533dc9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533815cdd0 con 0x7f53380cd630 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f533dc9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380b8750 con 0x7f533815c9f0 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f533dc9c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380d2c20 con 0x7f53380b5820 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f53377fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f533815c9f0 0x7f53380b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f53377fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f533815c9f0 0x7f53380b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59666/0 (socket says 172.21.15.5:59666) 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.521+0000 7f53377fe640 1 -- 172.21.15.5:0/82413784 learned_addr learned my addr 172.21.15.5:0/82413784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.522+0000 7f53377fe640 1 -- 172.21.15.5:0/82413784 >> v2:172.21.15.179:3300/0 conn(0x7f53380b5820 msgr2=0x7f53380b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.522+0000 7f53377fe640 1 --2- 172.21.15.5:0/82413784 >> v2:172.21.15.179:3300/0 conn(0x7f53380b5820 0x7f53380b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.522+0000 7f53377fe640 1 -- 172.21.15.5:0/82413784 >> v1:172.21.15.179:6789/0 conn(0x7f53380cd630 legacy=0x7f53380b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.522+0000 7f53377fe640 1 -- 172.21.15.5:0/82413784 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380d3040 con 0x7f533815c9f0 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.522+0000 7f53377fe640 1 --2- 172.21.15.5:0/82413784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533815c9f0 0x7f53380b4170 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f53380c60b0 tx=0x7f532802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17621b59f69585e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f53367fc640 1 -- 172.21.15.5:0/82413784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328032440 con 0x7f533815c9f0 2024-09-13T17:18:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f53367fc640 1 -- 172.21.15.5:0/82413784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53280325a0 con 0x7f533815c9f0 2024-09-13T17:18:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f53367fc640 1 -- 172.21.15.5:0/82413784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328032930 con 0x7f533815c9f0 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 -- 172.21.15.5:0/82413784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533815c9f0 msgr2=0x7f53380b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 --2- 172.21.15.5:0/82413784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533815c9f0 0x7f53380b4170 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f53380c60b0 tx=0x7f532802a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 -- 172.21.15.5:0/82413784 shutdown_connections 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 --2- 172.21.15.5:0/82413784 >> v2:172.21.15.179:3300/0 conn(0x7f53380b5820 0x7f53380b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 --2- 172.21.15.5:0/82413784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533815c9f0 0x7f53380b4170 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 -- 172.21.15.5:0/82413784 >> 172.21.15.5:0/82413784 conn(0x7f5338071a20 msgr2=0x7f5338071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 -- 172.21.15.5:0/82413784 shutdown_connections 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.523+0000 7f533dc9c640 1 -- 172.21.15.5:0/82413784 wait complete. 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.524+0000 7f533dc9c640 1 Processor -- start 2024-09-13T17:18:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 -- start start 2024-09-13T17:18:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53380cd630 0x7f53381f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533815c9f0 0x7f53380c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380c6c40 con 0x7f53380b5820 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53381f2ee0 con 0x7f53380cd630 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f533dc9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53380c62a0 con 0x7f533815c9f0 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f53377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f53377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59674/0 (socket says 172.21.15.5:59674) 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.525+0000 7f53377fe640 1 -- 172.21.15.5:0/2269947237 learned_addr learned my addr 172.21.15.5:0/2269947237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f5337fff640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533815c9f0 0x7f53380c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f5336ffd640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53380cd630 0x7f53381f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 -- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533815c9f0 msgr2=0x7f53380c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533815c9f0 0x7f53380c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 -- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53380cd630 msgr2=0x7f53381f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53380cd630 0x7f53381f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 -- 172.21.15.5:0/2269947237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280094d0 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f53377fe640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f5328000c00 tx=0x7f53280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328032440 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328030b80 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53380c6580 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532803b400 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.526+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53381f1da0 con 0x7f53380b5820 2024-09-13T17:18:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.527+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53380c6d80 con 0x7f53380b5820 2024-09-13T17:18:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.528+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5328039040 con 0x7f53380b5820 2024-09-13T17:18:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.528+0000 7f531ffff640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 0x7f532406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.528+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f53280a9d20 con 0x7f53380b5820 2024-09-13T17:18:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.528+0000 7f5336ffd640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 0x7f532406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.529+0000 7f5336ffd640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 0x7f532406d0c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5338152ae0 tx=0x7f532c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.532+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53380c6d80 con 0x7f53380b5820 2024-09-13T17:18:35.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.700+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53380d2560 con 0x7f532406ac00 2024-09-13T17:18:35.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.708+0000 7f531ffff640 1 -- 172.21.15.5:0/2269947237 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286996 (secure 0 0 0) 0x7f532c001c60 con 0x7f532406ac00 2024-09-13T17:18:35.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:35.715 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 msgr2=0x7f532406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 0x7f532406d0c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5338152ae0 tx=0x7f532c009040 comp rx=0 tx=0).stop 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 msgr2=0x7f53381f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f5328000c00 tx=0x7f53280046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 shutdown_connections 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533815c9f0 0x7f53380c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53380cd630 0x7f53381f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f532406ac00 0x7f532406d0c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 --2- 172.21.15.5:0/2269947237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53380b5820 0x7f53381f3170 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.711+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 >> 172.21.15.5:0/2269947237 conn(0x7f5338071a20 msgr2=0x7f53380d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.712+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 shutdown_connections 2024-09-13T17:18:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.712+0000 7f533dc9c640 1 -- 172.21.15.5:0/2269947237 wait complete. 2024-09-13T17:18:35.725 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-13T17:18:35.333915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252004,"kb_used_data":11252,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754722716,"statfs":{"total":773094113280,"available":772836061184,"internally_reserved":0,"allocated":11522048,"data_stored":5878683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301395"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043061+0000","last_change":"2024-09-13T17:18:32.043061+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043061+0000","last_undegraded":"2024-09-13T17:18:32.043061+0000","last_fullsized":"2024-09-13T17:18:32.043061+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046688+0000","last_change":"2024-09-13T17:18:32.046688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046688+0000","last_undegraded":"2024-09-13T17:18:32.046688+0000","last_fullsized":"2024-09-13T17:18:32.046688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042635+0000","last_change":"2024-09-13T17:18:32.042635+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042635+0000","last_undegraded":"2024-09-13T17:18:32.042635+0000","last_fullsized":"2024-09-13T17:18:32.042635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041129+0000","last_change":"2024-09-13T17:18:32.041129+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041129+0000","last_undegraded":"2024-09-13T17:18:32.041129+0000","last_fullsized":"2024-09-13T17:18:32.041129+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048167+0000","last_change":"2024-09-13T17:18:32.048167+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048167+0000","last_undegraded":"2024-09-13T17:18:32.048167+0000","last_fullsized":"2024-09-13T17:18:32.048167+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046342+0000","last_change":"2024-09-13T17:18:32.046342+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046342+0000","last_undegraded":"2024-09-13T17:18:32.046342+0000","last_fullsized":"2024-09-13T17:18:32.046342+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043353+0000","last_change":"2024-09-13T17:18:32.043353+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043353+0000","last_undegraded":"2024-09-13T17:18:32.043353+0000","last_fullsized":"2024-09-13T17:18:32.043353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.049247+0000","last_change":"2024-09-13T17:18:32.049247+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.049247+0000","last_undegraded":"2024-09-13T17:18:32.049247+0000","last_fullsized":"2024-09-13T17:18:32.049247+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044253+0000","last_change":"2024-09-13T17:18:32.044253+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044253+0000","last_undegraded":"2024-09-13T17:18:32.044253+0000","last_fullsized":"2024-09-13T17:18:32.044253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045481+0000","last_change":"2024-09-13T17:18:32.045481+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045481+0000","last_undegraded":"2024-09-13T17:18:32.045481+0000","last_fullsized":"2024-09-13T17:18:32.045481+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037743+0000","last_change":"2024-09-13T17:18:32.037743+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037743+0000","last_undegraded":"2024-09-13T17:18:32.037743+0000","last_fullsized":"2024-09-13T17:18:32.037743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041268+0000","last_change":"2024-09-13T17:18:32.041268+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041268+0000","last_undegraded":"2024-09-13T17:18:32.041268+0000","last_fullsized":"2024-09-13T17:18:32.041268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041006+0000","last_change":"2024-09-13T17:18:32.041006+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041006+0000","last_undegraded":"2024-09-13T17:18:32.041006+0000","last_fullsized":"2024-09-13T17:18:32.041006+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043934+0000","last_change":"2024-09-13T17:18:32.043934+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043934+0000","last_undegraded":"2024-09-13T17:18:32.043934+0000","last_fullsized":"2024-09-13T17:18:32.043934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042527+0000","last_change":"2024-09-13T17:18:32.042527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042527+0000","last_undegraded":"2024-09-13T17:18:32.042527+0000","last_fullsized":"2024-09-13T17:18:32.042527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042901+0000","last_change":"2024-09-13T17:18:32.042901+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042901+0000","last_undegraded":"2024-09-13T17:18:32.042901+0000","last_fullsized":"2024-09-13T17:18:32.042901+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042179+0000","last_change":"2024-09-13T17:18:32.042179+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042179+0000","last_undegraded":"2024-09-13T17:18:32.042179+0000","last_fullsized":"2024-09-13T17:18:32.042179+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045113+0000","last_change":"2024-09-13T17:18:32.045113+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045113+0000","last_undegraded":"2024-09-13T17:18:32.045113+0000","last_fullsized":"2024-09-13T17:18:32.045113+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041691+0000","last_change":"2024-09-13T17:18:32.041691+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041691+0000","last_undegraded":"2024-09-13T17:18:32.041691+0000","last_fullsized":"2024-09-13T17:18:32.041691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040846+0000","last_change":"2024-09-13T17:18:32.040846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040846+0000","last_undegraded":"2024-09-13T17:18:32.040846+0000","last_fullsized":"2024-09-13T17:18:32.040846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048698+0000","last_change":"2024-09-13T17:18:32.048698+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048698+0000","last_undegraded":"2024-09-13T17:18:32.048698+0000","last_fullsized":"2024-09-13T17:18:32.048698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045424+0000","last_change":"2024-09-13T17:18:32.045424+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045424+0000","last_undegraded":"2024-09-13T17:18:32.045424+0000","last_fullsized":"2024-09-13T17:18:32.045424+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041209+0000","last_change":"2024-09-13T17:18:32.041209+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041209+0000","last_undegraded":"2024-09-13T17:18:32.041209+0000","last_fullsized":"2024-09-13T17:18:32.041209+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044393+0000","last_change":"2024-09-13T17:18:32.044393+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044393+0000","last_undegraded":"2024-09-13T17:18:32.044393+0000","last_fullsized":"2024-09-13T17:18:32.044393+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039846+0000","last_change":"2024-09-13T17:18:32.039846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039846+0000","last_undegraded":"2024-09-13T17:18:32.039846+0000","last_fullsized":"2024-09-13T17:18:32.039846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041710+0000","last_change":"2024-09-13T17:18:32.041710+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041710+0000","last_undegraded":"2024-09-13T17:18:32.041710+0000","last_fullsized":"2024-09-13T17:18:32.041710+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036999+0000","last_change":"2024-09-13T17:18:32.036999+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036999+0000","last_undegraded":"2024-09-13T17:18:32.036999+0000","last_fullsized":"2024-09-13T17:18:32.036999+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043016+0000","last_change":"2024-09-13T17:18:32.043016+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043016+0000","last_undegraded":"2024-09-13T17:18:32.043016+0000","last_fullsized":"2024-09-13T17:18:32.043016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048157+0000","last_change":"2024-09-13T17:18:32.048157+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048157+0000","last_undegraded":"2024-09-13T17:18:32.048157+0000","last_fullsized":"2024-09-13T17:18:32.048157+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039890+0000","last_change":"2024-09-13T17:18:32.039890+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039890+0000","last_undegraded":"2024-09-13T17:18:32.039890+0000","last_fullsized":"2024-09-13T17:18:32.039890+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042841+0000","last_change":"2024-09-13T17:18:32.042841+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042841+0000","last_undegraded":"2024-09-13T17:18:32.042841+0000","last_fullsized":"2024-09-13T17:18:32.042841+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047688+0000","last_change":"2024-09-13T17:18:32.047688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047688+0000","last_undegraded":"2024-09-13T17:18:32.047688+0000","last_fullsized":"2024-09-13T17:18:32.047688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039023+0000","last_change":"2024-09-13T17:18:32.039023+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039023+0000","last_undegraded":"2024-09-13T17:18:32.039023+0000","last_fullsized":"2024-09-13T17:18:32.039023+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055137+0000","last_change":"2024-09-13T17:18:32.053380+0000","last_active":"2024-09-13T17:18:32.055137+0000","last_peered":"2024-09-13T17:18:32.055137+0000","last_clean":"2024-09-13T17:18:32.055137+0000","last_became_active":"2024-09-13T17:18:32.053093+0000","last_became_peered":"2024-09-13T17:18:32.053093+0000","last_unstale":"2024-09-13T17:18:32.055137+0000","last_undegraded":"2024-09-13T17:18:32.055137+0000","last_fullsized":"2024-09-13T17:18:32.055137+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:19.522901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043214+0000","last_change":"2024-09-13T17:18:32.043214+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043214+0000","last_undegraded":"2024-09-13T17:18:32.043214+0000","last_fullsized":"2024-09-13T17:18:32.043214+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048640+0000","last_change":"2024-09-13T17:18:32.046895+0000","last_active":"2024-09-13T17:18:32.048640+0000","last_peered":"2024-09-13T17:18:32.048640+0000","last_clean":"2024-09-13T17:18:32.048640+0000","last_became_active":"2024-09-13T17:18:32.046631+0000","last_became_peered":"2024-09-13T17:18:32.046631+0000","last_unstale":"2024-09-13T17:18:32.048640+0000","last_undegraded":"2024-09-13T17:18:32.048640+0000","last_fullsized":"2024-09-13T17:18:32.048640+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:50.355643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039405+0000","last_change":"2024-09-13T17:18:32.039405+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039405+0000","last_undegraded":"2024-09-13T17:18:32.039405+0000","last_fullsized":"2024-09-13T17:18:32.039405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048432+0000","last_change":"2024-09-13T17:18:32.046706+0000","last_active":"2024-09-13T17:18:32.048432+0000","last_peered":"2024-09-13T17:18:32.048432+0000","last_clean":"2024-09-13T17:18:32.048432+0000","last_became_active":"2024-09-13T17:18:32.046095+0000","last_became_peered":"2024-09-13T17:18:32.046095+0000","last_unstale":"2024-09-13T17:18:32.048432+0000","last_undegraded":"2024-09-13T17:18:32.048432+0000","last_fullsized":"2024-09-13T17:18:32.048432+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037211+0000","last_change":"2024-09-13T17:18:32.037211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037211+0000","last_undegraded":"2024-09-13T17:18:32.037211+0000","last_fullsized":"2024-09-13T17:18:32.037211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059236+0000","last_change":"2024-09-13T17:18:32.058586+0000","last_active":"2024-09-13T17:18:32.059236+0000","last_peered":"2024-09-13T17:18:32.059236+0000","last_clean":"2024-09-13T17:18:32.059236+0000","last_became_active":"2024-09-13T17:18:32.058270+0000","last_became_peered":"2024-09-13T17:18:32.058270+0000","last_unstale":"2024-09-13T17:18:32.059236+0000","last_undegraded":"2024-09-13T17:18:32.059236+0000","last_fullsized":"2024-09-13T17:18:32.059236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040619+0000","last_change":"2024-09-13T17:18:32.040619+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040619+0000","last_undegraded":"2024-09-13T17:18:32.040619+0000","last_fullsized":"2024-09-13T17:18:32.040619+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057811+0000","last_change":"2024-09-13T17:18:32.055699+0000","last_active":"2024-09-13T17:18:32.057811+0000","last_peered":"2024-09-13T17:18:32.057811+0000","last_clean":"2024-09-13T17:18:32.057811+0000","last_became_active":"2024-09-13T17:18:32.055400+0000","last_became_peered":"2024-09-13T17:18:32.055400+0000","last_unstale":"2024-09-13T17:18:32.057811+0000","last_undegraded":"2024-09-13T17:18:32.057811+0000","last_fullsized":"2024-09-13T17:18:32.057811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038949+0000","last_change":"2024-09-13T17:18:32.038949+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038949+0000","last_undegraded":"2024-09-13T17:18:32.038949+0000","last_fullsized":"2024-09-13T17:18:32.038949+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.044529+0000","last_change":"2024-09-13T17:18:32.043559+0000","last_active":"2024-09-13T17:18:32.044529+0000","last_peered":"2024-09-13T17:18:32.044529+0000","last_clean":"2024-09-13T17:18:32.044529+0000","last_became_active":"2024-09-13T17:18:32.043256+0000","last_became_peered":"2024-09-13T17:18:32.043256+0000","last_unstale":"2024-09-13T17:18:32.044529+0000","last_undegraded":"2024-09-13T17:18:32.044529+0000","last_fullsized":"2024-09-13T17:18:32.044529+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044020+0000","last_change":"2024-09-13T17:18:32.044020+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044020+0000","last_undegraded":"2024-09-13T17:18:32.044020+0000","last_fullsized":"2024-09-13T17:18:32.044020+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057566+0000","last_change":"2024-09-13T17:18:32.051660+0000","last_active":"2024-09-13T17:18:32.057566+0000","last_peered":"2024-09-13T17:18:32.057566+0000","last_clean":"2024-09-13T17:18:32.057566+0000","last_became_active":"2024-09-13T17:18:32.051389+0000","last_became_peered":"2024-09-13T17:18:32.051389+0000","last_unstale":"2024-09-13T17:18:32.057566+0000","last_undegraded":"2024-09-13T17:18:32.057566+0000","last_fullsized":"2024-09-13T17:18:32.057566+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041287+0000","last_change":"2024-09-13T17:18:32.041287+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041287+0000","last_undegraded":"2024-09-13T17:18:32.041287+0000","last_fullsized":"2024-09-13T17:18:32.041287+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057567+0000","last_change":"2024-09-13T17:18:32.056515+0000","last_active":"2024-09-13T17:18:32.057567+0000","last_peered":"2024-09-13T17:18:32.057567+0000","last_clean":"2024-09-13T17:18:32.057567+0000","last_became_active":"2024-09-13T17:18:32.056248+0000","last_became_peered":"2024-09-13T17:18:32.056248+0000","last_unstale":"2024-09-13T17:18:32.057567+0000","last_undegraded":"2024-09-13T17:18:32.057567+0000","last_fullsized":"2024-09-13T17:18:32.057567+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:56.745772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039552+0000","last_change":"2024-09-13T17:18:32.039552+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039552+0000","last_undegraded":"2024-09-13T17:18:32.039552+0000","last_fullsized":"2024-09-13T17:18:32.039552+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057613+0000","last_change":"2024-09-13T17:18:32.051852+0000","last_active":"2024-09-13T17:18:32.057613+0000","last_peered":"2024-09-13T17:18:32.057613+0000","last_clean":"2024-09-13T17:18:32.057613+0000","last_became_active":"2024-09-13T17:18:32.051491+0000","last_became_peered":"2024-09-13T17:18:32.051491+0000","last_unstale":"2024-09-13T17:18:32.057613+0000","last_undegraded":"2024-09-13T17:18:32.057613+0000","last_fullsized":"2024-09-13T17:18:32.057613+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.758976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046527+0000","last_change":"2024-09-13T17:18:32.046527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046527+0000","last_undegraded":"2024-09-13T17:18:32.046527+0000","last_fullsized":"2024-09-13T17:18:32.046527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053636+0000","last_change":"2024-09-13T17:18:32.052318+0000","last_active":"2024-09-13T17:18:32.053636+0000","last_peered":"2024-09-13T17:18:32.053636+0000","last_clean":"2024-09-13T17:18:32.053636+0000","last_became_active":"2024-09-13T17:18:32.052032+0000","last_became_peered":"2024-09-13T17:18:32.052032+0000","last_unstale":"2024-09-13T17:18:32.053636+0000","last_undegraded":"2024-09-13T17:18:32.053636+0000","last_fullsized":"2024-09-13T17:18:32.053636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:31.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043751+0000","last_change":"2024-09-13T17:18:32.043751+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043751+0000","last_undegraded":"2024-09-13T17:18:32.043751+0000","last_fullsized":"2024-09-13T17:18:32.043751+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057207+0000","last_change":"2024-09-13T17:18:32.052462+0000","last_active":"2024-09-13T17:18:32.057207+0000","last_peered":"2024-09-13T17:18:32.057207+0000","last_clean":"2024-09-13T17:18:32.057207+0000","last_became_active":"2024-09-13T17:18:32.052178+0000","last_became_peered":"2024-09-13T17:18:32.052178+0000","last_unstale":"2024-09-13T17:18:32.057207+0000","last_undegraded":"2024-09-13T17:18:32.057207+0000","last_fullsized":"2024-09-13T17:18:32.057207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047325+0000","last_change":"2024-09-13T17:18:32.047325+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047325+0000","last_undegraded":"2024-09-13T17:18:32.047325+0000","last_fullsized":"2024-09-13T17:18:32.047325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057828+0000","last_change":"2024-09-13T17:18:32.052090+0000","last_active":"2024-09-13T17:18:32.057828+0000","last_peered":"2024-09-13T17:18:32.057828+0000","last_clean":"2024-09-13T17:18:32.057828+0000","last_became_active":"2024-09-13T17:18:32.051825+0000","last_became_peered":"2024-09-13T17:18:32.051825+0000","last_unstale":"2024-09-13T17:18:32.057828+0000","last_undegraded":"2024-09-13T17:18:32.057828+0000","last_fullsized":"2024-09-13T17:18:32.057828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:03.796734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037448+0000","last_change":"2024-09-13T17:18:32.037448+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037448+0000","last_undegraded":"2024-09-13T17:18:32.037448+0000","last_fullsized":"2024-09-13T17:18:32.037448+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055849+0000","last_change":"2024-09-13T17:18:32.054701+0000","last_active":"2024-09-13T17:18:32.055849+0000","last_peered":"2024-09-13T17:18:32.055849+0000","last_clean":"2024-09-13T17:18:32.055849+0000","last_became_active":"2024-09-13T17:18:32.054402+0000","last_became_peered":"2024-09-13T17:18:32.054402+0000","last_unstale":"2024-09-13T17:18:32.055849+0000","last_undegraded":"2024-09-13T17:18:32.055849+0000","last_fullsized":"2024-09-13T17:18:32.055849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044082+0000","last_change":"2024-09-13T17:18:32.044082+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044082+0000","last_undegraded":"2024-09-13T17:18:32.044082+0000","last_fullsized":"2024-09-13T17:18:32.044082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053111+0000","last_change":"2024-09-13T17:18:32.049352+0000","last_active":"2024-09-13T17:18:32.053111+0000","last_peered":"2024-09-13T17:18:32.053111+0000","last_clean":"2024-09-13T17:18:32.053111+0000","last_became_active":"2024-09-13T17:18:32.049083+0000","last_became_peered":"2024-09-13T17:18:32.049083+0000","last_unstale":"2024-09-13T17:18:32.053111+0000","last_undegraded":"2024-09-13T17:18:32.053111+0000","last_fullsized":"2024-09-13T17:18:32.053111+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:10.146181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044211+0000","last_change":"2024-09-13T17:18:32.044211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044211+0000","last_undegraded":"2024-09-13T17:18:32.044211+0000","last_fullsized":"2024-09-13T17:18:32.044211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.056366+0000","last_change":"2024-09-13T17:18:32.055502+0000","last_active":"2024-09-13T17:18:32.056366+0000","last_peered":"2024-09-13T17:18:32.056366+0000","last_clean":"2024-09-13T17:18:32.056366+0000","last_became_active":"2024-09-13T17:18:32.055221+0000","last_became_peered":"2024-09-13T17:18:32.055221+0000","last_unstale":"2024-09-13T17:18:32.056366+0000","last_undegraded":"2024-09-13T17:18:32.056366+0000","last_fullsized":"2024-09-13T17:18:32.056366+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:47.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040235+0000","last_change":"2024-09-13T17:18:32.040235+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040235+0000","last_undegraded":"2024-09-13T17:18:32.040235+0000","last_fullsized":"2024-09-13T17:18:32.040235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051391+0000","last_change":"2024-09-13T17:18:32.049724+0000","last_active":"2024-09-13T17:18:32.051391+0000","last_peered":"2024-09-13T17:18:32.051391+0000","last_clean":"2024-09-13T17:18:32.051391+0000","last_became_active":"2024-09-13T17:18:32.048989+0000","last_became_peered":"2024-09-13T17:18:32.048989+0000","last_unstale":"2024-09-13T17:18:32.051391+0000","last_undegraded":"2024-09-13T17:18:32.051391+0000","last_fullsized":"2024-09-13T17:18:32.051391+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.692313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044695+0000","last_change":"2024-09-13T17:18:32.044695+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044695+0000","last_undegraded":"2024-09-13T17:18:32.044695+0000","last_fullsized":"2024-09-13T17:18:32.044695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055101+0000","last_change":"2024-09-13T17:18:32.047867+0000","last_active":"2024-09-13T17:18:32.055101+0000","last_peered":"2024-09-13T17:18:32.055101+0000","last_clean":"2024-09-13T17:18:32.055101+0000","last_became_active":"2024-09-13T17:18:32.047515+0000","last_became_peered":"2024-09-13T17:18:32.047515+0000","last_unstale":"2024-09-13T17:18:32.055101+0000","last_undegraded":"2024-09-13T17:18:32.055101+0000","last_fullsized":"2024-09-13T17:18:32.055101+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044878+0000","last_change":"2024-09-13T17:18:32.044878+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044878+0000","last_undegraded":"2024-09-13T17:18:32.044878+0000","last_fullsized":"2024-09-13T17:18:32.044878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057271+0000","last_change":"2024-09-13T17:18:32.053603+0000","last_active":"2024-09-13T17:18:32.057271+0000","last_peered":"2024-09-13T17:18:32.057271+0000","last_clean":"2024-09-13T17:18:32.057271+0000","last_became_active":"2024-09-13T17:18:32.053322+0000","last_became_peered":"2024-09-13T17:18:32.053322+0000","last_unstale":"2024-09-13T17:18:32.057271+0000","last_undegraded":"2024-09-13T17:18:32.057271+0000","last_fullsized":"2024-09-13T17:18:32.057271+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047763+0000","last_change":"2024-09-13T17:18:32.047763+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047763+0000","last_undegraded":"2024-09-13T17:18:32.047763+0000","last_fullsized":"2024-09-13T17:18:32.047763+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.050959+0000","last_change":"2024-09-13T17:18:32.049980+0000","last_active":"2024-09-13T17:18:32.050959+0000","last_peered":"2024-09-13T17:18:32.050959+0000","last_clean":"2024-09-13T17:18:32.050959+0000","last_became_active":"2024-09-13T17:18:32.049675+0000","last_became_peered":"2024-09-13T17:18:32.049675+0000","last_unstale":"2024-09-13T17:18:32.050959+0000","last_undegraded":"2024-09-13T17:18:32.050959+0000","last_fullsized":"2024-09-13T17:18:32.050959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040144+0000","last_change":"2024-09-13T17:18:32.040144+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040144+0000","last_undegraded":"2024-09-13T17:18:32.040144+0000","last_fullsized":"2024-09-13T17:18:32.040144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.052474+0000","last_change":"2024-09-13T17:18:32.051684+0000","last_active":"2024-09-13T17:18:32.052474+0000","last_peered":"2024-09-13T17:18:32.052474+0000","last_clean":"2024-09-13T17:18:32.052474+0000","last_became_active":"2024-09-13T17:18:32.051408+0000","last_became_peered":"2024-09-13T17:18:32.051408+0000","last_unstale":"2024-09-13T17:18:32.052474+0000","last_undegraded":"2024-09-13T17:18:32.052474+0000","last_fullsized":"2024-09-13T17:18:32.052474+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:24.762568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040723+0000","last_change":"2024-09-13T17:18:32.040723+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040723+0000","last_undegraded":"2024-09-13T17:18:32.040723+0000","last_fullsized":"2024-09-13T17:18:32.040723+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048678+0000","last_change":"2024-09-13T17:18:32.045340+0000","last_active":"2024-09-13T17:18:32.048678+0000","last_peered":"2024-09-13T17:18:32.048678+0000","last_clean":"2024-09-13T17:18:32.048678+0000","last_became_active":"2024-09-13T17:18:32.045082+0000","last_became_peered":"2024-09-13T17:18:32.045082+0000","last_unstale":"2024-09-13T17:18:32.048678+0000","last_undegraded":"2024-09-13T17:18:32.048678+0000","last_fullsized":"2024-09-13T17:18:32.048678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.968862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040860+0000","last_change":"2024-09-13T17:18:32.040860+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040860+0000","last_undegraded":"2024-09-13T17:18:32.040860+0000","last_fullsized":"2024-09-13T17:18:32.040860+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.058085+0000","last_change":"2024-09-13T17:18:32.055416+0000","last_active":"2024-09-13T17:18:32.058085+0000","last_peered":"2024-09-13T17:18:32.058085+0000","last_clean":"2024-09-13T17:18:32.058085+0000","last_became_active":"2024-09-13T17:18:32.055170+0000","last_became_peered":"2024-09-13T17:18:32.055170+0000","last_unstale":"2024-09-13T17:18:32.058085+0000","last_undegraded":"2024-09-13T17:18:32.058085+0000","last_fullsized":"2024-09-13T17:18:32.058085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046923+0000","last_change":"2024-09-13T17:18:32.046923+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046923+0000","last_undegraded":"2024-09-13T17:18:32.046923+0000","last_fullsized":"2024-09-13T17:18:32.046923+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049505+0000","last_change":"2024-09-13T17:18:32.048620+0000","last_active":"2024-09-13T17:18:32.049505+0000","last_peered":"2024-09-13T17:18:32.049505+0000","last_clean":"2024-09-13T17:18:32.049505+0000","last_became_active":"2024-09-13T17:18:32.048322+0000","last_became_peered":"2024-09-13T17:18:32.048322+0000","last_unstale":"2024-09-13T17:18:32.049505+0000","last_undegraded":"2024-09-13T17:18:32.049505+0000","last_fullsized":"2024-09-13T17:18:32.049505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.661885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041509+0000","last_change":"2024-09-13T17:18:32.041509+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041509+0000","last_undegraded":"2024-09-13T17:18:32.041509+0000","last_fullsized":"2024-09-13T17:18:32.041509+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055304+0000","last_change":"2024-09-13T17:18:32.054556+0000","last_active":"2024-09-13T17:18:32.055304+0000","last_peered":"2024-09-13T17:18:32.055304+0000","last_clean":"2024-09-13T17:18:32.055304+0000","last_became_active":"2024-09-13T17:18:32.054202+0000","last_became_peered":"2024-09-13T17:18:32.054202+0000","last_unstale":"2024-09-13T17:18:32.055304+0000","last_undegraded":"2024-09-13T17:18:32.055304+0000","last_fullsized":"2024-09-13T17:18:32.055304+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039865+0000","last_change":"2024-09-13T17:18:32.039865+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039865+0000","last_undegraded":"2024-09-13T17:18:32.039865+0000","last_fullsized":"2024-09-13T17:18:32.039865+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049468+0000","last_change":"2024-09-13T17:18:32.044430+0000","last_active":"2024-09-13T17:18:32.049468+0000","last_peered":"2024-09-13T17:18:32.049468+0000","last_clean":"2024-09-13T17:18:32.049468+0000","last_became_active":"2024-09-13T17:18:32.044134+0000","last_became_peered":"2024-09-13T17:18:32.044134+0000","last_unstale":"2024-09-13T17:18:32.049468+0000","last_undegraded":"2024-09-13T17:18:32.049468+0000","last_fullsized":"2024-09-13T17:18:32.049468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:10.753053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040487+0000","last_change":"2024-09-13T17:18:32.040487+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040487+0000","last_undegraded":"2024-09-13T17:18:32.040487+0000","last_fullsized":"2024-09-13T17:18:32.040487+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057520+0000","last_change":"2024-09-13T17:18:32.053192+0000","last_active":"2024-09-13T17:18:32.057520+0000","last_peered":"2024-09-13T17:18:32.057520+0000","last_clean":"2024-09-13T17:18:32.057520+0000","last_became_active":"2024-09-13T17:18:32.052993+0000","last_became_peered":"2024-09-13T17:18:32.052993+0000","last_unstale":"2024-09-13T17:18:32.057520+0000","last_undegraded":"2024-09-13T17:18:32.057520+0000","last_fullsized":"2024-09-13T17:18:32.057520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038221+0000","last_change":"2024-09-13T17:18:32.038221+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038221+0000","last_undegraded":"2024-09-13T17:18:32.038221+0000","last_fullsized":"2024-09-13T17:18:32.038221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059254+0000","last_change":"2024-09-13T17:18:32.058647+0000","last_active":"2024-09-13T17:18:32.059254+0000","last_peered":"2024-09-13T17:18:32.059254+0000","last_clean":"2024-09-13T17:18:32.059254+0000","last_became_active":"2024-09-13T17:18:32.058335+0000","last_became_peered":"2024-09-13T17:18:32.058335+0000","last_unstale":"2024-09-13T17:18:32.059254+0000","last_undegraded":"2024-09-13T17:18:32.059254+0000","last_fullsized":"2024-09-13T17:18:32.059254+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:52.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046286+0000","last_change":"2024-09-13T17:18:32.046286+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046286+0000","last_undegraded":"2024-09-13T17:18:32.046286+0000","last_fullsized":"2024-09-13T17:18:32.046286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051328+0000","last_change":"2024-09-13T17:18:32.049134+0000","last_active":"2024-09-13T17:18:32.051328+0000","last_peered":"2024-09-13T17:18:32.051328+0000","last_clean":"2024-09-13T17:18:32.051328+0000","last_became_active":"2024-09-13T17:18:32.048872+0000","last_became_peered":"2024-09-13T17:18:32.048872+0000","last_unstale":"2024-09-13T17:18:32.051328+0000","last_undegraded":"2024-09-13T17:18:32.051328+0000","last_fullsized":"2024-09-13T17:18:32.051328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:12.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047194+0000","last_change":"2024-09-13T17:18:32.047194+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047194+0000","last_undegraded":"2024-09-13T17:18:32.047194+0000","last_fullsized":"2024-09-13T17:18:32.047194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059186+0000","last_change":"2024-09-13T17:18:32.058217+0000","last_active":"2024-09-13T17:18:32.059186+0000","last_peered":"2024-09-13T17:18:32.059186+0000","last_clean":"2024-09-13T17:18:32.059186+0000","last_became_active":"2024-09-13T17:18:32.057860+0000","last_became_peered":"2024-09-13T17:18:32.057860+0000","last_unstale":"2024-09-13T17:18:32.059186+0000","last_undegraded":"2024-09-13T17:18:32.059186+0000","last_fullsized":"2024-09-13T17:18:32.059186+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:44.171955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043425+0000","last_change":"2024-09-13T17:18:32.043425+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043425+0000","last_undegraded":"2024-09-13T17:18:32.043425+0000","last_fullsized":"2024-09-13T17:18:32.043425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055334+0000","last_change":"2024-09-13T17:18:32.050290+0000","last_active":"2024-09-13T17:18:32.055334+0000","last_peered":"2024-09-13T17:18:32.055334+0000","last_clean":"2024-09-13T17:18:32.055334+0000","last_became_active":"2024-09-13T17:18:32.050038+0000","last_became_peered":"2024-09-13T17:18:32.050038+0000","last_unstale":"2024-09-13T17:18:32.055334+0000","last_undegraded":"2024-09-13T17:18:32.055334+0000","last_fullsized":"2024-09-13T17:18:32.055334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038329+0000","last_change":"2024-09-13T17:18:32.038329+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038329+0000","last_undegraded":"2024-09-13T17:18:32.038329+0000","last_fullsized":"2024-09-13T17:18:32.038329+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059156+0000","last_change":"2024-09-13T17:18:32.058246+0000","last_active":"2024-09-13T17:18:32.059156+0000","last_peered":"2024-09-13T17:18:32.059156+0000","last_clean":"2024-09-13T17:18:32.059156+0000","last_became_active":"2024-09-13T17:18:32.057888+0000","last_became_peered":"2024-09-13T17:18:32.057888+0000","last_unstale":"2024-09-13T17:18:32.059156+0000","last_undegraded":"2024-09-13T17:18:32.059156+0000","last_fullsized":"2024-09-13T17:18:32.059156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:37.515238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036938+0000","last_change":"2024-09-13T17:18:32.036938+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036938+0000","last_undegraded":"2024-09-13T17:18:32.036938+0000","last_fullsized":"2024-09-13T17:18:32.036938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049480+0000","last_change":"2024-09-13T17:18:32.047953+0000","last_active":"2024-09-13T17:18:32.049480+0000","last_peered":"2024-09-13T17:18:32.049480+0000","last_clean":"2024-09-13T17:18:32.049480+0000","last_became_active":"2024-09-13T17:18:32.047691+0000","last_became_peered":"2024-09-13T17:18:32.047691+0000","last_unstale":"2024-09-13T17:18:32.049480+0000","last_undegraded":"2024-09-13T17:18:32.049480+0000","last_fullsized":"2024-09-13T17:18:32.049480+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:05.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-13T17:18:31.041688+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:18:31.041688+0000","last_peered":"2024-09-13T17:18:31.041688+0000","last_clean":"2024-09-13T17:18:31.041688+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:18:31.041688+0000","last_undegraded":"2024-09-13T17:18:31.041688+0000","last_fullsized":"2024-09-13T17:18:31.041688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1896448,"data_stored":1183382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70799999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":1.165,"15min":1.165},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":1.216,"15min":1.216},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76800000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":1.234,"15min":1.234},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.878,"15min":0.878},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67800000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69299999999999995,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70099999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.66600000000000004,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.378},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73799999999999999,"5min":1.173,"15min":1.173},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":1.008,"15min":1.008},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":1.085,"15min":1.085},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.47699999999999998},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.50700000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":1.034,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72699999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.622},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33300000000000002,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63400000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.245,"5min":0.214,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":1.458,"15min":1.458},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.23699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.437}]},{"osd":5,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88100000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.81000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":1.226,"15min":1.226},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32600000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.42499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.51000000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35799999999999998,"15min":0.36599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39900000000000002,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53100000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":0.871,"15min":0.871},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.39400000000000002},"min":{"1min":0.252,"5min":0.223,"15min":0.223},"max":{"1min":0.56999999999999995,"5min":1.159,"15min":1.159},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.40500000000000003},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50800000000000001,"5min":1.081,"15min":1.081},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.45500000000000002,"5min":1.286,"15min":1.286},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.752,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73099999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.254,"15min":1.254},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1884160,"data_stored":1176787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54800000000000004,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.501,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61499999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.51600000000000001,"15min":0.433},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":14.262,"15min":14.262},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.33900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58999999999999997,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.98499999999999999,"5min":3.956,"15min":3.956},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":0.998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":4.069,"15min":4.069},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.026,"5min":4.04,"15min":4.04},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93500000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:35.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.864+0000 7f44e7345640 1 Processor -- start 2024-09-13T17:18:35.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.864+0000 7f44e7345640 1 -- start start 2024-09-13T17:18:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e015c680 0x7f44e00b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44e00ae270 0x7f44e00ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44e00cd140 0x7f44e00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e0071a80 con 0x7f44e00cd140 2024-09-13T17:18:35.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00ac5f0 con 0x7f44e00ae270 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e7345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00714c0 con 0x7f44e015c680 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44e00cd140 0x7f44e00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44e00cd140 0x7f44e00ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59678/0 (socket says 172.21.15.5:59678) 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 -- 172.21.15.5:0/3641639036 learned_addr learned my addr 172.21.15.5:0/3641639036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e48e0640 1 --2- 172.21.15.5:0/3641639036 >> v2:172.21.15.179:3300/0 conn(0x7f44e00ae270 0x7f44e00ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e50e1640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e015c680 0x7f44e00b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 -- 172.21.15.5:0/3641639036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e015c680 msgr2=0x7f44e00b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e015c680 0x7f44e00b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 -- 172.21.15.5:0/3641639036 >> v2:172.21.15.179:3300/0 conn(0x7f44e00ae270 msgr2=0x7f44e00ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 --2- 172.21.15.5:0/3641639036 >> v2:172.21.15.179:3300/0 conn(0x7f44e00ae270 0x7f44e00ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.865+0000 7f44e58e2640 1 -- 172.21.15.5:0/3641639036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e00717a0 con 0x7f44e00cd140 2024-09-13T17:18:35.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.866+0000 7f44e58e2640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e00ad090 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f44e009cf00 tx=0x7f44d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e2b3055524eec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.866+0000 7f44d3fff640 1 -- 172.21.15.5:0/3641639036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8031600 con 0x7f44e00cd140 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.866+0000 7f44d3fff640 1 -- 172.21.15.5:0/3641639036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d802d050 con 0x7f44e00cd140 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.866+0000 7f44d3fff640 1 -- 172.21.15.5:0/3641639036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8031980 con 0x7f44e00cd140 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 -- 172.21.15.5:0/3641639036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 msgr2=0x7f44e00ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e00ad090 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f44e009cf00 tx=0x7f44d802a6a0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 -- 172.21.15.5:0/3641639036 shutdown_connections 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e00ad090 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 --2- 172.21.15.5:0/3641639036 >> v2:172.21.15.179:3300/0 conn(0x7f44e00ae270 0x7f44e00ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 --2- 172.21.15.5:0/3641639036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e015c680 0x7f44e00b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 -- 172.21.15.5:0/3641639036 >> 172.21.15.5:0/3641639036 conn(0x7f44e00cc610 msgr2=0x7f44e0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 -- 172.21.15.5:0/3641639036 shutdown_connections 2024-09-13T17:18:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.867+0000 7f44e7345640 1 -- 172.21.15.5:0/3641639036 wait complete. 2024-09-13T17:18:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.868+0000 7f44e7345640 1 Processor -- start 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.868+0000 7f44e7345640 1 -- start start 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e00ae270 0x7f44e015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e015c680 0x7f44e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01564a0 con 0x7f44e00cd140 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0151700 con 0x7f44e015c680 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e7345640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0152d30 con 0x7f44e00ae270 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59688/0 (socket says 172.21.15.5:59688) 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 -- 172.21.15.5:0/53912698 learned_addr learned my addr 172.21.15.5:0/53912698 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e50e1640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e00ae270 0x7f44e015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e58e2640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e015c680 0x7f44e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 -- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e00ae270 msgr2=0x7f44e015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e00ae270 0x7f44e015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 -- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e015c680 msgr2=0x7f44e0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e015c680 0x7f44e0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 -- 172.21.15.5:0/53912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d8009b30 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44e48e0640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d800 tx=0x7f44d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40096a0 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.869+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4009800 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.870+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e0153010 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.870+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4009b90 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.870+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e01535d0 con 0x7f44e00cd140 2024-09-13T17:18:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.871+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00ccc00 con 0x7f44e00cd140 2024-09-13T17:18:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.871+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44d4009cf0 con 0x7f44e00cd140 2024-09-13T17:18:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.872+0000 7f44d1ffb640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 0x7f44c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.872+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44d4089970 con 0x7f44e00cd140 2024-09-13T17:18:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.872+0000 7f44e50e1640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 0x7f44c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.872+0000 7f44e50e1640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 0x7f44c406d110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0079a0 tx=0x7f44dc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:35.876+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f44d4054ba0 con 0x7f44e00cd140 2024-09-13T17:18:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.043+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44e00b22f0 con 0x7f44c406ac50 2024-09-13T17:18:36.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.051+0000 7f44d1ffb640 1 -- 172.21.15.5:0/53912698 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286996 (secure 0 0 0) 0x7f44dc0108d0 con 0x7f44c406ac50 2024-09-13T17:18:36.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:36.057 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 msgr2=0x7f44c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 0x7f44c406d110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0079a0 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 msgr2=0x7f44e0155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d800 tx=0x7f44d400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 shutdown_connections 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e015c680 0x7f44e0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f44c406ac50 0x7f44c406d110 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44e00cd140 0x7f44e0155f60 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 --2- 172.21.15.5:0/53912698 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44e00ae270 0x7f44e015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 >> 172.21.15.5:0/53912698 conn(0x7f44e00cc610 msgr2=0x7f44e006b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:36.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 shutdown_connections 2024-09-13T17:18:36.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.054+0000 7f44e7345640 1 -- 172.21.15.5:0/53912698 wait complete. 2024-09-13T17:18:36.067 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-13T17:18:35.333915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252004,"kb_used_data":11252,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754722716,"statfs":{"total":773094113280,"available":772836061184,"internally_reserved":0,"allocated":11522048,"data_stored":5878683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301395"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043061+0000","last_change":"2024-09-13T17:18:32.043061+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043061+0000","last_undegraded":"2024-09-13T17:18:32.043061+0000","last_fullsized":"2024-09-13T17:18:32.043061+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046688+0000","last_change":"2024-09-13T17:18:32.046688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046688+0000","last_undegraded":"2024-09-13T17:18:32.046688+0000","last_fullsized":"2024-09-13T17:18:32.046688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042635+0000","last_change":"2024-09-13T17:18:32.042635+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042635+0000","last_undegraded":"2024-09-13T17:18:32.042635+0000","last_fullsized":"2024-09-13T17:18:32.042635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041129+0000","last_change":"2024-09-13T17:18:32.041129+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041129+0000","last_undegraded":"2024-09-13T17:18:32.041129+0000","last_fullsized":"2024-09-13T17:18:32.041129+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048167+0000","last_change":"2024-09-13T17:18:32.048167+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048167+0000","last_undegraded":"2024-09-13T17:18:32.048167+0000","last_fullsized":"2024-09-13T17:18:32.048167+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046342+0000","last_change":"2024-09-13T17:18:32.046342+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046342+0000","last_undegraded":"2024-09-13T17:18:32.046342+0000","last_fullsized":"2024-09-13T17:18:32.046342+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043353+0000","last_change":"2024-09-13T17:18:32.043353+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043353+0000","last_undegraded":"2024-09-13T17:18:32.043353+0000","last_fullsized":"2024-09-13T17:18:32.043353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.049247+0000","last_change":"2024-09-13T17:18:32.049247+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.049247+0000","last_undegraded":"2024-09-13T17:18:32.049247+0000","last_fullsized":"2024-09-13T17:18:32.049247+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044253+0000","last_change":"2024-09-13T17:18:32.044253+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044253+0000","last_undegraded":"2024-09-13T17:18:32.044253+0000","last_fullsized":"2024-09-13T17:18:32.044253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045481+0000","last_change":"2024-09-13T17:18:32.045481+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045481+0000","last_undegraded":"2024-09-13T17:18:32.045481+0000","last_fullsized":"2024-09-13T17:18:32.045481+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037743+0000","last_change":"2024-09-13T17:18:32.037743+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037743+0000","last_undegraded":"2024-09-13T17:18:32.037743+0000","last_fullsized":"2024-09-13T17:18:32.037743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041268+0000","last_change":"2024-09-13T17:18:32.041268+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041268+0000","last_undegraded":"2024-09-13T17:18:32.041268+0000","last_fullsized":"2024-09-13T17:18:32.041268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041006+0000","last_change":"2024-09-13T17:18:32.041006+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041006+0000","last_undegraded":"2024-09-13T17:18:32.041006+0000","last_fullsized":"2024-09-13T17:18:32.041006+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043934+0000","last_change":"2024-09-13T17:18:32.043934+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043934+0000","last_undegraded":"2024-09-13T17:18:32.043934+0000","last_fullsized":"2024-09-13T17:18:32.043934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042527+0000","last_change":"2024-09-13T17:18:32.042527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042527+0000","last_undegraded":"2024-09-13T17:18:32.042527+0000","last_fullsized":"2024-09-13T17:18:32.042527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042901+0000","last_change":"2024-09-13T17:18:32.042901+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042901+0000","last_undegraded":"2024-09-13T17:18:32.042901+0000","last_fullsized":"2024-09-13T17:18:32.042901+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042179+0000","last_change":"2024-09-13T17:18:32.042179+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042179+0000","last_undegraded":"2024-09-13T17:18:32.042179+0000","last_fullsized":"2024-09-13T17:18:32.042179+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045113+0000","last_change":"2024-09-13T17:18:32.045113+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045113+0000","last_undegraded":"2024-09-13T17:18:32.045113+0000","last_fullsized":"2024-09-13T17:18:32.045113+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041691+0000","last_change":"2024-09-13T17:18:32.041691+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041691+0000","last_undegraded":"2024-09-13T17:18:32.041691+0000","last_fullsized":"2024-09-13T17:18:32.041691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040846+0000","last_change":"2024-09-13T17:18:32.040846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040846+0000","last_undegraded":"2024-09-13T17:18:32.040846+0000","last_fullsized":"2024-09-13T17:18:32.040846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048698+0000","last_change":"2024-09-13T17:18:32.048698+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048698+0000","last_undegraded":"2024-09-13T17:18:32.048698+0000","last_fullsized":"2024-09-13T17:18:32.048698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045424+0000","last_change":"2024-09-13T17:18:32.045424+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045424+0000","last_undegraded":"2024-09-13T17:18:32.045424+0000","last_fullsized":"2024-09-13T17:18:32.045424+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041209+0000","last_change":"2024-09-13T17:18:32.041209+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041209+0000","last_undegraded":"2024-09-13T17:18:32.041209+0000","last_fullsized":"2024-09-13T17:18:32.041209+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044393+0000","last_change":"2024-09-13T17:18:32.044393+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044393+0000","last_undegraded":"2024-09-13T17:18:32.044393+0000","last_fullsized":"2024-09-13T17:18:32.044393+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039846+0000","last_change":"2024-09-13T17:18:32.039846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039846+0000","last_undegraded":"2024-09-13T17:18:32.039846+0000","last_fullsized":"2024-09-13T17:18:32.039846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041710+0000","last_change":"2024-09-13T17:18:32.041710+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041710+0000","last_undegraded":"2024-09-13T17:18:32.041710+0000","last_fullsized":"2024-09-13T17:18:32.041710+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036999+0000","last_change":"2024-09-13T17:18:32.036999+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036999+0000","last_undegraded":"2024-09-13T17:18:32.036999+0000","last_fullsized":"2024-09-13T17:18:32.036999+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043016+0000","last_change":"2024-09-13T17:18:32.043016+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043016+0000","last_undegraded":"2024-09-13T17:18:32.043016+0000","last_fullsized":"2024-09-13T17:18:32.043016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048157+0000","last_change":"2024-09-13T17:18:32.048157+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048157+0000","last_undegraded":"2024-09-13T17:18:32.048157+0000","last_fullsized":"2024-09-13T17:18:32.048157+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039890+0000","last_change":"2024-09-13T17:18:32.039890+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039890+0000","last_undegraded":"2024-09-13T17:18:32.039890+0000","last_fullsized":"2024-09-13T17:18:32.039890+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042841+0000","last_change":"2024-09-13T17:18:32.042841+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042841+0000","last_undegraded":"2024-09-13T17:18:32.042841+0000","last_fullsized":"2024-09-13T17:18:32.042841+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047688+0000","last_change":"2024-09-13T17:18:32.047688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047688+0000","last_undegraded":"2024-09-13T17:18:32.047688+0000","last_fullsized":"2024-09-13T17:18:32.047688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039023+0000","last_change":"2024-09-13T17:18:32.039023+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039023+0000","last_undegraded":"2024-09-13T17:18:32.039023+0000","last_fullsized":"2024-09-13T17:18:32.039023+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055137+0000","last_change":"2024-09-13T17:18:32.053380+0000","last_active":"2024-09-13T17:18:32.055137+0000","last_peered":"2024-09-13T17:18:32.055137+0000","last_clean":"2024-09-13T17:18:32.055137+0000","last_became_active":"2024-09-13T17:18:32.053093+0000","last_became_peered":"2024-09-13T17:18:32.053093+0000","last_unstale":"2024-09-13T17:18:32.055137+0000","last_undegraded":"2024-09-13T17:18:32.055137+0000","last_fullsized":"2024-09-13T17:18:32.055137+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:19.522901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043214+0000","last_change":"2024-09-13T17:18:32.043214+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043214+0000","last_undegraded":"2024-09-13T17:18:32.043214+0000","last_fullsized":"2024-09-13T17:18:32.043214+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048640+0000","last_change":"2024-09-13T17:18:32.046895+0000","last_active":"2024-09-13T17:18:32.048640+0000","last_peered":"2024-09-13T17:18:32.048640+0000","last_clean":"2024-09-13T17:18:32.048640+0000","last_became_active":"2024-09-13T17:18:32.046631+0000","last_became_peered":"2024-09-13T17:18:32.046631+0000","last_unstale":"2024-09-13T17:18:32.048640+0000","last_undegraded":"2024-09-13T17:18:32.048640+0000","last_fullsized":"2024-09-13T17:18:32.048640+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:50.355643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039405+0000","last_change":"2024-09-13T17:18:32.039405+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039405+0000","last_undegraded":"2024-09-13T17:18:32.039405+0000","last_fullsized":"2024-09-13T17:18:32.039405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048432+0000","last_change":"2024-09-13T17:18:32.046706+0000","last_active":"2024-09-13T17:18:32.048432+0000","last_peered":"2024-09-13T17:18:32.048432+0000","last_clean":"2024-09-13T17:18:32.048432+0000","last_became_active":"2024-09-13T17:18:32.046095+0000","last_became_peered":"2024-09-13T17:18:32.046095+0000","last_unstale":"2024-09-13T17:18:32.048432+0000","last_undegraded":"2024-09-13T17:18:32.048432+0000","last_fullsized":"2024-09-13T17:18:32.048432+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037211+0000","last_change":"2024-09-13T17:18:32.037211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037211+0000","last_undegraded":"2024-09-13T17:18:32.037211+0000","last_fullsized":"2024-09-13T17:18:32.037211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059236+0000","last_change":"2024-09-13T17:18:32.058586+0000","last_active":"2024-09-13T17:18:32.059236+0000","last_peered":"2024-09-13T17:18:32.059236+0000","last_clean":"2024-09-13T17:18:32.059236+0000","last_became_active":"2024-09-13T17:18:32.058270+0000","last_became_peered":"2024-09-13T17:18:32.058270+0000","last_unstale":"2024-09-13T17:18:32.059236+0000","last_undegraded":"2024-09-13T17:18:32.059236+0000","last_fullsized":"2024-09-13T17:18:32.059236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040619+0000","last_change":"2024-09-13T17:18:32.040619+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040619+0000","last_undegraded":"2024-09-13T17:18:32.040619+0000","last_fullsized":"2024-09-13T17:18:32.040619+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057811+0000","last_change":"2024-09-13T17:18:32.055699+0000","last_active":"2024-09-13T17:18:32.057811+0000","last_peered":"2024-09-13T17:18:32.057811+0000","last_clean":"2024-09-13T17:18:32.057811+0000","last_became_active":"2024-09-13T17:18:32.055400+0000","last_became_peered":"2024-09-13T17:18:32.055400+0000","last_unstale":"2024-09-13T17:18:32.057811+0000","last_undegraded":"2024-09-13T17:18:32.057811+0000","last_fullsized":"2024-09-13T17:18:32.057811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038949+0000","last_change":"2024-09-13T17:18:32.038949+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038949+0000","last_undegraded":"2024-09-13T17:18:32.038949+0000","last_fullsized":"2024-09-13T17:18:32.038949+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.044529+0000","last_change":"2024-09-13T17:18:32.043559+0000","last_active":"2024-09-13T17:18:32.044529+0000","last_peered":"2024-09-13T17:18:32.044529+0000","last_clean":"2024-09-13T17:18:32.044529+0000","last_became_active":"2024-09-13T17:18:32.043256+0000","last_became_peered":"2024-09-13T17:18:32.043256+0000","last_unstale":"2024-09-13T17:18:32.044529+0000","last_undegraded":"2024-09-13T17:18:32.044529+0000","last_fullsized":"2024-09-13T17:18:32.044529+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044020+0000","last_change":"2024-09-13T17:18:32.044020+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044020+0000","last_undegraded":"2024-09-13T17:18:32.044020+0000","last_fullsized":"2024-09-13T17:18:32.044020+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057566+0000","last_change":"2024-09-13T17:18:32.051660+0000","last_active":"2024-09-13T17:18:32.057566+0000","last_peered":"2024-09-13T17:18:32.057566+0000","last_clean":"2024-09-13T17:18:32.057566+0000","last_became_active":"2024-09-13T17:18:32.051389+0000","last_became_peered":"2024-09-13T17:18:32.051389+0000","last_unstale":"2024-09-13T17:18:32.057566+0000","last_undegraded":"2024-09-13T17:18:32.057566+0000","last_fullsized":"2024-09-13T17:18:32.057566+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041287+0000","last_change":"2024-09-13T17:18:32.041287+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041287+0000","last_undegraded":"2024-09-13T17:18:32.041287+0000","last_fullsized":"2024-09-13T17:18:32.041287+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057567+0000","last_change":"2024-09-13T17:18:32.056515+0000","last_active":"2024-09-13T17:18:32.057567+0000","last_peered":"2024-09-13T17:18:32.057567+0000","last_clean":"2024-09-13T17:18:32.057567+0000","last_became_active":"2024-09-13T17:18:32.056248+0000","last_became_peered":"2024-09-13T17:18:32.056248+0000","last_unstale":"2024-09-13T17:18:32.057567+0000","last_undegraded":"2024-09-13T17:18:32.057567+0000","last_fullsized":"2024-09-13T17:18:32.057567+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:56.745772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039552+0000","last_change":"2024-09-13T17:18:32.039552+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039552+0000","last_undegraded":"2024-09-13T17:18:32.039552+0000","last_fullsized":"2024-09-13T17:18:32.039552+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057613+0000","last_change":"2024-09-13T17:18:32.051852+0000","last_active":"2024-09-13T17:18:32.057613+0000","last_peered":"2024-09-13T17:18:32.057613+0000","last_clean":"2024-09-13T17:18:32.057613+0000","last_became_active":"2024-09-13T17:18:32.051491+0000","last_became_peered":"2024-09-13T17:18:32.051491+0000","last_unstale":"2024-09-13T17:18:32.057613+0000","last_undegraded":"2024-09-13T17:18:32.057613+0000","last_fullsized":"2024-09-13T17:18:32.057613+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.758976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046527+0000","last_change":"2024-09-13T17:18:32.046527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046527+0000","last_undegraded":"2024-09-13T17:18:32.046527+0000","last_fullsized":"2024-09-13T17:18:32.046527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053636+0000","last_change":"2024-09-13T17:18:32.052318+0000","last_active":"2024-09-13T17:18:32.053636+0000","last_peered":"2024-09-13T17:18:32.053636+0000","last_clean":"2024-09-13T17:18:32.053636+0000","last_became_active":"2024-09-13T17:18:32.052032+0000","last_became_peered":"2024-09-13T17:18:32.052032+0000","last_unstale":"2024-09-13T17:18:32.053636+0000","last_undegraded":"2024-09-13T17:18:32.053636+0000","last_fullsized":"2024-09-13T17:18:32.053636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:31.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043751+0000","last_change":"2024-09-13T17:18:32.043751+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043751+0000","last_undegraded":"2024-09-13T17:18:32.043751+0000","last_fullsized":"2024-09-13T17:18:32.043751+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057207+0000","last_change":"2024-09-13T17:18:32.052462+0000","last_active":"2024-09-13T17:18:32.057207+0000","last_peered":"2024-09-13T17:18:32.057207+0000","last_clean":"2024-09-13T17:18:32.057207+0000","last_became_active":"2024-09-13T17:18:32.052178+0000","last_became_peered":"2024-09-13T17:18:32.052178+0000","last_unstale":"2024-09-13T17:18:32.057207+0000","last_undegraded":"2024-09-13T17:18:32.057207+0000","last_fullsized":"2024-09-13T17:18:32.057207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047325+0000","last_change":"2024-09-13T17:18:32.047325+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047325+0000","last_undegraded":"2024-09-13T17:18:32.047325+0000","last_fullsized":"2024-09-13T17:18:32.047325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057828+0000","last_change":"2024-09-13T17:18:32.052090+0000","last_active":"2024-09-13T17:18:32.057828+0000","last_peered":"2024-09-13T17:18:32.057828+0000","last_clean":"2024-09-13T17:18:32.057828+0000","last_became_active":"2024-09-13T17:18:32.051825+0000","last_became_peered":"2024-09-13T17:18:32.051825+0000","last_unstale":"2024-09-13T17:18:32.057828+0000","last_undegraded":"2024-09-13T17:18:32.057828+0000","last_fullsized":"2024-09-13T17:18:32.057828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:03.796734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037448+0000","last_change":"2024-09-13T17:18:32.037448+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037448+0000","last_undegraded":"2024-09-13T17:18:32.037448+0000","last_fullsized":"2024-09-13T17:18:32.037448+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055849+0000","last_change":"2024-09-13T17:18:32.054701+0000","last_active":"2024-09-13T17:18:32.055849+0000","last_peered":"2024-09-13T17:18:32.055849+0000","last_clean":"2024-09-13T17:18:32.055849+0000","last_became_active":"2024-09-13T17:18:32.054402+0000","last_became_peered":"2024-09-13T17:18:32.054402+0000","last_unstale":"2024-09-13T17:18:32.055849+0000","last_undegraded":"2024-09-13T17:18:32.055849+0000","last_fullsized":"2024-09-13T17:18:32.055849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044082+0000","last_change":"2024-09-13T17:18:32.044082+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044082+0000","last_undegraded":"2024-09-13T17:18:32.044082+0000","last_fullsized":"2024-09-13T17:18:32.044082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053111+0000","last_change":"2024-09-13T17:18:32.049352+0000","last_active":"2024-09-13T17:18:32.053111+0000","last_peered":"2024-09-13T17:18:32.053111+0000","last_clean":"2024-09-13T17:18:32.053111+0000","last_became_active":"2024-09-13T17:18:32.049083+0000","last_became_peered":"2024-09-13T17:18:32.049083+0000","last_unstale":"2024-09-13T17:18:32.053111+0000","last_undegraded":"2024-09-13T17:18:32.053111+0000","last_fullsized":"2024-09-13T17:18:32.053111+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:10.146181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044211+0000","last_change":"2024-09-13T17:18:32.044211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044211+0000","last_undegraded":"2024-09-13T17:18:32.044211+0000","last_fullsized":"2024-09-13T17:18:32.044211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.056366+0000","last_change":"2024-09-13T17:18:32.055502+0000","last_active":"2024-09-13T17:18:32.056366+0000","last_peered":"2024-09-13T17:18:32.056366+0000","last_clean":"2024-09-13T17:18:32.056366+0000","last_became_active":"2024-09-13T17:18:32.055221+0000","last_became_peered":"2024-09-13T17:18:32.055221+0000","last_unstale":"2024-09-13T17:18:32.056366+0000","last_undegraded":"2024-09-13T17:18:32.056366+0000","last_fullsized":"2024-09-13T17:18:32.056366+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:47.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040235+0000","last_change":"2024-09-13T17:18:32.040235+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040235+0000","last_undegraded":"2024-09-13T17:18:32.040235+0000","last_fullsized":"2024-09-13T17:18:32.040235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051391+0000","last_change":"2024-09-13T17:18:32.049724+0000","last_active":"2024-09-13T17:18:32.051391+0000","last_peered":"2024-09-13T17:18:32.051391+0000","last_clean":"2024-09-13T17:18:32.051391+0000","last_became_active":"2024-09-13T17:18:32.048989+0000","last_became_peered":"2024-09-13T17:18:32.048989+0000","last_unstale":"2024-09-13T17:18:32.051391+0000","last_undegraded":"2024-09-13T17:18:32.051391+0000","last_fullsized":"2024-09-13T17:18:32.051391+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.692313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044695+0000","last_change":"2024-09-13T17:18:32.044695+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044695+0000","last_undegraded":"2024-09-13T17:18:32.044695+0000","last_fullsized":"2024-09-13T17:18:32.044695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055101+0000","last_change":"2024-09-13T17:18:32.047867+0000","last_active":"2024-09-13T17:18:32.055101+0000","last_peered":"2024-09-13T17:18:32.055101+0000","last_clean":"2024-09-13T17:18:32.055101+0000","last_became_active":"2024-09-13T17:18:32.047515+0000","last_became_peered":"2024-09-13T17:18:32.047515+0000","last_unstale":"2024-09-13T17:18:32.055101+0000","last_undegraded":"2024-09-13T17:18:32.055101+0000","last_fullsized":"2024-09-13T17:18:32.055101+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044878+0000","last_change":"2024-09-13T17:18:32.044878+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044878+0000","last_undegraded":"2024-09-13T17:18:32.044878+0000","last_fullsized":"2024-09-13T17:18:32.044878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057271+0000","last_change":"2024-09-13T17:18:32.053603+0000","last_active":"2024-09-13T17:18:32.057271+0000","last_peered":"2024-09-13T17:18:32.057271+0000","last_clean":"2024-09-13T17:18:32.057271+0000","last_became_active":"2024-09-13T17:18:32.053322+0000","last_became_peered":"2024-09-13T17:18:32.053322+0000","last_unstale":"2024-09-13T17:18:32.057271+0000","last_undegraded":"2024-09-13T17:18:32.057271+0000","last_fullsized":"2024-09-13T17:18:32.057271+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047763+0000","last_change":"2024-09-13T17:18:32.047763+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047763+0000","last_undegraded":"2024-09-13T17:18:32.047763+0000","last_fullsized":"2024-09-13T17:18:32.047763+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.050959+0000","last_change":"2024-09-13T17:18:32.049980+0000","last_active":"2024-09-13T17:18:32.050959+0000","last_peered":"2024-09-13T17:18:32.050959+0000","last_clean":"2024-09-13T17:18:32.050959+0000","last_became_active":"2024-09-13T17:18:32.049675+0000","last_became_peered":"2024-09-13T17:18:32.049675+0000","last_unstale":"2024-09-13T17:18:32.050959+0000","last_undegraded":"2024-09-13T17:18:32.050959+0000","last_fullsized":"2024-09-13T17:18:32.050959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040144+0000","last_change":"2024-09-13T17:18:32.040144+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040144+0000","last_undegraded":"2024-09-13T17:18:32.040144+0000","last_fullsized":"2024-09-13T17:18:32.040144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.052474+0000","last_change":"2024-09-13T17:18:32.051684+0000","last_active":"2024-09-13T17:18:32.052474+0000","last_peered":"2024-09-13T17:18:32.052474+0000","last_clean":"2024-09-13T17:18:32.052474+0000","last_became_active":"2024-09-13T17:18:32.051408+0000","last_became_peered":"2024-09-13T17:18:32.051408+0000","last_unstale":"2024-09-13T17:18:32.052474+0000","last_undegraded":"2024-09-13T17:18:32.052474+0000","last_fullsized":"2024-09-13T17:18:32.052474+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:24.762568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040723+0000","last_change":"2024-09-13T17:18:32.040723+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040723+0000","last_undegraded":"2024-09-13T17:18:32.040723+0000","last_fullsized":"2024-09-13T17:18:32.040723+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048678+0000","last_change":"2024-09-13T17:18:32.045340+0000","last_active":"2024-09-13T17:18:32.048678+0000","last_peered":"2024-09-13T17:18:32.048678+0000","last_clean":"2024-09-13T17:18:32.048678+0000","last_became_active":"2024-09-13T17:18:32.045082+0000","last_became_peered":"2024-09-13T17:18:32.045082+0000","last_unstale":"2024-09-13T17:18:32.048678+0000","last_undegraded":"2024-09-13T17:18:32.048678+0000","last_fullsized":"2024-09-13T17:18:32.048678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.968862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040860+0000","last_change":"2024-09-13T17:18:32.040860+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040860+0000","last_undegraded":"2024-09-13T17:18:32.040860+0000","last_fullsized":"2024-09-13T17:18:32.040860+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.058085+0000","last_change":"2024-09-13T17:18:32.055416+0000","last_active":"2024-09-13T17:18:32.058085+0000","last_peered":"2024-09-13T17:18:32.058085+0000","last_clean":"2024-09-13T17:18:32.058085+0000","last_became_active":"2024-09-13T17:18:32.055170+0000","last_became_peered":"2024-09-13T17:18:32.055170+0000","last_unstale":"2024-09-13T17:18:32.058085+0000","last_undegraded":"2024-09-13T17:18:32.058085+0000","last_fullsized":"2024-09-13T17:18:32.058085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046923+0000","last_change":"2024-09-13T17:18:32.046923+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046923+0000","last_undegraded":"2024-09-13T17:18:32.046923+0000","last_fullsized":"2024-09-13T17:18:32.046923+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049505+0000","last_change":"2024-09-13T17:18:32.048620+0000","last_active":"2024-09-13T17:18:32.049505+0000","last_peered":"2024-09-13T17:18:32.049505+0000","last_clean":"2024-09-13T17:18:32.049505+0000","last_became_active":"2024-09-13T17:18:32.048322+0000","last_became_peered":"2024-09-13T17:18:32.048322+0000","last_unstale":"2024-09-13T17:18:32.049505+0000","last_undegraded":"2024-09-13T17:18:32.049505+0000","last_fullsized":"2024-09-13T17:18:32.049505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.661885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041509+0000","last_change":"2024-09-13T17:18:32.041509+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041509+0000","last_undegraded":"2024-09-13T17:18:32.041509+0000","last_fullsized":"2024-09-13T17:18:32.041509+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055304+0000","last_change":"2024-09-13T17:18:32.054556+0000","last_active":"2024-09-13T17:18:32.055304+0000","last_peered":"2024-09-13T17:18:32.055304+0000","last_clean":"2024-09-13T17:18:32.055304+0000","last_became_active":"2024-09-13T17:18:32.054202+0000","last_became_peered":"2024-09-13T17:18:32.054202+0000","last_unstale":"2024-09-13T17:18:32.055304+0000","last_undegraded":"2024-09-13T17:18:32.055304+0000","last_fullsized":"2024-09-13T17:18:32.055304+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039865+0000","last_change":"2024-09-13T17:18:32.039865+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039865+0000","last_undegraded":"2024-09-13T17:18:32.039865+0000","last_fullsized":"2024-09-13T17:18:32.039865+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049468+0000","last_change":"2024-09-13T17:18:32.044430+0000","last_active":"2024-09-13T17:18:32.049468+0000","last_peered":"2024-09-13T17:18:32.049468+0000","last_clean":"2024-09-13T17:18:32.049468+0000","last_became_active":"2024-09-13T17:18:32.044134+0000","last_became_peered":"2024-09-13T17:18:32.044134+0000","last_unstale":"2024-09-13T17:18:32.049468+0000","last_undegraded":"2024-09-13T17:18:32.049468+0000","last_fullsized":"2024-09-13T17:18:32.049468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:10.753053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040487+0000","last_change":"2024-09-13T17:18:32.040487+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040487+0000","last_undegraded":"2024-09-13T17:18:32.040487+0000","last_fullsized":"2024-09-13T17:18:32.040487+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057520+0000","last_change":"2024-09-13T17:18:32.053192+0000","last_active":"2024-09-13T17:18:32.057520+0000","last_peered":"2024-09-13T17:18:32.057520+0000","last_clean":"2024-09-13T17:18:32.057520+0000","last_became_active":"2024-09-13T17:18:32.052993+0000","last_became_peered":"2024-09-13T17:18:32.052993+0000","last_unstale":"2024-09-13T17:18:32.057520+0000","last_undegraded":"2024-09-13T17:18:32.057520+0000","last_fullsized":"2024-09-13T17:18:32.057520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038221+0000","last_change":"2024-09-13T17:18:32.038221+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038221+0000","last_undegraded":"2024-09-13T17:18:32.038221+0000","last_fullsized":"2024-09-13T17:18:32.038221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059254+0000","last_change":"2024-09-13T17:18:32.058647+0000","last_active":"2024-09-13T17:18:32.059254+0000","last_peered":"2024-09-13T17:18:32.059254+0000","last_clean":"2024-09-13T17:18:32.059254+0000","last_became_active":"2024-09-13T17:18:32.058335+0000","last_became_peered":"2024-09-13T17:18:32.058335+0000","last_unstale":"2024-09-13T17:18:32.059254+0000","last_undegraded":"2024-09-13T17:18:32.059254+0000","last_fullsized":"2024-09-13T17:18:32.059254+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:52.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046286+0000","last_change":"2024-09-13T17:18:32.046286+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046286+0000","last_undegraded":"2024-09-13T17:18:32.046286+0000","last_fullsized":"2024-09-13T17:18:32.046286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051328+0000","last_change":"2024-09-13T17:18:32.049134+0000","last_active":"2024-09-13T17:18:32.051328+0000","last_peered":"2024-09-13T17:18:32.051328+0000","last_clean":"2024-09-13T17:18:32.051328+0000","last_became_active":"2024-09-13T17:18:32.048872+0000","last_became_peered":"2024-09-13T17:18:32.048872+0000","last_unstale":"2024-09-13T17:18:32.051328+0000","last_undegraded":"2024-09-13T17:18:32.051328+0000","last_fullsized":"2024-09-13T17:18:32.051328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:12.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047194+0000","last_change":"2024-09-13T17:18:32.047194+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047194+0000","last_undegraded":"2024-09-13T17:18:32.047194+0000","last_fullsized":"2024-09-13T17:18:32.047194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059186+0000","last_change":"2024-09-13T17:18:32.058217+0000","last_active":"2024-09-13T17:18:32.059186+0000","last_peered":"2024-09-13T17:18:32.059186+0000","last_clean":"2024-09-13T17:18:32.059186+0000","last_became_active":"2024-09-13T17:18:32.057860+0000","last_became_peered":"2024-09-13T17:18:32.057860+0000","last_unstale":"2024-09-13T17:18:32.059186+0000","last_undegraded":"2024-09-13T17:18:32.059186+0000","last_fullsized":"2024-09-13T17:18:32.059186+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:44.171955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043425+0000","last_change":"2024-09-13T17:18:32.043425+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043425+0000","last_undegraded":"2024-09-13T17:18:32.043425+0000","last_fullsized":"2024-09-13T17:18:32.043425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055334+0000","last_change":"2024-09-13T17:18:32.050290+0000","last_active":"2024-09-13T17:18:32.055334+0000","last_peered":"2024-09-13T17:18:32.055334+0000","last_clean":"2024-09-13T17:18:32.055334+0000","last_became_active":"2024-09-13T17:18:32.050038+0000","last_became_peered":"2024-09-13T17:18:32.050038+0000","last_unstale":"2024-09-13T17:18:32.055334+0000","last_undegraded":"2024-09-13T17:18:32.055334+0000","last_fullsized":"2024-09-13T17:18:32.055334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038329+0000","last_change":"2024-09-13T17:18:32.038329+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038329+0000","last_undegraded":"2024-09-13T17:18:32.038329+0000","last_fullsized":"2024-09-13T17:18:32.038329+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059156+0000","last_change":"2024-09-13T17:18:32.058246+0000","last_active":"2024-09-13T17:18:32.059156+0000","last_peered":"2024-09-13T17:18:32.059156+0000","last_clean":"2024-09-13T17:18:32.059156+0000","last_became_active":"2024-09-13T17:18:32.057888+0000","last_became_peered":"2024-09-13T17:18:32.057888+0000","last_unstale":"2024-09-13T17:18:32.059156+0000","last_undegraded":"2024-09-13T17:18:32.059156+0000","last_fullsized":"2024-09-13T17:18:32.059156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:37.515238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036938+0000","last_change":"2024-09-13T17:18:32.036938+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036938+0000","last_undegraded":"2024-09-13T17:18:32.036938+0000","last_fullsized":"2024-09-13T17:18:32.036938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049480+0000","last_change":"2024-09-13T17:18:32.047953+0000","last_active":"2024-09-13T17:18:32.049480+0000","last_peered":"2024-09-13T17:18:32.049480+0000","last_clean":"2024-09-13T17:18:32.049480+0000","last_became_active":"2024-09-13T17:18:32.047691+0000","last_became_peered":"2024-09-13T17:18:32.047691+0000","last_unstale":"2024-09-13T17:18:32.049480+0000","last_undegraded":"2024-09-13T17:18:32.049480+0000","last_fullsized":"2024-09-13T17:18:32.049480+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:05.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-13T17:18:31.041688+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:18:31.041688+0000","last_peered":"2024-09-13T17:18:31.041688+0000","last_clean":"2024-09-13T17:18:31.041688+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:18:31.041688+0000","last_undegraded":"2024-09-13T17:18:31.041688+0000","last_fullsized":"2024-09-13T17:18:31.041688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1896448,"data_stored":1183382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70799999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":1.165,"15min":1.165},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":1.216,"15min":1.216},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76800000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":1.234,"15min":1.234},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.878,"15min":0.878},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67800000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69299999999999995,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70099999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.66600000000000004,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.378},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73799999999999999,"5min":1.173,"15min":1.173},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":1.008,"15min":1.008},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":1.085,"15min":1.085},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.47699999999999998},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.50700000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":1.034,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72699999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.622},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33300000000000002,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63400000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.245,"5min":0.214,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":1.458,"15min":1.458},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.23699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.437}]},{"osd":5,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88100000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.81000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":1.226,"15min":1.226},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32600000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.42499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.51000000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35799999999999998,"15min":0.36599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39900000000000002,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53100000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":0.871,"15min":0.871},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.39400000000000002},"min":{"1min":0.252,"5min":0.223,"15min":0.223},"max":{"1min":0.56999999999999995,"5min":1.159,"15min":1.159},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.40500000000000003},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50800000000000001,"5min":1.081,"15min":1.081},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.45500000000000002,"5min":1.286,"15min":1.286},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.752,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73099999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.254,"15min":1.254},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1884160,"data_stored":1176787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54800000000000004,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.501,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61499999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.51600000000000001,"15min":0.433},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":14.262,"15min":14.262},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.33900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58999999999999997,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.98499999999999999,"5min":3.956,"15min":3.956},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":0.998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":4.069,"15min":4.069},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.026,"5min":4.04,"15min":4.04},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93500000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043061+0000', 'last_change': '2024-09-13T17:18:32.043061+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043061+0000', 'last_undegraded': '2024-09-13T17:18:32.043061+0000', 'last_fullsized': '2024-09-13T17:18:32.043061+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.046688+0000', 'last_change': '2024-09-13T17:18:32.046688+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.046688+0000', 'last_undegraded': '2024-09-13T17:18:32.046688+0000', 'last_fullsized': '2024-09-13T17:18:32.046688+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-09-13T17:18:36.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.042635+0000', 'last_change': '2024-09-13T17:18:32.042635+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.042635+0000', 'last_undegraded': '2024-09-13T17:18:32.042635+0000', 'last_fullsized': '2024-09-13T17:18:32.042635+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041129+0000', 'last_change': '2024-09-13T17:18:32.041129+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041129+0000', 'last_undegraded': '2024-09-13T17:18:32.041129+0000', 'last_fullsized': '2024-09-13T17:18:32.041129+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.048167+0000', 'last_change': '2024-09-13T17:18:32.048167+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.048167+0000', 'last_undegraded': '2024-09-13T17:18:32.048167+0000', 'last_fullsized': '2024-09-13T17:18:32.048167+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.046342+0000', 'last_change': '2024-09-13T17:18:32.046342+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.046342+0000', 'last_undegraded': '2024-09-13T17:18:32.046342+0000', 'last_fullsized': '2024-09-13T17:18:32.046342+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043353+0000', 'last_change': '2024-09-13T17:18:32.043353+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043353+0000', 'last_undegraded': '2024-09-13T17:18:32.043353+0000', 'last_fullsized': '2024-09-13T17:18:32.043353+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.049247+0000', 'last_change': '2024-09-13T17:18:32.049247+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.049247+0000', 'last_undegraded': '2024-09-13T17:18:32.049247+0000', 'last_fullsized': '2024-09-13T17:18:32.049247+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-09-13T17:18:36.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044253+0000', 'last_change': '2024-09-13T17:18:32.044253+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044253+0000', 'last_undegraded': '2024-09-13T17:18:32.044253+0000', 'last_fullsized': '2024-09-13T17:18:32.044253+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.045481+0000', 'last_change': '2024-09-13T17:18:32.045481+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.045481+0000', 'last_undegraded': '2024-09-13T17:18:32.045481+0000', 'last_fullsized': '2024-09-13T17:18:32.045481+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.037743+0000', 'last_change': '2024-09-13T17:18:32.037743+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.037743+0000', 'last_undegraded': '2024-09-13T17:18:32.037743+0000', 'last_fullsized': '2024-09-13T17:18:32.037743+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041268+0000', 'last_change': '2024-09-13T17:18:32.041268+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041268+0000', 'last_undegraded': '2024-09-13T17:18:32.041268+0000', 'last_fullsized': '2024-09-13T17:18:32.041268+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041006+0000', 'last_change': '2024-09-13T17:18:32.041006+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041006+0000', 'last_undegraded': '2024-09-13T17:18:32.041006+0000', 'last_fullsized': '2024-09-13T17:18:32.041006+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2024-09-13T17:18:36.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043934+0000', 'last_change': '2024-09-13T17:18:32.043934+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043934+0000', 'last_undegraded': '2024-09-13T17:18:32.043934+0000', 'last_fullsized': '2024-09-13T17:18:32.043934+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.042527+0000', 'last_change': '2024-09-13T17:18:32.042527+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.042527+0000', 'last_undegraded': '2024-09-13T17:18:32.042527+0000', 'last_fullsized': '2024-09-13T17:18:32.042527+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.042901+0000', 'last_change': '2024-09-13T17:18:32.042901+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.042901+0000', 'last_undegraded': '2024-09-13T17:18:32.042901+0000', 'last_fullsized': '2024-09-13T17:18:32.042901+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.042179+0000', 'last_change': '2024-09-13T17:18:32.042179+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.042179+0000', 'last_undegraded': '2024-09-13T17:18:32.042179+0000', 'last_fullsized': '2024-09-13T17:18:32.042179+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.045113+0000', 'last_change': '2024-09-13T17:18:32.045113+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.045113+0000', 'last_undegraded': '2024-09-13T17:18:32.045113+0000', 'last_fullsized': '2024-09-13T17:18:32.045113+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041691+0000', 'last_change': '2024-09-13T17:18:32.041691+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041691+0000', 'last_undegraded': '2024-09-13T17:18:32.041691+0000', 'last_fullsized': '2024-09-13T17:18:32.041691+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-09-13T17:18:36.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040846+0000', 'last_change': '2024-09-13T17:18:32.040846+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040846+0000', 'last_undegraded': '2024-09-13T17:18:32.040846+0000', 'last_fullsized': '2024-09-13T17:18:32.040846+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.048698+0000', 'last_change': '2024-09-13T17:18:32.048698+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.048698+0000', 'last_undegraded': '2024-09-13T17:18:32.048698+0000', 'last_fullsized': '2024-09-13T17:18:32.048698+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.045424+0000', 'last_change': '2024-09-13T17:18:32.045424+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.045424+0000', 'last_undegraded': '2024-09-13T17:18:32.045424+0000', 'last_fullsized': '2024-09-13T17:18:32.045424+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041209+0000', 'last_change': '2024-09-13T17:18:32.041209+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041209+0000', 'last_undegraded': '2024-09-13T17:18:32.041209+0000', 'last_fullsized': '2024-09-13T17:18:32.041209+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044393+0000', 'last_change': '2024-09-13T17:18:32.044393+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044393+0000', 'last_undegraded': '2024-09-13T17:18:32.044393+0000', 'last_fullsized': '2024-09-13T17:18:32.044393+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039846+0000', 'last_change': '2024-09-13T17:18:32.039846+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039846+0000', 'last_undegraded': '2024-09-13T17:18:32.039846+0000', 'last_fullsized': '2024-09-13T17:18:32.039846+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041710+0000', 'last_change': '2024-09-13T17:18:32.041710+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041710+0000', 'last_undegraded': '2024-09-13T17:18:32.041710+0000', 'last_fullsized': '2024-09-13T17:18:32.041710+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.036999+0000', 'last_change': '2024-09-13T17:18:32.036999+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.036999+0000', 'last_undegraded': '2024-09-13T17:18:32.036999+0000', 'last_fullsized': '2024-09-13T17:18:32.036999+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043016+0000', 'last_change': '2024-09-13T17:18:32.043016+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043016+0000', 'last_undegraded': '2024-09-13T17:18:32.043016+0000', 'last_fullsized': '2024-09-13T17:18:32.043016+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.048157+0000', 'last_change': '2024-09-13T17:18:32.048157+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.048157+0000', 'last_undegraded': '2024-09-13T17:18:32.048157+0000', 'last_fullsized': '2024-09-13T17:18:32.048157+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039890+0000', 'last_change': '2024-09-13T17:18:32.039890+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039890+0000', 'last_undegraded': '2024-09-13T17:18:32.039890+0000', 'last_fullsized': '2024-09-13T17:18:32.039890+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-09-13T17:18:36.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.042841+0000', 'last_change': '2024-09-13T17:18:32.042841+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.042841+0000', 'last_undegraded': '2024-09-13T17:18:32.042841+0000', 'last_fullsized': '2024-09-13T17:18:32.042841+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.047688+0000', 'last_change': '2024-09-13T17:18:32.047688+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.047688+0000', 'last_undegraded': '2024-09-13T17:18:32.047688+0000', 'last_fullsized': '2024-09-13T17:18:32.047688+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039023+0000', 'last_change': '2024-09-13T17:18:32.039023+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039023+0000', 'last_undegraded': '2024-09-13T17:18:32.039023+0000', 'last_fullsized': '2024-09-13T17:18:32.039023+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043214+0000', 'last_change': '2024-09-13T17:18:32.043214+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043214+0000', 'last_undegraded': '2024-09-13T17:18:32.043214+0000', 'last_fullsized': '2024-09-13T17:18:32.043214+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039405+0000', 'last_change': '2024-09-13T17:18:32.039405+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039405+0000', 'last_undegraded': '2024-09-13T17:18:32.039405+0000', 'last_fullsized': '2024-09-13T17:18:32.039405+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.037211+0000', 'last_change': '2024-09-13T17:18:32.037211+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.037211+0000', 'last_undegraded': '2024-09-13T17:18:32.037211+0000', 'last_fullsized': '2024-09-13T17:18:32.037211+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040619+0000', 'last_change': '2024-09-13T17:18:32.040619+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040619+0000', 'last_undegraded': '2024-09-13T17:18:32.040619+0000', 'last_fullsized': '2024-09-13T17:18:32.040619+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.038949+0000', 'last_change': '2024-09-13T17:18:32.038949+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.038949+0000', 'last_undegraded': '2024-09-13T17:18:32.038949+0000', 'last_fullsized': '2024-09-13T17:18:32.038949+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044020+0000', 'last_change': '2024-09-13T17:18:32.044020+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044020+0000', 'last_undegraded': '2024-09-13T17:18:32.044020+0000', 'last_fullsized': '2024-09-13T17:18:32.044020+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041287+0000', 'last_change': '2024-09-13T17:18:32.041287+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041287+0000', 'last_undegraded': '2024-09-13T17:18:32.041287+0000', 'last_fullsized': '2024-09-13T17:18:32.041287+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039552+0000', 'last_change': '2024-09-13T17:18:32.039552+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039552+0000', 'last_undegraded': '2024-09-13T17:18:32.039552+0000', 'last_fullsized': '2024-09-13T17:18:32.039552+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-09-13T17:18:36.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.046527+0000', 'last_change': '2024-09-13T17:18:32.046527+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.046527+0000', 'last_undegraded': '2024-09-13T17:18:32.046527+0000', 'last_fullsized': '2024-09-13T17:18:32.046527+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043751+0000', 'last_change': '2024-09-13T17:18:32.043751+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043751+0000', 'last_undegraded': '2024-09-13T17:18:32.043751+0000', 'last_fullsized': '2024-09-13T17:18:32.043751+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.047325+0000', 'last_change': '2024-09-13T17:18:32.047325+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.047325+0000', 'last_undegraded': '2024-09-13T17:18:32.047325+0000', 'last_fullsized': '2024-09-13T17:18:32.047325+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.037448+0000', 'last_change': '2024-09-13T17:18:32.037448+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.037448+0000', 'last_undegraded': '2024-09-13T17:18:32.037448+0000', 'last_fullsized': '2024-09-13T17:18:32.037448+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044082+0000', 'last_change': '2024-09-13T17:18:32.044082+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044082+0000', 'last_undegraded': '2024-09-13T17:18:32.044082+0000', 'last_fullsized': '2024-09-13T17:18:32.044082+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044211+0000', 'last_change': '2024-09-13T17:18:32.044211+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044211+0000', 'last_undegraded': '2024-09-13T17:18:32.044211+0000', 'last_fullsized': '2024-09-13T17:18:32.044211+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040235+0000', 'last_change': '2024-09-13T17:18:32.040235+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040235+0000', 'last_undegraded': '2024-09-13T17:18:32.040235+0000', 'last_fullsized': '2024-09-13T17:18:32.040235+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044695+0000', 'last_change': '2024-09-13T17:18:32.044695+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044695+0000', 'last_undegraded': '2024-09-13T17:18:32.044695+0000', 'last_fullsized': '2024-09-13T17:18:32.044695+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.044878+0000', 'last_change': '2024-09-13T17:18:32.044878+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.044878+0000', 'last_undegraded': '2024-09-13T17:18:32.044878+0000', 'last_fullsized': '2024-09-13T17:18:32.044878+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.047763+0000', 'last_change': '2024-09-13T17:18:32.047763+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.047763+0000', 'last_undegraded': '2024-09-13T17:18:32.047763+0000', 'last_fullsized': '2024-09-13T17:18:32.047763+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040144+0000', 'last_change': '2024-09-13T17:18:32.040144+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040144+0000', 'last_undegraded': '2024-09-13T17:18:32.040144+0000', 'last_fullsized': '2024-09-13T17:18:32.040144+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-09-13T17:18:36.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040723+0000', 'last_change': '2024-09-13T17:18:32.040723+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040723+0000', 'last_undegraded': '2024-09-13T17:18:32.040723+0000', 'last_fullsized': '2024-09-13T17:18:32.040723+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040860+0000', 'last_change': '2024-09-13T17:18:32.040860+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040860+0000', 'last_undegraded': '2024-09-13T17:18:32.040860+0000', 'last_fullsized': '2024-09-13T17:18:32.040860+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.046923+0000', 'last_change': '2024-09-13T17:18:32.046923+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.046923+0000', 'last_undegraded': '2024-09-13T17:18:32.046923+0000', 'last_fullsized': '2024-09-13T17:18:32.046923+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.041509+0000', 'last_change': '2024-09-13T17:18:32.041509+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.041509+0000', 'last_undegraded': '2024-09-13T17:18:32.041509+0000', 'last_fullsized': '2024-09-13T17:18:32.041509+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.039865+0000', 'last_change': '2024-09-13T17:18:32.039865+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.039865+0000', 'last_undegraded': '2024-09-13T17:18:32.039865+0000', 'last_fullsized': '2024-09-13T17:18:32.039865+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.040487+0000', 'last_change': '2024-09-13T17:18:32.040487+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.040487+0000', 'last_undegraded': '2024-09-13T17:18:32.040487+0000', 'last_fullsized': '2024-09-13T17:18:32.040487+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:18:36.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.038221+0000', 'last_change': '2024-09-13T17:18:32.038221+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.038221+0000', 'last_undegraded': '2024-09-13T17:18:32.038221+0000', 'last_fullsized': '2024-09-13T17:18:32.038221+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.046286+0000', 'last_change': '2024-09-13T17:18:32.046286+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.046286+0000', 'last_undegraded': '2024-09-13T17:18:32.046286+0000', 'last_fullsized': '2024-09-13T17:18:32.046286+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.047194+0000', 'last_change': '2024-09-13T17:18:32.047194+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.047194+0000', 'last_undegraded': '2024-09-13T17:18:32.047194+0000', 'last_fullsized': '2024-09-13T17:18:32.047194+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.043425+0000', 'last_change': '2024-09-13T17:18:32.043425+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.043425+0000', 'last_undegraded': '2024-09-13T17:18:32.043425+0000', 'last_fullsized': '2024-09-13T17:18:32.043425+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.038329+0000', 'last_change': '2024-09-13T17:18:32.038329+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.038329+0000', 'last_undegraded': '2024-09-13T17:18:32.038329+0000', 'last_fullsized': '2024-09-13T17:18:32.038329+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2024-09-13T17:18:36.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:18:32.036938+0000', 'last_change': '2024-09-13T17:18:32.036938+0000', 'last_active': '2024-09-13T17:18:32.031556+0000', 'last_peered': '2024-09-13T17:18:32.031556+0000', 'last_clean': '2024-09-13T17:18:32.031556+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:18:32.036938+0000', 'last_undegraded': '2024-09-13T17:18:32.036938+0000', 'last_fullsized': '2024-09-13T17:18:32.036938+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'last_clean_scrub_stamp': '2024-09-13T17:18:32.031556+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:18:36.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:18:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.207+0000 7f45bef5e640 1 Processor -- start 2024-09-13T17:18:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.207+0000 7f45bef5e640 1 -- start start 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45bef5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45b8160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45bef5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b806b8a0 con 0x7f45b80cb1c0 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45bef5e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b80ad830 con 0x7f45b80b1db0 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45bef5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80ae8d0 con 0x7f45b815c5f0 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45b7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45b80cb1c0 0x7f45b8160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33768/0 (socket says 172.21.15.5:33768) 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45b7fff640 1 -- 172.21.15.5:0/2061029927 learned_addr learned my addr 172.21.15.5:0/2061029927 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45b8160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.208+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782096483 0 0) 0x7f45b806b8a0 con 0x7f45b80cb1c0 2024-09-13T17:18:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a8003520 con 0x7f45b80cb1c0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301301510 0 0) 0x7f45b80ad830 con 0x7f45b80b1db0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b806b8a0 con 0x7f45b80b1db0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457759618 0 0) 0x7f45a8003520 con 0x7f45b80cb1c0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 msgr2=0x7f45b8160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45b8160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 >> v1:172.21.15.179:6789/0 conn(0x7f45b80b1db0 legacy=0x7f45b80b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80adb10 con 0x7f45b80cb1c0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f45a40015f0 con 0x7f45b80cb1c0 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45b8160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 >> v1:172.21.15.5:6789/0 conn(0x7f45b80cb1c0 legacy=0x7f45b8160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45a8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a80047c0 0x7f45a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45a80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a800ba60 con 0x7f45a8003b30 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a800bbd0 con 0x7f45a80047c0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a800bd90 con 0x7f45b815c5f0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45a8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45b7fff640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a80047c0 0x7f45a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bd4fb640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45a80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 -- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 msgr2=0x7f45a80051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b815c5f0 0x7f45a80051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 -- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a80047c0 msgr2=0x7f45a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45a80047c0 0x7f45a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.209+0000 7f45bccfa640 1 -- 172.21.15.5:0/2061029927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009400 con 0x7f45a8003b30 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.210+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45a8003f30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c90 tx=0x7f45a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2eb1277628d59d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.210+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac031400 con 0x7f45a8003b30 2024-09-13T17:18:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.210+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac02d050 con 0x7f45a8003b30 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.210+0000 7f45b77fe640 1 -- 172.21.15.5:0/2061029927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac031760 con 0x7f45a8003b30 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 -- 172.21.15.5:0/2061029927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 msgr2=0x7f45a8003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2061029927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45a8003f30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c90 tx=0x7f45a80057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bd4fb640 1 -- 172.21.15.5:0/2061029927 reap_dead start 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 -- 172.21.15.5:0/2061029927 shutdown_connections 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 -- 172.21.15.5:0/2061029927 >> 172.21.15.5:0/2061029927 conn(0x7f45b8071980 msgr2=0x7f45b8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 -- 172.21.15.5:0/2061029927 shutdown_connections 2024-09-13T17:18:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.211+0000 7f45bef5e640 1 -- 172.21.15.5:0/2061029927 wait complete. 2024-09-13T17:18:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.212+0000 7f45bef5e640 1 Processor -- start 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.212+0000 7f45bef5e640 1 -- start start 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cc7e0 0x7f45b80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 0x7f45b80ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80cada0 con 0x7f45a8003b30 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80cd030 con 0x7f45b80ca3e0 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bef5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80cd310 con 0x7f45b80cc7e0 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59704/0 (socket says 172.21.15.5:59704) 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 -- 172.21.15.5:0/2652123785 learned_addr learned my addr 172.21.15.5:0/2652123785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45b7fff640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cc7e0 0x7f45b80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bd4fb640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 0x7f45b80ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 -- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cc7e0 msgr2=0x7f45b80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cc7e0 0x7f45b80c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 -- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 msgr2=0x7f45b80ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 0x7f45b80ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bccfa640 1 -- 172.21.15.5:0/2652123785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80cd5f0 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.213+0000 7f45bd4fb640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 0x7f45b80ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45bccfa640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c90 tx=0x7f45ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac03a600 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac03a760 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80cd8d0 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac03ab10 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.214+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b80ce0d0 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.215+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80cddf0 con 0x7f45a8003b30 2024-09-13T17:18:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.215+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45ac038040 con 0x7f45a8003b30 2024-09-13T17:18:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.216+0000 7f45b57fa640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 0x7f459c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.216+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45ac0a9650 con 0x7f45a8003b30 2024-09-13T17:18:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.216+0000 7f45b7fff640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 0x7f459c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.217+0000 7f45b7fff640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 0x7f459c06d0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f45a4001b00 tx=0x7f45a4007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.220+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f45b80cddf0 con 0x7f45a8003b30 2024-09-13T17:18:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.460+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f45b80cddf0 con 0x7f45a8003b30 2024-09-13T17:18:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.460+0000 7f45b57fa640 1 -- 172.21.15.5:0/2652123785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1195 (secure 0 0 0) 0x7f45b80cddf0 con 0x7f45a8003b30 2024-09-13T17:18:36.462 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:36.463 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":345,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1726247581,"num_in_osds":8,"osd_in_since":1726247573,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":258052096,"bytes_avail":772836061184,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8232}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-13T17:17:09.313320+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:18:36.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 msgr2=0x7f459c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 0x7f459c06d0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f45a4001b00 tx=0x7f45a4007040 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 msgr2=0x7f45b81f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009c90 tx=0x7f45ac004730 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 shutdown_connections 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b80ca3e0 0x7f45b80ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45b80cc7e0 0x7f45b80c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f459c06ac00 0x7f459c06d0c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 --2- 172.21.15.5:0/2652123785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a8003b30 0x7f45b81f1dd0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 >> 172.21.15.5:0/2652123785 conn(0x7f45b8071980 msgr2=0x7f45b806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 shutdown_connections 2024-09-13T17:18:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.462+0000 7f45bef5e640 1 -- 172.21.15.5:0/2652123785 wait complete. 2024-09-13T17:18:36.475 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:18:36.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.574+0000 7f3a4d868640 1 Processor -- start 2024-09-13T17:18:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.574+0000 7f3a4d868640 1 -- start start 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a480b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a4806dfe0 0x7f3a480b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a480b43f0 0x7f3a480ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a480b2990 con 0x7f3a4806dfe0 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4806db50 con 0x7f3a480b43f0 2024-09-13T17:18:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a4d868640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4806d540 con 0x7f3a48145f20 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a467fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a4806dfe0 0x7f3a480b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a467fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a4806dfe0 0x7f3a480b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59708/0 (socket says 172.21.15.5:59708) 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a467fc640 1 -- 172.21.15.5:0/2240811500 learned_addr learned my addr 172.21.15.5:0/2240811500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a477fe640 1 --2- 172.21.15.5:0/2240811500 >> v2:172.21.15.179:3300/0 conn(0x7f3a480b43f0 0x7f3a480ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.575+0000 7f3a46ffd640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a480b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 -- 172.21.15.5:0/2240811500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 msgr2=0x7f3a480b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a480b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 -- 172.21.15.5:0/2240811500 >> v2:172.21.15.179:3300/0 conn(0x7f3a480b43f0 msgr2=0x7f3a480ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 --2- 172.21.15.5:0/2240811500 >> v2:172.21.15.179:3300/0 conn(0x7f3a480b43f0 0x7f3a480ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 -- 172.21.15.5:0/2240811500 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4806ee60 con 0x7f3a4806dfe0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a467fc640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a4806dfe0 0x7f3a480b3eb0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806e980 tx=0x7f3a3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41026215030f013 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a45ffb640 1 -- 172.21.15.5:0/2240811500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c032440 con 0x7f3a4806dfe0 2024-09-13T17:18:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a45ffb640 1 -- 172.21.15.5:0/2240811500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c0325a0 con 0x7f3a4806dfe0 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.576+0000 7f3a45ffb640 1 -- 172.21.15.5:0/2240811500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c032930 con 0x7f3a4806dfe0 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 -- 172.21.15.5:0/2240811500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a4806dfe0 msgr2=0x7f3a480b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a4806dfe0 0x7f3a480b3eb0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806e980 tx=0x7f3a3c02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 -- 172.21.15.5:0/2240811500 shutdown_connections 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 --2- 172.21.15.5:0/2240811500 >> v2:172.21.15.179:3300/0 conn(0x7f3a480b43f0 0x7f3a480ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a4806dfe0 0x7f3a480b3eb0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 --2- 172.21.15.5:0/2240811500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a480b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 -- 172.21.15.5:0/2240811500 >> 172.21.15.5:0/2240811500 conn(0x7f3a480b50e0 msgr2=0x7f3a48098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 -- 172.21.15.5:0/2240811500 shutdown_connections 2024-09-13T17:18:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.577+0000 7f3a4d868640 1 -- 172.21.15.5:0/2240811500 wait complete. 2024-09-13T17:18:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.578+0000 7f3a4d868640 1 Processor -- start 2024-09-13T17:18:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.578+0000 7f3a4d868640 1 -- start start 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 0x7f3a481e6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a4815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481e68d0 con 0x7f3a480b43f0 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481e52f0 con 0x7f3a4806dfe0 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a4d868640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481e55d0 con 0x7f3a48145f20 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a467fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59712/0 (socket says 172.21.15.5:59712) 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a467fc640 1 -- 172.21.15.5:0/4084951491 learned_addr learned my addr 172.21.15.5:0/4084951491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a46ffd640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 0x7f3a481e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.579+0000 7f3a477fe640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a4815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 -- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 msgr2=0x7f3a4815eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a4815eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 -- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 msgr2=0x7f3a481e6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 0x7f3a481e6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 -- 172.21.15.5:0/4084951491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c0094d0 con 0x7f3a480b43f0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a477fe640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a4815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a46ffd640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 0x7f3a481e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a467fc640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c02a220 tx=0x7f3a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c032440 con 0x7f3a480b43f0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c030ba0 con 0x7f3a480b43f0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a481e58b0 con 0x7f3a480b43f0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c03d440 con 0x7f3a480b43f0 2024-09-13T17:18:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.580+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a481e5e70 con 0x7f3a480b43f0 2024-09-13T17:18:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.581+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a481e5710 con 0x7f3a480b43f0 2024-09-13T17:18:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.581+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a3c039040 con 0x7f3a480b43f0 2024-09-13T17:18:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.582+0000 7f3a2ffff640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 0x7f3a3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.582+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3a3c0aa0e0 con 0x7f3a480b43f0 2024-09-13T17:18:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.582+0000 7f3a46ffd640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 0x7f3a3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.583+0000 7f3a46ffd640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 0x7f3a3406d0c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.586+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a481e5710 con 0x7f3a480b43f0 2024-09-13T17:18:36.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.756+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a4806d7e0 con 0x7f3a3406ac00 2024-09-13T17:18:36.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.764+0000 7f3a2ffff640 1 -- 172.21.15.5:0/4084951491 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286996 (secure 0 0 0) 0x7f3a38007730 con 0x7f3a3406ac00 2024-09-13T17:18:36.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:36.770 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 msgr2=0x7f3a3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 0x7f3a3406d0c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38008040 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 msgr2=0x7f3a4815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c02a220 tx=0x7f3a3c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 shutdown_connections 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a48145f20 0x7f3a4815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3a3406ac00 0x7f3a3406d0c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a480b43f0 0x7f3a4815b540 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 --2- 172.21.15.5:0/4084951491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a4806dfe0 0x7f3a481e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 >> 172.21.15.5:0/4084951491 conn(0x7f3a480b50e0 msgr2=0x7f3a480ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 shutdown_connections 2024-09-13T17:18:36.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:36.767+0000 7f3a4d868640 1 -- 172.21.15.5:0/4084951491 wait complete. 2024-09-13T17:18:36.780 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-13T17:18:35.333915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252004,"kb_used_data":11252,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754722716,"statfs":{"total":773094113280,"available":772836061184,"internally_reserved":0,"allocated":11522048,"data_stored":5878683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.301395"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043061+0000","last_change":"2024-09-13T17:18:32.043061+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043061+0000","last_undegraded":"2024-09-13T17:18:32.043061+0000","last_fullsized":"2024-09-13T17:18:32.043061+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046688+0000","last_change":"2024-09-13T17:18:32.046688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046688+0000","last_undegraded":"2024-09-13T17:18:32.046688+0000","last_fullsized":"2024-09-13T17:18:32.046688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042635+0000","last_change":"2024-09-13T17:18:32.042635+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042635+0000","last_undegraded":"2024-09-13T17:18:32.042635+0000","last_fullsized":"2024-09-13T17:18:32.042635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041129+0000","last_change":"2024-09-13T17:18:32.041129+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041129+0000","last_undegraded":"2024-09-13T17:18:32.041129+0000","last_fullsized":"2024-09-13T17:18:32.041129+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048167+0000","last_change":"2024-09-13T17:18:32.048167+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048167+0000","last_undegraded":"2024-09-13T17:18:32.048167+0000","last_fullsized":"2024-09-13T17:18:32.048167+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046342+0000","last_change":"2024-09-13T17:18:32.046342+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046342+0000","last_undegraded":"2024-09-13T17:18:32.046342+0000","last_fullsized":"2024-09-13T17:18:32.046342+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043353+0000","last_change":"2024-09-13T17:18:32.043353+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043353+0000","last_undegraded":"2024-09-13T17:18:32.043353+0000","last_fullsized":"2024-09-13T17:18:32.043353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.049247+0000","last_change":"2024-09-13T17:18:32.049247+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.049247+0000","last_undegraded":"2024-09-13T17:18:32.049247+0000","last_fullsized":"2024-09-13T17:18:32.049247+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044253+0000","last_change":"2024-09-13T17:18:32.044253+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044253+0000","last_undegraded":"2024-09-13T17:18:32.044253+0000","last_fullsized":"2024-09-13T17:18:32.044253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045481+0000","last_change":"2024-09-13T17:18:32.045481+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045481+0000","last_undegraded":"2024-09-13T17:18:32.045481+0000","last_fullsized":"2024-09-13T17:18:32.045481+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037743+0000","last_change":"2024-09-13T17:18:32.037743+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037743+0000","last_undegraded":"2024-09-13T17:18:32.037743+0000","last_fullsized":"2024-09-13T17:18:32.037743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041268+0000","last_change":"2024-09-13T17:18:32.041268+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041268+0000","last_undegraded":"2024-09-13T17:18:32.041268+0000","last_fullsized":"2024-09-13T17:18:32.041268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041006+0000","last_change":"2024-09-13T17:18:32.041006+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041006+0000","last_undegraded":"2024-09-13T17:18:32.041006+0000","last_fullsized":"2024-09-13T17:18:32.041006+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043934+0000","last_change":"2024-09-13T17:18:32.043934+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043934+0000","last_undegraded":"2024-09-13T17:18:32.043934+0000","last_fullsized":"2024-09-13T17:18:32.043934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042527+0000","last_change":"2024-09-13T17:18:32.042527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042527+0000","last_undegraded":"2024-09-13T17:18:32.042527+0000","last_fullsized":"2024-09-13T17:18:32.042527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042901+0000","last_change":"2024-09-13T17:18:32.042901+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042901+0000","last_undegraded":"2024-09-13T17:18:32.042901+0000","last_fullsized":"2024-09-13T17:18:32.042901+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042179+0000","last_change":"2024-09-13T17:18:32.042179+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042179+0000","last_undegraded":"2024-09-13T17:18:32.042179+0000","last_fullsized":"2024-09-13T17:18:32.042179+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045113+0000","last_change":"2024-09-13T17:18:32.045113+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045113+0000","last_undegraded":"2024-09-13T17:18:32.045113+0000","last_fullsized":"2024-09-13T17:18:32.045113+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041691+0000","last_change":"2024-09-13T17:18:32.041691+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041691+0000","last_undegraded":"2024-09-13T17:18:32.041691+0000","last_fullsized":"2024-09-13T17:18:32.041691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040846+0000","last_change":"2024-09-13T17:18:32.040846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040846+0000","last_undegraded":"2024-09-13T17:18:32.040846+0000","last_fullsized":"2024-09-13T17:18:32.040846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048698+0000","last_change":"2024-09-13T17:18:32.048698+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048698+0000","last_undegraded":"2024-09-13T17:18:32.048698+0000","last_fullsized":"2024-09-13T17:18:32.048698+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.045424+0000","last_change":"2024-09-13T17:18:32.045424+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.045424+0000","last_undegraded":"2024-09-13T17:18:32.045424+0000","last_fullsized":"2024-09-13T17:18:32.045424+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041209+0000","last_change":"2024-09-13T17:18:32.041209+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041209+0000","last_undegraded":"2024-09-13T17:18:32.041209+0000","last_fullsized":"2024-09-13T17:18:32.041209+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044393+0000","last_change":"2024-09-13T17:18:32.044393+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044393+0000","last_undegraded":"2024-09-13T17:18:32.044393+0000","last_fullsized":"2024-09-13T17:18:32.044393+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039846+0000","last_change":"2024-09-13T17:18:32.039846+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039846+0000","last_undegraded":"2024-09-13T17:18:32.039846+0000","last_fullsized":"2024-09-13T17:18:32.039846+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041710+0000","last_change":"2024-09-13T17:18:32.041710+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041710+0000","last_undegraded":"2024-09-13T17:18:32.041710+0000","last_fullsized":"2024-09-13T17:18:32.041710+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036999+0000","last_change":"2024-09-13T17:18:32.036999+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036999+0000","last_undegraded":"2024-09-13T17:18:32.036999+0000","last_fullsized":"2024-09-13T17:18:32.036999+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043016+0000","last_change":"2024-09-13T17:18:32.043016+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043016+0000","last_undegraded":"2024-09-13T17:18:32.043016+0000","last_fullsized":"2024-09-13T17:18:32.043016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.048157+0000","last_change":"2024-09-13T17:18:32.048157+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.048157+0000","last_undegraded":"2024-09-13T17:18:32.048157+0000","last_fullsized":"2024-09-13T17:18:32.048157+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039890+0000","last_change":"2024-09-13T17:18:32.039890+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039890+0000","last_undegraded":"2024-09-13T17:18:32.039890+0000","last_fullsized":"2024-09-13T17:18:32.039890+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.042841+0000","last_change":"2024-09-13T17:18:32.042841+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.042841+0000","last_undegraded":"2024-09-13T17:18:32.042841+0000","last_fullsized":"2024-09-13T17:18:32.042841+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047688+0000","last_change":"2024-09-13T17:18:32.047688+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047688+0000","last_undegraded":"2024-09-13T17:18:32.047688+0000","last_fullsized":"2024-09-13T17:18:32.047688+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039023+0000","last_change":"2024-09-13T17:18:32.039023+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039023+0000","last_undegraded":"2024-09-13T17:18:32.039023+0000","last_fullsized":"2024-09-13T17:18:32.039023+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055137+0000","last_change":"2024-09-13T17:18:32.053380+0000","last_active":"2024-09-13T17:18:32.055137+0000","last_peered":"2024-09-13T17:18:32.055137+0000","last_clean":"2024-09-13T17:18:32.055137+0000","last_became_active":"2024-09-13T17:18:32.053093+0000","last_became_peered":"2024-09-13T17:18:32.053093+0000","last_unstale":"2024-09-13T17:18:32.055137+0000","last_undegraded":"2024-09-13T17:18:32.055137+0000","last_fullsized":"2024-09-13T17:18:32.055137+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:19.522901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043214+0000","last_change":"2024-09-13T17:18:32.043214+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043214+0000","last_undegraded":"2024-09-13T17:18:32.043214+0000","last_fullsized":"2024-09-13T17:18:32.043214+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048640+0000","last_change":"2024-09-13T17:18:32.046895+0000","last_active":"2024-09-13T17:18:32.048640+0000","last_peered":"2024-09-13T17:18:32.048640+0000","last_clean":"2024-09-13T17:18:32.048640+0000","last_became_active":"2024-09-13T17:18:32.046631+0000","last_became_peered":"2024-09-13T17:18:32.046631+0000","last_unstale":"2024-09-13T17:18:32.048640+0000","last_undegraded":"2024-09-13T17:18:32.048640+0000","last_fullsized":"2024-09-13T17:18:32.048640+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:50.355643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039405+0000","last_change":"2024-09-13T17:18:32.039405+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039405+0000","last_undegraded":"2024-09-13T17:18:32.039405+0000","last_fullsized":"2024-09-13T17:18:32.039405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048432+0000","last_change":"2024-09-13T17:18:32.046706+0000","last_active":"2024-09-13T17:18:32.048432+0000","last_peered":"2024-09-13T17:18:32.048432+0000","last_clean":"2024-09-13T17:18:32.048432+0000","last_became_active":"2024-09-13T17:18:32.046095+0000","last_became_peered":"2024-09-13T17:18:32.046095+0000","last_unstale":"2024-09-13T17:18:32.048432+0000","last_undegraded":"2024-09-13T17:18:32.048432+0000","last_fullsized":"2024-09-13T17:18:32.048432+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037211+0000","last_change":"2024-09-13T17:18:32.037211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037211+0000","last_undegraded":"2024-09-13T17:18:32.037211+0000","last_fullsized":"2024-09-13T17:18:32.037211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059236+0000","last_change":"2024-09-13T17:18:32.058586+0000","last_active":"2024-09-13T17:18:32.059236+0000","last_peered":"2024-09-13T17:18:32.059236+0000","last_clean":"2024-09-13T17:18:32.059236+0000","last_became_active":"2024-09-13T17:18:32.058270+0000","last_became_peered":"2024-09-13T17:18:32.058270+0000","last_unstale":"2024-09-13T17:18:32.059236+0000","last_undegraded":"2024-09-13T17:18:32.059236+0000","last_fullsized":"2024-09-13T17:18:32.059236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040619+0000","last_change":"2024-09-13T17:18:32.040619+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040619+0000","last_undegraded":"2024-09-13T17:18:32.040619+0000","last_fullsized":"2024-09-13T17:18:32.040619+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057811+0000","last_change":"2024-09-13T17:18:32.055699+0000","last_active":"2024-09-13T17:18:32.057811+0000","last_peered":"2024-09-13T17:18:32.057811+0000","last_clean":"2024-09-13T17:18:32.057811+0000","last_became_active":"2024-09-13T17:18:32.055400+0000","last_became_peered":"2024-09-13T17:18:32.055400+0000","last_unstale":"2024-09-13T17:18:32.057811+0000","last_undegraded":"2024-09-13T17:18:32.057811+0000","last_fullsized":"2024-09-13T17:18:32.057811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038949+0000","last_change":"2024-09-13T17:18:32.038949+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038949+0000","last_undegraded":"2024-09-13T17:18:32.038949+0000","last_fullsized":"2024-09-13T17:18:32.038949+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.044529+0000","last_change":"2024-09-13T17:18:32.043559+0000","last_active":"2024-09-13T17:18:32.044529+0000","last_peered":"2024-09-13T17:18:32.044529+0000","last_clean":"2024-09-13T17:18:32.044529+0000","last_became_active":"2024-09-13T17:18:32.043256+0000","last_became_peered":"2024-09-13T17:18:32.043256+0000","last_unstale":"2024-09-13T17:18:32.044529+0000","last_undegraded":"2024-09-13T17:18:32.044529+0000","last_fullsized":"2024-09-13T17:18:32.044529+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044020+0000","last_change":"2024-09-13T17:18:32.044020+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044020+0000","last_undegraded":"2024-09-13T17:18:32.044020+0000","last_fullsized":"2024-09-13T17:18:32.044020+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057566+0000","last_change":"2024-09-13T17:18:32.051660+0000","last_active":"2024-09-13T17:18:32.057566+0000","last_peered":"2024-09-13T17:18:32.057566+0000","last_clean":"2024-09-13T17:18:32.057566+0000","last_became_active":"2024-09-13T17:18:32.051389+0000","last_became_peered":"2024-09-13T17:18:32.051389+0000","last_unstale":"2024-09-13T17:18:32.057566+0000","last_undegraded":"2024-09-13T17:18:32.057566+0000","last_fullsized":"2024-09-13T17:18:32.057566+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041287+0000","last_change":"2024-09-13T17:18:32.041287+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041287+0000","last_undegraded":"2024-09-13T17:18:32.041287+0000","last_fullsized":"2024-09-13T17:18:32.041287+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057567+0000","last_change":"2024-09-13T17:18:32.056515+0000","last_active":"2024-09-13T17:18:32.057567+0000","last_peered":"2024-09-13T17:18:32.057567+0000","last_clean":"2024-09-13T17:18:32.057567+0000","last_became_active":"2024-09-13T17:18:32.056248+0000","last_became_peered":"2024-09-13T17:18:32.056248+0000","last_unstale":"2024-09-13T17:18:32.057567+0000","last_undegraded":"2024-09-13T17:18:32.057567+0000","last_fullsized":"2024-09-13T17:18:32.057567+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:56.745772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039552+0000","last_change":"2024-09-13T17:18:32.039552+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039552+0000","last_undegraded":"2024-09-13T17:18:32.039552+0000","last_fullsized":"2024-09-13T17:18:32.039552+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057613+0000","last_change":"2024-09-13T17:18:32.051852+0000","last_active":"2024-09-13T17:18:32.057613+0000","last_peered":"2024-09-13T17:18:32.057613+0000","last_clean":"2024-09-13T17:18:32.057613+0000","last_became_active":"2024-09-13T17:18:32.051491+0000","last_became_peered":"2024-09-13T17:18:32.051491+0000","last_unstale":"2024-09-13T17:18:32.057613+0000","last_undegraded":"2024-09-13T17:18:32.057613+0000","last_fullsized":"2024-09-13T17:18:32.057613+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.758976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046527+0000","last_change":"2024-09-13T17:18:32.046527+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046527+0000","last_undegraded":"2024-09-13T17:18:32.046527+0000","last_fullsized":"2024-09-13T17:18:32.046527+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053636+0000","last_change":"2024-09-13T17:18:32.052318+0000","last_active":"2024-09-13T17:18:32.053636+0000","last_peered":"2024-09-13T17:18:32.053636+0000","last_clean":"2024-09-13T17:18:32.053636+0000","last_became_active":"2024-09-13T17:18:32.052032+0000","last_became_peered":"2024-09-13T17:18:32.052032+0000","last_unstale":"2024-09-13T17:18:32.053636+0000","last_undegraded":"2024-09-13T17:18:32.053636+0000","last_fullsized":"2024-09-13T17:18:32.053636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:31.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043751+0000","last_change":"2024-09-13T17:18:32.043751+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043751+0000","last_undegraded":"2024-09-13T17:18:32.043751+0000","last_fullsized":"2024-09-13T17:18:32.043751+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057207+0000","last_change":"2024-09-13T17:18:32.052462+0000","last_active":"2024-09-13T17:18:32.057207+0000","last_peered":"2024-09-13T17:18:32.057207+0000","last_clean":"2024-09-13T17:18:32.057207+0000","last_became_active":"2024-09-13T17:18:32.052178+0000","last_became_peered":"2024-09-13T17:18:32.052178+0000","last_unstale":"2024-09-13T17:18:32.057207+0000","last_undegraded":"2024-09-13T17:18:32.057207+0000","last_fullsized":"2024-09-13T17:18:32.057207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047325+0000","last_change":"2024-09-13T17:18:32.047325+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047325+0000","last_undegraded":"2024-09-13T17:18:32.047325+0000","last_fullsized":"2024-09-13T17:18:32.047325+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057828+0000","last_change":"2024-09-13T17:18:32.052090+0000","last_active":"2024-09-13T17:18:32.057828+0000","last_peered":"2024-09-13T17:18:32.057828+0000","last_clean":"2024-09-13T17:18:32.057828+0000","last_became_active":"2024-09-13T17:18:32.051825+0000","last_became_peered":"2024-09-13T17:18:32.051825+0000","last_unstale":"2024-09-13T17:18:32.057828+0000","last_undegraded":"2024-09-13T17:18:32.057828+0000","last_fullsized":"2024-09-13T17:18:32.057828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:03.796734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.037448+0000","last_change":"2024-09-13T17:18:32.037448+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.037448+0000","last_undegraded":"2024-09-13T17:18:32.037448+0000","last_fullsized":"2024-09-13T17:18:32.037448+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055849+0000","last_change":"2024-09-13T17:18:32.054701+0000","last_active":"2024-09-13T17:18:32.055849+0000","last_peered":"2024-09-13T17:18:32.055849+0000","last_clean":"2024-09-13T17:18:32.055849+0000","last_became_active":"2024-09-13T17:18:32.054402+0000","last_became_peered":"2024-09-13T17:18:32.054402+0000","last_unstale":"2024-09-13T17:18:32.055849+0000","last_undegraded":"2024-09-13T17:18:32.055849+0000","last_fullsized":"2024-09-13T17:18:32.055849+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044082+0000","last_change":"2024-09-13T17:18:32.044082+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044082+0000","last_undegraded":"2024-09-13T17:18:32.044082+0000","last_fullsized":"2024-09-13T17:18:32.044082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.053111+0000","last_change":"2024-09-13T17:18:32.049352+0000","last_active":"2024-09-13T17:18:32.053111+0000","last_peered":"2024-09-13T17:18:32.053111+0000","last_clean":"2024-09-13T17:18:32.053111+0000","last_became_active":"2024-09-13T17:18:32.049083+0000","last_became_peered":"2024-09-13T17:18:32.049083+0000","last_unstale":"2024-09-13T17:18:32.053111+0000","last_undegraded":"2024-09-13T17:18:32.053111+0000","last_fullsized":"2024-09-13T17:18:32.053111+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:10.146181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044211+0000","last_change":"2024-09-13T17:18:32.044211+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044211+0000","last_undegraded":"2024-09-13T17:18:32.044211+0000","last_fullsized":"2024-09-13T17:18:32.044211+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.056366+0000","last_change":"2024-09-13T17:18:32.055502+0000","last_active":"2024-09-13T17:18:32.056366+0000","last_peered":"2024-09-13T17:18:32.056366+0000","last_clean":"2024-09-13T17:18:32.056366+0000","last_became_active":"2024-09-13T17:18:32.055221+0000","last_became_peered":"2024-09-13T17:18:32.055221+0000","last_unstale":"2024-09-13T17:18:32.056366+0000","last_undegraded":"2024-09-13T17:18:32.056366+0000","last_fullsized":"2024-09-13T17:18:32.056366+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:47.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040235+0000","last_change":"2024-09-13T17:18:32.040235+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040235+0000","last_undegraded":"2024-09-13T17:18:32.040235+0000","last_fullsized":"2024-09-13T17:18:32.040235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051391+0000","last_change":"2024-09-13T17:18:32.049724+0000","last_active":"2024-09-13T17:18:32.051391+0000","last_peered":"2024-09-13T17:18:32.051391+0000","last_clean":"2024-09-13T17:18:32.051391+0000","last_became_active":"2024-09-13T17:18:32.048989+0000","last_became_peered":"2024-09-13T17:18:32.048989+0000","last_unstale":"2024-09-13T17:18:32.051391+0000","last_undegraded":"2024-09-13T17:18:32.051391+0000","last_fullsized":"2024-09-13T17:18:32.051391+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.692313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044695+0000","last_change":"2024-09-13T17:18:32.044695+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044695+0000","last_undegraded":"2024-09-13T17:18:32.044695+0000","last_fullsized":"2024-09-13T17:18:32.044695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055101+0000","last_change":"2024-09-13T17:18:32.047867+0000","last_active":"2024-09-13T17:18:32.055101+0000","last_peered":"2024-09-13T17:18:32.055101+0000","last_clean":"2024-09-13T17:18:32.055101+0000","last_became_active":"2024-09-13T17:18:32.047515+0000","last_became_peered":"2024-09-13T17:18:32.047515+0000","last_unstale":"2024-09-13T17:18:32.055101+0000","last_undegraded":"2024-09-13T17:18:32.055101+0000","last_fullsized":"2024-09-13T17:18:32.055101+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.044878+0000","last_change":"2024-09-13T17:18:32.044878+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.044878+0000","last_undegraded":"2024-09-13T17:18:32.044878+0000","last_fullsized":"2024-09-13T17:18:32.044878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057271+0000","last_change":"2024-09-13T17:18:32.053603+0000","last_active":"2024-09-13T17:18:32.057271+0000","last_peered":"2024-09-13T17:18:32.057271+0000","last_clean":"2024-09-13T17:18:32.057271+0000","last_became_active":"2024-09-13T17:18:32.053322+0000","last_became_peered":"2024-09-13T17:18:32.053322+0000","last_unstale":"2024-09-13T17:18:32.057271+0000","last_undegraded":"2024-09-13T17:18:32.057271+0000","last_fullsized":"2024-09-13T17:18:32.057271+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047763+0000","last_change":"2024-09-13T17:18:32.047763+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047763+0000","last_undegraded":"2024-09-13T17:18:32.047763+0000","last_fullsized":"2024-09-13T17:18:32.047763+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.050959+0000","last_change":"2024-09-13T17:18:32.049980+0000","last_active":"2024-09-13T17:18:32.050959+0000","last_peered":"2024-09-13T17:18:32.050959+0000","last_clean":"2024-09-13T17:18:32.050959+0000","last_became_active":"2024-09-13T17:18:32.049675+0000","last_became_peered":"2024-09-13T17:18:32.049675+0000","last_unstale":"2024-09-13T17:18:32.050959+0000","last_undegraded":"2024-09-13T17:18:32.050959+0000","last_fullsized":"2024-09-13T17:18:32.050959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040144+0000","last_change":"2024-09-13T17:18:32.040144+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040144+0000","last_undegraded":"2024-09-13T17:18:32.040144+0000","last_fullsized":"2024-09-13T17:18:32.040144+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.052474+0000","last_change":"2024-09-13T17:18:32.051684+0000","last_active":"2024-09-13T17:18:32.052474+0000","last_peered":"2024-09-13T17:18:32.052474+0000","last_clean":"2024-09-13T17:18:32.052474+0000","last_became_active":"2024-09-13T17:18:32.051408+0000","last_became_peered":"2024-09-13T17:18:32.051408+0000","last_unstale":"2024-09-13T17:18:32.052474+0000","last_undegraded":"2024-09-13T17:18:32.052474+0000","last_fullsized":"2024-09-13T17:18:32.052474+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:24.762568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040723+0000","last_change":"2024-09-13T17:18:32.040723+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040723+0000","last_undegraded":"2024-09-13T17:18:32.040723+0000","last_fullsized":"2024-09-13T17:18:32.040723+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.048678+0000","last_change":"2024-09-13T17:18:32.045340+0000","last_active":"2024-09-13T17:18:32.048678+0000","last_peered":"2024-09-13T17:18:32.048678+0000","last_clean":"2024-09-13T17:18:32.048678+0000","last_became_active":"2024-09-13T17:18:32.045082+0000","last_became_peered":"2024-09-13T17:18:32.045082+0000","last_unstale":"2024-09-13T17:18:32.048678+0000","last_undegraded":"2024-09-13T17:18:32.048678+0000","last_fullsized":"2024-09-13T17:18:32.048678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.968862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040860+0000","last_change":"2024-09-13T17:18:32.040860+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040860+0000","last_undegraded":"2024-09-13T17:18:32.040860+0000","last_fullsized":"2024-09-13T17:18:32.040860+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.058085+0000","last_change":"2024-09-13T17:18:32.055416+0000","last_active":"2024-09-13T17:18:32.058085+0000","last_peered":"2024-09-13T17:18:32.058085+0000","last_clean":"2024-09-13T17:18:32.058085+0000","last_became_active":"2024-09-13T17:18:32.055170+0000","last_became_peered":"2024-09-13T17:18:32.055170+0000","last_unstale":"2024-09-13T17:18:32.058085+0000","last_undegraded":"2024-09-13T17:18:32.058085+0000","last_fullsized":"2024-09-13T17:18:32.058085+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046923+0000","last_change":"2024-09-13T17:18:32.046923+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046923+0000","last_undegraded":"2024-09-13T17:18:32.046923+0000","last_fullsized":"2024-09-13T17:18:32.046923+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049505+0000","last_change":"2024-09-13T17:18:32.048620+0000","last_active":"2024-09-13T17:18:32.049505+0000","last_peered":"2024-09-13T17:18:32.049505+0000","last_clean":"2024-09-13T17:18:32.049505+0000","last_became_active":"2024-09-13T17:18:32.048322+0000","last_became_peered":"2024-09-13T17:18:32.048322+0000","last_unstale":"2024-09-13T17:18:32.049505+0000","last_undegraded":"2024-09-13T17:18:32.049505+0000","last_fullsized":"2024-09-13T17:18:32.049505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.661885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.041509+0000","last_change":"2024-09-13T17:18:32.041509+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.041509+0000","last_undegraded":"2024-09-13T17:18:32.041509+0000","last_fullsized":"2024-09-13T17:18:32.041509+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055304+0000","last_change":"2024-09-13T17:18:32.054556+0000","last_active":"2024-09-13T17:18:32.055304+0000","last_peered":"2024-09-13T17:18:32.055304+0000","last_clean":"2024-09-13T17:18:32.055304+0000","last_became_active":"2024-09-13T17:18:32.054202+0000","last_became_peered":"2024-09-13T17:18:32.054202+0000","last_unstale":"2024-09-13T17:18:32.055304+0000","last_undegraded":"2024-09-13T17:18:32.055304+0000","last_fullsized":"2024-09-13T17:18:32.055304+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.039865+0000","last_change":"2024-09-13T17:18:32.039865+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.039865+0000","last_undegraded":"2024-09-13T17:18:32.039865+0000","last_fullsized":"2024-09-13T17:18:32.039865+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049468+0000","last_change":"2024-09-13T17:18:32.044430+0000","last_active":"2024-09-13T17:18:32.049468+0000","last_peered":"2024-09-13T17:18:32.049468+0000","last_clean":"2024-09-13T17:18:32.049468+0000","last_became_active":"2024-09-13T17:18:32.044134+0000","last_became_peered":"2024-09-13T17:18:32.044134+0000","last_unstale":"2024-09-13T17:18:32.049468+0000","last_undegraded":"2024-09-13T17:18:32.049468+0000","last_fullsized":"2024-09-13T17:18:32.049468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:10.753053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.040487+0000","last_change":"2024-09-13T17:18:32.040487+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.040487+0000","last_undegraded":"2024-09-13T17:18:32.040487+0000","last_fullsized":"2024-09-13T17:18:32.040487+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.057520+0000","last_change":"2024-09-13T17:18:32.053192+0000","last_active":"2024-09-13T17:18:32.057520+0000","last_peered":"2024-09-13T17:18:32.057520+0000","last_clean":"2024-09-13T17:18:32.057520+0000","last_became_active":"2024-09-13T17:18:32.052993+0000","last_became_peered":"2024-09-13T17:18:32.052993+0000","last_unstale":"2024-09-13T17:18:32.057520+0000","last_undegraded":"2024-09-13T17:18:32.057520+0000","last_fullsized":"2024-09-13T17:18:32.057520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038221+0000","last_change":"2024-09-13T17:18:32.038221+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038221+0000","last_undegraded":"2024-09-13T17:18:32.038221+0000","last_fullsized":"2024-09-13T17:18:32.038221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059254+0000","last_change":"2024-09-13T17:18:32.058647+0000","last_active":"2024-09-13T17:18:32.059254+0000","last_peered":"2024-09-13T17:18:32.059254+0000","last_clean":"2024-09-13T17:18:32.059254+0000","last_became_active":"2024-09-13T17:18:32.058335+0000","last_became_peered":"2024-09-13T17:18:32.058335+0000","last_unstale":"2024-09-13T17:18:32.059254+0000","last_undegraded":"2024-09-13T17:18:32.059254+0000","last_fullsized":"2024-09-13T17:18:32.059254+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:52.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.046286+0000","last_change":"2024-09-13T17:18:32.046286+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.046286+0000","last_undegraded":"2024-09-13T17:18:32.046286+0000","last_fullsized":"2024-09-13T17:18:32.046286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.051328+0000","last_change":"2024-09-13T17:18:32.049134+0000","last_active":"2024-09-13T17:18:32.051328+0000","last_peered":"2024-09-13T17:18:32.051328+0000","last_clean":"2024-09-13T17:18:32.051328+0000","last_became_active":"2024-09-13T17:18:32.048872+0000","last_became_peered":"2024-09-13T17:18:32.048872+0000","last_unstale":"2024-09-13T17:18:32.051328+0000","last_undegraded":"2024-09-13T17:18:32.051328+0000","last_fullsized":"2024-09-13T17:18:32.051328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:12.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.047194+0000","last_change":"2024-09-13T17:18:32.047194+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.047194+0000","last_undegraded":"2024-09-13T17:18:32.047194+0000","last_fullsized":"2024-09-13T17:18:32.047194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059186+0000","last_change":"2024-09-13T17:18:32.058217+0000","last_active":"2024-09-13T17:18:32.059186+0000","last_peered":"2024-09-13T17:18:32.059186+0000","last_clean":"2024-09-13T17:18:32.059186+0000","last_became_active":"2024-09-13T17:18:32.057860+0000","last_became_peered":"2024-09-13T17:18:32.057860+0000","last_unstale":"2024-09-13T17:18:32.059186+0000","last_undegraded":"2024-09-13T17:18:32.059186+0000","last_fullsized":"2024-09-13T17:18:32.059186+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:44.171955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.043425+0000","last_change":"2024-09-13T17:18:32.043425+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.043425+0000","last_undegraded":"2024-09-13T17:18:32.043425+0000","last_fullsized":"2024-09-13T17:18:32.043425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.055334+0000","last_change":"2024-09-13T17:18:32.050290+0000","last_active":"2024-09-13T17:18:32.055334+0000","last_peered":"2024-09-13T17:18:32.055334+0000","last_clean":"2024-09-13T17:18:32.055334+0000","last_became_active":"2024-09-13T17:18:32.050038+0000","last_became_peered":"2024-09-13T17:18:32.050038+0000","last_unstale":"2024-09-13T17:18:32.055334+0000","last_undegraded":"2024-09-13T17:18:32.055334+0000","last_fullsized":"2024-09-13T17:18:32.055334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.038329+0000","last_change":"2024-09-13T17:18:32.038329+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.038329+0000","last_undegraded":"2024-09-13T17:18:32.038329+0000","last_fullsized":"2024-09-13T17:18:32.038329+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.059156+0000","last_change":"2024-09-13T17:18:32.058246+0000","last_active":"2024-09-13T17:18:32.059156+0000","last_peered":"2024-09-13T17:18:32.059156+0000","last_clean":"2024-09-13T17:18:32.059156+0000","last_became_active":"2024-09-13T17:18:32.057888+0000","last_became_peered":"2024-09-13T17:18:32.057888+0000","last_unstale":"2024-09-13T17:18:32.059156+0000","last_undegraded":"2024-09-13T17:18:32.059156+0000","last_fullsized":"2024-09-13T17:18:32.059156+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:37.515238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-09-13T17:18:32.036938+0000","last_change":"2024-09-13T17:18:32.036938+0000","last_active":"2024-09-13T17:18:32.031556+0000","last_peered":"2024-09-13T17:18:32.031556+0000","last_clean":"2024-09-13T17:18:32.031556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:18:32.036938+0000","last_undegraded":"2024-09-13T17:18:32.036938+0000","last_fullsized":"2024-09-13T17:18:32.036938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.049480+0000","last_change":"2024-09-13T17:18:32.047953+0000","last_active":"2024-09-13T17:18:32.049480+0000","last_peered":"2024-09-13T17:18:32.049480+0000","last_clean":"2024-09-13T17:18:32.049480+0000","last_became_active":"2024-09-13T17:18:32.047691+0000","last_became_peered":"2024-09-13T17:18:32.047691+0000","last_unstale":"2024-09-13T17:18:32.049480+0000","last_undegraded":"2024-09-13T17:18:32.049480+0000","last_fullsized":"2024-09-13T17:18:32.049480+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:05.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-13T17:18:31.041688+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:18:31.041688+0000","last_peered":"2024-09-13T17:18:31.041688+0000","last_clean":"2024-09-13T17:18:31.041688+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:18:31.041688+0000","last_undegraded":"2024-09-13T17:18:31.041688+0000","last_fullsized":"2024-09-13T17:18:31.041688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1896448,"data_stored":1183382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70799999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":1.165,"15min":1.165},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":1.216,"15min":1.216},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76800000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":1.234,"15min":1.234},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":1.044,"15min":1.044},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.878,"15min":0.878},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67800000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69299999999999995,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70099999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.66600000000000004,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.378},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73799999999999999,"5min":1.173,"15min":1.173},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":1.008,"15min":1.008},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":1.085,"15min":1.085},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.47699999999999998},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.50700000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":1.034,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72699999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.622}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.622},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33300000000000002,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63400000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.245,"5min":0.214,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":1.458,"15min":1.458},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.23699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.437}]},{"osd":5,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88100000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.81000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":1.226,"15min":1.226},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32600000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.42499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.51000000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35799999999999998,"15min":0.36599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39900000000000002,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53100000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":0.871,"15min":0.871},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1290240,"data_stored":586419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.39400000000000002},"min":{"1min":0.252,"5min":0.223,"15min":0.223},"max":{"1min":0.56999999999999995,"5min":1.159,"15min":1.159},"last":0.315}]},{"osd":2,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.40500000000000003},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50800000000000001,"5min":1.081,"15min":1.081},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.45500000000000002,"5min":1.286,"15min":1.286},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.752,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73099999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.254,"15min":1.254},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1884160,"data_stored":1176787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54800000000000004,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.501,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61499999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.51600000000000001,"15min":0.433},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":14.262,"15min":14.262},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.33900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58999999999999997,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.98499999999999999,"5min":3.956,"15min":3.956},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":0.998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":4.069,"15min":4.069},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.026,"5min":4.04,"15min":4.04},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93500000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:38.314 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-09-13T17:18:38.312+0000 7fc12570e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:18:39.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:18:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.899+0000 7f6586918640 1 Processor -- start 2024-09-13T17:18:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.899+0000 7f6586918640 1 -- start start 2024-09-13T17:18:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f6586918640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f658015c9f0 0x7f65800b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f6586918640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f6586918640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658015cdd0 con 0x7f65800b4bf0 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f6586918640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65800b8750 con 0x7f658015c9f0 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f6586918640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800b5040 con 0x7f65800cd630 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f658015c9f0 0x7f65800b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f658015c9f0 0x7f65800b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59718/0 (socket says 172.21.15.5:59718) 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 -- 172.21.15.5:0/64314651 learned_addr learned my addr 172.21.15.5:0/64314651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657f7fe640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 -- 172.21.15.5:0/64314651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 msgr2=0x7f65800b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 -- 172.21.15.5:0/64314651 >> v1:172.21.15.179:6789/0 conn(0x7f65800b4bf0 legacy=0x7f65800d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:39.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.900+0000 7f657ffff640 1 -- 172.21.15.5:0/64314651 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800d3040 con 0x7f658015c9f0 2024-09-13T17:18:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.901+0000 7f657ffff640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f658015c9f0 0x7f65800b4170 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f65700098a0 tx=0x7f657002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f088a7b578f904 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.901+0000 7f657effd640 1 -- 172.21.15.5:0/64314651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570032440 con 0x7f658015c9f0 2024-09-13T17:18:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.901+0000 7f657effd640 1 -- 172.21.15.5:0/64314651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65700325a0 con 0x7f658015c9f0 2024-09-13T17:18:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.901+0000 7f657effd640 1 -- 172.21.15.5:0/64314651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570032930 con 0x7f658015c9f0 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 -- 172.21.15.5:0/64314651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f658015c9f0 msgr2=0x7f65800b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f658015c9f0 0x7f65800b4170 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f65700098a0 tx=0x7f657002a200 comp rx=0 tx=0).stop 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 -- 172.21.15.5:0/64314651 shutdown_connections 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 --2- 172.21.15.5:0/64314651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f658015c9f0 0x7f65800b4170 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 -- 172.21.15.5:0/64314651 >> 172.21.15.5:0/64314651 conn(0x7f6580071a20 msgr2=0x7f6580071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 -- 172.21.15.5:0/64314651 shutdown_connections 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.902+0000 7f6586918640 1 -- 172.21.15.5:0/64314651 wait complete. 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.903+0000 7f6586918640 1 Processor -- start 2024-09-13T17:18:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.903+0000 7f6586918640 1 -- start start 2024-09-13T17:18:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658015c9f0 0x7f65800c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65800d2c20 con 0x7f65800b4bf0 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580150080 con 0x7f658015c9f0 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6586918640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800cc120 con 0x7f65800cd630 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59730/0 (socket says 172.21.15.5:59730) 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 -- 172.21.15.5:0/170736703 learned_addr learned my addr 172.21.15.5:0/170736703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f6584eb5640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658015c9f0 0x7f65800c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657f7fe640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 -- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 msgr2=0x7f65800caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 -- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658015c9f0 msgr2=0x7f65800c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658015c9f0 0x7f65800c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.904+0000 7f657ffff640 1 -- 172.21.15.5:0/170736703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700094d0 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f657ffff640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6570000c00 tx=0x7f65700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570032440 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570030b80 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65800cb510 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657003d440 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.905+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65800cbad0 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.906+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65800b1e70 con 0x7f65800b4bf0 2024-09-13T17:18:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.906+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6570039040 con 0x7f65800b4bf0 2024-09-13T17:18:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.907+0000 7f657cff9640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 0x7f656c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.907+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f65700a9e80 con 0x7f65800b4bf0 2024-09-13T17:18:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.907+0000 7f657f7fe640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 0x7f656c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.908+0000 7f657f7fe640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 0x7f656c06d0c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f65801f5f30 tx=0x7f6574008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:39.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:39.911+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6570074fd0 con 0x7f65800b4bf0 2024-09-13T17:18:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.084+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65800d0310 con 0x7f656c06ac00 2024-09-13T17:18:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.092+0000 7f657cff9640 1 -- 172.21.15.5:0/170736703 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289984 (secure 0 0 0) 0x7f65800d0310 con 0x7f656c06ac00 2024-09-13T17:18:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:18:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 msgr2=0x7f656c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 0x7f656c06d0c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f65801f5f30 tx=0x7f6574008040 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 msgr2=0x7f658014fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6570000c00 tx=0x7f65700046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 shutdown_connections 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f658015c9f0 0x7f65800c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65800cd630 0x7f65800caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f656c06ac00 0x7f656c06d0c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 --2- 172.21.15.5:0/170736703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65800b4bf0 0x7f658014fb40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.095+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 >> 172.21.15.5:0/170736703 conn(0x7f6580071a20 msgr2=0x7f65800b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.096+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 shutdown_connections 2024-09-13T17:18:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.096+0000 7f6586918640 1 -- 172.21.15.5:0/170736703 wait complete. 2024-09-13T17:18:40.108 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-13T17:18:39.334953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252372,"kb_used_data":11592,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754722348,"statfs":{"total":773094113280,"available":772835684352,"internally_reserved":0,"allocated":11870208,"data_stored":6039292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.299560"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423529+0000","last_change":"2024-09-13T17:18:32.419955+0000","last_active":"2024-09-13T17:18:32.423529+0000","last_peered":"2024-09-13T17:18:32.423529+0000","last_clean":"2024-09-13T17:18:32.423529+0000","last_became_active":"2024-09-13T17:18:32.419522+0000","last_became_peered":"2024-09-13T17:18:32.419522+0000","last_unstale":"2024-09-13T17:18:32.423529+0000","last_undegraded":"2024-09-13T17:18:32.423529+0000","last_fullsized":"2024-09-13T17:18:32.423529+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:48:22.967769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437898+0000","last_change":"2024-09-13T17:18:32.435532+0000","last_active":"2024-09-13T17:18:32.437898+0000","last_peered":"2024-09-13T17:18:32.437898+0000","last_clean":"2024-09-13T17:18:32.437898+0000","last_became_active":"2024-09-13T17:18:32.435292+0000","last_became_peered":"2024-09-13T17:18:32.435292+0000","last_unstale":"2024-09-13T17:18:32.437898+0000","last_undegraded":"2024-09-13T17:18:32.437898+0000","last_fullsized":"2024-09-13T17:18:32.437898+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.425201+0000","last_change":"2024-09-13T17:18:32.423418+0000","last_active":"2024-09-13T17:18:32.425201+0000","last_peered":"2024-09-13T17:18:32.425201+0000","last_clean":"2024-09-13T17:18:32.425201+0000","last_became_active":"2024-09-13T17:18:32.423229+0000","last_became_peered":"2024-09-13T17:18:32.423229+0000","last_unstale":"2024-09-13T17:18:32.425201+0000","last_undegraded":"2024-09-13T17:18:32.425201+0000","last_fullsized":"2024-09-13T17:18:32.425201+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:26.548563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.422065+0000","last_change":"2024-09-13T17:18:32.421198+0000","last_active":"2024-09-13T17:18:32.422065+0000","last_peered":"2024-09-13T17:18:32.422065+0000","last_clean":"2024-09-13T17:18:32.422065+0000","last_became_active":"2024-09-13T17:18:32.420785+0000","last_became_peered":"2024-09-13T17:18:32.420785+0000","last_unstale":"2024-09-13T17:18:32.422065+0000","last_undegraded":"2024-09-13T17:18:32.422065+0000","last_fullsized":"2024-09-13T17:18:32.422065+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:36.721948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427424+0000","last_change":"2024-09-13T17:18:32.419565+0000","last_active":"2024-09-13T17:18:32.427424+0000","last_peered":"2024-09-13T17:18:32.427424+0000","last_clean":"2024-09-13T17:18:32.427424+0000","last_became_active":"2024-09-13T17:18:32.419326+0000","last_became_peered":"2024-09-13T17:18:32.419326+0000","last_unstale":"2024-09-13T17:18:32.427424+0000","last_undegraded":"2024-09-13T17:18:32.427424+0000","last_fullsized":"2024-09-13T17:18:32.427424+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437705+0000","last_change":"2024-09-13T17:18:32.435314+0000","last_active":"2024-09-13T17:18:32.437705+0000","last_peered":"2024-09-13T17:18:32.437705+0000","last_clean":"2024-09-13T17:18:32.437705+0000","last_became_active":"2024-09-13T17:18:32.434739+0000","last_became_peered":"2024-09-13T17:18:32.434739+0000","last_unstale":"2024-09-13T17:18:32.437705+0000","last_undegraded":"2024-09-13T17:18:32.437705+0000","last_fullsized":"2024-09-13T17:18:32.437705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437802+0000","last_change":"2024-09-13T17:18:32.435238+0000","last_active":"2024-09-13T17:18:32.437802+0000","last_peered":"2024-09-13T17:18:32.437802+0000","last_clean":"2024-09-13T17:18:32.437802+0000","last_became_active":"2024-09-13T17:18:32.434444+0000","last_became_peered":"2024-09-13T17:18:32.434444+0000","last_unstale":"2024-09-13T17:18:32.437802+0000","last_undegraded":"2024-09-13T17:18:32.437802+0000","last_fullsized":"2024-09-13T17:18:32.437802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430735+0000","last_change":"2024-09-13T17:18:32.429093+0000","last_active":"2024-09-13T17:18:32.430735+0000","last_peered":"2024-09-13T17:18:32.430735+0000","last_clean":"2024-09-13T17:18:32.430735+0000","last_became_active":"2024-09-13T17:18:32.428233+0000","last_became_peered":"2024-09-13T17:18:32.428233+0000","last_unstale":"2024-09-13T17:18:32.430735+0000","last_undegraded":"2024-09-13T17:18:32.430735+0000","last_fullsized":"2024-09-13T17:18:32.430735+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:40.772155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437776+0000","last_change":"2024-09-13T17:18:32.435217+0000","last_active":"2024-09-13T17:18:32.437776+0000","last_peered":"2024-09-13T17:18:32.437776+0000","last_clean":"2024-09-13T17:18:32.437776+0000","last_became_active":"2024-09-13T17:18:32.434769+0000","last_became_peered":"2024-09-13T17:18:32.434769+0000","last_unstale":"2024-09-13T17:18:32.437776+0000","last_undegraded":"2024-09-13T17:18:32.437776+0000","last_fullsized":"2024-09-13T17:18:32.437776+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437892+0000","last_change":"2024-09-13T17:18:32.437358+0000","last_active":"2024-09-13T17:18:32.437892+0000","last_peered":"2024-09-13T17:18:32.437892+0000","last_clean":"2024-09-13T17:18:32.437892+0000","last_became_active":"2024-09-13T17:18:32.437057+0000","last_became_peered":"2024-09-13T17:18:32.437057+0000","last_unstale":"2024-09-13T17:18:32.437892+0000","last_undegraded":"2024-09-13T17:18:32.437892+0000","last_fullsized":"2024-09-13T17:18:32.437892+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:58.047559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.442244+0000","last_change":"2024-09-13T17:18:32.435942+0000","last_active":"2024-09-13T17:18:32.442244+0000","last_peered":"2024-09-13T17:18:32.442244+0000","last_clean":"2024-09-13T17:18:32.442244+0000","last_became_active":"2024-09-13T17:18:32.435644+0000","last_became_peered":"2024-09-13T17:18:32.435644+0000","last_unstale":"2024-09-13T17:18:32.442244+0000","last_undegraded":"2024-09-13T17:18:32.442244+0000","last_fullsized":"2024-09-13T17:18:32.442244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:38.803551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433337+0000","last_change":"2024-09-13T17:18:32.426512+0000","last_active":"2024-09-13T17:18:32.433337+0000","last_peered":"2024-09-13T17:18:32.433337+0000","last_clean":"2024-09-13T17:18:32.433337+0000","last_became_active":"2024-09-13T17:18:32.426268+0000","last_became_peered":"2024-09-13T17:18:32.426268+0000","last_unstale":"2024-09-13T17:18:32.433337+0000","last_undegraded":"2024-09-13T17:18:32.433337+0000","last_fullsized":"2024-09-13T17:18:32.433337+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423331+0000","last_change":"2024-09-13T17:18:32.422495+0000","last_active":"2024-09-13T17:18:32.423331+0000","last_peered":"2024-09-13T17:18:32.423331+0000","last_clean":"2024-09-13T17:18:32.423331+0000","last_became_active":"2024-09-13T17:18:32.422249+0000","last_became_peered":"2024-09-13T17:18:32.422249+0000","last_unstale":"2024-09-13T17:18:32.423331+0000","last_undegraded":"2024-09-13T17:18:32.423331+0000","last_fullsized":"2024-09-13T17:18:32.423331+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:18.352351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.429539+0000","last_change":"2024-09-13T17:18:32.426283+0000","last_active":"2024-09-13T17:18:32.429539+0000","last_peered":"2024-09-13T17:18:32.429539+0000","last_clean":"2024-09-13T17:18:32.429539+0000","last_became_active":"2024-09-13T17:18:32.425915+0000","last_became_peered":"2024-09-13T17:18:32.425915+0000","last_unstale":"2024-09-13T17:18:32.429539+0000","last_undegraded":"2024-09-13T17:18:32.429539+0000","last_fullsized":"2024-09-13T17:18:32.429539+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430935+0000","last_change":"2024-09-13T17:18:32.428901+0000","last_active":"2024-09-13T17:18:32.430935+0000","last_peered":"2024-09-13T17:18:32.430935+0000","last_clean":"2024-09-13T17:18:32.430935+0000","last_became_active":"2024-09-13T17:18:32.428602+0000","last_became_peered":"2024-09-13T17:18:32.428602+0000","last_unstale":"2024-09-13T17:18:32.430935+0000","last_undegraded":"2024-09-13T17:18:32.430935+0000","last_fullsized":"2024-09-13T17:18:32.430935+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430099+0000","last_change":"2024-09-13T17:18:32.426446+0000","last_active":"2024-09-13T17:18:32.430099+0000","last_peered":"2024-09-13T17:18:32.430099+0000","last_clean":"2024-09-13T17:18:32.430099+0000","last_became_active":"2024-09-13T17:18:32.426124+0000","last_became_peered":"2024-09-13T17:18:32.426124+0000","last_unstale":"2024-09-13T17:18:32.430099+0000","last_undegraded":"2024-09-13T17:18:32.430099+0000","last_fullsized":"2024-09-13T17:18:32.430099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423627+0000","last_change":"2024-09-13T17:18:32.422693+0000","last_active":"2024-09-13T17:18:32.423627+0000","last_peered":"2024-09-13T17:18:32.423627+0000","last_clean":"2024-09-13T17:18:32.423627+0000","last_became_active":"2024-09-13T17:18:32.422412+0000","last_became_peered":"2024-09-13T17:18:32.422412+0000","last_unstale":"2024-09-13T17:18:32.423627+0000","last_undegraded":"2024-09-13T17:18:32.423627+0000","last_fullsized":"2024-09-13T17:18:32.423627+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:31.966339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437887+0000","last_change":"2024-09-13T17:18:32.435048+0000","last_active":"2024-09-13T17:18:32.437887+0000","last_peered":"2024-09-13T17:18:32.437887+0000","last_clean":"2024-09-13T17:18:32.437887+0000","last_became_active":"2024-09-13T17:18:32.434601+0000","last_became_peered":"2024-09-13T17:18:32.434601+0000","last_unstale":"2024-09-13T17:18:32.437887+0000","last_undegraded":"2024-09-13T17:18:32.437887+0000","last_fullsized":"2024-09-13T17:18:32.437887+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:12.755359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.436680+0000","last_change":"2024-09-13T17:18:32.435655+0000","last_active":"2024-09-13T17:18:32.436680+0000","last_peered":"2024-09-13T17:18:32.436680+0000","last_clean":"2024-09-13T17:18:32.436680+0000","last_became_active":"2024-09-13T17:18:32.435282+0000","last_became_peered":"2024-09-13T17:18:32.435282+0000","last_unstale":"2024-09-13T17:18:32.436680+0000","last_undegraded":"2024-09-13T17:18:32.436680+0000","last_fullsized":"2024-09-13T17:18:32.436680+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.852947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433356+0000","last_change":"2024-09-13T17:18:32.427352+0000","last_active":"2024-09-13T17:18:32.433356+0000","last_peered":"2024-09-13T17:18:32.433356+0000","last_clean":"2024-09-13T17:18:32.433356+0000","last_became_active":"2024-09-13T17:18:32.427079+0000","last_became_peered":"2024-09-13T17:18:32.427079+0000","last_unstale":"2024-09-13T17:18:32.433356+0000","last_undegraded":"2024-09-13T17:18:32.433356+0000","last_fullsized":"2024-09-13T17:18:32.433356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.424472+0000","last_change":"2024-09-13T17:18:32.423678+0000","last_active":"2024-09-13T17:18:32.424472+0000","last_peered":"2024-09-13T17:18:32.424472+0000","last_clean":"2024-09-13T17:18:32.424472+0000","last_became_active":"2024-09-13T17:18:32.423162+0000","last_became_peered":"2024-09-13T17:18:32.423162+0000","last_unstale":"2024-09-13T17:18:32.424472+0000","last_undegraded":"2024-09-13T17:18:32.424472+0000","last_fullsized":"2024-09-13T17:18:32.424472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:10.784630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427709+0000","last_change":"2024-09-13T17:18:32.422563+0000","last_active":"2024-09-13T17:18:32.427709+0000","last_peered":"2024-09-13T17:18:32.427709+0000","last_clean":"2024-09-13T17:18:32.427709+0000","last_became_active":"2024-09-13T17:18:32.422311+0000","last_became_peered":"2024-09-13T17:18:32.422311+0000","last_unstale":"2024-09-13T17:18:32.427709+0000","last_undegraded":"2024-09-13T17:18:32.427709+0000","last_fullsized":"2024-09-13T17:18:32.427709+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:11.147889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.425124+0000","last_change":"2024-09-13T17:18:32.423203+0000","last_active":"2024-09-13T17:18:32.425124+0000","last_peered":"2024-09-13T17:18:32.425124+0000","last_clean":"2024-09-13T17:18:32.425124+0000","last_became_active":"2024-09-13T17:18:32.422918+0000","last_became_peered":"2024-09-13T17:18:32.422918+0000","last_unstale":"2024-09-13T17:18:32.425124+0000","last_undegraded":"2024-09-13T17:18:32.425124+0000","last_fullsized":"2024-09-13T17:18:32.425124+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:23.419369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427316+0000","last_change":"2024-09-13T17:18:32.424261+0000","last_active":"2024-09-13T17:18:32.427316+0000","last_peered":"2024-09-13T17:18:32.427316+0000","last_clean":"2024-09-13T17:18:32.427316+0000","last_became_active":"2024-09-13T17:18:32.423971+0000","last_became_peered":"2024-09-13T17:18:32.423971+0000","last_unstale":"2024-09-13T17:18:32.427316+0000","last_undegraded":"2024-09-13T17:18:32.427316+0000","last_fullsized":"2024-09-13T17:18:32.427316+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431531+0000","last_change":"2024-09-13T17:18:32.422953+0000","last_active":"2024-09-13T17:18:32.431531+0000","last_peered":"2024-09-13T17:18:32.431531+0000","last_clean":"2024-09-13T17:18:32.431531+0000","last_became_active":"2024-09-13T17:18:32.422657+0000","last_became_peered":"2024-09-13T17:18:32.422657+0000","last_unstale":"2024-09-13T17:18:32.431531+0000","last_undegraded":"2024-09-13T17:18:32.431531+0000","last_fullsized":"2024-09-13T17:18:32.431531+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.442358+0000","last_change":"2024-09-13T17:18:32.437612+0000","last_active":"2024-09-13T17:18:32.442358+0000","last_peered":"2024-09-13T17:18:32.442358+0000","last_clean":"2024-09-13T17:18:32.442358+0000","last_became_active":"2024-09-13T17:18:32.437253+0000","last_became_peered":"2024-09-13T17:18:32.437253+0000","last_unstale":"2024-09-13T17:18:32.442358+0000","last_undegraded":"2024-09-13T17:18:32.442358+0000","last_fullsized":"2024-09-13T17:18:32.442358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:46.545937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433501+0000","last_change":"2024-09-13T17:18:32.429178+0000","last_active":"2024-09-13T17:18:32.433501+0000","last_peered":"2024-09-13T17:18:32.433501+0000","last_clean":"2024-09-13T17:18:32.433501+0000","last_became_active":"2024-09-13T17:18:32.428903+0000","last_became_peered":"2024-09-13T17:18:32.428903+0000","last_unstale":"2024-09-13T17:18:32.433501+0000","last_undegraded":"2024-09-13T17:18:32.433501+0000","last_fullsized":"2024-09-13T17:18:32.433501+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.442645+0000","last_change":"2024-09-13T17:18:32.437341+0000","last_active":"2024-09-13T17:18:32.442645+0000","last_peered":"2024-09-13T17:18:32.442645+0000","last_clean":"2024-09-13T17:18:32.442645+0000","last_became_active":"2024-09-13T17:18:32.436587+0000","last_became_peered":"2024-09-13T17:18:32.436587+0000","last_unstale":"2024-09-13T17:18:32.442645+0000","last_undegraded":"2024-09-13T17:18:32.442645+0000","last_fullsized":"2024-09-13T17:18:32.442645+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.429132+0000","last_change":"2024-09-13T17:18:32.427107+0000","last_active":"2024-09-13T17:18:32.429132+0000","last_peered":"2024-09-13T17:18:32.429132+0000","last_clean":"2024-09-13T17:18:32.429132+0000","last_became_active":"2024-09-13T17:18:32.426868+0000","last_became_peered":"2024-09-13T17:18:32.426868+0000","last_unstale":"2024-09-13T17:18:32.429132+0000","last_undegraded":"2024-09-13T17:18:32.429132+0000","last_fullsized":"2024-09-13T17:18:32.429132+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:52.460362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431390+0000","last_change":"2024-09-13T17:18:32.423062+0000","last_active":"2024-09-13T17:18:32.431390+0000","last_peered":"2024-09-13T17:18:32.431390+0000","last_clean":"2024-09-13T17:18:32.431390+0000","last_became_active":"2024-09-13T17:18:32.422500+0000","last_became_peered":"2024-09-13T17:18:32.422500+0000","last_unstale":"2024-09-13T17:18:32.431390+0000","last_undegraded":"2024-09-13T17:18:32.431390+0000","last_fullsized":"2024-09-13T17:18:32.431390+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437784+0000","last_change":"2024-09-13T17:18:32.434588+0000","last_active":"2024-09-13T17:18:32.437784+0000","last_peered":"2024-09-13T17:18:32.437784+0000","last_clean":"2024-09-13T17:18:32.437784+0000","last_became_active":"2024-09-13T17:18:32.434137+0000","last_became_peered":"2024-09-13T17:18:32.434137+0000","last_unstale":"2024-09-13T17:18:32.437784+0000","last_undegraded":"2024-09-13T17:18:32.437784+0000","last_fullsized":"2024-09-13T17:18:32.437784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:26.117131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431214+0000","last_change":"2024-09-13T17:18:32.429973+0000","last_active":"2024-09-13T17:18:32.431214+0000","last_peered":"2024-09-13T17:18:32.431214+0000","last_clean":"2024-09-13T17:18:32.431214+0000","last_became_active":"2024-09-13T17:18:32.429718+0000","last_became_peered":"2024-09-13T17:18:32.429718+0000","last_unstale":"2024-09-13T17:18:32.431214+0000","last_undegraded":"2024-09-13T17:18:32.431214+0000","last_fullsized":"2024-09-13T17:18:32.431214+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.612918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437082+0000","last_change":"2024-09-13T17:18:32.436021+0000","last_active":"2024-09-13T17:18:32.437082+0000","last_peered":"2024-09-13T17:18:32.437082+0000","last_clean":"2024-09-13T17:18:32.437082+0000","last_became_active":"2024-09-13T17:18:32.435772+0000","last_became_peered":"2024-09-13T17:18:32.435772+0000","last_unstale":"2024-09-13T17:18:32.437082+0000","last_undegraded":"2024-09-13T17:18:32.437082+0000","last_fullsized":"2024-09-13T17:18:32.437082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:38.145220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.432777+0000","last_change":"2024-09-13T17:18:32.053380+0000","last_active":"2024-09-13T17:18:32.432777+0000","last_peered":"2024-09-13T17:18:32.432777+0000","last_clean":"2024-09-13T17:18:32.432777+0000","last_became_active":"2024-09-13T17:18:32.053093+0000","last_became_peered":"2024-09-13T17:18:32.053093+0000","last_unstale":"2024-09-13T17:18:32.432777+0000","last_undegraded":"2024-09-13T17:18:32.432777+0000","last_fullsized":"2024-09-13T17:18:32.432777+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:19.522901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430250+0000","last_change":"2024-09-13T17:18:32.428510+0000","last_active":"2024-09-13T17:18:32.430250+0000","last_peered":"2024-09-13T17:18:32.430250+0000","last_clean":"2024-09-13T17:18:32.430250+0000","last_became_active":"2024-09-13T17:18:32.428269+0000","last_became_peered":"2024-09-13T17:18:32.428269+0000","last_unstale":"2024-09-13T17:18:32.430250+0000","last_undegraded":"2024-09-13T17:18:32.430250+0000","last_fullsized":"2024-09-13T17:18:32.430250+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:34.070106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.426062+0000","last_change":"2024-09-13T17:18:32.046895+0000","last_active":"2024-09-13T17:18:32.426062+0000","last_peered":"2024-09-13T17:18:32.426062+0000","last_clean":"2024-09-13T17:18:32.426062+0000","last_became_active":"2024-09-13T17:18:32.046631+0000","last_became_peered":"2024-09-13T17:18:32.046631+0000","last_unstale":"2024-09-13T17:18:32.426062+0000","last_undegraded":"2024-09-13T17:18:32.426062+0000","last_fullsized":"2024-09-13T17:18:32.426062+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:50.355643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.425692+0000","last_change":"2024-09-13T17:18:32.417771+0000","last_active":"2024-09-13T17:18:32.425692+0000","last_peered":"2024-09-13T17:18:32.425692+0000","last_clean":"2024-09-13T17:18:32.425692+0000","last_became_active":"2024-09-13T17:18:32.417412+0000","last_became_peered":"2024-09-13T17:18:32.417412+0000","last_unstale":"2024-09-13T17:18:32.425692+0000","last_undegraded":"2024-09-13T17:18:32.425692+0000","last_fullsized":"2024-09-13T17:18:32.425692+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431739+0000","last_change":"2024-09-13T17:18:32.046706+0000","last_active":"2024-09-13T17:18:32.431739+0000","last_peered":"2024-09-13T17:18:32.431739+0000","last_clean":"2024-09-13T17:18:32.431739+0000","last_became_active":"2024-09-13T17:18:32.046095+0000","last_became_peered":"2024-09-13T17:18:32.046095+0000","last_unstale":"2024-09-13T17:18:32.431739+0000","last_undegraded":"2024-09-13T17:18:32.431739+0000","last_fullsized":"2024-09-13T17:18:32.431739+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.426004+0000","last_change":"2024-09-13T17:18:32.420375+0000","last_active":"2024-09-13T17:18:32.426004+0000","last_peered":"2024-09-13T17:18:32.426004+0000","last_clean":"2024-09-13T17:18:32.426004+0000","last_became_active":"2024-09-13T17:18:32.420096+0000","last_became_peered":"2024-09-13T17:18:32.420096+0000","last_unstale":"2024-09-13T17:18:32.426004+0000","last_undegraded":"2024-09-13T17:18:32.426004+0000","last_fullsized":"2024-09-13T17:18:32.426004+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:14.556340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433506+0000","last_change":"2024-09-13T17:18:32.058586+0000","last_active":"2024-09-13T17:18:32.433506+0000","last_peered":"2024-09-13T17:18:32.433506+0000","last_clean":"2024-09-13T17:18:32.433506+0000","last_became_active":"2024-09-13T17:18:32.058270+0000","last_became_peered":"2024-09-13T17:18:32.058270+0000","last_unstale":"2024-09-13T17:18:32.433506+0000","last_undegraded":"2024-09-13T17:18:32.433506+0000","last_fullsized":"2024-09-13T17:18:32.433506+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.416670+0000","last_change":"2024-09-13T17:18:32.415477+0000","last_active":"2024-09-13T17:18:32.416670+0000","last_peered":"2024-09-13T17:18:32.416670+0000","last_clean":"2024-09-13T17:18:32.416670+0000","last_became_active":"2024-09-13T17:18:32.415227+0000","last_became_peered":"2024-09-13T17:18:32.415227+0000","last_unstale":"2024-09-13T17:18:32.416670+0000","last_undegraded":"2024-09-13T17:18:32.416670+0000","last_fullsized":"2024-09-13T17:18:32.416670+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:18.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431140+0000","last_change":"2024-09-13T17:18:32.055699+0000","last_active":"2024-09-13T17:18:32.431140+0000","last_peered":"2024-09-13T17:18:32.431140+0000","last_clean":"2024-09-13T17:18:32.431140+0000","last_became_active":"2024-09-13T17:18:32.055400+0000","last_became_peered":"2024-09-13T17:18:32.055400+0000","last_unstale":"2024-09-13T17:18:32.431140+0000","last_undegraded":"2024-09-13T17:18:32.431140+0000","last_fullsized":"2024-09-13T17:18:32.431140+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:31.515450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437106+0000","last_change":"2024-09-13T17:18:32.436450+0000","last_active":"2024-09-13T17:18:32.437106+0000","last_peered":"2024-09-13T17:18:32.437106+0000","last_clean":"2024-09-13T17:18:32.437106+0000","last_became_active":"2024-09-13T17:18:32.436193+0000","last_became_peered":"2024-09-13T17:18:32.436193+0000","last_unstale":"2024-09-13T17:18:32.437106+0000","last_undegraded":"2024-09-13T17:18:32.437106+0000","last_fullsized":"2024-09-13T17:18:32.437106+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:12.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431375+0000","last_change":"2024-09-13T17:18:32.043559+0000","last_active":"2024-09-13T17:18:32.431375+0000","last_peered":"2024-09-13T17:18:32.431375+0000","last_clean":"2024-09-13T17:18:32.431375+0000","last_became_active":"2024-09-13T17:18:32.043256+0000","last_became_peered":"2024-09-13T17:18:32.043256+0000","last_unstale":"2024-09-13T17:18:32.431375+0000","last_undegraded":"2024-09-13T17:18:32.431375+0000","last_fullsized":"2024-09-13T17:18:32.431375+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437567+0000","last_change":"2024-09-13T17:18:32.434444+0000","last_active":"2024-09-13T17:18:32.437567+0000","last_peered":"2024-09-13T17:18:32.437567+0000","last_clean":"2024-09-13T17:18:32.437567+0000","last_became_active":"2024-09-13T17:18:32.434113+0000","last_became_peered":"2024-09-13T17:18:32.434113+0000","last_unstale":"2024-09-13T17:18:32.437567+0000","last_undegraded":"2024-09-13T17:18:32.437567+0000","last_fullsized":"2024-09-13T17:18:32.437567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.416265+0000","last_change":"2024-09-13T17:18:32.051660+0000","last_active":"2024-09-13T17:18:32.416265+0000","last_peered":"2024-09-13T17:18:32.416265+0000","last_clean":"2024-09-13T17:18:32.416265+0000","last_became_active":"2024-09-13T17:18:32.051389+0000","last_became_peered":"2024-09-13T17:18:32.051389+0000","last_unstale":"2024-09-13T17:18:32.416265+0000","last_undegraded":"2024-09-13T17:18:32.416265+0000","last_fullsized":"2024-09-13T17:18:32.416265+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.419401+0000","last_change":"2024-09-13T17:18:32.418206+0000","last_active":"2024-09-13T17:18:32.419401+0000","last_peered":"2024-09-13T17:18:32.419401+0000","last_clean":"2024-09-13T17:18:32.419401+0000","last_became_active":"2024-09-13T17:18:32.417958+0000","last_became_peered":"2024-09-13T17:18:32.417958+0000","last_unstale":"2024-09-13T17:18:32.419401+0000","last_undegraded":"2024-09-13T17:18:32.419401+0000","last_fullsized":"2024-09-13T17:18:32.419401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:26:09.373594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.406804+0000","last_change":"2024-09-13T17:18:32.056515+0000","last_active":"2024-09-13T17:18:32.406804+0000","last_peered":"2024-09-13T17:18:32.406804+0000","last_clean":"2024-09-13T17:18:32.406804+0000","last_became_active":"2024-09-13T17:18:32.056248+0000","last_became_peered":"2024-09-13T17:18:32.056248+0000","last_unstale":"2024-09-13T17:18:32.406804+0000","last_undegraded":"2024-09-13T17:18:32.406804+0000","last_fullsized":"2024-09-13T17:18:32.406804+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:56.745772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.436651+0000","last_change":"2024-09-13T17:18:32.435373+0000","last_active":"2024-09-13T17:18:32.436651+0000","last_peered":"2024-09-13T17:18:32.436651+0000","last_clean":"2024-09-13T17:18:32.436651+0000","last_became_active":"2024-09-13T17:18:32.435098+0000","last_became_peered":"2024-09-13T17:18:32.435098+0000","last_unstale":"2024-09-13T17:18:32.436651+0000","last_undegraded":"2024-09-13T17:18:32.436651+0000","last_fullsized":"2024-09-13T17:18:32.436651+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.214464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.416631+0000","last_change":"2024-09-13T17:18:32.051852+0000","last_active":"2024-09-13T17:18:32.416631+0000","last_peered":"2024-09-13T17:18:32.416631+0000","last_clean":"2024-09-13T17:18:32.416631+0000","last_became_active":"2024-09-13T17:18:32.051491+0000","last_became_peered":"2024-09-13T17:18:32.051491+0000","last_unstale":"2024-09-13T17:18:32.416631+0000","last_undegraded":"2024-09-13T17:18:32.416631+0000","last_fullsized":"2024-09-13T17:18:32.416631+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.758976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.426516+0000","last_change":"2024-09-13T17:18:32.418738+0000","last_active":"2024-09-13T17:18:32.426516+0000","last_peered":"2024-09-13T17:18:32.426516+0000","last_clean":"2024-09-13T17:18:32.426516+0000","last_became_active":"2024-09-13T17:18:32.418387+0000","last_became_peered":"2024-09-13T17:18:32.418387+0000","last_unstale":"2024-09-13T17:18:32.426516+0000","last_undegraded":"2024-09-13T17:18:32.426516+0000","last_fullsized":"2024-09-13T17:18:32.426516+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:20.524609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.410476+0000","last_change":"2024-09-13T17:18:32.052318+0000","last_active":"2024-09-13T17:18:32.410476+0000","last_peered":"2024-09-13T17:18:32.410476+0000","last_clean":"2024-09-13T17:18:32.410476+0000","last_became_active":"2024-09-13T17:18:32.052032+0000","last_became_peered":"2024-09-13T17:18:32.052032+0000","last_unstale":"2024-09-13T17:18:32.410476+0000","last_undegraded":"2024-09-13T17:18:32.410476+0000","last_fullsized":"2024-09-13T17:18:32.410476+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:31.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430194+0000","last_change":"2024-09-13T17:18:32.428986+0000","last_active":"2024-09-13T17:18:32.430194+0000","last_peered":"2024-09-13T17:18:32.430194+0000","last_clean":"2024-09-13T17:18:32.430194+0000","last_became_active":"2024-09-13T17:18:32.428753+0000","last_became_peered":"2024-09-13T17:18:32.428753+0000","last_unstale":"2024-09-13T17:18:32.430194+0000","last_undegraded":"2024-09-13T17:18:32.430194+0000","last_fullsized":"2024-09-13T17:18:32.430194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:56.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.428331+0000","last_change":"2024-09-13T17:18:32.052462+0000","last_active":"2024-09-13T17:18:32.428331+0000","last_peered":"2024-09-13T17:18:32.428331+0000","last_clean":"2024-09-13T17:18:32.428331+0000","last_became_active":"2024-09-13T17:18:32.052178+0000","last_became_peered":"2024-09-13T17:18:32.052178+0000","last_unstale":"2024-09-13T17:18:32.428331+0000","last_undegraded":"2024-09-13T17:18:32.428331+0000","last_fullsized":"2024-09-13T17:18:32.428331+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427403+0000","last_change":"2024-09-13T17:18:32.419226+0000","last_active":"2024-09-13T17:18:32.427403+0000","last_peered":"2024-09-13T17:18:32.427403+0000","last_clean":"2024-09-13T17:18:32.427403+0000","last_became_active":"2024-09-13T17:18:32.418985+0000","last_became_peered":"2024-09-13T17:18:32.418985+0000","last_unstale":"2024-09-13T17:18:32.427403+0000","last_undegraded":"2024-09-13T17:18:32.427403+0000","last_fullsized":"2024-09-13T17:18:32.427403+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.442779+0000","last_change":"2024-09-13T17:18:32.052090+0000","last_active":"2024-09-13T17:18:32.442779+0000","last_peered":"2024-09-13T17:18:32.442779+0000","last_clean":"2024-09-13T17:18:32.442779+0000","last_became_active":"2024-09-13T17:18:32.051825+0000","last_became_peered":"2024-09-13T17:18:32.051825+0000","last_unstale":"2024-09-13T17:18:32.442779+0000","last_undegraded":"2024-09-13T17:18:32.442779+0000","last_fullsized":"2024-09-13T17:18:32.442779+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:03.796734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427830+0000","last_change":"2024-09-13T17:18:32.422046+0000","last_active":"2024-09-13T17:18:32.427830+0000","last_peered":"2024-09-13T17:18:32.427830+0000","last_clean":"2024-09-13T17:18:32.427830+0000","last_became_active":"2024-09-13T17:18:32.421827+0000","last_became_peered":"2024-09-13T17:18:32.421827+0000","last_unstale":"2024-09-13T17:18:32.427830+0000","last_undegraded":"2024-09-13T17:18:32.427830+0000","last_fullsized":"2024-09-13T17:18:32.427830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:21.611055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.432563+0000","last_change":"2024-09-13T17:18:32.054701+0000","last_active":"2024-09-13T17:18:32.432563+0000","last_peered":"2024-09-13T17:18:32.432563+0000","last_clean":"2024-09-13T17:18:32.432563+0000","last_became_active":"2024-09-13T17:18:32.054402+0000","last_became_peered":"2024-09-13T17:18:32.054402+0000","last_unstale":"2024-09-13T17:18:32.432563+0000","last_undegraded":"2024-09-13T17:18:32.432563+0000","last_fullsized":"2024-09-13T17:18:32.432563+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:20.609347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437818+0000","last_change":"2024-09-13T17:18:32.435687+0000","last_active":"2024-09-13T17:18:32.437818+0000","last_peered":"2024-09-13T17:18:32.437818+0000","last_clean":"2024-09-13T17:18:32.437818+0000","last_became_active":"2024-09-13T17:18:32.434763+0000","last_became_peered":"2024-09-13T17:18:32.434763+0000","last_unstale":"2024-09-13T17:18:32.437818+0000","last_undegraded":"2024-09-13T17:18:32.437818+0000","last_fullsized":"2024-09-13T17:18:32.437818+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:41.771534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.406920+0000","last_change":"2024-09-13T17:18:32.049352+0000","last_active":"2024-09-13T17:18:32.406920+0000","last_peered":"2024-09-13T17:18:32.406920+0000","last_clean":"2024-09-13T17:18:32.406920+0000","last_became_active":"2024-09-13T17:18:32.049083+0000","last_became_peered":"2024-09-13T17:18:32.049083+0000","last_unstale":"2024-09-13T17:18:32.406920+0000","last_undegraded":"2024-09-13T17:18:32.406920+0000","last_fullsized":"2024-09-13T17:18:32.406920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:10.146181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431802+0000","last_change":"2024-09-13T17:18:32.430677+0000","last_active":"2024-09-13T17:18:32.431802+0000","last_peered":"2024-09-13T17:18:32.431802+0000","last_clean":"2024-09-13T17:18:32.431802+0000","last_became_active":"2024-09-13T17:18:32.430425+0000","last_became_peered":"2024-09-13T17:18:32.430425+0000","last_unstale":"2024-09-13T17:18:32.431802+0000","last_undegraded":"2024-09-13T17:18:32.431802+0000","last_fullsized":"2024-09-13T17:18:32.431802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:30.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.413748+0000","last_change":"2024-09-13T17:18:32.055502+0000","last_active":"2024-09-13T17:18:32.413748+0000","last_peered":"2024-09-13T17:18:32.413748+0000","last_clean":"2024-09-13T17:18:32.413748+0000","last_became_active":"2024-09-13T17:18:32.055221+0000","last_became_peered":"2024-09-13T17:18:32.055221+0000","last_unstale":"2024-09-13T17:18:32.413748+0000","last_undegraded":"2024-09-13T17:18:32.413748+0000","last_fullsized":"2024-09-13T17:18:32.413748+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:47.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423919+0000","last_change":"2024-09-13T17:18:32.422766+0000","last_active":"2024-09-13T17:18:32.423919+0000","last_peered":"2024-09-13T17:18:32.423919+0000","last_clean":"2024-09-13T17:18:32.423919+0000","last_became_active":"2024-09-13T17:18:32.422508+0000","last_became_peered":"2024-09-13T17:18:32.422508+0000","last_unstale":"2024-09-13T17:18:32.423919+0000","last_undegraded":"2024-09-13T17:18:32.423919+0000","last_fullsized":"2024-09-13T17:18:32.423919+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:49.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433483+0000","last_change":"2024-09-13T17:18:32.049724+0000","last_active":"2024-09-13T17:18:32.433483+0000","last_peered":"2024-09-13T17:18:32.433483+0000","last_clean":"2024-09-13T17:18:32.433483+0000","last_became_active":"2024-09-13T17:18:32.048989+0000","last_became_peered":"2024-09-13T17:18:32.048989+0000","last_unstale":"2024-09-13T17:18:32.433483+0000","last_undegraded":"2024-09-13T17:18:32.433483+0000","last_fullsized":"2024-09-13T17:18:32.433483+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:49.692313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.424484+0000","last_change":"2024-09-13T17:18:32.423623+0000","last_active":"2024-09-13T17:18:32.424484+0000","last_peered":"2024-09-13T17:18:32.424484+0000","last_clean":"2024-09-13T17:18:32.424484+0000","last_became_active":"2024-09-13T17:18:32.423372+0000","last_became_peered":"2024-09-13T17:18:32.423372+0000","last_unstale":"2024-09-13T17:18:32.424484+0000","last_undegraded":"2024-09-13T17:18:32.424484+0000","last_fullsized":"2024-09-13T17:18:32.424484+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.047962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.436588+0000","last_change":"2024-09-13T17:18:32.047867+0000","last_active":"2024-09-13T17:18:32.436588+0000","last_peered":"2024-09-13T17:18:32.436588+0000","last_clean":"2024-09-13T17:18:32.436588+0000","last_became_active":"2024-09-13T17:18:32.047515+0000","last_became_peered":"2024-09-13T17:18:32.047515+0000","last_unstale":"2024-09-13T17:18:32.436588+0000","last_undegraded":"2024-09-13T17:18:32.436588+0000","last_fullsized":"2024-09-13T17:18:32.436588+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:46.255838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.437686+0000","last_change":"2024-09-13T17:18:32.435103+0000","last_active":"2024-09-13T17:18:32.437686+0000","last_peered":"2024-09-13T17:18:32.437686+0000","last_clean":"2024-09-13T17:18:32.437686+0000","last_became_active":"2024-09-13T17:18:32.434172+0000","last_became_peered":"2024-09-13T17:18:32.434172+0000","last_unstale":"2024-09-13T17:18:32.437686+0000","last_undegraded":"2024-09-13T17:18:32.437686+0000","last_fullsized":"2024-09-13T17:18:32.437686+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:57.747480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.432026+0000","last_change":"2024-09-13T17:18:32.053603+0000","last_active":"2024-09-13T17:18:32.432026+0000","last_peered":"2024-09-13T17:18:32.432026+0000","last_clean":"2024-09-13T17:18:32.432026+0000","last_became_active":"2024-09-13T17:18:32.053322+0000","last_became_peered":"2024-09-13T17:18:32.053322+0000","last_unstale":"2024-09-13T17:18:32.432026+0000","last_undegraded":"2024-09-13T17:18:32.432026+0000","last_fullsized":"2024-09-13T17:18:32.432026+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431777+0000","last_change":"2024-09-13T17:18:32.429270+0000","last_active":"2024-09-13T17:18:32.431777+0000","last_peered":"2024-09-13T17:18:32.431777+0000","last_clean":"2024-09-13T17:18:32.431777+0000","last_became_active":"2024-09-13T17:18:32.429013+0000","last_became_peered":"2024-09-13T17:18:32.429013+0000","last_unstale":"2024-09-13T17:18:32.431777+0000","last_undegraded":"2024-09-13T17:18:32.431777+0000","last_fullsized":"2024-09-13T17:18:32.431777+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:45.870101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.415500+0000","last_change":"2024-09-13T17:18:32.049980+0000","last_active":"2024-09-13T17:18:32.415500+0000","last_peered":"2024-09-13T17:18:32.415500+0000","last_clean":"2024-09-13T17:18:32.415500+0000","last_became_active":"2024-09-13T17:18:32.049675+0000","last_became_peered":"2024-09-13T17:18:32.049675+0000","last_unstale":"2024-09-13T17:18:32.415500+0000","last_undegraded":"2024-09-13T17:18:32.415500+0000","last_fullsized":"2024-09-13T17:18:32.415500+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423283+0000","last_change":"2024-09-13T17:18:32.419085+0000","last_active":"2024-09-13T17:18:32.423283+0000","last_peered":"2024-09-13T17:18:32.423283+0000","last_clean":"2024-09-13T17:18:32.423283+0000","last_became_active":"2024-09-13T17:18:32.418853+0000","last_became_peered":"2024-09-13T17:18:32.418853+0000","last_unstale":"2024-09-13T17:18:32.423283+0000","last_undegraded":"2024-09-13T17:18:32.423283+0000","last_fullsized":"2024-09-13T17:18:32.423283+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:18.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423928+0000","last_change":"2024-09-13T17:18:32.051684+0000","last_active":"2024-09-13T17:18:32.423928+0000","last_peered":"2024-09-13T17:18:32.423928+0000","last_clean":"2024-09-13T17:18:32.423928+0000","last_became_active":"2024-09-13T17:18:32.051408+0000","last_became_peered":"2024-09-13T17:18:32.051408+0000","last_unstale":"2024-09-13T17:18:32.423928+0000","last_undegraded":"2024-09-13T17:18:32.423928+0000","last_fullsized":"2024-09-13T17:18:32.423928+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:24.762568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.421917+0000","last_change":"2024-09-13T17:18:32.416504+0000","last_active":"2024-09-13T17:18:32.421917+0000","last_peered":"2024-09-13T17:18:32.421917+0000","last_clean":"2024-09-13T17:18:32.421917+0000","last_became_active":"2024-09-13T17:18:32.416266+0000","last_became_peered":"2024-09-13T17:18:32.416266+0000","last_unstale":"2024-09-13T17:18:32.421917+0000","last_undegraded":"2024-09-13T17:18:32.421917+0000","last_fullsized":"2024-09-13T17:18:32.421917+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:36.949580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.416121+0000","last_change":"2024-09-13T17:18:32.045340+0000","last_active":"2024-09-13T17:18:32.416121+0000","last_peered":"2024-09-13T17:18:32.416121+0000","last_clean":"2024-09-13T17:18:32.416121+0000","last_became_active":"2024-09-13T17:18:32.045082+0000","last_became_peered":"2024-09-13T17:18:32.045082+0000","last_unstale":"2024-09-13T17:18:32.416121+0000","last_undegraded":"2024-09-13T17:18:32.416121+0000","last_fullsized":"2024-09-13T17:18:32.416121+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:02.968862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.438233+0000","last_change":"2024-09-13T17:18:32.437632+0000","last_active":"2024-09-13T17:18:32.438233+0000","last_peered":"2024-09-13T17:18:32.438233+0000","last_clean":"2024-09-13T17:18:32.438233+0000","last_became_active":"2024-09-13T17:18:32.437370+0000","last_became_peered":"2024-09-13T17:18:32.437370+0000","last_unstale":"2024-09-13T17:18:32.438233+0000","last_undegraded":"2024-09-13T17:18:32.438233+0000","last_fullsized":"2024-09-13T17:18:32.438233+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:37.014816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.426939+0000","last_change":"2024-09-13T17:18:32.055416+0000","last_active":"2024-09-13T17:18:32.426939+0000","last_peered":"2024-09-13T17:18:32.426939+0000","last_clean":"2024-09-13T17:18:32.426939+0000","last_became_active":"2024-09-13T17:18:32.055170+0000","last_became_peered":"2024-09-13T17:18:32.055170+0000","last_unstale":"2024-09-13T17:18:32.426939+0000","last_undegraded":"2024-09-13T17:18:32.426939+0000","last_fullsized":"2024-09-13T17:18:32.426939+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:25.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430226+0000","last_change":"2024-09-13T17:18:32.427920+0000","last_active":"2024-09-13T17:18:32.430226+0000","last_peered":"2024-09-13T17:18:32.430226+0000","last_clean":"2024-09-13T17:18:32.430226+0000","last_became_active":"2024-09-13T17:18:32.427675+0000","last_became_peered":"2024-09-13T17:18:32.427675+0000","last_unstale":"2024-09-13T17:18:32.430226+0000","last_undegraded":"2024-09-13T17:18:32.430226+0000","last_fullsized":"2024-09-13T17:18:32.430226+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:47.039455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.414778+0000","last_change":"2024-09-13T17:18:32.048620+0000","last_active":"2024-09-13T17:18:32.414778+0000","last_peered":"2024-09-13T17:18:32.414778+0000","last_clean":"2024-09-13T17:18:32.414778+0000","last_became_active":"2024-09-13T17:18:32.048322+0000","last_became_peered":"2024-09-13T17:18:32.048322+0000","last_unstale":"2024-09-13T17:18:32.414778+0000","last_undegraded":"2024-09-13T17:18:32.414778+0000","last_fullsized":"2024-09-13T17:18:32.414778+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:10.661885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.423375+0000","last_change":"2024-09-13T17:18:32.419745+0000","last_active":"2024-09-13T17:18:32.423375+0000","last_peered":"2024-09-13T17:18:32.423375+0000","last_clean":"2024-09-13T17:18:32.423375+0000","last_became_active":"2024-09-13T17:18:32.419509+0000","last_became_peered":"2024-09-13T17:18:32.419509+0000","last_unstale":"2024-09-13T17:18:32.423375+0000","last_undegraded":"2024-09-13T17:18:32.423375+0000","last_fullsized":"2024-09-13T17:18:32.423375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:45.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427341+0000","last_change":"2024-09-13T17:18:32.054556+0000","last_active":"2024-09-13T17:18:32.427341+0000","last_peered":"2024-09-13T17:18:32.427341+0000","last_clean":"2024-09-13T17:18:32.427341+0000","last_became_active":"2024-09-13T17:18:32.054202+0000","last_became_peered":"2024-09-13T17:18:32.054202+0000","last_unstale":"2024-09-13T17:18:32.427341+0000","last_undegraded":"2024-09-13T17:18:32.427341+0000","last_fullsized":"2024-09-13T17:18:32.427341+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:02.785437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.431412+0000","last_change":"2024-09-13T17:18:32.421762+0000","last_active":"2024-09-13T17:18:32.431412+0000","last_peered":"2024-09-13T17:18:32.431412+0000","last_clean":"2024-09-13T17:18:32.431412+0000","last_became_active":"2024-09-13T17:18:32.421443+0000","last_became_peered":"2024-09-13T17:18:32.421443+0000","last_unstale":"2024-09-13T17:18:32.431412+0000","last_undegraded":"2024-09-13T17:18:32.431412+0000","last_fullsized":"2024-09-13T17:18:32.431412+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:15.507579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.410565+0000","last_change":"2024-09-13T17:18:32.044430+0000","last_active":"2024-09-13T17:18:32.410565+0000","last_peered":"2024-09-13T17:18:32.410565+0000","last_clean":"2024-09-13T17:18:32.410565+0000","last_became_active":"2024-09-13T17:18:32.044134+0000","last_became_peered":"2024-09-13T17:18:32.044134+0000","last_unstale":"2024-09-13T17:18:32.410565+0000","last_undegraded":"2024-09-13T17:18:32.410565+0000","last_fullsized":"2024-09-13T17:18:32.410565+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:10.753053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.436766+0000","last_change":"2024-09-13T17:18:32.435817+0000","last_active":"2024-09-13T17:18:32.436766+0000","last_peered":"2024-09-13T17:18:32.436766+0000","last_clean":"2024-09-13T17:18:32.436766+0000","last_became_active":"2024-09-13T17:18:32.435568+0000","last_became_peered":"2024-09-13T17:18:32.435568+0000","last_unstale":"2024-09-13T17:18:32.436766+0000","last_undegraded":"2024-09-13T17:18:32.436766+0000","last_fullsized":"2024-09-13T17:18:32.436766+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:31.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430444+0000","last_change":"2024-09-13T17:18:32.053192+0000","last_active":"2024-09-13T17:18:32.430444+0000","last_peered":"2024-09-13T17:18:32.430444+0000","last_clean":"2024-09-13T17:18:32.430444+0000","last_became_active":"2024-09-13T17:18:32.052993+0000","last_became_peered":"2024-09-13T17:18:32.052993+0000","last_unstale":"2024-09-13T17:18:32.430444+0000","last_undegraded":"2024-09-13T17:18:32.430444+0000","last_fullsized":"2024-09-13T17:18:32.430444+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:17.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427949+0000","last_change":"2024-09-13T17:18:32.421446+0000","last_active":"2024-09-13T17:18:32.427949+0000","last_peered":"2024-09-13T17:18:32.427949+0000","last_clean":"2024-09-13T17:18:32.427949+0000","last_became_active":"2024-09-13T17:18:32.421166+0000","last_became_peered":"2024-09-13T17:18:32.421166+0000","last_unstale":"2024-09-13T17:18:32.427949+0000","last_undegraded":"2024-09-13T17:18:32.427949+0000","last_fullsized":"2024-09-13T17:18:32.427949+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:19.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.412158+0000","last_change":"2024-09-13T17:18:32.058647+0000","last_active":"2024-09-13T17:18:32.412158+0000","last_peered":"2024-09-13T17:18:32.412158+0000","last_clean":"2024-09-13T17:18:32.412158+0000","last_became_active":"2024-09-13T17:18:32.058335+0000","last_became_peered":"2024-09-13T17:18:32.058335+0000","last_unstale":"2024-09-13T17:18:32.412158+0000","last_undegraded":"2024-09-13T17:18:32.412158+0000","last_fullsized":"2024-09-13T17:18:32.412158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:52.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430131+0000","last_change":"2024-09-13T17:18:32.428559+0000","last_active":"2024-09-13T17:18:32.430131+0000","last_peered":"2024-09-13T17:18:32.430131+0000","last_clean":"2024-09-13T17:18:32.430131+0000","last_became_active":"2024-09-13T17:18:32.428317+0000","last_became_peered":"2024-09-13T17:18:32.428317+0000","last_unstale":"2024-09-13T17:18:32.430131+0000","last_undegraded":"2024-09-13T17:18:32.430131+0000","last_fullsized":"2024-09-13T17:18:32.430131+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:57.377028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.416422+0000","last_change":"2024-09-13T17:18:32.049134+0000","last_active":"2024-09-13T17:18:32.416422+0000","last_peered":"2024-09-13T17:18:32.416422+0000","last_clean":"2024-09-13T17:18:32.416422+0000","last_became_active":"2024-09-13T17:18:32.048872+0000","last_became_peered":"2024-09-13T17:18:32.048872+0000","last_unstale":"2024-09-13T17:18:32.416422+0000","last_undegraded":"2024-09-13T17:18:32.416422+0000","last_fullsized":"2024-09-13T17:18:32.416422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:12.366605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.430723+0000","last_change":"2024-09-13T17:18:32.429124+0000","last_active":"2024-09-13T17:18:32.430723+0000","last_peered":"2024-09-13T17:18:32.430723+0000","last_clean":"2024-09-13T17:18:32.430723+0000","last_became_active":"2024-09-13T17:18:32.428877+0000","last_became_peered":"2024-09-13T17:18:32.428877+0000","last_unstale":"2024-09-13T17:18:32.430723+0000","last_undegraded":"2024-09-13T17:18:32.430723+0000","last_fullsized":"2024-09-13T17:18:32.430723+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:18.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.415062+0000","last_change":"2024-09-13T17:18:32.058217+0000","last_active":"2024-09-13T17:18:32.415062+0000","last_peered":"2024-09-13T17:18:32.415062+0000","last_clean":"2024-09-13T17:18:32.415062+0000","last_became_active":"2024-09-13T17:18:32.057860+0000","last_became_peered":"2024-09-13T17:18:32.057860+0000","last_unstale":"2024-09-13T17:18:32.415062+0000","last_undegraded":"2024-09-13T17:18:32.415062+0000","last_fullsized":"2024-09-13T17:18:32.415062+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:44.171955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433739+0000","last_change":"2024-09-13T17:18:32.429992+0000","last_active":"2024-09-13T17:18:32.433739+0000","last_peered":"2024-09-13T17:18:32.433739+0000","last_clean":"2024-09-13T17:18:32.433739+0000","last_became_active":"2024-09-13T17:18:32.429732+0000","last_became_peered":"2024-09-13T17:18:32.429732+0000","last_unstale":"2024-09-13T17:18:32.433739+0000","last_undegraded":"2024-09-13T17:18:32.433739+0000","last_fullsized":"2024-09-13T17:18:32.433739+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:55.708951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427033+0000","last_change":"2024-09-13T17:18:32.050290+0000","last_active":"2024-09-13T17:18:32.427033+0000","last_peered":"2024-09-13T17:18:32.427033+0000","last_clean":"2024-09-13T17:18:32.427033+0000","last_became_active":"2024-09-13T17:18:32.050038+0000","last_became_peered":"2024-09-13T17:18:32.050038+0000","last_unstale":"2024-09-13T17:18:32.427033+0000","last_undegraded":"2024-09-13T17:18:32.427033+0000","last_fullsized":"2024-09-13T17:18:32.427033+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:23.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.433649+0000","last_change":"2024-09-13T17:18:32.429074+0000","last_active":"2024-09-13T17:18:32.433649+0000","last_peered":"2024-09-13T17:18:32.433649+0000","last_clean":"2024-09-13T17:18:32.433649+0000","last_became_active":"2024-09-13T17:18:32.428777+0000","last_became_peered":"2024-09-13T17:18:32.428777+0000","last_unstale":"2024-09-13T17:18:32.433649+0000","last_undegraded":"2024-09-13T17:18:32.433649+0000","last_fullsized":"2024-09-13T17:18:32.433649+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:35.141713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.414864+0000","last_change":"2024-09-13T17:18:32.058246+0000","last_active":"2024-09-13T17:18:32.414864+0000","last_peered":"2024-09-13T17:18:32.414864+0000","last_clean":"2024-09-13T17:18:32.414864+0000","last_became_active":"2024-09-13T17:18:32.057888+0000","last_became_peered":"2024-09-13T17:18:32.057888+0000","last_unstale":"2024-09-13T17:18:32.414864+0000","last_undegraded":"2024-09-13T17:18:32.414864+0000","last_fullsized":"2024-09-13T17:18:32.414864+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:49:37.515238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.427918+0000","last_change":"2024-09-13T17:18:32.422766+0000","last_active":"2024-09-13T17:18:32.427918+0000","last_peered":"2024-09-13T17:18:32.427918+0000","last_clean":"2024-09-13T17:18:32.427918+0000","last_became_active":"2024-09-13T17:18:32.422423+0000","last_became_peered":"2024-09-13T17:18:32.422423+0000","last_unstale":"2024-09-13T17:18:32.427918+0000","last_undegraded":"2024-09-13T17:18:32.427918+0000","last_fullsized":"2024-09-13T17:18:32.427918+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:32.031556+0000","last_clean_scrub_stamp":"2024-09-13T17:18:32.031556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:53.555144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.421565+0000","last_change":"2024-09-13T17:18:32.047953+0000","last_active":"2024-09-13T17:18:32.421565+0000","last_peered":"2024-09-13T17:18:32.421565+0000","last_clean":"2024-09-13T17:18:32.421565+0000","last_became_active":"2024-09-13T17:18:32.047691+0000","last_became_peered":"2024-09-13T17:18:32.047691+0000","last_unstale":"2024-09-13T17:18:32.421565+0000","last_undegraded":"2024-09-13T17:18:32.421565+0000","last_fullsized":"2024-09-13T17:18:32.421565+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:18:31.029848+0000","last_clean_scrub_stamp":"2024-09-13T17:18:31.029848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:05.152790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":242,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T17:18:32.419242+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:18:32.419242+0000","last_peered":"2024-09-13T17:18:32.419242+0000","last_clean":"2024-09-13T17:18:32.419242+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:18:32.419242+0000","last_undegraded":"2024-09-13T17:18:32.419242+0000","last_fullsized":"2024-09-13T17:18:32.419242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1929216,"data_stored":1197257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70799999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.505}]},{"osd":1,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34899999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65700000000000003,"5min":1.165,"15min":1.165},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61599999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.34999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54200000000000004,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":1.216,"15min":1.216},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76800000000000002,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":1.234,"15min":1.234},"last":0.374},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.504},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53100000000000003,"15min":0.54500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35299999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67400000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":1.044,"15min":1.044},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73999999999999999,"5min":0.878,"15min":0.878},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1347584,"data_stored":608897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.59499999999999997},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48599999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.67800000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:18:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1327104,"data_stored":606729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69299999999999995,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70099999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.66600000000000004,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.502},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.39400000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.88,"15min":0.88},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73799999999999999,"5min":1.173,"15min":1.173},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69599999999999995,"5min":1.008,"15min":1.008},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51400000000000001,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":1.085,"15min":1.085},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.33000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1335296,"data_stored":606821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51600000000000001,"15min":0.47699999999999998},"min":{"1min":0.40600000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.50700000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.498},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.371},"max":{"1min":0.70899999999999996,"5min":1.034,"15min":1.034},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.625},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.748,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67100000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.439}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.56299999999999994},"min":{"1min":0.32400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72699999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58899999999999997,"15min":0.622},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.63800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574918,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1331200,"data_stored":607311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33300000000000002,"15min":0.36399999999999999},"min":{"1min":0.23200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.254},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.63400000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.245,"5min":0.214,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":1.458,"15min":1.458},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38400000000000001,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.42899999999999999},"min":{"1min":0.28899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88100000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.81000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82399999999999995,"5min":1.226,"15min":1.226},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1331200,"data_stored":606763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.32600000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.42499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.51000000000000001,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35799999999999998,"15min":0.36599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48699999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39900000000000002,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55500000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.53100000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.26400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":0.871,"15min":0.871},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1331200,"data_stored":606763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.44,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.39400000000000002},"min":{"1min":0.252,"5min":0.223,"15min":0.223},"max":{"1min":0.56999999999999995,"5min":1.159,"15min":1.159},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.39100000000000001,"15min":0.40500000000000003},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.50800000000000001,"5min":1.081,"15min":1.081},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52400000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.45500000000000002,"5min":1.286,"15min":1.286},"last":0.376}]},{"osd":4,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.752,"5min":1.046,"15min":1.046},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73099999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.626,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.624}]},{"osd":7,"last update":"Fri Sep 13 17:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69899999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.254,"15min":1.254},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1937408,"data_stored":1198751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54800000000000004,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39700000000000002},"min":{"1min":0.254,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67000000000000004,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.247}]},{"osd":2,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.501,"15min":0.439},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61499999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.51600000000000001,"15min":0.433},"min":{"1min":0.28599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":14.262,"15min":14.262},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.52600000000000002,"15min":0.45100000000000001},"min":{"1min":0.33900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58999999999999997,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.98499999999999999,"5min":3.956,"15min":3.956},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96699999999999997,"5min":0.998,"15min":0.998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.622,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":4.069,"15min":4.069},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.026,"5min":4.04,"15min":4.04},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93500000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:18:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:18:40.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:18:40.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.256+0000 7f7cc0125640 1 Processor -- start 2024-09-13T17:18:40.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.256+0000 7f7cc0125640 1 -- start start 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cc0125640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cb806df80 0x7f7cb80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cc0125640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7cb8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cc0125640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80b37c0 con 0x7f7cb806e360 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cc0125640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80cbed0 con 0x7f7cb806df80 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cc0125640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80b21e0 con 0x7f7cb8159860 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbd6c0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7cb806e360 0x7f7cb80cb7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33778/0 (socket says 172.21.15.5:33778) 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbd6c0640 1 -- 172.21.15.5:0/530888700 learned_addr learned my addr 172.21.15.5:0/530888700 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/530888700 >> v2:172.21.15.179:3300/0 conn(0x7f7cb806df80 0x7f7cb80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbe6c2640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7cb8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120906864 0 0) 0x7f7cb80b37c0 con 0x7f7cb806e360 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.257+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca4003520 con 0x7f7cb806e360 2024-09-13T17:18:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561723555 0 0) 0x7f7ca4003520 con 0x7f7cb806e360 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 msgr2=0x7f7cb8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7cb8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 >> v2:172.21.15.179:3300/0 conn(0x7f7cb806df80 msgr2=0x7f7cb80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 --2- 172.21.15.5:0/530888700 >> v2:172.21.15.179:3300/0 conn(0x7f7cb806df80 0x7f7cb80b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80b24c0 con 0x7f7cb806e360 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f7ca8001670 con 0x7f7cb806e360 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 >> v1:172.21.15.5:6789/0 conn(0x7f7cb806e360 legacy=0x7f7cb80cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7ca40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4004d00 0x7f7ca4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80cbed0 con 0x7f7ca4003970 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80b21e0 con 0x7f7ca4004d00 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400b980 con 0x7f7cb8159860 2024-09-13T17:18:40.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbd6c0640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7ca40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbe6c2640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4004d00 0x7f7ca4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 -- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 msgr2=0x7f7ca40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7ca40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 -- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4004d00 msgr2=0x7f7ca4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4004d00 0x7f7ca4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbdec1640 1 -- 172.21.15.5:0/530888700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4003520 con 0x7f7ca4003970 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbe6c2640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4004d00 0x7f7ca4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.258+0000 7f7cbd6c0640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb8159860 0x7f7ca40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009ac0 tx=0x7f7ca40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25feba9655543c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4031400 con 0x7f7ca4003970 2024-09-13T17:18:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb402d050 con 0x7f7ca4003970 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cbcebf640 1 -- 172.21.15.5:0/530888700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4031780 con 0x7f7ca4003970 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cc0125640 1 -- 172.21.15.5:0/530888700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4003970 msgr2=0x7f7ca4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cc0125640 1 --2- 172.21.15.5:0/530888700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009ac0 tx=0x7f7ca40057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.259+0000 7f7cbe6c2640 1 -- 172.21.15.5:0/530888700 reap_dead start 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.260+0000 7f7cc0125640 1 -- 172.21.15.5:0/530888700 shutdown_connections 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.260+0000 7f7cc0125640 1 -- 172.21.15.5:0/530888700 >> 172.21.15.5:0/530888700 conn(0x7f7cb8069ed0 msgr2=0x7f7cb806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.260+0000 7f7cc0125640 1 -- 172.21.15.5:0/530888700 shutdown_connections 2024-09-13T17:18:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.260+0000 7f7cc0125640 1 -- 172.21.15.5:0/530888700 wait complete. 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.261+0000 7f7cc0125640 1 Processor -- start 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.261+0000 7f7cc0125640 1 -- start start 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4003970 0x7f7cb8141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 0x7f7cb814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ad060 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ac3e0 con 0x7f7ca4003970 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cc0125640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80ac6c0 con 0x7f7cb81f2330 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59756/0 (socket says 172.21.15.5:59756) 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 -- 172.21.15.5:0/3033867060 learned_addr learned my addr 172.21.15.5:0/3033867060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4003970 0x7f7cb8141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbe6c2640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 0x7f7cb814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 -- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 msgr2=0x7f7cb814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 0x7f7cb814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 -- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4003970 msgr2=0x7f7cb8141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4003970 0x7f7cb8141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 -- 172.21.15.5:0/3033867060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80ac9a0 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbe6c2640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 0x7f7cb814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cbd6c0640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80017a0 tx=0x7f7ca800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800c870 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.262+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800c9d0 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.263+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80acc80 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.263+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800cd40 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.263+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb80ac070 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.264+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80ad1a0 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.264+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7ca801d460 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.265+0000 7f7cae7fc640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.265+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ca80894f0 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.265+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.265+0000 7f7cbdec1640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4033000 tx=0x7f7cb4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.269+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7cb80ad1a0 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.506+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7cb806c400 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.510+0000 7f7cae7fc640 1 -- 172.21.15.5:0/3033867060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7ca8054500 con 0x7f7cb81f1ed0 2024-09-13T17:18:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 msgr2=0x7f7c9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4033000 tx=0x7f7cb4008030 comp rx=0 tx=0).stop 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 msgr2=0x7f7cb8150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80017a0 tx=0x7f7ca800ed50 comp rx=0 tx=0).stop 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 shutdown_connections 2024-09-13T17:18:40.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb81f2330 0x7f7cb814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7c9c06ac00 0x7f7c9c06d0c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cb81f1ed0 0x7f7cb8150350 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 --2- 172.21.15.5:0/3033867060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ca4003970 0x7f7cb8141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 >> 172.21.15.5:0/3033867060 conn(0x7f7cb8069ed0 msgr2=0x7f7cb8155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 shutdown_connections 2024-09-13T17:18:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.512+0000 7f7cc0125640 1 -- 172.21.15.5:0/3033867060 wait complete. 2024-09-13T17:18:40.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:40.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.624+0000 7fa19ed5e640 1 Processor -- start 2024-09-13T17:18:40.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.624+0000 7fa19ed5e640 1 -- start start 2024-09-13T17:18:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa19ed5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa19806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa19ed5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980b3150 con 0x7fa1980cb7b0 2024-09-13T17:18:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa19ed5e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980b3430 con 0x7fa19806e370 2024-09-13T17:18:40.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa19ed5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19815cf00 con 0x7fa1981592d0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa197fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa1980cb7b0 0x7fa19806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33794/0 (socket says 172.21.15.5:33794) 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa197fff640 1 -- 172.21.15.5:0/2061775545 learned_addr learned my addr 172.21.15.5:0/2061775545 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092051075 0 0) 0x7fa1980b3150 con 0x7fa1980cb7b0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa19cafa640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa19806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa188003520 con 0x7fa1980cb7b0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412038275 0 0) 0x7fa188003520 con 0x7fa1980cb7b0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 msgr2=0x7fa19806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa19806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 >> v1:172.21.15.179:6789/0 conn(0x7fa19806e370 legacy=0x7fa19815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980b3710 con 0x7fa1980cb7b0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fa184001670 con 0x7fa1980cb7b0 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 >> v1:172.21.15.5:6789/0 conn(0x7fa1980cb7b0 legacy=0x7fa19806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa1880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa188003ee0 0x7fa1880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa188005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800ba60 con 0x7fa188004d00 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800dde0 con 0x7fa188003ee0 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.625+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800dfa0 con 0x7fa1981592d0 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa188005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa197fff640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa188003ee0 0x7fa1880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19cafa640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa1880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 -- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 msgr2=0x7fa1880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981592d0 0x7fa1880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 -- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa188003ee0 msgr2=0x7fa1880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa188003ee0 0x7fa1880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.626+0000 7fa19d2fb640 1 -- 172.21.15.5:0/2061775545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188003520 con 0x7fa188004d00 2024-09-13T17:18:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa188005180 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa1980ce360 tx=0x7fa1880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b55633098abd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190032440 con 0x7fa188004d00 2024-09-13T17:18:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900325c0 con 0x7fa188004d00 2024-09-13T17:18:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa1977fe640 1 -- 172.21.15.5:0/2061775545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190032970 con 0x7fa188004d00 2024-09-13T17:18:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 -- 172.21.15.5:0/2061775545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 msgr2=0x7fa188005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/2061775545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa188005180 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa1980ce360 tx=0x7fa1880057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19d2fb640 1 -- 172.21.15.5:0/2061775545 reap_dead start 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 -- 172.21.15.5:0/2061775545 shutdown_connections 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 -- 172.21.15.5:0/2061775545 >> 172.21.15.5:0/2061775545 conn(0x7fa198066200 msgr2=0x7fa198069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 -- 172.21.15.5:0/2061775545 shutdown_connections 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.627+0000 7fa19ed5e640 1 -- 172.21.15.5:0/2061775545 wait complete. 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 Processor -- start 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 -- start start 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981579a0 0x7fa19815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 0x7fa19814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19813f1f0 con 0x7fa188004d00 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19815b500 con 0x7fa19815b060 2024-09-13T17:18:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.629+0000 7fa19ed5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19815b7e0 con 0x7fa1981579a0 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59778/0 (socket says 172.21.15.5:59778) 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 -- 172.21.15.5:0/605828814 learned_addr learned my addr 172.21.15.5:0/605828814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 0x7fa19814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa197fff640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981579a0 0x7fa19815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 -- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981579a0 msgr2=0x7fa19815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981579a0 0x7fa19815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 -- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 msgr2=0x7fa19814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 0x7fa19814cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 -- 172.21.15.5:0/605828814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19815bac0 con 0x7fa188004d00 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19d2fb640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 0x7fa19814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19cafa640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0119a0 tx=0x7fa18c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00faf0 con 0x7fa188004d00 2024-09-13T17:18:40.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c00fc50 con 0x7fa188004d00 2024-09-13T17:18:40.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19815bda0 con 0x7fa188004d00 2024-09-13T17:18:40.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c014440 con 0x7fa188004d00 2024-09-13T17:18:40.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.630+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1981554f0 con 0x7fa188004d00 2024-09-13T17:18:40.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.631+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1980672f0 con 0x7fa188004d00 2024-09-13T17:18:40.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.632+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa18c0145a0 con 0x7fa188004d00 2024-09-13T17:18:40.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.632+0000 7fa1957fa640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 0x7fa17c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:40.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.632+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa18c089de0 con 0x7fa188004d00 2024-09-13T17:18:40.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.632+0000 7fa197fff640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 0x7fa17c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:40.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.633+0000 7fa197fff640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 0x7fa17c06d0c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa1981f0ff0 tx=0x7fa184000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.637+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa18c054d50 con 0x7fa188004d00 2024-09-13T17:18:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.843+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1980cdcb0 con 0x7fa188004d00 2024-09-13T17:18:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.844+0000 7fa1957fa640 1 -- 172.21.15.5:0/605828814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fa18c022020 con 0x7fa188004d00 2024-09-13T17:18:40.846 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:40.846 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":48,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2137139495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2137139495},{"type":"v1","addr":"172.21.15.179:6837","nonce":2137139495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1886354202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1886354202},{"type":"v1","addr":"172.21.15.5:6835","nonce":1886354202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3557899480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3557899480},{"type":"v1","addr":"172.21.15.179:6836","nonce":3557899480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:34.417093+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1677867267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1677867267},{"type":"v1","addr":"172.21.15.5:6833","nonce":1677867267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:40.846 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 48 2024-09-13T17:18:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 msgr2=0x7fa17c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 0x7fa17c06d0c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa1981f0ff0 tx=0x7fa184000f80 comp rx=0 tx=0).stop 2024-09-13T17:18:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 msgr2=0x7fa198154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0119a0 tx=0x7fa18c011e60 comp rx=0 tx=0).stop 2024-09-13T17:18:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 shutdown_connections 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa19815b060 0x7fa19814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1981579a0 0x7fa19815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa17c06ac00 0x7fa17c06d0c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 --2- 172.21.15.5:0/605828814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa188004d00 0x7fa198154fb0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 >> 172.21.15.5:0/605828814 conn(0x7fa198066200 msgr2=0x7fa1980aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 shutdown_connections 2024-09-13T17:18:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:40.846+0000 7fa19ed5e640 1 -- 172.21.15.5:0/605828814 wait complete. 2024-09-13T17:18:41.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:18:34.417093+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8232': {'gid': 8232, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6833/1677867267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1677867267}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1677867267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:41.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:18:41.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:18:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.366+0000 7f8e72c9d640 1 Processor -- start 2024-09-13T17:18:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.367+0000 7f8e72c9d640 1 -- start start 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.367+0000 7f8e72c9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e6c0b6fa0 0x7f8e6c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.367+0000 7f8e72c9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6c0b5ab0 con 0x7f8e6c15c920 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.367+0000 7f8e72c9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6c0d0ff0 con 0x7f8e6c0d29b0 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.367+0000 7f8e72c9d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c0d1b70 con 0x7f8e6c0b6fa0 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e70a39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8e6c15c920 0x7f8e6c0d22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33796/0 (socket says 172.21.15.5:33796) 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e70a39640 1 -- 172.21.15.5:0/3648150754 learned_addr learned my addr 172.21.15.5:0/3648150754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e7123a640 1 --2- 172.21.15.5:0/3648150754 >> v2:172.21.15.179:3300/0 conn(0x7f8e6c0b6fa0 0x7f8e6c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519227649 0 0) 0x7f8e6c0b5ab0 con 0x7f8e6c15c920 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e58003520 con 0x7f8e6c15c920 2024-09-13T17:18:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2414603322 0 0) 0x7f8e58003520 con 0x7f8e6c15c920 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 >> v2:172.21.15.179:3300/0 conn(0x7f8e6c0b6fa0 msgr2=0x7f8e6c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 --2- 172.21.15.5:0/3648150754 >> v2:172.21.15.179:3300/0 conn(0x7f8e6c0b6fa0 0x7f8e6c0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 >> v1:172.21.15.179:6789/0 conn(0x7f8e6c0d29b0 legacy=0x7f8e6c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c0d12d0 con 0x7f8e6c15c920 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8e5c001670 con 0x7f8e6c15c920 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 >> v1:172.21.15.5:6789/0 conn(0x7f8e6c15c920 legacy=0x7f8e6c0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580039a0 0x7f8e58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e580047c0 0x7f8e58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 0x7f8e5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c0d1b70 con 0x7f8e580051d0 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5800c100 con 0x7f8e580039a0 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5800c2c0 con 0x7f8e580047c0 2024-09-13T17:18:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e7123a640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 0x7f8e5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e70a39640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580039a0 0x7f8e58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.368+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e580047c0 0x7f8e58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 -- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e580047c0 msgr2=0x7f8e58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e580047c0 0x7f8e58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 -- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580039a0 msgr2=0x7f8e58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580039a0 0x7f8e58003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 -- 172.21.15.5:0/3648150754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58003520 con 0x7f8e580051d0 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 -- 172.21.15.5:0/3648150754 reap_dead start 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.369+0000 7f8e7123a640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 0x7f8e5800b980 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009ac0 tx=0x7f8e580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550059f1c02233be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004020 con 0x7f8e580051d0 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6402d050 con 0x7f8e580051d0 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e6b7fe640 1 -- 172.21.15.5:0/3648150754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640043c0 con 0x7f8e580051d0 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 -- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 msgr2=0x7f8e5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 0x7f8e5800b980 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009ac0 tx=0x7f8e580057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 -- 172.21.15.5:0/3648150754 shutdown_connections 2024-09-13T17:18:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/3648150754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e580051d0 0x7f8e5800b980 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 -- 172.21.15.5:0/3648150754 >> 172.21.15.5:0/3648150754 conn(0x7f8e6c071c30 msgr2=0x7f8e6c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 -- 172.21.15.5:0/3648150754 shutdown_connections 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.370+0000 7f8e72c9d640 1 -- 172.21.15.5:0/3648150754 wait complete. 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.371+0000 7f8e72c9d640 1 Processor -- start 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.371+0000 7f8e72c9d640 1 -- start start 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 0x7f8e6c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e6c1f2370 0x7f8e6c1f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1576d0 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c0c9ed0 con 0x7f8e580051d0 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e72c9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c0cc460 con 0x7f8e6c1f2370 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59800/0 (socket says 172.21.15.5:59800) 2024-09-13T17:18:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.372+0000 7f8e6bfff640 1 -- 172.21.15.5:0/1819736467 learned_addr learned my addr 172.21.15.5:0/1819736467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e70a39640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 0x7f8e6c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e7123a640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e6c1f2370 0x7f8e6c1f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 -- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e6c1f2370 msgr2=0x7f8e6c1f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e6c1f2370 0x7f8e6c1f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 -- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 msgr2=0x7f8e6c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 0x7f8e6c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 -- 172.21.15.5:0/1819736467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c1f2d60 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e70a39640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 0x7f8e6c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400f9c0 tx=0x7f8e5400fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e697fa640 1 -- 172.21.15.5:0/1819736467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54003b80 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e697fa640 1 -- 172.21.15.5:0/1819736467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e54003ce0 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c0cfd70 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e697fa640 1 -- 172.21.15.5:0/1819736467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400da70 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.373+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c1f32a0 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.375+0000 7f8e697fa640 1 -- 172.21.15.5:0/1819736467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e5400dbd0 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.375+0000 7f8e697fa640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 0x7f8e4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.375+0000 7f8e697fa640 1 -- 172.21.15.5:0/1819736467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e54089650 con 0x7f8e6c0cbaa0 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.376+0000 7f8e70a39640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 0x7f8e4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.376+0000 7f8e70a39640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 0x7f8e4c06d0f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c1eff60 tx=0x7f8e5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.376+0000 7f8e759bf740 1 Processor -- start 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.376+0000 7f8e759bf740 1 -- start start 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d100a0 0x55dad0d10480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d0d860 0x55dad0d5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c6a7c0 con 0x55dad0d37550 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c79b70 con 0x55dad0d0d860 2024-09-13T17:18:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c77300 con 0x55dad0d100a0 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e7123a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e7123a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59812/0 (socket says 172.21.15.5:59812) 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e7123a640 1 -- 172.21.15.5:0/1273261014 learned_addr learned my addr 172.21.15.5:0/1273261014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d0d860 0x55dad0d5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.377+0000 7f8e70a39640 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d100a0 0x55dad0d10480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 -- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d100a0 msgr2=0x55dad0d10480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d100a0 0x55dad0d10480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 -- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d0d860 msgr2=0x55dad0d5d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d0d860 0x55dad0d5d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 -- 172.21.15.5:0/1273261014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dad0bff4b0 con 0x55dad0d37550 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e7123a640 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402abe0 tx=0x7f8e6402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9334af968317278b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e627fc640 1 -- 172.21.15.5:0/1273261014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004100 con 0x55dad0d37550 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e627fc640 1 -- 172.21.15.5:0/1273261014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64004260 con 0x55dad0d37550 2024-09-13T17:18:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e627fc640 1 -- 172.21.15.5:0/1273261014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64003610 con 0x55dad0d37550 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e759bf740 1 -- 172.21.15.5:0/1273261014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 msgr2=0x55dad0d5dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.378+0000 7f8e759bf740 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402abe0 tx=0x7f8e6402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 -- 172.21.15.5:0/1273261014 shutdown_connections 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5dab0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d0d860 0x55dad0d5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 --2- 172.21.15.5:0/1273261014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d100a0 0x55dad0d10480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 -- 172.21.15.5:0/1273261014 >> 172.21.15.5:0/1273261014 conn(0x55dad0d0c7d0 msgr2=0x55dad0d54c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 -- 172.21.15.5:0/1273261014 shutdown_connections 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 -- 172.21.15.5:0/1273261014 wait complete. 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 -- start start 2024-09-13T17:18:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.379+0000 7f8e759bf740 1 Processor -- start 2024-09-13T17:18:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d5ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d36180 0x55dad0d5d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c72bf0 con 0x55dad0d37550 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c31250 con 0x55dad0d100a0 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dad0c30ef0 con 0x55dad0d36180 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e759bf740 10 client.0 _ll_register_callbacks cb 0x55dad0c63740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59822/0 (socket says 172.21.15.5:59822) 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e6bfff640 1 -- 172.21.15.5:0/356034524 learned_addr learned my addr 172.21.15.5:0/356034524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e7123a640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d36180 0x55dad0d5d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.380+0000 7f8e70a39640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d5ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 -- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d36180 msgr2=0x55dad0d5d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d36180 0x55dad0d5d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 -- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 msgr2=0x55dad0d5ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d5ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 -- 172.21.15.5:0/356034524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e64035040 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8e540548a0 tx=0x7f8e54058bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601ec37e06efa743 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54060790 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e54056740 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dad09663c0 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e54057890 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 10 client.8388 fetch_fsmap learned FSMap version 48 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55dad0c71270 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dad09663c0 con 0x55dad0d37550 2024-09-13T17:18:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e54012070 con 0x55dad0d37550 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 10 client.8388 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 10 client.8388 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 20 client.8388 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0d535b0 0x55dad0d38aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 4 client.8388 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.381+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 --> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dad09776c0 con 0x55dad0d535b0 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e70a39640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0d535b0 0x55dad0d38aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e70a39640 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0d535b0 0x55dad0d38aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5caccc9336a402cc server_cookie=6cc35de86988d684 in_seq=0 out_seq=0 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e4b7fe640 10 client.8388 ms_handle_connect on v2:172.21.15.5:6832/1677867267 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/356034524 <== mds.0 v2:172.21.15.5:6832/1677867267 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55dad09776c0 con 0x55dad0d535b0 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e4b7fe640 10 client.8388 handle_command_reply: tid=0 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.382+0000 7f8e759bf740 1 client.8388 shutdown 2024-09-13T17:18:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 msgr2=0x55dad0d5c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8e540548a0 tx=0x7f8e54058bd0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 shutdown_connections 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0d535b0 0x55dad0d38aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d36180 0x55dad0d5d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e4b7fe640 0 client.8388 ms_handle_reset on v2:172.21.15.5:6832/1677867267 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d37550 0x55dad0d5c840 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 --2- 172.21.15.5:0/356034524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d5ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 >> 172.21.15.5:0/356034524 conn(0x55dad0d0d860 msgr2=0x55dad0d0b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 shutdown_connections 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 1 -- 172.21.15.5:0/356034524 wait complete. 2024-09-13T17:18:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.383+0000 7f8e759bf740 20 client.8388 trim_cache size 0 max 16384 2024-09-13T17:18:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.398+0000 7f8e759bf740 1 Processor -- start 2024-09-13T17:18:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.398+0000 7f8e759bf740 1 -- start start 2024-09-13T17:18:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d3ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0d54670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0bf6460 con 0x55dad0d36180 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0d0c0e0 con 0x55dad0d100a0 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dad0bfc060 con 0x55dad0d37550 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59834/0 (socket says 172.21.15.5:59834) 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 -- 172.21.15.5:0/900069230 learned_addr learned my addr 172.21.15.5:0/900069230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e70a39640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d3ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 -- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 msgr2=0x55dad0d54670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e7123a640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0d54670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0d54670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 -- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 msgr2=0x55dad0d3ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d3ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 -- 172.21.15.5:0/900069230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dad0c135f0 con 0x55dad0d36180 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e70a39640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d3ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e7123a640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0d54670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8e54058330 tx=0x7f8e5405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f8940a619dedd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e62ffd640 1 -- 172.21.15.5:0/900069230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54060790 con 0x55dad0d36180 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e62ffd640 1 -- 172.21.15.5:0/900069230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e540604a0 con 0x55dad0d36180 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.399+0000 7f8e62ffd640 1 -- 172.21.15.5:0/900069230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54057ab0 con 0x55dad0d36180 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 -- 172.21.15.5:0/900069230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 msgr2=0x55dad0d0dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8e54058330 tx=0x7f8e5405c000 comp rx=0 tx=0).stop 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 -- 172.21.15.5:0/900069230 shutdown_connections 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0d54670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d36180 0x55dad0d0dd70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 --2- 172.21.15.5:0/900069230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d100a0 0x55dad0d3ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 -- 172.21.15.5:0/900069230 >> 172.21.15.5:0/900069230 conn(0x55dad0d0d860 msgr2=0x55dad0d76e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 -- 172.21.15.5:0/900069230 shutdown_connections 2024-09-13T17:18:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.400+0000 7f8e759bf740 1 -- 172.21.15.5:0/900069230 wait complete. 2024-09-13T17:18:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.401+0000 7f8e759bf740 1 -- start start 2024-09-13T17:18:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.401+0000 7f8e759bf740 1 Processor -- start 2024-09-13T17:18:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.401+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d36180 0x55dad0d6da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0db15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0db61d0 con 0x55dad0d100a0 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dad0d0b4f0 con 0x55dad0d36180 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dad0d0bc10 con 0x55dad0d37550 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 10 client.0 _ll_register_callbacks cb 0x7f8e580036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59842/0 (socket says 172.21.15.5:59842) 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 -- 172.21.15.5:0/4037780428 learned_addr learned my addr 172.21.15.5:0/4037780428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d36180 0x55dad0d6da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e7123a640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0db15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 -- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 msgr2=0x55dad0db15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0db15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 -- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d36180 msgr2=0x55dad0d6da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d36180 0x55dad0d6da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 -- 172.21.15.5:0/4037780428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dad0c71270 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e70a39640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x55dad0d677f0 tx=0x7f8e5c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8702e7090312b9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c015640 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e5c01a040 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e64004260 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e5c0157a0 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.402+0000 7f8e759bf740 10 client.8394 fetch_fsmap learned FSMap version 48 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55dad0c38d00 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64004260 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e5c015900 con 0x55dad0d100a0 2024-09-13T17:18:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 10 client.8394 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 10 client.8394 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 20 client.8394 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0db1ca0 0x55dad0daf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 4 client.8394 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 --> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dad09cad10 con 0x55dad0db1ca0 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0db1ca0 0x55dad0daf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e4b7fe640 10 client.8394 ms_handle_connect on v2:172.21.15.5:6832/1677867267 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e6bfff640 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0db1ca0 0x55dad0daf060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6d989398c1dd60d server_cookie=c9e018cc877b302d in_seq=0 out_seq=0 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e4b7fe640 1 -- 172.21.15.5:0/4037780428 <== mds.0 v2:172.21.15.5:6832/1677867267 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55dad09cad10 con 0x55dad0db1ca0 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e4b7fe640 10 client.8394 handle_command_reply: tid=0 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.403+0000 7f8e759bf740 1 client.8394 shutdown 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 msgr2=0x55dad0db5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x55dad0d677f0 tx=0x7f8e5c001a00 comp rx=0 tx=0).stop 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 shutdown_connections 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:6832/1677867267,v1:172.21.15.5:6833/1677867267] conn(0x55dad0db1ca0 0x55dad0daf060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dad0d37550 0x55dad0db15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dad0d36180 0x55dad0d6da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 --2- 172.21.15.5:0/4037780428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dad0d100a0 0x55dad0db5940 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e4b7fe640 0 client.8394 ms_handle_reset on v2:172.21.15.5:6832/1677867267 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 >> 172.21.15.5:0/4037780428 conn(0x55dad0d0d860 msgr2=0x55dad0d350f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 shutdown_connections 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 1 -- 172.21.15.5:0/4037780428 wait complete. 2024-09-13T17:18:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e759bf740 20 client.8394 trim_cache size 0 max 16384 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8232, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 9.0002754169999992, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 48, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 107, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.424614433 2024-09-13T17:18:41.414 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 msgr2=0x7f8e4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 0x7f8e4c06d0f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c1eff60 tx=0x7f8e5c009040 comp rx=0 tx=0).stop 2024-09-13T17:18:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 msgr2=0x7f8e6c0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400f9c0 tx=0x7f8e5400fe80 comp rx=0 tx=0).stop 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 shutdown_connections 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e6c1f2370 0x7f8e6c1f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8e4c06ac30 0x7f8e4c06d0f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e6c0cbaa0 0x7f8e6c0cbf20 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 --2- 172.21.15.5:0/1819736467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e580051d0 0x7f8e6c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.404+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 >> 172.21.15.5:0/1819736467 conn(0x7f8e6c071c30 msgr2=0x7f8e6c0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.405+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 shutdown_connections 2024-09-13T17:18:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.405+0000 7f8e72c9d640 1 -- 172.21.15.5:0/1819736467 wait complete. 2024-09-13T17:18:41.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.517+0000 7ff5e6cd7640 1 Processor -- start 2024-09-13T17:18:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.517+0000 7ff5e6cd7640 1 -- start start 2024-09-13T17:18:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e6cd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e6cd7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5e00d09f0 0x7ff5e00b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e6cd7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00d2c20 con 0x7ff5e00d27e0 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e6cd7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00d1b70 con 0x7ff5e00d09f0 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e6cd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00b5ab0 con 0x7ff5e015c920 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e5274640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5e00d09f0 0x7ff5e00b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:55324/0 (socket says 172.21.15.5:55324) 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 -- 172.21.15.5:0/1126364453 learned_addr learned my addr 172.21.15.5:0/1126364453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 -- 172.21.15.5:0/1126364453 >> v2:172.21.15.179:3300/0 conn(0x7ff5e00d09f0 msgr2=0x7ff5e00b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 --2- 172.21.15.5:0/1126364453 >> v2:172.21.15.179:3300/0 conn(0x7ff5e00d09f0 0x7ff5e00b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 -- 172.21.15.5:0/1126364453 >> v1:172.21.15.179:6789/0 conn(0x7ff5e00d27e0 legacy=0x7ff5e00d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.518+0000 7ff5e4a73640 1 -- 172.21.15.5:0/1126364453 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00d0ff0 con 0x7ff5e015c920 2024-09-13T17:18:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.519+0000 7ff5e4a73640 1 --2- 172.21.15.5:0/1126364453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f90716769cb1d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.519+0000 7ff5df7fe640 1 -- 172.21.15.5:0/1126364453 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032440 con 0x7ff5e015c920 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.519+0000 7ff5df7fe640 1 -- 172.21.15.5:0/1126364453 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00325a0 con 0x7ff5e015c920 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.519+0000 7ff5df7fe640 1 -- 172.21.15.5:0/1126364453 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032930 con 0x7ff5e015c920 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/1126364453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 msgr2=0x7ff5e00d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/1126364453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d002a1c0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/1126364453 shutdown_connections 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/1126364453 >> v2:172.21.15.179:3300/0 conn(0x7ff5e00d09f0 0x7ff5e00b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/1126364453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e015c920 0x7ff5e00d22a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/1126364453 >> 172.21.15.5:0/1126364453 conn(0x7ff5e0071c30 msgr2=0x7ff5e006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/1126364453 shutdown_connections 2024-09-13T17:18:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.520+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/1126364453 wait complete. 2024-09-13T17:18:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.521+0000 7ff5e6cd7640 1 Processor -- start 2024-09-13T17:18:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.521+0000 7ff5e6cd7640 1 -- start start 2024-09-13T17:18:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 0x7ff5e01f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e015c920 0x7ff5e0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00a9fa0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01f33b0 con 0x7ff5e015c920 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e6cd7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00a90f0 con 0x7ff5e00d27e0 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59858/0 (socket says 172.21.15.5:59858) 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 -- 172.21.15.5:0/276724974 learned_addr learned my addr 172.21.15.5:0/276724974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e5274640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e015c920 0x7ff5e0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5dffff640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 0x7ff5e01f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 -- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 msgr2=0x7ff5e01f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 0x7ff5e01f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 -- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e015c920 msgr2=0x7ff5e0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e015c920 0x7ff5e0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5e4a73640 1 -- 172.21.15.5:0/276724974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00094d0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.522+0000 7ff5dffff640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 0x7ff5e01f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5e4a73640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff5d002a200 tx=0x7ff5d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032440 con 0x7ff5e00d09f0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0030ba0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e00a9390 con 0x7ff5e00d09f0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d003c400 con 0x7ff5e00d09f0 2024-09-13T17:18:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.523+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e00a9950 con 0x7ff5e00d09f0 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.524+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00672f0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.524+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5d003c560 con 0x7ff5e00d09f0 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.525+0000 7ff5dd7fa640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 0x7ff5c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.525+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff5d00aa240 con 0x7ff5e00d09f0 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.525+0000 7ff5dffff640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 0x7ff5c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.525+0000 7ff5dffff640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 0x7ff5c006d0c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00aac10 tx=0x7ff5c8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.529+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff5d0075390 con 0x7ff5e00d09f0 2024-09-13T17:18:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.737+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5e00d22a0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.738+0000 7ff5dd7fa640 1 -- 172.21.15.5:0/276724974 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5d00789b0 con 0x7ff5e00d09f0 2024-09-13T17:18:41.740 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 msgr2=0x7ff5c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 0x7ff5c006d0c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00aac10 tx=0x7ff5c8009040 comp rx=0 tx=0).stop 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 msgr2=0x7ff5e00aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff5d002a200 tx=0x7ff5d00046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 shutdown_connections 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e015c920 0x7ff5e0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e00d27e0 0x7ff5e01f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff5c006ac00 0x7ff5c006d0c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 --2- 172.21.15.5:0/276724974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e00d09f0 0x7ff5e00aa430 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 >> 172.21.15.5:0/276724974 conn(0x7ff5e0071c30 msgr2=0x7ff5e00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 shutdown_connections 2024-09-13T17:18:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:41.740+0000 7ff5e6cd7640 1 -- 172.21.15.5:0/276724974 wait complete. 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:18:41.753 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:41.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.754 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:41.770 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42408sec preferred_lft 42408sec 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.771 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:18:41.772 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.773 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:41.773 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:18:41.773 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:18:41.773 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:41.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.773 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:18:41.834 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:18:41.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.836 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:18:41.892 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:18:41.892 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:18:41.893 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:18:41.893 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:18:41.893 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:18:41.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:18:41.893 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:18:41.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.982 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:18:41.998 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:18:41.998 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:18:41.999 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:41.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:41.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:18:42.066 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:18:42.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:42.066 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:42.122 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:42.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:42.122 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:42.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:42.244 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:42.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:42.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:42.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:42.312 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:42.368 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:18:42.368 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:18:42.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:42.437 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:42.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:42.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:18:42.494+0000 7f7c74e71480 -1 init, newargv = 0x556eca0dd1f0 newargc=15 2024-09-13T17:18:42.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[73225]: starting ceph client 2024-09-13T17:18:42.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[73225]: starting fuse 2024-09-13T17:18:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:42.507 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:42.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:42.507 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:42.564 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:18:42.564 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:18:42.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:18:42.564 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:42.565 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:18:42.566 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:18:42.680 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.73225.asok 2024-09-13T17:18:42.867 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73225.asok 2024-09-13T17:18:42.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:42.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73225.asok status 2024-09-13T17:18:42.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:18:42.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:18:43.006 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "73225", 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8403, 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 8403 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:43.007 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 925978857 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 925978857 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.8403 192.168.0.1:0/925978857", 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/925978857", 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 48, 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 107, 2024-09-13T17:18:43.008 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:18:43.009 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:18:43.009 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:18:43.009 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:43.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.015 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:18:43.015 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:43.071 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:18:43.071 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:43.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:43.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.278+0000 7f9401c80640 1 Processor -- start 2024-09-13T17:18:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 -- start start 2024-09-13T17:18:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93fc0d29b0 0x7f93fc0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93fc0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc0b5ab0 con 0x7f93fc15c920 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0d1b70 con 0x7f93fc0d29b0 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f9401c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0d0ff0 con 0x7f93fc0d0820 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f93fb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f93fc15c920 0x7f93fc0d22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33810/0 (socket says 172.21.15.5:33810) 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.279+0000 7f93fb7fe640 1 -- 172.21.15.5:0/3077084358 learned_addr learned my addr 172.21.15.5:0/3077084358 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fbfff640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93fc0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518801164 0 0) 0x7f93fc0b5ab0 con 0x7f93fc15c920 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93faffd640 1 --2- 172.21.15.5:0/3077084358 >> v2:172.21.15.179:3300/0 conn(0x7f93fc0d29b0 0x7f93fc0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4003520 con 0x7f93fc15c920 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3942481261 0 0) 0x7f93e4003520 con 0x7f93fc15c920 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 msgr2=0x7f93fc0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93fc0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 >> v2:172.21.15.179:3300/0 conn(0x7f93fc0d29b0 msgr2=0x7f93fc0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 --2- 172.21.15.5:0/3077084358 >> v2:172.21.15.179:3300/0 conn(0x7f93fc0d29b0 0x7f93fc0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0d12d0 con 0x7f93fc15c920 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f93ec001670 con 0x7f93fc15c920 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 >> v1:172.21.15.5:6789/0 conn(0x7f93fc15c920 legacy=0x7f93fc0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93e4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e4003f40 0x7f93e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4004d00 0x7f93e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0d1b70 con 0x7f93e4003f40 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0d0ff0 con 0x7f93e4004d00 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e400ba30 con 0x7f93fc0d0820 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93faffd640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e4003f40 0x7f93e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fbfff640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4004d00 0x7f93e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.280+0000 7f93fb7fe640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93e4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 -- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 msgr2=0x7f93e4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0d0820 0x7f93e4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 -- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4004d00 msgr2=0x7f93e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4004d00 0x7f93e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 -- 172.21.15.5:0/3077084358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4003520 con 0x7f93e4003f40 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93faffd640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e4003f40 0x7f93e40047c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009ac0 tx=0x7f93e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d234c3a1c5ff37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0031400 con 0x7f93e4003f40 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f002d050 con 0x7f93e4003f40 2024-09-13T17:18:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.281+0000 7f93fa7fc640 1 -- 172.21.15.5:0/3077084358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0031780 con 0x7f93e4003f40 2024-09-13T17:18:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 -- 172.21.15.5:0/3077084358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e4003f40 msgr2=0x7f93e40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 --2- 172.21.15.5:0/3077084358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e4003f40 0x7f93e40047c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009ac0 tx=0x7f93e40057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f93fbfff640 1 -- 172.21.15.5:0/3077084358 reap_dead start 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 -- 172.21.15.5:0/3077084358 shutdown_connections 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 -- 172.21.15.5:0/3077084358 >> 172.21.15.5:0/3077084358 conn(0x7f93fc071c30 msgr2=0x7f93fc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 -- 172.21.15.5:0/3077084358 shutdown_connections 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.282+0000 7f9401c80640 1 -- 172.21.15.5:0/3077084358 wait complete. 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.283+0000 7f9401c80640 1 Processor -- start 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.283+0000 7f9401c80640 1 -- start start 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4003f40 0x7f93fc150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0cbed0 0x7f93fc0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0cc890 con 0x7f93fc0aad90 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc1510d0 con 0x7f93e4003f40 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f9401c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0a9da0 con 0x7f93fc0cbed0 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59872/0 (socket says 172.21.15.5:59872) 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f93fbfff640 1 -- 172.21.15.5:0/3036127707 learned_addr learned my addr 172.21.15.5:0/3036127707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f93fb7fe640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4003f40 0x7f93fc150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.284+0000 7f93faffd640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0cbed0 0x7f93fc0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 -- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0cbed0 msgr2=0x7f93fc0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0cbed0 0x7f93fc0cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 -- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4003f40 msgr2=0x7f93fc150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4003f40 0x7f93fc150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 -- 172.21.15.5:0/3036127707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0a9190 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93fbfff640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0d1f00 tx=0x7f93f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f400e040 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f400f040 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4015430 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc0a9470 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.285+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc0a9a30 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.286+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc0672f0 con 0x7f93fc0aad90 2024-09-13T17:18:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.287+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93f4015590 con 0x7f93fc0aad90 2024-09-13T17:18:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.287+0000 7f93e3fff640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 0x7f93e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.287+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93f40899d0 con 0x7f93fc0aad90 2024-09-13T17:18:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.287+0000 7f93fb7fe640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 0x7f93e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.288+0000 7f93fb7fe640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 0x7f93e806d0c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f93ec001c20 tx=0x7f93ec001e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.292+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f93f4054b20 con 0x7f93fc0aad90 2024-09-13T17:18:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.498+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93fc0d0640 con 0x7f93fc0aad90 2024-09-13T17:18:43.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.498+0000 7f93e3fff640 1 -- 172.21.15.5:0/3036127707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f93f4058140 con 0x7f93fc0aad90 2024-09-13T17:18:43.500 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:18:43.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 msgr2=0x7f93e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 0x7f93e806d0c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f93ec001c20 tx=0x7f93ec001e00 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 msgr2=0x7f93fc0ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0d1f00 tx=0x7f93f400f580 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 shutdown_connections 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f93e806ac00 0x7f93e806d0c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93fc0aad90 0x7f93fc0ab210 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93fc0cbed0 0x7f93fc0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 --2- 172.21.15.5:0/3036127707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4003f40 0x7f93fc150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 >> 172.21.15.5:0/3036127707 conn(0x7f93fc071c30 msgr2=0x7f93fc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 shutdown_connections 2024-09-13T17:18:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:43.500+0000 7f9401c80640 1 -- 172.21.15.5:0/3036127707 wait complete. 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:43.513 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:18:43.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:18:43.514 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:18:43.514 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:43.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.514 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:18:43.533 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:18:43.533 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:43.534 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42372sec preferred_lft 42372sec 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.535 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:18:43.536 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:43.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.538 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:18:43.602 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:18:43.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.604 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:18:43.662 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:18:43.662 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:18:43.662 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:18:43.662 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:18:43.662 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:18:43.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:18:43.663 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:18:43.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.753 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:18:43.769 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:18:43.769 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:18:43.770 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:43.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:43.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:18:43.836 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:18:43.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:43.836 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:43.891 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:18:43.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:43.892 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:43.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:18:44.012 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:44.012 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:44.076 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:44.077 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:44.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:44.078 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:18:44.134 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:18:44.134 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:18:44.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:18:44.201 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:44.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:44.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:18:44.256+0000 7f8ddd1e4480 -1 init, newargv = 0x563159847270 newargc=15 2024-09-13T17:18:44.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48284]: starting ceph client 2024-09-13T17:18:44.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48284]: starting fuse 2024-09-13T17:18:44.267 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:44.268 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:44.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:44.269 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:18:44.324 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:18:44.324 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:18:44.325 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:18:44.326 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:18:44.327 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:18:44.327 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:18:44.327 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:18:44.327 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:18:44.438 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.48284.asok 2024-09-13T17:18:44.625 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48284.asok 2024-09-13T17:18:44.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:44.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48284.asok status 2024-09-13T17:18:44.758 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:18:44.758 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:18:44.758 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:18:44.758 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:18:44.758 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "48284", 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 6923, 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 6923 2024-09-13T17:18:44.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 910557076 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 910557076 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.6923 192.168.0.1:0/910557076", 2024-09-13T17:18:44.760 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/910557076", 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 48, 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 107, 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:18:44.761 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:18:44.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:44.766 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:18:44.766 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:44.782 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:18:44.782 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:44.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:44.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:44.848 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:44.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.021+0000 7f3c0a044640 1 Processor -- start 2024-09-13T17:18:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.021+0000 7f3c0a044640 1 -- start start 2024-09-13T17:18:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c0a044640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c04158c60 0x7f3c040703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c0a044640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c040cd260 con 0x7f3c04070920 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c0a044640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c04070d60 con 0x7f3c0406ded0 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c0a044640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040cd6f0 con 0x7f3c04158c60 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c037fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c04158c60 0x7f3c040703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c02ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c04070920 0x7f3c0406d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34144/0 (socket says 172.21.15.5:34144) 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c02ffd640 1 -- 172.21.15.5:0/1805434317 learned_addr learned my addr 172.21.15.5:0/1805434317 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c037fe640 1 -- 172.21.15.5:0/1805434317 >> v1:172.21.15.179:6789/0 conn(0x7f3c0406ded0 legacy=0x7f3c040b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c037fe640 1 -- 172.21.15.5:0/1805434317 >> v1:172.21.15.5:6789/0 conn(0x7f3c04070920 legacy=0x7f3c0406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c027fc640 1 -- 172.21.15.5:0/1805434317 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302952341 0 0) 0x7f3c040cd260 con 0x7f3c04070920 2024-09-13T17:18:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.022+0000 7f3c037fe640 1 -- 172.21.15.5:0/1805434317 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040cc650 con 0x7f3c04158c60 2024-09-13T17:18:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.023+0000 7f3c037fe640 1 --2- 172.21.15.5:0/1805434317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04158c60 0x7f3c040703e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400a940 tx=0x7f3bf402b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd2f499082999b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.023+0000 7f3c027fc640 1 -- 172.21.15.5:0/1805434317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4030510 con 0x7f3c04158c60 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.023+0000 7f3c027fc640 1 -- 172.21.15.5:0/1805434317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf402e050 con 0x7f3c04158c60 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.023+0000 7f3c027fc640 1 -- 172.21.15.5:0/1805434317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4030890 con 0x7f3c04158c60 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 -- 172.21.15.5:0/1805434317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04158c60 msgr2=0x7f3c040703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 --2- 172.21.15.5:0/1805434317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04158c60 0x7f3c040703e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400a940 tx=0x7f3bf402b5e0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 -- 172.21.15.5:0/1805434317 shutdown_connections 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 --2- 172.21.15.5:0/1805434317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04158c60 0x7f3c040703e0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 -- 172.21.15.5:0/1805434317 >> 172.21.15.5:0/1805434317 conn(0x7f3c04066200 msgr2=0x7f3c04069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 -- 172.21.15.5:0/1805434317 shutdown_connections 2024-09-13T17:18:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.024+0000 7f3c0a044640 1 -- 172.21.15.5:0/1805434317 wait complete. 2024-09-13T17:18:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.025+0000 7f3c0a044640 1 Processor -- start 2024-09-13T17:18:45.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 -- start start 2024-09-13T17:18:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0406ded0 0x7f3c0414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c04158c60 0x7f3c0414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414ab20 con 0x7f3c04070920 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414d3e0 con 0x7f3c04158c60 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c0a044640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0414caf0 con 0x7f3c0406ded0 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.026+0000 7f3c02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54208/0 (socket says 172.21.15.5:54208) 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 -- 172.21.15.5:0/473048233 learned_addr learned my addr 172.21.15.5:0/473048233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c037fe640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0406ded0 0x7f3c0414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c03fff640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c04158c60 0x7f3c0414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 -- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0406ded0 msgr2=0x7f3c0414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0406ded0 0x7f3c0414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 -- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c04158c60 msgr2=0x7f3c0414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c04158c60 0x7f3c0414f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 -- 172.21.15.5:0/473048233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf400a5a0 con 0x7f3c04070920 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c02ffd640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c4a0 tx=0x7f3bf800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80074e0 con 0x7f3c04070920 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf8007640 con 0x7f3c04070920 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0414cd90 con 0x7f3c04070920 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8004a00 con 0x7f3c04070920 2024-09-13T17:18:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.027+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c040b0670 con 0x7f3c04070920 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.028+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c040672f0 con 0x7f3c04070920 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.029+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bf8004b60 con 0x7f3c04070920 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.029+0000 7f3bebfff640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 0x7f3bf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.029+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3bf80889c0 con 0x7f3c04070920 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.030+0000 7f3c037fe640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 0x7f3bf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.030+0000 7f3c037fe640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 0x7f3bf006d0c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4035000 tx=0x7f3bf4030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.034+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bf8053a70 con 0x7f3c04070920 2024-09-13T17:18:45.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.208+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c0414d520 con 0x7f3c04070920 2024-09-13T17:18:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.209+0000 7f3bebfff640 1 -- 172.21.15.5:0/473048233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f3bf8018020 con 0x7f3c04070920 2024-09-13T17:18:45.212 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:33.404731+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 msgr2=0x7f3bf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 0x7f3bf006d0c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4035000 tx=0x7f3bf4030000 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 msgr2=0x7f3c04136cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c4a0 tx=0x7f3bf800c960 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 shutdown_connections 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c04158c60 0x7f3c0414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3bf006ac00 0x7f3bf006d0c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c04070920 0x7f3c04136cf0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 --2- 172.21.15.5:0/473048233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0406ded0 0x7f3c0414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 >> 172.21.15.5:0/473048233 conn(0x7f3c04066200 msgr2=0x7f3c04159040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 shutdown_connections 2024-09-13T17:18:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.211+0000 7f3c0a044640 1 -- 172.21.15.5:0/473048233 wait complete. 2024-09-13T17:18:45.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:45.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.327+0000 7fa98ba5a640 1 Processor -- start 2024-09-13T17:18:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.327+0000 7fa98ba5a640 1 -- start start 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa98ba5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa98415c760 0x7fa9840cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa98ba5a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 0x7fa9840cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa98ba5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9840d34d0 con 0x7fa9840d20c0 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa98ba5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840cddb0 con 0x7fa98415c760 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa98ba5a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840b5700 con 0x7fa9840d1b00 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa9897f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa98415c760 0x7fa9840cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa9897f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa98415c760 0x7fa9840cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54214/0 (socket says 172.21.15.5:54214) 2024-09-13T17:18:45.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.328+0000 7fa9897f6640 1 -- 172.21.15.5:0/1011675048 learned_addr learned my addr 172.21.15.5:0/1011675048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa9897f6640 1 -- 172.21.15.5:0/1011675048 >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 msgr2=0x7fa9840cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa989ff7640 1 --2- 172.21.15.5:0/1011675048 >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 0x7fa9840cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa9897f6640 1 --2- 172.21.15.5:0/1011675048 >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 0x7fa9840cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa9897f6640 1 -- 172.21.15.5:0/1011675048 >> v1:172.21.15.179:6789/0 conn(0x7fa9840d20c0 legacy=0x7fa9840b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa9897f6640 1 -- 172.21.15.5:0/1011675048 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840d2950 con 0x7fa98415c760 2024-09-13T17:18:45.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa989ff7640 1 --2- 172.21.15.5:0/1011675048 >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 0x7fa9840cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.329+0000 7fa9897f6640 1 --2- 172.21.15.5:0/1011675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98415c760 0x7fa9840cf640 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b5550 tx=0x7fa98002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292d47341286de91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa97bfff640 1 -- 172.21.15.5:0/1011675048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980032440 con 0x7fa98415c760 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa97bfff640 1 -- 172.21.15.5:0/1011675048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9800325a0 con 0x7fa98415c760 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa97bfff640 1 -- 172.21.15.5:0/1011675048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980032930 con 0x7fa98415c760 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 -- 172.21.15.5:0/1011675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98415c760 msgr2=0x7fa9840cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/1011675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98415c760 0x7fa9840cf640 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa9840b5550 tx=0x7fa98002a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 -- 172.21.15.5:0/1011675048 shutdown_connections 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/1011675048 >> v2:172.21.15.179:3300/0 conn(0x7fa9840d1b00 0x7fa9840cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/1011675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98415c760 0x7fa9840cf640 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 -- 172.21.15.5:0/1011675048 >> 172.21.15.5:0/1011675048 conn(0x7fa984071a20 msgr2=0x7fa984071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 -- 172.21.15.5:0/1011675048 shutdown_connections 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.330+0000 7fa98ba5a640 1 -- 172.21.15.5:0/1011675048 wait complete. 2024-09-13T17:18:45.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 Processor -- start 2024-09-13T17:18:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 -- start start 2024-09-13T17:18:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9840d1b00 0x7fa9841f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa98415c760 0x7fa984158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841592e0 con 0x7fa9840d20c0 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98415e8b0 con 0x7fa98415c760 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa98ba5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98415eb90 con 0x7fa9840d1b00 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa988ff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa988ff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54216/0 (socket says 172.21.15.5:54216) 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.332+0000 7fa988ff5640 1 -- 172.21.15.5:0/49483119 learned_addr learned my addr 172.21.15.5:0/49483119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa989ff7640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa98415c760 0x7fa984158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa9897f6640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9840d1b00 0x7fa9841f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 -- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9840d1b00 msgr2=0x7fa9841f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9840d1b00 0x7fa9841f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 -- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa98415c760 msgr2=0x7fa984158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa98415c760 0x7fa984158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 -- 172.21.15.5:0/49483119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800094d0 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa988ff5640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c430 tx=0x7fa97400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974011790 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740118f0 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974011ce0 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98415ee70 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.333+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98415e4d0 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.334+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98415e9f0 con 0x7fa9840d20c0 2024-09-13T17:18:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.335+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa97401c460 con 0x7fa9840d20c0 2024-09-13T17:18:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.335+0000 7fa979ffb640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 0x7fa96806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.335+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa974089360 con 0x7fa9840d20c0 2024-09-13T17:18:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.335+0000 7fa9897f6640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 0x7fa96806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.336+0000 7fa9897f6640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 0x7fa96806d0c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa980034000 tx=0x7fa98002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.339+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa98415e9f0 con 0x7fa9840d20c0 2024-09-13T17:18:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.511+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa98415e9f0 con 0x7fa9840d20c0 2024-09-13T17:18:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.511+0000 7fa979ffb640 1 -- 172.21.15.5:0/49483119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa98415e9f0 con 0x7fa9840d20c0 2024-09-13T17:18:45.513 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.513+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 msgr2=0x7fa96806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.513+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 0x7fa96806d0c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa980034000 tx=0x7fa98002e000 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.513+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 msgr2=0x7fa98414f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.513+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c430 tx=0x7fa97400c8f0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 shutdown_connections 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa98415c760 0x7fa984158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa96806ac00 0x7fa96806d0c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9840d20c0 0x7fa98414f670 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 --2- 172.21.15.5:0/49483119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9840d1b00 0x7fa9841f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 >> 172.21.15.5:0/49483119 conn(0x7fa984071a20 msgr2=0x7fa9840ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 shutdown_connections 2024-09-13T17:18:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.514+0000 7fa98ba5a640 1 -- 172.21.15.5:0/49483119 wait complete. 2024-09-13T17:18:45.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.629+0000 7f2fda75a640 1 Processor -- start 2024-09-13T17:18:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.629+0000 7f2fda75a640 1 -- start start 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fda75a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fda75a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fd406c780 0x7f2fd40acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fda75a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd406cc30 con 0x7f2fd41535f0 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fda75a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd406cef0 con 0x7f2fd406c780 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fda75a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd406d1d0 con 0x7f2fd4070e30 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fd8cf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fd406c780 0x7f2fd40acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fd8cf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fd406c780 0x7f2fd40acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54226/0 (socket says 172.21.15.5:54226) 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.630+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/2123438591 learned_addr learned my addr 172.21.15.5:0/2123438591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fcbfff640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/2123438591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 msgr2=0x7f2fd415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fd8cf7640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/2123438591 >> v1:172.21.15.179:6789/0 conn(0x7f2fd41535f0 legacy=0x7f2fd4070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/2123438591 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd406d4b0 con 0x7f2fd406c780 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.631+0000 7f2fd8cf7640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd406c780 0x7f2fd40acdf0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d6bc07b44d8903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fd37fe640 1 -- 172.21.15.5:0/2123438591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc02aea0 con 0x7f2fd406c780 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fd37fe640 1 -- 172.21.15.5:0/2123438591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc02d050 con 0x7f2fd406c780 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fd37fe640 1 -- 172.21.15.5:0/2123438591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc031820 con 0x7f2fd406c780 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 -- 172.21.15.5:0/2123438591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd406c780 msgr2=0x7f2fd40acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd406c780 0x7f2fd40acdf0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc02a680 comp rx=0 tx=0).stop 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 -- 172.21.15.5:0/2123438591 shutdown_connections 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd406c780 0x7f2fd40acdf0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 --2- 172.21.15.5:0/2123438591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 -- 172.21.15.5:0/2123438591 >> 172.21.15.5:0/2123438591 conn(0x7f2fd4069ed0 msgr2=0x7f2fd406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 -- 172.21.15.5:0/2123438591 shutdown_connections 2024-09-13T17:18:45.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.632+0000 7f2fda75a640 1 -- 172.21.15.5:0/2123438591 wait complete. 2024-09-13T17:18:45.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.633+0000 7f2fda75a640 1 Processor -- start 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.633+0000 7f2fda75a640 1 -- start start 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd406c780 0x7f2fd41f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd41f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd413e040 con 0x7f2fd41535f0 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd41f6190 con 0x7f2fd406c780 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fda75a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd41f5bd0 con 0x7f2fd4070e30 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fd8cf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fd8cf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54232/0 (socket says 172.21.15.5:54232) 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/435320150 learned_addr learned my addr 172.21.15.5:0/435320150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fcbfff640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd41f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.634+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd406c780 0x7f2fd41f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 msgr2=0x7f2fd41f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd41f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd406c780 msgr2=0x7f2fd41f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd406c780 0x7f2fd41f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 -- 172.21.15.5:0/435320150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009b30 con 0x7f2fd41535f0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd8cf7640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc03d860 con 0x7f2fd41535f0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc03d9e0 con 0x7f2fd41535f0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd41f5eb0 con 0x7f2fd41535f0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc03dd90 con 0x7f2fd41535f0 2024-09-13T17:18:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.635+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd41f5830 con 0x7f2fd41535f0 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.636+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd413e1f0 con 0x7f2fd41535f0 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.637+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fcc03b400 con 0x7f2fd41535f0 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.637+0000 7f2fd17fa640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 0x7f2fb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.637+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2fcc0aa1c0 con 0x7f2fd41535f0 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.637+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 0x7f2fb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.638+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 0x7f2fb406d0c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f60 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.641+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2fd413e1f0 con 0x7f2fd41535f0 2024-09-13T17:18:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.814+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fd40acdf0 con 0x7f2fd41535f0 2024-09-13T17:18:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.814+0000 7f2fd17fa640 1 -- 172.21.15.5:0/435320150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fcc075270 con 0x7f2fd41535f0 2024-09-13T17:18:45.816 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 msgr2=0x7f2fb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 0x7f2fb406d0c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f60 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 msgr2=0x7f2fd413e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 shutdown_connections 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fb406ac00 0x7f2fb406d0c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd41535f0 0x7f2fd413e4d0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd4070e30 0x7f2fd41f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 --2- 172.21.15.5:0/435320150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd406c780 0x7f2fd41f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 >> 172.21.15.5:0/435320150 conn(0x7f2fd4069ed0 msgr2=0x7f2fd406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 shutdown_connections 2024-09-13T17:18:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.816+0000 7f2fda75a640 1 -- 172.21.15.5:0/435320150 wait complete. 2024-09-13T17:18:45.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.931+0000 7fe250718640 1 Processor -- start 2024-09-13T17:18:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.931+0000 7fe250718640 1 -- start start 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe250718640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2480ce320 0x7fe248098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe250718640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 0x7fe2480cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe250718640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2480993a0 con 0x7fe24815dd40 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe250718640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2480cebc0 con 0x7fe2480ce320 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe250718640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2480ceea0 con 0x7fe248098f90 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe24dcb3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2480ce320 0x7fe248098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe24e4b4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe24815dd40 0x7fe2480b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34146/0 (socket says 172.21.15.5:34146) 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe24e4b4640 1 -- 172.21.15.5:0/2332002913 learned_addr learned my addr 172.21.15.5:0/2332002913 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe24ecb5640 1 --2- 172.21.15.5:0/2332002913 >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 0x7fe2480cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.932+0000 7fe24dcb3640 1 -- 172.21.15.5:0/2332002913 >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 msgr2=0x7fe2480cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24dcb3640 1 --2- 172.21.15.5:0/2332002913 >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 0x7fe2480cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24dcb3640 1 -- 172.21.15.5:0/2332002913 >> v1:172.21.15.5:6789/0 conn(0x7fe24815dd40 legacy=0x7fe2480b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24d4b2640 1 -- 172.21.15.5:0/2332002913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506755256 0 0) 0x7fe2480993a0 con 0x7fe24815dd40 2024-09-13T17:18:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24dcb3640 1 -- 172.21.15.5:0/2332002913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480cf180 con 0x7fe2480ce320 2024-09-13T17:18:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24ecb5640 1 --2- 172.21.15.5:0/2332002913 >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 0x7fe2480cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24dcb3640 1 --2- 172.21.15.5:0/2332002913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2480ce320 0x7fe248098a50 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe2480c75a0 tx=0x7fe23802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9309c6770164a5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24d4b2640 1 -- 172.21.15.5:0/2332002913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23802ae60 con 0x7fe2480ce320 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24d4b2640 1 -- 172.21.15.5:0/2332002913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238032440 con 0x7fe2480ce320 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.933+0000 7fe24d4b2640 1 -- 172.21.15.5:0/2332002913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380327d0 con 0x7fe2480ce320 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 -- 172.21.15.5:0/2332002913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2480ce320 msgr2=0x7fe248098a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 --2- 172.21.15.5:0/2332002913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2480ce320 0x7fe248098a50 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe2480c75a0 tx=0x7fe23802a110 comp rx=0 tx=0).stop 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 -- 172.21.15.5:0/2332002913 shutdown_connections 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 --2- 172.21.15.5:0/2332002913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2480ce320 0x7fe248098a50 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 --2- 172.21.15.5:0/2332002913 >> v2:172.21.15.179:3300/0 conn(0x7fe248098f90 0x7fe2480cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 -- 172.21.15.5:0/2332002913 >> 172.21.15.5:0/2332002913 conn(0x7fe2480d0540 msgr2=0x7fe2480d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 -- 172.21.15.5:0/2332002913 shutdown_connections 2024-09-13T17:18:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.934+0000 7fe250718640 1 -- 172.21.15.5:0/2332002913 wait complete. 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.935+0000 7fe250718640 1 Processor -- start 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.935+0000 7fe250718640 1 -- start start 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe248098f90 0x7fe2480c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2480ce320 0x7fe2481f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2481f0f10 con 0x7fe24815dd40 2024-09-13T17:18:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2480c4d90 con 0x7fe248098f90 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe250718640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2480c8ce0 con 0x7fe2480ce320 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe24ecb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe24ecb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54242/0 (socket says 172.21.15.5:54242) 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe24ecb5640 1 -- 172.21.15.5:0/1988377436 learned_addr learned my addr 172.21.15.5:0/1988377436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe24e4b4640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe248098f90 0x7fe2480c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.936+0000 7fe24dcb3640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2480ce320 0x7fe2481f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 -- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2480ce320 msgr2=0x7fe2481f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2480ce320 0x7fe2481f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 -- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe248098f90 msgr2=0x7fe2480c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe248098f90 0x7fe2480c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 -- 172.21.15.5:0/1988377436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009400 con 0x7fe24815dd40 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe24ecb5640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe24000cef0 tx=0x7fe24000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000d840 con 0x7fe24815dd40 2024-09-13T17:18:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24000d9c0 con 0x7fe24815dd40 2024-09-13T17:18:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000dd70 con 0x7fe24815dd40 2024-09-13T17:18:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2480c8fc0 con 0x7fe24815dd40 2024-09-13T17:18:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.937+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2480c9580 con 0x7fe24815dd40 2024-09-13T17:18:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.938+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2480cb770 con 0x7fe24815dd40 2024-09-13T17:18:45.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.939+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe24001e3b0 con 0x7fe24815dd40 2024-09-13T17:18:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.939+0000 7fe23effd640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 0x7fe22c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.939+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe240089de0 con 0x7fe24815dd40 2024-09-13T17:18:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.939+0000 7fe24e4b4640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 0x7fe22c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.940+0000 7fe24e4b4640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 0x7fe22c06d0f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe244007fd0 tx=0x7fe244007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:45.943+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe240055080 con 0x7fe24815dd40 2024-09-13T17:18:46.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.117+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2480ce900 con 0x7fe24815dd40 2024-09-13T17:18:46.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.117+0000 7fe23effd640 1 -- 172.21.15.5:0/1988377436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe24001a020 con 0x7fe24815dd40 2024-09-13T17:18:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.119+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 msgr2=0x7fe22c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.119+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 0x7fe22c06d0f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe244007fd0 tx=0x7fe244007de0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.119+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 msgr2=0x7fe2481518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.119+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe24000cef0 tx=0x7fe24000a710 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 shutdown_connections 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe22c06ac30 0x7fe22c06d0f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe24815dd40 0x7fe2481518f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2480ce320 0x7fe2481f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 --2- 172.21.15.5:0/1988377436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe248098f90 0x7fe2480c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 >> 172.21.15.5:0/1988377436 conn(0x7fe2480d0540 msgr2=0x7fe24815c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 shutdown_connections 2024-09-13T17:18:46.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.120+0000 7fe250718640 1 -- 172.21.15.5:0/1988377436 wait complete. 2024-09-13T17:18:46.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.233+0000 7fbc6622b640 1 Processor -- start 2024-09-13T17:18:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.233+0000 7fbc6622b640 1 -- start start 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6015c540 0x7fbc6006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 0x7fbc600ad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbc600abd90 0x7fbc600adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6006de70 con 0x7fbc6015c540 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6006e150 con 0x7fbc600abd90 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc6622b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6006e430 con 0x7fbc600cb1c0 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6015c540 0x7fbc6006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc6015c540 0x7fbc6006ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54254/0 (socket says 172.21.15.5:54254) 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3587621237 learned_addr learned my addr 172.21.15.5:0/3587621237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3587621237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 msgr2=0x7fbc600ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 0x7fbc600ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5ffff640 1 --2- 172.21.15.5:0/3587621237 >> v2:172.21.15.179:3300/0 conn(0x7fbc600abd90 0x7fbc600adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 0x7fbc600ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3587621237 >> v2:172.21.15.179:3300/0 conn(0x7fbc600abd90 msgr2=0x7fbc600adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3587621237 >> v2:172.21.15.179:3300/0 conn(0x7fbc600abd90 0x7fbc600adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3587621237 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6006e710 con 0x7fbc6015c540 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.234+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 0x7fbc600ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.235+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6015c540 0x7fbc6006ef10 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b41e0 tx=0x7fbc5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dc522363b9abf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.235+0000 7fbc5e7fc640 1 -- 172.21.15.5:0/3587621237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50032440 con 0x7fbc6015c540 2024-09-13T17:18:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.235+0000 7fbc5e7fc640 1 -- 172.21.15.5:0/3587621237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc500325a0 con 0x7fbc6015c540 2024-09-13T17:18:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.235+0000 7fbc5e7fc640 1 -- 172.21.15.5:0/3587621237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50032930 con 0x7fbc6015c540 2024-09-13T17:18:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 -- 172.21.15.5:0/3587621237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6015c540 msgr2=0x7fbc6006ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6015c540 0x7fbc6006ef10 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b41e0 tx=0x7fbc5002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 -- 172.21.15.5:0/3587621237 shutdown_connections 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3587621237 >> v2:172.21.15.179:3300/0 conn(0x7fbc600abd90 0x7fbc600adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc600cb1c0 0x7fbc600ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3587621237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc6015c540 0x7fbc6006ef10 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 -- 172.21.15.5:0/3587621237 >> 172.21.15.5:0/3587621237 conn(0x7fbc600719e0 msgr2=0x7fbc60069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 -- 172.21.15.5:0/3587621237 shutdown_connections 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.236+0000 7fbc6622b640 1 -- 172.21.15.5:0/3587621237 wait complete. 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.237+0000 7fbc6622b640 1 Processor -- start 2024-09-13T17:18:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.237+0000 7fbc6622b640 1 -- start start 2024-09-13T17:18:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 0x7fbc60140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc6015c540 0x7fbc600cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60141b30 con 0x7fbc600abd90 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601530d0 con 0x7fbc600cb1c0 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc6622b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601533b0 con 0x7fbc6015c540 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54264/0 (socket says 172.21.15.5:54264) 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3548257361 learned_addr learned my addr 172.21.15.5:0/3548257361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 0x7fbc60140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5ffff640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc6015c540 0x7fbc600cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc6015c540 msgr2=0x7fbc600cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc6015c540 0x7fbc600cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 msgr2=0x7fbc60140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 0x7fbc60140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5f7fe640 1 -- 172.21.15.5:0/3548257361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500094d0 con 0x7fbc600abd90 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.238+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 0x7fbc60140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc5f7fe640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000c00 tx=0x7fbc500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50032440 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50030b80 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5003b400 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60141750 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.239+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc60150ee0 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.240+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6006d8e0 con 0x7fbc600abd90 2024-09-13T17:18:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.240+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc50039040 con 0x7fbc600abd90 2024-09-13T17:18:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.241+0000 7fbc47fff640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 0x7fbc4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.241+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc500a9fb0 con 0x7fbc600abd90 2024-09-13T17:18:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.241+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 0x7fbc4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.242+0000 7fbc5effd640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 0x7fbc4c06d0c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc600676a0 tx=0x7fbc54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.245+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc50075160 con 0x7fbc600abd90 2024-09-13T17:18:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.426+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc60067260 con 0x7fbc600abd90 2024-09-13T17:18:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.427+0000 7fbc47fff640 1 -- 172.21.15.5:0/3548257361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc5004c080 con 0x7fbc600abd90 2024-09-13T17:18:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 msgr2=0x7fbc4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 0x7fbc4c06d0c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc600676a0 tx=0x7fbc54008040 comp rx=0 tx=0).stop 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 msgr2=0x7fbc601506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000c00 tx=0x7fbc500046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 shutdown_connections 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc6015c540 0x7fbc600cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc600cb1c0 0x7fbc60140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbc4c06ac00 0x7fbc4c06d0c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 --2- 172.21.15.5:0/3548257361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc600abd90 0x7fbc601506e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.428+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 >> 172.21.15.5:0/3548257361 conn(0x7fbc600719e0 msgr2=0x7fbc6015f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.429+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 shutdown_connections 2024-09-13T17:18:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.429+0000 7fbc6622b640 1 -- 172.21.15.5:0/3548257361 wait complete. 2024-09-13T17:18:46.441 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:18:46.442 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:46.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:46.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.597+0000 7f757cbe2640 1 Processor -- start 2024-09-13T17:18:46.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.597+0000 7f757cbe2640 1 -- start start 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757cbe2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7578145f20 0x7f75780b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757cbe2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780b2990 con 0x7f75780b45c0 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757cbe2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757806db50 con 0x7f757806dfe0 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757cbe2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757806d540 con 0x7f7578145f20 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f7576d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75780b45c0 0x7f75780ac430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34154/0 (socket says 172.21.15.5:34154) 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f7576d9d640 1 -- 172.21.15.5:0/2596053002 learned_addr learned my addr 172.21.15.5:0/2596053002 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264348852 0 0) 0x7f7570001490 con 0x7f75780b45c0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7560003520 con 0x7f75780b45c0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.598+0000 7f757659c640 1 --2- 172.21.15.5:0/2596053002 >> v2:172.21.15.179:3300/0 conn(0x7f7578145f20 0x7f75780b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319177180 0 0) 0x7f7560003520 con 0x7f75780b45c0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 >> v2:172.21.15.179:3300/0 conn(0x7f7578145f20 msgr2=0x7f75780b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 --2- 172.21.15.5:0/2596053002 >> v2:172.21.15.179:3300/0 conn(0x7f7578145f20 0x7f75780b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 >> v1:172.21.15.179:6789/0 conn(0x7f757806dfe0 legacy=0x7f75780b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757806ee60 con 0x7f75780b45c0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f7570001b80 con 0x7f75780b45c0 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 >> v1:172.21.15.5:6789/0 conn(0x7f75780b45c0 legacy=0x7f75780ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 0x7f7560004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560005180 0x7f756000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757806d540 con 0x7f75600047c0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756000c020 con 0x7f7560005180 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756000c1e0 con 0x7f7560003970 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 0x7f7560004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f757659c640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7576d9d640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560005180 0x7f756000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 -- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7560003970 msgr2=0x7f7560003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 -- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560005180 msgr2=0x7f756000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7560005180 0x7f756000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7575d9b640 1 -- 172.21.15.5:0/2596053002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560003520 con 0x7f75600047c0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.599+0000 7f7576d9d640 1 -- 172.21.15.5:0/2596053002 reap_dead start 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.600+0000 7f7575d9b640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 0x7f7560004c40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f756c001750 tx=0x7f75600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ed9df9c689be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.600+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0052d0 con 0x7f75600047c0 2024-09-13T17:18:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.600+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c005430 con 0x7f75600047c0 2024-09-13T17:18:46.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.600+0000 7f757559a640 1 -- 172.21.15.5:0/2596053002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c02abc0 con 0x7f75600047c0 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 -- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 msgr2=0x7f7560004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 0x7f7560004c40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f756c001750 tx=0x7f75600057f0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 -- 172.21.15.5:0/2596053002 shutdown_connections 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 --2- 172.21.15.5:0/2596053002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75600047c0 0x7f7560004c40 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 -- 172.21.15.5:0/2596053002 >> 172.21.15.5:0/2596053002 conn(0x7f75780b50e0 msgr2=0x7f7578098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 -- 172.21.15.5:0/2596053002 shutdown_connections 2024-09-13T17:18:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.601+0000 7f757cbe2640 1 -- 172.21.15.5:0/2596053002 wait complete. 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.602+0000 7f757cbe2640 1 Processor -- start 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.602+0000 7f757cbe2640 1 -- start start 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 0x7f757813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578141dd0 0x7f7578142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578142790 con 0x7f757813bda0 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757815cc90 con 0x7f7578141dd0 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757cbe2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757813c280 con 0x7f75600047c0 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54274/0 (socket says 172.21.15.5:54274) 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 -- 172.21.15.5:0/22378359 learned_addr learned my addr 172.21.15.5:0/22378359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7576d9d640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578141dd0 0x7f7578142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757659c640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 0x7f757813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 -- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 msgr2=0x7f757813d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 0x7f757813d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 -- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578141dd0 msgr2=0x7f7578142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578141dd0 0x7f7578142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 -- 172.21.15.5:0/22378359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757813c560 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f757659c640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 0x7f757813d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.603+0000 7f7575d9b640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f756c000c00 tx=0x7f756c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.604+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c007300 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.604+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c007460 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.604+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757815cf50 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.604+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0067d0 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.604+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757815c560 con 0x7f757813bda0 2024-09-13T17:18:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.605+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757815c560 con 0x7f757813bda0 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.605+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f756c006930 con 0x7f757813bda0 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.605+0000 7f7566ffd640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 0x7f755806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.606+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f756c0a9410 con 0x7f757813bda0 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.606+0000 7f757659c640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 0x7f755806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.606+0000 7f757659c640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 0x7f755806d0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7568009b30 tx=0x7f7568008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.610+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f756c074420 con 0x7f757813bda0 2024-09-13T17:18:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.782+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f757815c560 con 0x7f757813bda0 2024-09-13T17:18:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.783+0000 7f7566ffd640 1 -- 172.21.15.5:0/22378359 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f756c077a40 con 0x7f757813bda0 2024-09-13T17:18:46.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:46.786 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:33.404731+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 msgr2=0x7f755806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 0x7f755806d0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7568009b30 tx=0x7f7568008040 comp rx=0 tx=0).stop 2024-09-13T17:18:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 msgr2=0x7f757815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f756c000c00 tx=0x7f756c001120 comp rx=0 tx=0).stop 2024-09-13T17:18:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 shutdown_connections 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7578141dd0 0x7f7578142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f755806ac00 0x7f755806d0c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f757813bda0 0x7f757815c020 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 --2- 172.21.15.5:0/22378359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75600047c0 0x7f757813d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 >> 172.21.15.5:0/22378359 conn(0x7f75780b50e0 msgr2=0x7f75780af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 shutdown_connections 2024-09-13T17:18:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.786+0000 7f757cbe2640 1 -- 172.21.15.5:0/22378359 wait complete. 2024-09-13T17:18:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:46.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.901+0000 7f94bff08640 1 Processor -- start 2024-09-13T17:18:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.901+0000 7f94bff08640 1 -- start start 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bff08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80ccf40 0x7f94b815a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bff08640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94b806cef0 0x7f94b806d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bff08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b806c780 con 0x7f94b80716d0 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bff08640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b806e650 con 0x7f94b806cef0 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bff08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b806d8c0 con 0x7f94b80ccf40 2024-09-13T17:18:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94b806cef0 0x7f94b806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94b806cef0 0x7f94b806d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54288/0 (socket says 172.21.15.5:54288) 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 -- 172.21.15.5:0/1635255279 learned_addr learned my addr 172.21.15.5:0/1635255279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bd4a3640 1 --1- 172.21.15.5:0/1635255279 >> v1:172.21.15.5:6789/0 conn(0x7f94b80716d0 0x7f94b815b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34156/0 (socket says 172.21.15.5:34156) 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bdca4640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80ccf40 0x7f94b815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 -- 172.21.15.5:0/1635255279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80ccf40 msgr2=0x7f94b815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80ccf40 0x7f94b815a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 -- 172.21.15.5:0/1635255279 >> v1:172.21.15.5:6789/0 conn(0x7f94b80716d0 legacy=0x7f94b815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94be4a5640 1 -- 172.21.15.5:0/1635255279 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80cd320 con 0x7f94b806cef0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.902+0000 7f94bcca2640 1 -- 172.21.15.5:0/1635255279 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321372290 0 0) 0x7f94b806c780 con 0x7f94b80716d0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.903+0000 7f94be4a5640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b806d380 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7412e2bd396999 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.903+0000 7f94bcca2640 1 -- 172.21.15.5:0/1635255279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0031600 con 0x7f94b806cef0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.903+0000 7f94bcca2640 1 -- 172.21.15.5:0/1635255279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b002d050 con 0x7f94b806cef0 2024-09-13T17:18:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.903+0000 7f94bcca2640 1 -- 172.21.15.5:0/1635255279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0031980 con 0x7f94b806cef0 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 -- 172.21.15.5:0/1635255279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 msgr2=0x7f94b806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b806d380 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b002a710 comp rx=0 tx=0).stop 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 -- 172.21.15.5:0/1635255279 shutdown_connections 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b806d380 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 --2- 172.21.15.5:0/1635255279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80ccf40 0x7f94b815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 -- 172.21.15.5:0/1635255279 >> 172.21.15.5:0/1635255279 conn(0x7f94b8069ed0 msgr2=0x7f94b806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 -- 172.21.15.5:0/1635255279 shutdown_connections 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.904+0000 7f94bff08640 1 -- 172.21.15.5:0/1635255279 wait complete. 2024-09-13T17:18:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.905+0000 7f94bff08640 1 Processor -- start 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.905+0000 7f94bff08640 1 -- start start 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80716d0 0x7f94b8155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94b80ccf40 0x7f94b814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8150800 con 0x7f94b806cef0 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8157080 con 0x7f94b80ccf40 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bff08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b814eea0 con 0x7f94b80716d0 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54294/0 (socket says 172.21.15.5:54294) 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 -- 172.21.15.5:0/3491473670 learned_addr learned my addr 172.21.15.5:0/3491473670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bd4a3640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80716d0 0x7f94b8155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94be4a5640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94b80ccf40 0x7f94b814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 -- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80716d0 msgr2=0x7f94b8155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80716d0 0x7f94b8155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 -- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94b80ccf40 msgr2=0x7f94b814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94b80ccf40 0x7f94b814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 -- 172.21.15.5:0/3491473670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0009b30 con 0x7f94b806cef0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.906+0000 7f94bdca4640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d5f0 tx=0x7f94b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.907+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40125f0 con 0x7f94b806cef0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.907+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4012750 con 0x7f94b806cef0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.907+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4012b00 con 0x7f94b806cef0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.907+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b814f090 con 0x7f94b806cef0 2024-09-13T17:18:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.907+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b814f650 con 0x7f94b806cef0 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.908+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b806d380 con 0x7f94b806cef0 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.908+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94b4012c60 con 0x7f94b806cef0 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.908+0000 7f94ae7fc640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 0x7f949c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.909+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94b40897a0 con 0x7f94b806cef0 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.909+0000 7f94bd4a3640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 0x7f949c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.909+0000 7f94bd4a3640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 0x7f949c06d0c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f94b81f2fb0 tx=0x7f94a8007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:46.913+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94b4054980 con 0x7f94b806cef0 2024-09-13T17:18:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.083+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94b806da10 con 0x7f94b806cef0 2024-09-13T17:18:47.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.084+0000 7f94ae7fc640 1 -- 172.21.15.5:0/3491473670 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94b4057fa0 con 0x7f94b806cef0 2024-09-13T17:18:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 msgr2=0x7f949c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 0x7f949c06d0c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f94b81f2fb0 tx=0x7f94a8007d50 comp rx=0 tx=0).stop 2024-09-13T17:18:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 msgr2=0x7f94b8157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f94b400d5f0 tx=0x7f94b400dab0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 shutdown_connections 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94b80ccf40 0x7f94b814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94b80716d0 0x7f94b8155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f949c06ac00 0x7f949c06d0c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 --2- 172.21.15.5:0/3491473670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94b806cef0 0x7f94b8157940 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 >> 172.21.15.5:0/3491473670 conn(0x7f94b8069ed0 msgr2=0x7f94b80ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 shutdown_connections 2024-09-13T17:18:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.086+0000 7f94bff08640 1 -- 172.21.15.5:0/3491473670 wait complete. 2024-09-13T17:18:47.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.201+0000 7ff7ff2f0640 1 Processor -- start 2024-09-13T17:18:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.202+0000 7ff7ff2f0640 1 -- start start 2024-09-13T17:18:47.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.202+0000 7ff7ff2f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 0x7ff7f8159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.202+0000 7ff7ff2f0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f8153570 con 0x7ff7f815c640 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7ff2f0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f815a010 con 0x7ff7f80b3240 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7ff2f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f806ad10 con 0x7ff7f8153190 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fc88b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7f815c640 0x7ff7f80b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34170/0 (socket says 172.21.15.5:34170) 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fc88b640 1 -- 172.21.15.5:0/1614891205 learned_addr learned my addr 172.21.15.5:0/1614891205 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1614891205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 0x7ff7f8159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122008179 0 0) 0x7ff7ec001110 con 0x7ff7f815c640 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e0003440 con 0x7ff7f815c640 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194598274 0 0) 0x7ff7f815a010 con 0x7ff7f80b3240 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7ec001110 con 0x7ff7f80b3240 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 376164549 0 0) 0x7ff7e0003440 con 0x7ff7f815c640 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fd08c640 1 -- 172.21.15.5:0/1614891205 >> v1:172.21.15.179:6789/0 conn(0x7ff7f80b3240 legacy=0x7ff7f80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fd08c640 1 -- 172.21.15.5:0/1614891205 >> v1:172.21.15.5:6789/0 conn(0x7ff7f815c640 legacy=0x7ff7f80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.203+0000 7ff7fd08c640 1 -- 172.21.15.5:0/1614891205 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f815cb30 con 0x7ff7f8153190 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.204+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1614891205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 0x7ff7f8159ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009dc0 tx=0x7ff7e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a731ec12e1dfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.204+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec001800 con 0x7ff7f8153190 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.204+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e802d050 con 0x7ff7f8153190 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.204+0000 7ff7f7fff640 1 -- 172.21.15.5:0/1614891205 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8007760 con 0x7ff7f8153190 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1614891205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 msgr2=0x7ff7f8159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1614891205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 0x7ff7f8159ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009dc0 tx=0x7ff7e802a660 comp rx=0 tx=0).stop 2024-09-13T17:18:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1614891205 shutdown_connections 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1614891205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f8153190 0x7ff7f8159ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1614891205 >> 172.21.15.5:0/1614891205 conn(0x7ff7f8069ed0 msgr2=0x7ff7f806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1614891205 shutdown_connections 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.205+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1614891205 wait complete. 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.206+0000 7ff7ff2f0640 1 Processor -- start 2024-09-13T17:18:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.206+0000 7ff7ff2f0640 1 -- start start 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 0x7ff7f8141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 0x7ff7f815ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8158030 con 0x7ff7f8153190 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8158310 con 0x7ff7f815c640 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7ff2f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81585f0 con 0x7ff7f80b3240 2024-09-13T17:18:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54310/0 (socket says 172.21.15.5:54310) 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 -- 172.21.15.5:0/1520197742 learned_addr learned my addr 172.21.15.5:0/1520197742 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 0x7ff7f8141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fd88d640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 0x7ff7f815ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 -- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 msgr2=0x7ff7f8141ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 0x7ff7f8141ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 -- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 msgr2=0x7ff7f815ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 0x7ff7f815ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 -- 172.21.15.5:0/1520197742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009a70 con 0x7ff7f8153190 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 0x7ff7f8141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fd88d640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 0x7ff7f815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.207+0000 7ff7fc88b640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0010e0 tx=0x7ff7ec00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.208+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec005ad0 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.208+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec005c30 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.208+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f81588d0 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.208+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec007070 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.208+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f814d140 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.209+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f8158df0 con 0x7ff7f8153190 2024-09-13T17:18:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.209+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7ec0071f0 con 0x7ff7f8153190 2024-09-13T17:18:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.210+0000 7ff7f5ffb640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 0x7ff7e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.210+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7ec0889e0 con 0x7ff7f8153190 2024-09-13T17:18:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.210+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 0x7ff7e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.210+0000 7ff7fd08c640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 0x7ff7e406d0c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8034000 tx=0x7ff7e8033040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.214+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7f8158df0 con 0x7ff7f8153190 2024-09-13T17:18:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.385+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7f8153570 con 0x7ff7f8153190 2024-09-13T17:18:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.385+0000 7ff7f5ffb640 1 -- 172.21.15.5:0/1520197742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7f8153570 con 0x7ff7f8153190 2024-09-13T17:18:47.388 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 msgr2=0x7ff7e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 0x7ff7e406d0c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8034000 tx=0x7ff7e8033040 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 msgr2=0x7ff7f80b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0010e0 tx=0x7ff7ec00cb70 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 shutdown_connections 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f815c640 0x7ff7f815ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff7e406ac00 0x7ff7e406d0c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7f8153190 0x7ff7f80b2290 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 --2- 172.21.15.5:0/1520197742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7f80b3240 0x7ff7f8141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 >> 172.21.15.5:0/1520197742 conn(0x7ff7f8069ed0 msgr2=0x7ff7f80af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 shutdown_connections 2024-09-13T17:18:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.387+0000 7ff7ff2f0640 1 -- 172.21.15.5:0/1520197742 wait complete. 2024-09-13T17:18:47.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.503+0000 7fad3980d640 1 Processor -- start 2024-09-13T17:18:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.503+0000 7fad3980d640 1 -- start start 2024-09-13T17:18:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad3980d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 0x7fad340b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad3980d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad3406e360 0x7fad340cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad3980d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad340b37c0 con 0x7fad34159860 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad3980d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340b21e0 con 0x7fad3406e360 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad3980d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340b24c0 con 0x7fad3406df80 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad3406e360 0x7fad340cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad3406e360 0x7fad340cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54324/0 (socket says 172.21.15.5:54324) 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad337fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad34159860 0x7fad34159cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34182/0 (socket says 172.21.15.5:34182) 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 -- 172.21.15.5:0/2424786220 learned_addr learned my addr 172.21.15.5:0/2424786220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad32ffd640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 0x7fad340b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 -- 172.21.15.5:0/2424786220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 msgr2=0x7fad340b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 0x7fad340b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 -- 172.21.15.5:0/2424786220 >> v1:172.21.15.5:6789/0 conn(0x7fad34159860 legacy=0x7fad34159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad2bfff640 1 -- 172.21.15.5:0/2424786220 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340b27a0 con 0x7fad3406e360 2024-09-13T17:18:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad327fc640 1 -- 172.21.15.5:0/2424786220 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167513239 0 0) 0x7fad340b37c0 con 0x7fad34159860 2024-09-13T17:18:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.504+0000 7fad32ffd640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 0x7fad340b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.505+0000 7fad2bfff640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406e360 0x7fad340cb7c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009870 tx=0x7fad1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfdee3c685334b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.505+0000 7fad327fc640 1 -- 172.21.15.5:0/2424786220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c032440 con 0x7fad3406e360 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.505+0000 7fad327fc640 1 -- 172.21.15.5:0/2424786220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c0325a0 con 0x7fad3406e360 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.505+0000 7fad327fc640 1 -- 172.21.15.5:0/2424786220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c032930 con 0x7fad3406e360 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 -- 172.21.15.5:0/2424786220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406e360 msgr2=0x7fad340cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406e360 0x7fad340cb7c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009870 tx=0x7fad1c02a270 comp rx=0 tx=0).stop 2024-09-13T17:18:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 -- 172.21.15.5:0/2424786220 shutdown_connections 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406e360 0x7fad340cb7c0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 --2- 172.21.15.5:0/2424786220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406df80 0x7fad340b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 -- 172.21.15.5:0/2424786220 >> 172.21.15.5:0/2424786220 conn(0x7fad34069ed0 msgr2=0x7fad3406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 -- 172.21.15.5:0/2424786220 shutdown_connections 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.506+0000 7fad3980d640 1 -- 172.21.15.5:0/2424786220 wait complete. 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.507+0000 7fad3980d640 1 Processor -- start 2024-09-13T17:18:47.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.507+0000 7fad3980d640 1 -- start start 2024-09-13T17:18:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406e360 0x7fad340aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad34159860 0x7fad340c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad341436d0 con 0x7fad3406df80 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340abfb0 con 0x7fad34159860 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340aa9d0 con 0x7fad3406e360 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54338/0 (socket says 172.21.15.5:54338) 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 -- 172.21.15.5:0/3614423061 learned_addr learned my addr 172.21.15.5:0/3614423061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad2bfff640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406e360 0x7fad340aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 -- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406e360 msgr2=0x7fad340aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406e360 0x7fad340aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 -- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad34159860 msgr2=0x7fad340c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad337fe640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad34159860 0x7fad340c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad34159860 0x7fad340c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 -- 172.21.15.5:0/3614423061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0094d0 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad32ffd640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fad2400d7d0 tx=0x7fad2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24004030 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad24004190 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24004520 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad340aacb0 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.508+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340ab270 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.509+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340b3280 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.510+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad240096a0 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.510+0000 7fad30ff9640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 0x7fad1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.510+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fad24089630 con 0x7fad3406df80 2024-09-13T17:18:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.511+0000 7fad2bfff640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 0x7fad1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.511+0000 7fad2bfff640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 0x7fad1406d0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.515+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fad240546d0 con 0x7fad3406df80 2024-09-13T17:18:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.687+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad340ca3b0 con 0x7fad3406df80 2024-09-13T17:18:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.688+0000 7fad30ff9640 1 -- 172.21.15.5:0/3614423061 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad24057cf0 con 0x7fad3406df80 2024-09-13T17:18:47.691 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 msgr2=0x7fad1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 0x7fad1406d0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 msgr2=0x7fad34143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fad2400d7d0 tx=0x7fad2400dc90 comp rx=0 tx=0).stop 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 shutdown_connections 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad34159860 0x7fad340c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad3406e360 0x7fad340aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fad1406ac00 0x7fad1406d0c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 --2- 172.21.15.5:0/3614423061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad3406df80 0x7fad34143190 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 >> 172.21.15.5:0/3614423061 conn(0x7fad34069ed0 msgr2=0x7fad340af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 shutdown_connections 2024-09-13T17:18:47.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.690+0000 7fad3980d640 1 -- 172.21.15.5:0/3614423061 wait complete. 2024-09-13T17:18:47.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.803+0000 7fb98cdaa640 1 Processor -- start 2024-09-13T17:18:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.803+0000 7fb98cdaa640 1 -- start start 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb98cdaa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9880b1660 0x7fb988070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb98cdaa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988070ce0 con 0x7fb9880708b0 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb98cdaa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880b3180 con 0x7fb988158ad0 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb98cdaa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98806e730 con 0x7fb9880b1660 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb985d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9880b1660 0x7fb988070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb986d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb9880708b0 0x7fb98806c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34184/0 (socket says 172.21.15.5:34184) 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.804+0000 7fb986d9d640 1 -- 172.21.15.5:0/2255065398 learned_addr learned my addr 172.21.15.5:0/2255065398 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb985d9b640 1 -- 172.21.15.5:0/2255065398 >> v1:172.21.15.179:6789/0 conn(0x7fb988158ad0 legacy=0x7fb98806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb985d9b640 1 -- 172.21.15.5:0/2255065398 >> v1:172.21.15.5:6789/0 conn(0x7fb9880708b0 legacy=0x7fb98806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb985d9b640 1 -- 172.21.15.5:0/2255065398 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880b3420 con 0x7fb9880b1660 2024-09-13T17:18:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb98559a640 1 -- 172.21.15.5:0/2255065398 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645341524 0 0) 0x7fb988070ce0 con 0x7fb9880708b0 2024-09-13T17:18:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb985d9b640 1 --2- 172.21.15.5:0/2255065398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988070370 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097a0 tx=0x7fb97002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e221d5d2afbd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb98559a640 1 -- 172.21.15.5:0/2255065398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970032440 con 0x7fb9880b1660 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb98559a640 1 -- 172.21.15.5:0/2255065398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700325a0 con 0x7fb9880b1660 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.805+0000 7fb98559a640 1 -- 172.21.15.5:0/2255065398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970032930 con 0x7fb9880b1660 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2255065398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 msgr2=0x7fb988070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2255065398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988070370 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097a0 tx=0x7fb97002a230 comp rx=0 tx=0).stop 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2255065398 shutdown_connections 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2255065398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988070370 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2255065398 >> 172.21.15.5:0/2255065398 conn(0x7fb98806a500 msgr2=0x7fb9880b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2255065398 shutdown_connections 2024-09-13T17:18:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.806+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2255065398 wait complete. 2024-09-13T17:18:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.807+0000 7fb98cdaa640 1 Processor -- start 2024-09-13T17:18:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.807+0000 7fb98cdaa640 1 -- start start 2024-09-13T17:18:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9880708b0 0x7fb988141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 0x7fb988146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9881420e0 con 0x7fb9880b1660 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98814bfb0 con 0x7fb988158ad0 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98cdaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98814c290 con 0x7fb9880708b0 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb985d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb985d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54348/0 (socket says 172.21.15.5:54348) 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb985d9b640 1 -- 172.21.15.5:0/2920244631 learned_addr learned my addr 172.21.15.5:0/2920244631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb98659c640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9880708b0 0x7fb988141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.808+0000 7fb986d9d640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 0x7fb988146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 -- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9880708b0 msgr2=0x7fb988141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9880708b0 0x7fb988141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 -- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 msgr2=0x7fb988146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 0x7fb988146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 -- 172.21.15.5:0/2920244631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb970009400 con 0x7fb9880b1660 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb986d9d640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 0x7fb988146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb985d9b640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb970000c00 tx=0x7fb9700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970030b80 con 0x7fb9880b1660 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970030ce0 con 0x7fb9880b1660 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98814c570 con 0x7fb9880b1660 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97003d680 con 0x7fb9880b1660 2024-09-13T17:18:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.809+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9880af3c0 con 0x7fb9880b1660 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.810+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98814ca90 con 0x7fb9880b1660 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.811+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb970039040 con 0x7fb9880b1660 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.811+0000 7fb97effd640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 0x7fb96806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.811+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb9700a9fb0 con 0x7fb9880b1660 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.811+0000 7fb98659c640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 0x7fb96806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.812+0000 7fb98659c640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 0x7fb96806d0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.816+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb9700dd9c0 con 0x7fb9880b1660 2024-09-13T17:18:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.996+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9880b41e0 con 0x7fb9880b1660 2024-09-13T17:18:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.997+0000 7fb97effd640 1 -- 172.21.15.5:0/2920244631 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb970041080 con 0x7fb9880b1660 2024-09-13T17:18:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 msgr2=0x7fb96806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 0x7fb96806d0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb9780012e0 tx=0x7fb978009040 comp rx=0 tx=0).stop 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 msgr2=0x7fb988146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb970000c00 tx=0x7fb9700046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 shutdown_connections 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb988158ad0 0x7fb988146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb96806ac00 0x7fb96806d0c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9880b1660 0x7fb988146230 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 --2- 172.21.15.5:0/2920244631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9880708b0 0x7fb988141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 >> 172.21.15.5:0/2920244631 conn(0x7fb98806a500 msgr2=0x7fb98806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 shutdown_connections 2024-09-13T17:18:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:47.999+0000 7fb98cdaa640 1 -- 172.21.15.5:0/2920244631 wait complete. 2024-09-13T17:18:48.011 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:18:48.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:48.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:48.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[73225]: fuse finished with error 0 and tester_r 0 2024-09-13T17:18:48.037 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:48.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:18:48.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:48.089 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:18:48.105 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:48.105 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:48.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.246+0000 7fa8ed3ce640 1 Processor -- start 2024-09-13T17:18:48.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.246+0000 7fa8ed3ce640 1 -- start start 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8ed3ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8e806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8ed3ce640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80cd260 con 0x7fa8e8158c60 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8ed3ce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80cd6f0 con 0x7fa8e806dd00 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8ed3ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80cc650 con 0x7fa8e8070af0 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa8e8158c60 0x7fa8e80703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34192/0 (socket says 172.21.15.5:34192) 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/1898258641 learned_addr learned my addr 172.21.15.5:0/1898258641 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8dffff640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8e806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196935544 0 0) 0x7fa8e80cd260 con 0x7fa8e8158c60 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d4005730 con 0x7fa8e8158c60 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664975720 0 0) 0x7fa8e80cd6f0 con 0x7fa8e806dd00 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e80cd260 con 0x7fa8e806dd00 2024-09-13T17:18:48.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135910845 0 0) 0x7fa8d4005730 con 0x7fa8e8158c60 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 msgr2=0x7fa8e806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8e806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 >> v1:172.21.15.179:6789/0 conn(0x7fa8e806dd00 legacy=0x7fa8e80b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80cc930 con 0x7fa8e8158c60 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fa8d8001670 con 0x7fa8e8158c60 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 >> v1:172.21.15.5:6789/0 conn(0x7fa8e8158c60 legacy=0x7fa8e80703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8d4005d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d40062a0 0x7fa8d40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d4006f10 0x7fa8d4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80cc650 con 0x7fa8d4006f10 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400dc70 con 0x7fa8d40062a0 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.247+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400de30 con 0x7fa8e8070af0 2024-09-13T17:18:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d4006f10 0x7fa8d4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e6ffd640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8d4005d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8dffff640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d40062a0 0x7fa8d40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 -- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 msgr2=0x7fa8d4005d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8e8070af0 0x7fa8d4005d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 -- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d40062a0 msgr2=0x7fa8d40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d40062a0 0x7fa8d40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 -- 172.21.15.5:0/1898258641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4005730 con 0x7fa8d4006f10 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.248+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d4006f10 0x7fa8d4007390 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001fd0 tx=0x7fa8d4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5a84ba10194e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0003b70 con 0x7fa8d4006f10 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e002d050 con 0x7fa8d4006f10 2024-09-13T17:18:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8e67fc640 1 -- 172.21.15.5:0/1898258641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e00050d0 con 0x7fa8d4006f10 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1898258641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d4006f10 msgr2=0x7fa8d4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1898258641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d4006f10 0x7fa8d4007390 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001fd0 tx=0x7fa8d4007a00 comp rx=0 tx=0).stop 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8e77fe640 1 -- 172.21.15.5:0/1898258641 reap_dead start 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1898258641 shutdown_connections 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1898258641 >> 172.21.15.5:0/1898258641 conn(0x7fa8e8066200 msgr2=0x7fa8e8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1898258641 shutdown_connections 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.249+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1898258641 wait complete. 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.250+0000 7fa8ed3ce640 1 Processor -- start 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 -- start start 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d4006f10 0x7fa8e80a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 0x7fa8e80ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8143f40 con 0x7fa8e81579f0 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81441e0 con 0x7fa8e8157e50 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8ed3ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81444c0 con 0x7fa8d4006f10 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54378/0 (socket says 172.21.15.5:54378) 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.251+0000 7fa8dffff640 1 -- 172.21.15.5:0/1571262958 learned_addr learned my addr 172.21.15.5:0/1571262958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8e6ffd640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d4006f10 0x7fa8e80a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 0x7fa8e80ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 -- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d4006f10 msgr2=0x7fa8e80a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d4006f10 0x7fa8e80a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 -- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 msgr2=0x7fa8e80ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 0x7fa8e80ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 -- 172.21.15.5:0/1571262958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e81447a0 con 0x7fa8e81579f0 2024-09-13T17:18:48.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8e77fe640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 0x7fa8e80ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8dffff640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0011960 tx=0x7fa8d0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0004300 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0004460 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d000fa20 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e8144a80 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.252+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8144fa0 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.253+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e80672f0 con 0x7fa8e81579f0 2024-09-13T17:18:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.254+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8d000fb80 con 0x7fa8e81579f0 2024-09-13T17:18:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.254+0000 7fa8df7fe640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 0x7fa8c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.254+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa8d0089a30 con 0x7fa8e81579f0 2024-09-13T17:18:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.254+0000 7fa8e6ffd640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 0x7fa8c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.255+0000 7fa8e6ffd640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 0x7fa8c806d0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8001eb0 tx=0x7fa8d8001e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.258+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8d0054b80 con 0x7fa8e81579f0 2024-09-13T17:18:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.437+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e80b19b0 con 0x7fa8e81579f0 2024-09-13T17:18:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.438+0000 7fa8df7fe640 1 -- 172.21.15.5:0/1571262958 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fa8d0023090 con 0x7fa8e81579f0 2024-09-13T17:18:48.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:48.441 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:33.404731+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 msgr2=0x7fa8c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 0x7fa8c806d0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8001eb0 tx=0x7fa8d8001e00 comp rx=0 tx=0).stop 2024-09-13T17:18:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 msgr2=0x7fa8e80abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0011960 tx=0x7fa8d0011e20 comp rx=0 tx=0).stop 2024-09-13T17:18:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 shutdown_connections 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8e8157e50 0x7fa8e80ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa8c806ac30 0x7fa8c806d0f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8e81579f0 0x7fa8e80abc70 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 --2- 172.21.15.5:0/1571262958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d4006f10 0x7fa8e80a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 >> 172.21.15.5:0/1571262958 conn(0x7fa8e8066200 msgr2=0x7fa8e80ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 shutdown_connections 2024-09-13T17:18:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.441+0000 7fa8ed3ce640 1 -- 172.21.15.5:0/1571262958 wait complete. 2024-09-13T17:18:48.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:48.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.557+0000 7ff43f3ec640 1 Processor -- start 2024-09-13T17:18:48.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.557+0000 7ff43f3ec640 1 -- start start 2024-09-13T17:18:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43f3ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43806df80 0x7ff4380b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43f3ec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380b37c0 con 0x7ff438159860 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43f3ec640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380b21e0 con 0x7ff43806e360 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43f3ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4380cbed0 con 0x7ff43806df80 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43806df80 0x7ff4380b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff43806df80 0x7ff4380b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54390/0 (socket says 172.21.15.5:54390) 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d989640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff438159860 0x7ff438159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34200/0 (socket says 172.21.15.5:34200) 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 -- 172.21.15.5:0/3247728844 learned_addr learned my addr 172.21.15.5:0/3247728844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 -- 172.21.15.5:0/3247728844 >> v1:172.21.15.179:6789/0 conn(0x7ff43806e360 legacy=0x7ff4380cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 -- 172.21.15.5:0/3247728844 >> v1:172.21.15.5:6789/0 conn(0x7ff438159860 legacy=0x7ff438159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff43d188640 1 -- 172.21.15.5:0/3247728844 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380b24c0 con 0x7ff43806df80 2024-09-13T17:18:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.558+0000 7ff437fff640 1 -- 172.21.15.5:0/3247728844 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892762267 0 0) 0x7ff4380b37c0 con 0x7ff438159860 2024-09-13T17:18:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.559+0000 7ff43d188640 1 --2- 172.21.15.5:0/3247728844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43806df80 0x7ff4380b3280 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff428009e80 tx=0x7ff42802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a13c39fa6f6747 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.559+0000 7ff437fff640 1 -- 172.21.15.5:0/3247728844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428031600 con 0x7ff43806df80 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.559+0000 7ff437fff640 1 -- 172.21.15.5:0/3247728844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42802d050 con 0x7ff43806df80 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.559+0000 7ff437fff640 1 -- 172.21.15.5:0/3247728844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428031980 con 0x7ff43806df80 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 -- 172.21.15.5:0/3247728844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43806df80 msgr2=0x7ff4380b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/3247728844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43806df80 0x7ff4380b3280 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff428009e80 tx=0x7ff42802a7a0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 -- 172.21.15.5:0/3247728844 shutdown_connections 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/3247728844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff43806df80 0x7ff4380b3280 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 -- 172.21.15.5:0/3247728844 >> 172.21.15.5:0/3247728844 conn(0x7ff438069ed0 msgr2=0x7ff43806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 -- 172.21.15.5:0/3247728844 shutdown_connections 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.560+0000 7ff43f3ec640 1 -- 172.21.15.5:0/3247728844 wait complete. 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.561+0000 7ff43f3ec640 1 Processor -- start 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.561+0000 7ff43f3ec640 1 -- start start 2024-09-13T17:18:48.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff43806df80 0x7ff438156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff43806e360 0x7ff4381f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438143990 con 0x7ff438159860 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381e10a0 con 0x7ff43806e360 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43f3ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff438156f40 con 0x7ff43806df80 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54398/0 (socket says 172.21.15.5:54398) 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 -- 172.21.15.5:0/2231430659 learned_addr learned my addr 172.21.15.5:0/2231430659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d188640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff43806df80 0x7ff438156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43c987640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff43806e360 0x7ff4381f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 -- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff43806df80 msgr2=0x7ff438156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff43806df80 0x7ff438156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 -- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff43806e360 msgr2=0x7ff4381f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff43806e360 0x7ff4381f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.562+0000 7ff43d989640 1 -- 172.21.15.5:0/2231430659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428009b30 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff43d989640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff43000c3e0 tx=0x7ff43000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300074e0 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff430007640 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300049e0 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4381f4910 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.563+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4381e15d0 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.564+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43806c400 con 0x7ff438159860 2024-09-13T17:18:48.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.564+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff430004b40 con 0x7ff438159860 2024-09-13T17:18:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.565+0000 7ff435ffb640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 0x7ff42406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.565+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4300891c0 con 0x7ff438159860 2024-09-13T17:18:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.565+0000 7ff43d188640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 0x7ff42406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.566+0000 7ff43d188640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 0x7ff42406d0c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff428033000 tx=0x7ff428009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.569+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff430057d80 con 0x7ff438159860 2024-09-13T17:18:48.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.738+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff43806d9e0 con 0x7ff438159860 2024-09-13T17:18:48.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.738+0000 7ff435ffb640 1 -- 172.21.15.5:0/2231430659 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff430057910 con 0x7ff438159860 2024-09-13T17:18:48.741 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 msgr2=0x7ff42406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 0x7ff42406d0c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff428033000 tx=0x7ff428009000 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 msgr2=0x7ff438154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff43000c3e0 tx=0x7ff43000c8a0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 shutdown_connections 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff42406ac00 0x7ff42406d0c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff438159860 0x7ff438154c80 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff43806e360 0x7ff4381f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 --2- 172.21.15.5:0/2231430659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff43806df80 0x7ff438156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 >> 172.21.15.5:0/2231430659 conn(0x7ff438069ed0 msgr2=0x7ff438150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 shutdown_connections 2024-09-13T17:18:48.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.740+0000 7ff43f3ec640 1 -- 172.21.15.5:0/2231430659 wait complete. 2024-09-13T17:18:48.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.855+0000 7f10d12e9640 1 Processor -- start 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 -- start start 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 0x7f10cc0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10cc06e360 0x7f10cc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0b37c0 con 0x7f10cc159860 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0b21e0 con 0x7f10cc06e360 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.856+0000 7f10d12e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0b24c0 con 0x7f10cc06df80 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10cc06e360 0x7f10cc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10cc06e360 0x7f10cc0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54414/0 (socket says 172.21.15.5:54414) 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 -- 172.21.15.5:0/3045156309 learned_addr learned my addr 172.21.15.5:0/3045156309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10cb7fe640 1 --1- 172.21.15.5:0/3045156309 >> v1:172.21.15.5:6789/0 conn(0x7f10cc159860 0x7f10cc159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34206/0 (socket says 172.21.15.5:34206) 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10caffd640 1 --2- 172.21.15.5:0/3045156309 >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 0x7f10cc0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 -- 172.21.15.5:0/3045156309 >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 msgr2=0x7f10cc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 --2- 172.21.15.5:0/3045156309 >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 0x7f10cc0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 -- 172.21.15.5:0/3045156309 >> v1:172.21.15.5:6789/0 conn(0x7f10cc159860 legacy=0x7f10cc159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10ca7fc640 1 -- 172.21.15.5:0/3045156309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0b27a0 con 0x7f10cc06e360 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10c9ffb640 1 -- 172.21.15.5:0/3045156309 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056426137 0 0) 0x7f10cc0b37c0 con 0x7f10cc159860 2024-09-13T17:18:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.857+0000 7f10caffd640 1 --2- 172.21.15.5:0/3045156309 >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 0x7f10cc0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10ca7fc640 1 --2- 172.21.15.5:0/3045156309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0cb7c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f10b400bb10 tx=0x7f10b402c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbad9e0a98441f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10c9ffb640 1 -- 172.21.15.5:0/3045156309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4032820 con 0x7f10cc06e360 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10c9ffb640 1 -- 172.21.15.5:0/3045156309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b402e040 con 0x7f10cc06e360 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10c9ffb640 1 -- 172.21.15.5:0/3045156309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4032ba0 con 0x7f10cc06e360 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 -- 172.21.15.5:0/3045156309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 msgr2=0x7f10cc0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 --2- 172.21.15.5:0/3045156309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0cb7c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f10b400bb10 tx=0x7f10b402c960 comp rx=0 tx=0).stop 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 -- 172.21.15.5:0/3045156309 shutdown_connections 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 --2- 172.21.15.5:0/3045156309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0cb7c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 --2- 172.21.15.5:0/3045156309 >> v2:172.21.15.179:3300/0 conn(0x7f10cc06df80 0x7f10cc0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 -- 172.21.15.5:0/3045156309 >> 172.21.15.5:0/3045156309 conn(0x7f10cc069ed0 msgr2=0x7f10cc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.858+0000 7f10d12e9640 1 -- 172.21.15.5:0/3045156309 shutdown_connections 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.859+0000 7f10d12e9640 1 -- 172.21.15.5:0/3045156309 wait complete. 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.860+0000 7f10d12e9640 1 Processor -- start 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.860+0000 7f10d12e9640 1 -- start start 2024-09-13T17:18:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10cc06df80 0x7f10cc14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 0x7f10cc0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0ad2a0 con 0x7f10cc06e360 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1f6b50 con 0x7f10cc159860 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1f66c0 con 0x7f10cc06df80 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54416/0 (socket says 172.21.15.5:54416) 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 -- 172.21.15.5:0/897022499 learned_addr learned my addr 172.21.15.5:0/897022499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10caffd640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10cc06df80 0x7f10cc14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10cb7fe640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 0x7f10cc0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 -- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10cc06df80 msgr2=0x7f10cc14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10cc06df80 0x7f10cc14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 -- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 msgr2=0x7f10cc0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 0x7f10cc0af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 -- 172.21.15.5:0/897022499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b400b770 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10cb7fe640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 0x7f10cc0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10ca7fc640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b2c0 tx=0x7f10b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4031bb0 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4031d10 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc1f5d90 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b403b660 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.861+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc1f6350 con 0x7f10cc06e360 2024-09-13T17:18:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.863+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc0b3280 con 0x7f10cc06e360 2024-09-13T17:18:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.863+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10b403b7c0 con 0x7f10cc06e360 2024-09-13T17:18:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.863+0000 7f10c37fe640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 0x7f10ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.864+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f10b40aaad0 con 0x7f10cc06e360 2024-09-13T17:18:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.864+0000 7f10caffd640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 0x7f10ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.864+0000 7f10caffd640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 0x7f10ac06d0f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00f500 tx=0x7f10bc007770 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:48.868+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10b4075d40 con 0x7f10cc06e360 2024-09-13T17:18:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.042+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10cc0674e0 con 0x7f10cc06e360 2024-09-13T17:18:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.042+0000 7f10c37fe640 1 -- 172.21.15.5:0/897022499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10b4079360 con 0x7f10cc06e360 2024-09-13T17:18:49.045 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 msgr2=0x7f10ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 0x7f10ac06d0f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00f500 tx=0x7f10bc007770 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 msgr2=0x7f10cc0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b2c0 tx=0x7f10b4004730 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 shutdown_connections 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10cc159860 0x7f10cc0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f10ac06ac30 0x7f10ac06d0f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10cc06e360 0x7f10cc0af2e0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 --2- 172.21.15.5:0/897022499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10cc06df80 0x7f10cc14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.044+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 >> 172.21.15.5:0/897022499 conn(0x7f10cc069ed0 msgr2=0x7f10cc06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.045+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 shutdown_connections 2024-09-13T17:18:49.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.045+0000 7f10d12e9640 1 -- 172.21.15.5:0/897022499 wait complete. 2024-09-13T17:18:49.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.160+0000 7f718e901640 1 Processor -- start 2024-09-13T17:18:49.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.160+0000 7f718e901640 1 -- start start 2024-09-13T17:18:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718806df80 0x7f71880b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f718806e360 0x7f71880cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7188159860 0x7f7188159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880b37c0 con 0x7f7188159860 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880b21e0 con 0x7f718806e360 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718e901640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71880b24c0 con 0x7f718806df80 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7188159860 0x7f7188159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7188159860 0x7f7188159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54430/0 (socket says 172.21.15.5:54430) 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 -- 172.21.15.5:0/2874379070 learned_addr learned my addr 172.21.15.5:0/2874379070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f71877fe640 1 --2- 172.21.15.5:0/2874379070 >> v2:172.21.15.179:3300/0 conn(0x7f718806e360 0x7f71880cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f7187fff640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718806df80 0x7f71880b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 -- 172.21.15.5:0/2874379070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718806df80 msgr2=0x7f71880b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718806df80 0x7f71880b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 -- 172.21.15.5:0/2874379070 >> v2:172.21.15.179:3300/0 conn(0x7f718806e360 msgr2=0x7f71880cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 --2- 172.21.15.5:0/2874379070 >> v2:172.21.15.179:3300/0 conn(0x7f718806e360 0x7f71880cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 -- 172.21.15.5:0/2874379070 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880b27a0 con 0x7f7188159860 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f718ce9e640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7188159860 0x7f7188159cf0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7188071cf0 tx=0x7f718002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241fe0d7c145ed25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f7186ffd640 1 -- 172.21.15.5:0/2874379070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180031600 con 0x7f7188159860 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f7186ffd640 1 -- 172.21.15.5:0/2874379070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718002d050 con 0x7f7188159860 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.162+0000 7f7186ffd640 1 -- 172.21.15.5:0/2874379070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180031980 con 0x7f7188159860 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 -- 172.21.15.5:0/2874379070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7188159860 msgr2=0x7f7188159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7188159860 0x7f7188159cf0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7188071cf0 tx=0x7f718002a6a0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 -- 172.21.15.5:0/2874379070 shutdown_connections 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7188159860 0x7f7188159cf0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 --2- 172.21.15.5:0/2874379070 >> v2:172.21.15.179:3300/0 conn(0x7f718806e360 0x7f71880cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 --2- 172.21.15.5:0/2874379070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718806df80 0x7f71880b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 -- 172.21.15.5:0/2874379070 >> 172.21.15.5:0/2874379070 conn(0x7f7188069ed0 msgr2=0x7f718806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 -- 172.21.15.5:0/2874379070 shutdown_connections 2024-09-13T17:18:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.163+0000 7f718e901640 1 -- 172.21.15.5:0/2874379070 wait complete. 2024-09-13T17:18:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.164+0000 7f718e901640 1 Processor -- start 2024-09-13T17:18:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.164+0000 7f718e901640 1 -- start start 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 0x7f71880c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7188159860 0x7f71880c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71880c8840 con 0x7f718806df80 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188156a00 con 0x7f718806e360 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718e901640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188139d20 con 0x7f7188159860 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f7187fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f7187fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54444/0 (socket says 172.21.15.5:54444) 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f7187fff640 1 -- 172.21.15.5:0/66988617 learned_addr learned my addr 172.21.15.5:0/66988617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f71877fe640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 0x7f71880c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f7187fff640 1 -- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7188159860 msgr2=0x7f71880c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.165+0000 7f718ce9e640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7188159860 0x7f71880c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7187fff640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7188159860 0x7f71880c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7187fff640 1 -- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 msgr2=0x7f71880c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7187fff640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 0x7f71880c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7187fff640 1 -- 172.21.15.5:0/66988617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009b30 con 0x7f718806df80 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f71877fe640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 0x7f71880c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7187fff640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f717800c570 tx=0x7f717800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178011800 con 0x7f718806df80 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7178011960 con 0x7f718806df80 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71880ca420 con 0x7f718806df80 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178011d10 con 0x7f718806df80 2024-09-13T17:18:49.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.166+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7188139760 con 0x7f718806df80 2024-09-13T17:18:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.167+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71880b3280 con 0x7f718806df80 2024-09-13T17:18:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.167+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7178018360 con 0x7f718806df80 2024-09-13T17:18:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.168+0000 7f7184ff9640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 0x7f717406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.168+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f71780894e0 con 0x7f718806df80 2024-09-13T17:18:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.168+0000 7f71877fe640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 0x7f717406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.169+0000 7f71877fe640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 0x7f717406d0c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7188136c30 tx=0x7f717c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.173+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7178054570 con 0x7f718806df80 2024-09-13T17:18:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.342+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71880cdf20 con 0x7f718806df80 2024-09-13T17:18:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.342+0000 7f7184ff9640 1 -- 172.21.15.5:0/66988617 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7178057b90 con 0x7f718806df80 2024-09-13T17:18:49.345 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 msgr2=0x7f717406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 0x7f717406d0c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7188136c30 tx=0x7f717c008040 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 msgr2=0x7f7188138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f717800c570 tx=0x7f717800ca30 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 shutdown_connections 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7188159860 0x7f71880c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718806e360 0x7f71880c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f717406ac00 0x7f717406d0c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 --2- 172.21.15.5:0/66988617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f718806df80 0x7f7188138d90 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.344+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 >> 172.21.15.5:0/66988617 conn(0x7f7188069ed0 msgr2=0x7f71880af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.345+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 shutdown_connections 2024-09-13T17:18:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.345+0000 7f718e901640 1 -- 172.21.15.5:0/66988617 wait complete. 2024-09-13T17:18:49.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.459+0000 7fdcf1641640 1 Processor -- start 2024-09-13T17:18:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.459+0000 7fdcf1641640 1 -- start start 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcf1641640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec15a4a0 0x7fdcec0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcf1641640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcec0cc980 0x7fdcec070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcf1641640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec0cd730 con 0x7fdcec0708b0 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcf1641640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec070d60 con 0x7fdcec0cc980 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcf1641640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec0a74b0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcec0cc980 0x7fdcec070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcec0cc980 0x7fdcec070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54454/0 (socket says 172.21.15.5:54454) 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 -- 172.21.15.5:0/1339143587 learned_addr learned my addr 172.21.15.5:0/1339143587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdceaffd640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec15a4a0 0x7fdcec0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 -- 172.21.15.5:0/1339143587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec15a4a0 msgr2=0x7fdcec0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec15a4a0 0x7fdcec0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 -- 172.21.15.5:0/1339143587 >> v1:172.21.15.179:6789/0 conn(0x7fdcec0708b0 legacy=0x7fdcec15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 -- 172.21.15.5:0/1339143587 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec15a880 con 0x7fdcec0cc980 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdcea7fc640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec0cc980 0x7fdcec070370 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009870 tx=0x7fdcd402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44336cfa07a4c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdce9ffb640 1 -- 172.21.15.5:0/1339143587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4032640 con 0x7fdcec0cc980 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdce9ffb640 1 -- 172.21.15.5:0/1339143587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40327a0 con 0x7fdcec0cc980 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.460+0000 7fdce9ffb640 1 -- 172.21.15.5:0/1339143587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4032b30 con 0x7fdcec0cc980 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 -- 172.21.15.5:0/1339143587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec0cc980 msgr2=0x7fdcec070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec0cc980 0x7fdcec070370 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009870 tx=0x7fdcd402a300 comp rx=0 tx=0).stop 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 -- 172.21.15.5:0/1339143587 shutdown_connections 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec0cc980 0x7fdcec070370 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 --2- 172.21.15.5:0/1339143587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec15a4a0 0x7fdcec0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 -- 172.21.15.5:0/1339143587 >> 172.21.15.5:0/1339143587 conn(0x7fdcec06a500 msgr2=0x7fdcec0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 -- 172.21.15.5:0/1339143587 shutdown_connections 2024-09-13T17:18:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.461+0000 7fdcf1641640 1 -- 172.21.15.5:0/1339143587 wait complete. 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.462+0000 7fdcf1641640 1 Processor -- start 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.462+0000 7fdcf1641640 1 -- start start 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec0708b0 0x7fdcec140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 0x7fdcec0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec0ac540 con 0x7fdcec15a4a0 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec141100 con 0x7fdcec0cc980 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec1413e0 con 0x7fdcec0708b0 2024-09-13T17:18:49.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54456/0 (socket says 172.21.15.5:54456) 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 -- 172.21.15.5:0/2692367993 learned_addr learned my addr 172.21.15.5:0/2692367993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcea7fc640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 0x7fdcec0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceaffd640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec0708b0 0x7fdcec140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 -- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec0708b0 msgr2=0x7fdcec140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec0708b0 0x7fdcec140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 -- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 msgr2=0x7fdcec0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 0x7fdcec0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 -- 172.21.15.5:0/2692367993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40094d0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcea7fc640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 0x7fdcec0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdceb7fe640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdce4001eb0 tx=0x7fdce400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40052d0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4005430 con 0x7fdcec15a4a0 2024-09-13T17:18:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcec1416c0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4003810 con 0x7fdcec15a4a0 2024-09-13T17:18:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.464+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcec140d40 con 0x7fdcec15a4a0 2024-09-13T17:18:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.465+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec140ed0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.466+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdce4003970 con 0x7fdcec15a4a0 2024-09-13T17:18:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.466+0000 7fdce37fe640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 0x7fdccc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.466+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdce4088a00 con 0x7fdcec15a4a0 2024-09-13T17:18:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.466+0000 7fdceaffd640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 0x7fdccc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.467+0000 7fdceaffd640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 0x7fdccc06d0c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009e90 tx=0x7fdcdc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.470+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdce4053aa0 con 0x7fdcec15a4a0 2024-09-13T17:18:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.653+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdcec0ac680 con 0x7fdcec15a4a0 2024-09-13T17:18:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.654+0000 7fdce37fe640 1 -- 172.21.15.5:0/2692367993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdcec0ac680 con 0x7fdcec15a4a0 2024-09-13T17:18:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 msgr2=0x7fdccc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 0x7fdccc06d0c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009e90 tx=0x7fdcdc00b040 comp rx=0 tx=0).stop 2024-09-13T17:18:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 msgr2=0x7fdcec0c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdce4001eb0 tx=0x7fdce400c890 comp rx=0 tx=0).stop 2024-09-13T17:18:49.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 shutdown_connections 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdccc06ac00 0x7fdccc06d0c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcec15a4a0 0x7fdcec0c4ae0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcec0cc980 0x7fdcec0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 --2- 172.21.15.5:0/2692367993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcec0708b0 0x7fdcec140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 >> 172.21.15.5:0/2692367993 conn(0x7fdcec06a500 msgr2=0x7fdcec0ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 shutdown_connections 2024-09-13T17:18:49.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.656+0000 7fdcf1641640 1 -- 172.21.15.5:0/2692367993 wait complete. 2024-09-13T17:18:49.668 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:18:49.668 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:18:49.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:18:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.788+0000 7f3b41ee5640 1 Processor -- start 2024-09-13T17:18:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.788+0000 7f3b41ee5640 1 -- start start 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b41ee5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b3c145f20 0x7f3b3c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b41ee5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b3c06dfe0 0x7f3b3c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b41ee5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c0b2990 con 0x7f3b3c0b43f0 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b41ee5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c06db50 con 0x7f3b3c145f20 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b41ee5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c06d540 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b3c145f20 0x7f3b3c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b3c0b43f0 0x7f3b3c0ac430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34210/0 (socket says 172.21.15.5:34210) 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3bfff640 1 -- 172.21.15.5:0/1379312394 learned_addr learned my addr 172.21.15.5:0/1379312394 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b3c145f20 0x7f3b3c0b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54472/0 (socket says 172.21.15.5:54472) 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3affd640 1 --2- 172.21.15.5:0/1379312394 >> v2:172.21.15.179:3300/0 conn(0x7f3b3c06dfe0 0x7f3b3c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/1379312394 >> v2:172.21.15.179:3300/0 conn(0x7f3b3c06dfe0 msgr2=0x7f3b3c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 --2- 172.21.15.5:0/1379312394 >> v2:172.21.15.179:3300/0 conn(0x7f3b3c06dfe0 0x7f3b3c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/1379312394 >> v1:172.21.15.5:6789/0 conn(0x7f3b3c0b43f0 legacy=0x7f3b3c0ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/1379312394 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c06ee60 con 0x7f3b3c145f20 2024-09-13T17:18:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.789+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/1379312394 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186385139 0 0) 0x7f3b34001490 con 0x7f3b3c0b43f0 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.790+0000 7f3b3b7fe640 1 --2- 172.21.15.5:0/1379312394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c145f20 0x7f3b3c0b2450 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c071940 tx=0x7f3b2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19309a81a71d8b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.790+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/1379312394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032440 con 0x7f3b3c145f20 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.790+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/1379312394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0325a0 con 0x7f3b3c145f20 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.790+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/1379312394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032930 con 0x7f3b3c145f20 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 -- 172.21.15.5:0/1379312394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c145f20 msgr2=0x7f3b3c0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/1379312394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c145f20 0x7f3b3c0b2450 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c071940 tx=0x7f3b2c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 -- 172.21.15.5:0/1379312394 shutdown_connections 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/1379312394 >> v2:172.21.15.179:3300/0 conn(0x7f3b3c06dfe0 0x7f3b3c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/1379312394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c145f20 0x7f3b3c0b2450 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 -- 172.21.15.5:0/1379312394 >> 172.21.15.5:0/1379312394 conn(0x7f3b3c0b50e0 msgr2=0x7f3b3c098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 -- 172.21.15.5:0/1379312394 shutdown_connections 2024-09-13T17:18:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.791+0000 7f3b41ee5640 1 -- 172.21.15.5:0/1379312394 wait complete. 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.792+0000 7f3b41ee5640 1 Processor -- start 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.792+0000 7f3b41ee5640 1 -- start start 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0b43f0 0x7f3b3c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3c145f20 0x7f3b3c1f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c13bb50 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c15f190 con 0x7f3b3c145f20 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b41ee5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c13b220 con 0x7f3b3c0b43f0 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54486/0 (socket says 172.21.15.5:54486) 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/3359338890 learned_addr learned my addr 172.21.15.5:0/3359338890 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3bfff640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3c145f20 0x7f3b3c1f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3affd640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0b43f0 0x7f3b3c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0b43f0 msgr2=0x7f3b3c15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0b43f0 0x7f3b3c15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3c145f20 msgr2=0x7f3b3c1f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3c145f20 0x7f3b3c1f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.793+0000 7f3b3b7fe640 1 -- 172.21.15.5:0/3359338890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009400 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b3b7fe640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000c00 tx=0x7f3b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c032440 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c030ba0 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c13b500 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c006e10 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.794+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c144050 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.795+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c0b4820 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.795+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b2c039040 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.796+0000 7f3b23fff640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 0x7f3b2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.796+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3b2c0a9f70 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.796+0000 7f3b3affd640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 0x7f3b2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.797+0000 7f3b3affd640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 0x7f3b2806d0c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c15f650 tx=0x7f3b30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.800+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b2c075000 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.972+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b3c0b02a0 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.974+0000 7f3b23fff640 1 -- 172.21.15.5:0/3359338890 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f3b2c078620 con 0x7f3b3c06dfe0 2024-09-13T17:18:49.975 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:49.975 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:33.404731+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:18:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 msgr2=0x7f3b2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 0x7f3b2806d0c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c15f650 tx=0x7f3b30008040 comp rx=0 tx=0).stop 2024-09-13T17:18:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 msgr2=0x7f3b3c141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c000c00 tx=0x7f3b2c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 shutdown_connections 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b3c145f20 0x7f3b3c1f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0b43f0 0x7f3b3c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b2806ac00 0x7f3b2806d0c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 --2- 172.21.15.5:0/3359338890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b3c06dfe0 0x7f3b3c141e20 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 >> 172.21.15.5:0/3359338890 conn(0x7f3b3c0b50e0 msgr2=0x7f3b3c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 shutdown_connections 2024-09-13T17:18:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:49.976+0000 7f3b41ee5640 1 -- 172.21.15.5:0/3359338890 wait complete. 2024-09-13T17:18:49.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:18:49.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:18:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.092+0000 7fe72db18640 1 Processor -- start 2024-09-13T17:18:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.092+0000 7fe72db18640 1 -- start start 2024-09-13T17:18:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe72db18640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe72815c840 0x7fe7280ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe72db18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe7280ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe72db18640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728071e40 con 0x7fe728065f30 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe72db18640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72815cc20 con 0x7fe72815c840 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe72db18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe728071880 con 0x7fe72806b5f0 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe72815c840 0x7fe7280ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe72815c840 0x7fe7280ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54488/0 (socket says 172.21.15.5:54488) 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 -- 172.21.15.5:0/1782092395 learned_addr learned my addr 172.21.15.5:0/1782092395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe727fff640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe7280ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 -- 172.21.15.5:0/1782092395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 msgr2=0x7fe7280ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe7280ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 -- 172.21.15.5:0/1782092395 >> v1:172.21.15.179:6789/0 conn(0x7fe728065f30 legacy=0x7fe72806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.093+0000 7fe7277fe640 1 -- 172.21.15.5:0/1782092395 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728071b60 con 0x7fe72815c840 2024-09-13T17:18:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.094+0000 7fe7277fe640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe7280ae380 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe718009870 tx=0x7fe71802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c226b307ece9518 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.094+0000 7fe7267fc640 1 -- 172.21.15.5:0/1782092395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71802ae80 con 0x7fe72815c840 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.094+0000 7fe7267fc640 1 -- 172.21.15.5:0/1782092395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718032440 con 0x7fe72815c840 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.094+0000 7fe7267fc640 1 -- 172.21.15.5:0/1782092395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180327b0 con 0x7fe72815c840 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 -- 172.21.15.5:0/1782092395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 msgr2=0x7fe7280ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe7280ae380 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe718009870 tx=0x7fe71802a130 comp rx=0 tx=0).stop 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 -- 172.21.15.5:0/1782092395 shutdown_connections 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe7280ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 --2- 172.21.15.5:0/1782092395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe7280ae380 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 -- 172.21.15.5:0/1782092395 >> 172.21.15.5:0/1782092395 conn(0x7fe7280cc570 msgr2=0x7fe728070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 -- 172.21.15.5:0/1782092395 shutdown_connections 2024-09-13T17:18:50.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.095+0000 7fe72db18640 1 -- 172.21.15.5:0/1782092395 wait complete. 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.096+0000 7fe72db18640 1 Processor -- start 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.096+0000 7fe72db18640 1 -- start start 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe728065f30 0x7fe7280c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe728145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815d8a0 con 0x7fe72815c840 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815db80 con 0x7fe728065f30 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe72db18640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815de60 con 0x7fe72806b5f0 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54504/0 (socket says 172.21.15.5:54504) 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 -- 172.21.15.5:0/508839039 learned_addr learned my addr 172.21.15.5:0/508839039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe7277fe640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe728065f30 0x7fe7280c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe726ffd640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe728145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 -- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 msgr2=0x7fe728145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe728145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 -- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe728065f30 msgr2=0x7fe7280c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe728065f30 0x7fe7280c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.097+0000 7fe727fff640 1 -- 172.21.15.5:0/508839039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180094d0 con 0x7fe72815c840 2024-09-13T17:18:50.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe727fff640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe720007e40 tx=0x7fe72000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720014620 con 0x7fe72815c840 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000ee90 con 0x7fe72815c840 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72815e140 con 0x7fe72815c840 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200149e0 con 0x7fe72815c840 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.098+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72815ee20 con 0x7fe72815c840 2024-09-13T17:18:50.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.099+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7280672c0 con 0x7fe72815c840 2024-09-13T17:18:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.101+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe720014b40 con 0x7fe72815c840 2024-09-13T17:18:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.101+0000 7fe70ffff640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.101+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe72008aa90 con 0x7fe72815c840 2024-09-13T17:18:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.102+0000 7fe7277fe640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.102+0000 7fe7277fe640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 0x7fe71406d0c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe718034000 tx=0x7fe71802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.104+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe720055d50 con 0x7fe72815c840 2024-09-13T17:18:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.274+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe72815e660 con 0x7fe72815c840 2024-09-13T17:18:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.274+0000 7fe70ffff640 1 -- 172.21.15.5:0/508839039 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe720059370 con 0x7fe72815c840 2024-09-13T17:18:50.276 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:18:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 msgr2=0x7fe71406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 0x7fe71406d0c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe718034000 tx=0x7fe71802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 msgr2=0x7fe728145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe720007e40 tx=0x7fe72000e4b0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 shutdown_connections 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe72815c840 0x7fe728145690 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe72806b5f0 0x7fe728145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 --2- 172.21.15.5:0/508839039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe728065f30 0x7fe7280c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 >> 172.21.15.5:0/508839039 conn(0x7fe7280cc570 msgr2=0x7fe7280cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 shutdown_connections 2024-09-13T17:18:50.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.276+0000 7fe72db18640 1 -- 172.21.15.5:0/508839039 wait complete. 2024-09-13T17:18:50.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:18:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.392+0000 7faae6b45640 1 Processor -- start 2024-09-13T17:18:50.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.392+0000 7faae6b45640 1 -- start start 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015c630 0x7faae00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faae015ca10 0x7faae00cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 0x7faae0098ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae0099420 con 0x7faae015ca10 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae006afe0 con 0x7faae0098a50 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faae6b45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae006be00 con 0x7faae015c630 2024-09-13T17:18:50.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faadffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faae015ca10 0x7faae00cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faadffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faae015ca10 0x7faae00cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54520/0 (socket says 172.21.15.5:54520) 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.393+0000 7faadffff640 1 -- 172.21.15.5:0/1385337995 learned_addr learned my addr 172.21.15.5:0/1385337995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faae50e2640 1 --2- 172.21.15.5:0/1385337995 >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 0x7faae0098ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faae48e1640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015c630 0x7faae00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 -- 172.21.15.5:0/1385337995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015c630 msgr2=0x7faae00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015c630 0x7faae00cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 -- 172.21.15.5:0/1385337995 >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 msgr2=0x7faae0098ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 --2- 172.21.15.5:0/1385337995 >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 0x7faae0098ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 -- 172.21.15.5:0/1385337995 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00b1f10 con 0x7faae015ca10 2024-09-13T17:18:50.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faae50e2640 1 --2- 172.21.15.5:0/1385337995 >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 0x7faae0098ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:50.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.394+0000 7faadffff640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015ca10 0x7faae00cf7b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7faae0071770 tx=0x7faac802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7fc68213874be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faadf7fe640 1 -- 172.21.15.5:0/1385337995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8031600 con 0x7faae015ca10 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faadf7fe640 1 -- 172.21.15.5:0/1385337995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac802d050 con 0x7faae015ca10 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faadf7fe640 1 -- 172.21.15.5:0/1385337995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8031980 con 0x7faae015ca10 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 -- 172.21.15.5:0/1385337995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015ca10 msgr2=0x7faae00cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015ca10 0x7faae00cf7b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7faae0071770 tx=0x7faac802a6a0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 -- 172.21.15.5:0/1385337995 shutdown_connections 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 --2- 172.21.15.5:0/1385337995 >> v2:172.21.15.179:3300/0 conn(0x7faae0098a50 0x7faae0098ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015ca10 0x7faae00cf7b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 --2- 172.21.15.5:0/1385337995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015c630 0x7faae00cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 -- 172.21.15.5:0/1385337995 >> 172.21.15.5:0/1385337995 conn(0x7faae00d0520 msgr2=0x7faae00d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 -- 172.21.15.5:0/1385337995 shutdown_connections 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.395+0000 7faae6b45640 1 -- 172.21.15.5:0/1385337995 wait complete. 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.396+0000 7faae6b45640 1 Processor -- start 2024-09-13T17:18:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.396+0000 7faae6b45640 1 -- start start 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 0x7faae015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015ca10 0x7faae015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00cc550 con 0x7faae015c630 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c8710 con 0x7faae0098a50 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faae6b45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c89f0 con 0x7faae015ca10 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faadffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faadffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54528/0 (socket says 172.21.15.5:54528) 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.397+0000 7faadffff640 1 -- 172.21.15.5:0/1705489350 learned_addr learned my addr 172.21.15.5:0/1705489350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faae48e1640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 0x7faae015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faae50e2640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015ca10 0x7faae015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 -- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015ca10 msgr2=0x7faae015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015ca10 0x7faae015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 -- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 msgr2=0x7faae015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 0x7faae015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 -- 172.21.15.5:0/1705489350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8009b30 con 0x7faae015c630 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faae48e1640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 0x7faae015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadffff640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7faac8034040 tx=0x7faac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac803b820 con 0x7faae015c630 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac803b9a0 con 0x7faae015c630 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac803bd50 con 0x7faae015c630 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00c8cd0 con 0x7faae015c630 2024-09-13T17:18:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.398+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae01f6600 con 0x7faae015c630 2024-09-13T17:18:50.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.399+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae00cc550 con 0x7faae015c630 2024-09-13T17:18:50.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.400+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faac8038050 con 0x7faae015c630 2024-09-13T17:18:50.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.400+0000 7faadd7fa640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 0x7faac006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.400+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faac80a9ce0 con 0x7faae015c630 2024-09-13T17:18:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.401+0000 7faae48e1640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 0x7faac006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.401+0000 7faae48e1640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 0x7faac006d0c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7faad0006fd0 tx=0x7faad0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.405+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faae00cc550 con 0x7faae015c630 2024-09-13T17:18:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.574+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faae00cc550 con 0x7faae015c630 2024-09-13T17:18:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.574+0000 7faadd7fa640 1 -- 172.21.15.5:0/1705489350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7faac8036020 con 0x7faae015c630 2024-09-13T17:18:50.576 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:18:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 msgr2=0x7faac006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 0x7faac006d0c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7faad0006fd0 tx=0x7faad0008040 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 msgr2=0x7faae00c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7faac8034040 tx=0x7faac8004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 shutdown_connections 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faae015ca10 0x7faae015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7faac006ac00 0x7faac006d0c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faae015c630 0x7faae00c94d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 --2- 172.21.15.5:0/1705489350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faae0098a50 0x7faae015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 >> 172.21.15.5:0/1705489350 conn(0x7faae00d0520 msgr2=0x7faae00cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 shutdown_connections 2024-09-13T17:18:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.576+0000 7faae6b45640 1 -- 172.21.15.5:0/1705489350 wait complete. 2024-09-13T17:18:50.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:18:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.692+0000 7fe4d5c09640 1 Processor -- start 2024-09-13T17:18:50.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.692+0000 7fe4d5c09640 1 -- start start 2024-09-13T17:18:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4d5c09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4d015c760 0x7fe4d00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4d5c09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 0x7fe4d00cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4d5c09640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00d34d0 con 0x7fe4d00d1b00 2024-09-13T17:18:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4d5c09640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00cddb0 con 0x7fe4d015c760 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4d5c09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b5700 con 0x7fe4d00d20c0 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4d015c760 0x7fe4d00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4d015c760 0x7fe4d00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54534/0 (socket says 172.21.15.5:54534) 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 -- 172.21.15.5:0/2587728761 learned_addr learned my addr 172.21.15.5:0/2587728761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 -- 172.21.15.5:0/2587728761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 msgr2=0x7fe4d00cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4ceffd640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 0x7fe4d00cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 0x7fe4d00cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 -- 172.21.15.5:0/2587728761 >> v1:172.21.15.179:6789/0 conn(0x7fe4d00d1b00 legacy=0x7fe4d00b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4cf7fe640 1 -- 172.21.15.5:0/2587728761 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00d2950 con 0x7fe4d015c760 2024-09-13T17:18:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.693+0000 7fe4ceffd640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 0x7fe4d00cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.694+0000 7fe4cf7fe640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00cf640 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009870 tx=0x7fe4c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8156d4d8d37c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.694+0000 7fe4ce7fc640 1 -- 172.21.15.5:0/2587728761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0032440 con 0x7fe4d015c760 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.694+0000 7fe4ce7fc640 1 -- 172.21.15.5:0/2587728761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00325a0 con 0x7fe4d015c760 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.694+0000 7fe4ce7fc640 1 -- 172.21.15.5:0/2587728761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0032930 con 0x7fe4d015c760 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 -- 172.21.15.5:0/2587728761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 msgr2=0x7fe4d00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00cf640 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009870 tx=0x7fe4c002a1c0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 -- 172.21.15.5:0/2587728761 shutdown_connections 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d20c0 0x7fe4d00cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/2587728761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00cf640 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 -- 172.21.15.5:0/2587728761 >> 172.21.15.5:0/2587728761 conn(0x7fe4d0071a20 msgr2=0x7fe4d0071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 -- 172.21.15.5:0/2587728761 shutdown_connections 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.695+0000 7fe4d5c09640 1 -- 172.21.15.5:0/2587728761 wait complete. 2024-09-13T17:18:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.696+0000 7fe4d5c09640 1 Processor -- start 2024-09-13T17:18:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.696+0000 7fe4d5c09640 1 -- start start 2024-09-13T17:18:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d1b00 0x7fe4d00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d00d20c0 0x7fe4d0158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0157ec0 con 0x7fe4d015c760 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0158160 con 0x7fe4d00d20c0 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4d5c09640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0158440 con 0x7fe4d00d1b00 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54538/0 (socket says 172.21.15.5:54538) 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 -- 172.21.15.5:0/4073992507 learned_addr learned my addr 172.21.15.5:0/4073992507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cf7fe640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d1b00 0x7fe4d00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4ceffd640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d00d20c0 0x7fe4d0158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 -- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d1b00 msgr2=0x7fe4d00c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d1b00 0x7fe4d00c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 -- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d00d20c0 msgr2=0x7fe4d0158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d00d20c0 0x7fe4d0158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 -- 172.21.15.5:0/4073992507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094d0 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4cffff640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c7a0 tx=0x7fe4c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003b70 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.697+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8003cf0 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.698+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d0158720 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.698+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003ea0 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.698+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d01567b0 con 0x7fe4d015c760 2024-09-13T17:18:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.698+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d00d2580 con 0x7fe4d015c760 2024-09-13T17:18:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.699+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4c800aa90 con 0x7fe4d015c760 2024-09-13T17:18:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.699+0000 7fe4b7fff640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 0x7fe4bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.700+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe4c80891f0 con 0x7fe4d015c760 2024-09-13T17:18:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.700+0000 7fe4cf7fe640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 0x7fe4bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.700+0000 7fe4cf7fe640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 0x7fe4bc06d0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0034000 tx=0x7fe4c002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.704+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe4c80542a0 con 0x7fe4d015c760 2024-09-13T17:18:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.875+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4d00c5d20 con 0x7fe4d015c760 2024-09-13T17:18:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.876+0000 7fe4b7fff640 1 -- 172.21.15.5:0/4073992507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4c80578c0 con 0x7fe4d015c760 2024-09-13T17:18:50.877 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.877+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 msgr2=0x7fe4bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.877+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 0x7fe4bc06d0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0034000 tx=0x7fe4c002e000 comp rx=0 tx=0).stop 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.877+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 msgr2=0x7fe4d00b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.877+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c7a0 tx=0x7fe4c800cc60 comp rx=0 tx=0).stop 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.877+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 shutdown_connections 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe4bc06ac00 0x7fe4bc06d0c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d015c760 0x7fe4d00b1890 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4d00d20c0 0x7fe4d0158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 --2- 172.21.15.5:0/4073992507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4d00d1b00 0x7fe4d00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 >> 172.21.15.5:0/4073992507 conn(0x7fe4d0071a20 msgr2=0x7fe4d00c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 shutdown_connections 2024-09-13T17:18:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.878+0000 7fe4d5c09640 1 -- 172.21.15.5:0/4073992507 wait complete. 2024-09-13T17:18:50.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:18:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.991+0000 7f8861508640 1 Processor -- start 2024-09-13T17:18:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.991+0000 7f8861508640 1 -- start start 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f8861508640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f885c154c70 0x7f885c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f8861508640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c070e60 0x7f885c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f8861508640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0cc940 con 0x7f885c15eae0 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f8861508640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c15afb0 con 0x7f885c070e60 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f8861508640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c0ae440 con 0x7f885c154c70 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c070e60 0x7f885c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f885c070e60 0x7f885c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54552/0 (socket says 172.21.15.5:54552) 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 -- 172.21.15.5:0/595220635 learned_addr learned my addr 172.21.15.5:0/595220635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885affd640 1 --2- 172.21.15.5:0/595220635 >> v2:172.21.15.179:3300/0 conn(0x7f885c154c70 0x7f885c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 -- 172.21.15.5:0/595220635 >> v2:172.21.15.179:3300/0 conn(0x7f885c154c70 msgr2=0x7f885c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 --2- 172.21.15.5:0/595220635 >> v2:172.21.15.179:3300/0 conn(0x7f885c154c70 0x7f885c15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 -- 172.21.15.5:0/595220635 >> v1:172.21.15.179:6789/0 conn(0x7f885c15eae0 legacy=0x7f885c070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.992+0000 7f885b7fe640 1 -- 172.21.15.5:0/595220635 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c15ba40 con 0x7f885c070e60 2024-09-13T17:18:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.993+0000 7f885b7fe640 1 --2- 172.21.15.5:0/595220635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c070e60 0x7f885c0ccdd0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f885c067790 tx=0x7f885402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea1e01930793b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.993+0000 7f8859ffb640 1 -- 172.21.15.5:0/595220635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854031600 con 0x7f885c070e60 2024-09-13T17:18:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.993+0000 7f8859ffb640 1 -- 172.21.15.5:0/595220635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885402d050 con 0x7f885c070e60 2024-09-13T17:18:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.993+0000 7f8859ffb640 1 -- 172.21.15.5:0/595220635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854031980 con 0x7f885c070e60 2024-09-13T17:18:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 -- 172.21.15.5:0/595220635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c070e60 msgr2=0x7f885c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 --2- 172.21.15.5:0/595220635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c070e60 0x7f885c0ccdd0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f885c067790 tx=0x7f885402a760 comp rx=0 tx=0).stop 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 -- 172.21.15.5:0/595220635 shutdown_connections 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 --2- 172.21.15.5:0/595220635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c070e60 0x7f885c0ccdd0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 --2- 172.21.15.5:0/595220635 >> v2:172.21.15.179:3300/0 conn(0x7f885c154c70 0x7f885c15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 -- 172.21.15.5:0/595220635 >> 172.21.15.5:0/595220635 conn(0x7f885c0b0c80 msgr2=0x7f885c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 -- 172.21.15.5:0/595220635 shutdown_connections 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.994+0000 7f8861508640 1 -- 172.21.15.5:0/595220635 wait complete. 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.995+0000 7f8861508640 1 Processor -- start 2024-09-13T17:18:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.995+0000 7f8861508640 1 -- start start 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885c070e60 0x7f885c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 0x7f885c1f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b2420 con 0x7f885c154c70 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b2680 con 0x7f885c15eae0 2024-09-13T17:18:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f8861508640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b2960 con 0x7f885c070e60 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54556/0 (socket says 172.21.15.5:54556) 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 -- 172.21.15.5:0/900850727 learned_addr learned my addr 172.21.15.5:0/900850727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885b7fe640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 0x7f885c1f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885affd640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885c070e60 0x7f885c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 -- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885c070e60 msgr2=0x7f885c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885c070e60 0x7f885c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 -- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 msgr2=0x7f885c1f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 0x7f885c1f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885a7fc640 1 -- 172.21.15.5:0/900850727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009b30 con 0x7f885c154c70 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.996+0000 7f885b7fe640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 0x7f885c1f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f885a7fc640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f885000c3c0 tx=0x7f885000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500052d0 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850005450 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0b2c40 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850007260 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.997+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0b3200 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.998+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c0672c0 con 0x7f885c154c70 2024-09-13T17:18:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.998+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f88500073c0 con 0x7f885c154c70 2024-09-13T17:18:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.999+0000 7f88437fe640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 0x7f884806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.999+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f88500887a0 con 0x7f885c154c70 2024-09-13T17:18:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.999+0000 7f885affd640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 0x7f884806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:50.999+0000 7f885affd640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 0x7f884806d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f884c006fd0 tx=0x7f884c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.003+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f88500538d0 con 0x7f885c154c70 2024-09-13T17:18:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.186+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f885c0b3420 con 0x7f885c154c70 2024-09-13T17:18:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.186+0000 7f88437fe640 1 -- 172.21.15.5:0/900850727 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8850056ef0 con 0x7f885c154c70 2024-09-13T17:18:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-09-13T17:18:51.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 msgr2=0x7f884806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 0x7f884806d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f884c006fd0 tx=0x7f884c008040 comp rx=0 tx=0).stop 2024-09-13T17:18:51.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 msgr2=0x7f885c0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f885000c3c0 tx=0x7f885000c880 comp rx=0 tx=0).stop 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 shutdown_connections 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885c15eae0 0x7f885c1f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f884806ac00 0x7f884806d0c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885c154c70 0x7f885c0b1ee0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 --2- 172.21.15.5:0/900850727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885c070e60 0x7f885c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 >> 172.21.15.5:0/900850727 conn(0x7f885c0b0c80 msgr2=0x7f885c070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 shutdown_connections 2024-09-13T17:18:51.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.188+0000 7f8861508640 1 -- 172.21.15.5:0/900850727 wait complete. 2024-09-13T17:18:51.200 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:18:51.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:51.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:18:51.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48284]: fuse finished with error 0 and tester_r 0 2024-09-13T17:18:51.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:51.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:18:51.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:51.257 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:18:51.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:18:51.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:18:51.361 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:18:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:18:51.361 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:18:51.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:18:51.363 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:18:51.364 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:18:51.365 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:18:51.366 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:18:51.367 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:18:51.368 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:18:51.369 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:18:51.370 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:18:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout: mds_sessionmap_keys_per_op = 1 2024-09-13T17:18:51.372 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:18:51.402 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:18:51.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:18:51.404 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:18:51.405 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:18:51.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:18:51.407 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:18:51.408 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:18:51.409 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:18:51.410 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:18:51.411 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:18:51.412 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout: mds_sessionmap_keys_per_op = 1 2024-09-13T17:18:51.413 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:18:51.415 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:18:51.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:51.415 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:18:51.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:51.415 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:18:51.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:51.416 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:18:51.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:18:51.425 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:18:51.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-13T17:18:51.425 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:18:51.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-13T17:18:51.465 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:18:51.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-13T17:18:51.466 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:18:51.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-13T17:18:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7ff790b25640 1 Processor -- start 2024-09-13T17:18:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7f525cfbc640 1 Processor -- start 2024-09-13T17:18:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7f525cfbc640 1 -- start start 2024-09-13T17:18:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7f51fbd76640 1 Processor -- start 2024-09-13T17:18:51.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7ff790b25640 1 -- start start 2024-09-13T17:18:51.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7feac96b7640 1 Processor -- start 2024-09-13T17:18:51.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.573+0000 7feac96b7640 1 -- start start 2024-09-13T17:18:51.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7f51fbd76640 1 -- start start 2024-09-13T17:18:51.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7ff790b25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7feac96b7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feac415cc10 0x7feac406e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7feac96b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feac406ee00 0x7feac406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7feac96b7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac415cff0 con 0x7feac406d670 2024-09-13T17:18:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac96b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40cdd70 con 0x7feac406ee00 2024-09-13T17:18:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac96b7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac406e6d0 con 0x7feac415cc10 2024-09-13T17:18:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.574+0000 7ff790b25640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 0x7ff78c06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:56178/0 (socket says 172.21.15.5:56178) 2024-09-13T17:18:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 0x7ff78c06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac2ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feac415cc10 0x7feac406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac37fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7feac406d670 0x7feac40ac180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:57166/0 (socket says 172.21.15.5:57166) 2024-09-13T17:18:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac37fe640 1 -- 172.21.15.5:0/4191745503 learned_addr learned my addr 172.21.15.5:0/4191745503 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 0x7ff78c06b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54578/0 (socket says 172.21.15.5:54578) 2024-09-13T17:18:51.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac27fc640 1 --2- 172.21.15.5:0/4191745503 >> v2:172.21.15.5:3300/0 conn(0x7feac406ee00 0x7feac406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f525815c770 0x7f525806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 -- 172.21.15.5:0/567233889 learned_addr learned my addr 172.21.15.5:0/567233889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0b31b0 con 0x7ff78c15c570 2024-09-13T17:18:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f525806bae0 0x7f52580cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f525815c770 0x7f525806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac1ffb640 1 -- 172.21.15.5:0/4191745503 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305193754 0 0) 0x7feabc001490 con 0x7feac406d670 2024-09-13T17:18:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac2ffd640 1 -- 172.21.15.5:0/4191745503 >> v2:172.21.15.5:3300/0 conn(0x7feac406ee00 msgr2=0x7feac406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac2ffd640 1 --2- 172.21.15.5:0/4191745503 >> v2:172.21.15.5:3300/0 conn(0x7feac406ee00 0x7feac406d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f525815c770 0x7f525806b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54586/0 (socket says 172.21.15.5:54586) 2024-09-13T17:18:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac2ffd640 1 -- 172.21.15.5:0/4191745503 >> v1:172.21.15.179:6789/0 conn(0x7feac406d670 legacy=0x7feac40ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c06b7e0 con 0x7ff78c06ae60 2024-09-13T17:18:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7feac2ffd640 1 -- 172.21.15.5:0/4191745503 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac406deb0 con 0x7feac415cc10 2024-09-13T17:18:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51fbd76640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51f40c1170 0x7f51f40c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51fbd76640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40aafd0 con 0x7f51f406da00 2024-09-13T17:18:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51fbd76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40ca850 con 0x7f51f40cbd70 2024-09-13T17:18:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51fbd76640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40c9b10 con 0x7f51f40c1170 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c14fed0 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 -- 172.21.15.5:0/567233889 >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 msgr2=0x7ff78c06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 --2- 172.21.15.5:0/567233889 >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 0x7ff78c06b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580cf8c0 con 0x7f525815c770 2024-09-13T17:18:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580d0c40 con 0x7f525806bae0 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525cfbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525806c110 con 0x7f52580cf4b0 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f525659c640 1 -- 172.21.15.5:0/1006062712 learned_addr learned my addr 172.21.15.5:0/1006062712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f5255d9b640 1 --2- 172.21.15.5:0/1006062712 >> v2:172.21.15.179:3300/0 conn(0x7f525806bae0 0x7f52580cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51f9311640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51f406da00 0x7f51f40ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34238/0 (socket says 172.21.15.5:34238) 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51f9311640 1 -- 172.21.15.5:0/3360673337 learned_addr learned my addr 172.21.15.5:0/3360673337 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7f51f9b12640 1 --2- 172.21.15.5:0/3360673337 >> v2:172.21.15.179:3300/0 conn(0x7f51f40c1170 0x7f51f40c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 -- 172.21.15.5:0/567233889 >> v1:172.21.15.5:6789/0 conn(0x7ff78c15c570 legacy=0x7ff78c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f5256d9d640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.575+0000 7ff78a59c640 1 -- 172.21.15.5:0/567233889 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c15ccc0 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f525659c640 1 -- 172.21.15.5:0/1006062712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 msgr2=0x7f52580b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f525659c640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f525659c640 1 -- 172.21.15.5:0/1006062712 >> v2:172.21.15.179:3300/0 conn(0x7f525806bae0 msgr2=0x7f52580cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f525659c640 1 --2- 172.21.15.5:0/1006062712 >> v2:172.21.15.179:3300/0 conn(0x7f525806bae0 0x7f52580cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100935723 0 0) 0x7f51f40ca850 con 0x7f51f40cbd70 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e0003520 con 0x7f51f40cbd70 2024-09-13T17:18:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003079039 0 0) 0x7f51f40aafd0 con 0x7f51f406da00 2024-09-13T17:18:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40ca850 con 0x7f51f406da00 2024-09-13T17:18:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f525659c640 1 -- 172.21.15.5:0/1006062712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525806c3f0 con 0x7f525815c770 2024-09-13T17:18:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f9b12640 1 -- 172.21.15.5:0/3360673337 >> v1:172.21.15.179:6789/0 conn(0x7f51f40cbd70 legacy=0x7f51f4069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f9b12640 1 -- 172.21.15.5:0/3360673337 >> v1:172.21.15.5:6789/0 conn(0x7f51f406da00 legacy=0x7f51f40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7f51f9b12640 1 -- 172.21.15.5:0/3360673337 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40c1a90 con 0x7f51f40c1170 2024-09-13T17:18:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7feac2ffd640 1 --2- 172.21.15.5:0/4191745503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac406e190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feac40d03b0 tx=0x7feab402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49f11546bd948c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.576+0000 7ff78a59c640 1 --2- 172.21.15.5:0/567233889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0b1850 tx=0x7ff77c02e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e18a01c5d0d04d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f525659c640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525815c770 0x7f525806b5a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f525806cef0 tx=0x7f524802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb99ff11280ccf3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7feac1ffb640 1 -- 172.21.15.5:0/4191745503 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab402add0 con 0x7feac415cc10 2024-09-13T17:18:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7ff78959a640 1 -- 172.21.15.5:0/567233889 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00b650 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7feac1ffb640 1 -- 172.21.15.5:0/4191745503 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4032440 con 0x7feac415cc10 2024-09-13T17:18:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7feac1ffb640 1 -- 172.21.15.5:0/4191745503 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40327d0 con 0x7feac415cc10 2024-09-13T17:18:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7ff78959a640 1 -- 172.21.15.5:0/567233889 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c031050 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7ff78959a640 1 -- 172.21.15.5:0/567233889 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00b9d0 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f525559a640 1 -- 172.21.15.5:0/1006062712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248032440 con 0x7f525815c770 2024-09-13T17:18:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f525559a640 1 -- 172.21.15.5:0/1006062712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480325a0 con 0x7f525815c770 2024-09-13T17:18:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f525559a640 1 -- 172.21.15.5:0/1006062712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248032930 con 0x7f525815c770 2024-09-13T17:18:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f51f9b12640 1 --2- 172.21.15.5:0/3360673337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c1170 0x7f51f40c1550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f51f00097a0 tx=0x7f51f002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabb28f060104776 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0032440 con 0x7f51f40c1170 2024-09-13T17:18:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f00325a0 con 0x7f51f40c1170 2024-09-13T17:18:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7f51f8b10640 1 -- 172.21.15.5:0/3360673337 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0032930 con 0x7f51f40c1170 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7feac96b7640 1 -- 172.21.15.5:0/4191745503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 msgr2=0x7feac406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.577+0000 7feac96b7640 1 --2- 172.21.15.5:0/4191745503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac406e190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feac40d03b0 tx=0x7feab402a080 comp rx=0 tx=0).stop 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 -- 172.21.15.5:0/4191745503 shutdown_connections 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 --2- 172.21.15.5:0/4191745503 >> v2:172.21.15.5:3300/0 conn(0x7feac406ee00 0x7feac406d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 --2- 172.21.15.5:0/4191745503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac406e190 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 -- 172.21.15.5:0/4191745503 >> 172.21.15.5:0/4191745503 conn(0x7feac4098a70 msgr2=0x7feac40b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 msgr2=0x7ff78c0b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 --2- 172.21.15.5:0/567233889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0b1850 tx=0x7ff77c02e530 comp rx=0 tx=0).stop 2024-09-13T17:18:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 -- 172.21.15.5:0/4191745503 shutdown_connections 2024-09-13T17:18:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 -- 172.21.15.5:0/1006062712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525815c770 msgr2=0x7f525806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525815c770 0x7f525806b5a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f525806cef0 tx=0x7f524802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 shutdown_connections 2024-09-13T17:18:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 --2- 172.21.15.5:0/567233889 >> v2:172.21.15.5:3300/0 conn(0x7ff78c06ae60 0x7ff78c06b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 --2- 172.21.15.5:0/567233889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c0b3ed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 >> 172.21.15.5:0/567233889 conn(0x7ff78c070800 msgr2=0x7ff78c070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7feac96b7640 1 -- 172.21.15.5:0/4191745503 wait complete. 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 -- 172.21.15.5:0/1006062712 shutdown_connections 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 --2- 172.21.15.5:0/1006062712 >> v2:172.21.15.179:3300/0 conn(0x7f525806bae0 0x7f52580cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 --2- 172.21.15.5:0/1006062712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525815c770 0x7f525806b5a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 -- 172.21.15.5:0/1006062712 >> 172.21.15.5:0/1006062712 conn(0x7f525808bfb0 msgr2=0x7f525809b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 shutdown_connections 2024-09-13T17:18:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7ff790b25640 1 -- 172.21.15.5:0/567233889 wait complete. 2024-09-13T17:18:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 -- 172.21.15.5:0/1006062712 shutdown_connections 2024-09-13T17:18:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f525cfbc640 1 -- 172.21.15.5:0/1006062712 wait complete. 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 -- 172.21.15.5:0/3360673337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c1170 msgr2=0x7f51f40c1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 --2- 172.21.15.5:0/3360673337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c1170 0x7f51f40c1550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f51f00097a0 tx=0x7f51f002a230 comp rx=0 tx=0).stop 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 -- 172.21.15.5:0/3360673337 shutdown_connections 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 --2- 172.21.15.5:0/3360673337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c1170 0x7f51f40c1550 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 -- 172.21.15.5:0/3360673337 >> 172.21.15.5:0/3360673337 conn(0x7f51f40ce380 msgr2=0x7f51f40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 -- 172.21.15.5:0/3360673337 shutdown_connections 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.578+0000 7f51fbd76640 1 -- 172.21.15.5:0/3360673337 wait complete. 2024-09-13T17:18:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.579+0000 7feac96b7640 1 Processor -- start 2024-09-13T17:18:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.579+0000 7feac96b7640 1 -- start start 2024-09-13T17:18:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.579+0000 7ff790b25640 1 Processor -- start 2024-09-13T17:18:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.579+0000 7f525cfbc640 1 Processor -- start 2024-09-13T17:18:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7ff790b25640 1 -- start start 2024-09-13T17:18:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7f525cfbc640 1 -- start start 2024-09-13T17:18:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7f51fbd76640 1 Processor -- start 2024-09-13T17:18:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7f51fbd76640 1 -- start start 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 0x7feac4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac40b3a30 con 0x7feac406d670 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac40c3610 con 0x7feac415cc10 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac96b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac4157160 con 0x7feac406ee00 2024-09-13T17:18:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54600/0 (socket says 172.21.15.5:54600) 2024-09-13T17:18:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac2ffd640 1 -- 172.21.15.5:0/2811172159 learned_addr learned my addr 172.21.15.5:0/2811172159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7feac27fc640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 0x7feac4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.580+0000 7f51fbd76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 0x7f51f4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fbd76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525806bae0 0x7f5258156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fbd76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c2c10 0x7f51f40c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fbd76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40c1c80 con 0x7f51f40c1170 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fbd76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40c55e0 con 0x7f51f40c2c10 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fbd76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40c58c0 con 0x7f51f40cbd70 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525815c770 0x7f52580b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580cb540 con 0x7f525806bae0 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5258156dc0 con 0x7f525815c770 2024-09-13T17:18:51.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525cfbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52580caf80 con 0x7f52580cf4b0 2024-09-13T17:18:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac37fe640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:50720/0 (socket says 172.21.15.5:50720) 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78c15c570 0x7ff78c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c152750 con 0x7ff78c06ae60 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c151b40 con 0x7ff78c0b2dd0 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 -- 172.21.15.5:0/1087608829 learned_addr learned my addr 172.21.15.5:0/1087608829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51fa313640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c2c10 0x7f51f40c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff790b25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c151e20 con 0x7ff78c15c570 2024-09-13T17:18:51.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9b12640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 0x7f51f4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54622/0 (socket says 172.21.15.5:54622) 2024-09-13T17:18:51.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78a59c640 1 -- 172.21.15.5:0/1363475010 learned_addr learned my addr 172.21.15.5:0/1363475010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:50734/0 (socket says 172.21.15.5:50734) 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 -- 172.21.15.5:0/2395597447 learned_addr learned my addr 172.21.15.5:0/2395597447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5256d9d640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525815c770 0x7f52580b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 -- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 msgr2=0x7feac40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac40c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 -- 172.21.15.5:0/2811172159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 msgr2=0x7feac40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff789d9b640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 -- 172.21.15.5:0/2811172159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009400 con 0x7feac406ee00 2024-09-13T17:18:51.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac2ffd640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:51.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f525659c640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525806bae0 0x7f5258156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 -- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c2c10 msgr2=0x7f51f40c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c2c10 0x7f51f40c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 -- 172.21.15.5:0/1087608829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 msgr2=0x7f51f4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 0x7f51f4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9311640 1 -- 172.21.15.5:0/1087608829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009400 con 0x7f51f40cbd70 2024-09-13T17:18:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78ad9d640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78c15c570 0x7ff78c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f51f9b12640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 0x7f51f4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7feac27fc640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 0x7feac4156c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feab800e870 tx=0x7feab800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 -- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525815c770 msgr2=0x7f52580b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525815c770 0x7f52580b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 -- 172.21.15.5:0/2395597447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525806bae0 msgr2=0x7f5258156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525806bae0 0x7f5258156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78a59c640 1 -- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78c15c570 msgr2=0x7ff78c140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7ff78a59c640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78c15c570 0x7ff78c140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff78a59c640 1 -- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 msgr2=0x7ff78c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff78a59c640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff78a59c640 1 -- 172.21.15.5:0/1363475010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c00d970 con 0x7ff78c06ae60 2024-09-13T17:18:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff789d9b640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.581+0000 7f5255d9b640 1 -- 172.21.15.5:0/2395597447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480094d0 con 0x7f52580cf4b0 2024-09-13T17:18:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51f9311640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cbc0 tx=0x7f51e800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8009590 con 0x7feac406ee00 2024-09-13T17:18:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800c940 con 0x7feac406ee00 2024-09-13T17:18:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac40c5d60 con 0x7feac406ee00 2024-09-13T17:18:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800ad40 con 0x7f51f40cbd70 2024-09-13T17:18:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800ccd0 con 0x7feac406ee00 2024-09-13T17:18:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff78a59c640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff77c02eb20 tx=0x7ff77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8012400 con 0x7f51f40cbd70 2024-09-13T17:18:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800aea0 con 0x7f51f40cbd70 2024-09-13T17:18:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f5255d9b640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f524c00e870 tx=0x7f524c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f40c1ed0 con 0x7f51f40cbd70 2024-09-13T17:18:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac40b3750 con 0x7feac406ee00 2024-09-13T17:18:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f40c5270 con 0x7f51f40cbd70 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c03f820 con 0x7ff78c06ae60 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c03f980 con 0x7ff78c06ae60 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.582+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c03fd30 con 0x7ff78c06ae60 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c152100 con 0x7ff78c06ae60 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c13e140 con 0x7ff78c06ae60 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c009540 con 0x7f52580cf4b0 2024-09-13T17:18:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c005990 con 0x7f52580cf4b0 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c005d20 con 0x7f52580cf4b0 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52580cb260 con 0x7f52580cf4b0 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52580b3ca0 con 0x7f52580cf4b0 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac40c65f0 con 0x7feac406ee00 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.583+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f40672d0 con 0x7f51f40cbd70 2024-09-13T17:18:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.584+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feab8013470 con 0x7feac406ee00 2024-09-13T17:18:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.584+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c0cb490 con 0x7ff78c06ae60 2024-09-13T17:18:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.584+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52580b3820 con 0x7f52580cf4b0 2024-09-13T17:18:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f51e80127b0 con 0x7f51f40cbd70 2024-09-13T17:18:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7feaab7fe640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 0x7feab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feab8089260 con 0x7feac406ee00 2024-09-13T17:18:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7feac2ffd640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 0x7feab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f524c00c940 con 0x7f52580cf4b0 2024-09-13T17:18:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7f51e67fc640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 0x7f51d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff77c03c070 con 0x7ff78c06ae60 2024-09-13T17:18:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f51e80894f0 con 0x7f51f40cbd70 2024-09-13T17:18:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.585+0000 7f51f9b12640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 0x7f51d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7feac2ffd640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 0x7feab006d190 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feab402bfd0 tx=0x7feab402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7f5246ffd640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 0x7f523806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7ff77affd640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 0x7ff76c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f524c089640 con 0x7f52580cf4b0 2024-09-13T17:18:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7f525659c640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 0x7f523806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff77c0adee0 con 0x7ff78c06ae60 2024-09-13T17:18:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7f51f9b12640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 0x7f51d806d0c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f51f0034000 tx=0x7f51f002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7ff789d9b640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 0x7ff76c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.586+0000 7f525659c640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 0x7f523806d110 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5248034000 tx=0x7f524802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.587+0000 7ff789d9b640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 0x7ff76c06d0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0ae7b0 tx=0x7ff780001750 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.589+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51e80547b0 con 0x7f51f40cbd70 2024-09-13T17:18:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.590+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff77c078fb0 con 0x7ff78c06ae60 2024-09-13T17:18:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.593+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feac40c65f0 con 0x7feac406ee00 2024-09-13T17:18:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.597+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f52580b3820 con 0x7f52580cf4b0 2024-09-13T17:18:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.828+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f51f40c5a00 con 0x7f51f40cbd70 2024-09-13T17:18:51.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.833+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7feac40c65f0 con 0x7feac406ee00 2024-09-13T17:18:51.835 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:18:51.834+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:18:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.835+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7ff78c0b31b0 con 0x7ff78c06ae60 2024-09-13T17:18:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.841+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f52580b3820 con 0x7f52580cf4b0 2024-09-13T17:18:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.842+0000 7f51e67fc640 1 -- 172.21.15.5:0/1087608829 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6785 v49) v1 ==== 95+0+0 (secure 0 0 0) 0x7f51f40c5a00 con 0x7f51f40cbd70 2024-09-13T17:18:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.842+0000 7feaab7fe640 1 -- 172.21.15.5:0/2811172159 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8232 v49) v1 ==== 95+0+0 (secure 0 0 0) 0x7feac40c65f0 con 0x7feac406ee00 2024-09-13T17:18:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6785 2024-09-13T17:18:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 8232 2024-09-13T17:18:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 msgr2=0x7f51d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 0x7f51d806d0c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f51f0034000 tx=0x7f51f002e000 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 msgr2=0x7f51f40c26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cbc0 tx=0x7f51e800a430 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 shutdown_connections 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f40c2c10 0x7f51f40c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51f40cbd70 0x7f51f40c26d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f51d806ac00 0x7f51d806d0c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 --2- 172.21.15.5:0/1087608829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f40c1170 0x7f51f4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.844+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 >> 172.21.15.5:0/1087608829 conn(0x7f51f40ce380 msgr2=0x7f51f406ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 shutdown_connections 2024-09-13T17:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7f51fbd76640 1 -- 172.21.15.5:0/1087608829 wait complete. 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 msgr2=0x7feab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 0x7feab006d190 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feab402bfd0 tx=0x7feab402e000 comp rx=0 tx=0).stop 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 msgr2=0x7feac4156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 0x7feac4156c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feab800e870 tx=0x7feab800ed30 comp rx=0 tx=0).stop 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 shutdown_connections 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac415cc10 0x7feac40c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac406ee00 0x7feac4156c20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7feab006acd0 0x7feab006d190 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 --2- 172.21.15.5:0/2811172159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feac406d670 0x7feac40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 >> 172.21.15.5:0/2811172159 conn(0x7feac4098a70 msgr2=0x7feac40b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 shutdown_connections 2024-09-13T17:18:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.845+0000 7feac96b7640 1 -- 172.21.15.5:0/2811172159 wait complete. 2024-09-13T17:18:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.849+0000 7ff77affd640 1 -- 172.21.15.5:0/1363475010 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7501 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff78c0b31b0 con 0x7ff78c06ae60 2024-09-13T17:18:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 7501 2024-09-13T17:18:51.850 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:18:51.850+0000 7f1b2dcec640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 msgr2=0x7ff76c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 0x7ff76c06d0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0ae7b0 tx=0x7ff780001750 comp rx=0 tx=0).stop 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 msgr2=0x7ff78c13dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff77c02eb20 tx=0x7ff77c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 shutdown_connections 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff78c15c570 0x7ff78c140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff78c0b2dd0 0x7ff78c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff76c06ac00 0x7ff76c06d0c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 --2- 172.21.15.5:0/1363475010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff78c06ae60 0x7ff78c13dc00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.851+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 >> 172.21.15.5:0/1363475010 conn(0x7ff78c070800 msgr2=0x7ff78c14f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.852+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 shutdown_connections 2024-09-13T17:18:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.852+0000 7ff790b25640 1 -- 172.21.15.5:0/1363475010 wait complete. 2024-09-13T17:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.858+0000 7f5246ffd640 1 -- 172.21.15.5:0/2395597447 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7492 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7f52580b3820 con 0x7f52580cf4b0 2024-09-13T17:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 7492 2024-09-13T17:18:51.861 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:18:51.862 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 msgr2=0x7f523806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 0x7f523806d110 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5248034000 tx=0x7f524802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 msgr2=0x7f52580ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f524c00e870 tx=0x7f524c00ed30 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 shutdown_connections 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f525815c770 0x7f52580b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52580cf4b0 0x7f52580ca200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f523806ac50 0x7f523806d110 secure :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5248034000 tx=0x7f524802e000 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 --2- 172.21.15.5:0/2395597447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525806bae0 0x7f5258156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 >> 172.21.15.5:0/2395597447 conn(0x7f525808bfb0 msgr2=0x7f525815d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 shutdown_connections 2024-09-13T17:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:51.861+0000 7f525cfbc640 1 -- 172.21.15.5:0/2395597447 wait complete. 2024-09-13T17:18:51.865 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:18:51.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:18:51.866 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:18:51.866 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:51.868 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:18:51.868 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:18:51.870 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:18:51.870 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:51.873 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:18:51.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:18:51.874 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:18:51.874 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:51.916 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:18:51.916 DEBUG:teuthology.parallel:result is None 2024-09-13T17:18:51.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:51.940 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-13T17:18:51.943 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:18:51.950 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:18:51.995 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-09-13T17:18:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.021+0000 7f468762b640 1 Processor -- start 2024-09-13T17:18:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.021+0000 7f468762b640 1 -- start start 2024-09-13T17:18:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f468762b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4680160090 0x7f46800d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f468762b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b47d0 con 0x7f46800d0790 2024-09-13T17:18:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f468762b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b3330 con 0x7f46800b4c60 2024-09-13T17:18:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f468762b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46800d0d00 con 0x7f4680160090 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4684bc6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46800d0790 0x7f46800b2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34254/0 (socket says 172.21.15.5:34254) 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4684bc6640 1 -- 172.21.15.5:0/199637336 learned_addr learned my addr 172.21.15.5:0/199637336 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f46853c7640 1 --2- 172.21.15.5:0/199637336 >> v2:172.21.15.179:3300/0 conn(0x7f4680160090 0x7f46800d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630977238 0 0) 0x7f46800b47d0 con 0x7f46800d0790 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003520 con 0x7f46800d0790 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841826812 0 0) 0x7f46800b3330 con 0x7f46800b4c60 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46800b47d0 con 0x7f46800b4c60 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f46853c7640 1 -- 172.21.15.5:0/199637336 >> v1:172.21.15.179:6789/0 conn(0x7f46800b4c60 legacy=0x7f46800b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f46853c7640 1 -- 172.21.15.5:0/199637336 >> v1:172.21.15.5:6789/0 conn(0x7f46800d0790 legacy=0x7f46800b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.022+0000 7f46853c7640 1 -- 172.21.15.5:0/199637336 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800b3ea0 con 0x7f4680160090 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.023+0000 7f46853c7640 1 --2- 172.21.15.5:0/199637336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4680160090 0x7f46800d0f90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f467c009790 tx=0x7f467c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15559c0cf9d2c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.023+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c02ae50 con 0x7f4680160090 2024-09-13T17:18:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.023+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c032440 con 0x7f4680160090 2024-09-13T17:18:52.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.023+0000 7f4677fff640 1 -- 172.21.15.5:0/199637336 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0327d0 con 0x7f4680160090 2024-09-13T17:18:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 -- 172.21.15.5:0/199637336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4680160090 msgr2=0x7f46800d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 --2- 172.21.15.5:0/199637336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4680160090 0x7f46800d0f90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f467c009790 tx=0x7f467c02a100 comp rx=0 tx=0).stop 2024-09-13T17:18:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 -- 172.21.15.5:0/199637336 shutdown_connections 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 --2- 172.21.15.5:0/199637336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4680160090 0x7f46800d0f90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 -- 172.21.15.5:0/199637336 >> 172.21.15.5:0/199637336 conn(0x7f468009b9a0 msgr2=0x7f468008a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 -- 172.21.15.5:0/199637336 shutdown_connections 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.024+0000 7f468762b640 1 -- 172.21.15.5:0/199637336 wait complete. 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.025+0000 7f468762b640 1 Processor -- start 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.025+0000 7f468762b640 1 -- start start 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46800b4c60 0x7f46801568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4680156110 0x7f468015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680157160 con 0x7f46800d0790 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800b5b60 con 0x7f46800b4c60 2024-09-13T17:18:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f468762b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46800c89b0 con 0x7f4680156110 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54674/0 (socket says 172.21.15.5:54674) 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 -- 172.21.15.5:0/2269473985 learned_addr learned my addr 172.21.15.5:0/2269473985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f46853c7640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46800b4c60 0x7f46801568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4685bc8640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4680156110 0x7f468015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 -- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4680156110 msgr2=0x7f468015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4680156110 0x7f468015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 -- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46800b4c60 msgr2=0x7f46801568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46800b4c60 0x7f46801568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.026+0000 7f4684bc6640 1 -- 172.21.15.5:0/2269473985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0093a0 con 0x7f46800d0790 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f4684bc6640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f467000c400 tx=0x7f467000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700074e0 con 0x7f46800d0790 2024-09-13T17:18:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670007640 con 0x7f46800d0790 2024-09-13T17:18:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46800b5550 con 0x7f46800d0790 2024-09-13T17:18:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700059c0 con 0x7f46800d0790 2024-09-13T17:18:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.027+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46800b57f0 con 0x7f46800d0790 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.028+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680067310 con 0x7f46800d0790 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.028+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4670005b20 con 0x7f46800d0790 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.029+0000 7f4675ffb640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 0x7f466406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.029+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f4670088ad0 con 0x7f46800d0790 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.029+0000 7f46853c7640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 0x7f466406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.030+0000 7f46853c7640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 0x7f466406d0c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f467c034000 tx=0x7f467c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.033+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4670053b70 con 0x7f46800d0790 2024-09-13T17:18:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.240+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46800b5d10 con 0x7f46800d0790 2024-09-13T17:18:52.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.240+0000 7f4675ffb640 1 -- 172.21.15.5:0/2269473985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1702 (secure 0 0 0) 0x7f46800b5d10 con 0x7f46800d0790 2024-09-13T17:18:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:52.242 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:51.850740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:52.242 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2024-09-13T17:18:52.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 msgr2=0x7f466406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 0x7f466406d0c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f467c034000 tx=0x7f467c02e000 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 msgr2=0x7f46800c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f467000c400 tx=0x7f467000c8c0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 shutdown_connections 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4680156110 0x7f468015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f466406ac00 0x7f466406d0c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46800d0790 0x7f46800c8470 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 --2- 172.21.15.5:0/2269473985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46800b4c60 0x7f46801568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 >> 172.21.15.5:0/2269473985 conn(0x7f468009b9a0 msgr2=0x7f46800b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 shutdown_connections 2024-09-13T17:18:52.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:52.242+0000 7f468762b640 1 -- 172.21.15.5:0/2269473985 wait complete. 2024-09-13T17:18:52.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:18:51.850740+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:52.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-13T17:18:53.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.771+0000 7f3bb8318640 1 Processor -- start 2024-09-13T17:18:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.771+0000 7f3bb8318640 1 -- start start 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bb0160090 0x7f3bb00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 0x7f3bb00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 0x7f3bb00b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00b47d0 con 0x7f3bb0160090 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00d0d00 con 0x7f3bb00b4c60 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.772+0000 7f3bb8318640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00b3ea0 con 0x7f3bb00d0790 2024-09-13T17:18:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bb0160090 0x7f3bb00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bb0160090 0x7f3bb00d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50956/0 (socket says 172.21.15.5:50956) 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 -- 172.21.15.5:0/2905216707 learned_addr learned my addr 172.21.15.5:0/2905216707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb68b5640 1 --2- 172.21.15.5:0/2905216707 >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 0x7f3bb00b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb58b3640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 0x7f3bb00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 -- 172.21.15.5:0/2905216707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 msgr2=0x7f3bb00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 0x7f3bb00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 -- 172.21.15.5:0/2905216707 >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 msgr2=0x7f3bb00b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/2905216707 >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 0x7f3bb00b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb60b4640 1 -- 172.21.15.5:0/2905216707 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00b4180 con 0x7f3bb0160090 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb68b5640 1 --2- 172.21.15.5:0/2905216707 >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 0x7f3bb00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.773+0000 7f3bb58b3640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 0x7f3bb00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb0160090 0x7f3bb00d0f90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006a710 tx=0x7f3bac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c30e00e6b8aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb50b2640 1 -- 172.21.15.5:0/2905216707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac031400 con 0x7f3bb0160090 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb50b2640 1 -- 172.21.15.5:0/2905216707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac02d050 con 0x7f3bb0160090 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb50b2640 1 -- 172.21.15.5:0/2905216707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac031780 con 0x7f3bb0160090 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb8318640 1 -- 172.21.15.5:0/2905216707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb0160090 msgr2=0x7f3bb00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.774+0000 7f3bb8318640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb0160090 0x7f3bb00d0f90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006a710 tx=0x7f3bac02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 -- 172.21.15.5:0/2905216707 shutdown_connections 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 --2- 172.21.15.5:0/2905216707 >> v2:172.21.15.179:3300/0 conn(0x7f3bb00b4c60 0x7f3bb00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb00d0790 0x7f3bb00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 --2- 172.21.15.5:0/2905216707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb0160090 0x7f3bb00d0f90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 -- 172.21.15.5:0/2905216707 >> 172.21.15.5:0/2905216707 conn(0x7f3bb009b9a0 msgr2=0x7f3bb008a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 -- 172.21.15.5:0/2905216707 shutdown_connections 2024-09-13T17:18:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.775+0000 7f3bb8318640 1 -- 172.21.15.5:0/2905216707 wait complete. 2024-09-13T17:18:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.776+0000 7f3bb8318640 1 Processor -- start 2024-09-13T17:18:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.776+0000 7f3bb8318640 1 -- start start 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb00d0790 0x7f3bb00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb0156e90 0x7f3bb014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00c84f0 con 0x7f3bb00b4c60 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00b5800 con 0x7f3bb00d0790 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb8318640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00c7620 con 0x7f3bb0156e90 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50972/0 (socket says 172.21.15.5:50972) 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 -- 172.21.15.5:0/1395630714 learned_addr learned my addr 172.21.15.5:0/1395630714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb68b5640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb0156e90 0x7f3bb014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb58b3640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb00d0790 0x7f3bb00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 -- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb0156e90 msgr2=0x7f3bb014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb0156e90 0x7f3bb014d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 -- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb00d0790 msgr2=0x7f3bb00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb00d0790 0x7f3bb00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 -- 172.21.15.5:0/1395630714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009b30 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3bb60b4640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f3bac000f80 tx=0x7f3bac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.777+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac03d650 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.778+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac03d7b0 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.778+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb00c7870 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.778+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac03db60 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.778+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00c7e30 con 0x7f3bb00b4c60 2024-09-13T17:18:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.779+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0067310 con 0x7f3bb00b4c60 2024-09-13T17:18:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.779+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bac03dcc0 con 0x7f3bb00b4c60 2024-09-13T17:18:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.779+0000 7f3ba6ffd640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 0x7f3b9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.780+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f3bac0aa1c0 con 0x7f3bb00b4c60 2024-09-13T17:18:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.780+0000 7f3bb58b3640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 0x7f3b9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.780+0000 7f3bb58b3640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 0x7f3b9406d0c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00cfe70 tx=0x7f3ba0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.784+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bac0751d0 con 0x7f3bb00b4c60 2024-09-13T17:18:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.993+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bb015ed90 con 0x7f3bb00b4c60 2024-09-13T17:18:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.993+0000 7f3ba6ffd640 1 -- 172.21.15.5:0/1395630714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f3bac009510 con 0x7f3bb00b4c60 2024-09-13T17:18:53.994 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:53.995 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:53.861258+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8607},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 54 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 msgr2=0x7f3b9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 0x7f3b9406d0c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00cfe70 tx=0x7f3ba0008040 comp rx=0 tx=0).stop 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 msgr2=0x7f3bb00c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f3bac000f80 tx=0x7f3bac004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 shutdown_connections 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb0156e90 0x7f3bb014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bb00d0790 0x7f3bb00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.995+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3b9406ac00 0x7f3b9406d0c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.996+0000 7f3bb8318640 1 --2- 172.21.15.5:0/1395630714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bb00b4c60 0x7f3bb00c8910 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.996+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 >> 172.21.15.5:0/1395630714 conn(0x7f3bb009b9a0 msgr2=0x7f3bb00b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.996+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 shutdown_connections 2024-09-13T17:18:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:53.996+0000 7f3bb8318640 1 -- 172.21.15.5:0/1395630714 wait complete. 2024-09-13T17:18:54.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:18:53.861258+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8607}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8607': {'gid': 8607, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.5:6833/3736030266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3736030266}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3736030266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:54.411 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8607:up:reconnect 2024-09-13T17:18:55.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.526+0000 7f90ca984640 1 Processor -- start 2024-09-13T17:18:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.526+0000 7f90ca984640 1 -- start start 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90ca984640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c40cedc0 0x7f90c40acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90ca984640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90c40abf40 0x7f90c4070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90ca984640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c40701a0 con 0x7f90c41591e0 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90ca984640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40ad540 con 0x7f90c40abf40 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90ca984640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40ad820 con 0x7f90c40cedc0 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90c8f21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90c40abf40 0x7f90c4070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90c8f21640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90c40abf40 0x7f90c4070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50974/0 (socket says 172.21.15.5:50974) 2024-09-13T17:18:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.527+0000 7f90c8f21640 1 -- 172.21.15.5:0/1500670595 learned_addr learned my addr 172.21.15.5:0/1500670595 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.528+0000 7f90bbfff640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c40cedc0 0x7f90c40acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.528+0000 7f90c8f21640 1 -- 172.21.15.5:0/1500670595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c40cedc0 msgr2=0x7f90c40acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.528+0000 7f90c8f21640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c40cedc0 0x7f90c40acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.528+0000 7f90c8f21640 1 -- 172.21.15.5:0/1500670595 >> v1:172.21.15.179:6789/0 conn(0x7f90c41591e0 legacy=0x7f90c40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.528+0000 7f90c8f21640 1 -- 172.21.15.5:0/1500670595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40adb00 con 0x7f90c40abf40 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90c8f21640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40abf40 0x7f90c4070910 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009e50 tx=0x7f90bc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff5717ad6072e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90c37fe640 1 -- 172.21.15.5:0/1500670595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc02aea0 con 0x7f90c40abf40 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90c37fe640 1 -- 172.21.15.5:0/1500670595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc02d050 con 0x7f90c40abf40 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90c37fe640 1 -- 172.21.15.5:0/1500670595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc031820 con 0x7f90c40abf40 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 -- 172.21.15.5:0/1500670595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40abf40 msgr2=0x7f90c4070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40abf40 0x7f90c4070910 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009e50 tx=0x7f90bc02a680 comp rx=0 tx=0).stop 2024-09-13T17:18:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 -- 172.21.15.5:0/1500670595 shutdown_connections 2024-09-13T17:18:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40abf40 0x7f90c4070910 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 --2- 172.21.15.5:0/1500670595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c40cedc0 0x7f90c40acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 -- 172.21.15.5:0/1500670595 >> 172.21.15.5:0/1500670595 conn(0x7f90c406a270 msgr2=0x7f90c406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 -- 172.21.15.5:0/1500670595 shutdown_connections 2024-09-13T17:18:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.529+0000 7f90ca984640 1 -- 172.21.15.5:0/1500670595 wait complete. 2024-09-13T17:18:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 Processor -- start 2024-09-13T17:18:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 -- start start 2024-09-13T17:18:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c40abf40 0x7f90c415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c41591e0 0x7f90c4150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c414bdd0 con 0x7f90c40cedc0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c414c7d0 con 0x7f90c40abf40 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.531+0000 7f90ca984640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c414cab0 con 0x7f90c41591e0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50980/0 (socket says 172.21.15.5:50980) 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 -- 172.21.15.5:0/932986273 learned_addr learned my addr 172.21.15.5:0/932986273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90c8f21640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c41591e0 0x7f90c4150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90c3fff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c40abf40 0x7f90c415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 -- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c41591e0 msgr2=0x7f90c4150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c41591e0 0x7f90c4150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 -- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c40abf40 msgr2=0x7f90c415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c40abf40 0x7f90c415bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 -- 172.21.15.5:0/932986273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009b30 con 0x7f90c40cedc0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90bbfff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00d800 tx=0x7f90ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00b6c0 con 0x7f90c40cedc0 2024-09-13T17:18:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00b820 con 0x7f90c40cedc0 2024-09-13T17:18:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c415b230 con 0x7f90c40cedc0 2024-09-13T17:18:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00bbb0 con 0x7f90c40cedc0 2024-09-13T17:18:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.532+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c415b7f0 con 0x7f90c40cedc0 2024-09-13T17:18:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.533+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c40acf20 con 0x7f90c40cedc0 2024-09-13T17:18:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.534+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90ac00bd10 con 0x7f90c40cedc0 2024-09-13T17:18:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.534+0000 7f90c17fa640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 0x7f90a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.534+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f90ac089990 con 0x7f90c40cedc0 2024-09-13T17:18:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.535+0000 7f90c3fff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 0x7f90a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.535+0000 7f90c3fff640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 0x7f90a406d0c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f90b4000f60 tx=0x7f90b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.539+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90ac054a30 con 0x7f90c40cedc0 2024-09-13T17:18:55.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.745+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90c40ce070 con 0x7f90c40cedc0 2024-09-13T17:18:55.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.745+0000 7f90c17fa640 1 -- 172.21.15.5:0/932986273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f90ac058050 con 0x7f90c40cedc0 2024-09-13T17:18:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:55.747 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:54.863019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8607},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:55.747 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 55 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 msgr2=0x7f90a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 0x7f90a406d0c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f90b4000f60 tx=0x7f90b4009040 comp rx=0 tx=0).stop 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 msgr2=0x7f90c414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00d800 tx=0x7f90ac00dcc0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 shutdown_connections 2024-09-13T17:18:55.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90c41591e0 0x7f90c4150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90a406ac00 0x7f90a406d0c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90c40cedc0 0x7f90c414b890 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 --2- 172.21.15.5:0/932986273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90c40abf40 0x7f90c415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.747+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 >> 172.21.15.5:0/932986273 conn(0x7f90c406a270 msgr2=0x7f90c40afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.748+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 shutdown_connections 2024-09-13T17:18:55.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:55.748+0000 7f90ca984640 1 -- 172.21.15.5:0/932986273 wait complete. 2024-09-13T17:18:56.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:18:54.863019+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8607}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8607': {'gid': 8607, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.5:6833/3736030266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3736030266}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3736030266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:56.162 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8607:up:rejoin 2024-09-13T17:18:57.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:57.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.277+0000 7fabdad65640 1 Processor -- start 2024-09-13T17:18:57.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 -- start start 2024-09-13T17:18:57.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 0x7fabd40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 0x7fabd40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd40b47d0 con 0x7fabd40b4c60 2024-09-13T17:18:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40d0d00 con 0x7fabd40d0790 2024-09-13T17:18:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.278+0000 7fabdad65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b3ea0 con 0x7fabd4160090 2024-09-13T17:18:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 0x7fabd40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd8b01640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 0x7fabd40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd9302640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fabd40b4c60 0x7fabd40b2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:58372/0 (socket says 172.21.15.5:58372) 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd9302640 1 -- 172.21.15.5:0/1466634221 learned_addr learned my addr 172.21.15.5:0/1466634221 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd8b01640 1 -- 172.21.15.5:0/1466634221 >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 msgr2=0x7fabd40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd8b01640 1 --2- 172.21.15.5:0/1466634221 >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 0x7fabd40d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd8b01640 1 -- 172.21.15.5:0/1466634221 >> v1:172.21.15.179:6789/0 conn(0x7fabd40b4c60 legacy=0x7fabd40b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd8b01640 1 -- 172.21.15.5:0/1466634221 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40b4180 con 0x7fabd4160090 2024-09-13T17:18:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.279+0000 7fabd3fff640 1 --2- 172.21.15.5:0/1466634221 >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 0x7fabd40d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.280+0000 7fabd8b01640 1 --2- 172.21.15.5:0/1466634221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 0x7fabd40d0f90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009790 tx=0x7fabc402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c063001045b2428 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.280+0000 7fabd37fe640 1 -- 172.21.15.5:0/1466634221 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc402adb0 con 0x7fabd4160090 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.280+0000 7fabd37fe640 1 -- 172.21.15.5:0/1466634221 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4032440 con 0x7fabd4160090 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.280+0000 7fabd37fe640 1 -- 172.21.15.5:0/1466634221 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40327d0 con 0x7fabd4160090 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 -- 172.21.15.5:0/1466634221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 msgr2=0x7fabd40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 --2- 172.21.15.5:0/1466634221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 0x7fabd40d0f90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009790 tx=0x7fabc402a060 comp rx=0 tx=0).stop 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 -- 172.21.15.5:0/1466634221 shutdown_connections 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 --2- 172.21.15.5:0/1466634221 >> v2:172.21.15.179:3300/0 conn(0x7fabd40d0790 0x7fabd40d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 --2- 172.21.15.5:0/1466634221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd4160090 0x7fabd40d0f90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 -- 172.21.15.5:0/1466634221 >> 172.21.15.5:0/1466634221 conn(0x7fabd409b9a0 msgr2=0x7fabd408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 -- 172.21.15.5:0/1466634221 shutdown_connections 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.281+0000 7fabdad65640 1 -- 172.21.15.5:0/1466634221 wait complete. 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.282+0000 7fabdad65640 1 Processor -- start 2024-09-13T17:18:57.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.282+0000 7fabdad65640 1 -- start start 2024-09-13T17:18:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd40d0790 0x7fabd41e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40c6c00 0x7fabd40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40c80d0 con 0x7fabd40b4c60 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41e8ef0 con 0x7fabd40c6c00 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabdad65640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40c7450 con 0x7fabd40d0790 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabd8b01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabd8b01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50992/0 (socket says 172.21.15.5:50992) 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.283+0000 7fabd8b01640 1 -- 172.21.15.5:0/323807016 learned_addr learned my addr 172.21.15.5:0/323807016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd3fff640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd40d0790 0x7fabd41e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd9302640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40c6c00 0x7fabd40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 -- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd40d0790 msgr2=0x7fabd41e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd40d0790 0x7fabd41e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 -- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40c6c00 msgr2=0x7fabd40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40c6c00 0x7fabd40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 -- 172.21.15.5:0/323807016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0093a0 con 0x7fabd40b4c60 2024-09-13T17:18:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd8b01640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fabc4035040 tx=0x7fabc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4005e60 con 0x7fabd40b4c60 2024-09-13T17:18:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4006030 con 0x7fabd40b4c60 2024-09-13T17:18:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc40093a0 con 0x7fabd40b4c60 2024-09-13T17:18:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40063e0 con 0x7fabd40b4c60 2024-09-13T17:18:57.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.284+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd40c7a10 con 0x7fabd40b4c60 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.285+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd4067310 con 0x7fabd40b4c60 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.286+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabc4039040 con 0x7fabd40b4c60 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.286+0000 7fabd17fa640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 0x7fabb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.286+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fabc40a9db0 con 0x7fabd40b4c60 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.286+0000 7fabd3fff640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 0x7fabb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:57.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.287+0000 7fabd3fff640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 0x7fabb406d0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fabd414f8b0 tx=0x7fabbc009110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:57.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.291+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabc4074e10 con 0x7fabd40b4c60 2024-09-13T17:18:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.498+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabd40c5f00 con 0x7fabd40b4c60 2024-09-13T17:18:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.498+0000 7fabd17fa640 1 -- 172.21.15.5:0/323807016 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4738 (secure 0 0 0) 0x7fabc4037090 con 0x7fabd40b4c60 2024-09-13T17:18:57.499 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:18:57.500 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:18:55.868155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8607},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:18:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2024-09-13T17:18:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 msgr2=0x7fabb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 0x7fabb406d0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fabd414f8b0 tx=0x7fabbc009110 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 msgr2=0x7fabd40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fabc4035040 tx=0x7fabc40046c0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 shutdown_connections 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabd40c6c00 0x7fabd40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabd40d0790 0x7fabd41e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fabb406ac00 0x7fabb406d0c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 --2- 172.21.15.5:0/323807016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabd40b4c60 0x7fabd40cc650 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 >> 172.21.15.5:0/323807016 conn(0x7fabd409b9a0 msgr2=0x7fabd415eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 shutdown_connections 2024-09-13T17:18:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:57.500+0000 7fabdad65640 1 -- 172.21.15.5:0/323807016 wait complete. 2024-09-13T17:18:57.915 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:18:55.868155+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8607}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8607': {'gid': 8607, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6833/3736030266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3736030266}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3736030266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:18:57.915 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:18:57.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:18:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.023+0000 7f6b1179c640 1 Processor -- start 2024-09-13T17:18:58.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.023+0000 7f6b1179c640 1 -- start start 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b1179c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b1179c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b1179c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0c0d07f0 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b1179c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c15cc90 con 0x7f6b0c0d2870 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b1179c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0cd470 con 0x7f6b0c06b7d0 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.024+0000 7f6b0b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50994/0 (socket says 172.21.15.5:50994) 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/1018171745 learned_addr learned my addr 172.21.15.5:0/1018171745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b0c15c8b0 0x7f6b0c06b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40814/0 (socket says 172.21.15.5:40814) 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/1018171745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 msgr2=0x7f6b0c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/1018171745 >> v1:172.21.15.5:6789/0 conn(0x7f6b0c15c8b0 legacy=0x7f6b0c06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/1018171745 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c06c520 con 0x7f6b0c0d2870 2024-09-13T17:18:58.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.025+0000 7f6b09ffb640 1 -- 172.21.15.5:0/1018171745 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068555568 0 0) 0x7f6b0c0d07f0 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009e50 tx=0x7f6afc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab7e6bf9440852a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b09ffb640 1 -- 172.21.15.5:0/1018171745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc031600 con 0x7f6b0c0d2870 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b09ffb640 1 -- 172.21.15.5:0/1018171745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc02d050 con 0x7f6b0c0d2870 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b09ffb640 1 -- 172.21.15.5:0/1018171745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc031980 con 0x7f6b0c0d2870 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 -- 172.21.15.5:0/1018171745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c0d2870 msgr2=0x7f6b0c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009e50 tx=0x7f6afc02a710 comp rx=0 tx=0).stop 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 -- 172.21.15.5:0/1018171745 shutdown_connections 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c0cdba0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 --2- 172.21.15.5:0/1018171745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 -- 172.21.15.5:0/1018171745 >> 172.21.15.5:0/1018171745 conn(0x7f6b0c08c0d0 msgr2=0x7f6b0c09b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 -- 172.21.15.5:0/1018171745 shutdown_connections 2024-09-13T17:18:58.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.026+0000 7f6b1179c640 1 -- 172.21.15.5:0/1018171745 wait complete. 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 Processor -- start 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 -- start start 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c15e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0b6ed0 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0b71b0 con 0x7f6b0c0d2870 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.028+0000 7f6b1179c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0b7490 con 0x7f6b0c06b7d0 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51010/0 (socket says 172.21.15.5:51010) 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/351732579 learned_addr learned my addr 172.21.15.5:0/351732579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0affd640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 msgr2=0x7f6b0c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c15e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0d2870 msgr2=0x7f6b0c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/351732579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009b30 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6afc034040 tx=0x7f6afc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b037fe640 1 -- 172.21.15.5:0/351732579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc03d860 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b037fe640 1 -- 172.21.15.5:0/351732579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc03d9c0 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c15ce70 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b037fe640 1 -- 172.21.15.5:0/351732579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc03dd70 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.029+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c15eed0 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.031+0000 7f6b037fe640 1 -- 172.21.15.5:0/351732579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6afc03b400 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.031+0000 7f6b037fe640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 0x7f6aec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.031+0000 7f6b037fe640 1 -- 172.21.15.5:0/351732579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6afc0aa480 con 0x7f6b0c15c8b0 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.032+0000 7f6b0affd640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 0x7f6aec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.032+0000 7f6b0affd640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 0x7f6aec06d0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6b04000f60 tx=0x7f6b04007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.032+0000 7f6b144bd740 1 Processor -- start 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.032+0000 7f6b144bd740 1 -- start start 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4ce0a0 0x556d3d4ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4f5550 0x556d3d51bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d4287c0 con 0x556d3d4cb860 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d437b70 con 0x556d3d4f5550 2024-09-13T17:18:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3d435300 con 0x556d3d4ce0a0 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b0a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b0a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51014/0 (socket says 172.21.15.5:51014) 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b0a7fc640 1 -- 172.21.15.5:0/2130515015 learned_addr learned my addr 172.21.15.5:0/2130515015 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b0affd640 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4ce0a0 0x556d3d4ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.033+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4f5550 0x556d3d51bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 -- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4ce0a0 msgr2=0x556d3d4ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4ce0a0 0x556d3d4ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 -- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4f5550 msgr2=0x556d3d51bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4f5550 0x556d3d51bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 -- 172.21.15.5:0/2130515015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3d3bd4b0 con 0x556d3d4cb860 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b860 tx=0x7f6af400bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1820d4abc7f419 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b00ff9640 1 -- 172.21.15.5:0/2130515015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4005b90 con 0x556d3d4cb860 2024-09-13T17:18:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b00ff9640 1 -- 172.21.15.5:0/2130515015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4005cf0 con 0x556d3d4cb860 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.034+0000 7f6b00ff9640 1 -- 172.21.15.5:0/2130515015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400f9c0 con 0x556d3d4cb860 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- 172.21.15.5:0/2130515015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 msgr2=0x556d3d51b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6af400b860 tx=0x7f6af400bd20 comp rx=0 tx=0).stop 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- 172.21.15.5:0/2130515015 shutdown_connections 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4f5550 0x556d3d51bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4cb860 0x556d3d51b570 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2130515015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4ce0a0 0x556d3d4ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- 172.21.15.5:0/2130515015 >> 172.21.15.5:0/2130515015 conn(0x556d3d4ca7d0 msgr2=0x556d3d512c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- 172.21.15.5:0/2130515015 shutdown_connections 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- 172.21.15.5:0/2130515015 wait complete. 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 -- start start 2024-09-13T17:18:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.035+0000 7f6b144bd740 1 Processor -- start 2024-09-13T17:18:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4c8bb0 0x556d3d4f4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d430bf0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d3ef250 con 0x556d3d4c8bb0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3d3eeef0 con 0x556d3d4f5550 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b144bd740 10 client.0 _ll_register_callbacks cb 0x556d3d421740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51016/0 (socket says 172.21.15.5:51016) 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 -- 172.21.15.5:0/3805247691 learned_addr learned my addr 172.21.15.5:0/3805247691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4c8bb0 0x556d3d4f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 -- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 msgr2=0x556d3d4c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 -- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4c8bb0 msgr2=0x556d3d4f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.036+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4c8bb0 0x556d3d4f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b0affd640 1 -- 172.21.15.5:0/3805247691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af400e040 con 0x556d3d4ce0a0 2024-09-13T17:18:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001d50 tx=0x7f6b04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3180b1b32a24ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04001d80 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6b040213f0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d3d1243c0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b040215b0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 10 client.8649 fetch_fsmap learned FSMap version 56 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x556d3d42f270 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d3d1243c0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6b04020070 con 0x556d3d4ce0a0 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 10 client.8649 fetch_fsmap finished waiting for FSMap version 56 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 10 client.8649 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 20 client.8649 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d51adb0 0x556d3d4e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 4 client.8649 mds_command: new command op to 8607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.037+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 --> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d3d1356c0 con 0x556d3d51adb0 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d51adb0 0x556d3d4e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6ae9ffb640 10 client.8649 ms_handle_connect on v2:172.21.15.5:6832/3736030266 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d51adb0 0x556d3d4e1530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff5ea74b41017ab server_cookie=6cd91b4c8fbbc182 in_seq=0 out_seq=0 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3805247691 <== mds.0 v2:172.21.15.5:6832/3736030266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x556d3d1356c0 con 0x556d3d51adb0 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6ae9ffb640 10 client.8649 handle_command_reply: tid=0 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6b144bd740 1 client.8649 shutdown 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 msgr2=0x556d3d50fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.038+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001d50 tx=0x7f6b04000ed0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 shutdown_connections 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d51adb0 0x556d3d4e1530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4c8bb0 0x556d3d4f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6ae9ffb640 0 client.8649 ms_handle_reset on v2:172.21.15.5:6832/3736030266 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3805247691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d4ce0a0 0x556d3d50fdf0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 >> 172.21.15.5:0/3805247691 conn(0x556d3d4cb860 msgr2=0x556d3d512300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 shutdown_connections 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 1 -- 172.21.15.5:0/3805247691 wait complete. 2024-09-13T17:18:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.039+0000 7f6b144bd740 20 client.8649 trim_cache size 0 max 16384 2024-09-13T17:18:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 Processor -- start 2024-09-13T17:18:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 -- start start 2024-09-13T17:18:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d51a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d3b4460 con 0x556d3d5739b0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d514ef0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3d519f40 con 0x556d3d4f5550 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.054+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51030/0 (socket says 172.21.15.5:51030) 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/2316599265 learned_addr learned my addr 172.21.15.5:0/2316599265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0affd640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d51a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 msgr2=0x556d3d4f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 msgr2=0x556d3d51a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d51a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/2316599265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3d3d15f0 con 0x556d3d5739b0 2024-09-13T17:18:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0affd640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d51a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f6afc02a750 tx=0x7f6afc0aa040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb49510d47e8eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b017fa640 1 -- 172.21.15.5:0/2316599265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0814f0 con 0x556d3d5739b0 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b017fa640 1 -- 172.21.15.5:0/2316599265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc0774a0 con 0x556d3d5739b0 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.055+0000 7f6b017fa640 1 -- 172.21.15.5:0/2316599265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc07f0b0 con 0x556d3d5739b0 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- 172.21.15.5:0/2316599265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 msgr2=0x556d3d4f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f6afc02a750 tx=0x7f6afc0aa040 comp rx=0 tx=0).stop 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- 172.21.15.5:0/2316599265 shutdown_connections 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d4f7a30 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d4f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 --2- 172.21.15.5:0/2316599265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d51a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- 172.21.15.5:0/2316599265 >> 172.21.15.5:0/2316599265 conn(0x556d3d4cb860 msgr2=0x556d3d4c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- 172.21.15.5:0/2316599265 shutdown_connections 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- 172.21.15.5:0/2316599265 wait complete. 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 -- start start 2024-09-13T17:18:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.056+0000 7f6b144bd740 1 Processor -- start 2024-09-13T17:18:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d4f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d533f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d4cca50 con 0x556d3d5739b0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3d5310e0 con 0x556d3d4ce0a0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3d4f3df0 con 0x556d3d4f5550 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b144bd740 10 client.0 _ll_register_callbacks cb 0x7f6af400b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51036/0 (socket says 172.21.15.5:51036) 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/3780185823 learned_addr learned my addr 172.21.15.5:0/3780185823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d4f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0a7fc640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d533f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.057+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 msgr2=0x556d3d533f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d533f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 msgr2=0x556d3d4f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d4f7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0b7fe640 1 -- 172.21.15.5:0/3780185823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c15eed0 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0b7fe640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f6afc075600 tx=0x7f6afc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c64d03ccbb3c769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0aa0b0 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6afc0aa210 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6af4005cf0 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6afc0a82f0 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 10 client.8655 fetch_fsmap learned FSMap version 56 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x556d3d3f6d00 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4005cf0 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6afc04d020 con 0x556d3d5739b0 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 10 client.8655 fetch_fsmap finished waiting for FSMap version 56 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 10 client.8655 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:18:58.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 20 client.8655 populate_metadata read hostname 'smithi005' 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d571950 0x556d3d571f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 4 client.8655 mds_command: new command op to 8607 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 --> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d3d188d10 con 0x556d3d571950 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.058+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d571950 0x556d3d571f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b0affd640 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d571950 0x556d3d571f10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d6dd2d4b4c4ef0 server_cookie=e8e1f4c2719408bd in_seq=0 out_seq=0 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6ae9ffb640 10 client.8655 ms_handle_connect on v2:172.21.15.5:6832/3736030266 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6ae9ffb640 1 -- 172.21.15.5:0/3780185823 <== mds.0 v2:172.21.15.5:6832/3736030266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x556d3d188d10 con 0x556d3d571950 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6ae9ffb640 10 client.8655 handle_command_reply: tid=0 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 client.8655 shutdown 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 msgr2=0x556d3d5344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f6afc075600 tx=0x7f6afc009810 comp rx=0 tx=0).stop 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 shutdown_connections 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x556d3d571950 0x556d3d571f10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d3d5739b0 0x556d3d5344b0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556d3d4f5550 0x556d3d533f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 --2- 172.21.15.5:0/3780185823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556d3d4ce0a0 0x556d3d4f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 >> 172.21.15.5:0/3780185823 conn(0x556d3d4cb860 msgr2=0x556d3d4c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6ae9ffb640 0 client.8655 ms_handle_reset on v2:172.21.15.5:6832/3736030266 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 shutdown_connections 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 1 -- 172.21.15.5:0/3780185823 wait complete. 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.059+0000 7f6b144bd740 20 client.8655 trim_cache size 0 max 16384 2024-09-13T17:18:58.067 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8607, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.1961602320000004, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 56, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 113, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 111, 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 6.1079393770000001 2024-09-13T17:18:58.068 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 msgr2=0x7f6aec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 0x7f6aec06d0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6b04000f60 tx=0x7f6b04007c00 comp rx=0 tx=0).stop 2024-09-13T17:18:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 msgr2=0x7f6b0c0b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6afc034040 tx=0x7f6afc004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 shutdown_connections 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f6aec06ac00 0x7f6aec06d0c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b0c15c8b0 0x7f6b0c0b04b0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0d2870 0x7f6b0c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 --2- 172.21.15.5:0/351732579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c06b7d0 0x7f6b0c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 >> 172.21.15.5:0/351732579 conn(0x7f6b0c08c0d0 msgr2=0x7f6b0c0730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 shutdown_connections 2024-09-13T17:18:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.060+0000 7f6b1179c640 1 -- 172.21.15.5:0/351732579 wait complete. 2024-09-13T17:18:58.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.172+0000 7f4d29e61640 1 Processor -- start 2024-09-13T17:18:58.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.172+0000 7f4d29e61640 1 -- start start 2024-09-13T17:18:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d29e61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240af6a0 0x7f4d240c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d29e61640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240cdb00 0x7f4d240cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d29e61640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d240afc40 con 0x7f4d24159530 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d29e61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240aff20 con 0x7f4d240af6a0 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d29e61640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240b0200 con 0x7f4d240cdb00 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240af6a0 0x7f4d240c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d240af6a0 0x7f4d240c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51038/0 (socket says 172.21.15.5:51038) 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 -- 172.21.15.5:0/1890950981 learned_addr learned my addr 172.21.15.5:0/1890950981 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d23fff640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240cdb00 0x7f4d240cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 -- 172.21.15.5:0/1890950981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240cdb00 msgr2=0x7f4d240cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240cdb00 0x7f4d240cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 -- 172.21.15.5:0/1890950981 >> v1:172.21.15.179:6789/0 conn(0x7f4d24159530 legacy=0x7f4d240c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:58.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.173+0000 7f4d22ffd640 1 -- 172.21.15.5:0/1890950981 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240b04e0 con 0x7f4d240af6a0 2024-09-13T17:18:58.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.174+0000 7f4d22ffd640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240af6a0 0x7f4d240c4c10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c11bdd0314e36c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.174+0000 7f4d227fc640 1 -- 172.21.15.5:0/1890950981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1802ae90 con 0x7f4d240af6a0 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.174+0000 7f4d227fc640 1 -- 172.21.15.5:0/1890950981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18032440 con 0x7f4d240af6a0 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.174+0000 7f4d227fc640 1 -- 172.21.15.5:0/1890950981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180327d0 con 0x7f4d240af6a0 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 -- 172.21.15.5:0/1890950981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240af6a0 msgr2=0x7f4d240c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240af6a0 0x7f4d240c4c10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1802a180 comp rx=0 tx=0).stop 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 -- 172.21.15.5:0/1890950981 shutdown_connections 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240cdb00 0x7f4d240cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 --2- 172.21.15.5:0/1890950981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d240af6a0 0x7f4d240c4c10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 -- 172.21.15.5:0/1890950981 >> 172.21.15.5:0/1890950981 conn(0x7f4d24098a70 msgr2=0x7f4d240cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 -- 172.21.15.5:0/1890950981 shutdown_connections 2024-09-13T17:18:58.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.175+0000 7f4d29e61640 1 -- 172.21.15.5:0/1890950981 wait complete. 2024-09-13T17:18:58.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.176+0000 7f4d29e61640 1 Processor -- start 2024-09-13T17:18:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.176+0000 7f4d29e61640 1 -- start start 2024-09-13T17:18:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240af6a0 0x7f4d24145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 0x7f4d240ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240b3300 con 0x7f4d24159530 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240b26f0 con 0x7f4d240cdb00 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d29e61640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240b29d0 con 0x7f4d240af6a0 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51048/0 (socket says 172.21.15.5:51048) 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 -- 172.21.15.5:0/2022630273 learned_addr learned my addr 172.21.15.5:0/2022630273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d237fe640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240af6a0 0x7f4d24145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d22ffd640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 0x7f4d240ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 -- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240af6a0 msgr2=0x7f4d24145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240af6a0 0x7f4d24145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 -- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 msgr2=0x7f4d240ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 0x7f4d240ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d23fff640 1 -- 172.21.15.5:0/2022630273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180094d0 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.177+0000 7f4d22ffd640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 0x7f4d240ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d23fff640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00cc30 tx=0x7f4d1c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00ce40 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c003990 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240b2cb0 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c003d20 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.178+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d240adcc0 con 0x7f4d24159530 2024-09-13T17:18:58.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.179+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d240b3470 con 0x7f4d24159530 2024-09-13T17:18:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.179+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d1c003e80 con 0x7f4d24159530 2024-09-13T17:18:58.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.180+0000 7f4d0bfff640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 0x7f4d1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.180+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4d1c089970 con 0x7f4d24159530 2024-09-13T17:18:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.180+0000 7f4d237fe640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 0x7f4d1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:58.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.181+0000 7f4d237fe640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 0x7f4d1006d0c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4d14004f60 tx=0x7f4d14007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:58.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.184+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d1c054960 con 0x7f4d24159530 2024-09-13T17:18:58.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.390+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d240c4500 con 0x7f4d24159530 2024-09-13T17:18:58.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.390+0000 7f4d0bfff640 1 -- 172.21.15.5:0/2022630273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d1c01d030 con 0x7f4d24159530 2024-09-13T17:18:58.391 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 msgr2=0x7f4d1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 0x7f4d1006d0c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4d14004f60 tx=0x7f4d14007e30 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 msgr2=0x7f4d24158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00cc30 tx=0x7f4d1c00a5c0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 shutdown_connections 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4d1006ac00 0x7f4d1006d0c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d24159530 0x7f4d24158050 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d240cdb00 0x7f4d240ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 --2- 172.21.15.5:0/2022630273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d240af6a0 0x7f4d24145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.392+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 >> 172.21.15.5:0/2022630273 conn(0x7f4d24098a70 msgr2=0x7f4d24069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.393+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 shutdown_connections 2024-09-13T17:18:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:58.393+0000 7f4d29e61640 1 -- 172.21.15.5:0/2022630273 wait complete. 2024-09-13T17:18:58.404 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:18:58.405 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:58.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.406 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:18:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::fcd2:44ff:fea3:d219/64 scope link 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:90:8a:09:42:16 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e490:8aff:fe09:4216/64 scope link 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether f2:14:c9:34:8e:d9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::f014:c9ff:fe34:8ed9/64 scope link 2024-09-13T17:18:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:18:58.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.425 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:18:58.486 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-13T17:18:58.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.488 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-13T17:18:58.544 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-13T17:18:58.544 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:18:58.544 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T17:18:58.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T17:18:58.545 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:18:58.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T17:18:58.545 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-13T17:18:58.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.634 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:18:58.649 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:18:58.650 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:18:58.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:58.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-13T17:18:58.715 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T17:18:58.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:58.716 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:58.771 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:18:58.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:18:58.772 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:58.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:58.864 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-09-13T17:18:58.863+0000 7f43cb3e6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:18:58.890 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:58.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:58.956 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:58.956 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:59.012 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:18:59.012 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T17:18:59.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-13T17:18:59.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:18:59.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:18:59.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-13T17:18:59.137+0000 7f79aa40a480 -1 init, newargv = 0x55fb7f5ba060 newargc=15 2024-09-13T17:18:59.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[75130]: starting ceph client 2024-09-13T17:18:59.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[75130]: starting fuse 2024-09-13T17:18:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:18:59.148 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:18:59.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:59.149 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-13T17:18:59.204 INFO:teuthology.orchestra.run.smithi005.stdout:43 2024-09-13T17:18:59.205 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-13T17:18:59.205 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:18:59.206 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-13T17:18:59.207 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-13T17:18:59.321 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.75130.asok 2024-09-13T17:18:59.507 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75130.asok 2024-09-13T17:18:59.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:59.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75130.asok status 2024-09-13T17:18:59.644 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:18:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-13T17:18:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "75130", 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8670, 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-13T17:18:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 8670 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3438738796 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:18:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3438738796 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.8670 192.168.0.1:0/3438738796", 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/3438738796", 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 56, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 113, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-13T17:18:59.647 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:18:59.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:59.654 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-13T17:18:59.654 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:59.670 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-13T17:18:59.670 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:18:59.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:18:59.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:18:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 Processor -- start 2024-09-13T17:18:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 -- start start 2024-09-13T17:18:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff00154920 0x7eff0015a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7eff0015ae60 0x7eff000ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 0x7eff000b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000ceff0 con 0x7eff00154920 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0015bc60 con 0x7eff0015ae60 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.877+0000 7eff068a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0015b3e0 con 0x7eff000cebc0 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff00154920 0x7eff0015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff00154920 0x7eff0015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51054/0 (socket says 172.21.15.5:51054) 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 -- 172.21.15.5:0/1091084478 learned_addr learned my addr 172.21.15.5:0/1091084478 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efeff7fe640 1 --2- 172.21.15.5:0/1091084478 >> v2:172.21.15.179:3300/0 conn(0x7eff0015ae60 0x7eff000ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7eff04e40640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 0x7eff000b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 -- 172.21.15.5:0/1091084478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 msgr2=0x7eff000b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 0x7eff000b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 -- 172.21.15.5:0/1091084478 >> v2:172.21.15.179:3300/0 conn(0x7eff0015ae60 msgr2=0x7eff000ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 --2- 172.21.15.5:0/1091084478 >> v2:172.21.15.179:3300/0 conn(0x7eff0015ae60 0x7eff000ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7efefffff640 1 -- 172.21.15.5:0/1091084478 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0015b6c0 con 0x7eff00154920 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.878+0000 7eff04e40640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 0x7eff000b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7efefffff640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff00154920 0x7eff0015a920 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7eff0015b2f0 tx=0x7efef002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0f1564745053a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7efefeffd640 1 -- 172.21.15.5:0/1091084478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef002ae90 con 0x7eff00154920 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7efefeffd640 1 -- 172.21.15.5:0/1091084478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0032440 con 0x7eff00154920 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7efefeffd640 1 -- 172.21.15.5:0/1091084478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00327d0 con 0x7eff00154920 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 -- 172.21.15.5:0/1091084478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff00154920 msgr2=0x7eff0015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff00154920 0x7eff0015a920 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7eff0015b2f0 tx=0x7efef002a140 comp rx=0 tx=0).stop 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 -- 172.21.15.5:0/1091084478 shutdown_connections 2024-09-13T17:18:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff000cebc0 0x7eff000b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 --2- 172.21.15.5:0/1091084478 >> v2:172.21.15.179:3300/0 conn(0x7eff0015ae60 0x7eff000ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.879+0000 7eff068a3640 1 --2- 172.21.15.5:0/1091084478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff00154920 0x7eff0015a920 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.880+0000 7eff068a3640 1 -- 172.21.15.5:0/1091084478 >> 172.21.15.5:0/1091084478 conn(0x7eff0006a270 msgr2=0x7eff0006a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.880+0000 7eff068a3640 1 -- 172.21.15.5:0/1091084478 shutdown_connections 2024-09-13T17:18:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.880+0000 7eff068a3640 1 -- 172.21.15.5:0/1091084478 wait complete. 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.881+0000 7eff068a3640 1 Processor -- start 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.881+0000 7eff068a3640 1 -- start start 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff00154920 0x7eff00159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 0x7eff000cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001f20d0 con 0x7eff000cebc0 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001f14c0 con 0x7eff00154920 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff068a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff001f17a0 con 0x7eff0015ae60 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51068/0 (socket says 172.21.15.5:51068) 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 -- 172.21.15.5:0/2163713707 learned_addr learned my addr 172.21.15.5:0/2163713707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efeff7fe640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff00154920 0x7eff00159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff04e40640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 0x7eff000cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 -- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 msgr2=0x7eff000cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 0x7eff000cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 -- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff00154920 msgr2=0x7eff00159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff00154920 0x7eff00159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 -- 172.21.15.5:0/2163713707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00094d0 con 0x7eff000cebc0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7eff04e40640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 0x7eff000cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.882+0000 7efefffff640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7efef002a180 tx=0x7efef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.883+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0030850 con 0x7eff000cebc0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.883+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef00309b0 con 0x7eff000cebc0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.883+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff001f1a80 con 0x7eff000cebc0 2024-09-13T17:18:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.883+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0030d60 con 0x7eff000cebc0 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.883+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff001edda0 con 0x7eff000cebc0 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.884+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0009c550 con 0x7eff000cebc0 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.884+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efef0039040 con 0x7eff000cebc0 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.885+0000 7efefcff9640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 0x7efeec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.885+0000 7efeff7fe640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 0x7efeec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.885+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7efef0079490 con 0x7eff000cebc0 2024-09-13T17:18:59.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.886+0000 7efeff7fe640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 0x7efeec06d0f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7eff0015d160 tx=0x7efef4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:59.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:18:59.890+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efef00750d0 con 0x7eff000cebc0 2024-09-13T17:19:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.094+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff000ae8d0 con 0x7eff000cebc0 2024-09-13T17:19:00.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.095+0000 7efefcff9640 1 -- 172.21.15.5:0/2163713707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7efef00786f0 con 0x7eff000cebc0 2024-09-13T17:19:00.096 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 msgr2=0x7efeec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 0x7efeec06d0f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7eff0015d160 tx=0x7efef4008040 comp rx=0 tx=0).stop 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 msgr2=0x7eff001ed860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7efef002a180 tx=0x7efef00046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 shutdown_connections 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff0015ae60 0x7eff000cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff00154920 0x7eff00159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7efeec06ac30 0x7efeec06d0f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 --2- 172.21.15.5:0/2163713707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff000cebc0 0x7eff001ed860 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 >> 172.21.15.5:0/2163713707 conn(0x7eff0006a270 msgr2=0x7eff0006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 shutdown_connections 2024-09-13T17:19:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:00.097+0000 7eff068a3640 1 -- 172.21.15.5:0/2163713707 wait complete. 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:19:00.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:19:00.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:19:00.110 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:19:00.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.110 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-13T17:19:00.130 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:19:00.130 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:19:00.130 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:19:00.130 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:19:00.131 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42355sec preferred_lft 42355sec 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4c8b:58ff:fec4:5513/64 scope link 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.132 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 62:ae:70:b1:3e:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::60ae:70ff:feb1:3ed7/64 scope link 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 6a:99:e3:cf:09:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::6899:e3ff:fecf:917/64 scope link 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:19:00.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.133 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:19:00.199 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-13T17:19:00.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.202 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-13T17:19:00.260 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-13T17:19:00.261 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:19:00.261 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:19:00.261 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:19:00.261 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:19:00.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.261 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2024-09-13T17:19:00.262 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-13T17:19:00.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:19:00.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:19:00.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:19:00.262 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-13T17:19:00.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.353 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:19:00.369 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:19:00.369 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:19:00.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:19:00.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-13T17:19:00.436 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T17:19:00.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:19:00.437 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:00.493 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:19:00.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:19:00.493 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:00.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:19:00.614 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:19:00.614 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:19:00.679 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:19:00.680 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:19:00.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.680 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:19:00.736 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:19:00.737 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T17:19:00.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2024-09-13T17:19:00.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:19:00.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:19:00.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:2024-09-13T17:19:00.860+0000 7fa590d52480 -1 init, newargv = 0x5627a84020d0 newargc=15 2024-09-13T17:19:00.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48833]: starting ceph client 2024-09-13T17:19:00.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48833]: starting fuse 2024-09-13T17:19:00.871 INFO:teuthology.orchestra.run.smithi179.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:19:00.872 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:19:00.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:00.873 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2024-09-13T17:19:00.929 INFO:teuthology.orchestra.run.smithi179.stdout:43 2024-09-13T17:19:00.929 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-13T17:19:00.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> import re 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> import os 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:19:00.930 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> return f 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> 2024-09-13T17:19:00.931 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.1")) 2024-09-13T17:19:00.932 DEBUG:teuthology.orchestra.run.smithi179:> ' 2024-09-13T17:19:01.042 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.1.48833.asok 2024-09-13T17:19:01.229 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48833.asok 2024-09-13T17:19:01.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.229 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48833.asok status 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "1", 2024-09-13T17:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "48833", 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 7879, 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 7879 2024-09-13T17:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 3726067149 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 3726067149 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.7879 192.168.0.1:0/3726067149", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/3726067149", 2024-09-13T17:19:01.364 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 56, 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 113, 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2024-09-13T17:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-13T17:19:01.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.371 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2024-09-13T17:19:01.371 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:01.386 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2024-09-13T17:19:01.386 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:01.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.386 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:01.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T17:19:01.582 INFO:teuthology.orchestra.run.smithi005.stdout:[{"id":7879,"entity":{"name":{"type":"client","num":7879},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3726067149}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":0.708986436,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99837015448601685,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7879 192.168.0.1:0/3726067149","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"1","hostname":"smithi179","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"48833","root":"/"}},{"id":8670,"entity":{"name":{"type":"client","num":8670},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3438738796}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":2.4319534740000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.9944013464492153,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8670 192.168.0.1:0/3438738796","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"0","hostname":"smithi005","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"75130","root":"/"}}] 2024-09-13T17:19:01.582 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "1", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "48833", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3726067149, "type": "any" }, "name": { "num": 7879, "type": "client" } }, "id": 7879, "inst": "client.7879 192.168.0.1:0/3726067149", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9983701544860168 }, "state": "open", "uptime": 0.708986436 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "0", "hostname": "smithi005", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "75130", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3438738796, "type": "any" }, "name": { "num": 8670, "type": "client" } }, "id": 8670, "inst": "client.8670 192.168.0.1:0/3438738796", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9944013464492153 }, "state": "open", "uptime": 2.431953474 } ] 2024-09-13T17:19:01.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T17:19:01.706 INFO:teuthology.orchestra.run.smithi005.stdout:{"message":"","return_code":0} 2024-09-13T17:19:01.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T17:19:01.707 DEBUG:teuthology.orchestra.run.smithi005:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-13T17:19:01.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 -- start start 2024-09-13T17:19:01.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 Processor -- start 2024-09-13T17:19:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2a23ac00 0x560c2a2d5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2a23b800 0x560c2a2d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc640 con 0x560c2a23bc00 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc500 con 0x560c2a23ac00 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc3c0 con 0x560c2a23b800 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e147c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.747+0000 7fe5e147c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51086/0 (socket says 172.21.15.5:51086) 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 -- 172.21.15.5:0/322307176 learned_addr learned my addr 172.21.15.5:0/322307176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e047a640 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2a23b800 0x560c2a2d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2a23ac00 0x560c2a2d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 -- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2a23b800 msgr2=0x560c2a2d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2a23b800 0x560c2a2d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 -- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2a23ac00 msgr2=0x560c2a2d5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2a23ac00 0x560c2a2d5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 -- 172.21.15.5:0/322307176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c2a2609c0 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e147c640 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x560c2b071050 tx=0x560c2b008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d4b7635758645f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5de476640 1 -- 172.21.15.5:0/322307176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2ff600 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5de476640 1 -- 172.21.15.5:0/322307176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c2b01e000 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5de476640 1 -- 172.21.15.5:0/322307176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2ff1e0 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c2a260b60 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560c2a260820 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e24d3280 4 waiting for MDS map... 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5de476640 1 -- 172.21.15.5:0/322307176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x560c2a266380 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5de476640 1 -- 172.21.15.5:0/322307176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) v1 ==== 3114+0+0 (secure 0 0 0) 0x560c2a28cf00 con 0x560c2a23bc00 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.748+0000 7fe5e24d3280 4 Got MDS map 56 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.749+0000 7fe5e24d3280 10 main: main 2024-09-13T17:19:01.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.749+0000 7fe5e24d3280 4 main: connecting to RADOS... 2024-09-13T17:19:01.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.749+0000 7fe5e24d3280 1 Processor -- start 2024-09-13T17:19:01.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.749+0000 7fe5e24d3280 1 -- start start 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc280 con 0x560c2b01d400 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc500 con 0x560c2b01d800 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc140 con 0x560c2b01d000 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51100/0 (socket says 172.21.15.5:51100) 2024-09-13T17:19:01.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/24047658 learned_addr learned my addr 172.21.15.5:0/24047658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e047a640 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e047a640 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 msgr2=0x560c2a2d4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 msgr2=0x560c2a2d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/24047658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c2a2604e0 con 0x560c2b01d400 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x560c2b070120 tx=0x560c2b008c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc6dec3d57e8614 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.750+0000 7fe5dc472640 1 -- 172.21.15.5:0/24047658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2ff080 con 0x560c2b01d400 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5dc472640 1 -- 172.21.15.5:0/24047658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c2b01e480 con 0x560c2b01d400 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5dc472640 1 -- 172.21.15.5:0/24047658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2ff600 con 0x560c2b01d400 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 -- 172.21.15.5:0/24047658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 msgr2=0x560c2a2d4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x560c2b070120 tx=0x560c2b008c60 comp rx=0 tx=0).stop 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 -- 172.21.15.5:0/24047658 shutdown_connections 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/24047658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 -- 172.21.15.5:0/24047658 >> 172.21.15.5:0/24047658 conn(0x560c2b01cc00 msgr2=0x560c2afb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 -- 172.21.15.5:0/24047658 shutdown_connections 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 -- 172.21.15.5:0/24047658 wait complete. 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.751+0000 7fe5e24d3280 1 Processor -- start 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 -- start start 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cc000 con 0x560c2b01d400 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cd040 con 0x560c2b01d800 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e24d3280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c2a2cd180 con 0x560c2b01d000 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51108/0 (socket says 172.21.15.5:51108) 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/3897839048 learned_addr learned my addr 172.21.15.5:0/3897839048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 msgr2=0x560c2a2d4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2b01d000 0x560c2a2d4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 msgr2=0x560c2a2d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c2a260d00 con 0x560c2b01d400 2024-09-13T17:19:01.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.752+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2b01d800 0x560c2a2d6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5e0c7b640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x560c2b17ac00 tx=0x560c2b008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5dac6f640 1 -- 172.21.15.5:0/3897839048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2ff1e0 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5dac6f640 1 -- 172.21.15.5:0/3897839048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c2b01e180 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c2a2604e0 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5dac6f640 1 -- 172.21.15.5:0/3897839048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560c2a2fedc0 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c2a2609c0 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.753+0000 7fe5e24d3280 4 main: resolving pool 15 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.754+0000 7fe5dac6f640 1 -- 172.21.15.5:0/3897839048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x560c2a2ab340 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.754+0000 7fe5dac6f640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x560c2b01dc00 0x560c2a5b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.754+0000 7fe5dac6f640 1 -- 172.21.15.5:0/3897839048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x560c2a266540 con 0x560c2b01d400 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e24d3280 4 main: creating IoCtx.. 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x560c2a53e000 0x560c2a2d6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:01.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x560c2a53e400 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x560c2b01dc00 0x560c2a5b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x560c2a53e000 0x560c2a2d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x560c2b01dc00 0x560c2a5b6000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x560c2a2fbe90 tx=0x560c2afd1080 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e047a640 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x560c2a53e000 0x560c2a2d6680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e047a640 1 -- 172.21.15.5:0/3897839048 <== osd.2 v2:172.21.15.5:6816/2157447166 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x560c2b0feb40 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.755+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x560c2a53e800 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e047a640 1 -- 172.21.15.5:0/3897839048 <== osd.2 v2:172.21.15.5:6816/2157447166 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=843b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+843 (crc 0 0 0) 0x560c2b0feb40 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- osd_op(unknown.0.0:3 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x560c2a53ec00 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e047a640 1 -- 172.21.15.5:0/3897839048 <== osd.2 v2:172.21.15.5:6816/2157447166 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x560c2b0feb40 con 0x560c2a53e000 2024-09-13T17:19:01.763 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "0": { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "data": { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions": [ 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8670, 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 8670 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "any", 2024-09-13T17:19:01.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3438738796 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "open", 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "num_leases": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "num_caps": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "request_load_avg": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "requests_in_flight": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "num_completed_requests": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "num_completed_flushes": 0, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "reconnecting": false, 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps": { 2024-09-13T17:19:01.765 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 60 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "release_caps": { 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 60 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps_throttle": { 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 1.5 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps_throttle2o": { 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.766 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 0.5 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "session_cache_liveness": { 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 300 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition": { 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 30 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "delegated_inos": [], 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": "client.8670 192.168.0.1:0/3438738796", 2024-09-13T17:19:01.767 INFO:teuthology.orchestra.run.smithi005.stdout: "completed_requests": [], 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "prealloc_inos": [], 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "client_metadata": { 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "client_features": { 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_bits": "0x00000000003fffff" 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "metric_spec": { 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "metric_flags": { 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_bits": "0x000000000000ffff" 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:19:01.768 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "75130", 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7879, 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": { 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 7879 2024-09-13T17:19:01.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "any", 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3726067149 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "open", 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "num_leases": 0, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "num_caps": 0, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "request_load_avg": 0, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 0, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "requests_in_flight": 0, 2024-09-13T17:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout: "num_completed_requests": 0, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "num_completed_flushes": 0, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "reconnecting": false, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps": { 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 60 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "release_caps": { 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 60 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps_throttle": { 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 1.5 2024-09-13T17:19:01.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "recall_caps_throttle2o": { 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 0.5 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "session_cache_liveness": { 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 300 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition": { 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "value": 0, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "halflife": 30 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "last_trim_completed_requests_tid": 0, 2024-09-13T17:19:01.772 INFO:teuthology.orchestra.run.smithi005.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "delegated_inos": [], 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": "client.7879 192.168.0.1:0/3726067149", 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "completed_requests": [], 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "prealloc_inos": [], 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "client_metadata": { 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "client_features": { 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_bits": "0x00000000003fffff" 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "metric_spec": { 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "metric_flags": { 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: "feature_bits": "0x000000000000ffff" 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "1", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi179", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "48833", 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: "result": 0 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:01.774 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:01.775 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x560c2a53e000 msgr2=0x560c2a2d6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x560c2a53e000 0x560c2a2d6680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x560c2b01dc00 msgr2=0x560c2a5b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x560c2b01dc00 0x560c2a5b6000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x560c2a2fbe90 tx=0x560c2afd1080 comp rx=0 tx=0).stop 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 msgr2=0x560c2a2d4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/3897839048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2b01d400 0x560c2a2d4580 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x560c2b17ac00 tx=0x560c2b008c00 comp rx=0 tx=0).stop 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e0c7b640 1 -- 172.21.15.5:0/3897839048 reap_dead start 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 shutdown_connections 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 >> 172.21.15.5:0/3897839048 conn(0x560c2b01cc00 msgr2=0x560c2afb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 shutdown_connections 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.756+0000 7fe5e24d3280 1 -- 172.21.15.5:0/3897839048 wait complete. 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 msgr2=0x560c2a2d5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x560c2b071050 tx=0x560c2b008e40 comp rx=0 tx=0).stop 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 shutdown_connections 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c2a23bc00 0x560c2a2d5080 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560c2a23b800 0x560c2a2d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 --2- 172.21.15.5:0/322307176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560c2a23ac00 0x560c2a2d5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 >> 172.21.15.5:0/322307176 conn(0x560c2a23b000 msgr2=0x560c2afb8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 shutdown_connections 2024-09-13T17:19:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:01.757+0000 7fe5e24d3280 1 -- 172.21.15.5:0/322307176 wait complete. 2024-09-13T17:19:01.778 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.071262, result: { "0": { "data": { "sessions": [ { "id": 8670, "entity": { "name": { "type": "client", "num": 8670 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3438738796 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.8670 192.168.0.1:0/3438738796", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "0", "hostname": "smithi005", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "75130", "root": "/" } }, { "id": 7879, "entity": { "name": { "type": "client", "num": 7879 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3726067149 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7879 192.168.0.1:0/3726067149", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "1", "hostname": "smithi179", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "48833", "root": "/" } } ] }, "result": 0 } } 2024-09-13T17:19:01.778 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 8670, "entity": { "name": { "type": "client", "num": 8670 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3438738796 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.8670 192.168.0.1:0/3438738796", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "0", "hostname": "smithi005", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "75130", "root": "/" } }, { "id": 7879, "entity": { "name": { "type": "client", "num": 7879 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3726067149 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7879 192.168.0.1:0/3726067149", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x00000000003fffff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "entity_id": "1", "hostname": "smithi179", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "48833", "root": "/" } } ] }, "result": 0 } } 2024-09-13T17:19:01.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.779 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2024-09-13T17:19:01.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.837 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2024-09-13T17:19:01.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:01.897 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2024-09-13T17:19:01.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-13T17:19:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.040+0000 7f60270de640 1 Processor -- start 2024-09-13T17:19:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.040+0000 7f60270de640 1 -- start start 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f60270de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f60200ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f60270de640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602006b760 con 0x7f602015a030 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f60270de640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602006cd30 con 0x7f602006ae60 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f60270de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602006d010 con 0x7f602006b2d0 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f6024e7a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f602015a030 0x7f602015d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40820/0 (socket says 172.21.15.5:40820) 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f6024e7a640 1 -- 172.21.15.5:0/744261676 learned_addr learned my addr 172.21.15.5:0/744261676 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f602567b640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f60200ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282501730 0 0) 0x7f602006b760 con 0x7f602015a030 2024-09-13T17:19:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6010003520 con 0x7f602015a030 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053920429 0 0) 0x7f6010003520 con 0x7f602015a030 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 msgr2=0x7f60200ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f60200ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 >> v1:172.21.15.179:6789/0 conn(0x7f602006ae60 legacy=0x7f60200abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602006d2f0 con 0x7f602015a030 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f6014001670 con 0x7f602015a030 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 >> v1:172.21.15.5:6789/0 conn(0x7f602015a030 legacy=0x7f602015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.041+0000 7f601f7fe640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f6010003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601f7fe640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6010004350 0x7f6010004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601f7fe640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f6010005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602006d010 con 0x7f60100039a0 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601000b980 con 0x7f6010004350 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601000bb40 con 0x7f602006b2d0 2024-09-13T17:19:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f6010003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f601ffff640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6010004350 0x7f6010004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f602567b640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f6010005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 -- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 msgr2=0x7f6010005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602006b2d0 0x7f6010005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 -- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6010004350 msgr2=0x7f6010004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6010004350 0x7f6010004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.042+0000 7f6024e7a640 1 -- 172.21.15.5:0/744261676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010003520 con 0x7f60100039a0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f6024e7a640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f6010003d80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f601400c210 tx=0x7f60100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ba48ed052c0d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014005ad0 con 0x7f60100039a0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014005c50 con 0x7f60100039a0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f601f7fe640 1 -- 172.21.15.5:0/744261676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014007070 con 0x7f60100039a0 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 -- 172.21.15.5:0/744261676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 msgr2=0x7f6010003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 --2- 172.21.15.5:0/744261676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f6010003d80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f601400c210 tx=0x7f60100057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f602567b640 1 -- 172.21.15.5:0/744261676 reap_dead start 2024-09-13T17:19:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 -- 172.21.15.5:0/744261676 shutdown_connections 2024-09-13T17:19:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 -- 172.21.15.5:0/744261676 >> 172.21.15.5:0/744261676 conn(0x7f6020070800 msgr2=0x7f6020070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 -- 172.21.15.5:0/744261676 shutdown_connections 2024-09-13T17:19:02.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.043+0000 7f60270de640 1 -- 172.21.15.5:0/744261676 wait complete. 2024-09-13T17:19:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.045+0000 7f60270de640 1 Processor -- start 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.045+0000 7f60270de640 1 -- start start 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.045+0000 7f60270de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 0x7f60200c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 0x7f6020159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020159c80 con 0x7f60100039a0 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f5330 con 0x7f60201f3a80 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f4290 con 0x7f6020159290 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51118/0 (socket says 172.21.15.5:51118) 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 -- 172.21.15.5:0/3524175747 learned_addr learned my addr 172.21.15.5:0/3524175747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f602567b640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 0x7f6020159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f601ffff640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 0x7f60200c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 -- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 msgr2=0x7f6020159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 0x7f6020159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 -- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 msgr2=0x7f60200c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 0x7f60200c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 -- 172.21.15.5:0/3524175747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60201f4570 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f601ffff640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 0x7f60200c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f602567b640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 0x7f6020159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f6024e7a640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f6014034040 tx=0x7f6014001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004d30 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014004e90 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201f4850 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.046+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014007290 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.047+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201f4e10 con 0x7f60100039a0 2024-09-13T17:19:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.048+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60201f4fd0 con 0x7f60100039a0 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.048+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f60140073f0 con 0x7f60100039a0 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.048+0000 7f601d7fa640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 0x7f600406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.048+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f60140a9a70 con 0x7f60100039a0 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.049+0000 7f601ffff640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 0x7f600406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.049+0000 7f601ffff640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 0x7f600406d0f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c00 tx=0x7f600c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.053+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6014078580 con 0x7f60100039a0 2024-09-13T17:19:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.263+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f60201f4fd0 con 0x7f60100039a0 2024-09-13T17:19:02.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.889+0000 7f601d7fa640 1 -- 172.21.15.5:0/3524175747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6014078110 con 0x7f60100039a0 2024-09-13T17:19:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 msgr2=0x7f600406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 0x7f600406d0f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f600c000c00 tx=0x7f600c009040 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 msgr2=0x7f60200c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f6014034040 tx=0x7f6014001a00 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 shutdown_connections 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6020159290 0x7f6020159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60201f3a80 0x7f60200c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f600406ac30 0x7f600406d0f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 --2- 172.21.15.5:0/3524175747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60100039a0 0x7f60200c50d0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 >> 172.21.15.5:0/3524175747 conn(0x7f6020070800 msgr2=0x7f60200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.892+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 shutdown_connections 2024-09-13T17:19:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:02.893+0000 7f60270de640 1 -- 172.21.15.5:0/3524175747 wait complete. 2024-09-13T17:19:02.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.015+0000 7f5507653640 1 Processor -- start 2024-09-13T17:19:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.015+0000 7f5507653640 1 -- start start 2024-09-13T17:19:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5507653640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55000abdb0 0x7f55000ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5507653640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550006dac0 con 0x7f550015c4e0 2024-09-13T17:19:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5507653640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5500069ef0 con 0x7f5500065e40 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5507653640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000ac750 con 0x7f55000abdb0 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5505bf0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55000abdb0 0x7f55000ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f55053ef640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f550015c4e0 0x7f550006d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40832/0 (socket says 172.21.15.5:40832) 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f55053ef640 1 -- 172.21.15.5:0/629675175 learned_addr learned my addr 172.21.15.5:0/629675175 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5505bf0640 1 -- 172.21.15.5:0/629675175 >> v1:172.21.15.179:6789/0 conn(0x7f5500065e40 legacy=0x7f550006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5505bf0640 1 -- 172.21.15.5:0/629675175 >> v1:172.21.15.5:6789/0 conn(0x7f550015c4e0 legacy=0x7f550006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f5505bf0640 1 -- 172.21.15.5:0/629675175 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550006a1d0 con 0x7f55000abdb0 2024-09-13T17:19:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.016+0000 7f54f7fff640 1 -- 172.21.15.5:0/629675175 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274474708 0 0) 0x7f550006dac0 con 0x7f550015c4e0 2024-09-13T17:19:03.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.017+0000 7f5505bf0640 1 --2- 172.21.15.5:0/629675175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ac210 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009d90 tx=0x7f54f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bab25ac53c273d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:03.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.017+0000 7f54f7fff640 1 -- 172.21.15.5:0/629675175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8007740 con 0x7f55000abdb0 2024-09-13T17:19:03.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.017+0000 7f54f7fff640 1 -- 172.21.15.5:0/629675175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f802d050 con 0x7f55000abdb0 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.017+0000 7f54f7fff640 1 -- 172.21.15.5:0/629675175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8007ac0 con 0x7f55000abdb0 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 -- 172.21.15.5:0/629675175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 msgr2=0x7f55000ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 --2- 172.21.15.5:0/629675175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ac210 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009d90 tx=0x7f54f802a6f0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 -- 172.21.15.5:0/629675175 shutdown_connections 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 --2- 172.21.15.5:0/629675175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ac210 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 -- 172.21.15.5:0/629675175 >> 172.21.15.5:0/629675175 conn(0x7f55000cebb0 msgr2=0x7f55000cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 -- 172.21.15.5:0/629675175 shutdown_connections 2024-09-13T17:19:03.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.018+0000 7f5507653640 1 -- 172.21.15.5:0/629675175 wait complete. 2024-09-13T17:19:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.019+0000 7f5507653640 1 Processor -- start 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.019+0000 7f5507653640 1 -- start start 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5500065e40 0x7f550014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f550015c4e0 0x7f55000b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550014ead0 con 0x7f55000abdb0 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500155520 con 0x7f550015c4e0 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5507653640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5500155800 con 0x7f5500065e40 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51136/0 (socket says 172.21.15.5:51136) 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 -- 172.21.15.5:0/4140425173 learned_addr learned my addr 172.21.15.5:0/4140425173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 -- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5500065e40 msgr2=0x7f550014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5500065e40 0x7f550014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 -- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f550015c4e0 msgr2=0x7f55000b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f550015c4e0 0x7f55000b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.020+0000 7f5504bee640 1 -- 172.21.15.5:0/4140425173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009a70 con 0x7f55000abdb0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f5504bee640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c450 tx=0x7f54f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f00052d0 con 0x7f55000abdb0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0005430 con 0x7f55000abdb0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0012870 con 0x7f55000abdb0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500155ae0 con 0x7f55000abdb0 2024-09-13T17:19:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.021+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550015fad0 con 0x7f55000abdb0 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.022+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550015c8c0 con 0x7f55000abdb0 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.022+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54f00129d0 con 0x7f55000abdb0 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.023+0000 7f54f5ffb640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 0x7f54e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.023+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f54f0089020 con 0x7f55000abdb0 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.023+0000 7f55053ef640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 0x7f54e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.024+0000 7f55053ef640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 0x7f54e406d0f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f54fc000c00 tx=0x7f54fc0079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.027+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f54f0054080 con 0x7f55000abdb0 2024-09-13T17:19:03.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.234+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f550006b990 con 0x7f55000abdb0 2024-09-13T17:19:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.235+0000 7f54f5ffb640 1 -- 172.21.15.5:0/4140425173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f54f00576a0 con 0x7f55000abdb0 2024-09-13T17:19:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:03.236 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:02.890403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:creating","state_seq":1,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 58 2024-09-13T17:19:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 msgr2=0x7f54e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 0x7f54e406d0f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f54fc000c00 tx=0x7f54fc0079c0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 msgr2=0x7f55000ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c450 tx=0x7f54f000c910 comp rx=0 tx=0).stop 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 shutdown_connections 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f550015c4e0 0x7f55000b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54e406ac30 0x7f54e406d0f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55000abdb0 0x7f55000ce2d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 --2- 172.21.15.5:0/4140425173 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5500065e40 0x7f550014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 >> 172.21.15.5:0/4140425173 conn(0x7f55000cebb0 msgr2=0x7f550006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 shutdown_connections 2024-09-13T17:19:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:03.237+0000 7f5507653640 1 -- 172.21.15.5:0/4140425173 wait complete. 2024-09-13T17:19:03.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:19:02.890403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 8607, 'mds_1': 7810}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7810': {'gid': 7810, 'name': 'd', 'rank': 1, 'incarnation': 58, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.179:6837/3695538283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 3695538283}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3695538283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8607': {'gid': 8607, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6833/3736030266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3736030266}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3736030266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:19:03.652 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7810:up:creating 2024-09-13T17:19:04.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:04.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 Processor -- start 2024-09-13T17:19:04.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 -- start start 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 0x7fa3700cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3700b47d0 con 0x7fa370160090 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3700d0d00 con 0x7fa3700d16a0 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.767+0000 7fa376e27640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700b3ea0 con 0x7fa3700d0790 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa36ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 0x7fa3700cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:42460/0 (socket says 172.21.15.5:42460) 2024-09-13T17:19:04.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 -- 172.21.15.5:0/2685116398 learned_addr learned my addr 172.21.15.5:0/2685116398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 -- 172.21.15.5:0/2685116398 >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 msgr2=0x7fa3700cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 --2- 172.21.15.5:0/2685116398 >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 0x7fa3700cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 -- 172.21.15.5:0/2685116398 >> v1:172.21.15.179:6789/0 conn(0x7fa370160090 legacy=0x7fa3700d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa3753c4640 1 -- 172.21.15.5:0/2685116398 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700b4180 con 0x7fa3700d0790 2024-09-13T17:19:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.768+0000 7fa36ffff640 1 --2- 172.21.15.5:0/2685116398 >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 0x7fa3700cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.769+0000 7fa3753c4640 1 --2- 172.21.15.5:0/2685116398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa36802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f337daf3e354004 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.769+0000 7fa36f7fe640 1 -- 172.21.15.5:0/2685116398 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36802aea0 con 0x7fa3700d0790 2024-09-13T17:19:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.769+0000 7fa36f7fe640 1 -- 172.21.15.5:0/2685116398 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36802d050 con 0x7fa3700d0790 2024-09-13T17:19:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.769+0000 7fa36f7fe640 1 -- 172.21.15.5:0/2685116398 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368031820 con 0x7fa3700d0790 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 -- 172.21.15.5:0/2685116398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 msgr2=0x7fa3700cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 --2- 172.21.15.5:0/2685116398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa368009e50 tx=0x7fa36802a680 comp rx=0 tx=0).stop 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 -- 172.21.15.5:0/2685116398 shutdown_connections 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 --2- 172.21.15.5:0/2685116398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700cd990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 --2- 172.21.15.5:0/2685116398 >> v2:172.21.15.179:3300/0 conn(0x7fa3700d16a0 0x7fa3700cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 -- 172.21.15.5:0/2685116398 >> 172.21.15.5:0/2685116398 conn(0x7fa37009b9a0 msgr2=0x7fa37008a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 -- 172.21.15.5:0/2685116398 shutdown_connections 2024-09-13T17:19:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.770+0000 7fa376e27640 1 -- 172.21.15.5:0/2685116398 wait complete. 2024-09-13T17:19:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.771+0000 7fa376e27640 1 Processor -- start 2024-09-13T17:19:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.771+0000 7fa376e27640 1 -- start start 2024-09-13T17:19:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370156b60 0x7fa3700b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c8c90 con 0x7fa3700d16a0 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c7bf0 con 0x7fa370156b60 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa376e27640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c7ed0 con 0x7fa3700d0790 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa36ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa36ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52704/0 (socket says 172.21.15.5:52704) 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa36ffff640 1 -- 172.21.15.5:0/4226889619 learned_addr learned my addr 172.21.15.5:0/4226889619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.772+0000 7fa374bc3640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa3753c4640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370156b60 0x7fa3700b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 -- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 msgr2=0x7fa3700c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 -- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370156b60 msgr2=0x7fa3700b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370156b60 0x7fa3700b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 -- 172.21.15.5:0/4226889619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0093a0 con 0x7fa3700d16a0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36ffff640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00ebe0 tx=0x7fa35c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c009750 con 0x7fa3700d16a0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c00cc30 con 0x7fa3700d16a0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa368009b30 con 0x7fa3700d16a0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00eee0 con 0x7fa3700d16a0 2024-09-13T17:19:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.773+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3700c8490 con 0x7fa3700d16a0 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.774+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa370067310 con 0x7fa3700d16a0 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.775+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa35c005990 con 0x7fa3700d16a0 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.775+0000 7fa36d7fa640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 0x7fa35406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.775+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fa35c089990 con 0x7fa3700d16a0 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.775+0000 7fa374bc3640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 0x7fa35406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.776+0000 7fa374bc3640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 0x7fa35406d0f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:04.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.779+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa35c054a10 con 0x7fa3700d16a0 2024-09-13T17:19:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.985+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3700b1460 con 0x7fa3700d16a0 2024-09-13T17:19:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.986+0000 7fa36d7fa640 1 -- 172.21.15.5:0/4226889619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4752 (secure 0 0 0) 0x7fa35c058030 con 0x7fa3700d16a0 2024-09-13T17:19:04.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:04.987 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:03.891944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 59 2024-09-13T17:19:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 msgr2=0x7fa35406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 0x7fa35406d0f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364009040 comp rx=0 tx=0).stop 2024-09-13T17:19:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 msgr2=0x7fa37015c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00ebe0 tx=0x7fa35c00c520 comp rx=0 tx=0).stop 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 shutdown_connections 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370156b60 0x7fa3700b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa35406ac30 0x7fa35406d0f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3700d16a0 0x7fa37015c3c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 --2- 172.21.15.5:0/4226889619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700d0790 0x7fa3700c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 >> 172.21.15.5:0/4226889619 conn(0x7fa37009b9a0 msgr2=0x7fa3700b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 shutdown_connections 2024-09-13T17:19:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:04.988+0000 7fa376e27640 1 -- 172.21.15.5:0/4226889619 wait complete. 2024-09-13T17:19:05.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:18:32.403163+0000', 'modified': '2024-09-13T17:19:03.891944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 8607, 'mds_1': 7810}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7810': {'gid': 7810, 'name': 'd', 'rank': 1, 'incarnation': 58, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.179:6837/3695538283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 3695538283}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3695538283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8607': {'gid': 8607, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6833/3736030266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3736030266}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3736030266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:19:05.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-13T17:19:05.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T17:19:05.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.508+0000 7f920579d640 1 Processor -- start 2024-09-13T17:19:05.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 -- start start 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f920015c520 0x7f920006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f9200098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9200098fb0 0x7f92000b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9200099460 con 0x7f920015c520 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92000ce410 con 0x7f9200098fb0 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f920579d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200099860 con 0x7f92000b0390 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f91fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f920015c520 0x7f920006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.509+0000 7f91fffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f920015c520 0x7f920006af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52716/0 (socket says 172.21.15.5:52716) 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 -- 172.21.15.5:0/2404003474 learned_addr learned my addr 172.21.15.5:0/2404003474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f9200098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f9204f9c640 1 --2- 172.21.15.5:0/2404003474 >> v2:172.21.15.179:3300/0 conn(0x7f9200098fb0 0x7f92000b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 -- 172.21.15.5:0/2404003474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 msgr2=0x7f9200098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f9200098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 -- 172.21.15.5:0/2404003474 >> v2:172.21.15.179:3300/0 conn(0x7f9200098fb0 msgr2=0x7f92000b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 --2- 172.21.15.5:0/2404003474 >> v2:172.21.15.179:3300/0 conn(0x7f9200098fb0 0x7f92000b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.510+0000 7f91fffff640 1 -- 172.21.15.5:0/2404003474 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920006b5d0 con 0x7f920015c520 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f91fffff640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f920015c520 0x7f920006af60 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f92000b1960 tx=0x7f91f002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bc8528f6a5e38e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f91feffd640 1 -- 172.21.15.5:0/2404003474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f002ae90 con 0x7f920015c520 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f91feffd640 1 -- 172.21.15.5:0/2404003474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0032440 con 0x7f920015c520 2024-09-13T17:19:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f91feffd640 1 -- 172.21.15.5:0/2404003474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00327d0 con 0x7f920015c520 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 -- 172.21.15.5:0/2404003474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f920015c520 msgr2=0x7f920006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f920015c520 0x7f920006af60 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f92000b1960 tx=0x7f91f002a140 comp rx=0 tx=0).stop 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 -- 172.21.15.5:0/2404003474 shutdown_connections 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 --2- 172.21.15.5:0/2404003474 >> v2:172.21.15.179:3300/0 conn(0x7f9200098fb0 0x7f92000b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f9200098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 --2- 172.21.15.5:0/2404003474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f920015c520 0x7f920006af60 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 -- 172.21.15.5:0/2404003474 >> 172.21.15.5:0/2404003474 conn(0x7f92000d0410 msgr2=0x7f92000d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 -- 172.21.15.5:0/2404003474 shutdown_connections 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.511+0000 7f920579d640 1 -- 172.21.15.5:0/2404003474 wait complete. 2024-09-13T17:19:05.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 Processor -- start 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 -- start start 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f92001f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920015c520 0x7f920015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.513+0000 7f920579d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9200155f40 con 0x7f9200098fb0 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f920579d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92000c3f50 con 0x7f920015c520 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f920579d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92001f3230 con 0x7f92000b0390 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52732/0 (socket says 172.21.15.5:52732) 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 -- 172.21.15.5:0/3394589716 learned_addr learned my addr 172.21.15.5:0/3394589716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f92001f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f9204f9c640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920015c520 0x7f920015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 -- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 msgr2=0x7f92001f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f92001f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 -- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920015c520 msgr2=0x7f920015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920015c520 0x7f920015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 -- 172.21.15.5:0/3394589716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00094d0 con 0x7f9200098fb0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fffff640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f91f002a180 tx=0x7f91f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fcff9640 1 -- 172.21.15.5:0/3394589716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00308d0 con 0x7f9200098fb0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fcff9640 1 -- 172.21.15.5:0/3394589716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0030a30 con 0x7f9200098fb0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f91fcff9640 1 -- 172.21.15.5:0/3394589716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0030da0 con 0x7f9200098fb0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92000c41c0 con 0x7f9200098fb0 2024-09-13T17:19:05.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.514+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92000c4780 con 0x7f9200098fb0 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.516+0000 7f91fcff9640 1 -- 172.21.15.5:0/3394589716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91f0039040 con 0x7f9200098fb0 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.516+0000 7f91fcff9640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 0x7f91ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.516+0000 7f91fcff9640 1 -- 172.21.15.5:0/3394589716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f91f00a9fe0 con 0x7f9200098fb0 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.517+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 0x7f91ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.517+0000 7f92097fa740 1 Processor -- start 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.517+0000 7f92097fa740 1 -- start start 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.517+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 0x7f91ec06d0c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f92000cf8f0 tx=0x7f91f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f11a50 0x555895f61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f61ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895e6e7c0 con 0x555895f14290 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895e7db70 con 0x555895f3b740 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555895e7b300 con 0x555895f11a50 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52738/0 (socket says 172.21.15.5:52738) 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 -- 172.21.15.5:0/3195907247 learned_addr learned my addr 172.21.15.5:0/3195907247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f11a50 0x555895f61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f9204f9c640 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f61ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 -- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f11a50 msgr2=0x555895f61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f11a50 0x555895f61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 -- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 msgr2=0x555895f61ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f61ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 -- 172.21.15.5:0/3195907247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555895e034b0 con 0x555895f14290 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.518+0000 7f91fffff640 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f91f0006da0 tx=0x7f91f0079380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f722f1ee54badf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f91e5ffb640 1 -- 172.21.15.5:0/3195907247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f007cab0 con 0x555895f14290 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f91e5ffb640 1 -- 172.21.15.5:0/3195907247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0081070 con 0x555895f14290 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f91e5ffb640 1 -- 172.21.15.5:0/3195907247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0075390 con 0x555895f14290 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 -- 172.21.15.5:0/3195907247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 msgr2=0x555895f14670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f91f0006da0 tx=0x7f91f0079380 comp rx=0 tx=0).stop 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 -- 172.21.15.5:0/3195907247 shutdown_connections 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f61ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f11a50 0x555895f61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 --2- 172.21.15.5:0/3195907247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f14670 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 -- 172.21.15.5:0/3195907247 >> 172.21.15.5:0/3195907247 conn(0x555895f109c0 msgr2=0x555895f58e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 -- 172.21.15.5:0/3195907247 shutdown_connections 2024-09-13T17:19:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.519+0000 7f92097fa740 1 -- 172.21.15.5:0/3195907247 wait complete. 2024-09-13T17:19:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.520+0000 7f92097fa740 1 -- start start 2024-09-13T17:19:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.520+0000 7f92097fa740 1 Processor -- start 2024-09-13T17:19:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f14290 0x555895f38da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 0x555895f60d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895e76bf0 con 0x555895f3b740 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895e35250 con 0x555895f14290 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555895e34ef0 con 0x555895f3b060 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f92097fa740 10 client.0 _ll_register_callbacks cb 0x555895e67740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52740/0 (socket says 172.21.15.5:52740) 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 -- 172.21.15.5:0/2260130666 learned_addr learned my addr 172.21.15.5:0/2260130666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91fffff640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f14290 0x555895f38da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f9204f9c640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 0x555895f60d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 -- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 msgr2=0x555895f60d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 0x555895f60d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 -- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f14290 msgr2=0x555895f38da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f14290 0x555895f38da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 -- 172.21.15.5:0/2260130666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92000c4780 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f9204f9c640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 0x555895f60d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f91f4016740 tx=0x7f91f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baac45479d42ab7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.521+0000 7f91deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4014880 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f91f40149e0 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555895b6a3c0 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91f4014be0 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 10 client.8721 fetch_fsmap learned FSMap version 59 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x555895e75270 con 0x555895f3b740 2024-09-13T17:19:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555895b6a3c0 con 0x555895f3b740 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 59) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f91f402b440 con 0x555895f3b740 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 10 client.8721 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 10 client.8721 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 20 client.8721 populate_metadata read hostname 'smithi005' 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f39a80 0x555895f39e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 4 client.8721 mds_command: new command op to 7810 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 --> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555895b7b6c0 con 0x555895f39a80 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.522+0000 7f91fffff640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f39a80 0x555895f39e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.523+0000 7f91deffd640 10 client.8721 ms_handle_connect on v2:172.21.15.179:6836/3695538283 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.523+0000 7f91fffff640 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f39a80 0x555895f39e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=171cc390e6641446 server_cookie=30cee46b7ab1bef0 in_seq=0 out_seq=0 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.523+0000 7f91deffd640 1 -- 172.21.15.5:0/2260130666 <== mds.1 v2:172.21.15.179:6836/3695538283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555895b7b6c0 con 0x555895f39a80 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.523+0000 7f91deffd640 10 client.8721 handle_command_reply: tid=0 2024-09-13T17:19:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.523+0000 7f92097fa740 1 client.8721 shutdown 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 msgr2=0x555895f60800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f91f4016740 tx=0x7f91f40046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 shutdown_connections 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b060 0x555895f60d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f39a80 0x555895f39e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b740 0x555895f60800 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 --2- 172.21.15.5:0/2260130666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f14290 0x555895f38da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f91deffd640 0 client.8721 ms_handle_reset on v2:172.21.15.179:6836/3695538283 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 >> 172.21.15.5:0/2260130666 conn(0x555895f11a50 msgr2=0x555895f0fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 shutdown_connections 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 1 -- 172.21.15.5:0/2260130666 wait complete. 2024-09-13T17:19:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.524+0000 7f92097fa740 20 client.8721 trim_cache size 0 max 16384 2024-09-13T17:19:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 Processor -- start 2024-09-13T17:19:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 -- start start 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 0x555895f7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 0x555895f3a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895dfa460 con 0x555895f14290 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895f3f0b0 con 0x555895f3b060 2024-09-13T17:19:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.539+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555895f3d0b0 con 0x555895f3b740 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52748/0 (socket says 172.21.15.5:52748) 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 -- 172.21.15.5:0/3236967647 learned_addr learned my addr 172.21.15.5:0/3236967647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 0x555895f7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 -- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 msgr2=0x555895f3a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f9204f9c640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 0x555895f3a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 0x555895f3a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 -- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 msgr2=0x555895f7adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 0x555895f7adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 -- 172.21.15.5:0/3236967647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555895e175f0 con 0x555895f14290 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f9204f9c640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 0x555895f3a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 0x555895f7adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91fffff640 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009280 tx=0x7f91f007a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17b38479b6e4288 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91e67fc640 1 -- 172.21.15.5:0/3236967647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00a8080 con 0x555895f14290 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91e67fc640 1 -- 172.21.15.5:0/3236967647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0074fc0 con 0x555895f14290 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.540+0000 7f91e67fc640 1 -- 172.21.15.5:0/3236967647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0075390 con 0x555895f14290 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- 172.21.15.5:0/3236967647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 msgr2=0x555895f715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009280 tx=0x7f91f007a000 comp rx=0 tx=0).stop 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- 172.21.15.5:0/3236967647 shutdown_connections 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f3b740 0x555895f3a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b060 0x555895f7adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 --2- 172.21.15.5:0/3236967647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f14290 0x555895f715f0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- 172.21.15.5:0/3236967647 >> 172.21.15.5:0/3236967647 conn(0x555895f11a50 msgr2=0x555895f3d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- 172.21.15.5:0/3236967647 shutdown_connections 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- 172.21.15.5:0/3236967647 wait complete. 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 -- start start 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.541+0000 7f92097fa740 1 Processor -- start 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f14290 0x555895fabf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f37370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895f2c690 con 0x555895f3b060 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555895f37e40 con 0x555895f3b740 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x555895f59d00 con 0x555895f14290 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f92097fa740 10 client.0 _ll_register_callbacks cb 0x7f91f0006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f91ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f91ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52764/0 (socket says 172.21.15.5:52764) 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f91ff7fe640 1 -- 172.21.15.5:0/1196355251 learned_addr learned my addr 172.21.15.5:0/1196355251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.542+0000 7f9204f9c640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f37370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91fffff640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f14290 0x555895fabf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 -- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f14290 msgr2=0x555895fabf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f14290 0x555895fabf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 -- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 msgr2=0x555895f37370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f37370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 -- 172.21.15.5:0/1196355251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555895e034b0 con 0x555895f3b060 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91ff7fe640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f91f4010cc0 tx=0x7f91f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224089ac6d1b7626 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4014430 con 0x555895f3b060 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f91f4007630 con 0x555895f3b060 2024-09-13T17:19:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91f0081070 con 0x555895f3b060 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91f402bdf0 con 0x555895f3b060 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f92097fa740 10 client.8727 fetch_fsmap learned FSMap version 59 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x555895e3cd00 con 0x555895f3b060 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0081070 con 0x555895f3b060 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.543+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 59) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f91f403b020 con 0x555895f3b060 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 10 client.8727 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 10 client.8727 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 20 client.8727 populate_metadata read hostname 'smithi005' 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f37900 0x555895f0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 4 client.8727 mds_command: new command op to 7810 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 --> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555895bced10 con 0x555895f37900 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f91fffff640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f37900 0x555895f0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f91deffd640 10 client.8727 ms_handle_connect on v2:172.21.15.179:6836/3695538283 2024-09-13T17:19:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f91fffff640 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f37900 0x555895f0f990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae0ad081d7d691f server_cookie=7f493af9c45ac513 in_seq=0 out_seq=0 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f91deffd640 1 -- 172.21.15.5:0/1196355251 <== mds.1 v2:172.21.15.179:6836/3695538283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555895bced10 con 0x555895f37900 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f91deffd640 10 client.8727 handle_command_reply: tid=0 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.544+0000 7f92097fa740 1 client.8727 shutdown 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 msgr2=0x555895f2cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f91f4010cc0 tx=0x7f91f4017000 comp rx=0 tx=0).stop 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 shutdown_connections 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555895f3b740 0x555895f37370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:6836/3695538283,v1:172.21.15.179:6837/3695538283] conn(0x555895f37900 0x555895f0f990 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555895f3b060 0x555895f2cab0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 --2- 172.21.15.5:0/1196355251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555895f14290 0x555895fabf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f91deffd640 0 client.8727 ms_handle_reset on v2:172.21.15.179:6836/3695538283 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 >> 172.21.15.5:0/1196355251 conn(0x555895f11a50 msgr2=0x555895f715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 shutdown_connections 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 1 -- 172.21.15.5:0/1196355251 wait complete. 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f92097fa740 20 client.8727 trim_cache size 0 max 16384 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7810, 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:19:05.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 2.6530244280000002, 2024-09-13T17:19:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 59, 2024-09-13T17:19:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 113, 2024-09-13T17:19:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 113, 2024-09-13T17:19:05.564 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.600864395 2024-09-13T17:19:05.564 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 msgr2=0x7f91ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 0x7f91ec06d0c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f92000cf8f0 tx=0x7f91f4008040 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 msgr2=0x7f9200155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f91f002a180 tx=0x7f91f00046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 shutdown_connections 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f920015c520 0x7f920015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92000b0390 0x7f92001f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f91ec06ac00 0x7f91ec06d0c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 --2- 172.21.15.5:0/3394589716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9200098fb0 0x7f9200155a00 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 >> 172.21.15.5:0/3394589716 conn(0x7f92000d0410 msgr2=0x7f920006e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 shutdown_connections 2024-09-13T17:19:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.545+0000 7f920579d640 1 -- 172.21.15.5:0/3394589716 wait complete. 2024-09-13T17:19:05.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:19:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.667+0000 7f1f58945640 1 Processor -- start 2024-09-13T17:19:05.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 -- start start 2024-09-13T17:19:05.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f540acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f540abf40 0x7f1f54070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540701a0 con 0x7f1f541591e0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f540ad540 con 0x7f1f540abf40 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.668+0000 7f1f58945640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540ad820 con 0x7f1f540cedc0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f5259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f541591e0 0x7f1f540ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43858/0 (socket says 172.21.15.5:43858) 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f5259c640 1 -- 172.21.15.5:0/2909200600 learned_addr learned my addr 172.21.15.5:0/2909200600 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2909200600 >> v2:172.21.15.5:3300/0 conn(0x7f1f540abf40 0x7f1f54070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f540acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f5159a640 1 -- 172.21.15.5:0/2909200600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747909599 0 0) 0x7f1f540701a0 con 0x7f1f541591e0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f5159a640 1 -- 172.21.15.5:0/2909200600 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c003520 con 0x7f1f541591e0 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2909200600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 msgr2=0x7f1f540acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f540acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2909200600 >> v1:172.21.15.5:6789/0 conn(0x7f1f541591e0 legacy=0x7f1f540ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2909200600 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540adb00 con 0x7f1f540abf40 2024-09-13T17:19:05.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.669+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f540acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f540abf40 0x7f1f54070910 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dfbbd743ceaea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f5159a640 1 -- 172.21.15.5:0/2909200600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c031600 con 0x7f1f540abf40 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f5159a640 1 -- 172.21.15.5:0/2909200600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c02d050 con 0x7f1f540abf40 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f5159a640 1 -- 172.21.15.5:0/2909200600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c031980 con 0x7f1f540abf40 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 -- 172.21.15.5:0/2909200600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f540abf40 msgr2=0x7f1f54070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f540abf40 0x7f1f54070910 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 -- 172.21.15.5:0/2909200600 shutdown_connections 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f540abf40 0x7f1f54070910 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 --2- 172.21.15.5:0/2909200600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f540acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.670+0000 7f1f58945640 1 -- 172.21.15.5:0/2909200600 >> 172.21.15.5:0/2909200600 conn(0x7f1f5406a270 msgr2=0x7f1f5406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.671+0000 7f1f58945640 1 -- 172.21.15.5:0/2909200600 shutdown_connections 2024-09-13T17:19:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.671+0000 7f1f58945640 1 -- 172.21.15.5:0/2909200600 wait complete. 2024-09-13T17:19:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.672+0000 7f1f58945640 1 Processor -- start 2024-09-13T17:19:05.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.672+0000 7f1f58945640 1 -- start start 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 0x7f1f540b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f5414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5414b790 con 0x7f1f541591e0 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541efe30 con 0x7f1f540abf40 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5414cf70 con 0x7f1f540cedc0 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52790/0 (socket says 172.21.15.5:52790) 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2441540225 learned_addr learned my addr 172.21.15.5:0/2441540225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f5414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 0x7f1f540b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 msgr2=0x7f1f5414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f5414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 msgr2=0x7f1f540b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 0x7f1f540b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2441540225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009a70 con 0x7f1f541591e0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f5414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 0x7f1f540b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02abc0 tx=0x7f1f4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f42ffd640 1 -- 172.21.15.5:0/2441540225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c03b820 con 0x7f1f541591e0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f42ffd640 1 -- 172.21.15.5:0/2441540225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c03b980 con 0x7f1f541591e0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5414d250 con 0x7f1f541591e0 2024-09-13T17:19:05.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f42ffd640 1 -- 172.21.15.5:0/2441540225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c03bcf0 con 0x7f1f541591e0 2024-09-13T17:19:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.673+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f54151ae0 con 0x7f1f541591e0 2024-09-13T17:19:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.675+0000 7f1f42ffd640 1 -- 172.21.15.5:0/2441540225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f4c04d3f0 con 0x7f1f541591e0 2024-09-13T17:19:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.675+0000 7f1f42ffd640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 0x7f1f3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.675+0000 7f1f42ffd640 1 -- 172.21.15.5:0/2441540225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f1f4c0aab90 con 0x7f1f541591e0 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.676+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 0x7f1f3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.676+0000 7f1f5b66c740 1 Processor -- start 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.676+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 0x7f1f3406d0c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1f440011e0 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.676+0000 7f1f5b66c740 1 -- start start 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x5621724f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f2860 0x562172542570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217244f7c0 con 0x56217251c550 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217245eb70 con 0x5621724f2860 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56217245c300 con 0x5621724f50a0 2024-09-13T17:19:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52794/0 (socket says 172.21.15.5:52794) 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3741458422 learned_addr learned my addr 172.21.15.5:0/3741458422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f5259c640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x5621724f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.677+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f2860 0x562172542570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 msgr2=0x5621724f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x5621724f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f2860 msgr2=0x562172542570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f2860 0x562172542570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3741458422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621723e44b0 con 0x56217251c550 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f5259c640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x5621724f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0a8e20 tx=0x7f1f4c043480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c692d1618798c6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f33fff640 1 -- 172.21.15.5:0/3741458422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c081c10 con 0x56217251c550 2024-09-13T17:19:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f33fff640 1 -- 172.21.15.5:0/3741458422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c091180 con 0x56217251c550 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f33fff640 1 -- 172.21.15.5:0/3741458422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c075f30 con 0x56217251c550 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3741458422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 msgr2=0x562172542ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.678+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0a8e20 tx=0x7f1f4c043480 comp rx=0 tx=0).stop 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3741458422 shutdown_connections 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56217251c550 0x562172542ab0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f2860 0x562172542570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3741458422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x5621724f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3741458422 >> 172.21.15.5:0/3741458422 conn(0x5621724f17d0 msgr2=0x562172539c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3741458422 shutdown_connections 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3741458422 wait complete. 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 -- start start 2024-09-13T17:19:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.679+0000 7f1f5b66c740 1 Processor -- start 2024-09-13T17:19:05.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f50a0 0x562172520030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x562172519ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562172457bf0 con 0x562172541b20 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562172416250 con 0x5621724f50a0 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x562172415ef0 con 0x56217251c550 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5b66c740 10 client.0 _ll_register_callbacks cb 0x562172448740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52804/0 (socket says 172.21.15.5:52804) 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2363414765 learned_addr learned my addr 172.21.15.5:0/2363414765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f50a0 0x562172520030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.680+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x562172519ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 msgr2=0x562172519ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x562172519ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f50a0 msgr2=0x562172520030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f50a0 0x562172520030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 -- 172.21.15.5:0/2363414765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f54151ae0 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02a610 tx=0x7f1f4c046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e6a12b3b249096 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c079c80 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f1f4c098270 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56217214b3c0 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4c081c10 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 10 client.8742 fetch_fsmap learned FSMap version 59 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x562172456270 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56217214b3c0 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 59) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f1f4c038040 con 0x562172541b20 2024-09-13T17:19:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 10 client.8742 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 10 client.8742 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 20 client.8742 populate_metadata read hostname 'smithi005' 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x562172540010 0x5621724eed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 4 client.8742 mds_command: new command op to 8607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.681+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 --> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56217215c6c0 con 0x562172540010 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x562172540010 0x5621724eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f5259c640 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x562172540010 0x5621724eed70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c73667766caee896 server_cookie=46cc6d53130a6236 in_seq=0 out_seq=0 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f317fa640 10 client.8742 ms_handle_connect on v2:172.21.15.5:6832/3736030266 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f317fa640 1 -- 172.21.15.5:0/2363414765 <== mds.0 v2:172.21.15.5:6832/3736030266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56217215c6c0 con 0x562172540010 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f317fa640 10 client.8742 handle_command_reply: tid=0 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f5b66c740 1 client.8742 shutdown 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 msgr2=0x56217251a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.682+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02a610 tx=0x7f1f4c046040 comp rx=0 tx=0).stop 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 shutdown_connections 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x562172540010 0x5621724eed70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x56217251a5d0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x562172519ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/2363414765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5621724f50a0 0x562172520030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f317fa640 0 client.8742 ms_handle_reset on v2:172.21.15.5:6832/3736030266 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 >> 172.21.15.5:0/2363414765 conn(0x5621724f2860 msgr2=0x56217253a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 shutdown_connections 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 1 -- 172.21.15.5:0/2363414765 wait complete. 2024-09-13T17:19:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.683+0000 7f1f5b66c740 20 client.8742 trim_cache size 0 max 16384 2024-09-13T17:19:05.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 Processor -- start 2024-09-13T17:19:05.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 -- start start 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x562172541230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56217251c550 0x562172539910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621723db460 con 0x562172541b20 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217251af40 con 0x56217251c550 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56217251b950 con 0x5621724f50a0 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52810/0 (socket says 172.21.15.5:52810) 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.698+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3172076221 learned_addr learned my addr 172.21.15.5:0/3172076221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 msgr2=0x562172541230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x562172541230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56217251c550 msgr2=0x562172539910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56217251c550 0x562172539910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 -- 172.21.15.5:0/3172076221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621723f85f0 con 0x562172541b20 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c079640 tx=0x7f1f4c0434f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edb0383fe1cf80d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f40ff9640 1 -- 172.21.15.5:0/3172076221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c079c80 con 0x562172541b20 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f40ff9640 1 -- 172.21.15.5:0/3172076221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c098270 con 0x562172541b20 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f40ff9640 1 -- 172.21.15.5:0/3172076221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c081c10 con 0x562172541b20 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3172076221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 msgr2=0x5621724f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.699+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c079640 tx=0x7f1f4c0434f0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3172076221 shutdown_connections 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562172541b20 0x5621724f3d80 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56217251c550 0x562172539910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/3172076221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5621724f50a0 0x562172541230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3172076221 >> 172.21.15.5:0/3172076221 conn(0x5621724f2860 msgr2=0x5621724f0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3172076221 shutdown_connections 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 -- 172.21.15.5:0/3172076221 wait complete. 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 -- start start 2024-09-13T17:19:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.700+0000 7f1f5b66c740 1 Processor -- start 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x5621725a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562172541b20 0x562172555d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621725a3870 con 0x5621724f50a0 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217253b150 con 0x562172541b20 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56217253b3a0 con 0x56217251c550 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5b66c740 10 client.0 _ll_register_callbacks cb 0x7f1f4c079670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52812/0 (socket says 172.21.15.5:52812) 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 -- 172.21.15.5:0/992731207 learned_addr learned my addr 172.21.15.5:0/992731207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f52d9d640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562172541b20 0x562172555d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 -- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 msgr2=0x5621725a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x5621725a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 -- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562172541b20 msgr2=0x562172555d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562172541b20 0x562172555d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.701+0000 7f1f5259c640 1 -- 172.21.15.5:0/992731207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562172456270 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5259c640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x562172457cb0 tx=0x7f1f44001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51239529a99eb452 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44007560 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f1f440076c0 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f4c091180 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4400ec00 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 10 client.8748 fetch_fsmap learned FSMap version 59 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x56217241dd00 con 0x5621724f50a0 2024-09-13T17:19:05.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c091180 con 0x5621724f50a0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 59) v1 ==== 3126+0+0 (secure 0 0 0) 0x7f1f4400ed60 con 0x5621724f50a0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 10 client.8748 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 10 client.8748 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 20 client.8748 populate_metadata read hostname 'smithi005' 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x5621725a6eb0 0x5621725a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 4 client.8748 mds_command: new command op to 8607 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 --> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5621721afd10 con 0x5621725a6eb0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.702+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x5621725a6eb0 0x5621725a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f51d9b640 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x5621725a6eb0 0x5621725a7290 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc0e552fb1c0048f server_cookie=bcf461fbaccb15db in_seq=0 out_seq=0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f317fa640 10 client.8748 ms_handle_connect on v2:172.21.15.5:6832/3736030266 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f317fa640 1 -- 172.21.15.5:0/992731207 <== mds.0 v2:172.21.15.5:6832/3736030266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5621721afd10 con 0x5621725a6eb0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f317fa640 10 client.8748 handle_command_reply: tid=0 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 client.8748 shutdown 2024-09-13T17:19:05.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 msgr2=0x562172539c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x562172457cb0 tx=0x7f1f44001150 comp rx=0 tx=0).stop 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 shutdown_connections 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:6832/3736030266,v1:172.21.15.5:6833/3736030266] conn(0x5621725a6eb0 0x5621725a7290 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562172541b20 0x562172555d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56217251c550 0x5621725a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f317fa640 0 client.8748 ms_handle_reset on v2:172.21.15.5:6832/3736030266 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 --2- 172.21.15.5:0/992731207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621724f50a0 0x562172539c40 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 >> 172.21.15.5:0/992731207 conn(0x5621724f2860 msgr2=0x562172541150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 shutdown_connections 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 1 -- 172.21.15.5:0/992731207 wait complete. 2024-09-13T17:19:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.703+0000 7f1f5b66c740 20 client.8748 trim_cache size 0 max 16384 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "3b63ea2f-5230-4468-aa58-3481f4f99558", 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8607, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 12.840252251000001, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 59, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 113, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 113, 2024-09-13T17:19:05.711 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.752032528999999 2024-09-13T17:19:05.712 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 msgr2=0x7f1f3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 0x7f1f3406d0c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1f440011e0 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 msgr2=0x7f1f541472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c02abc0 tx=0x7f1f4c004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 shutdown_connections 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f3406ac00 0x7f1f3406d0c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f541591e0 0x7f1f541472b0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f540cedc0 0x7f1f5414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 --2- 172.21.15.5:0/2441540225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f540abf40 0x7f1f540b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 >> 172.21.15.5:0/2441540225 conn(0x7f1f5406a270 msgr2=0x7f1f540af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 shutdown_connections 2024-09-13T17:19:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:05.704+0000 7f1f58945640 1 -- 172.21.15.5:0/2441540225 wait complete. 2024-09-13T17:19:05.716 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-13T17:19:05.840 INFO:teuthology.orchestra.run.smithi179.stdout:{"message":"","return_code":0} 2024-09-13T17:19:05.841 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T17:19:05.841 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump objecter 2024-09-13T17:19:05.955 INFO:teuthology.orchestra.run.smithi179.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":38,"op_send_bytes":11382,"op_resend":33,"op_reply":38,"op_latency":{"avgcount":38,"sum":0.200995377,"avgtime":0.005289352},"op_inflight":0,"oplen_avg":{"avgcount":38,"sum":60},"op":38,"op_r":0,"op_w":38,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":14,"omap_rd":0,"omap_del":1}} 2024-09-13T17:19:05.955 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 14, "op": 38, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 38, "avgtime": 0.005289352, "sum": 0.200995377 }, "op_pg": 0, "op_r": 0, "op_reply": 38, "op_resend": 33, "op_rmw": 0, "op_send": 38, "op_send_bytes": 11382, "op_w": 38, "oplen_avg": { "avgcount": 38, "sum": 60 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T17:19:05.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json export dir /bravo 1 2024-09-13T17:19:06.071 INFO:teuthology.orchestra.run.smithi005.stdout:{"return_code":0} 2024-09-13T17:19:06.071 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-09-13T17:19:06.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump objecter 2024-09-13T17:19:06.183 INFO:teuthology.orchestra.run.smithi179.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":38,"op_send_bytes":11382,"op_resend":33,"op_reply":38,"op_latency":{"avgcount":38,"sum":0.200995377,"avgtime":0.005289352},"op_inflight":0,"oplen_avg":{"avgcount":38,"sum":60},"op":38,"op_r":0,"op_w":38,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":14,"omap_rd":0,"omap_del":1}} 2024-09-13T17:19:06.184 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 14, "op": 38, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 38, "avgtime": 0.005289352, "sum": 0.200995377 }, "op_pg": 0, "op_r": 0, "op_reply": 38, "op_resend": 33, "op_rmw": 0, "op_send": 38, "op_send_bytes": 11382, "op_w": 38, "oplen_avg": { "avgcount": 38, "sum": 60 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T17:19:06.184 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-13T17:19:11.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump objecter 2024-09-13T17:19:11.310 INFO:teuthology.orchestra.run.smithi179.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":38,"op_send_bytes":11382,"op_resend":33,"op_reply":38,"op_latency":{"avgcount":38,"sum":0.200995377,"avgtime":0.005289352},"op_inflight":0,"oplen_avg":{"avgcount":38,"sum":60},"op":38,"op_r":0,"op_w":38,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":14,"omap_rd":0,"omap_del":1}} 2024-09-13T17:19:11.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 14, "op": 38, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 38, "avgtime": 0.005289352, "sum": 0.200995377 }, "op_pg": 0, "op_r": 0, "op_reply": 38, "op_resend": 33, "op_rmw": 0, "op_send": 38, "op_send_bytes": 11382, "op_w": 38, "oplen_avg": { "avgcount": 38, "sum": 60 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T17:19:11.311 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-13T17:19:13.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:13.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:16.313 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump objecter 2024-09-13T17:19:16.438 INFO:teuthology.orchestra.run.smithi179.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":40,"op_send_bytes":14994,"op_resend":33,"op_reply":40,"op_latency":{"avgcount":40,"sum":0.203995308,"avgtime":0.005099882},"op_inflight":0,"oplen_avg":{"avgcount":40,"sum":63},"op":40,"op_r":0,"op_w":40,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":3,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":0,"omap_del":1}} 2024-09-13T17:19:16.438 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 16, "op": 40, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 40, "avgtime": 0.005099882, "sum": 0.203995308 }, "op_pg": 0, "op_r": 0, "op_reply": 40, "op_resend": 33, "op_rmw": 0, "op_send": 40, "op_send_bytes": 14994, "op_w": 40, "oplen_avg": { "avgcount": 40, "sum": 63 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T17:19:16.439 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-13T17:19:21.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json perf dump objecter 2024-09-13T17:19:21.565 INFO:teuthology.orchestra.run.smithi179.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":15208,"op_resend":33,"op_reply":42,"op_latency":{"avgcount":42,"sum":0.206995239,"avgtime":0.004928458},"op_inflight":0,"oplen_avg":{"avgcount":42,"sum":66},"op":42,"op_r":0,"op_w":42,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":18,"omap_rd":0,"omap_del":1}} 2024-09-13T17:19:21.565 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 18, "op": 42, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 42, "avgtime": 0.004928458, "sum": 0.206995239 }, "op_pg": 0, "op_r": 0, "op_reply": 42, "op_resend": 33, "op_rmw": 0, "op_send": 42, "op_send_bytes": 15208, "op_w": 42, "oplen_avg": { "avgcount": 42, "sum": 66 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-13T17:19:21.566 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2024-09-13T17:19:21.566 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:21.566 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:21.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.738+0000 7f2d79890640 1 Processor -- start 2024-09-13T17:19:21.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.738+0000 7f2d79890640 1 -- start start 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d79890640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d740cedc0 0x7f2d740acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d79890640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d79890640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740701a0 con 0x7f2d741591e0 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d79890640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740ac3b0 con 0x7f2d740cedc0 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d79890640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740ad540 con 0x7f2d740abf40 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.739+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:40112/0 (socket says 172.21.15.5:40112) 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d737fe640 1 -- 172.21.15.5:0/3274134656 learned_addr learned my addr 172.21.15.5:0/3274134656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d727fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d740cedc0 0x7f2d740acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d72ffd640 1 --1- 172.21.15.5:0/3274134656 >> v1:172.21.15.179:6789/0 conn(0x7f2d741591e0 0x7f2d740ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:38468/0 (socket says 172.21.15.5:38468) 2024-09-13T17:19:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d727fc640 1 -- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 msgr2=0x7f2d74070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d727fc640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d727fc640 1 -- 172.21.15.5:0/3274134656 >> v1:172.21.15.179:6789/0 conn(0x7f2d741591e0 legacy=0x7f2d740ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d727fc640 1 -- 172.21.15.5:0/3274134656 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740ad820 con 0x7f2d740cedc0 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d71ffb640 1 -- 172.21.15.5:0/3274134656 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123912085 0 0) 0x7f2d740701a0 con 0x7f2d741591e0 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.740+0000 7f2d737fe640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d727fc640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740cedc0 0x7f2d740acf20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2d680097a0 tx=0x7f2d6802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bba5e716235cc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d71ffb640 1 -- 172.21.15.5:0/3274134656 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6802ae50 con 0x7f2d740cedc0 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d71ffb640 1 -- 172.21.15.5:0/3274134656 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d68032440 con 0x7f2d740cedc0 2024-09-13T17:19:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d71ffb640 1 -- 172.21.15.5:0/3274134656 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680327d0 con 0x7f2d740cedc0 2024-09-13T17:19:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 -- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740cedc0 msgr2=0x7f2d740acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740cedc0 0x7f2d740acf20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2d680097a0 tx=0x7f2d6802a100 comp rx=0 tx=0).stop 2024-09-13T17:19:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 -- 172.21.15.5:0/3274134656 shutdown_connections 2024-09-13T17:19:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740abf40 0x7f2d74070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 --2- 172.21.15.5:0/3274134656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740cedc0 0x7f2d740acf20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.741+0000 7f2d79890640 1 -- 172.21.15.5:0/3274134656 >> 172.21.15.5:0/3274134656 conn(0x7f2d7406a270 msgr2=0x7f2d7406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.742+0000 7f2d79890640 1 -- 172.21.15.5:0/3274134656 shutdown_connections 2024-09-13T17:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.742+0000 7f2d79890640 1 -- 172.21.15.5:0/3274134656 wait complete. 2024-09-13T17:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.743+0000 7f2d79890640 1 Processor -- start 2024-09-13T17:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.743+0000 7f2d79890640 1 -- start start 2024-09-13T17:19:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740abf40 0x7f2d741502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740cedc0 0x7f2d7415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7414f5a0 con 0x7f2d741591e0 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415c5e0 con 0x7f2d740abf40 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d79890640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7414f7f0 con 0x7f2d740cedc0 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50066/0 (socket says 172.21.15.5:50066) 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 -- 172.21.15.5:0/3461661411 learned_addr learned my addr 172.21.15.5:0/3461661411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d72ffd640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740abf40 0x7f2d741502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d727fc640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740cedc0 0x7f2d7415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 -- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740cedc0 msgr2=0x7f2d7415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740cedc0 0x7f2d7415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 -- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740abf40 msgr2=0x7f2d741502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740abf40 0x7f2d741502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 -- 172.21.15.5:0/3461661411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c00bd40 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.744+0000 7f2d737fe640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e340 tx=0x7f2d6c00e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.745+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c010040 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.745+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c00b2d0 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.745+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68009400 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.745+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00ee90 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.745+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7414fdb0 con 0x7f2d741591e0 2024-09-13T17:19:21.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.746+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74156440 con 0x7f2d741591e0 2024-09-13T17:19:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.746+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d6c009600 con 0x7f2d741591e0 2024-09-13T17:19:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.747+0000 7f2d5bfff640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 0x7f2d6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.747+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f2d6c0898b0 con 0x7f2d741591e0 2024-09-13T17:19:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.747+0000 7f2d72ffd640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 0x7f2d6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.747+0000 7f2d72ffd640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 0x7f2d6006d0c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d64007fd0 tx=0x7f2d64007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.751+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d6c0549c0 con 0x7f2d741591e0 2024-09-13T17:19:21.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.925+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d740acf20 con 0x7f2d741591e0 2024-09-13T17:19:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.926+0000 7f2d5bfff640 1 -- 172.21.15.5:0/3461661411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7f2d6c01a020 con 0x7f2d741591e0 2024-09-13T17:19:21.928 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:21.928 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 msgr2=0x7f2d6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 0x7f2d6006d0c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d64007fd0 tx=0x7f2d64007de0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 msgr2=0x7f2d74156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00e340 tx=0x7f2d6c00e800 comp rx=0 tx=0).stop 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 shutdown_connections 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2d6006ac00 0x7f2d6006d0c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d741591e0 0x7f2d74156ca0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d740cedc0 0x7f2d7415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 --2- 172.21.15.5:0/3461661411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d740abf40 0x7f2d741502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 >> 172.21.15.5:0/3461661411 conn(0x7f2d7406a270 msgr2=0x7f2d7406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 shutdown_connections 2024-09-13T17:19:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:21.928+0000 7f2d79890640 1 -- 172.21.15.5:0/3461661411 wait complete. 2024-09-13T17:19:21.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:19:21.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:19:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.045+0000 7f13ef496640 1 Processor -- start 2024-09-13T17:19:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.045+0000 7f13ef496640 1 -- start start 2024-09-13T17:19:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ef496640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ef496640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e8069e50 0x7f13e806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ef496640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e815a8a0 con 0x7f13e8071c40 2024-09-13T17:19:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ef496640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e806a820 con 0x7f13e8069e50 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ef496640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e815e060 con 0x7f13e815a4c0 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eda33640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e8069e50 0x7f13e806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eca31640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f13e8071c40 0x7f13e806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50532/0 (socket says 172.21.15.5:50532) 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eca31640 1 -- 172.21.15.5:0/1841676393 learned_addr learned my addr 172.21.15.5:0/1841676393 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ed232640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eda33640 1 -- 172.21.15.5:0/1841676393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 msgr2=0x7f13e80c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eda33640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eda33640 1 -- 172.21.15.5:0/1841676393 >> v1:172.21.15.5:6789/0 conn(0x7f13e8071c40 legacy=0x7f13e806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13eda33640 1 -- 172.21.15.5:0/1841676393 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e80723e0 con 0x7f13e8069e50 2024-09-13T17:19:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.046+0000 7f13ed232640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13eda33640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8069e50 0x7f13e806a2e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097a0 tx=0x7f13e002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f171aee6f87334 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13e7fff640 1 -- 172.21.15.5:0/1841676393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e002ae50 con 0x7f13e8069e50 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13e7fff640 1 -- 172.21.15.5:0/1841676393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0032440 con 0x7f13e8069e50 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13e7fff640 1 -- 172.21.15.5:0/1841676393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00327d0 con 0x7f13e8069e50 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13ef496640 1 -- 172.21.15.5:0/1841676393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8069e50 msgr2=0x7f13e806a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.047+0000 7f13ef496640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8069e50 0x7f13e806a2e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f13e00097a0 tx=0x7f13e002a100 comp rx=0 tx=0).stop 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 -- 172.21.15.5:0/1841676393 shutdown_connections 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8069e50 0x7f13e806a2e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 --2- 172.21.15.5:0/1841676393 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 -- 172.21.15.5:0/1841676393 >> 172.21.15.5:0/1841676393 conn(0x7f13e80ce380 msgr2=0x7f13e80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 -- 172.21.15.5:0/1841676393 shutdown_connections 2024-09-13T17:19:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.048+0000 7f13ef496640 1 -- 172.21.15.5:0/1841676393 wait complete. 2024-09-13T17:19:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.049+0000 7f13ef496640 1 Processor -- start 2024-09-13T17:19:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.049+0000 7f13ef496640 1 -- start start 2024-09-13T17:19:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13e8069e50 0x7f13e8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80c2c90 con 0x7f13e8071c40 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b3920 con 0x7f13e8069e50 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ef496640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b3bc0 con 0x7f13e815a4c0 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50082/0 (socket says 172.21.15.5:50082) 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 -- 172.21.15.5:0/1574700651 learned_addr learned my addr 172.21.15.5:0/1574700651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13ed232640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13e8069e50 0x7f13e8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eda33640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 -- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 msgr2=0x7f13e80acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 -- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13e8069e50 msgr2=0x7f13e8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13e8069e50 0x7f13e8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 -- 172.21.15.5:0/1574700651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0009400 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13eca31640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c4d0 tx=0x7f13dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.050+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc005ce0 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.051+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc005e40 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.051+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e80b3ea0 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.051+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc007290 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.051+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8157980 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.052+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e8157c00 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.052+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13dc0073f0 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.052+0000 7f13e5ffb640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 0x7f13d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.053+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f13dc088930 con 0x7f13e8071c40 2024-09-13T17:19:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.053+0000 7f13ed232640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 0x7f13d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.053+0000 7f13ed232640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 0x7f13d406d0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009fd0 tx=0x7f13d8009870 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.057+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13dc053a40 con 0x7f13e8071c40 2024-09-13T17:19:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.228+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13e80672b0 con 0x7f13e8071c40 2024-09-13T17:19:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.228+0000 7f13e5ffb640 1 -- 172.21.15.5:0/1574700651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13dc0170a0 con 0x7f13e8071c40 2024-09-13T17:19:22.231 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:19:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 msgr2=0x7f13d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 0x7f13d406d0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009fd0 tx=0x7f13d8009870 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 msgr2=0x7f13e80ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c4d0 tx=0x7f13dc00c990 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 shutdown_connections 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e815a4c0 0x7f13e80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f13d406ac00 0x7f13d406d0c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e8071c40 0x7f13e80ac5c0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 --2- 172.21.15.5:0/1574700651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13e8069e50 0x7f13e8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 >> 172.21.15.5:0/1574700651 conn(0x7f13e80ce380 msgr2=0x7f13e809b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 shutdown_connections 2024-09-13T17:19:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.230+0000 7f13ef496640 1 -- 172.21.15.5:0/1574700651 wait complete. 2024-09-13T17:19:22.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:19:22.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.348+0000 7f0b7759e640 1 Processor -- start 2024-09-13T17:19:22.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.348+0000 7f0b7759e640 1 -- start start 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b780cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7759e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7815cc60 con 0x7f0b7806bb80 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7759e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7806ef10 con 0x7f0b7815a060 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7815d800 con 0x7f0b780707a0 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b76d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b7806bb80 0x7f0b780ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50546/0 (socket says 172.21.15.5:50546) 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b76d9d640 1 -- 172.21.15.5:0/1132476026 learned_addr learned my addr 172.21.15.5:0/1132476026 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:22.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b780cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495944218 0 0) 0x7f0b7815cc60 con 0x7f0b7806bb80 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b60003520 con 0x7f0b7806bb80 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316153541 0 0) 0x7f0b7806ef10 con 0x7f0b7815a060 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7815cc60 con 0x7f0b7815a060 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206327495 0 0) 0x7f0b60003520 con 0x7f0b7806bb80 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 msgr2=0x7f0b780cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b780cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 >> v1:172.21.15.179:6789/0 conn(0x7f0b7815a060 legacy=0x7f0b7815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780cd090 con 0x7f0b7806bb80 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f0b700019f0 con 0x7f0b7806bb80 2024-09-13T17:19:22.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 >> v1:172.21.15.5:6789/0 conn(0x7f0b7806bb80 legacy=0x7f0b780ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b60003b30 0x7f0b60003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b600047c0 0x7f0b60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7815d800 con 0x7f0b600047c0 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6000ba30 con 0x7f0b60003b30 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.349+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6000bbf0 con 0x7f0b780707a0 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b600047c0 0x7f0b60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b7659c640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b60003b30 0x7f0b60003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b76d9d640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 -- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 msgr2=0x7f0b60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 -- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b60003b30 msgr2=0x7f0b60003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b60003b30 0x7f0b60003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b75d9b640 1 -- 172.21.15.5:0/1132476026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60003520 con 0x7f0b600047c0 2024-09-13T17:19:22.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.350+0000 7f0b76d9d640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b780707a0 0x7f0b60005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:22.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b600047c0 0x7f0b60004c40 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009a90 tx=0x7f0b600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccc1b2ac4e84137 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c031400 con 0x7f0b600047c0 2024-09-13T17:19:22.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c02d050 con 0x7f0b600047c0 2024-09-13T17:19:22.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7559a640 1 -- 172.21.15.5:0/1132476026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0317a0 con 0x7f0b600047c0 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 -- 172.21.15.5:0/1132476026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b600047c0 msgr2=0x7f0b60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 --2- 172.21.15.5:0/1132476026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b600047c0 0x7f0b60004c40 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009a90 tx=0x7f0b600057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b76d9d640 1 -- 172.21.15.5:0/1132476026 reap_dead start 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 -- 172.21.15.5:0/1132476026 shutdown_connections 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 -- 172.21.15.5:0/1132476026 >> 172.21.15.5:0/1132476026 conn(0x7f0b7806e140 msgr2=0x7f0b7806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 -- 172.21.15.5:0/1132476026 shutdown_connections 2024-09-13T17:19:22.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.351+0000 7f0b7759e640 1 -- 172.21.15.5:0/1132476026 wait complete. 2024-09-13T17:19:22.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.353+0000 7f0b7759e640 1 Processor -- start 2024-09-13T17:19:22.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.353+0000 7f0b7759e640 1 -- start start 2024-09-13T17:19:22.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b600047c0 0x7f0b781574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 0x7f0b78145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781579e0 con 0x7f0b78142780 2024-09-13T17:19:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78146080 con 0x7f0b600047c0 2024-09-13T17:19:22.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7815e030 con 0x7f0b7815e4c0 2024-09-13T17:19:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50102/0 (socket says 172.21.15.5:50102) 2024-09-13T17:19:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 -- 172.21.15.5:0/4182927931 learned_addr learned my addr 172.21.15.5:0/4182927931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 0x7f0b78145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7659c640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b600047c0 0x7f0b781574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 -- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 msgr2=0x7f0b78145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 0x7f0b78145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 -- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b600047c0 msgr2=0x7f0b781574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b600047c0 0x7f0b781574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 -- 172.21.15.5:0/4182927931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78157bd0 con 0x7f0b78142780 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b75d9b640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 0x7f0b78145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b76d9d640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0b7806acf0 tx=0x7f0b7000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000eb30 con 0x7f0b78142780 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000ecb0 con 0x7f0b78142780 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70013420 con 0x7f0b78142780 2024-09-13T17:19:22.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7815d9e0 con 0x7f0b78142780 2024-09-13T17:19:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.354+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7815e940 con 0x7f0b78142780 2024-09-13T17:19:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.355+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7815e1c0 con 0x7f0b78142780 2024-09-13T17:19:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.356+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b70013580 con 0x7f0b78142780 2024-09-13T17:19:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.356+0000 7f0b66ffd640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 0x7f0b5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.356+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f0b70089880 con 0x7f0b78142780 2024-09-13T17:19:22.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.356+0000 7f0b7659c640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 0x7f0b5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.357+0000 7f0b7659c640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 0x7f0b5806d0f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b781f56f0 tx=0x7f0b68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.360+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b70054850 con 0x7f0b78142780 2024-09-13T17:19:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.535+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b780cca00 con 0x7f0b78142780 2024-09-13T17:19:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.535+0000 7f0b66ffd640 1 -- 172.21.15.5:0/4182927931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b70057e70 con 0x7f0b78142780 2024-09-13T17:19:22.538 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 msgr2=0x7f0b5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 0x7f0b5806d0f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0b781f56f0 tx=0x7f0b68009040 comp rx=0 tx=0).stop 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 msgr2=0x7f0b780cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0b7806acf0 tx=0x7f0b7000e530 comp rx=0 tx=0).stop 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 shutdown_connections 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f0b5806ac30 0x7f0b5806d0f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b78142780 0x7f0b780cb540 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b7815e4c0 0x7f0b78145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 --2- 172.21.15.5:0/4182927931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b600047c0 0x7f0b781574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 >> 172.21.15.5:0/4182927931 conn(0x7f0b7806e140 msgr2=0x7f0b7806c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 shutdown_connections 2024-09-13T17:19:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.538+0000 7f0b7759e640 1 -- 172.21.15.5:0/4182927931 wait complete. 2024-09-13T17:19:22.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:19:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.653+0000 7fae612f7640 1 Processor -- start 2024-09-13T17:19:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.653+0000 7fae612f7640 1 -- start start 2024-09-13T17:19:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae612f7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae5c0cdb20 0x7fae5c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae612f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae612f7640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c06da10 con 0x7fae5c06d630 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae612f7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c0cd0d0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae612f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c072060 con 0x7fae5c0c87f0 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae5c0cdb20 0x7fae5c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c0c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:40176/0 (socket says 172.21.15.5:40176) 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae5c0cdb20 0x7fae5c06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:57248/0 (socket says 172.21.15.5:57248) 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5affd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fae5c06d630 0x7fae5c06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:38480/0 (socket says 172.21.15.5:38480) 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5b7fe640 1 -- 172.21.15.5:0/1211576535 learned_addr learned my addr 172.21.15.5:0/1211576535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 -- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 msgr2=0x7fae5c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 --2- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 -- 172.21.15.5:0/1211576535 >> v1:172.21.15.179:6789/0 conn(0x7fae5c06d630 legacy=0x7fae5c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.654+0000 7fae5a7fc640 1 -- 172.21.15.5:0/1211576535 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0cdf90 con 0x7fae5c0cdb20 2024-09-13T17:19:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.655+0000 7fae5a7fc640 1 --2- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c0cdb20 0x7fae5c06c730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d331cf578995540 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.655+0000 7fae59ffb640 1 -- 172.21.15.5:0/1211576535 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4402ae50 con 0x7fae5c0cdb20 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.655+0000 7fae59ffb640 1 -- 172.21.15.5:0/1211576535 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44032440 con 0x7fae5c0cdb20 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.655+0000 7fae59ffb640 1 -- 172.21.15.5:0/1211576535 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440327d0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 -- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c0cdb20 msgr2=0x7fae5c06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 --2- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c0cdb20 0x7fae5c06c730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fae440097a0 tx=0x7fae4402a100 comp rx=0 tx=0).stop 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 -- 172.21.15.5:0/1211576535 shutdown_connections 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 --2- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 --2- 172.21.15.5:0/1211576535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c0cdb20 0x7fae5c06c730 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 -- 172.21.15.5:0/1211576535 >> 172.21.15.5:0/1211576535 conn(0x7fae5c0ce380 msgr2=0x7fae5c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 -- 172.21.15.5:0/1211576535 shutdown_connections 2024-09-13T17:19:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.656+0000 7fae612f7640 1 -- 172.21.15.5:0/1211576535 wait complete. 2024-09-13T17:19:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.657+0000 7fae612f7640 1 Processor -- start 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.657+0000 7fae612f7640 1 -- start start 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c06d630 0x7fae5c1672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c167880 con 0x7fae5c0cdb20 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0b2f30 con 0x7fae5c06d630 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae612f7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c153300 con 0x7fae5c0c87f0 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50114/0 (socket says 172.21.15.5:50114) 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 -- 172.21.15.5:0/3868739403 learned_addr learned my addr 172.21.15.5:0/3868739403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5affd640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c06d630 0x7fae5c1672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5a7fc640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 -- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 msgr2=0x7fae5c1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 -- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c06d630 msgr2=0x7fae5c1672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c06d630 0x7fae5c1672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.658+0000 7fae5b7fe640 1 -- 172.21.15.5:0/3868739403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009400 con 0x7fae5c0cdb20 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae5b7fe640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fae5400efc0 tx=0x7fae5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400cd20 con 0x7fae5c0cdb20 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5400f040 con 0x7fae5c0cdb20 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c152d40 con 0x7fae5c0cdb20 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54003bd0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.659+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c0b3160 con 0x7fae5c0cdb20 2024-09-13T17:19:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.660+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c0b1b20 con 0x7fae5c0cdb20 2024-09-13T17:19:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.660+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae54003d30 con 0x7fae5c0cdb20 2024-09-13T17:19:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.661+0000 7fae537fe640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 0x7fae3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.661+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fae54089bd0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.661+0000 7fae5affd640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 0x7fae3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.662+0000 7fae5affd640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 0x7fae3c06d0c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f60 tx=0x7fae4c007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.665+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fae54054ba0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.835+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae5c06a910 con 0x7fae5c0cdb20 2024-09-13T17:19:22.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.836+0000 7fae537fe640 1 -- 172.21.15.5:0/3868739403 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae540581c0 con 0x7fae5c0cdb20 2024-09-13T17:19:22.838 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 msgr2=0x7fae3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 0x7fae3c06d0c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f60 tx=0x7fae4c007c20 comp rx=0 tx=0).stop 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 msgr2=0x7fae5c0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fae5400efc0 tx=0x7fae5400c490 comp rx=0 tx=0).stop 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 shutdown_connections 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fae3c06ac00 0x7fae3c06d0c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae5c0cdb20 0x7fae5c0b3680 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae5c0c87f0 0x7fae5c1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 --2- 172.21.15.5:0/3868739403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae5c06d630 0x7fae5c1672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 >> 172.21.15.5:0/3868739403 conn(0x7fae5c0ce380 msgr2=0x7fae5c0cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 shutdown_connections 2024-09-13T17:19:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.838+0000 7fae612f7640 1 -- 172.21.15.5:0/3868739403 wait complete. 2024-09-13T17:19:22.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:19:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 Processor -- start 2024-09-13T17:19:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 -- start start 2024-09-13T17:19:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 0x7f05240acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05240cedc0 0x7f0524070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240701a0 con 0x7f05240abf40 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240ac3b0 con 0x7f05240cedc0 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.952+0000 7f052a6b7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240ad540 con 0x7f05241591e0 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05240cedc0 0x7f0524070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05240cedc0 0x7f0524070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50122/0 (socket says 172.21.15.5:50122) 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 -- 172.21.15.5:0/919847208 learned_addr learned my addr 172.21.15.5:0/919847208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f05237fe640 1 --1- 172.21.15.5:0/919847208 >> v1:172.21.15.5:6789/0 conn(0x7f05240abf40 0x7f05240ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50560/0 (socket says 172.21.15.5:50560) 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0523fff640 1 --2- 172.21.15.5:0/919847208 >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 0x7f05240acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 -- 172.21.15.5:0/919847208 >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 msgr2=0x7f05240acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 --2- 172.21.15.5:0/919847208 >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 0x7f05240acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 -- 172.21.15.5:0/919847208 >> v1:172.21.15.5:6789/0 conn(0x7f05240abf40 legacy=0x7f05240ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0522ffd640 1 -- 172.21.15.5:0/919847208 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156966080 0 0) 0x7f05240701a0 con 0x7f05240abf40 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0528c54640 1 -- 172.21.15.5:0/919847208 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240ad820 con 0x7f05240cedc0 2024-09-13T17:19:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.953+0000 7f0523fff640 1 --2- 172.21.15.5:0/919847208 >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 0x7f05240acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f0528c54640 1 --2- 172.21.15.5:0/919847208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f0524070910 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f05240cf270 tx=0x7f051c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc11567ddfac24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f0522ffd640 1 -- 172.21.15.5:0/919847208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c031600 con 0x7f05240cedc0 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f0522ffd640 1 -- 172.21.15.5:0/919847208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c02d050 con 0x7f05240cedc0 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f0522ffd640 1 -- 172.21.15.5:0/919847208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c031980 con 0x7f05240cedc0 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 -- 172.21.15.5:0/919847208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 msgr2=0x7f0524070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 --2- 172.21.15.5:0/919847208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f0524070910 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f05240cf270 tx=0x7f051c02a6a0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 -- 172.21.15.5:0/919847208 shutdown_connections 2024-09-13T17:19:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 --2- 172.21.15.5:0/919847208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f0524070910 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 --2- 172.21.15.5:0/919847208 >> v2:172.21.15.179:3300/0 conn(0x7f05241591e0 0x7f05240acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 -- 172.21.15.5:0/919847208 >> 172.21.15.5:0/919847208 conn(0x7f052406a270 msgr2=0x7f052406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 -- 172.21.15.5:0/919847208 shutdown_connections 2024-09-13T17:19:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.954+0000 7f052a6b7640 1 -- 172.21.15.5:0/919847208 wait complete. 2024-09-13T17:19:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.955+0000 7f052a6b7640 1 Processor -- start 2024-09-13T17:19:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 -- start start 2024-09-13T17:19:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05240abf40 0x7f05241f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 0x7f052415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241f2d40 con 0x7f05240cedc0 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241f1d40 con 0x7f05241591e0 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.956+0000 7f052a6b7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052415b250 con 0x7f05240abf40 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50130/0 (socket says 172.21.15.5:50130) 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 -- 172.21.15.5:0/1116229001 learned_addr learned my addr 172.21.15.5:0/1116229001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0528c54640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 0x7f052415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0523fff640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05240abf40 0x7f05241f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 -- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05240abf40 msgr2=0x7f05241f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05240abf40 0x7f05241f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 -- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 msgr2=0x7f052415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 0x7f052415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 -- 172.21.15.5:0/1116229001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c009b30 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0528c54640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 0x7f052415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f05237fe640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f05180011e0 tx=0x7f051800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518006480 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05180065e0 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052415b530 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180049e0 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.957+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05241f22e0 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.958+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05240acf20 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.959+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0518004b40 con 0x7f05240cedc0 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.959+0000 7f0520ff9640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 0x7f051006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.959+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f0518088b50 con 0x7f05240cedc0 2024-09-13T17:19:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.959+0000 7f0523fff640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 0x7f051006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.960+0000 7f0523fff640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 0x7f051006d0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f051400a950 tx=0x7f0514008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:22.963+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0518053b20 con 0x7f05240cedc0 2024-09-13T17:19:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.144+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05240ce070 con 0x7f05240cedc0 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.144+0000 7f0520ff9640 1 -- 172.21.15.5:0/1116229001 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v113) v1 ==== 80+0+240 (secure 0 0 0) 0x7f0518017070 con 0x7f05240cedc0 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 msgr2=0x7f051006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 0x7f051006d0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f051400a950 tx=0x7f0514008040 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 msgr2=0x7f05240cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f05180011e0 tx=0x7f051800c9b0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 shutdown_connections 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05241591e0 0x7f052415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f051006ac00 0x7f051006d0c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05240cedc0 0x7f05240cce30 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 --2- 172.21.15.5:0/1116229001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05240abf40 0x7f05241f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 >> 172.21.15.5:0/1116229001 conn(0x7f052406a270 msgr2=0x7f05240708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 shutdown_connections 2024-09-13T17:19:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.146+0000 7f052a6b7640 1 -- 172.21.15.5:0/1116229001 wait complete. 2024-09-13T17:19:23.159 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:23.159 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:23.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.315+0000 7f54e3f08640 1 Processor -- start 2024-09-13T17:19:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.315+0000 7f54e3f08640 1 -- start start 2024-09-13T17:19:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e3f08640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54dc1548b0 0x7f54dc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e3f08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e3f08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc06c1a0 con 0x7f54dc15a930 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e3f08640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0cf060 con 0x7f54dc1548b0 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e3f08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc15ae60 con 0x7f54dc0ce6b0 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e1ca4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54dc1548b0 0x7f54dc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e14a3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f54dc15a930 0x7f54dc0ab480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50570/0 (socket says 172.21.15.5:50570) 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e14a3640 1 -- 172.21.15.5:0/647747015 learned_addr learned my addr 172.21.15.5:0/647747015 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e24a5640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e1ca4640 1 -- 172.21.15.5:0/647747015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 msgr2=0x7f54dc0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e1ca4640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc0ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e1ca4640 1 -- 172.21.15.5:0/647747015 >> v1:172.21.15.5:6789/0 conn(0x7f54dc15a930 legacy=0x7f54dc0ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e1ca4640 1 -- 172.21.15.5:0/647747015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc15b140 con 0x7f54dc1548b0 2024-09-13T17:19:23.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.316+0000 7f54e24a5640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc0ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.317+0000 7f54e1ca4640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc1548b0 0x7f54dc0706b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f54d80097a0 tx=0x7f54d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4eb1a93dab8466 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.317+0000 7f54e0ca2640 1 -- 172.21.15.5:0/647747015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8032440 con 0x7f54dc1548b0 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.317+0000 7f54e0ca2640 1 -- 172.21.15.5:0/647747015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d80325a0 con 0x7f54dc1548b0 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.317+0000 7f54e0ca2640 1 -- 172.21.15.5:0/647747015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8032930 con 0x7f54dc1548b0 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.317+0000 7f54e3f08640 1 -- 172.21.15.5:0/647747015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc1548b0 msgr2=0x7f54dc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc1548b0 0x7f54dc0706b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f54d80097a0 tx=0x7f54d802a180 comp rx=0 tx=0).stop 2024-09-13T17:19:23.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 -- 172.21.15.5:0/647747015 shutdown_connections 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc0ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 --2- 172.21.15.5:0/647747015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc1548b0 0x7f54dc0706b0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 -- 172.21.15.5:0/647747015 >> 172.21.15.5:0/647747015 conn(0x7f54dc06a270 msgr2=0x7f54dc06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 -- 172.21.15.5:0/647747015 shutdown_connections 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.318+0000 7f54e3f08640 1 -- 172.21.15.5:0/647747015 wait complete. 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.319+0000 7f54e3f08640 1 Processor -- start 2024-09-13T17:19:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.319+0000 7f54e3f08640 1 -- start start 2024-09-13T17:19:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc1548b0 0x7f54dc150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc14cdc0 con 0x7f54dc15a930 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc154ea0 con 0x7f54dc1548b0 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc14e530 con 0x7f54dc0ce6b0 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50148/0 (socket says 172.21.15.5:50148) 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 -- 172.21.15.5:0/936977381 learned_addr learned my addr 172.21.15.5:0/936977381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e1ca4640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e14a3640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc1548b0 0x7f54dc150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 -- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 msgr2=0x7f54dc14c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc14c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 -- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc1548b0 msgr2=0x7f54dc150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc1548b0 0x7f54dc150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 -- 172.21.15.5:0/936977381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8009400 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e24a5640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f54d400cd80 tx=0x7f54d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d400f680 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d400f800 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc09b7a0 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.320+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d400fbb0 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.321+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc09bd60 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.321+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc154c90 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.322+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54d400b040 con 0x7f54dc15a930 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.322+0000 7f54d27fc640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.323+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f54d4089df0 con 0x7f54dc15a930 2024-09-13T17:19:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.323+0000 7f54e1ca4640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.323+0000 7f54e1ca4640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 0x7f54c006d0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f54d8034000 tx=0x7f54d802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.327+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f54d4054f00 con 0x7f54dc15a930 2024-09-13T17:19:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.498+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54dc070fa0 con 0x7f54dc15a930 2024-09-13T17:19:23.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.499+0000 7f54d27fc640 1 -- 172.21.15.5:0/936977381 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7f54d4058520 con 0x7f54dc15a930 2024-09-13T17:19:23.501 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:23.501 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 msgr2=0x7f54c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 0x7f54c006d0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f54d8034000 tx=0x7f54d802e000 comp rx=0 tx=0).stop 2024-09-13T17:19:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 msgr2=0x7f54dc151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f54d400cd80 tx=0x7f54d400a650 comp rx=0 tx=0).stop 2024-09-13T17:19:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 shutdown_connections 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f54c006ac00 0x7f54c006d0c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc15a930 0x7f54dc151350 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc1548b0 0x7f54dc150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 --2- 172.21.15.5:0/936977381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54dc0ce6b0 0x7f54dc14c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 >> 172.21.15.5:0/936977381 conn(0x7f54dc06a270 msgr2=0x7f54dc0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 shutdown_connections 2024-09-13T17:19:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.501+0000 7f54e3f08640 1 -- 172.21.15.5:0/936977381 wait complete. 2024-09-13T17:19:23.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:19:23.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:19:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.616+0000 7f20dce5a640 1 Processor -- start 2024-09-13T17:19:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.616+0000 7f20dce5a640 1 -- start start 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20dce5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20d80cef70 0x7f20d80cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20dce5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80d0c40 con 0x7f20d815c770 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20dce5a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d806c110 con 0x7f20d80cd270 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20dce5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80cf920 con 0x7f20d80cef70 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20d5d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20d80cef70 0x7f20d80cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20d659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20d815c770 0x7f20d806b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58308/0 (socket says 172.21.15.5:58308) 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.617+0000 7f20d659c640 1 -- 172.21.15.5:0/1107869328 learned_addr learned my addr 172.21.15.5:0/1107869328 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.618+0000 7f20d5d9b640 1 -- 172.21.15.5:0/1107869328 >> v1:172.21.15.179:6789/0 conn(0x7f20d80cd270 legacy=0x7f20d80cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.618+0000 7f20d5d9b640 1 -- 172.21.15.5:0/1107869328 >> v1:172.21.15.5:6789/0 conn(0x7f20d815c770 legacy=0x7f20d806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.618+0000 7f20d5d9b640 1 -- 172.21.15.5:0/1107869328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d806c3f0 con 0x7f20d80cef70 2024-09-13T17:19:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.618+0000 7f20d559a640 1 -- 172.21.15.5:0/1107869328 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804517902 0 0) 0x7f20d80d0c40 con 0x7f20d815c770 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20d5d9b640 1 --2- 172.21.15.5:0/1107869328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cef70 0x7f20d80cf3e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009790 tx=0x7f20cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb217e0adb6df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20d559a640 1 -- 172.21.15.5:0/1107869328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc032440 con 0x7f20d80cef70 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20d559a640 1 -- 172.21.15.5:0/1107869328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc0325a0 con 0x7f20d80cef70 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20d559a640 1 -- 172.21.15.5:0/1107869328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc032930 con 0x7f20d80cef70 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 -- 172.21.15.5:0/1107869328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cef70 msgr2=0x7f20d80cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 --2- 172.21.15.5:0/1107869328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cef70 0x7f20d80cf3e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009790 tx=0x7f20cc02a1c0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 -- 172.21.15.5:0/1107869328 shutdown_connections 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 --2- 172.21.15.5:0/1107869328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cef70 0x7f20d80cf3e0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 -- 172.21.15.5:0/1107869328 >> 172.21.15.5:0/1107869328 conn(0x7f20d808bfb0 msgr2=0x7f20d809b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 -- 172.21.15.5:0/1107869328 shutdown_connections 2024-09-13T17:19:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.619+0000 7f20dce5a640 1 -- 172.21.15.5:0/1107869328 wait complete. 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 Processor -- start 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 -- start start 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 0x7f20d814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 0x7f20d80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80b5b40 con 0x7f20d80cd270 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80b4d70 con 0x7f20d80cef70 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20dce5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80b54c0 con 0x7f20d815c770 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.621+0000 7f20d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53546/0 (socket says 172.21.15.5:53546) 2024-09-13T17:19:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 -- 172.21.15.5:0/428111855 learned_addr learned my addr 172.21.15.5:0/428111855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d5d9b640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 0x7f20d814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d6d9d640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 0x7f20d80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 -- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 msgr2=0x7f20d80cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 0x7f20d80cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 -- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 msgr2=0x7f20d814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 0x7f20d814d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 -- 172.21.15.5:0/428111855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0093a0 con 0x7f20d80cd270 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d5d9b640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 0x7f20d814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d6d9d640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 0x7f20d80cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20d659c640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c7c0 tx=0x7f20c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800a640 con 0x7f20d80cd270 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800a7c0 con 0x7f20d80cd270 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800ab70 con 0x7f20d80cd270 2024-09-13T17:19:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d814d910 con 0x7f20d80cd270 2024-09-13T17:19:23.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.622+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d80b5760 con 0x7f20d80cd270 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.623+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d80b5db0 con 0x7f20d80cd270 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.624+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20c800acd0 con 0x7f20d80cd270 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.624+0000 7f20c6ffd640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 0x7f20b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.624+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f20c8088b50 con 0x7f20d80cd270 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.624+0000 7f20d5d9b640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 0x7f20b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.625+0000 7f20d5d9b640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 0x7f20b806d0c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f20cc034000 tx=0x7f20cc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.628+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f20c8053b10 con 0x7f20d80cd270 2024-09-13T17:19:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.800+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20d80cf3e0 con 0x7f20d80cd270 2024-09-13T17:19:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.800+0000 7f20c6ffd640 1 -- 172.21.15.5:0/428111855 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20c8018070 con 0x7f20d80cd270 2024-09-13T17:19:23.803 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:19:23.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 msgr2=0x7f20b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 0x7f20b806d0c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f20cc034000 tx=0x7f20cc02e000 comp rx=0 tx=0).stop 2024-09-13T17:19:23.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 msgr2=0x7f20d80b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c7c0 tx=0x7f20c800cc80 comp rx=0 tx=0).stop 2024-09-13T17:19:23.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 shutdown_connections 2024-09-13T17:19:23.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d815c770 0x7f20d80cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d80cef70 0x7f20d814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f20b806ac00 0x7f20b806d0c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 --2- 172.21.15.5:0/428111855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d80cd270 0x7f20d80b5f60 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 >> 172.21.15.5:0/428111855 conn(0x7f20d808bfb0 msgr2=0x7f20d815ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 shutdown_connections 2024-09-13T17:19:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.802+0000 7f20dce5a640 1 -- 172.21.15.5:0/428111855 wait complete. 2024-09-13T17:19:23.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:19:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.919+0000 7f2617a96640 1 Processor -- start 2024-09-13T17:19:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.919+0000 7f2617a96640 1 -- start start 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2617a96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 0x7f26100c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2617a96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100c8e50 con 0x7f2610070be0 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2617a96640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2610159db0 con 0x7f26101595d0 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2617a96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100c9420 con 0x7f26101591f0 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2616033640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2610070be0 0x7f261006d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58324/0 (socket says 172.21.15.5:58324) 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2616033640 1 -- 172.21.15.5:0/1961260256 learned_addr learned my addr 172.21.15.5:0/1961260256 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2615832640 1 --2- 172.21.15.5:0/1961260256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 0x7f26100c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041218266 0 0) 0x7f26100c8e50 con 0x7f2610070be0 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.920+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25fc005730 con 0x7f2610070be0 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553348311 0 0) 0x7f2610159db0 con 0x7f26101595d0 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26100c8e50 con 0x7f26101595d0 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 673525570 0 0) 0x7f25fc005730 con 0x7f2610070be0 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2615832640 1 -- 172.21.15.5:0/1961260256 >> v1:172.21.15.179:6789/0 conn(0x7f26101595d0 legacy=0x7f261015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2615832640 1 -- 172.21.15.5:0/1961260256 >> v1:172.21.15.5:6789/0 conn(0x7f2610070be0 legacy=0x7f261006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2615832640 1 -- 172.21.15.5:0/1961260256 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261015a090 con 0x7f26101591f0 2024-09-13T17:19:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.921+0000 7f2615832640 1 --2- 172.21.15.5:0/1961260256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 0x7f26100c8910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f260c0097d0 tx=0x7f260c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a498aa11b32ad395 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608001970 con 0x7f26101591f0 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c02ac30 con 0x7f26101591f0 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2614830640 1 -- 172.21.15.5:0/1961260256 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c032440 con 0x7f26101591f0 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 -- 172.21.15.5:0/1961260256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 msgr2=0x7f26100c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 --2- 172.21.15.5:0/1961260256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 0x7f26100c8910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f260c0097d0 tx=0x7f260c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 -- 172.21.15.5:0/1961260256 shutdown_connections 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 --2- 172.21.15.5:0/1961260256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101591f0 0x7f26100c8910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 -- 172.21.15.5:0/1961260256 >> 172.21.15.5:0/1961260256 conn(0x7f26100ce380 msgr2=0x7f26100ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 -- 172.21.15.5:0/1961260256 shutdown_connections 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.922+0000 7f2617a96640 1 -- 172.21.15.5:0/1961260256 wait complete. 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.923+0000 7f2617a96640 1 Processor -- start 2024-09-13T17:19:23.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 -- start start 2024-09-13T17:19:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26101591f0 0x7f26100acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 0x7f26100c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101553b0 con 0x7f2610070be0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100abfd0 con 0x7f26101591f0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2617a96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2610155600 con 0x7f26101595d0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2615832640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2615832640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53556/0 (socket says 172.21.15.5:53556) 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2615832640 1 -- 172.21.15.5:0/138982660 learned_addr learned my addr 172.21.15.5:0/138982660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.924+0000 7f2616033640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 0x7f26100c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615031640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26101591f0 0x7f26100acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 -- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 msgr2=0x7f26100c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 0x7f26100c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 -- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26101591f0 msgr2=0x7f26100acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26101591f0 0x7f26100acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 -- 172.21.15.5:0/138982660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009400 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2616033640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 0x7f26100c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2615832640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f260c035040 tx=0x7f260c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c03c670 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c03c7d0 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26101558e0 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c03cb80 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.925+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2610155ea0 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.926+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26100672d0 con 0x7f2610070be0 2024-09-13T17:19:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.927+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f260c039040 con 0x7f2610070be0 2024-09-13T17:19:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.927+0000 7f26067fc640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 0x7f25f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.927+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f260c0a9e50 con 0x7f2610070be0 2024-09-13T17:19:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.927+0000 7f2615031640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 0x7f25f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.928+0000 7f2615031640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 0x7f25f406d0f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f26101f1850 tx=0x7f2600009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:23.931+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f260c074e20 con 0x7f2610070be0 2024-09-13T17:19:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.103+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26100ca800 con 0x7f2610070be0 2024-09-13T17:19:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.104+0000 7f26067fc640 1 -- 172.21.15.5:0/138982660 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f260c006e10 con 0x7f2610070be0 2024-09-13T17:19:24.106 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:19:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 msgr2=0x7f25f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 0x7f25f406d0f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f26101f1850 tx=0x7f2600009040 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 msgr2=0x7f26101566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f260c035040 tx=0x7f260c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 shutdown_connections 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26101595d0 0x7f26100c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26101591f0 0x7f26100acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f25f406ac30 0x7f25f406d0f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 --2- 172.21.15.5:0/138982660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610070be0 0x7f26101566a0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 >> 172.21.15.5:0/138982660 conn(0x7f26100ce380 msgr2=0x7f26100cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 shutdown_connections 2024-09-13T17:19:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.106+0000 7f2617a96640 1 -- 172.21.15.5:0/138982660 wait complete. 2024-09-13T17:19:24.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:19:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.222+0000 7f8f32d08640 1 Processor -- start 2024-09-13T17:19:24.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.222+0000 7f8f32d08640 1 -- start start 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f32d08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f2c071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f32d08640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c15a8a0 con 0x7f8f2c069e50 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f32d08640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c072180 con 0x7f8f2c15a4c0 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f32d08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15e060 con 0x7f8f2c0c9270 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f312a5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f2c069e50 0x7f8f2c15e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58336/0 (socket says 172.21.15.5:58336) 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f312a5640 1 -- 172.21.15.5:0/591240805 learned_addr learned my addr 172.21.15.5:0/591240805 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f23fff640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f2c071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553712907 0 0) 0x7f8f2c15a8a0 con 0x7f8f2c069e50 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f14003520 con 0x7f8f2c069e50 2024-09-13T17:19:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498369382 0 0) 0x7f8f14003520 con 0x7f8f2c069e50 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 msgr2=0x7f8f2c071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f2c071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 >> v1:172.21.15.179:6789/0 conn(0x7f8f2c15a4c0 legacy=0x7f8f2c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0723e0 con 0x7f8f2c069e50 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f8f24001a10 con 0x7f8f2c069e50 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.223+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 >> v1:172.21.15.5:6789/0 conn(0x7f8f2c069e50 legacy=0x7f8f2c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f140039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f14003f40 0x7f8f140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15e060 con 0x7f8f14004d00 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1400bb40 con 0x7f8f14003f40 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1400bd00 con 0x7f8f2c0c9270 2024-09-13T17:19:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f30aa4640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f140039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f23fff640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f14003f40 0x7f8f140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 -- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 msgr2=0x7f8f140039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0c9270 0x7f8f140039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 -- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f14003f40 msgr2=0x7f8f140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f14003f40 0x7f8f140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f312a5640 1 -- 172.21.15.5:0/591240805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14003520 con 0x7f8f14004d00 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.224+0000 7f8f23fff640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f14003f40 0x7f8f140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f312a5640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f14005180 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0adc30 tx=0x7f8f140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1e5ff5ec1fe52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2402ba10 con 0x7f8f14004d00 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2402bb70 con 0x7f8f14004d00 2024-09-13T17:19:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f237fe640 1 -- 172.21.15.5:0/591240805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24034470 con 0x7f8f14004d00 2024-09-13T17:19:24.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 -- 172.21.15.5:0/591240805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 msgr2=0x7f8f14005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 --2- 172.21.15.5:0/591240805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f14005180 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0adc30 tx=0x7f8f140057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f312a5640 1 -- 172.21.15.5:0/591240805 reap_dead start 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 -- 172.21.15.5:0/591240805 shutdown_connections 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 -- 172.21.15.5:0/591240805 >> 172.21.15.5:0/591240805 conn(0x7f8f2c0ce380 msgr2=0x7f8f2c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 -- 172.21.15.5:0/591240805 shutdown_connections 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.225+0000 7f8f32d08640 1 -- 172.21.15.5:0/591240805 wait complete. 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 Processor -- start 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 -- start start 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0b1330 0x7f8f2c15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0b3840 0x7f8f2c0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15ccc0 con 0x7f8f14004d00 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c1730 con 0x7f8f2c0b1330 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.227+0000 7f8f32d08640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0c1170 con 0x7f8f2c0b3840 2024-09-13T17:19:24.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53576/0 (socket says 172.21.15.5:53576) 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 -- 172.21.15.5:0/2483410042 learned_addr learned my addr 172.21.15.5:0/2483410042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f23fff640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0b1330 0x7f8f2c15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f312a5640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0b3840 0x7f8f2c0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 -- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0b3840 msgr2=0x7f8f2c0ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0b3840 0x7f8f2c0ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 -- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0b1330 msgr2=0x7f8f2c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0b1330 0x7f8f2c15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 -- 172.21.15.5:0/2483410042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0c1450 con 0x7f8f14004d00 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f30aa4640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800f820 tx=0x7f8f2800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280050d0 con 0x7f8f14004d00 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28005230 con 0x7f8f14004d00 2024-09-13T17:19:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c0b3e00 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800d730 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.228+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c15aa60 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.229+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0672d0 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.230+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f2800d890 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.230+0000 7f8f217fa640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 0x7f8f1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.230+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f8f280894f0 con 0x7f8f14004d00 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.230+0000 7f8f23fff640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 0x7f8f1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.231+0000 7f8f23fff640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 0x7f8f1806d0c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0c4f70 tx=0x7f8f1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.234+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f280544c0 con 0x7f8f14004d00 2024-09-13T17:19:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.403+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f2c0706a0 con 0x7f8f14004d00 2024-09-13T17:19:24.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.404+0000 7f8f217fa640 1 -- 172.21.15.5:0/2483410042 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f28057ae0 con 0x7f8f14004d00 2024-09-13T17:19:24.407 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:19:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 msgr2=0x7f8f1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 0x7f8f1806d0c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0c4f70 tx=0x7f8f1c008040 comp rx=0 tx=0).stop 2024-09-13T17:19:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 msgr2=0x7f8f2c151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800f820 tx=0x7f8f2800fce0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 shutdown_connections 2024-09-13T17:19:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f2c0b3840 0x7f8f2c0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f2c0b1330 0x7f8f2c15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8f1806ac00 0x7f8f1806d0c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 --2- 172.21.15.5:0/2483410042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f14004d00 0x7f8f2c151200 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 >> 172.21.15.5:0/2483410042 conn(0x7f8f2c0ce380 msgr2=0x7f8f2c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 shutdown_connections 2024-09-13T17:19:24.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.406+0000 7f8f32d08640 1 -- 172.21.15.5:0/2483410042 wait complete. 2024-09-13T17:19:24.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:19:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.521+0000 7fa7205b5640 1 Processor -- start 2024-09-13T17:19:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.521+0000 7fa7205b5640 1 -- start start 2024-09-13T17:19:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa7205b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa71815fc50 0x7fa71815d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa7205b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa71815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa7205b5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa718156ff0 con 0x7fa7180b1c60 2024-09-13T17:19:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa7205b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71815da80 con 0x7fa71815fc50 2024-09-13T17:19:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa7205b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806e8b0 con 0x7fa71806e330 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71eb52640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7180b1c60 0x7fa71806acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58342/0 (socket says 172.21.15.5:58342) 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71eb52640 1 -- 172.21.15.5:0/1373396620 learned_addr learned my addr 172.21.15.5:0/1373396620 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71db50640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa71815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71e351640 1 --2- 172.21.15.5:0/1373396620 >> v2:172.21.15.179:3300/0 conn(0x7fa71815fc50 0x7fa71815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741100386 0 0) 0x7fa718156ff0 con 0x7fa7180b1c60 2024-09-13T17:19:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa704003520 con 0x7fa7180b1c60 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4082913650 0 0) 0x7fa704003520 con 0x7fa7180b1c60 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 msgr2=0x7fa71815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa71815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 >> v2:172.21.15.179:3300/0 conn(0x7fa71815fc50 msgr2=0x7fa71815d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 --2- 172.21.15.5:0/1373396620 >> v2:172.21.15.179:3300/0 conn(0x7fa71815fc50 0x7fa71815d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718069ef0 con 0x7fa7180b1c60 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fa710001690 con 0x7fa7180b1c60 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.522+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 >> v1:172.21.15.5:6789/0 conn(0x7fa7180b1c60 legacy=0x7fa71806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa704003970 0x7fa704003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7040047c0 0x7fa704004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa704005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71815da80 con 0x7fa7040047c0 2024-09-13T17:19:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806e8b0 con 0x7fa704003970 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70400b980 con 0x7fa71806e330 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7040047c0 0x7fa704004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71eb52640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa704005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71e351640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa704003970 0x7fa704003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 -- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 msgr2=0x7fa704005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa71806e330 0x7fa704005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 -- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa704003970 msgr2=0x7fa704003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa704003970 0x7fa704003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.523+0000 7fa71db50640 1 -- 172.21.15.5:0/1373396620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704003520 con 0x7fa7040047c0 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa71db50640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7040047c0 0x7fa704004c40 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fa708009a90 tx=0x7fa7040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb0d5c53ca9689 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708031400 con 0x7fa7040047c0 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70802d050 con 0x7fa7040047c0 2024-09-13T17:19:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa71d34f640 1 -- 172.21.15.5:0/1373396620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080317a0 con 0x7fa7040047c0 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa7205b5640 1 -- 172.21.15.5:0/1373396620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7040047c0 msgr2=0x7fa704004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa7205b5640 1 --2- 172.21.15.5:0/1373396620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7040047c0 0x7fa704004c40 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fa708009a90 tx=0x7fa7040057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa71eb52640 1 -- 172.21.15.5:0/1373396620 reap_dead start 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa7205b5640 1 -- 172.21.15.5:0/1373396620 shutdown_connections 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.524+0000 7fa7205b5640 1 -- 172.21.15.5:0/1373396620 >> 172.21.15.5:0/1373396620 conn(0x7fa7180cebb0 msgr2=0x7fa7180cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.525+0000 7fa7205b5640 1 -- 172.21.15.5:0/1373396620 shutdown_connections 2024-09-13T17:19:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.525+0000 7fa7205b5640 1 -- 172.21.15.5:0/1373396620 wait complete. 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.526+0000 7fa7205b5640 1 Processor -- start 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.526+0000 7fa7205b5640 1 -- start start 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.526+0000 7fa7205b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040047c0 0x7fa718154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.526+0000 7fa7205b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7181f1d40 0x7fa718159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.526+0000 7fa7205b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa7205b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181f2240 con 0x7fa71815a060 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa7205b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181f2520 con 0x7fa7181f1d40 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa7205b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181f2800 con 0x7fa7040047c0 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53590/0 (socket says 172.21.15.5:53590) 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 -- 172.21.15.5:0/814411903 learned_addr learned my addr 172.21.15.5:0/814411903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71db50640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7181f1d40 0x7fa718159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71e351640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040047c0 0x7fa718154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 -- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040047c0 msgr2=0x7fa718154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040047c0 0x7fa718154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 -- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7181f1d40 msgr2=0x7fa718159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7181f1d40 0x7fa718159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 -- 172.21.15.5:0/814411903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7181f2ae0 con 0x7fa71815a060 2024-09-13T17:19:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa71eb52640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa710001cf0 tx=0x7fa710007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710001690 con 0x7fa71815a060 2024-09-13T17:19:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71000f910 con 0x7fa71815a060 2024-09-13T17:19:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa718155e50 con 0x7fa71815a060 2024-09-13T17:19:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000fca0 con 0x7fa71815a060 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.527+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7180abdb0 con 0x7fa71815a060 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.528+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71815d540 con 0x7fa71815a060 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.529+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa71001d460 con 0x7fa71815a060 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.529+0000 7fa70effd640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 0x7fa6fc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.529+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fa710089260 con 0x7fa71815a060 2024-09-13T17:19:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.530+0000 7fa71e351640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 0x7fa6fc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:24.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.530+0000 7fa71e351640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 0x7fa6fc06d110 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa714014450 tx=0x7fa71400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:24.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.534+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa710054450 con 0x7fa71815a060 2024-09-13T17:19:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.717+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7180cf130 con 0x7fa71815a060 2024-09-13T17:19:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.717+0000 7fa70effd640 1 -- 172.21.15.5:0/814411903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v113) v1 ==== 80+0+240 (secure 0 0 0) 0x7fa710057a70 con 0x7fa71815a060 2024-09-13T17:19:24.720 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:24.721 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:24.721 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:24.721 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2024-09-13T17:19:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 msgr2=0x7fa6fc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 0x7fa6fc06d110 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa714014450 tx=0x7fa71400b040 comp rx=0 tx=0).stop 2024-09-13T17:19:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 msgr2=0x7fa718155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa710001cf0 tx=0x7fa710007720 comp rx=0 tx=0).stop 2024-09-13T17:19:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 shutdown_connections 2024-09-13T17:19:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa6fc06ac50 0x7fa6fc06d110 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa71815a060 0x7fa718155910 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7181f1d40 0x7fa718159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 --2- 172.21.15.5:0/814411903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7040047c0 0x7fa718154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 >> 172.21.15.5:0/814411903 conn(0x7fa7180cebb0 msgr2=0x7fa71815cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 shutdown_connections 2024-09-13T17:19:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:24.719+0000 7fa7205b5640 1 -- 172.21.15.5:0/814411903 wait complete. 2024-09-13T17:19:24.731 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-13T17:19:24.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:24.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:19:24.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[75130]: fuse finished with error 0 and tester_r 0 2024-09-13T17:19:24.759 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:19:30.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:19:30.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:30.861 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:19:30.882 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:30.882 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:30.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:31.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.034+0000 7f4459de2640 1 Processor -- start 2024-09-13T17:19:31.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.034+0000 7f4459de2640 1 -- start start 2024-09-13T17:19:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4459de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 0x7f44540706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4459de2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 0x7f44540ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4459de2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445406c1a0 con 0x7f44540ab9c0 2024-09-13T17:19:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4459de2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445415ae60 con 0x7f445415a930 2024-09-13T17:19:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4459de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445415b140 con 0x7f44541548b0 2024-09-13T17:19:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4453fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f44540ab9c0 0x7f44540ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58348/0 (socket says 172.21.15.5:58348) 2024-09-13T17:19:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4453fff640 1 -- 172.21.15.5:0/762097691 learned_addr learned my addr 172.21.15.5:0/762097691 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44537fe640 1 --2- 172.21.15.5:0/762097691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 0x7f44540706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4452ffd640 1 --2- 172.21.15.5:0/762097691 >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 0x7f44540ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058752025 0 0) 0x7f445406c1a0 con 0x7f44540ab9c0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c003520 con 0x7f44540ab9c0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44537fe640 1 -- 172.21.15.5:0/762097691 >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 msgr2=0x7f44540ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44537fe640 1 --2- 172.21.15.5:0/762097691 >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 0x7f44540ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44537fe640 1 -- 172.21.15.5:0/762097691 >> v1:172.21.15.5:6789/0 conn(0x7f44540ab9c0 legacy=0x7f44540ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 39591330 0 0) 0x7f443c003520 con 0x7f44540ab9c0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f44537fe640 1 -- 172.21.15.5:0/762097691 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445415b420 con 0x7f44541548b0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.035+0000 7f4452ffd640 1 --2- 172.21.15.5:0/762097691 >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 0x7f44540ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.036+0000 7f44537fe640 1 --2- 172.21.15.5:0/762097691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 0x7f44540706b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f444402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa964614354f39f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.036+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0019f0 con 0x7f44541548b0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.036+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444402aba0 con 0x7f44541548b0 2024-09-13T17:19:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.036+0000 7f44527fc640 1 -- 172.21.15.5:0/762097691 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444032440 con 0x7f44541548b0 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 -- 172.21.15.5:0/762097691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 msgr2=0x7f44540706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 --2- 172.21.15.5:0/762097691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 0x7f44540706b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44440097a0 tx=0x7f444402a110 comp rx=0 tx=0).stop 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 -- 172.21.15.5:0/762097691 shutdown_connections 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 --2- 172.21.15.5:0/762097691 >> v2:172.21.15.179:3300/0 conn(0x7f445415a930 0x7f44540ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 --2- 172.21.15.5:0/762097691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44541548b0 0x7f44540706b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 -- 172.21.15.5:0/762097691 >> 172.21.15.5:0/762097691 conn(0x7f445406a270 msgr2=0x7f445406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 -- 172.21.15.5:0/762097691 shutdown_connections 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.037+0000 7f4459de2640 1 -- 172.21.15.5:0/762097691 wait complete. 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.038+0000 7f4459de2640 1 Processor -- start 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 -- start start 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ab9c0 0x7f4454149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445415a930 0x7f445414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540aeb80 con 0x7f44541548b0 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44541516e0 con 0x7f44540ab9c0 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4459de2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4454148970 con 0x7f445415a930 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4452ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4452ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53606/0 (socket says 172.21.15.5:53606) 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.039+0000 7f4452ffd640 1 -- 172.21.15.5:0/4225473639 learned_addr learned my addr 172.21.15.5:0/4225473639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4453fff640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445415a930 0x7f445414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f44537fe640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ab9c0 0x7f4454149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 -- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445415a930 msgr2=0x7f445414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445415a930 0x7f445414c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 -- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ab9c0 msgr2=0x7f4454149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ab9c0 0x7f4454149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 -- 172.21.15.5:0/4225473639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448009400 con 0x7f44541548b0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4452ffd640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f444800e910 tx=0x7f444800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800ca00 con 0x7f44541548b0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800cb60 con 0x7f44541548b0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4444009400 con 0x7f44541548b0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448013470 con 0x7f44541548b0 2024-09-13T17:19:31.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.040+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540ae0a0 con 0x7f44541548b0 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.041+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44540adf00 con 0x7f44541548b0 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.042+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44480135d0 con 0x7f44541548b0 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.042+0000 7f443bfff640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 0x7f444006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.042+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4448089830 con 0x7f44541548b0 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.042+0000 7f44537fe640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 0x7f444006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.043+0000 7f44537fe640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 0x7f444006d0c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4444034000 tx=0x7f444402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.047+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f44540adf00 con 0x7f44541548b0 2024-09-13T17:19:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.218+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44540adf00 con 0x7f44541548b0 2024-09-13T17:19:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.219+0000 7f443bfff640 1 -- 172.21.15.5:0/4225473639 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7f44540adf00 con 0x7f44541548b0 2024-09-13T17:19:31.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:31.222 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 msgr2=0x7f444006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 0x7f444006d0c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4444034000 tx=0x7f444402e000 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 msgr2=0x7f4454148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f444800e910 tx=0x7f444800edd0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 shutdown_connections 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445415a930 0x7f445414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f444006ac00 0x7f444006d0c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44541548b0 0x7f4454148430 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 --2- 172.21.15.5:0/4225473639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44540ab9c0 0x7f4454149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 >> 172.21.15.5:0/4225473639 conn(0x7f445406a270 msgr2=0x7f4454149000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 shutdown_connections 2024-09-13T17:19:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.221+0000 7f4459de2640 1 -- 172.21.15.5:0/4225473639 wait complete. 2024-09-13T17:19:31.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:19:31.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:19:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.338+0000 7f18ae383640 1 Processor -- start 2024-09-13T17:19:31.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.338+0000 7f18ae383640 1 -- start start 2024-09-13T17:19:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a815a4c0 0x7f18a80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a8071c40 0x7f18a806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18a8069e50 0x7f18a806a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a806a820 con 0x7f18a8071c40 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a815e060 con 0x7f18a8069e50 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ae383640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80c97b0 con 0x7f18a815a4c0 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a8071c40 0x7f18a806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a8071c40 0x7f18a806c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53612/0 (socket says 172.21.15.5:53612) 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 -- 172.21.15.5:0/3322341868 learned_addr learned my addr 172.21.15.5:0/3322341868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18ac920640 1 --2- 172.21.15.5:0/3322341868 >> v2:172.21.15.179:3300/0 conn(0x7f18a8069e50 0x7f18a806a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a7fff640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a815a4c0 0x7f18a80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 -- 172.21.15.5:0/3322341868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a815a4c0 msgr2=0x7f18a80c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a815a4c0 0x7f18a80c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 -- 172.21.15.5:0/3322341868 >> v2:172.21.15.179:3300/0 conn(0x7f18a8069e50 msgr2=0x7f18a806a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 --2- 172.21.15.5:0/3322341868 >> v2:172.21.15.179:3300/0 conn(0x7f18a8069e50 0x7f18a806a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.339+0000 7f18a77fe640 1 -- 172.21.15.5:0/3322341868 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a815a8a0 con 0x7f18a8071c40 2024-09-13T17:19:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.340+0000 7f18a77fe640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a8071c40 0x7f18a806c020 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f18a806d550 tx=0x7f189c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37450887cd52cb4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.340+0000 7f18a6ffd640 1 -- 172.21.15.5:0/3322341868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c02ae90 con 0x7f18a8071c40 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.340+0000 7f18a6ffd640 1 -- 172.21.15.5:0/3322341868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c032440 con 0x7f18a8071c40 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.340+0000 7f18a6ffd640 1 -- 172.21.15.5:0/3322341868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c0327d0 con 0x7f18a8071c40 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 -- 172.21.15.5:0/3322341868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a8071c40 msgr2=0x7f18a806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a8071c40 0x7f18a806c020 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f18a806d550 tx=0x7f189c02a140 comp rx=0 tx=0).stop 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 -- 172.21.15.5:0/3322341868 shutdown_connections 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 --2- 172.21.15.5:0/3322341868 >> v2:172.21.15.179:3300/0 conn(0x7f18a8069e50 0x7f18a806a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a8071c40 0x7f18a806c020 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 --2- 172.21.15.5:0/3322341868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a815a4c0 0x7f18a80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 -- 172.21.15.5:0/3322341868 >> 172.21.15.5:0/3322341868 conn(0x7f18a80ce380 msgr2=0x7f18a80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 -- 172.21.15.5:0/3322341868 shutdown_connections 2024-09-13T17:19:31.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.341+0000 7f18ae383640 1 -- 172.21.15.5:0/3322341868 wait complete. 2024-09-13T17:19:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.342+0000 7f18ae383640 1 Processor -- start 2024-09-13T17:19:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.342+0000 7f18ae383640 1 -- start start 2024-09-13T17:19:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a8069e50 0x7f18a80b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a8071c40 0x7f18a80b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b39c0 con 0x7f18a815a4c0 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80995b0 con 0x7f18a8071c40 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ae383640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8098c10 con 0x7f18a8069e50 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53622/0 (socket says 172.21.15.5:53622) 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 -- 172.21.15.5:0/3317700515 learned_addr learned my addr 172.21.15.5:0/3317700515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18a7fff640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a8069e50 0x7f18a80b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18a77fe640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a8071c40 0x7f18a80b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 -- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a8069e50 msgr2=0x7f18a80b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a8069e50 0x7f18a80b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 -- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a8071c40 msgr2=0x7f18a80b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.343+0000 7f18ac920640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a8071c40 0x7f18a80b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18ac920640 1 -- 172.21.15.5:0/3317700515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c0094d0 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18ac920640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dd0 tx=0x7f18a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0014480 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a000f040 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a8098ef0 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0014840 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.344+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a80b36b0 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.345+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80672d0 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.345+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18a00149a0 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.346+0000 7f18a4ff9640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.346+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f18a0089f70 con 0x7f18a815a4c0 2024-09-13T17:19:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.346+0000 7f18a7fff640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.347+0000 7f18a7fff640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 0x7f189406d0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f18a80c96a0 tx=0x7f1898009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.350+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18a00bd9c0 con 0x7f18a815a4c0 2024-09-13T17:19:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.524+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18a80ce760 con 0x7f18a815a4c0 2024-09-13T17:19:31.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.524+0000 7f18a4ff9640 1 -- 172.21.15.5:0/3317700515 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18a0055080 con 0x7f18a815a4c0 2024-09-13T17:19:31.526 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 msgr2=0x7f189406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 0x7f189406d0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f18a80c96a0 tx=0x7f1898009190 comp rx=0 tx=0).stop 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 msgr2=0x7f18a80c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009dd0 tx=0x7f18a000c490 comp rx=0 tx=0).stop 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 shutdown_connections 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a815a4c0 0x7f18a80c5f80 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18a8071c40 0x7f18a80b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 --2- 172.21.15.5:0/3317700515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18a8069e50 0x7f18a80b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 >> 172.21.15.5:0/3317700515 conn(0x7f18a80ce380 msgr2=0x7f18a80ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 shutdown_connections 2024-09-13T17:19:31.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.526+0000 7f18ae383640 1 -- 172.21.15.5:0/3317700515 wait complete. 2024-09-13T17:19:31.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:19:31.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 Processor -- start 2024-09-13T17:19:31.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 -- start start 2024-09-13T17:19:31.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa49815c770 0x7fa49806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4980d0c40 con 0x7fa49806bae0 2024-09-13T17:19:31.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49806c110 con 0x7fa49815c770 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.643+0000 7fa49e1e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49806c3f0 con 0x7fa4980cf680 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa497fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa4977fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa49815c770 0x7fa49806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa497fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:59886/0 (socket says 172.21.15.5:59886) 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa497fff640 1 -- 172.21.15.5:0/4279011349 learned_addr learned my addr 172.21.15.5:0/4279011349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa4977fe640 1 -- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 msgr2=0x7fa4980cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa4977fe640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa4977fe640 1 -- 172.21.15.5:0/4279011349 >> v1:172.21.15.179:6789/0 conn(0x7fa49806bae0 legacy=0x7fa4980cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa4977fe640 1 -- 172.21.15.5:0/4279011349 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49806c6d0 con 0x7fa49815c770 2024-09-13T17:19:31.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.644+0000 7fa497fff640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.645+0000 7fa4977fe640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa49806b5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4880097a0 tx=0x7fa48802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8374a26aaed6cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.645+0000 7fa4967fc640 1 -- 172.21.15.5:0/4279011349 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488032440 con 0x7fa49815c770 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.645+0000 7fa4967fc640 1 -- 172.21.15.5:0/4279011349 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4880325a0 con 0x7fa49815c770 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.645+0000 7fa4967fc640 1 -- 172.21.15.5:0/4279011349 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488032930 con 0x7fa49815c770 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 -- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 msgr2=0x7fa49806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa49806b5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa4880097a0 tx=0x7fa48802a180 comp rx=0 tx=0).stop 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 -- 172.21.15.5:0/4279011349 shutdown_connections 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4980cf680 0x7fa4980cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/4279011349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa49806b5a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 -- 172.21.15.5:0/4279011349 >> 172.21.15.5:0/4279011349 conn(0x7fa49808bfb0 msgr2=0x7fa49809b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 -- 172.21.15.5:0/4279011349 shutdown_connections 2024-09-13T17:19:31.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.646+0000 7fa49e1e9640 1 -- 172.21.15.5:0/4279011349 wait complete. 2024-09-13T17:19:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.647+0000 7fa49e1e9640 1 Processor -- start 2024-09-13T17:19:31.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.647+0000 7fa49e1e9640 1 -- start start 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa49806bae0 0x7fa4980b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa4980b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498151550 con 0x7fa4980cf680 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980b54c0 con 0x7fa49815c770 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa49e1e9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980b57a0 con 0x7fa49806bae0 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53634/0 (socket says 172.21.15.5:53634) 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 -- 172.21.15.5:0/1558407905 learned_addr learned my addr 172.21.15.5:0/1558407905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa497fff640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa4980b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa4977fe640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa49806bae0 0x7fa4980b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 -- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa49806bae0 msgr2=0x7fa4980b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa49806bae0 0x7fa4980b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 -- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 msgr2=0x7fa4980b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa4980b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa496ffd640 1 -- 172.21.15.5:0/1558407905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009b30 con 0x7fa4980cf680 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.648+0000 7fa497fff640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa4980b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa496ffd640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c400 tx=0x7fa48c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0052d0 con 0x7fa4980cf680 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c005430 con 0x7fa4980cf680 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488009400 con 0x7fa4980cf680 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0038a0 con 0x7fa4980cf680 2024-09-13T17:19:31.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.649+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4980b5d60 con 0x7fa4980cf680 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.650+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49806b5a0 con 0x7fa4980cf680 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.650+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa48c003a00 con 0x7fa4980cf680 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.651+0000 7fa47ffff640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 0x7fa48406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.651+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fa48c088ba0 con 0x7fa4980cf680 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.651+0000 7fa4977fe640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 0x7fa48406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.652+0000 7fa4977fe640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 0x7fa48406d0c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa488034000 tx=0x7fa48802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.655+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa48c053b80 con 0x7fa4980cf680 2024-09-13T17:19:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.825+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa498069e50 con 0x7fa4980cf680 2024-09-13T17:19:31.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.826+0000 7fa47ffff640 1 -- 172.21.15.5:0/1558407905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa48c003cb0 con 0x7fa4980cf680 2024-09-13T17:19:31.828 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:19:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 msgr2=0x7fa48406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 0x7fa48406d0c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa488034000 tx=0x7fa48802e000 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 msgr2=0x7fa4980b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c400 tx=0x7fa48c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 shutdown_connections 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa49815c770 0x7fa4980b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa48406ac00 0x7fa48406d0c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4980cf680 0x7fa4980b6aa0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 --2- 172.21.15.5:0/1558407905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa49806bae0 0x7fa4980b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 >> 172.21.15.5:0/1558407905 conn(0x7fa49808bfb0 msgr2=0x7fa49815d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 shutdown_connections 2024-09-13T17:19:31.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.827+0000 7fa49e1e9640 1 -- 172.21.15.5:0/1558407905 wait complete. 2024-09-13T17:19:31.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:19:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.942+0000 7ff92845a640 1 Processor -- start 2024-09-13T17:19:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.943+0000 7ff92845a640 1 -- start start 2024-09-13T17:19:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.943+0000 7ff92845a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff92006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.943+0000 7ff92845a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9200d0c40 con 0x7ff92006bae0 2024-09-13T17:19:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.943+0000 7ff92845a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92006c110 con 0x7ff9200cf680 2024-09-13T17:19:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.943+0000 7ff92845a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92006bf20 con 0x7ff92015c770 2024-09-13T17:19:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9259f5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff92006bae0 0x7ff9200cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58358/0 (socket says 172.21.15.5:58358) 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9259f5640 1 -- 172.21.15.5:0/2557074947 learned_addr learned my addr 172.21.15.5:0/2557074947 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9261f6640 1 --2- 172.21.15.5:0/2557074947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff92006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078787918 0 0) 0x7ff9200d0c40 con 0x7ff92006bae0 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c003520 con 0x7ff92006bae0 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106745791 0 0) 0x7ff92006c110 con 0x7ff9200cf680 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9200d0c40 con 0x7ff9200cf680 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 344259616 0 0) 0x7ff90c003520 con 0x7ff92006bae0 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9261f6640 1 -- 172.21.15.5:0/2557074947 >> v1:172.21.15.179:6789/0 conn(0x7ff9200cf680 legacy=0x7ff9200cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9261f6640 1 -- 172.21.15.5:0/2557074947 >> v1:172.21.15.5:6789/0 conn(0x7ff92006bae0 legacy=0x7ff9200cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.944+0000 7ff9261f6640 1 -- 172.21.15.5:0/2557074947 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92006c3f0 con 0x7ff92015c770 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.945+0000 7ff9261f6640 1 --2- 172.21.15.5:0/2557074947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff92006b5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0097d0 tx=0x7ff91c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e69db2915c10e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.945+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100017f0 con 0x7ff92015c770 2024-09-13T17:19:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.945+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c02ac30 con 0x7ff92015c770 2024-09-13T17:19:31.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.945+0000 7ff9251f4640 1 -- 172.21.15.5:0/2557074947 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c032440 con 0x7ff92015c770 2024-09-13T17:19:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 -- 172.21.15.5:0/2557074947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 msgr2=0x7ff92006b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 --2- 172.21.15.5:0/2557074947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff92006b5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0097d0 tx=0x7ff91c02a1a0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 -- 172.21.15.5:0/2557074947 shutdown_connections 2024-09-13T17:19:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 --2- 172.21.15.5:0/2557074947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff92006b5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 -- 172.21.15.5:0/2557074947 >> 172.21.15.5:0/2557074947 conn(0x7ff92008bfb0 msgr2=0x7ff92009b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 -- 172.21.15.5:0/2557074947 shutdown_connections 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.946+0000 7ff92845a640 1 -- 172.21.15.5:0/2557074947 wait complete. 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.947+0000 7ff92845a640 1 Processor -- start 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.947+0000 7ff92845a640 1 -- start start 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9200cf680 0x7ff9200b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff9200cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200ca870 con 0x7ff92006bae0 2024-09-13T17:19:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92015a240 con 0x7ff9200cf680 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff92845a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200b7dc0 con 0x7ff92015c770 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53638/0 (socket says 172.21.15.5:53638) 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 -- 172.21.15.5:0/1966118475 learned_addr learned my addr 172.21.15.5:0/1966118475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9269f7640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff9200cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9259f5640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9200cf680 0x7ff9200b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 -- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 msgr2=0x7ff9200cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff9200cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 -- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9200cf680 msgr2=0x7ff9200b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9200cf680 0x7ff9200b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 -- 172.21.15.5:0/1966118475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009400 con 0x7ff92006bae0 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.948+0000 7ff9261f6640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0098f0 tx=0x7ff91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.949+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c006e10 con 0x7ff92006bae0 2024-09-13T17:19:31.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.949+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c03d630 con 0x7ff92006bae0 2024-09-13T17:19:31.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.949+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9200b71b0 con 0x7ff92006bae0 2024-09-13T17:19:31.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.949+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c03d9a0 con 0x7ff92006bae0 2024-09-13T17:19:31.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.949+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9200b7770 con 0x7ff92006bae0 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.950+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92006b5a0 con 0x7ff92006bae0 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.950+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff91c03db00 con 0x7ff92006bae0 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.951+0000 7ff916ffd640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 0x7ff90406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.951+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7ff91c0a9eb0 con 0x7ff92006bae0 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.951+0000 7ff9259f5640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 0x7ff90406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.951+0000 7ff9259f5640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 0x7ff90406d0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff9201f5290 tx=0x7ff910000f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:31.955+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff91c074fc0 con 0x7ff92006bae0 2024-09-13T17:19:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.125+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9200cde40 con 0x7ff92006bae0 2024-09-13T17:19:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.126+0000 7ff916ffd640 1 -- 172.21.15.5:0/1966118475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff91c0410a0 con 0x7ff92006bae0 2024-09-13T17:19:32.128 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 msgr2=0x7ff90406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 0x7ff90406d0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff9201f5290 tx=0x7ff910000f70 comp rx=0 tx=0).stop 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 msgr2=0x7ff920159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0098f0 tx=0x7ff91c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 shutdown_connections 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff92015c770 0x7ff9200cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9200cf680 0x7ff9200b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff90406ac00 0x7ff90406d0c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 --2- 172.21.15.5:0/1966118475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff92006bae0 0x7ff920159d00 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 >> 172.21.15.5:0/1966118475 conn(0x7ff92008bfb0 msgr2=0x7ff9200cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 shutdown_connections 2024-09-13T17:19:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.128+0000 7ff92845a640 1 -- 172.21.15.5:0/1966118475 wait complete. 2024-09-13T17:19:32.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:19:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.242+0000 7f3feef0f640 1 Processor -- start 2024-09-13T17:19:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.242+0000 7f3feef0f640 1 -- start start 2024-09-13T17:19:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feef0f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3fe81548b0 0x7f3fe80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feef0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 0x7f3fe80ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feef0f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe806c1a0 con 0x7f3fe80ab9c0 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feef0f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe815ae60 con 0x7f3fe81548b0 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feef0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe815b140 con 0x7f3fe815a930 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3fe7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 0x7f3fe80ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feccab640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3fe81548b0 0x7f3fe80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3fe7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 0x7f3fe80ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:59924/0 (socket says 172.21.15.5:59924) 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3fe7fff640 1 -- 172.21.15.5:0/135705500 learned_addr learned my addr 172.21.15.5:0/135705500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feccab640 1 -- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 msgr2=0x7f3fe80ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feccab640 1 --2- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 0x7f3fe80ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feccab640 1 -- 172.21.15.5:0/135705500 >> v1:172.21.15.179:6789/0 conn(0x7f3fe80ab9c0 legacy=0x7f3fe80ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3fe77fe640 1 -- 172.21.15.5:0/135705500 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172358696 0 0) 0x7f3fe806c1a0 con 0x7f3fe80ab9c0 2024-09-13T17:19:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.243+0000 7f3feccab640 1 -- 172.21.15.5:0/135705500 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe815b420 con 0x7f3fe81548b0 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.244+0000 7f3feccab640 1 --2- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe81548b0 0x7f3fe80706b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0097a0 tx=0x7f3fdc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b544b6fe8fa78d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.244+0000 7f3fe77fe640 1 -- 172.21.15.5:0/135705500 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc032440 con 0x7f3fe81548b0 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3fe77fe640 1 -- 172.21.15.5:0/135705500 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0325a0 con 0x7f3fe81548b0 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3fe77fe640 1 -- 172.21.15.5:0/135705500 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc032930 con 0x7f3fe81548b0 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 -- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe81548b0 msgr2=0x7f3fe80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 --2- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe81548b0 0x7f3fe80706b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0097a0 tx=0x7f3fdc02a180 comp rx=0 tx=0).stop 2024-09-13T17:19:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 -- 172.21.15.5:0/135705500 shutdown_connections 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 --2- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe815a930 0x7f3fe80ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 --2- 172.21.15.5:0/135705500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe81548b0 0x7f3fe80706b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 -- 172.21.15.5:0/135705500 >> 172.21.15.5:0/135705500 conn(0x7f3fe806a270 msgr2=0x7f3fe806a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 -- 172.21.15.5:0/135705500 shutdown_connections 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.245+0000 7f3feef0f640 1 -- 172.21.15.5:0/135705500 wait complete. 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.246+0000 7f3feef0f640 1 Processor -- start 2024-09-13T17:19:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.246+0000 7f3feef0f640 1 -- start start 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe80ab9c0 0x7f3fe8149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe81548b0 0x7f3fe814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8150520 con 0x7f3fe815a930 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81f0f10 con 0x7f3fe80ab9c0 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feef0f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81f11f0 con 0x7f3fe81548b0 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3fed4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3fed4ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53642/0 (socket says 172.21.15.5:53642) 2024-09-13T17:19:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3fed4ac640 1 -- 172.21.15.5:0/3258819649 learned_addr learned my addr 172.21.15.5:0/3258819649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3fe7fff640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe81548b0 0x7f3fe814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.247+0000 7f3feccab640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe80ab9c0 0x7f3fe8149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 -- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe81548b0 msgr2=0x7f3fe814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe81548b0 0x7f3fe814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 -- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe80ab9c0 msgr2=0x7f3fe8149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe80ab9c0 0x7f3fe8149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 -- 172.21.15.5:0/3258819649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009400 con 0x7f3fe815a930 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fed4ac640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c700 tx=0x7f3fe000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0003da0 con 0x7f3fe815a930 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000ce10 con 0x7f3fe815a930 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe81f14d0 con 0x7f3fe815a930 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0005270 con 0x7f3fe815a930 2024-09-13T17:19:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.248+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe81f1a90 con 0x7f3fe815a930 2024-09-13T17:19:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.249+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe8070bf0 con 0x7f3fe815a930 2024-09-13T17:19:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.249+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3fe00053d0 con 0x7f3fe815a930 2024-09-13T17:19:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.250+0000 7f3fe57fa640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 0x7f3fcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.250+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f3fe0089260 con 0x7f3fe815a930 2024-09-13T17:19:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.250+0000 7f3feccab640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 0x7f3fcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.251+0000 7f3feccab640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 0x7f3fcc06d0c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc034000 tx=0x7f3fdc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.254+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3fe00542e0 con 0x7f3fe815a930 2024-09-13T17:19:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.435+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3fe81f1cb0 con 0x7f3fe815a930 2024-09-13T17:19:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.435+0000 7f3fe57fa640 1 -- 172.21.15.5:0/3258819649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v113) v1 ==== 80+0+240 (secure 0 0 0) 0x7f3fe0057900 con 0x7f3fe815a930 2024-09-13T17:19:32.438 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:32.438 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:32.438 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:32.438 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.437+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 msgr2=0x7f3fcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.437+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 0x7f3fcc06d0c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc034000 tx=0x7f3fdc02e000 comp rx=0 tx=0).stop 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.437+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 msgr2=0x7f3fe8151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.437+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c700 tx=0x7f3fe000cbc0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 shutdown_connections 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3fcc06ac00 0x7f3fcc06d0c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe815a930 0x7f3fe8151830 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fe81548b0 0x7f3fe814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 --2- 172.21.15.5:0/3258819649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fe80ab9c0 0x7f3fe8149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 >> 172.21.15.5:0/3258819649 conn(0x7f3fe806a270 msgr2=0x7f3fe8071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 shutdown_connections 2024-09-13T17:19:32.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.438+0000 7f3feef0f640 1 -- 172.21.15.5:0/3258819649 wait complete. 2024-09-13T17:19:32.451 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:32.451 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:32.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.570+0000 7f3744a2b640 1 Processor -- start 2024-09-13T17:19:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.570+0000 7f3744a2b640 1 -- start start 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37401591e0 0x7f37400acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37400abf40 0x7f37400ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f37400b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400ac3b0 con 0x7f37401591e0 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400cf040 con 0x7f37400abf40 2024-09-13T17:19:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f3744a2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400701a0 con 0x7f37400cebf0 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37401591e0 0x7f37400acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37401591e0 0x7f37400acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53644/0 (socket says 172.21.15.5:53644) 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 -- 172.21.15.5:0/4289575229 learned_addr learned my addr 172.21.15.5:0/4289575229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 -- 172.21.15.5:0/4289575229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 msgr2=0x7f37400b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 --2- 172.21.15.5:0/4289575229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f37400b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 -- 172.21.15.5:0/4289575229 >> v2:172.21.15.179:3300/0 conn(0x7f37400abf40 msgr2=0x7f37400ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 --2- 172.21.15.5:0/4289575229 >> v2:172.21.15.179:3300/0 conn(0x7f37400abf40 0x7f37400ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.571+0000 7f373e59c640 1 -- 172.21.15.5:0/4289575229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400ad540 con 0x7f37401591e0 2024-09-13T17:19:32.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f373e59c640 1 --2- 172.21.15.5:0/4289575229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37401591e0 0x7f37400acf20 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f37400b29b0 tx=0x7f373002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95041b3e2d233ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f373dd9b640 1 -- 172.21.15.5:0/4289575229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373002ae90 con 0x7f37401591e0 2024-09-13T17:19:32.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f373dd9b640 1 -- 172.21.15.5:0/4289575229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730032440 con 0x7f37401591e0 2024-09-13T17:19:32.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f373dd9b640 1 -- 172.21.15.5:0/4289575229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300327d0 con 0x7f37401591e0 2024-09-13T17:19:32.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 -- 172.21.15.5:0/4289575229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37401591e0 msgr2=0x7f37400acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 --2- 172.21.15.5:0/4289575229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37401591e0 0x7f37400acf20 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f37400b29b0 tx=0x7f373002a140 comp rx=0 tx=0).stop 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 -- 172.21.15.5:0/4289575229 shutdown_connections 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 --2- 172.21.15.5:0/4289575229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f37400b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 --2- 172.21.15.5:0/4289575229 >> v2:172.21.15.179:3300/0 conn(0x7f37400abf40 0x7f37400ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 --2- 172.21.15.5:0/4289575229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37401591e0 0x7f37400acf20 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 -- 172.21.15.5:0/4289575229 >> 172.21.15.5:0/4289575229 conn(0x7f374006a270 msgr2=0x7f374006a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.572+0000 7f3744a2b640 1 -- 172.21.15.5:0/4289575229 shutdown_connections 2024-09-13T17:19:32.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.573+0000 7f3744a2b640 1 -- 172.21.15.5:0/4289575229 wait complete. 2024-09-13T17:19:32.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.574+0000 7f3744a2b640 1 Processor -- start 2024-09-13T17:19:32.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.574+0000 7f3744a2b640 1 -- start start 2024-09-13T17:19:32.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f3740152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 0x7f3740153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37401e4030 con 0x7f37400abf40 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740153940 con 0x7f37401591e0 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3744a2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3740153c20 con 0x7f37400cebf0 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53660/0 (socket says 172.21.15.5:53660) 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 -- 172.21.15.5:0/3552579217 learned_addr learned my addr 172.21.15.5:0/3552579217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373ed9d640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 0x7f3740153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3735d9b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f3740152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 -- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 msgr2=0x7f3740152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f3740152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 -- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 msgr2=0x7f3740153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 0x7f3740153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 -- 172.21.15.5:0/3552579217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300094d0 con 0x7f37400abf40 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373ed9d640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 0x7f3740153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f3735d9b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f3740152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f373e59c640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3730000c00 tx=0x7f37300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.575+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730030950 con 0x7f37400abf40 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.576+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730030ab0 con 0x7f37400abf40 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.576+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730030e60 con 0x7f37400abf40 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.576+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37401e3970 con 0x7f37400abf40 2024-09-13T17:19:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.576+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374014d410 con 0x7f37400abf40 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.577+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3740153d60 con 0x7f37400abf40 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.577+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3730039040 con 0x7f37400abf40 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.577+0000 7f37377fe640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 0x7f372006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.578+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f37300a9dc0 con 0x7f37400abf40 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.578+0000 7f3735d9b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 0x7f372006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.578+0000 7f3735d9b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 0x7f372006d0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f37400cdfe0 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.582+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3740153d60 con 0x7f37400abf40 2024-09-13T17:19:32.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.753+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3740153d60 con 0x7f37400abf40 2024-09-13T17:19:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.754+0000 7f37377fe640 1 -- 172.21.15.5:0/3552579217 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7f3740153d60 con 0x7f37400abf40 2024-09-13T17:19:32.757 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:32.757 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 msgr2=0x7f372006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 0x7f372006d0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f37400cdfe0 tx=0x7f3728008040 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 msgr2=0x7f37401efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3730000c00 tx=0x7f37300046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 shutdown_connections 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37401591e0 0x7f3740153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f37400cebf0 0x7f3740152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f372006ac00 0x7f372006d0c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 --2- 172.21.15.5:0/3552579217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37400abf40 0x7f37401efa50 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 >> 172.21.15.5:0/3552579217 conn(0x7f374006a270 msgr2=0x7f37400af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 shutdown_connections 2024-09-13T17:19:32.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.756+0000 7f3744a2b640 1 -- 172.21.15.5:0/3552579217 wait complete. 2024-09-13T17:19:32.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:19:32.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:19:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.872+0000 7f7b32c6b640 1 Processor -- start 2024-09-13T17:19:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.872+0000 7f7b32c6b640 1 -- start start 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b32c6b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7b2c0c9270 0x7f7b2c071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b32c6b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c15a8a0 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b32c6b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c072180 con 0x7f7b2c069e50 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b32c6b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c15e060 con 0x7f7b2c0c9270 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b30a07640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7b2c15a4c0 0x7f7b2c06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58368/0 (socket says 172.21.15.5:58368) 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b30a07640 1 -- 172.21.15.5:0/1783177794 learned_addr learned my addr 172.21.15.5:0/1783177794 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011055631 0 0) 0x7f7b2c15a8a0 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.873+0000 7f7b2bfff640 1 --2- 172.21.15.5:0/1783177794 >> v2:172.21.15.179:3300/0 conn(0x7f7b2c0c9270 0x7f7b2c071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b14003520 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798751026 0 0) 0x7f7b14003520 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 >> v2:172.21.15.179:3300/0 conn(0x7f7b2c0c9270 msgr2=0x7f7b2c071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 --2- 172.21.15.5:0/1783177794 >> v2:172.21.15.179:3300/0 conn(0x7f7b2c0c9270 0x7f7b2c071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 >> v1:172.21.15.179:6789/0 conn(0x7f7b2c069e50 legacy=0x7f7b2c06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0723e0 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f7b1c001670 con 0x7f7b2c15a4c0 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 >> v1:172.21.15.5:6789/0 conn(0x7f7b2c15a4c0 legacy=0x7f7b2c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b14003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b140047c0 0x7f7b14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b140051d0 0x7f7b1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15e060 con 0x7f7b14003970 2024-09-13T17:19:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1400c100 con 0x7f7b140047c0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1400c2c0 con 0x7f7b140051d0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b14003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b2bfff640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b140047c0 0x7f7b14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b31208640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b140051d0 0x7f7b1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 -- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b140051d0 msgr2=0x7f7b1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b140051d0 0x7f7b1400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 -- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b140047c0 msgr2=0x7f7b14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b140047c0 0x7f7b14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b30a07640 1 -- 172.21.15.5:0/1783177794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14003520 con 0x7f7b14003970 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b31208640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b140051d0 0x7f7b1400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.874+0000 7f7b31208640 1 -- 172.21.15.5:0/1783177794 reap_dead start 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.875+0000 7f7b30a07640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b14003db0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c240 tx=0x7f7b140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72af1c1cc23a5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.875+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c02e070 con 0x7f7b14003970 2024-09-13T17:19:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.875+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0058d0 con 0x7f7b14003970 2024-09-13T17:19:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.875+0000 7f7b2b7fe640 1 -- 172.21.15.5:0/1783177794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c005d00 con 0x7f7b14003970 2024-09-13T17:19:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 -- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 msgr2=0x7f7b14003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b14003db0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c240 tx=0x7f7b140057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 -- 172.21.15.5:0/1783177794 shutdown_connections 2024-09-13T17:19:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/1783177794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b14003db0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 -- 172.21.15.5:0/1783177794 >> 172.21.15.5:0/1783177794 conn(0x7f7b2c0ce380 msgr2=0x7f7b2c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 -- 172.21.15.5:0/1783177794 shutdown_connections 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.876+0000 7f7b32c6b640 1 -- 172.21.15.5:0/1783177794 wait complete. 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.877+0000 7f7b32c6b640 1 Processor -- start 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.877+0000 7f7b32c6b640 1 -- start start 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b2c09a1e0 0x7f7b2c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b2c0cda10 0x7f7b2c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15c300 con 0x7f7b14003970 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0cbd70 con 0x7f7b2c0cda10 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b32c6b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0cc050 con 0x7f7b2c09a1e0 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53676/0 (socket says 172.21.15.5:53676) 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 -- 172.21.15.5:0/547050087 learned_addr learned my addr 172.21.15.5:0/547050087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:32.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 -- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b2c09a1e0 msgr2=0x7f7b2c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b2bfff640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b2c09a1e0 0x7f7b2c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b31208640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b2c0cda10 0x7f7b2c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b2c09a1e0 0x7f7b2c0cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 -- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b2c0cda10 msgr2=0x7f7b2c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b2c0cda10 0x7f7b2c0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.878+0000 7f7b30a07640 1 -- 172.21.15.5:0/547050087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c15c550 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b30a07640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c240 tx=0x7f7b1c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c000ed0 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0049f0 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c15c830 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c004b60 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.879+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c09a660 con 0x7f7b14003970 2024-09-13T17:19:32.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.880+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c0cddf0 con 0x7f7b14003970 2024-09-13T17:19:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.880+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b1c004cc0 con 0x7f7b14003970 2024-09-13T17:19:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.881+0000 7f7b297fa640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 0x7f7b1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.881+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f7b1c0a8ed0 con 0x7f7b14003970 2024-09-13T17:19:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.881+0000 7f7b2bfff640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 0x7f7b1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.881+0000 7f7b2bfff640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 0x7f7b1806d0f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c1f5400 tx=0x7f7b20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:32.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:32.885+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b1c073f30 con 0x7f7b14003970 2024-09-13T17:19:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.054+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b2c0cddf0 con 0x7f7b14003970 2024-09-13T17:19:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.054+0000 7f7b297fa640 1 -- 172.21.15.5:0/547050087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b1c0400a0 con 0x7f7b14003970 2024-09-13T17:19:33.057 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:19:33.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.056+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 msgr2=0x7f7b1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.056+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 0x7f7b1806d0f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c1f5400 tx=0x7f7b20008040 comp rx=0 tx=0).stop 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.056+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 msgr2=0x7f7b2c0c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.056+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c240 tx=0x7f7b1c001a00 comp rx=0 tx=0).stop 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 shutdown_connections 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b2c0cda10 0x7f7b2c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b2c09a1e0 0x7f7b2c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f7b1806ac30 0x7f7b1806d0f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 --2- 172.21.15.5:0/547050087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b14003970 0x7f7b2c0c42d0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 >> 172.21.15.5:0/547050087 conn(0x7f7b2c0ce380 msgr2=0x7f7b2c0cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 shutdown_connections 2024-09-13T17:19:33.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.057+0000 7f7b32c6b640 1 -- 172.21.15.5:0/547050087 wait complete. 2024-09-13T17:19:33.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:19:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.172+0000 7f9efa072640 1 Processor -- start 2024-09-13T17:19:33.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.172+0000 7f9efa072640 1 -- start start 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9efa072640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ef40c9270 0x7f9ef4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9efa072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef4069e50 0x7f9ef406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9efa072640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef415a8a0 con 0x7f9ef415a4c0 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9efa072640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef415e060 con 0x7f9ef40c9270 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9efa072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef406a800 con 0x7f9ef4069e50 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9ef2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ef40c9270 0x7f9ef4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9ef2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ef40c9270 0x7f9ef4071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53680/0 (socket says 172.21.15.5:53680) 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9ef2ffd640 1 -- 172.21.15.5:0/2213478259 learned_addr learned my addr 172.21.15.5:0/2213478259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.173+0000 7f9ef3fff640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef4069e50 0x7f9ef406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef2ffd640 1 -- 172.21.15.5:0/2213478259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef4069e50 msgr2=0x7f9ef406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef4069e50 0x7f9ef406a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef2ffd640 1 -- 172.21.15.5:0/2213478259 >> v1:172.21.15.179:6789/0 conn(0x7f9ef415a4c0 legacy=0x7f9ef406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef2ffd640 1 -- 172.21.15.5:0/2213478259 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4072180 con 0x7f9ef40c9270 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef40c9270 0x7f9ef4071c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009870 tx=0x7f9ee802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8b31940e9ec731 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef27fc640 1 -- 172.21.15.5:0/2213478259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8032440 con 0x7f9ef40c9270 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef27fc640 1 -- 172.21.15.5:0/2213478259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80325a0 con 0x7f9ef40c9270 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.174+0000 7f9ef27fc640 1 -- 172.21.15.5:0/2213478259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8032930 con 0x7f9ef40c9270 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 -- 172.21.15.5:0/2213478259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef40c9270 msgr2=0x7f9ef4071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef40c9270 0x7f9ef4071c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009870 tx=0x7f9ee802a1c0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 -- 172.21.15.5:0/2213478259 shutdown_connections 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef4069e50 0x7f9ef406a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 --2- 172.21.15.5:0/2213478259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef40c9270 0x7f9ef4071c40 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 -- 172.21.15.5:0/2213478259 >> 172.21.15.5:0/2213478259 conn(0x7f9ef40ce380 msgr2=0x7f9ef40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 -- 172.21.15.5:0/2213478259 shutdown_connections 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.175+0000 7f9efa072640 1 -- 172.21.15.5:0/2213478259 wait complete. 2024-09-13T17:19:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.176+0000 7f9efa072640 1 Processor -- start 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 -- start start 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 0x7f9ef415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef415a4c0 0x7f9ef415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40b2070 con 0x7f9ef4069e50 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4156f80 con 0x7f9ef40c9270 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9efa072640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef41f3220 con 0x7f9ef415a4c0 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53682/0 (socket says 172.21.15.5:53682) 2024-09-13T17:19:33.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.177+0000 7f9ef37fe640 1 -- 172.21.15.5:0/4129019570 learned_addr learned my addr 172.21.15.5:0/4129019570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef3fff640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef415a4c0 0x7f9ef415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 0x7f9ef415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 -- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef415a4c0 msgr2=0x7f9ef415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef415a4c0 0x7f9ef415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 -- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 msgr2=0x7f9ef415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 0x7f9ef415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 -- 172.21.15.5:0/4129019570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80094d0 con 0x7f9ef4069e50 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 0x7f9ef415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9ef37fe640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c370 tx=0x7f9ee400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40052d0 con 0x7f9ef4069e50 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee4005430 con 0x7f9ef4069e50 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef40b1d90 con 0x7f9ef4069e50 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003850 con 0x7f9ef4069e50 2024-09-13T17:19:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.178+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef415ae40 con 0x7f9ef4069e50 2024-09-13T17:19:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.179+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef406c710 con 0x7f9ef4069e50 2024-09-13T17:19:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.180+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ee40039b0 con 0x7f9ef4069e50 2024-09-13T17:19:33.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.180+0000 7f9edbfff640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 0x7f9ee006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.180+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f9ee40889f0 con 0x7f9ef4069e50 2024-09-13T17:19:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.180+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 0x7f9ee006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.181+0000 7f9ef2ffd640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 0x7f9ee006d0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8034000 tx=0x7f9ee802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.184+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9ef406c710 con 0x7f9ef4069e50 2024-09-13T17:19:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.354+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ef406c710 con 0x7f9ef4069e50 2024-09-13T17:19:33.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.354+0000 7f9edbfff640 1 -- 172.21.15.5:0/4129019570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ee4017020 con 0x7f9ef4069e50 2024-09-13T17:19:33.359 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:19:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 msgr2=0x7f9ee006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 0x7f9ee006d0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8034000 tx=0x7f9ee802e000 comp rx=0 tx=0).stop 2024-09-13T17:19:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 msgr2=0x7f9ef4156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c370 tx=0x7f9ee400c830 comp rx=0 tx=0).stop 2024-09-13T17:19:33.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 shutdown_connections 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ef415a4c0 0x7f9ef415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ef40c9270 0x7f9ef415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f9ee006ac00 0x7f9ee006d0c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 --2- 172.21.15.5:0/4129019570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef4069e50 0x7f9ef4156a40 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 >> 172.21.15.5:0/4129019570 conn(0x7f9ef40ce380 msgr2=0x7f9ef40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 shutdown_connections 2024-09-13T17:19:33.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.357+0000 7f9efa072640 1 -- 172.21.15.5:0/4129019570 wait complete. 2024-09-13T17:19:33.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:19:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.472+0000 7ffa8e29c640 1 Processor -- start 2024-09-13T17:19:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.472+0000 7ffa8e29c640 1 -- start start 2024-09-13T17:19:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8e29c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffa880ad1f0 0x7ffa8806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8e29c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8815cac0 con 0x7ffa8815dcd0 2024-09-13T17:19:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8e29c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8806ce00 con 0x7ffa8806c990 2024-09-13T17:19:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8e29c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8806d930 con 0x7ffa880ad1f0 2024-09-13T17:19:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8c839640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa8815dcd0 0x7ffa8806ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa8c839640 1 -- 172.21.15.5:0/1208221713 learned_addr learned my addr 172.21.15.5:0/1208221713 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa87fff640 1 --2- 172.21.15.5:0/1208221713 >> v2:172.21.15.179:3300/0 conn(0x7ffa880ad1f0 0x7ffa8806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.473+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722221531 0 0) 0x7ffa8815cac0 con 0x7ffa8815dcd0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa74003520 con 0x7ffa8815dcd0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222222836 0 0) 0x7ffa74003520 con 0x7ffa8815dcd0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 >> v2:172.21.15.179:3300/0 conn(0x7ffa880ad1f0 msgr2=0x7ffa8806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 --2- 172.21.15.5:0/1208221713 >> v2:172.21.15.179:3300/0 conn(0x7ffa880ad1f0 0x7ffa8806dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 >> v1:172.21.15.179:6789/0 conn(0x7ffa8806c990 legacy=0x7ffa8815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8806d090 con 0x7ffa8815dcd0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7ffa800019f0 con 0x7ffa8815dcd0 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 >> v1:172.21.15.5:6789/0 conn(0x7ffa8815dcd0 legacy=0x7ffa8806ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa74003970 0x7ffa74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa740047c0 0x7ffa74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 0x7ffa7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8806d930 con 0x7ffa74005180 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7400c120 con 0x7ffa74003970 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7400c2e0 con 0x7ffa740047c0 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 0x7ffa7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa87fff640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa74003970 0x7ffa74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa7ffff640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa740047c0 0x7ffa74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 -- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa740047c0 msgr2=0x7ffa74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa740047c0 0x7ffa74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 -- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa74003970 msgr2=0x7ffa74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa74003970 0x7ffa74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.474+0000 7ffa8c839640 1 -- 172.21.15.5:0/1208221713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74003520 con 0x7ffa74005180 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.475+0000 7ffa8c839640 1 -- 172.21.15.5:0/1208221713 reap_dead start 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.475+0000 7ffa8c839640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 0x7ffa7400b980 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000a830 tx=0x7ffa740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91b1d71c1eb588d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.475+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8002ba50 con 0x7ffa74005180 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.475+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8002bbf0 con 0x7ffa74005180 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.475+0000 7ffa877fe640 1 -- 172.21.15.5:0/1208221713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80034470 con 0x7ffa74005180 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 -- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 msgr2=0x7ffa7400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 0x7ffa7400b980 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000a830 tx=0x7ffa740057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 -- 172.21.15.5:0/1208221713 shutdown_connections 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/1208221713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa74005180 0x7ffa7400b980 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 -- 172.21.15.5:0/1208221713 >> 172.21.15.5:0/1208221713 conn(0x7ffa88070800 msgr2=0x7ffa88070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 -- 172.21.15.5:0/1208221713 shutdown_connections 2024-09-13T17:19:33.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.476+0000 7ffa8e29c640 1 -- 172.21.15.5:0/1208221713 wait complete. 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.477+0000 7ffa8e29c640 1 Processor -- start 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.477+0000 7ffa8e29c640 1 -- start start 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa74005180 0x7ffa881495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88159c10 0x7ffa8815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c3b10 con 0x7ffa8815b410 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8815bdd0 con 0x7ffa88159c10 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8e29c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c4370 con 0x7ffa74005180 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40722/0 (socket says 172.21.15.5:40722) 2024-09-13T17:19:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 -- 172.21.15.5:0/2101945494 learned_addr learned my addr 172.21.15.5:0/2101945494 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa8c839640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88159c10 0x7ffa8815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa87fff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa74005180 0x7ffa881495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 -- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa74005180 msgr2=0x7ffa881495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa74005180 0x7ffa881495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 -- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88159c10 msgr2=0x7ffa8815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88159c10 0x7ffa8815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 -- 172.21.15.5:0/2101945494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88149ae0 con 0x7ffa8815b410 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.478+0000 7ffa7ffff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000f5f0 tx=0x7ffa7000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.479+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700052e0 con 0x7ffa8815b410 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.479+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70005440 con 0x7ffa8815b410 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.479+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8815a990 con 0x7ffa8815b410 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.479+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70003810 con 0x7ffa8815b410 2024-09-13T17:19:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.479+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880c4000 con 0x7ffa8815b410 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.480+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa880c4520 con 0x7ffa8815b410 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.480+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa70003970 con 0x7ffa8815b410 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.481+0000 7ffa857fa640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 0x7ffa6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.481+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7ffa70089360 con 0x7ffa8815b410 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.481+0000 7ffa87fff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 0x7ffa6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.481+0000 7ffa87fff640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 0x7ffa6806d0c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009a80 tx=0x7ffa78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.485+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffa880c4520 con 0x7ffa8815b410 2024-09-13T17:19:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.654+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa880c4520 con 0x7ffa8815b410 2024-09-13T17:19:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.654+0000 7ffa857fa640 1 -- 172.21.15.5:0/2101945494 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa880c4520 con 0x7ffa8815b410 2024-09-13T17:19:33.656 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 msgr2=0x7ffa6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 0x7ffa6806d0c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009a80 tx=0x7ffa78008040 comp rx=0 tx=0).stop 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 msgr2=0x7ffa8815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000f5f0 tx=0x7ffa7000fab0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 shutdown_connections 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88159c10 0x7ffa8815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffa6806ac00 0x7ffa6806d0c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa8815b410 0x7ffa8815b890 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 --2- 172.21.15.5:0/2101945494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa74005180 0x7ffa881495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 >> 172.21.15.5:0/2101945494 conn(0x7ffa88070800 msgr2=0x7ffa8815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 shutdown_connections 2024-09-13T17:19:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.656+0000 7ffa8e29c640 1 -- 172.21.15.5:0/2101945494 wait complete. 2024-09-13T17:19:33.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:19:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.770+0000 7fda389ce640 1 Processor -- start 2024-09-13T17:19:33.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.770+0000 7fda389ce640 1 -- start start 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda389ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda340acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda389ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda340cedc0 0x7fda34070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda389ce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340ac380 con 0x7fda340abf40 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda389ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340701a0 con 0x7fda340cedc0 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda389ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340ad540 con 0x7fda341591e0 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda340cedc0 0x7fda34070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda340cedc0 0x7fda34070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40736/0 (socket says 172.21.15.5:40736) 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 -- 172.21.15.5:0/2947754164 learned_addr learned my addr 172.21.15.5:0/2947754164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda3259c640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda340acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 -- 172.21.15.5:0/2947754164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 msgr2=0x7fda340acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda340acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 -- 172.21.15.5:0/2947754164 >> v1:172.21.15.179:6789/0 conn(0x7fda340abf40 legacy=0x7fda340ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.771+0000 7fda32d9d640 1 -- 172.21.15.5:0/2947754164 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340ad820 con 0x7fda340cedc0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.772+0000 7fda32d9d640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cedc0 0x7fda34070910 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a241162a37d6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.772+0000 7fda3159a640 1 -- 172.21.15.5:0/2947754164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c02aea0 con 0x7fda340cedc0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.772+0000 7fda3159a640 1 -- 172.21.15.5:0/2947754164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c02d050 con 0x7fda340cedc0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.772+0000 7fda3159a640 1 -- 172.21.15.5:0/2947754164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c031820 con 0x7fda340cedc0 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 -- 172.21.15.5:0/2947754164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cedc0 msgr2=0x7fda34070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cedc0 0x7fda34070910 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c02a680 comp rx=0 tx=0).stop 2024-09-13T17:19:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 -- 172.21.15.5:0/2947754164 shutdown_connections 2024-09-13T17:19:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cedc0 0x7fda34070910 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 --2- 172.21.15.5:0/2947754164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda340acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 -- 172.21.15.5:0/2947754164 >> 172.21.15.5:0/2947754164 conn(0x7fda3406a270 msgr2=0x7fda3406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 -- 172.21.15.5:0/2947754164 shutdown_connections 2024-09-13T17:19:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.773+0000 7fda389ce640 1 -- 172.21.15.5:0/2947754164 wait complete. 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.774+0000 7fda389ce640 1 Processor -- start 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.774+0000 7fda389ce640 1 -- start start 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda340cedc0 0x7fda34148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda341f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341e3b40 con 0x7fda340abf40 2024-09-13T17:19:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3415a670 con 0x7fda340cedc0 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda389ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda341546f0 con 0x7fda341591e0 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40740/0 (socket says 172.21.15.5:40740) 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 -- 172.21.15.5:0/3332322459 learned_addr learned my addr 172.21.15.5:0/3332322459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda31d9b640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda340cedc0 0x7fda34148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda32d9d640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda341f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 -- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 msgr2=0x7fda341f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda341f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 -- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda340cedc0 msgr2=0x7fda34148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda340cedc0 0x7fda34148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.775+0000 7fda3259c640 1 -- 172.21.15.5:0/3332322459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c009b30 con 0x7fda340abf40 2024-09-13T17:19:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda3259c640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fda2400e870 tx=0x7fda2400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240094f0 con 0x7fda340abf40 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400c940 con 0x7fda340abf40 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda341549d0 con 0x7fda340abf40 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400ccf0 con 0x7fda340abf40 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.776+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34154f90 con 0x7fda340abf40 2024-09-13T17:19:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.777+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda340acf20 con 0x7fda340abf40 2024-09-13T17:19:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.777+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda24013470 con 0x7fda340abf40 2024-09-13T17:19:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.778+0000 7fda22ffd640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.778+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fda24089630 con 0x7fda340abf40 2024-09-13T17:19:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.778+0000 7fda31d9b640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:33.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.779+0000 7fda31d9b640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 0x7fda1406d0c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda34159ef0 tx=0x7fda28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.782+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda240546b0 con 0x7fda340abf40 2024-09-13T17:19:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.964+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda340ce070 con 0x7fda340abf40 2024-09-13T17:19:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.965+0000 7fda22ffd640 1 -- 172.21.15.5:0/3332322459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v113) v1 ==== 80+0+240 (secure 0 0 0) 0x7fda24057cd0 con 0x7fda340abf40 2024-09-13T17:19:33.970 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:33.971 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/1886354202 2024-09-14T17:18:51.850170+0000 2024-09-13T17:19:33.971 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:33.971 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/1677867267 2024-09-14T17:18:51.834824+0000 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 msgr2=0x7fda1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 0x7fda1406d0c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fda34159ef0 tx=0x7fda28009040 comp rx=0 tx=0).stop 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 msgr2=0x7fda3415a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fda2400e870 tx=0x7fda2400ed30 comp rx=0 tx=0).stop 2024-09-13T17:19:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 shutdown_connections 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda341591e0 0x7fda341f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda340cedc0 0x7fda34148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 --2- 172.21.15.5:0/3332322459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340abf40 0x7fda3415a130 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 >> 172.21.15.5:0/3332322459 conn(0x7fda3406a270 msgr2=0x7fda34156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 shutdown_connections 2024-09-13T17:19:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:33.967+0000 7fda389ce640 1 -- 172.21.15.5:0/3332322459 wait complete. 2024-09-13T17:19:33.981 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2024-09-13T17:19:33.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:33.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T17:19:34.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi179.stderr:ceph-fuse[48833]: fuse finished with error 0 and tester_r 0 2024-09-13T17:19:34.016 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:19:34.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:19:34.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:34.097 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:19:34.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T17:19:34.251 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-13T17:19:34.252 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T17:19:34.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-13T17:19:34.375 INFO:teuthology.orchestra.run.smithi005.stdout:{"message":"","return_code":0} 2024-09-13T17:19:34.375 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T17:19:34.376 DEBUG:teuthology.orchestra.run.smithi005:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-13T17:19:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 -- start start 2024-09-13T17:19:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 Processor -- start 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d33d2c00 0x55c9d346c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 0x55c9d346cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3403e00 con 0x55c9d33d3c00 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464a00 con 0x55c9d33d2c00 2024-09-13T17:19:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.414+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464500 con 0x55c9d33d3800 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40764/0 (socket says 172.21.15.5:40764) 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 -- 172.21.15.5:0/2243527821 learned_addr learned my addr 172.21.15.5:0/2243527821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911719640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d33d2c00 0x55c9d346c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0910f18640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 0x55c9d346cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 -- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 msgr2=0x55c9d346cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 0x55c9d346cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 -- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d33d2c00 msgr2=0x55c9d346c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d33d2c00 0x55c9d346c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 -- 172.21.15.5:0/2243527821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d33f89c0 con 0x55c9d33d3c00 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0910f18640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 0x55c9d346cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0911f1a640 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x55c9d36ba6f0 tx=0x55c9d4169080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f85e649a1b61ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f090ef14640 1 -- 172.21.15.5:0/2243527821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497080 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f090ef14640 1 -- 172.21.15.5:0/2243527821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9d36c2000 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f090ef14640 1 -- 172.21.15.5:0/2243527821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497600 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9d33f8d00 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c9d33f89c0 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0912f73280 4 waiting for MDS map... 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f090ef14640 1 -- 172.21.15.5:0/2243527821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x55c9d33fe380 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f090ef14640 1 -- 172.21.15.5:0/2243527821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 60) v1 ==== 3130+0+0 (secure 0 0 0) 0x55c9d3425200 con 0x55c9d33d3c00 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.415+0000 7f0912f73280 4 Got MDS map 60 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.416+0000 7f0912f73280 10 main: main 2024-09-13T17:19:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.416+0000 7f0912f73280 4 main: connecting to RADOS... 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.416+0000 7f0912f73280 1 Processor -- start 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.416+0000 7f0912f73280 1 -- start start 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d41a3c00 0x55c9d346d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d3736400 0x55c9d346e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d34643c0 con 0x55c9d3736000 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464280 con 0x55c9d3736400 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464780 con 0x55c9d41a3c00 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40768/0 (socket says 172.21.15.5:40768) 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 -- 172.21.15.5:0/3663920651 learned_addr learned my addr 172.21.15.5:0/3663920651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 -- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d41a3c00 msgr2=0x55c9d346d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d41a3c00 0x55c9d346d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 -- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d3736400 msgr2=0x55c9d346e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d3736400 0x55c9d346e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 -- 172.21.15.5:0/3663920651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d33f8b60 con 0x55c9d3736000 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f0911719640 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x55c9d36bbe00 tx=0x55c9d36eac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b7ca38f19f70bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f090cf10640 1 -- 172.21.15.5:0/3663920651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497080 con 0x55c9d3736000 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f090cf10640 1 -- 172.21.15.5:0/3663920651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9d36c2600 con 0x55c9d3736000 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.417+0000 7f090cf10640 1 -- 172.21.15.5:0/3663920651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497600 con 0x55c9d3736000 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- 172.21.15.5:0/3663920651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 msgr2=0x55c9d346db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x55c9d36bbe00 tx=0x55c9d36eac00 comp rx=0 tx=0).stop 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- 172.21.15.5:0/3663920651 shutdown_connections 2024-09-13T17:19:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d3736400 0x55c9d346e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736000 0x55c9d346db80 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 --2- 172.21.15.5:0/3663920651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d41a3c00 0x55c9d346d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- 172.21.15.5:0/3663920651 >> 172.21.15.5:0/3663920651 conn(0x55c9d41a3800 msgr2=0x55c9d414e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- 172.21.15.5:0/3663920651 shutdown_connections 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- 172.21.15.5:0/3663920651 wait complete. 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 Processor -- start 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.418+0000 7f0912f73280 1 -- start start 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d41a3800 0x55c9d346f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d3737000 0x55c9d346ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 0x55c9d346e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464500 con 0x55c9d3736c00 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464140 con 0x55c9d41a3800 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0912f73280 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d3464000 con 0x55c9d3737000 2024-09-13T17:19:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 0x55c9d346e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 0x55c9d346e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40774/0 (socket says 172.21.15.5:40774) 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 learned_addr learned my addr 172.21.15.5:0/1946062008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0911719640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d3737000 0x55c9d346ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d41a3800 0x55c9d346f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d3737000 msgr2=0x55c9d346ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d3737000 0x55c9d346ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d41a3800 msgr2=0x55c9d346f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.419+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d41a3800 0x55c9d346f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d33f8820 con 0x55c9d3736c00 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 0x55c9d346e680 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x55c9d3748cf0 tx=0x55c9d36eaea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f090b70d640 1 -- 172.21.15.5:0/1946062008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497080 con 0x55c9d3736c00 2024-09-13T17:19:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f090b70d640 1 -- 172.21.15.5:0/1946062008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9d36c3500 con 0x55c9d3736c00 2024-09-13T17:19:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9d33f84e0 con 0x55c9d3736c00 2024-09-13T17:19:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f090b70d640 1 -- 172.21.15.5:0/1946062008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9d3497600 con 0x55c9d3736c00 2024-09-13T17:19:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9d33f81a0 con 0x55c9d3736c00 2024-09-13T17:19:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.420+0000 7f0912f73280 4 main: resolving pool 15 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.421+0000 7f090b70d640 1 -- 172.21.15.5:0/1946062008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x55c9d3443080 con 0x55c9d3736c00 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.421+0000 7f090b70d640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x55c9d3764c00 0x55c9d346f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.421+0000 7f090b70d640 1 -- 172.21.15.5:0/1946062008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x55c9d33fe540 con 0x55c9d3736c00 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.421+0000 7f0912f73280 4 main: creating IoCtx.. 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0912f73280 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x55c9d3736800 0x55c9d346d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- osd_op(unknown.0.0:1 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x55c9d3736400 con 0x55c9d3736800 2024-09-13T17:19:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0911719640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x55c9d3764c00 0x55c9d346f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x55c9d3736800 0x55c9d346d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0910f18640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x55c9d3736800 0x55c9d346d600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0911719640 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x55c9d3764c00 0x55c9d346f700 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55c9d36bbe00 tx=0x55c9d36bccc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 <== osd.2 v2:172.21.15.5:6816/2157447166 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x55c9d36b8b40 con 0x55c9d3736800 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.422+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- osd_op(unknown.0.0:2 15.b 15:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x55c9d3736000 con 0x55c9d3736800 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0910f18640 1 -- 172.21.15.5:0/1946062008 <== osd.2 v2:172.21.15.5:6816/2157447166 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x55c9d36b8b40 con 0x55c9d3736800 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:34.433 INFO:teuthology.orchestra.run.smithi005.stdout: "0": { 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: "data": { 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions": [] 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: "result": 0 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:34.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x55c9d3736800 msgr2=0x55c9d346d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x55c9d3736800 0x55c9d346d600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x55c9d3764c00 msgr2=0x55c9d346f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x55c9d3764c00 0x55c9d346f700 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55c9d36bbe00 tx=0x55c9d36bccc0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 msgr2=0x55c9d346e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/1946062008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d3736c00 0x55c9d346e680 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x55c9d3748cf0 tx=0x55c9d36eaea0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0911719640 1 -- 172.21.15.5:0/1946062008 reap_dead start 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 shutdown_connections 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 >> 172.21.15.5:0/1946062008 conn(0x55c9d41a3c00 msgr2=0x55c9d414e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 shutdown_connections 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/1946062008 wait complete. 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 msgr2=0x55c9d346d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x55c9d36ba6f0 tx=0x55c9d4169080 comp rx=0 tx=0).stop 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 shutdown_connections 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9d33d3c00 0x55c9d346d080 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9d33d3800 0x55c9d346cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 --2- 172.21.15.5:0/2243527821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9d33d2c00 0x55c9d346c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 >> 172.21.15.5:0/2243527821 conn(0x55c9d33d3000 msgr2=0x55c9d414f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 shutdown_connections 2024-09-13T17:19:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.423+0000 7f0912f73280 1 -- 172.21.15.5:0/2243527821 wait complete. 2024-09-13T17:19:34.440 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.064041, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T17:19:34.440 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-13T17:19:34.440 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:19:34.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:19:34.521 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:19:34.573 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:19:34.573 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:34.574 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:34.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:19:34.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:19:34.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:34.590 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:19:34.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T17:19:34.646 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:34.646 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:34.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:19:34.665 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:19:34.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:34.665 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:19:34.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:34.723 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T17:19:34.724 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:34.724 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:34.740 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:19:34.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:19:34.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:34.740 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:19:34.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T17:19:34.796 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:34.796 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:34.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:19:34.815 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:19:34.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:34.815 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:19:34.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:19:34.873 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T17:19:34.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.974+0000 7fb79c15e640 1 Processor -- start 2024-09-13T17:19:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.974+0000 7fb79c15e640 1 -- start start 2024-09-13T17:19:34.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79c15e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb79406e330 0x7fb79415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79c15e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 0x7fb7940b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79c15e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb794156ff0 con 0x7fb79415fc50 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79c15e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7940b2610 con 0x7fb79406e330 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79c15e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79406e8b0 con 0x7fb7940b1c60 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb79406e330 0x7fb79415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb79406e330 0x7fb79415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40786/0 (socket says 172.21.15.5:40786) 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb799efa640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb79415fc50 0x7fb79415d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54088/0 (socket says 172.21.15.5:54088) 2024-09-13T17:19:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 -- 172.21.15.5:0/817465237 learned_addr learned my addr 172.21.15.5:0/817465237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79a6fb640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 0x7fb7940b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 -- 172.21.15.5:0/817465237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 msgr2=0x7fb7940b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 0x7fb7940b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 -- 172.21.15.5:0/817465237 >> v1:172.21.15.5:6789/0 conn(0x7fb79415fc50 legacy=0x7fb79415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb798ef8640 1 -- 172.21.15.5:0/817465237 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215313594 0 0) 0x7fb794156ff0 con 0x7fb79415fc50 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb7996f9640 1 -- 172.21.15.5:0/817465237 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794069ef0 con 0x7fb79406e330 2024-09-13T17:19:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.975+0000 7fb79a6fb640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 0x7fb7940b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb7996f9640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb79406e330 0x7fb79415dc80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb784009870 tx=0x7fb78402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436fdcf5bc68cb3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb798ef8640 1 -- 172.21.15.5:0/817465237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784032440 con 0x7fb79406e330 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb798ef8640 1 -- 172.21.15.5:0/817465237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7840325a0 con 0x7fb79406e330 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb798ef8640 1 -- 172.21.15.5:0/817465237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784032930 con 0x7fb79406e330 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb79c15e640 1 -- 172.21.15.5:0/817465237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb79406e330 msgr2=0x7fb79415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb79c15e640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb79406e330 0x7fb79415dc80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb784009870 tx=0x7fb78402a270 comp rx=0 tx=0).stop 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb79c15e640 1 -- 172.21.15.5:0/817465237 shutdown_connections 2024-09-13T17:19:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.976+0000 7fb79c15e640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940b1c60 0x7fb7940b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.977+0000 7fb79c15e640 1 --2- 172.21.15.5:0/817465237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb79406e330 0x7fb79415dc80 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.977+0000 7fb79c15e640 1 -- 172.21.15.5:0/817465237 >> 172.21.15.5:0/817465237 conn(0x7fb7940cebb0 msgr2=0x7fb7940cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.977+0000 7fb79c15e640 1 -- 172.21.15.5:0/817465237 shutdown_connections 2024-09-13T17:19:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.977+0000 7fb79c15e640 1 -- 172.21.15.5:0/817465237 wait complete. 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.978+0000 7fb79c15e640 1 Processor -- start 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.978+0000 7fb79c15e640 1 -- start start 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406e330 0x7fb794156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb79406abb0 0x7fb79406b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794159630 con 0x7fb7940b1c60 2024-09-13T17:19:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79406b5a0 con 0x7fb79406e330 2024-09-13T17:19:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79c15e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb794156d50 con 0x7fb79406abb0 2024-09-13T17:19:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40796/0 (socket says 172.21.15.5:40796) 2024-09-13T17:19:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 -- 172.21.15.5:0/2159220973 learned_addr learned my addr 172.21.15.5:0/2159220973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb79a6fb640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb79406abb0 0x7fb79406b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb799efa640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406e330 0x7fb794156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 -- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb79406abb0 msgr2=0x7fb79406b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb79406abb0 0x7fb79406b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 -- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406e330 msgr2=0x7fb794156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:34.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406e330 0x7fb794156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 -- 172.21.15.5:0/2159220973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7840094d0 con 0x7fb7940b1c60 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb7996f9640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb784000c00 tx=0x7fb7840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.979+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784032440 con 0x7fb7940b1c60 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.980+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb794158150 con 0x7fb7940b1c60 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.980+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784030b80 con 0x7fb7940b1c60 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.980+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78403d440 con 0x7fb7940b1c60 2024-09-13T17:19:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.980+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7941f3400 con 0x7fb7940b1c60 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.981+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb794159770 con 0x7fb7940b1c60 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.981+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb784039040 con 0x7fb7940b1c60 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.981+0000 7fb78a7fc640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 0x7fb77806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.982+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb7840aa030 con 0x7fb7940b1c60 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.982+0000 7fb799efa640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 0x7fb77806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.982+0000 7fb799efa640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 0x7fb77806d0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb790000f60 tx=0x7fb790007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:34.986+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb794159770 con 0x7fb7940b1c60 2024-09-13T17:19:35.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.196+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb794159770 con 0x7fb7940b1c60 2024-09-13T17:19:35.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.196+0000 7fb78a7fc640 1 -- 172.21.15.5:0/2159220973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7fb794159770 con 0x7fb7940b1c60 2024-09-13T17:19:35.198 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:35.199 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:07.904884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:35.199 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2024-09-13T17:19:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 msgr2=0x7fb77806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 0x7fb77806d0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb790000f60 tx=0x7fb790007c00 comp rx=0 tx=0).stop 2024-09-13T17:19:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 msgr2=0x7fb7941f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb784000c00 tx=0x7fb7840046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 shutdown_connections 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb79406abb0 0x7fb79406b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb77806ac00 0x7fb77806d0c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7940b1c60 0x7fb7941f2ec0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 --2- 172.21.15.5:0/2159220973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406e330 0x7fb794156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.198+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 >> 172.21.15.5:0/2159220973 conn(0x7fb7940cebb0 msgr2=0x7fb7940cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.199+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 shutdown_connections 2024-09-13T17:19:35.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.199+0000 7fb79c15e640 1 -- 172.21.15.5:0/2159220973 wait complete. 2024-09-13T17:19:35.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.311+0000 7fb778620640 1 Processor -- start 2024-09-13T17:19:35.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.311+0000 7fb778620640 1 -- start start 2024-09-13T17:19:35.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb778620640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb778620640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb770070af0 0x7fb77015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb778620640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb770070f50 con 0x7fb77015d240 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb778620640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77015da70 con 0x7fb770070af0 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb778620640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015dd70 con 0x7fb770156c20 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb775bbb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb770070af0 0x7fb77015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb7763bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb776bbd640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb77015d240 0x7fb77015eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:53538/0 (socket says 172.21.15.5:53538) 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb775bbb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb770070af0 0x7fb77015cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb776bbd640 1 -- 172.21.15.5:0/3959616674 learned_addr learned my addr 172.21.15.5:0/3959616674 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.312+0000 7fb7763bc640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:56124/0 (socket says 172.21.15.5:56124) 2024-09-13T17:19:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb775bbb640 1 -- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 msgr2=0x7fb7700705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb775bbb640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb775bbb640 1 -- 172.21.15.5:0/3959616674 >> v1:172.21.15.179:6789/0 conn(0x7fb77015d240 legacy=0x7fb77015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb775bbb640 1 -- 172.21.15.5:0/3959616674 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77015e050 con 0x7fb770070af0 2024-09-13T17:19:35.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb7763bc640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.313+0000 7fb775bbb640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770070af0 0x7fb77015cd00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb7600097a0 tx=0x7fb76002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d697f9ec4cd5b079 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb7753ba640 1 -- 172.21.15.5:0/3959616674 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760032440 con 0x7fb770070af0 2024-09-13T17:19:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb7753ba640 1 -- 172.21.15.5:0/3959616674 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600325a0 con 0x7fb770070af0 2024-09-13T17:19:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb7753ba640 1 -- 172.21.15.5:0/3959616674 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760032930 con 0x7fb770070af0 2024-09-13T17:19:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 -- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770070af0 msgr2=0x7fb77015cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770070af0 0x7fb77015cd00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb7600097a0 tx=0x7fb76002a180 comp rx=0 tx=0).stop 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 -- 172.21.15.5:0/3959616674 shutdown_connections 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770070af0 0x7fb77015cd00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 --2- 172.21.15.5:0/3959616674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770156c20 0x7fb7700705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 -- 172.21.15.5:0/3959616674 >> 172.21.15.5:0/3959616674 conn(0x7fb77006a480 msgr2=0x7fb7700b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 -- 172.21.15.5:0/3959616674 shutdown_connections 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.314+0000 7fb778620640 1 -- 172.21.15.5:0/3959616674 wait complete. 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.315+0000 7fb778620640 1 Processor -- start 2024-09-13T17:19:35.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.315+0000 7fb778620640 1 -- start start 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770070af0 0x7fb7700c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 0x7fb7701592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770159810 con 0x7fb77015d240 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c5800 con 0x7fb770156c20 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb778620640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c4760 con 0x7fb770070af0 2024-09-13T17:19:35.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb776bbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb776bbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40798/0 (socket says 172.21.15.5:40798) 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.316+0000 7fb776bbd640 1 -- 172.21.15.5:0/3134853422 learned_addr learned my addr 172.21.15.5:0/3134853422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb775bbb640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 0x7fb7701592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb7763bc640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770070af0 0x7fb7700c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 -- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770070af0 msgr2=0x7fb7700c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770070af0 0x7fb7700c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 -- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 msgr2=0x7fb7701592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 0x7fb7701592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 -- 172.21.15.5:0/3134853422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009400 con 0x7fb77015d240 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb775bbb640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 0x7fb7701592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb776bbd640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cbf0 tx=0x7fb76800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800ad40 con 0x7fb77015d240 2024-09-13T17:19:35.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768012400 con 0x7fb77015d240 2024-09-13T17:19:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb760009400 con 0x7fb77015d240 2024-09-13T17:19:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800aea0 con 0x7fb77015d240 2024-09-13T17:19:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.317+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700c4af0 con 0x7fb77015d240 2024-09-13T17:19:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.318+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77015cd00 con 0x7fb77015d240 2024-09-13T17:19:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.318+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb768007070 con 0x7fb77015d240 2024-09-13T17:19:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.319+0000 7fb766ffd640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 0x7fb75406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.319+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb768089390 con 0x7fb77015d240 2024-09-13T17:19:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.319+0000 7fb7763bc640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 0x7fb75406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.320+0000 7fb7763bc640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 0x7fb75406d0c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009b80 tx=0x7fb76c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.323+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb768054400 con 0x7fb77015d240 2024-09-13T17:19:35.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.494+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb77015a4b0 con 0x7fb77015d240 2024-09-13T17:19:35.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.495+0000 7fb766ffd640 1 -- 172.21.15.5:0/3134853422 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7fb768057a20 con 0x7fb77015d240 2024-09-13T17:19:35.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:35.497 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 msgr2=0x7fb75406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 0x7fb75406d0c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009b80 tx=0x7fb76c008040 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 msgr2=0x7fb77006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fb76800cbf0 tx=0x7fb76800a430 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 shutdown_connections 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb75406ac00 0x7fb75406d0c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77015d240 0x7fb77006e0b0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb770156c20 0x7fb7701592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 --2- 172.21.15.5:0/3134853422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb770070af0 0x7fb7700c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 >> 172.21.15.5:0/3134853422 conn(0x7fb77006a480 msgr2=0x7fb7700af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 shutdown_connections 2024-09-13T17:19:35.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.497+0000 7fb778620640 1 -- 172.21.15.5:0/3134853422 wait complete. 2024-09-13T17:19:35.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:13:03.298806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:18:30.638720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:18:31.377718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:19:35.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:19:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.613+0000 7fa11f6c9640 1 Processor -- start 2024-09-13T17:19:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.613+0000 7fa11f6c9640 1 -- start start 2024-09-13T17:19:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11f6c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1181591f0 0x7fa1180c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11f6c9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1181595d0 0x7fa11815d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11f6c9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180c8e50 con 0x7fa11815d8c0 2024-09-13T17:19:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11f6c9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180c9420 con 0x7fa1181591f0 2024-09-13T17:19:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11f6c9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11815dcc0 con 0x7fa1181595d0 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1181591f0 0x7fa1180c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1181591f0 0x7fa1180c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40808/0 (socket says 172.21.15.5:40808) 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 -- 172.21.15.5:0/2576277210 learned_addr learned my addr 172.21.15.5:0/2576277210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11dc66640 1 --1- 172.21.15.5:0/2576277210 >> v1:172.21.15.5:6789/0 conn(0x7fa11815d8c0 0x7fa118070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54090/0 (socket says 172.21.15.5:54090) 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11cc64640 1 --2- 172.21.15.5:0/2576277210 >> v2:172.21.15.179:3300/0 conn(0x7fa1181595d0 0x7fa11815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 -- 172.21.15.5:0/2576277210 >> v2:172.21.15.179:3300/0 conn(0x7fa1181595d0 msgr2=0x7fa11815d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 --2- 172.21.15.5:0/2576277210 >> v2:172.21.15.179:3300/0 conn(0x7fa1181595d0 0x7fa11815d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 -- 172.21.15.5:0/2576277210 >> v1:172.21.15.5:6789/0 conn(0x7fa11815d8c0 legacy=0x7fa118070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa10ffff640 1 -- 172.21.15.5:0/2576277210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255028096 0 0) 0x7fa1180c8e50 con 0x7fa11815d8c0 2024-09-13T17:19:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.614+0000 7fa11d465640 1 -- 172.21.15.5:0/2576277210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118159db0 con 0x7fa1181591f0 2024-09-13T17:19:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.615+0000 7fa11d465640 1 --2- 172.21.15.5:0/2576277210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181591f0 0x7fa1180c8910 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa1180cc500 tx=0x7fa11402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba4111952305f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.615+0000 7fa10ffff640 1 -- 172.21.15.5:0/2576277210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114032440 con 0x7fa1181591f0 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.615+0000 7fa10ffff640 1 -- 172.21.15.5:0/2576277210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1140325a0 con 0x7fa1181591f0 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.615+0000 7fa10ffff640 1 -- 172.21.15.5:0/2576277210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114032930 con 0x7fa1181591f0 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 -- 172.21.15.5:0/2576277210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181591f0 msgr2=0x7fa1180c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/2576277210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181591f0 0x7fa1180c8910 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa1180cc500 tx=0x7fa11402a270 comp rx=0 tx=0).stop 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 -- 172.21.15.5:0/2576277210 shutdown_connections 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/2576277210 >> v2:172.21.15.179:3300/0 conn(0x7fa1181595d0 0x7fa11815d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/2576277210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181591f0 0x7fa1180c8910 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 -- 172.21.15.5:0/2576277210 >> 172.21.15.5:0/2576277210 conn(0x7fa1180ce380 msgr2=0x7fa1180ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 -- 172.21.15.5:0/2576277210 shutdown_connections 2024-09-13T17:19:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.616+0000 7fa11f6c9640 1 -- 172.21.15.5:0/2576277210 wait complete. 2024-09-13T17:19:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.617+0000 7fa11f6c9640 1 Processor -- start 2024-09-13T17:19:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.617+0000 7fa11f6c9640 1 -- start start 2024-09-13T17:19:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1181591f0 0x7fa118150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 0x7fa1180af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180c3470 con 0x7fa1181595d0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180ac030 con 0x7fa11815d8c0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180ab4b0 con 0x7fa1181591f0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40814/0 (socket says 172.21.15.5:40814) 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 -- 172.21.15.5:0/78456230 learned_addr learned my addr 172.21.15.5:0/78456230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11d465640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1181591f0 0x7fa118150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11dc66640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 0x7fa1180af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 -- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1181591f0 msgr2=0x7fa118150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1181591f0 0x7fa118150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 -- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 msgr2=0x7fa1180af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 0x7fa1180af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 -- 172.21.15.5:0/78456230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140094d0 con 0x7fa1181595d0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11dc66640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 0x7fa1180af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11cc64640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa10800d830 tx=0x7fa10800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10800b6c0 con 0x7fa1181595d0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10800b820 con 0x7fa1181595d0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10800bbb0 con 0x7fa1181595d0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.618+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1180ab790 con 0x7fa1181595d0 2024-09-13T17:19:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.619+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1180abd50 con 0x7fa1181595d0 2024-09-13T17:19:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.620+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1180672d0 con 0x7fa1181595d0 2024-09-13T17:19:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.620+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa10801e460 con 0x7fa1181595d0 2024-09-13T17:19:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.621+0000 7fa10dffb640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 0x7fa0fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.621+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fa108089e30 con 0x7fa1181595d0 2024-09-13T17:19:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.621+0000 7fa11d465640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 0x7fa0fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.621+0000 7fa11d465640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 0x7fa0fc06d0c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa114034000 tx=0x7fa11402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.625+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa108054cd0 con 0x7fa1181595d0 2024-09-13T17:19:35.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.797+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa11815d280 con 0x7fa1181595d0 2024-09-13T17:19:35.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.798+0000 7fa10dffb640 1 -- 172.21.15.5:0/78456230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1080582f0 con 0x7fa1181595d0 2024-09-13T17:19:35.800 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-13T17:19:35.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 msgr2=0x7fa0fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 0x7fa0fc06d0c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa114034000 tx=0x7fa11402e000 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 msgr2=0x7fa1180aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa10800d830 tx=0x7fa10800dcf0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 shutdown_connections 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa11815d8c0 0x7fa1180af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa0fc06ac00 0x7fa0fc06d0c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1181595d0 0x7fa1180aecb0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 --2- 172.21.15.5:0/78456230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1181591f0 0x7fa118150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 >> 172.21.15.5:0/78456230 conn(0x7fa1180ce380 msgr2=0x7fa118157160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 shutdown_connections 2024-09-13T17:19:35.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.800+0000 7fa11f6c9640 1 -- 172.21.15.5:0/78456230 wait complete. 2024-09-13T17:19:35.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:19:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.915+0000 7fe570419640 1 Processor -- start 2024-09-13T17:19:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.915+0000 7fe570419640 1 -- start start 2024-09-13T17:19:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe570419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe56806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe570419640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5680b16b0 0x7fe5680cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe570419640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe568160130 con 0x7fe5680cc1d0 2024-09-13T17:19:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe570419640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680cc680 con 0x7fe5680b16b0 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe570419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680ceaa0 con 0x7fe56815fd50 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe56d9b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5680b16b0 0x7fe5680cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe56d9b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5680b16b0 0x7fe5680cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40828/0 (socket says 172.21.15.5:40828) 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe56e9b6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5680cc1d0 0x7fe568160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54094/0 (socket says 172.21.15.5:54094) 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.916+0000 7fe56d9b4640 1 -- 172.21.15.5:0/3101152856 learned_addr learned my addr 172.21.15.5:0/3101152856 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56e1b5640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe56806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d9b4640 1 -- 172.21.15.5:0/3101152856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 msgr2=0x7fe56806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d9b4640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe56806a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d9b4640 1 -- 172.21.15.5:0/3101152856 >> v1:172.21.15.5:6789/0 conn(0x7fe5680cc1d0 legacy=0x7fe568160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d1b3640 1 -- 172.21.15.5:0/3101152856 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367694082 0 0) 0x7fe568160130 con 0x7fe5680cc1d0 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d9b4640 1 -- 172.21.15.5:0/3101152856 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680ced80 con 0x7fe5680b16b0 2024-09-13T17:19:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.917+0000 7fe56d9b4640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680b16b0 0x7fe5680cbc90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe55802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503e7eb0ace6496d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe56d1b3640 1 -- 172.21.15.5:0/3101152856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558032640 con 0x7fe5680b16b0 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe56d1b3640 1 -- 172.21.15.5:0/3101152856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5580327a0 con 0x7fe5680b16b0 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe56d1b3640 1 -- 172.21.15.5:0/3101152856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558032b30 con 0x7fe5680b16b0 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 -- 172.21.15.5:0/3101152856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680b16b0 msgr2=0x7fe5680cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680b16b0 0x7fe5680cbc90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe55802a300 comp rx=0 tx=0).stop 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 -- 172.21.15.5:0/3101152856 shutdown_connections 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680b16b0 0x7fe5680cbc90 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 --2- 172.21.15.5:0/3101152856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe56806a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 -- 172.21.15.5:0/3101152856 >> 172.21.15.5:0/3101152856 conn(0x7fe568098a70 msgr2=0x7fe5680b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 -- 172.21.15.5:0/3101152856 shutdown_connections 2024-09-13T17:19:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.918+0000 7fe570419640 1 -- 172.21.15.5:0/3101152856 wait complete. 2024-09-13T17:19:35.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.919+0000 7fe570419640 1 Processor -- start 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.919+0000 7fe570419640 1 -- start start 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5680b16b0 0x7fe5681f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe568156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681efeb0 con 0x7fe5680cc1d0 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681587e0 con 0x7fe5680b16b0 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe570419640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681567c0 con 0x7fe56815fd50 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56d9b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56d9b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40834/0 (socket says 172.21.15.5:40834) 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56d9b4640 1 -- 172.21.15.5:0/1957444657 learned_addr learned my addr 172.21.15.5:0/1957444657 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56e1b5640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5680b16b0 0x7fe5681f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56e9b6640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe568156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.920+0000 7fe56d9b4640 1 -- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 msgr2=0x7fe568156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56d9b4640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe568156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56d9b4640 1 -- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5680b16b0 msgr2=0x7fe5681f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56d9b4640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5680b16b0 0x7fe5681f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56d9b4640 1 -- 172.21.15.5:0/1957444657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580094d0 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56e9b6640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe568156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe56d9b4640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558004230 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558004390 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe568156a60 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55803e960 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.921+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe568157020 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.922+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5680672d0 con 0x7fe5680cc1d0 2024-09-13T17:19:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.922+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe55803eac0 con 0x7fe5680cc1d0 2024-09-13T17:19:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.923+0000 7fe55effd640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.923+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fe5580aa8f0 con 0x7fe5680cc1d0 2024-09-13T17:19:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.923+0000 7fe56e1b5640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:35.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.924+0000 7fe56e1b5640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 0x7fe54c06d0c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe564006fd0 tx=0x7fe564008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:35.927+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe558075a70 con 0x7fe5680cc1d0 2024-09-13T17:19:36.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.100+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5680cbc90 con 0x7fe5680cc1d0 2024-09-13T17:19:36.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.100+0000 7fe55effd640 1 -- 172.21.15.5:0/1957444657 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe558079090 con 0x7fe5680cc1d0 2024-09-13T17:19:36.102 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-13T17:19:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 msgr2=0x7fe54c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 0x7fe54c06d0c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe564006fd0 tx=0x7fe564008040 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 msgr2=0x7fe5681ef970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe5580046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 shutdown_connections 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe56815fd50 0x7fe568156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5680cc1d0 0x7fe5681ef970 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 --2- 172.21.15.5:0/1957444657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5680b16b0 0x7fe5681f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 >> 172.21.15.5:0/1957444657 conn(0x7fe568098a70 msgr2=0x7fe5680b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 shutdown_connections 2024-09-13T17:19:36.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.102+0000 7fe570419640 1 -- 172.21.15.5:0/1957444657 wait complete. 2024-09-13T17:19:36.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:19:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.218+0000 7f1f92096640 1 Processor -- start 2024-09-13T17:19:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.218+0000 7f1f92096640 1 -- start start 2024-09-13T17:19:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f92096640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f8c0cc3a0 0x7f1f8c167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f92096640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c160130 con 0x7f1f8c15fd50 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f92096640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c06ad80 con 0x7f1f8c06a960 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f92096640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0ceaa0 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f8c0cc3a0 0x7f1f8c167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f8c0cc3a0 0x7f1f8c167680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40836/0 (socket says 172.21.15.5:40836) 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 -- 172.21.15.5:0/2874234134 learned_addr learned my addr 172.21.15.5:0/2874234134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 -- 172.21.15.5:0/2874234134 >> v1:172.21.15.179:6789/0 conn(0x7f1f8c06a960 legacy=0x7f1f8c0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 -- 172.21.15.5:0/2874234134 >> v1:172.21.15.5:6789/0 conn(0x7f1f8c15fd50 legacy=0x7f1f8c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8bfff640 1 -- 172.21.15.5:0/2874234134 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0ced80 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.219+0000 7f1f8a7fc640 1 -- 172.21.15.5:0/2874234134 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157031634 0 0) 0x7f1f8c160130 con 0x7f1f8c15fd50 2024-09-13T17:19:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.220+0000 7f1f8bfff640 1 --2- 172.21.15.5:0/2874234134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c0cc3a0 0x7f1f8c167680 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009e50 tx=0x7f1f8402a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b991fb855aa07c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.220+0000 7f1f8a7fc640 1 -- 172.21.15.5:0/2874234134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84031600 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.220+0000 7f1f8a7fc640 1 -- 172.21.15.5:0/2874234134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8402d050 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.220+0000 7f1f8a7fc640 1 -- 172.21.15.5:0/2874234134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84031980 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 -- 172.21.15.5:0/2874234134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c0cc3a0 msgr2=0x7f1f8c167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 --2- 172.21.15.5:0/2874234134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c0cc3a0 0x7f1f8c167680 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009e50 tx=0x7f1f8402a7f0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 -- 172.21.15.5:0/2874234134 shutdown_connections 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 --2- 172.21.15.5:0/2874234134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c0cc3a0 0x7f1f8c167680 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 -- 172.21.15.5:0/2874234134 >> 172.21.15.5:0/2874234134 conn(0x7f1f8c098a70 msgr2=0x7f1f8c0b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 -- 172.21.15.5:0/2874234134 shutdown_connections 2024-09-13T17:19:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.221+0000 7f1f92096640 1 -- 172.21.15.5:0/2874234134 wait complete. 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.222+0000 7f1f92096640 1 Processor -- start 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.222+0000 7f1f92096640 1 -- start start 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f8c0cc3a0 0x7f1f8c0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8c15fd50 0x7f1f8c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c6580 con 0x7f1f8c06a960 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b38f0 con 0x7f1f8c15fd50 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f92096640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b3bd0 con 0x7f1f8c0cc3a0 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40838/0 (socket says 172.21.15.5:40838) 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 -- 172.21.15.5:0/3426943781 learned_addr learned my addr 172.21.15.5:0/3426943781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 -- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f8c0cc3a0 msgr2=0x7f1f8c0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f8c0cc3a0 0x7f1f8c0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 -- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8c15fd50 msgr2=0x7f1f8c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8c15fd50 0x7f1f8c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.223+0000 7f1f8b7fe640 1 -- 172.21.15.5:0/3426943781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84009b30 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f8b7fe640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c410 tx=0x7f1f7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0035f0 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c003770 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c0b3eb0 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c003b20 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.224+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0b2bc0 con 0x7f1f8c06a960 2024-09-13T17:19:36.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.225+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c0c6330 con 0x7f1f8c06a960 2024-09-13T17:19:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.225+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f7c003c80 con 0x7f1f8c06a960 2024-09-13T17:19:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.226+0000 7f1f73fff640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 0x7f1f7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.226+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f1f7c088bd0 con 0x7f1f8c06a960 2024-09-13T17:19:36.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.226+0000 7f1f8affd640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 0x7f1f7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.227+0000 7f1f8affd640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 0x7f1f7806d0c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0c9660 tx=0x7f1f800079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.230+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f7c053ba0 con 0x7f1f8c06a960 2024-09-13T17:19:36.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.402+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f8c0672d0 con 0x7f1f8c06a960 2024-09-13T17:19:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.403+0000 7f1f73fff640 1 -- 172.21.15.5:0/3426943781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f7c017020 con 0x7f1f8c06a960 2024-09-13T17:19:36.405 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 msgr2=0x7f1f7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 0x7f1f7806d0c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0c9660 tx=0x7f1f800079b0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 msgr2=0x7f1f8c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c410 tx=0x7f1f7c00c8d0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 shutdown_connections 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f8c15fd50 0x7f1f8c0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f8c0cc3a0 0x7f1f8c0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1f7806ac00 0x7f1f7806d0c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 --2- 172.21.15.5:0/3426943781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8c06a960 0x7f1f8c1530e0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 >> 172.21.15.5:0/3426943781 conn(0x7f1f8c098a70 msgr2=0x7f1f8c0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 shutdown_connections 2024-09-13T17:19:36.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.405+0000 7f1f92096640 1 -- 172.21.15.5:0/3426943781 wait complete. 2024-09-13T17:19:36.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.519+0000 7fc1cb518640 1 Processor -- start 2024-09-13T17:19:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.519+0000 7fc1cb518640 1 -- start start 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 0x7fc1c40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c40ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c406c1a0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c415ae60 con 0x7fc1c41548b0 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1cb518640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c415b140 con 0x7fc1c415a930 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1c9ab5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1c9ab5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40850/0 (socket says 172.21.15.5:40850) 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1c9ab5640 1 -- 172.21.15.5:0/2817012918 learned_addr learned my addr 172.21.15.5:0/2817012918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:36.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1c8ab3640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c40ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.520+0000 7fc1c92b4640 1 --2- 172.21.15.5:0/2817012918 >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 0x7fc1c40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 -- 172.21.15.5:0/2817012918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 msgr2=0x7fc1c40ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c40ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 -- 172.21.15.5:0/2817012918 >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 msgr2=0x7fc1c40706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 --2- 172.21.15.5:0/2817012918 >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 0x7fc1c40706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 -- 172.21.15.5:0/2817012918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c415b420 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c92b4640 1 --2- 172.21.15.5:0/2817012918 >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 0x7fc1c40706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c9ab5640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40cf270 tx=0x7fc1bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0def02f359110d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.521+0000 7fc1c3fff640 1 -- 172.21.15.5:0/2817012918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc032440 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1c3fff640 1 -- 172.21.15.5:0/2817012918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0325a0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1c3fff640 1 -- 172.21.15.5:0/2817012918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc032930 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 -- 172.21.15.5:0/2817012918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 msgr2=0x7fc1c40ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40cf270 tx=0x7fc1bc02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 -- 172.21.15.5:0/2817012918 shutdown_connections 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c40ce6b0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2817012918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c40ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2817012918 >> v2:172.21.15.179:3300/0 conn(0x7fc1c41548b0 0x7fc1c40706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 -- 172.21.15.5:0/2817012918 >> 172.21.15.5:0/2817012918 conn(0x7fc1c406a270 msgr2=0x7fc1c406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 -- 172.21.15.5:0/2817012918 shutdown_connections 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.522+0000 7fc1cb518640 1 -- 172.21.15.5:0/2817012918 wait complete. 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.523+0000 7fc1cb518640 1 Processor -- start 2024-09-13T17:19:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.523+0000 7fc1cb518640 1 -- start start 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c41548b0 0x7fc1c4146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c414d960 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c414dc40 con 0x7fc1c41548b0 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1cb518640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c414df20 con 0x7fc1c415a930 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1c92b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1c92b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40864/0 (socket says 172.21.15.5:40864) 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1c92b4640 1 -- 172.21.15.5:0/2719025155 learned_addr learned my addr 172.21.15.5:0/2719025155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1c92b4640 1 -- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 msgr2=0x7fc1c414b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.524+0000 7fc1c92b4640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c92b4640 1 -- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c41548b0 msgr2=0x7fc1c4146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c92b4640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c41548b0 0x7fc1c4146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c92b4640 1 -- 172.21.15.5:0/2719025155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0094d0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c92b4640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cf60 tx=0x7fc1b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400d840 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400d9a0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c414e200 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400dd30 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.525+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c414bd70 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.526+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c414e720 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.526+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc1b4015440 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.527+0000 7fc1c1ffb640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.527+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fc1b4089f90 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.527+0000 7fc1c8ab3640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.528+0000 7fc1c8ab3640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 0x7fc1b006d0c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8006b10 tx=0x7fc1b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.531+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc1b40bd9c0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.736+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1c4146cb0 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.736+0000 7fc1c1ffb640 1 -- 172.21.15.5:0/2719025155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7fc1b401a070 con 0x7fc1c40ab9c0 2024-09-13T17:19:36.738 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:36.738 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:07.904884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:36.739 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2024-09-13T17:19:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 msgr2=0x7fc1b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 0x7fc1b006d0c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8006b10 tx=0x7fc1b8008040 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 msgr2=0x7fc1c414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cf60 tx=0x7fc1b400cf90 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 shutdown_connections 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1c415a930 0x7fc1c414b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1c41548b0 0x7fc1c4146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 --2- 172.21.15.5:0/2719025155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ab9c0 0x7fc1c414d380 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 >> 172.21.15.5:0/2719025155 conn(0x7fc1c406a270 msgr2=0x7fc1c415dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 shutdown_connections 2024-09-13T17:19:36.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.738+0000 7fc1cb518640 1 -- 172.21.15.5:0/2719025155 wait complete. 2024-09-13T17:19:36.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.850+0000 7fe048b5e640 1 Processor -- start 2024-09-13T17:19:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.850+0000 7fe048b5e640 1 -- start start 2024-09-13T17:19:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.850+0000 7fe048b5e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0441591e0 0x7fe0440acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe048b5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe0440ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe048b5e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440701a0 con 0x7fe0440cebf0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe048b5e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0440cf080 con 0x7fe0441591e0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe048b5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440ac3b0 con 0x7fe0440abf40 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe042d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe0440cebf0 0x7fe0440b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54104/0 (socket says 172.21.15.5:54104) 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe042d9d640 1 -- 172.21.15.5:0/3414419541 learned_addr learned my addr 172.21.15.5:0/3414419541 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe041d9b640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe0440ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220688696 0 0) 0x7fe0440701a0 con 0x7fe0440cebf0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04259c640 1 --2- 172.21.15.5:0/3414419541 >> v2:172.21.15.179:3300/0 conn(0x7fe0441591e0 0x7fe0440acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02c003520 con 0x7fe0440cebf0 2024-09-13T17:19:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213055993 0 0) 0x7fe02c003520 con 0x7fe0440cebf0 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 msgr2=0x7fe0440ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe0440ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 >> v2:172.21.15.179:3300/0 conn(0x7fe0441591e0 msgr2=0x7fe0440acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 --2- 172.21.15.5:0/3414419541 >> v2:172.21.15.179:3300/0 conn(0x7fe0441591e0 0x7fe0440acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440ad540 con 0x7fe0440cebf0 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fe03c0019f0 con 0x7fe0440cebf0 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 >> v1:172.21.15.5:6789/0 conn(0x7fe0440cebf0 legacy=0x7fe0440b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe02c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe02c003ef0 0x7fe02c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe02c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440cf080 con 0x7fe02c004d00 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440ac3b0 con 0x7fe02c003ef0 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c00b9d0 con 0x7fe0440abf40 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.851+0000 7fe042d9d640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe02c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe04259c640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe02c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe041d9b640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe02c003ef0 0x7fe02c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 -- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 msgr2=0x7fe02c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0440abf40 0x7fe02c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 -- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe02c003ef0 msgr2=0x7fe02c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe02c003ef0 0x7fe02c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 -- 172.21.15.5:0/3414419541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c003520 con 0x7fe02c004d00 2024-09-13T17:19:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.852+0000 7fe042d9d640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe02c005180 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00a900 tx=0x7fe02c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bacdb693440301a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c02ba40 con 0x7fe02c004d00 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c02bba0 con 0x7fe02c004d00 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe04159a640 1 -- 172.21.15.5:0/3414419541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c034470 con 0x7fe02c004d00 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 -- 172.21.15.5:0/3414419541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 msgr2=0x7fe02c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 --2- 172.21.15.5:0/3414419541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe02c005180 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00a900 tx=0x7fe02c0057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe042d9d640 1 -- 172.21.15.5:0/3414419541 reap_dead start 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 -- 172.21.15.5:0/3414419541 shutdown_connections 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 -- 172.21.15.5:0/3414419541 >> 172.21.15.5:0/3414419541 conn(0x7fe04406a270 msgr2=0x7fe04406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 -- 172.21.15.5:0/3414419541 shutdown_connections 2024-09-13T17:19:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.853+0000 7fe048b5e640 1 -- 172.21.15.5:0/3414419541 wait complete. 2024-09-13T17:19:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 Processor -- start 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 -- start start 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe04414d240 0x7fe0441558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 0x7fe044150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044165840 con 0x7fe02c004d00 2024-09-13T17:19:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044156690 con 0x7fe044165cd0 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.855+0000 7fe048b5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044155e30 con 0x7fe04414d240 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40878/0 (socket says 172.21.15.5:40878) 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 -- 172.21.15.5:0/2404121902 learned_addr learned my addr 172.21.15.5:0/2404121902 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe042d9d640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 0x7fe044150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe041d9b640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe04414d240 0x7fe0441558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 -- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe04414d240 msgr2=0x7fe0441558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe04414d240 0x7fe0441558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 -- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 msgr2=0x7fe044150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 0x7fe044150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 -- 172.21.15.5:0/2404121902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0441560d0 con 0x7fe02c004d00 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe042d9d640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 0x7fe044150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe04259c640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe034011a70 tx=0x7fe034011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034009680 con 0x7fe02c004d00 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400fb50 con 0x7fe02c004d00 2024-09-13T17:19:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0441563b0 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400fee0 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.856+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04414d6c0 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.857+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04406df80 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.858+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe03401d400 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.858+0000 7fe032ffd640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 0x7fe02406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.858+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fe034089ed0 con 0x7fe02c004d00 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.858+0000 7fe041d9b640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 0x7fe02406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.859+0000 7fe041d9b640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 0x7fe02406d0c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe04409c450 tx=0x7fe038008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:36.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:36.862+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe034054ea0 con 0x7fe02c004d00 2024-09-13T17:19:37.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.036+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0440ce070 con 0x7fe02c004d00 2024-09-13T17:19:37.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.037+0000 7fe032ffd640 1 -- 172.21.15.5:0/2404121902 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7fe0340584c0 con 0x7fe02c004d00 2024-09-13T17:19:37.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:37.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 msgr2=0x7fe02406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 0x7fe02406d0c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe04409c450 tx=0x7fe038008040 comp rx=0 tx=0).stop 2024-09-13T17:19:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 msgr2=0x7fe04414f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe034011a70 tx=0x7fe034011f30 comp rx=0 tx=0).stop 2024-09-13T17:19:37.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 shutdown_connections 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe044165cd0 0x7fe044150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe04414d240 0x7fe0441558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe02406ac00 0x7fe02406d0c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 --2- 172.21.15.5:0/2404121902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe02c004d00 0x7fe04414f680 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 >> 172.21.15.5:0/2404121902 conn(0x7fe04406a270 msgr2=0x7fe0440afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 shutdown_connections 2024-09-13T17:19:37.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.039+0000 7fe048b5e640 1 -- 172.21.15.5:0/2404121902 wait complete. 2024-09-13T17:19:37.052 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:19:37.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.151+0000 7fa136d9c640 1 Processor -- start 2024-09-13T17:19:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.151+0000 7fa136d9c640 1 -- start start 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.151+0000 7fa136d9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1300d0790 0x7fa1300cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa136d9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300b47d0 con 0x7fa130160090 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa136d9c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300d0d00 con 0x7fa1300d16a0 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa136d9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300b3ea0 con 0x7fa1300d0790 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa135339640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1300d0790 0x7fa1300cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa134b38640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa130160090 0x7fa1300d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54120/0 (socket says 172.21.15.5:54120) 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa134b38640 1 -- 172.21.15.5:0/3035261715 learned_addr learned my addr 172.21.15.5:0/3035261715 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa135339640 1 -- 172.21.15.5:0/3035261715 >> v1:172.21.15.179:6789/0 conn(0x7fa1300d16a0 legacy=0x7fa1300cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa135339640 1 -- 172.21.15.5:0/3035261715 >> v1:172.21.15.5:6789/0 conn(0x7fa130160090 legacy=0x7fa1300d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa12f7fe640 1 -- 172.21.15.5:0/3035261715 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786686869 0 0) 0x7fa1300b47d0 con 0x7fa130160090 2024-09-13T17:19:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.152+0000 7fa135339640 1 -- 172.21.15.5:0/3035261715 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300b4180 con 0x7fa1300d0790 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa135339640 1 --2- 172.21.15.5:0/3035261715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300cdb60 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fa128009d90 tx=0x7fa12802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f498f16377bf7e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa12f7fe640 1 -- 172.21.15.5:0/3035261715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128007740 con 0x7fa1300d0790 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa12f7fe640 1 -- 172.21.15.5:0/3035261715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12802d050 con 0x7fa1300d0790 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa12f7fe640 1 -- 172.21.15.5:0/3035261715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128007ac0 con 0x7fa1300d0790 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 -- 172.21.15.5:0/3035261715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 msgr2=0x7fa1300cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 --2- 172.21.15.5:0/3035261715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300cdb60 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fa128009d90 tx=0x7fa12802a660 comp rx=0 tx=0).stop 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 -- 172.21.15.5:0/3035261715 shutdown_connections 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 --2- 172.21.15.5:0/3035261715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300cdb60 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 -- 172.21.15.5:0/3035261715 >> 172.21.15.5:0/3035261715 conn(0x7fa13009b9a0 msgr2=0x7fa13008a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.153+0000 7fa136d9c640 1 -- 172.21.15.5:0/3035261715 shutdown_connections 2024-09-13T17:19:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.154+0000 7fa136d9c640 1 -- 172.21.15.5:0/3035261715 wait complete. 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.155+0000 7fa136d9c640 1 Processor -- start 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.155+0000 7fa136d9c640 1 -- start start 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.155+0000 7fa136d9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 0x7fa13015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1300b54b0 0x7fa1301f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301f6500 con 0x7fa1300d0790 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b5940 con 0x7fa1300d16a0 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b5c20 con 0x7fa1300b54b0 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40902/0 (socket says 172.21.15.5:40902) 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 -- 172.21.15.5:0/1808198744 learned_addr learned my addr 172.21.15.5:0/1808198744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa12ffff640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 0x7fa13015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa135339640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1300b54b0 0x7fa1301f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 -- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1300b54b0 msgr2=0x7fa1301f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1300b54b0 0x7fa1301f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 -- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 msgr2=0x7fa13015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 0x7fa13015ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 -- 172.21.15.5:0/1808198744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128009a70 con 0x7fa1300d0790 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa12ffff640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 0x7fa13015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa134b38640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c410 tx=0x7fa12400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240074e0 con 0x7fa1300d0790 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124007660 con 0x7fa1300d0790 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300b5f00 con 0x7fa1300d0790 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240059e0 con 0x7fa1300d0790 2024-09-13T17:19:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.156+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300b64c0 con 0x7fa1300d0790 2024-09-13T17:19:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.158+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa130067310 con 0x7fa1300d0790 2024-09-13T17:19:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.158+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa124005b40 con 0x7fa1300d0790 2024-09-13T17:19:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.158+0000 7fa12d7fa640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 0x7fa11406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.159+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fa124088b50 con 0x7fa1300d0790 2024-09-13T17:19:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.159+0000 7fa12ffff640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 0x7fa11406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.159+0000 7fa12ffff640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 0x7fa11406d0c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa1300ca860 tx=0x7fa11c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.163+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa124053bd0 con 0x7fa1300d0790 2024-09-13T17:19:37.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.369+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa13015c9d0 con 0x7fa1300d0790 2024-09-13T17:19:37.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.370+0000 7fa12d7fa640 1 -- 172.21.15.5:0/1808198744 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7fa124017020 con 0x7fa1300d0790 2024-09-13T17:19:37.372 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:37.372 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:07.904884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 msgr2=0x7fa11406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 0x7fa11406d0c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa1300ca860 tx=0x7fa11c009040 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 msgr2=0x7fa1300b7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c410 tx=0x7fa12400c8d0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 shutdown_connections 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1300b54b0 0x7fa1301f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1300d16a0 0x7fa13015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa11406ac00 0x7fa11406d0c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 --2- 172.21.15.5:0/1808198744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1300d0790 0x7fa1300b7ec0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 >> 172.21.15.5:0/1808198744 conn(0x7fa13009b9a0 msgr2=0x7fa130073240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 shutdown_connections 2024-09-13T17:19:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.372+0000 7fa136d9c640 1 -- 172.21.15.5:0/1808198744 wait complete. 2024-09-13T17:19:37.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.485+0000 7fce2cc0d640 1 Processor -- start 2024-09-13T17:19:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.485+0000 7fce2cc0d640 1 -- start start 2024-09-13T17:19:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2cc0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2815c4e0 0x7fce2806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2cc0d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce28065e40 0x7fce280abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2cc0d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce28069ef0 con 0x7fce2806d8f0 2024-09-13T17:19:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2cc0d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2806a1d0 con 0x7fce28065e40 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2cc0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2806a4b0 con 0x7fce2815c4e0 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce28065e40 0x7fce280abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce28065e40 0x7fce280abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40904/0 (socket says 172.21.15.5:40904) 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 -- 172.21.15.5:0/3320179468 learned_addr learned my addr 172.21.15.5:0/3320179468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce2659c640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2815c4e0 0x7fce2806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 -- 172.21.15.5:0/3320179468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2815c4e0 msgr2=0x7fce2806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2815c4e0 0x7fce2806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 -- 172.21.15.5:0/3320179468 >> v1:172.21.15.179:6789/0 conn(0x7fce2806d8f0 legacy=0x7fce2806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.486+0000 7fce26d9d640 1 -- 172.21.15.5:0/3320179468 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2806a790 con 0x7fce28065e40 2024-09-13T17:19:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.487+0000 7fce26d9d640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28065e40 0x7fce280abdb0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fce20009e50 tx=0x7fce2002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194b3e07507e2044 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.487+0000 7fce2559a640 1 -- 172.21.15.5:0/3320179468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20031600 con 0x7fce28065e40 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.487+0000 7fce2559a640 1 -- 172.21.15.5:0/3320179468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2002d050 con 0x7fce28065e40 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.487+0000 7fce2559a640 1 -- 172.21.15.5:0/3320179468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20031980 con 0x7fce28065e40 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3320179468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28065e40 msgr2=0x7fce280abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28065e40 0x7fce280abdb0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fce20009e50 tx=0x7fce2002a710 comp rx=0 tx=0).stop 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3320179468 shutdown_connections 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28065e40 0x7fce280abdb0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3320179468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2815c4e0 0x7fce2806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3320179468 >> 172.21.15.5:0/3320179468 conn(0x7fce280cebb0 msgr2=0x7fce280cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3320179468 shutdown_connections 2024-09-13T17:19:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.488+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3320179468 wait complete. 2024-09-13T17:19:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.489+0000 7fce2cc0d640 1 Processor -- start 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.489+0000 7fce2cc0d640 1 -- start start 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce28065e40 0x7fce280ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 0x7fce2814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce281e6bc0 con 0x7fce2806d8f0 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce281e6dd0 con 0x7fce2815c4e0 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2cc0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce281e70b0 con 0x7fce28065e40 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40914/0 (socket says 172.21.15.5:40914) 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 -- 172.21.15.5:0/3638144119 learned_addr learned my addr 172.21.15.5:0/3638144119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce2659c640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce28065e40 0x7fce280ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce26d9d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 0x7fce2814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 -- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce28065e40 msgr2=0x7fce280ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce28065e40 0x7fce280ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 -- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 msgr2=0x7fce2814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 0x7fce2814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 -- 172.21.15.5:0/3638144119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20009b30 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce26d9d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 0x7fce2814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.490+0000 7fce25d9b640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c400 tx=0x7fce1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.491+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0052d0 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.491+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c005430 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.491+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce281e7390 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.491+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c003830 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.491+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce281e7950 con 0x7fce2806d8f0 2024-09-13T17:19:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.492+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce281e7b40 con 0x7fce2806d8f0 2024-09-13T17:19:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.492+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce1c003990 con 0x7fce2806d8f0 2024-09-13T17:19:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.493+0000 7fce16ffd640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 0x7fce0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.493+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fce1c088a10 con 0x7fce2806d8f0 2024-09-13T17:19:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.493+0000 7fce2659c640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 0x7fce0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.494+0000 7fce2659c640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 0x7fce0806d0c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce281e7de0 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.497+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce1c053a90 con 0x7fce2806d8f0 2024-09-13T17:19:37.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.702+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce280abdb0 con 0x7fce2806d8f0 2024-09-13T17:19:37.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.702+0000 7fce16ffd640 1 -- 172.21.15.5:0/3638144119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7fce1c017090 con 0x7fce2806d8f0 2024-09-13T17:19:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:37.705 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:18:32.403163+0000","modified":"2024-09-13T17:19:07.904884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8607,"mds_1":7810},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7810":{"gid":7810,"name":"d","rank":1,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6837/3695538283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3695538283},{"type":"v1","addr":"172.21.15.179:6837","nonce":3695538283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8607":{"gid":8607,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/3736030266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3736030266},{"type":"v1","addr":"172.21.15.5:6833","nonce":3736030266}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T17:19:37.705 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 msgr2=0x7fce0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 0x7fce0806d0c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce281e7de0 tx=0x7fce18008040 comp rx=0 tx=0).stop 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 msgr2=0x7fce2814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c400 tx=0x7fce1c00c8c0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 shutdown_connections 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce2815c4e0 0x7fce2814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fce0806ac00 0x7fce0806d0c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2806d8f0 0x7fce2814bd00 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 --2- 172.21.15.5:0/3638144119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce28065e40 0x7fce280ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 >> 172.21.15.5:0/3638144119 conn(0x7fce280cebb0 msgr2=0x7fce28070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 shutdown_connections 2024-09-13T17:19:37.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.705+0000 7fce2cc0d640 1 -- 172.21.15.5:0/3638144119 wait complete. 2024-09-13T17:19:37.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 Processor -- start 2024-09-13T17:19:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 -- start start 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c160090 0x7f818c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f818c0d0790 0x7f818c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 0x7f818c0b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0b47d0 con 0x7f818c0d0790 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0d0d00 con 0x7f818c0b4c60 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.817+0000 7f8192fe9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b3ea0 con 0x7f818c160090 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f818c0d0790 0x7f818c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f818c0d0790 0x7f818c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40922/0 (socket says 172.21.15.5:40922) 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 -- 172.21.15.5:0/2417942568 learned_addr learned my addr 172.21.15.5:0/2417942568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f8191586640 1 --2- 172.21.15.5:0/2417942568 >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 0x7f818c0b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f8190d85640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c160090 0x7f818c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 -- 172.21.15.5:0/2417942568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c160090 msgr2=0x7f818c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c160090 0x7f818c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 -- 172.21.15.5:0/2417942568 >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 msgr2=0x7f818c0b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 --2- 172.21.15.5:0/2417942568 >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 0x7f818c0b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f818bfff640 1 -- 172.21.15.5:0/2417942568 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0b4180 con 0x7f818c0d0790 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.818+0000 7f8191586640 1 --2- 172.21.15.5:0/2417942568 >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 0x7f818c0b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f818bfff640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0d14d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f818c06a710 tx=0x7f817402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e86f85c441d3c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f818b7fe640 1 -- 172.21.15.5:0/2417942568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174031400 con 0x7f818c0d0790 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f818b7fe640 1 -- 172.21.15.5:0/2417942568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817402d050 con 0x7f818c0d0790 2024-09-13T17:19:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f818b7fe640 1 -- 172.21.15.5:0/2417942568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174031780 con 0x7f818c0d0790 2024-09-13T17:19:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f8192fe9640 1 -- 172.21.15.5:0/2417942568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 msgr2=0x7f818c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.819+0000 7f8192fe9640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0d14d0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f818c06a710 tx=0x7f817402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 -- 172.21.15.5:0/2417942568 shutdown_connections 2024-09-13T17:19:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 --2- 172.21.15.5:0/2417942568 >> v2:172.21.15.179:3300/0 conn(0x7f818c0b4c60 0x7f818c0b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0d14d0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 --2- 172.21.15.5:0/2417942568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c160090 0x7f818c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 -- 172.21.15.5:0/2417942568 >> 172.21.15.5:0/2417942568 conn(0x7f818c09b9a0 msgr2=0x7f818c08a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 -- 172.21.15.5:0/2417942568 shutdown_connections 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.820+0000 7f8192fe9640 1 -- 172.21.15.5:0/2417942568 wait complete. 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.821+0000 7f8192fe9640 1 Processor -- start 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.821+0000 7f8192fe9640 1 -- start start 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c0b4c60 0x7f818c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c0c6f60 0x7f818c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0c7d30 con 0x7f818c0d0790 2024-09-13T17:19:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b6a60 con 0x7f818c0c6f60 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8192fe9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b6d40 con 0x7f818c0b4c60 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40938/0 (socket says 172.21.15.5:40938) 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 -- 172.21.15.5:0/3932187514 learned_addr learned my addr 172.21.15.5:0/3932187514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8190d85640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c0b4c60 0x7f818c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f8191586640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c0c6f60 0x7f818c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 -- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c0b4c60 msgr2=0x7f818c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c0b4c60 0x7f818c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 -- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c0c6f60 msgr2=0x7f818c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c0c6f60 0x7f818c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 -- 172.21.15.5:0/3932187514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009b30 con 0x7f818c0d0790 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.822+0000 7f818bfff640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f8174000f80 tx=0x7f8174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.823+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817403d650 con 0x7f818c0d0790 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.823+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817403d7b0 con 0x7f818c0d0790 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.823+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817403db60 con 0x7f818c0d0790 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.823+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c0c7670 con 0x7f818c0d0790 2024-09-13T17:19:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.823+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c0b66a0 con 0x7f818c0d0790 2024-09-13T17:19:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.824+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c0b6830 con 0x7f818c0d0790 2024-09-13T17:19:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.824+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f817403dcc0 con 0x7f818c0d0790 2024-09-13T17:19:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.825+0000 7f81897fa640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 0x7f816c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.825+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f81740aa240 con 0x7f818c0d0790 2024-09-13T17:19:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.825+0000 7f8190d85640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 0x7f816c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.826+0000 7f8190d85640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 0x7f816c06d0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f817c005f80 tx=0x7f817c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:37.829+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81740752c0 con 0x7f818c0d0790 2024-09-13T17:19:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.002+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f818c067310 con 0x7f818c0d0790 2024-09-13T17:19:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.003+0000 7f81897fa640 1 -- 172.21.15.5:0/3932187514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16985 (secure 0 0 0) 0x7f81740788e0 con 0x7f818c0d0790 2024-09-13T17:19:38.005 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:38.005 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:18:57.877602+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:18:30.638720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T17:18:31.377718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 msgr2=0x7f816c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 0x7f816c06d0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f817c005f80 tx=0x7f817c008040 comp rx=0 tx=0).stop 2024-09-13T17:19:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 msgr2=0x7f818c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f8174000f80 tx=0x7f8174004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 shutdown_connections 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f818c0c6f60 0x7f818c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f816c06ac00 0x7f816c06d0c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c0d0790 0x7f818c0b6160 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 --2- 172.21.15.5:0/3932187514 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f818c0b4c60 0x7f818c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 >> 172.21.15.5:0/3932187514 conn(0x7f818c09b9a0 msgr2=0x7f818c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 shutdown_connections 2024-09-13T17:19:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.005+0000 7f8192fe9640 1 -- 172.21.15.5:0/3932187514 wait complete. 2024-09-13T17:19:38.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:19:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.120+0000 7fb3ae3b5640 1 Processor -- start 2024-09-13T17:19:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.120+0000 7fb3ae3b5640 1 -- start start 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ae3b5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3a81591e0 0x7fb3a80acf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ae3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80cedc0 0x7fb3a8070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ae3b5640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80701a0 con 0x7fb3a80abf40 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ae3b5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80ac3b0 con 0x7fb3a81591e0 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ae3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80ad540 con 0x7fb3a80cedc0 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3a81591e0 0x7fb3a80acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3a81591e0 0x7fb3a80acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40950/0 (socket says 172.21.15.5:40950) 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 -- 172.21.15.5:0/3970269008 learned_addr learned my addr 172.21.15.5:0/3970269008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:38.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3ac952640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80cedc0 0x7fb3a8070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 -- 172.21.15.5:0/3970269008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80cedc0 msgr2=0x7fb3a8070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:38.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80cedc0 0x7fb3a8070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.121+0000 7fb3a7fff640 1 -- 172.21.15.5:0/3970269008 >> v1:172.21.15.179:6789/0 conn(0x7fb3a80abf40 legacy=0x7fb3a80ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:38.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.122+0000 7fb3a7fff640 1 -- 172.21.15.5:0/3970269008 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80ad820 con 0x7fb3a81591e0 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.122+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a81591e0 0x7fb3a80acf20 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb398009870 tx=0x7fb39802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c663058d847a5f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.122+0000 7fb3a77fe640 1 -- 172.21.15.5:0/3970269008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39802ae90 con 0x7fb3a81591e0 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.122+0000 7fb3a77fe640 1 -- 172.21.15.5:0/3970269008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398032440 con 0x7fb3a81591e0 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.122+0000 7fb3a77fe640 1 -- 172.21.15.5:0/3970269008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980327d0 con 0x7fb3a81591e0 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/3970269008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a81591e0 msgr2=0x7fb3a80acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a81591e0 0x7fb3a80acf20 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb398009870 tx=0x7fb39802a180 comp rx=0 tx=0).stop 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/3970269008 shutdown_connections 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80cedc0 0x7fb3a8070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/3970269008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a81591e0 0x7fb3a80acf20 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/3970269008 >> 172.21.15.5:0/3970269008 conn(0x7fb3a806a270 msgr2=0x7fb3a806a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:38.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/3970269008 shutdown_connections 2024-09-13T17:19:38.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.123+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/3970269008 wait complete. 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.124+0000 7fb3ae3b5640 1 Processor -- start 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.124+0000 7fb3ae3b5640 1 -- start start 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 0x7fb3a81f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 0x7fb3a806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f3630 con 0x7fb3a80cedc0 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8154050 con 0x7fb3a81591e0 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ae3b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81e2c80 con 0x7fb3a80abf40 2024-09-13T17:19:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40960/0 (socket says 172.21.15.5:40960) 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 -- 172.21.15.5:0/2242498275 learned_addr learned my addr 172.21.15.5:0/2242498275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 0x7fb3a81f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ac952640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 0x7fb3a806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 -- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 msgr2=0x7fb3a81f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 0x7fb3a81f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 -- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 msgr2=0x7fb3a806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 0x7fb3a806c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb39ffff640 1 -- 172.21.15.5:0/2242498275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980094d0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 0x7fb3a81f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.125+0000 7fb3ac952640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 0x7fb3a806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb39ffff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb39000c430 tx=0x7fb39000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390011790 con 0x7fb3a80cedc0 2024-09-13T17:19:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3900118f0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a815b010 con 0x7fb3a80cedc0 2024-09-13T17:19:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390011ce0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.126+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a815b5d0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.127+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80acf20 con 0x7fb3a80cedc0 2024-09-13T17:19:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.127+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb39001c460 con 0x7fb3a80cedc0 2024-09-13T17:19:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.128+0000 7fb3a57fa640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 0x7fb38806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.128+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb3900894c0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.128+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 0x7fb38806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.129+0000 7fb3a7fff640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 0x7fb38806d0c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb398034000 tx=0x7fb39802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.132+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb390054490 con 0x7fb3a80cedc0 2024-09-13T17:19:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.339+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3a806df00 con 0x7fb3a80cedc0 2024-09-13T17:19:38.341 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-13T17:19:38.339+0000 7f1b304f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:19:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.346+0000 7fb3a57fa640 1 -- 172.21.15.5:0/2242498275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb390057ab0 con 0x7fb3a80cedc0 2024-09-13T17:19:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 msgr2=0x7fb38806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 0x7fb38806d0c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb398034000 tx=0x7fb39802e000 comp rx=0 tx=0).stop 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 msgr2=0x7fb3a806c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb39000c430 tx=0x7fb39000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 shutdown_connections 2024-09-13T17:19:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a81591e0 0x7fb3a806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb38806ac00 0x7fb38806d0c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3a80cedc0 0x7fb3a806c1a0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 --2- 172.21.15.5:0/2242498275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a80abf40 0x7fb3a81f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 >> 172.21.15.5:0/2242498275 conn(0x7fb3a806a270 msgr2=0x7fb3a80b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 shutdown_connections 2024-09-13T17:19:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.348+0000 7fb3ae3b5640 1 -- 172.21.15.5:0/2242498275 wait complete. 2024-09-13T17:19:38.353 INFO:tasks.ceph.mds.a.smithi005.stderr: -5947> 2024-09-13T17:18:58.863+0000 7f43cb3e6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:19:38.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:19:38.381 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-13T17:19:38.385 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-09-13T17:19:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.464+0000 7fd560d33640 1 Processor -- start 2024-09-13T17:19:38.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.464+0000 7fd560d33640 1 -- start start 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd560d33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 0x7fd55c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd560d33640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd55c15afc0 0x7fd55c06a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd560d33640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c06ac10 con 0x7fd55c06a270 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd560d33640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c0b17e0 con 0x7fd55c15afc0 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd560d33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0ad3e0 con 0x7fd55c154b20 2024-09-13T17:19:38.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd559d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd55c06a270 0x7fd55c15a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54140/0 (socket says 172.21.15.5:54140) 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd559d9b640 1 -- 172.21.15.5:0/898822882 learned_addr learned my addr 172.21.15.5:0/898822882 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd55a59c640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 0x7fd55c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.465+0000 7fd55ad9d640 1 --2- 172.21.15.5:0/898822882 >> v2:172.21.15.179:3300/0 conn(0x7fd55c15afc0 0x7fd55c06a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55959a640 1 -- 172.21.15.5:0/898822882 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214235868 0 0) 0x7fd55c06ac10 con 0x7fd55c06a270 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55959a640 1 -- 172.21.15.5:0/898822882 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd548003520 con 0x7fd55c06a270 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55ad9d640 1 -- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 msgr2=0x7fd55c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55ad9d640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 0x7fd55c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55ad9d640 1 -- 172.21.15.5:0/898822882 >> v1:172.21.15.5:6789/0 conn(0x7fd55c06a270 legacy=0x7fd55c15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55ad9d640 1 -- 172.21.15.5:0/898822882 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0b2140 con 0x7fd55c15afc0 2024-09-13T17:19:38.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55a59c640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 0x7fd55c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:38.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.466+0000 7fd55ad9d640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c06a6d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd554009d90 tx=0x7fd55402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7af50ddaf0eed8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd55959a640 1 -- 172.21.15.5:0/898822882 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554031600 con 0x7fd55c15afc0 2024-09-13T17:19:38.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd55959a640 1 -- 172.21.15.5:0/898822882 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55402d050 con 0x7fd55c15afc0 2024-09-13T17:19:38.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd55959a640 1 -- 172.21.15.5:0/898822882 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554031980 con 0x7fd55c15afc0 2024-09-13T17:19:38.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 -- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 msgr2=0x7fd55c06a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c06a6d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd554009d90 tx=0x7fd55402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 -- 172.21.15.5:0/898822882 shutdown_connections 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c06a6d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 --2- 172.21.15.5:0/898822882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c154b20 0x7fd55c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 -- 172.21.15.5:0/898822882 >> 172.21.15.5:0/898822882 conn(0x7fd55c0b01a0 msgr2=0x7fd55c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 -- 172.21.15.5:0/898822882 shutdown_connections 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.467+0000 7fd560d33640 1 -- 172.21.15.5:0/898822882 wait complete. 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 Processor -- start 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 -- start start 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c06a270 0x7fd55c09b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c1577b0 con 0x7fd55c154b20 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c156240 con 0x7fd55c15afc0 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.469+0000 7fd560d33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c09b760 con 0x7fd55c06a270 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40978/0 (socket says 172.21.15.5:40978) 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 -- 172.21.15.5:0/2229560018 learned_addr learned my addr 172.21.15.5:0/2229560018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd55a59c640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c06a270 0x7fd55c09b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd55ad9d640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 -- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c06a270 msgr2=0x7fd55c09b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c06a270 0x7fd55c09b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 -- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 msgr2=0x7fd55c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c15cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 -- 172.21.15.5:0/2229560018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c009400 con 0x7fd55c154b20 2024-09-13T17:19:38.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd559d9b640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c4d0 tx=0x7fd54400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544005ce0 con 0x7fd55c154b20 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544005e40 con 0x7fd55c154b20 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd554009a70 con 0x7fd55c154b20 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544007270 con 0x7fd55c154b20 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.470+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c09bd20 con 0x7fd55c154b20 2024-09-13T17:19:38.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.471+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55c0672d0 con 0x7fd55c154b20 2024-09-13T17:19:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.472+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd544007490 con 0x7fd55c154b20 2024-09-13T17:19:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.472+0000 7fd552ffd640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 0x7fd53c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.472+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6402+0+0 (secure 0 0 0) 0x7fd544088a30 con 0x7fd55c154b20 2024-09-13T17:19:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.473+0000 7fd55a59c640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 0x7fd53c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.473+0000 7fd55a59c640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 0x7fd53c06d0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd55c15d650 tx=0x7fd54c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.477+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd544053a90 con 0x7fd55c154b20 2024-09-13T17:19:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:38.681+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd55c1578f0 con 0x7fd55c154b20 2024-09-13T17:19:39.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.348+0000 7fd552ffd640 1 -- 172.21.15.5:0/2229560018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd55c1578f0 con 0x7fd55c154b20 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 msgr2=0x7fd53c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 0x7fd53c06d0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd55c15d650 tx=0x7fd54c009190 comp rx=0 tx=0).stop 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 msgr2=0x7fd55c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c4d0 tx=0x7fd54400c990 comp rx=0 tx=0).stop 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 shutdown_connections 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd55c15afc0 0x7fd55c15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fd53c06ac00 0x7fd53c06d0c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c154b20 0x7fd55c155d00 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 --2- 172.21.15.5:0/2229560018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd55c06a270 0x7fd55c09b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 >> 172.21.15.5:0/2229560018 conn(0x7fd55c0b01a0 msgr2=0x7fd55c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:39.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 shutdown_connections 2024-09-13T17:19:39.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.352+0000 7fd560d33640 1 -- 172.21.15.5:0/2229560018 wait complete. 2024-09-13T17:19:39.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:19:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.519+0000 7f1d5689c640 1 Processor -- start 2024-09-13T17:19:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.519+0000 7f1d5689c640 1 -- start start 2024-09-13T17:19:39.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d500cd7c0 0x7f1d500cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 0x7f1d500d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d5006adf0 0x7f1d5006b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500d0ca0 con 0x7f1d500cd7c0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500d0f80 con 0x7f1d5006adf0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d5689c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500d1260 con 0x7f1d500cdba0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d500cd7c0 0x7f1d500cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d500cd7c0 0x7f1d500cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40986/0 (socket says 172.21.15.5:40986) 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 -- 172.21.15.5:0/3699991685 learned_addr learned my addr 172.21.15.5:0/3699991685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4f7fe640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 0x7f1d500d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d54e39640 1 --2- 172.21.15.5:0/3699991685 >> v2:172.21.15.179:3300/0 conn(0x7f1d5006adf0 0x7f1d5006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 -- 172.21.15.5:0/3699991685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 msgr2=0x7f1d500d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 0x7f1d500d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 -- 172.21.15.5:0/3699991685 >> v2:172.21.15.179:3300/0 conn(0x7f1d5006adf0 msgr2=0x7f1d5006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/3699991685 >> v2:172.21.15.179:3300/0 conn(0x7f1d5006adf0 0x7f1d5006b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4ffff640 1 -- 172.21.15.5:0/3699991685 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500d1540 con 0x7f1d500cd7c0 2024-09-13T17:19:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.520+0000 7f1d4f7fe640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 0x7f1d500d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.521+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cd7c0 0x7f1d500cd030 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1d5008bb80 tx=0x7f1d4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678edf1a0b787dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.521+0000 7f1d4effd640 1 -- 172.21.15.5:0/3699991685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40032440 con 0x7f1d500cd7c0 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.521+0000 7f1d4effd640 1 -- 172.21.15.5:0/3699991685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d400325a0 con 0x7f1d500cd7c0 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.521+0000 7f1d4effd640 1 -- 172.21.15.5:0/3699991685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40032930 con 0x7f1d500cd7c0 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 -- 172.21.15.5:0/3699991685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cd7c0 msgr2=0x7f1d500cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cd7c0 0x7f1d500cd030 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1d5008bb80 tx=0x7f1d4002a1e0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 -- 172.21.15.5:0/3699991685 shutdown_connections 2024-09-13T17:19:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 --2- 172.21.15.5:0/3699991685 >> v2:172.21.15.179:3300/0 conn(0x7f1d5006adf0 0x7f1d5006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d500cdba0 0x7f1d500d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 --2- 172.21.15.5:0/3699991685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cd7c0 0x7f1d500cd030 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 -- 172.21.15.5:0/3699991685 >> 172.21.15.5:0/3699991685 conn(0x7f1d500b4450 msgr2=0x7f1d500b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 -- 172.21.15.5:0/3699991685 shutdown_connections 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.522+0000 7f1d5689c640 1 -- 172.21.15.5:0/3699991685 wait complete. 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.523+0000 7f1d5689c640 1 Processor -- start 2024-09-13T17:19:39.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.523+0000 7f1d5689c640 1 -- start start 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d5006adf0 0x7f1d5014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 0x7f1d500b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015eef0 con 0x7f1d500cdba0 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5014d0e0 con 0x7f1d500cd7c0 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d5689c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015e270 con 0x7f1d5006adf0 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40990/0 (socket says 172.21.15.5:40990) 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 -- 172.21.15.5:0/2664914692 learned_addr learned my addr 172.21.15.5:0/2664914692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:39.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d5006adf0 0x7f1d5014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d4f7fe640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 0x7f1d500b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 -- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d5006adf0 msgr2=0x7f1d5014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d5006adf0 0x7f1d5014cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 -- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 msgr2=0x7f1d500b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 0x7f1d500b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 -- 172.21.15.5:0/2664914692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400094d0 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d4f7fe640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 0x7f1d500b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.524+0000 7f1d54e39640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800eed0 tx=0x7f1d4800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.525+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48010040 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.525+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48014400 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.525+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5015e550 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.525+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48009ea0 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.525+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5015eb10 con 0x7f1d500cdba0 2024-09-13T17:19:39.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.526+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5015f030 con 0x7f1d500cdba0 2024-09-13T17:19:39.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.526+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d480147b0 con 0x7f1d500cdba0 2024-09-13T17:19:39.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.526+0000 7f1d4cff9640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 0x7f1d3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:39.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.527+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6402+0+0 (secure 0 0 0) 0x7f1d4808a0c0 con 0x7f1d500cdba0 2024-09-13T17:19:39.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.527+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 0x7f1d3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:39.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.527+0000 7f1d4ffff640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 0x7f1d3c06d0c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d4002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:39.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.531+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d5015f030 con 0x7f1d500cdba0 2024-09-13T17:19:39.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:39.703+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d5015f030 con 0x7f1d500cdba0 2024-09-13T17:19:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.355+0000 7f1d4cff9640 1 -- 172.21.15.5:0/2664914692 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1d5015f030 con 0x7f1d500cdba0 2024-09-13T17:19:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:19:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 msgr2=0x7f1d3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 0x7f1d3c06d0c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1d40034000 tx=0x7f1d4002e000 comp rx=0 tx=0).stop 2024-09-13T17:19:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 msgr2=0x7f1d50159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800eed0 tx=0x7f1d4800b480 comp rx=0 tx=0).stop 2024-09-13T17:19:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 shutdown_connections 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f1d3c06ac00 0x7f1d3c06d0c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d500cdba0 0x7f1d50159c90 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d500cd7c0 0x7f1d500b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 --2- 172.21.15.5:0/2664914692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d5006adf0 0x7f1d5014cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 >> 172.21.15.5:0/2664914692 conn(0x7f1d500b4450 msgr2=0x7f1d500b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 shutdown_connections 2024-09-13T17:19:40.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.360+0000 7f1d5689c640 1 -- 172.21.15.5:0/2664914692 wait complete. 2024-09-13T17:19:40.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:19:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.486+0000 7f53d3725640 1 Processor -- start 2024-09-13T17:19:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.486+0000 7f53d3725640 1 -- start start 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d3725640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53cc15ca20 0x7f53cc06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d3725640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 0x7f53cc098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d3725640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0ce8c0 con 0x7f53cc098fb0 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d3725640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0cf7e0 con 0x7f53cc15ca20 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d3725640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc099460 con 0x7f53cc06afd0 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d14c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53cc15ca20 0x7f53cc06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d1cc2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53cc098fb0 0x7f53cc1603c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54144/0 (socket says 172.21.15.5:54144) 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d1cc2640 1 -- 172.21.15.5:0/4269255243 learned_addr learned my addr 172.21.15.5:0/4269255243 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d0cc0640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 0x7f53cc098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d14c1640 1 -- 172.21.15.5:0/4269255243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 msgr2=0x7f53cc098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d14c1640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 0x7f53cc098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d14c1640 1 -- 172.21.15.5:0/4269255243 >> v1:172.21.15.5:6789/0 conn(0x7f53cc098fb0 legacy=0x7f53cc1603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53c3fff640 1 -- 172.21.15.5:0/4269255243 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646850977 0 0) 0x7f53cc0ce8c0 con 0x7f53cc098fb0 2024-09-13T17:19:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d14c1640 1 -- 172.21.15.5:0/4269255243 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0ceb60 con 0x7f53cc15ca20 2024-09-13T17:19:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.487+0000 7f53d0cc0640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 0x7f53cc098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.488+0000 7f53d14c1640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc15ca20 0x7f53cc06c030 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f53c80097a0 tx=0x7f53c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b54f214be70d1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.488+0000 7f53c3fff640 1 -- 172.21.15.5:0/4269255243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8032440 con 0x7f53cc15ca20 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.488+0000 7f53c3fff640 1 -- 172.21.15.5:0/4269255243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c80325a0 con 0x7f53cc15ca20 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.488+0000 7f53c3fff640 1 -- 172.21.15.5:0/4269255243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8032930 con 0x7f53cc15ca20 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 -- 172.21.15.5:0/4269255243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc15ca20 msgr2=0x7f53cc06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc15ca20 0x7f53cc06c030 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f53c80097a0 tx=0x7f53c802a180 comp rx=0 tx=0).stop 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 -- 172.21.15.5:0/4269255243 shutdown_connections 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc06afd0 0x7f53cc098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 --2- 172.21.15.5:0/4269255243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc15ca20 0x7f53cc06c030 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 -- 172.21.15.5:0/4269255243 >> 172.21.15.5:0/4269255243 conn(0x7f53cc0b1fb0 msgr2=0x7f53cc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 -- 172.21.15.5:0/4269255243 shutdown_connections 2024-09-13T17:19:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.489+0000 7f53d3725640 1 -- 172.21.15.5:0/4269255243 wait complete. 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.490+0000 7f53d3725640 1 Processor -- start 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.490+0000 7f53d3725640 1 -- start start 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc098fb0 0x7f53cc154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 0x7f53cc0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc155200 con 0x7f53cc06afd0 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0c84c0 con 0x7f53cc15ca20 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d3725640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0c87a0 con 0x7f53cc098fb0 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41008/0 (socket says 172.21.15.5:41008) 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 -- 172.21.15.5:0/280488467 learned_addr learned my addr 172.21.15.5:0/280488467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d0cc0640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc098fb0 0x7f53cc154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d1cc2640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 0x7f53cc0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 -- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc098fb0 msgr2=0x7f53cc154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc098fb0 0x7f53cc154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 -- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 msgr2=0x7f53cc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 0x7f53cc0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d14c1640 1 -- 172.21.15.5:0/280488467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009400 con 0x7f53cc06afd0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.491+0000 7f53d1cc2640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 0x7f53cc0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53d14c1640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f53c8035040 tx=0x7f53c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8006e10 con 0x7f53cc06afd0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8030980 con 0x7f53cc06afd0 2024-09-13T17:19:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc0c8a80 con 0x7f53cc06afd0 2024-09-13T17:19:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8030d50 con 0x7f53cc06afd0 2024-09-13T17:19:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.492+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc0c9040 con 0x7f53cc06afd0 2024-09-13T17:19:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.493+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc067310 con 0x7f53cc06afd0 2024-09-13T17:19:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.493+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f53c8039040 con 0x7f53cc06afd0 2024-09-13T17:19:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.494+0000 7f53c1ffb640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 0x7f53b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.494+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5964+0+0 (secure 0 0 0) 0x7f53c80a9f40 con 0x7f53cc06afd0 2024-09-13T17:19:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.494+0000 7f53d0cc0640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 0x7f53b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.495+0000 7f53d0cc0640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 0x7f53b006d0c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b4610 tx=0x7f53bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.498+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53c8075020 con 0x7f53cc06afd0 2024-09-13T17:19:40.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:40.668+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53cc0cc7c0 con 0x7f53cc06afd0 2024-09-13T17:19:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.358+0000 7f53c1ffb640 1 -- 172.21.15.5:0/280488467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53c8078640 con 0x7f53cc06afd0 2024-09-13T17:19:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 msgr2=0x7f53b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 0x7f53b006d0c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0b4610 tx=0x7f53bc008040 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 msgr2=0x7f53cc0c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f53c8035040 tx=0x7f53c80046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 shutdown_connections 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53cc15ca20 0x7f53cc0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53cc098fb0 0x7f53cc154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f53b006ac00 0x7f53b006d0c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 --2- 172.21.15.5:0/280488467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53cc06afd0 0x7f53cc0c9560 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 >> 172.21.15.5:0/280488467 conn(0x7f53cc0b1fb0 msgr2=0x7f53cc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:41.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.362+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 shutdown_connections 2024-09-13T17:19:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.363+0000 7f53d3725640 1 -- 172.21.15.5:0/280488467 wait complete. 2024-09-13T17:19:41.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:19:41.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:19:41.425 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-13T17:19:41.425 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-13T17:19:41.425 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:19:41.425 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-13T17:19:41.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.426 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-13T17:19:41.427 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-13T17:19:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:19:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.432 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-13T17:19:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-13T17:19:41.435 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-09-13T17:19:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi005.stdout:[client.badguy] 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-13T17:19:41.437 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-13T17:19:41.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:19:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-13T17:19:41.440 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.5,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3b63ea2f-5230-4468-aa58-3481f4f99558 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-13T17:19:41.441 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.442 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:19:41.443 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-13T17:19:41.444 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:19:41.445 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:19:41.446 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-09-13T17:19:41.447 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-09-13T17:19:41.448 INFO:teuthology.orchestra.run.smithi179.stdout:[client.badguy] 2024-09-13T17:19:41.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:19:41.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.591+0000 7fbd48e96640 1 Processor -- start 2024-09-13T17:19:41.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.591+0000 7fbd48e96640 1 -- start start 2024-09-13T17:19:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd4415c800 0x7fbd440d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd440cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd440cf500 0x7fbd440b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440cf9b0 con 0x7fbd440cf500 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440d1f80 con 0x7fbd4415c800 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd48e96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440b8670 con 0x7fbd440d0e60 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd440cf500 0x7fbd440b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd440cf500 0x7fbd440b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41018/0 (socket says 172.21.15.5:41018) 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 -- 172.21.15.5:0/2832311484 learned_addr learned my addr 172.21.15.5:0/2832311484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd3bfff640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd440cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd4259c640 1 --2- 172.21.15.5:0/2832311484 >> v2:172.21.15.179:3300/0 conn(0x7fbd4415c800 0x7fbd440d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 -- 172.21.15.5:0/2832311484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 msgr2=0x7fbd440cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd440cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 -- 172.21.15.5:0/2832311484 >> v2:172.21.15.179:3300/0 conn(0x7fbd4415c800 msgr2=0x7fbd440d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 --2- 172.21.15.5:0/2832311484 >> v2:172.21.15.179:3300/0 conn(0x7fbd4415c800 0x7fbd440d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.592+0000 7fbd42d9d640 1 -- 172.21.15.5:0/2832311484 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440d2410 con 0x7fbd440cf500 2024-09-13T17:19:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.593+0000 7fbd42d9d640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440b4190 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b5240 tx=0x7fbd3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d822cec349e13d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.593+0000 7fbd41d9b640 1 -- 172.21.15.5:0/2832311484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c031600 con 0x7fbd440cf500 2024-09-13T17:19:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.593+0000 7fbd41d9b640 1 -- 172.21.15.5:0/2832311484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c02d050 con 0x7fbd440cf500 2024-09-13T17:19:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.593+0000 7fbd41d9b640 1 -- 172.21.15.5:0/2832311484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c031980 con 0x7fbd440cf500 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 -- 172.21.15.5:0/2832311484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 msgr2=0x7fbd440b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440b4190 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b5240 tx=0x7fbd3c02a6a0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 -- 172.21.15.5:0/2832311484 shutdown_connections 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440b4190 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 --2- 172.21.15.5:0/2832311484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd440cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 --2- 172.21.15.5:0/2832311484 >> v2:172.21.15.179:3300/0 conn(0x7fbd4415c800 0x7fbd440d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 -- 172.21.15.5:0/2832311484 >> 172.21.15.5:0/2832311484 conn(0x7fbd4406b110 msgr2=0x7fbd4406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 -- 172.21.15.5:0/2832311484 shutdown_connections 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.594+0000 7fbd48e96640 1 -- 172.21.15.5:0/2832311484 wait complete. 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.595+0000 7fbd48e96640 1 Processor -- start 2024-09-13T17:19:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.595+0000 7fbd48e96640 1 -- start start 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd441f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4415c800 0x7fbd441f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440a99e0 con 0x7fbd440cf500 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440a9cc0 con 0x7fbd4415c800 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd48e96640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440a9fa0 con 0x7fbd440d0e60 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41032/0 (socket says 172.21.15.5:41032) 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 -- 172.21.15.5:0/3964336832 learned_addr learned my addr 172.21.15.5:0/3964336832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd3bfff640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd441f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd42d9d640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4415c800 0x7fbd441f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 -- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 msgr2=0x7fbd441f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd441f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 -- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4415c800 msgr2=0x7fbd441f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4415c800 0x7fbd441f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 -- 172.21.15.5:0/3964336832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c009b30 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.596+0000 7fbd4259c640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400d5f0 tx=0x7fbd3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.597+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340125f0 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.597+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34012750 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.597+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd440aa280 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.597+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34012b00 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.597+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd440a9550 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.598+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd440672f0 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.598+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd34012c60 con 0x7fbd440cf500 2024-09-13T17:19:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.599+0000 7fbd3affd640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.599+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fbd340895b0 con 0x7fbd440cf500 2024-09-13T17:19:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.599+0000 7fbd3bfff640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.599+0000 7fbd3bfff640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 0x7fbd2406d0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b0ab0 tx=0x7fbd2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.603+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd34054980 con 0x7fbd440cf500 2024-09-13T17:19:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.776+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbd440cec70 con 0x7fbd440cf500 2024-09-13T17:19:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.779+0000 7fbd3affd640 1 -- 172.21.15.5:0/3964336832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd34057fa0 con 0x7fbd440cf500 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 msgr2=0x7fbd2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 0x7fbd2406d0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b0ab0 tx=0x7fbd2c008040 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 msgr2=0x7fbd440aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400d5f0 tx=0x7fbd3400dab0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 shutdown_connections 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4415c800 0x7fbd441f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd440d0e60 0x7fbd441f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 --2- 172.21.15.5:0/3964336832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd440cf500 0x7fbd440aaa80 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 >> 172.21.15.5:0/3964336832 conn(0x7fbd4406b110 msgr2=0x7fbd440b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 shutdown_connections 2024-09-13T17:19:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.781+0000 7fbd48e96640 1 -- 172.21.15.5:0/3964336832 wait complete. 2024-09-13T17:19:41.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-13T17:19:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.893+0000 7f41c70f0640 1 Processor -- start 2024-09-13T17:19:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.893+0000 7f41c70f0640 1 -- start start 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c70f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41c006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c70f0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00b3150 con 0x7f41c00cdcb0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c70f0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00b3430 con 0x7f41c01592d0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c70f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015cf00 con 0x7f41c00cb7b0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c568d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41c00cdcb0 0x7f41c015d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54154/0 (socket says 172.21.15.5:54154) 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.895+0000 7f41c568d640 1 -- 172.21.15.5:0/3188934569 learned_addr learned my addr 172.21.15.5:0/3188934569 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41c006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537625683 0 0) 0x7f41c00b3150 con 0x7f41c00cdcb0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a8003520 con 0x7f41c00cdcb0 2024-09-13T17:19:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891806157 0 0) 0x7f41c00b3430 con 0x7f41c01592d0 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c00b3150 con 0x7f41c01592d0 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871996317 0 0) 0x7f41a8003520 con 0x7f41c00cdcb0 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 msgr2=0x7f41c006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41c006dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 >> v1:172.21.15.179:6789/0 conn(0x7f41c01592d0 legacy=0x7f41c006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00b3710 con 0x7f41c00cdcb0 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f41b80019f0 con 0x7f41c00cdcb0 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41c006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 >> v1:172.21.15.5:6789/0 conn(0x7f41c00cdcb0 legacy=0x7f41c015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41a8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41a8004d00 0x7f41a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a800ba90 con 0x7f41a8004070 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a800bc00 con 0x7f41a8004d00 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a800bdc0 con 0x7f41c00cb7b0 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41c4e8c640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41a8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41c568d640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41a8004d00 0x7f41a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 -- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 msgr2=0x7f41a8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c00cb7b0 0x7f41a8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 -- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41a8004d00 msgr2=0x7f41a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41a8004d00 0x7f41a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.896+0000 7f41bffff640 1 -- 172.21.15.5:0/3188934569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4009400 con 0x7f41a8004070 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41bffff640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41a80047c0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009800 tx=0x7f41a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e2e4331a5cc843 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4032490 con 0x7f41a8004070 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b40325f0 con 0x7f41a8004070 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41bf7fe640 1 -- 172.21.15.5:0/3188934569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4032980 con 0x7f41a8004070 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 -- 172.21.15.5:0/3188934569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 msgr2=0x7f41a80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 --2- 172.21.15.5:0/3188934569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41a80047c0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009800 tx=0x7f41a80057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c568d640 1 -- 172.21.15.5:0/3188934569 reap_dead start 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 -- 172.21.15.5:0/3188934569 shutdown_connections 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 -- 172.21.15.5:0/3188934569 >> 172.21.15.5:0/3188934569 conn(0x7f41c0066200 msgr2=0x7f41c0069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 -- 172.21.15.5:0/3188934569 shutdown_connections 2024-09-13T17:19:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.897+0000 7f41c70f0640 1 -- 172.21.15.5:0/3188934569 wait complete. 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.899+0000 7f41c70f0640 1 Processor -- start 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.899+0000 7f41c70f0640 1 -- start start 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 0x7f41c014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c014f780 0x7f41c00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0151280 con 0x7f41a8004070 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015b580 con 0x7f41c015c620 2024-09-13T17:19:41.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c70f0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015b860 con 0x7f41c014f780 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c4e8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c4e8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41054/0 (socket says 172.21.15.5:41054) 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c4e8c640 1 -- 172.21.15.5:0/336007908 learned_addr learned my addr 172.21.15.5:0/336007908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41bffff640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 0x7f41c014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.900+0000 7f41c568d640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c014f780 0x7f41c00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 -- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c014f780 msgr2=0x7f41c00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c014f780 0x7f41c00703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 -- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 msgr2=0x7f41c014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 0x7f41c014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 -- 172.21.15.5:0/336007908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c015bb40 con 0x7f41a8004070 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41bffff640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 0x7f41c014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c4e8c640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f41b000f7a0 tx=0x7f41b000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000fe50 con 0x7f41a8004070 2024-09-13T17:19:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b00052e0 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c015be20 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000d970 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.901+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c014a490 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.902+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c00672f0 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.902+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41b000dad0 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.903+0000 7f41bd7fa640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 0x7f41ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.903+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f41b0089270 con 0x7f41a8004070 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.903+0000 7f41bffff640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 0x7f41ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.904+0000 7f41bffff640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 0x7f41ac06d0c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f41b4037000 tx=0x7f41b4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:41.907+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f41b00544f0 con 0x7f41a8004070 2024-09-13T17:19:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.150+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f41c00adb10 con 0x7f41a8004070 2024-09-13T17:19:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.360+0000 7f41bd7fa640 1 -- 172.21.15.5:0/336007908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v353) v1 ==== 145+0+0 (secure 0 0 0) 0x7f41b0057b10 con 0x7f41a8004070 2024-09-13T17:19:42.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 msgr2=0x7f41ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:42.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 0x7f41ac06d0c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f41b4037000 tx=0x7f41b4008030 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 msgr2=0x7f41c0149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f41b000f7a0 tx=0x7f41b000fc60 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 shutdown_connections 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41c014f780 0x7f41c00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41c015c620 0x7f41c014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f41ac06ac00 0x7f41ac06d0c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 --2- 172.21.15.5:0/336007908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8004070 0x7f41c0149f50 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 >> 172.21.15.5:0/336007908 conn(0x7f41c0066200 msgr2=0x7f41c00aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 shutdown_connections 2024-09-13T17:19:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:42.362+0000 7f41c70f0640 1 -- 172.21.15.5:0/336007908 wait complete. 2024-09-13T17:19:42.374 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2024-09-13T17:19:42.374 INFO:tasks.cephfs_test_runner: 2024-09-13T17:19:42.375 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T17:19:42.375 INFO:tasks.cephfs_test_runner:Ran 6 tests in 347.308s 2024-09-13T17:19:42.375 INFO:tasks.cephfs_test_runner: 2024-09-13T17:19:42.375 INFO:tasks.cephfs_test_runner:OK 2024-09-13T17:19:42.375 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T17:19:42.384 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T17:19:42.408 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T17:19:42.409 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:42.409 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:42.425 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:19:42.426 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-13T17:19:42.426 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:42.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20538 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:19:42.483 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:42.483 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:42.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:19:42.502 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-13T17:19:42.502 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:19:42.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18619 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:19:42.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.560 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-13T17:19:42.576 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:19:42.577 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:19:42.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:19:42.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:19:42.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-13T17:19:42.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.800 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-13T17:19:42.819 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:19:42.819 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:19:42.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:19:42.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.889 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:19:42.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:19:42.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-13T17:19:43.051 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T17:19:43.064 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:19:43.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:19:43.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:43.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:19:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.171+0000 7fbfad29c640 1 Processor -- start 2024-09-13T17:19:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.171+0000 7fbfad29c640 1 -- start start 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfad29c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfa806e370 0x7fbfa815d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfad29c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80b3150 con 0x7fbfa81592d0 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfad29c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80b3430 con 0x7fbfa80cb7b0 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfad29c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa815cf00 con 0x7fbfa806e370 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfa77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfa806e370 0x7fbfa815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfa6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfa81592d0 0x7fbfa806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54162/0 (socket says 172.21.15.5:54162) 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfa77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfa806e370 0x7fbfa815d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41058/0 (socket says 172.21.15.5:41058) 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.172+0000 7fbfa6ffd640 1 -- 172.21.15.5:0/856057279 learned_addr learned my addr 172.21.15.5:0/856057279 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.173+0000 7fbfa77fe640 1 -- 172.21.15.5:0/856057279 >> v1:172.21.15.179:6789/0 conn(0x7fbfa80cb7b0 legacy=0x7fbfa806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.173+0000 7fbfa77fe640 1 -- 172.21.15.5:0/856057279 >> v1:172.21.15.5:6789/0 conn(0x7fbfa81592d0 legacy=0x7fbfa806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.173+0000 7fbfa67fc640 1 -- 172.21.15.5:0/856057279 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855728760 0 0) 0x7fbfa80b3150 con 0x7fbfa81592d0 2024-09-13T17:19:43.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.173+0000 7fbfa77fe640 1 -- 172.21.15.5:0/856057279 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80b3710 con 0x7fbfa806e370 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.173+0000 7fbfa77fe640 1 --2- 172.21.15.5:0/856057279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815d350 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009d90 tx=0x7fbfa002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8675dcb3ae03fbda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfa67fc640 1 -- 172.21.15.5:0/856057279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007740 con 0x7fbfa806e370 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfa67fc640 1 -- 172.21.15.5:0/856057279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002d050 con 0x7fbfa806e370 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfa67fc640 1 -- 172.21.15.5:0/856057279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007ac0 con 0x7fbfa806e370 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 -- 172.21.15.5:0/856057279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 msgr2=0x7fbfa815d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 --2- 172.21.15.5:0/856057279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815d350 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009d90 tx=0x7fbfa002a660 comp rx=0 tx=0).stop 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 -- 172.21.15.5:0/856057279 shutdown_connections 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 --2- 172.21.15.5:0/856057279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815d350 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 -- 172.21.15.5:0/856057279 >> 172.21.15.5:0/856057279 conn(0x7fbfa8066200 msgr2=0x7fbfa8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 -- 172.21.15.5:0/856057279 shutdown_connections 2024-09-13T17:19:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.174+0000 7fbfad29c640 1 -- 172.21.15.5:0/856057279 wait complete. 2024-09-13T17:19:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 Processor -- start 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 -- start start 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfa80cb7b0 0x7fbfa814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfa81592d0 0x7fbfa814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8159cc0 con 0x7fbfa806e370 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8159fa0 con 0x7fbfa81592d0 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.176+0000 7fbfad29c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815a280 con 0x7fbfa80cb7b0 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41072/0 (socket says 172.21.15.5:41072) 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 -- 172.21.15.5:0/2777403450 learned_addr learned my addr 172.21.15.5:0/2777403450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbf9ffff640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfa80cb7b0 0x7fbfa814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa77fe640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfa81592d0 0x7fbfa814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 -- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfa80cb7b0 msgr2=0x7fbfa814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfa80cb7b0 0x7fbfa814be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 -- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfa81592d0 msgr2=0x7fbfa814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfa81592d0 0x7fbfa814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 -- 172.21.15.5:0/2777403450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009a70 con 0x7fbfa806e370 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfa6ffd640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c3c0 tx=0x7fbf9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98005ce0 con 0x7fbfa806e370 2024-09-13T17:19:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98005e40 con 0x7fbfa806e370 2024-09-13T17:19:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007310 con 0x7fbfa806e370 2024-09-13T17:19:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa815a560 con 0x7fbfa806e370 2024-09-13T17:19:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.177+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa8153490 con 0x7fbfa806e370 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.178+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa80672f0 con 0x7fbfa806e370 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.179+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf98007530 con 0x7fbfa806e370 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.179+0000 7fbf9f7fe640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 0x7fbf8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.180+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fbf98088780 con 0x7fbfa806e370 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.180+0000 7fbf9ffff640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 0x7fbf8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.180+0000 7fbf9ffff640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 0x7fbf8806d0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80b1f10 tx=0x7fbf90009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.184+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbf98053ac0 con 0x7fbfa806e370 2024-09-13T17:19:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.355+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfa815a110 con 0x7fbf8806ac00 2024-09-13T17:19:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.357+0000 7fbf9f7fe640 1 -- 172.21.15.5:0/2777403450 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50992 (secure 0 0 0) 0x7fbfa815a110 con 0x7fbf8806ac00 2024-09-13T17:19:43.359 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:19:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 msgr2=0x7fbf8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 0x7fbf8806d0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80b1f10 tx=0x7fbf90009040 comp rx=0 tx=0).stop 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 msgr2=0x7fbfa815ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c3c0 tx=0x7fbf9800c880 comp rx=0 tx=0).stop 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 shutdown_connections 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfa81592d0 0x7fbfa814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfa80cb7b0 0x7fbfa814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fbf8806ac00 0x7fbf8806d0c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 --2- 172.21.15.5:0/2777403450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfa806e370 0x7fbfa815ad60 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 >> 172.21.15.5:0/2777403450 conn(0x7fbfa8066200 msgr2=0x7fbfa806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 shutdown_connections 2024-09-13T17:19:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.359+0000 7fbfad29c640 1 -- 172.21.15.5:0/2777403450 wait complete. 2024-09-13T17:19:43.372 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-13T17:19:43.350619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":261380,"kb_used_data":12444,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713340,"statfs":{"total":773094113280,"available":772826460160,"internally_reserved":0,"allocated":12742656,"data_stored":6494862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":254791225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27738,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-165,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001354"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-13T17:19:39.310322+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:19:39.310322+0000","last_peered":"2024-09-13T17:19:39.310322+0000","last_clean":"2024-09-13T17:19:39.310322+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:19:39.310322+0000","last_undegraded":"2024-09-13T17:19:39.310322+0000","last_fullsized":"2024-09-13T17:19:39.310322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":2031616,"data_stored":1247575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.439}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78100000000000003,"5min":1.165,"15min":1.165},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":1.216,"15min":1.216},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61399999999999999,"5min":1.234,"15min":1.234},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57999999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.625,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.044,"15min":1.044},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":0.878,"15min":0.878},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1474560,"data_stored":678688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.627,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.752}]},{"osd":1,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.503},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.625},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67500000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65600000000000003,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.86299999999999999,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.173,"15min":1.173},"last":0.748}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.36699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":1.008,"15min":1.008},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.085,"15min":1.085},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.95699999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.372,"15min":0.371},"max":{"1min":0.745,"5min":0.80400000000000005,"15min":1.034},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.80900000000000005,"15min":0.91300000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":0.873,"15min":0.873},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.77700000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.503,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57699999999999996},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.76900000000000002,"15min":0.80900000000000005},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.33600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.76600000000000001,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79100000000000004},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.36199999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.91600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47599999999999998,"5min":0.63400000000000001,"15min":0.85199999999999998},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":0.67000000000000004,"15min":1.458},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.433},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":1.3560000000000001},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.374,"15min":0.40699999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":1.4239999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":1.3899999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":1.0069999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94199999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.226},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32512,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1429504,"data_stored":658442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.68899999999999995},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.378,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.28599999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.73399999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.244},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.75},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":1.216}]},{"osd":6,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.42799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88600000000000001},"last":1.177},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1421312,"data_stored":651972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.97799999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.622,"5min":0.622,"15min":1.159},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.314},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":1.081},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":1.1200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.286},"last":0.33300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.878,"15min":1.046},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":1.1919999999999999},"last":0.624},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2230000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":1.254},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":2048000,"data_stored":1264379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.47499999999999998,"15min":0.41099999999999998},"min":{"1min":0.217,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51900000000000002,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.498,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54800000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":14.262,"15min":14.262},"last":0.222},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.52800000000000002,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":0.63200000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.38200000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":3.956,"15min":3.956},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":4.069,"15min":4.069},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89900000000000002,"5min":4.04,"15min":4.04},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.375},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.623},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:19:43.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.474+0000 7f90f6d25640 1 Processor -- start 2024-09-13T17:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.474+0000 7f90f6d25640 1 -- start start 2024-09-13T17:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.474+0000 7f90f6d25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 0x7f90f00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.474+0000 7f90f6d25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 0x7f90f00b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.474+0000 7f90f6d25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f015cdd0 con 0x7f90f00cd630 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f6d25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00b8750 con 0x7f90f015c9f0 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f6d25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00d2c20 con 0x7f90f00b5820 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f52c2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 0x7f90f00b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f4ac1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 0x7f90f00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90effff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f90f00cd630 0x7f90f00b46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:53978/0 (socket says 172.21.15.5:53978) 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90effff640 1 -- 172.21.15.5:0/989045591 learned_addr learned my addr 172.21.15.5:0/989045591 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f52c2640 1 -- 172.21.15.5:0/989045591 >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 msgr2=0x7f90f00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f52c2640 1 --2- 172.21.15.5:0/989045591 >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 0x7f90f00b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f52c2640 1 -- 172.21.15.5:0/989045591 >> v1:172.21.15.179:6789/0 conn(0x7f90f00cd630 legacy=0x7f90f00b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f52c2640 1 -- 172.21.15.5:0/989045591 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00d3040 con 0x7f90f00b5820 2024-09-13T17:19:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90ef7fe640 1 -- 172.21.15.5:0/989045591 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787020056 0 0) 0x7f90f015cdd0 con 0x7f90f00cd630 2024-09-13T17:19:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.475+0000 7f90f4ac1640 1 --2- 172.21.15.5:0/989045591 >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 0x7f90f00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.476+0000 7f90f52c2640 1 --2- 172.21.15.5:0/989045591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 0x7f90f00b5cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009d90 tx=0x7f90e802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e23f1ccfb3730d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.476+0000 7f90ef7fe640 1 -- 172.21.15.5:0/989045591 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8031600 con 0x7f90f00b5820 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.476+0000 7f90ef7fe640 1 -- 172.21.15.5:0/989045591 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e802d050 con 0x7f90f00b5820 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.476+0000 7f90ef7fe640 1 -- 172.21.15.5:0/989045591 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8031980 con 0x7f90f00b5820 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 -- 172.21.15.5:0/989045591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 msgr2=0x7f90f00b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 --2- 172.21.15.5:0/989045591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 0x7f90f00b5cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009d90 tx=0x7f90e802a5d0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 -- 172.21.15.5:0/989045591 shutdown_connections 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 --2- 172.21.15.5:0/989045591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f00b5820 0x7f90f00b5cd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 --2- 172.21.15.5:0/989045591 >> v2:172.21.15.179:3300/0 conn(0x7f90f015c9f0 0x7f90f00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 -- 172.21.15.5:0/989045591 >> 172.21.15.5:0/989045591 conn(0x7f90f0071a20 msgr2=0x7f90f0071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 -- 172.21.15.5:0/989045591 shutdown_connections 2024-09-13T17:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.477+0000 7f90f6d25640 1 -- 172.21.15.5:0/989045591 wait complete. 2024-09-13T17:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.478+0000 7f90f6d25640 1 Processor -- start 2024-09-13T17:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.478+0000 7f90f6d25640 1 -- start start 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 0x7f90f014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 0x7f90f014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0152240 con 0x7f90f00b5820 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b4830 con 0x7f90f00cd630 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f6d25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00c6660 con 0x7f90f015c9f0 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35668/0 (socket says 172.21.15.5:35668) 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 -- 172.21.15.5:0/1497927260 learned_addr learned my addr 172.21.15.5:0/1497927260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f52c2640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 0x7f90f014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90effff640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 0x7f90f014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 -- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 msgr2=0x7f90f014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 0x7f90f014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 -- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 msgr2=0x7f90f014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 0x7f90f014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f4ac1640 1 -- 172.21.15.5:0/1497927260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4009400 con 0x7f90f00b5820 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90f52c2640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 0x7f90f014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.479+0000 7f90effff640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 0x7f90f014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90f4ac1640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e960 tx=0x7f90e400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e400ca00 con 0x7f90f00b5820 2024-09-13T17:19:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400cb60 con 0x7f90f00b5820 2024-09-13T17:19:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4013470 con 0x7f90f00b5820 2024-09-13T17:19:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e8009a70 con 0x7f90f00b5820 2024-09-13T17:19:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.480+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f00b4d90 con 0x7f90f00b5820 2024-09-13T17:19:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.481+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f00b1d90 con 0x7f90f00b5820 2024-09-13T17:19:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.481+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90e40135d0 con 0x7f90f00b5820 2024-09-13T17:19:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.482+0000 7f90ed7fa640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 0x7f90d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.482+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f90e4089420 con 0x7f90f00b5820 2024-09-13T17:19:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.482+0000 7f90effff640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 0x7f90d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.483+0000 7f90effff640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 0x7f90d406d0f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f90f00d2350 tx=0x7f90dc007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.486+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90e4054740 con 0x7f90f00b5820 2024-09-13T17:19:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.656+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90f00d2560 con 0x7f90d406ac30 2024-09-13T17:19:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.658+0000 7f90ed7fa640 1 -- 172.21.15.5:0/1497927260 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50992 (secure 0 0 0) 0x7f90dc007270 con 0x7f90d406ac30 2024-09-13T17:19:43.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.660+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 msgr2=0x7f90d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.660+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 0x7f90d406d0f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f90f00d2350 tx=0x7f90dc007c10 comp rx=0 tx=0).stop 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.660+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 msgr2=0x7f90f01f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.660+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e960 tx=0x7f90e400ee20 comp rx=0 tx=0).stop 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 shutdown_connections 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90f015c9f0 0x7f90f014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90f00cd630 0x7f90f014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f90d406ac30 0x7f90d406d0f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 --2- 172.21.15.5:0/1497927260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90f00b5820 0x7f90f01f6000 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 >> 172.21.15.5:0/1497927260 conn(0x7f90f0071a20 msgr2=0x7f90f00d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 shutdown_connections 2024-09-13T17:19:43.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.661+0000 7f90f6d25640 1 -- 172.21.15.5:0/1497927260 wait complete. 2024-09-13T17:19:43.673 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-13T17:19:43.350619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":261380,"kb_used_data":12444,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713340,"statfs":{"total":773094113280,"available":772826460160,"internally_reserved":0,"allocated":12742656,"data_stored":6494862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":254791225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27738,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-165,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001354"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-13T17:19:39.310322+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:19:39.310322+0000","last_peered":"2024-09-13T17:19:39.310322+0000","last_clean":"2024-09-13T17:19:39.310322+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:19:39.310322+0000","last_undegraded":"2024-09-13T17:19:39.310322+0000","last_fullsized":"2024-09-13T17:19:39.310322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":2031616,"data_stored":1247575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.439}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78100000000000003,"5min":1.165,"15min":1.165},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":1.216,"15min":1.216},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61399999999999999,"5min":1.234,"15min":1.234},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57999999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.625,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.044,"15min":1.044},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":0.878,"15min":0.878},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1474560,"data_stored":678688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.627,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.752}]},{"osd":1,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.503},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.625},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67500000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65600000000000003,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.86299999999999999,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.173,"15min":1.173},"last":0.748}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.36699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":1.008,"15min":1.008},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.085,"15min":1.085},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.95699999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.372,"15min":0.371},"max":{"1min":0.745,"5min":0.80400000000000005,"15min":1.034},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.80900000000000005,"15min":0.91300000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":0.873,"15min":0.873},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.77700000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.503,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57699999999999996},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.76900000000000002,"15min":0.80900000000000005},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.33600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.76600000000000001,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79100000000000004},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.36199999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.91600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47599999999999998,"5min":0.63400000000000001,"15min":0.85199999999999998},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":0.67000000000000004,"15min":1.458},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.433},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":1.3560000000000001},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.374,"15min":0.40699999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":1.4239999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":1.3899999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":1.0069999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94199999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.226},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32512,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1429504,"data_stored":658442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.68899999999999995},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.378,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.28599999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.73399999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.244},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.75},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":1.216}]},{"osd":6,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.42799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88600000000000001},"last":1.177},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1421312,"data_stored":651972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.97799999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.622,"5min":0.622,"15min":1.159},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.314},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":1.081},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":1.1200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.286},"last":0.33300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.878,"15min":1.046},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":1.1919999999999999},"last":0.624},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2230000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":1.254},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":2048000,"data_stored":1264379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.47499999999999998,"15min":0.41099999999999998},"min":{"1min":0.217,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51900000000000002,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.498,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54800000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":14.262,"15min":14.262},"last":0.222},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.52800000000000002,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":0.63200000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.38200000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":3.956,"15min":3.956},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":4.069,"15min":4.069},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89900000000000002,"5min":4.04,"15min":4.04},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.375},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.623},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:19:43.674 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:19:43.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:19:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.775+0000 7fdd0c301640 1 Processor -- start 2024-09-13T17:19:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.775+0000 7fdd0c301640 1 -- start start 2024-09-13T17:19:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0c301640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd0406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0c301640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 0x7fdd0415d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0c301640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd040b3150 con 0x7fdd040cb7b0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0c301640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0415cf00 con 0x7fdd0406e370 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0c301640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040b3430 con 0x7fdd041592d0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0989c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd040cb7b0 0x7fdd0406dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58102/0 (socket says 172.21.15.5:58102) 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0989c640 1 -- 172.21.15.5:0/2681689282 learned_addr learned my addr 172.21.15.5:0/2681689282 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/2681689282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd0406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a89e640 1 --2- 172.21.15.5:0/2681689282 >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 0x7fdd0415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417807302 0 0) 0x7fdd040b3150 con 0x7fdd040cb7b0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcec005730 con 0x7fdd040cb7b0 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a09d640 1 -- 172.21.15.5:0/2681689282 >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 msgr2=0x7fdd0415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/2681689282 >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 0x7fdd0415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a09d640 1 -- 172.21.15.5:0/2681689282 >> v1:172.21.15.5:6789/0 conn(0x7fdd040cb7b0 legacy=0x7fdd0406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152088837 0 0) 0x7fdcec005730 con 0x7fdd040cb7b0 2024-09-13T17:19:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a09d640 1 -- 172.21.15.5:0/2681689282 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040b3710 con 0x7fdd041592d0 2024-09-13T17:19:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.776+0000 7fdd0a89e640 1 --2- 172.21.15.5:0/2681689282 >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 0x7fdd0415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.777+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/2681689282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd0406c440 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009d90 tx=0x7fdcfc02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dbf997a04ed219d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.777+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8001670 con 0x7fdd041592d0 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.777+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc02d050 con 0x7fdd041592d0 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.777+0000 7fdd0909b640 1 -- 172.21.15.5:0/2681689282 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc007760 con 0x7fdd041592d0 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 -- 172.21.15.5:0/2681689282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 msgr2=0x7fdd0406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 --2- 172.21.15.5:0/2681689282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd0406c440 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009d90 tx=0x7fdcfc02a560 comp rx=0 tx=0).stop 2024-09-13T17:19:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 -- 172.21.15.5:0/2681689282 shutdown_connections 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 --2- 172.21.15.5:0/2681689282 >> v2:172.21.15.179:3300/0 conn(0x7fdd0406e370 0x7fdd0415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 --2- 172.21.15.5:0/2681689282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd0406c440 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 -- 172.21.15.5:0/2681689282 >> 172.21.15.5:0/2681689282 conn(0x7fdd04066200 msgr2=0x7fdd04069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 -- 172.21.15.5:0/2681689282 shutdown_connections 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.778+0000 7fdd0c301640 1 -- 172.21.15.5:0/2681689282 wait complete. 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.779+0000 7fdd0c301640 1 Processor -- start 2024-09-13T17:19:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.779+0000 7fdd0c301640 1 -- start start 2024-09-13T17:19:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 0x7fdd04141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd040ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040acf90 con 0x7fdd0406e370 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040ad270 con 0x7fdd040cb7b0 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0c301640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040ad550 con 0x7fdd041592d0 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35680/0 (socket says 172.21.15.5:35680) 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 -- 172.21.15.5:0/3095311378 learned_addr learned my addr 172.21.15.5:0/3095311378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a89e640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd040ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 -- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 msgr2=0x7fdd040ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd040ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0989c640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 0x7fdd04141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 -- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 msgr2=0x7fdd04141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 0x7fdd04141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0a09d640 1 -- 172.21.15.5:0/3095311378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4009400 con 0x7fdd0406e370 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.780+0000 7fdd0989c640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 0x7fdd04141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd0a09d640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f80 tx=0x7fdcfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc03c830 con 0x7fdd0406e370 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc03c990 con 0x7fdd0406e370 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc009a70 con 0x7fdd0406e370 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc03cd20 con 0x7fdd0406e370 2024-09-13T17:19:43.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.781+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd040adb10 con 0x7fdd0406e370 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.782+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd040672f0 con 0x7fdd0406e370 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.782+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcfc031400 con 0x7fdd0406e370 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.783+0000 7fdd02ffd640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 0x7fdcf006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.783+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fdcfc0aaf50 con 0x7fdd0406e370 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.783+0000 7fdd0989c640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 0x7fdcf006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.783+0000 7fdd0989c640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 0x7fdcf006d0f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdd040b24b0 tx=0x7fdcf8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:43.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.787+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdcfc0760c0 con 0x7fdd0406e370 2024-09-13T17:19:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.955+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd041596b0 con 0x7fdcf006ac30 2024-09-13T17:19:43.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.958+0000 7fdd02ffd640 1 -- 172.21.15.5:0/3095311378 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50992 (secure 0 0 0) 0x7fdcf80058d0 con 0x7fdcf006ac30 2024-09-13T17:19:43.959 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:19:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.959+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 msgr2=0x7fdcf006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.959+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 0x7fdcf006d0f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdd040b24b0 tx=0x7fdcf8009040 comp rx=0 tx=0).stop 2024-09-13T17:19:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.959+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 msgr2=0x7fdd04144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.959+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f80 tx=0x7fdcfc004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 shutdown_connections 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd041592d0 0x7fdd040ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd040cb7b0 0x7fdd04141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fdcf006ac30 0x7fdcf006d0f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 --2- 172.21.15.5:0/3095311378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd0406e370 0x7fdd04144d90 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 >> 172.21.15.5:0/3095311378 conn(0x7fdd04066200 msgr2=0x7fdd040cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 shutdown_connections 2024-09-13T17:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:43.960+0000 7fdd0c301640 1 -- 172.21.15.5:0/3095311378 wait complete. 2024-09-13T17:19:43.971 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-13T17:19:43.350619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":261380,"kb_used_data":12444,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713340,"statfs":{"total":773094113280,"available":772826460160,"internally_reserved":0,"allocated":12742656,"data_stored":6494862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":254791225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27738,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-165,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001354"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-13T17:19:39.310322+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:19:39.310322+0000","last_peered":"2024-09-13T17:19:39.310322+0000","last_clean":"2024-09-13T17:19:39.310322+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:19:39.310322+0000","last_undegraded":"2024-09-13T17:19:39.310322+0000","last_fullsized":"2024-09-13T17:19:39.310322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":2031616,"data_stored":1247575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.439}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78100000000000003,"5min":1.165,"15min":1.165},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":1.216,"15min":1.216},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61399999999999999,"5min":1.234,"15min":1.234},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57999999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.625,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.044,"15min":1.044},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":0.878,"15min":0.878},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1474560,"data_stored":678688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.627,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.752}]},{"osd":1,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.503},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.625},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67500000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65600000000000003,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.86299999999999999,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.173,"15min":1.173},"last":0.748}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.36699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":1.008,"15min":1.008},"last":0.504}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.085,"15min":1.085},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.95699999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":0.85299999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.372,"15min":0.371},"max":{"1min":0.745,"5min":0.80400000000000005,"15min":1.034},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.80900000000000005,"15min":0.91300000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":0.873,"15min":0.873},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.77700000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.503,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57699999999999996},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.76900000000000002,"15min":0.80900000000000005},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.33600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.76600000000000001,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79100000000000004},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.36199999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.91600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47599999999999998,"5min":0.63400000000000001,"15min":0.85199999999999998},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":0.67000000000000004,"15min":1.458},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.433},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":1.3560000000000001},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.374,"15min":0.40699999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":1.4239999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":1.3899999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":1.0069999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94199999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.226},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32512,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1429504,"data_stored":658442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.68899999999999995},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.378,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.28599999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.436},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.73399999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.244},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.75},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":1.216}]},{"osd":6,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.42799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88600000000000001},"last":1.177},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1421312,"data_stored":651972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.97799999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.622,"5min":0.622,"15min":1.159},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.314},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":1.081},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":1.1200000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.286},"last":0.33300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.878,"15min":1.046},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":1.1919999999999999},"last":0.624},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2230000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":1.254},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":2048000,"data_stored":1264379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.47499999999999998,"15min":0.41099999999999998},"min":{"1min":0.217,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51900000000000002,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.498,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54800000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":14.262,"15min":14.262},"last":0.222},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.52800000000000002,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":0.63200000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.38200000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":3.956,"15min":3.956},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":4.069,"15min":4.069},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89900000000000002,"5min":4.04,"15min":4.04},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.375},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.623},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:19:43.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:19:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.073+0000 7f4df479c640 1 Processor -- start 2024-09-13T17:19:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.073+0000 7f4df479c640 1 -- start start 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df479c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4dec06e370 0x7f4dec15d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df479c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b3150 con 0x7f4dec1592d0 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df479c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b3430 con 0x7f4dec0cb7b0 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df479c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec15cf00 con 0x7f4dec06e370 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df2538640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4dec1592d0 0x7f4dec06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58106/0 (socket says 172.21.15.5:58106) 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df2538640 1 -- 172.21.15.5:0/724995841 learned_addr learned my addr 172.21.15.5:0/724995841 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df2d39640 1 --2- 172.21.15.5:0/724995841 >> v2:172.21.15.179:3300/0 conn(0x7f4dec06e370 0x7f4dec15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340774988 0 0) 0x7f4dec0b3150 con 0x7f4dec1592d0 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.074+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd4003520 con 0x7f4dec1592d0 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197232942 0 0) 0x7f4dec0b3430 con 0x7f4dec0cb7b0 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec0b3150 con 0x7f4dec0cb7b0 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 489055602 0 0) 0x7f4dd4003520 con 0x7f4dec1592d0 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df2d39640 1 -- 172.21.15.5:0/724995841 >> v1:172.21.15.179:6789/0 conn(0x7f4dec0cb7b0 legacy=0x7f4dec06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df2d39640 1 -- 172.21.15.5:0/724995841 >> v1:172.21.15.5:6789/0 conn(0x7f4dec1592d0 legacy=0x7f4dec06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.075+0000 7f4df2d39640 1 -- 172.21.15.5:0/724995841 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0b3710 con 0x7f4dec06e370 2024-09-13T17:19:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df2d39640 1 --2- 172.21.15.5:0/724995841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec06e370 0x7f4dec15d350 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097a0 tx=0x7f4de402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374586208dbc22e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc001a10 con 0x7f4dec06e370 2024-09-13T17:19:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de402abc0 con 0x7f4dec06e370 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df1536640 1 -- 172.21.15.5:0/724995841 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4032440 con 0x7f4dec06e370 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 -- 172.21.15.5:0/724995841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec06e370 msgr2=0x7f4dec15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 --2- 172.21.15.5:0/724995841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec06e370 0x7f4dec15d350 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097a0 tx=0x7f4de402a130 comp rx=0 tx=0).stop 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 -- 172.21.15.5:0/724995841 shutdown_connections 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 --2- 172.21.15.5:0/724995841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec06e370 0x7f4dec15d350 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 -- 172.21.15.5:0/724995841 >> 172.21.15.5:0/724995841 conn(0x7f4dec066200 msgr2=0x7f4dec069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 -- 172.21.15.5:0/724995841 shutdown_connections 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.076+0000 7f4df479c640 1 -- 172.21.15.5:0/724995841 wait complete. 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 Processor -- start 2024-09-13T17:19:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 -- start start 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dec0cb7b0 0x7f4dec149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec1592d0 0x7f4dec14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec14bdb0 con 0x7f4dec06e370 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec14cc00 con 0x7f4dec1592d0 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df479c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec14bff0 con 0x7f4dec0cb7b0 2024-09-13T17:19:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df2538640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df2538640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35696/0 (socket says 172.21.15.5:35696) 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.078+0000 7f4df2538640 1 -- 172.21.15.5:0/1015353601 learned_addr learned my addr 172.21.15.5:0/1015353601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 -- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dec0cb7b0 msgr2=0x7f4dec149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dec0cb7b0 0x7f4dec149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 -- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec1592d0 msgr2=0x7f4dec14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec1592d0 0x7f4dec14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 -- 172.21.15.5:0/1015353601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009400 con 0x7f4dec06e370 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df2538640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00ca70 tx=0x7f4ddc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00a6a0 con 0x7f4dec06e370 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00a800 con 0x7f4dec06e370 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec14c2d0 con 0x7f4dec06e370 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00abf0 con 0x7f4dec06e370 2024-09-13T17:19:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.079+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec14c890 con 0x7f4dec06e370 2024-09-13T17:19:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.080+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec0672f0 con 0x7f4dec06e370 2024-09-13T17:19:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.081+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ddc00ad50 con 0x7f4dec06e370 2024-09-13T17:19:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.081+0000 7f4deaffd640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 0x7f4dd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.081+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f4ddc088c10 con 0x7f4dec06e370 2024-09-13T17:19:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.082+0000 7f4df1d37640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 0x7f4dd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.082+0000 7f4df1d37640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 0x7f4dd806d0c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4de00010e0 tx=0x7f4de0007950 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:44.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.085+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4ddc053f30 con 0x7f4dec06e370 2024-09-13T17:19:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.258+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dec0cdcb0 con 0x7f4dec06e370 2024-09-13T17:19:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.259+0000 7f4deaffd640 1 -- 172.21.15.5:0/1015353601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+13551 (secure 0 0 0) 0x7f4ddc018020 con 0x7f4dec06e370 2024-09-13T17:19:44.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:44.260 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":116,"fsid":"3b63ea2f-5230-4468-aa58-3481f4f99558","created":"2024-09-13T17:12:51.088568+0000","modified":"2024-09-13T17:19:41.355535+0000","last_up_change":"2024-09-13T17:13:01.684353+0000","last_in_change":"2024-09-13T17:12:53.970777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:13:03.298806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88246ab7-8144-43e9-8fcd-2bfd01c2526f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6819","nonce":2570471928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6821","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6824","nonce":2570471928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6831","nonce":2570471928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2570471928},{"type":"v1","addr":"172.21.15.5:6829","nonce":2570471928}]},"public_addr":"172.21.15.5:6819/2570471928","cluster_addr":"172.21.15.5:6824/2570471928","heartbeat_back_addr":"172.21.15.5:6831/2570471928","heartbeat_front_addr":"172.21.15.5:6829/2570471928","state":["exists","up"]},{"osd":1,"uuid":"2fdcc3ee-0538-4376-9494-e18ce97f3943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6801","nonce":1152985231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6803","nonce":1152985231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6807","nonce":1152985231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1152985231},{"type":"v1","addr":"172.21.15.5:6805","nonce":1152985231}]},"public_addr":"172.21.15.5:6801/1152985231","cluster_addr":"172.21.15.5:6803/1152985231","heartbeat_back_addr":"172.21.15.5:6807/1152985231","heartbeat_front_addr":"172.21.15.5:6805/1152985231","state":["exists","up"]},{"osd":2,"uuid":"a95f771e-3df2-42a8-935e-3fa6e1ef3845","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6818","nonce":2157447166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6822","nonce":2157447166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6828","nonce":2157447166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":2157447166},{"type":"v1","addr":"172.21.15.5:6825","nonce":2157447166}]},"public_addr":"172.21.15.5:6818/2157447166","cluster_addr":"172.21.15.5:6822/2157447166","heartbeat_back_addr":"172.21.15.5:6828/2157447166","heartbeat_front_addr":"172.21.15.5:6825/2157447166","state":["exists","up"]},{"osd":3,"uuid":"a7c61a9d-e157-4f72-bee2-46c3e9787541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6809","nonce":3301555269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6811","nonce":3301555269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6815","nonce":3301555269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3301555269},{"type":"v1","addr":"172.21.15.5:6813","nonce":3301555269}]},"public_addr":"172.21.15.5:6809/3301555269","cluster_addr":"172.21.15.5:6811/3301555269","heartbeat_back_addr":"172.21.15.5:6815/3301555269","heartbeat_front_addr":"172.21.15.5:6813/3301555269","state":["exists","up"]},{"osd":4,"uuid":"16465137-863c-4f89-83a2-43ee2ed6fb44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6801","nonce":1714873642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6803","nonce":1714873642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6807","nonce":1714873642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":1714873642},{"type":"v1","addr":"172.21.15.179:6805","nonce":1714873642}]},"public_addr":"172.21.15.179:6801/1714873642","cluster_addr":"172.21.15.179:6803/1714873642","heartbeat_back_addr":"172.21.15.179:6807/1714873642","heartbeat_front_addr":"172.21.15.179:6805/1714873642","state":["exists","up"]},{"osd":5,"uuid":"6319a912-abd4-4259-b992-7aaed68bc6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6822","nonce":2660134855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6825","nonce":2660134855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6831","nonce":2660134855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6827","nonce":2660134855},{"type":"v1","addr":"172.21.15.179:6829","nonce":2660134855}]},"public_addr":"172.21.15.179:6822/2660134855","cluster_addr":"172.21.15.179:6825/2660134855","heartbeat_back_addr":"172.21.15.179:6831/2660134855","heartbeat_front_addr":"172.21.15.179:6829/2660134855","state":["exists","up"]},{"osd":6,"uuid":"8de296e9-c643-45b8-9721-56700e58451c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6809","nonce":3336213944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6811","nonce":3336213944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6815","nonce":3336213944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":3336213944},{"type":"v1","addr":"172.21.15.179:6813","nonce":3336213944}]},"public_addr":"172.21.15.179:6809/3336213944","cluster_addr":"172.21.15.179:6811/3336213944","heartbeat_back_addr":"172.21.15.179:6815/3336213944","heartbeat_front_addr":"172.21.15.179:6813/3336213944","state":["exists","up"]},{"osd":7,"uuid":"d06961fe-67f5-4910-b533-4b0e69b816ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6817","nonce":1963856475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6819","nonce":1963856475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6828","nonce":1963856475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":1963856475},{"type":"v1","addr":"172.21.15.179:6823","nonce":1963856475}]},"public_addr":"172.21.15.179:6817/1963856475","cluster_addr":"172.21.15.179:6819/1963856475","heartbeat_back_addr":"172.21.15.179:6828/1963856475","heartbeat_front_addr":"172.21.15.179:6823/1963856475","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.112814+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.191866+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.169525+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.164783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.038480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.201835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.134508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:12:59.157739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6836/3695538283":"2024-09-14T17:19:38.341030+0000","172.21.15.179:6837/3695538283":"2024-09-14T17:19:38.341030+0000","172.21.15.5:6832/3736030266":"2024-09-14T17:19:38.341043+0000","172.21.15.5:6833/3736030266":"2024-09-14T17:19:38.341043+0000","172.21.15.5:6835/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6834/1886354202":"2024-09-14T17:18:51.850170+0000","172.21.15.5:6833/1677867267":"2024-09-14T17:18:51.834824+0000","172.21.15.5:6832/1677867267":"2024-09-14T17:18:51.834824+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 msgr2=0x7f4dd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 0x7f4dd806d0c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4de00010e0 tx=0x7f4de0007950 comp rx=0 tx=0).stop 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 msgr2=0x7f4dec143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00ca70 tx=0x7f4ddc00cf30 comp rx=0 tx=0).stop 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 shutdown_connections 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dec1592d0 0x7f4dec14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dec0cb7b0 0x7f4dec149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4dd806ac00 0x7f4dd806d0c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 --2- 172.21.15.5:0/1015353601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dec06e370 0x7f4dec143870 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 >> 172.21.15.5:0/1015353601 conn(0x7f4dec066200 msgr2=0x7f4dec15c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 shutdown_connections 2024-09-13T17:19:44.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:44.261+0000 7f4df479c640 1 -- 172.21.15.5:0/1015353601 wait complete. 2024-09-13T17:19:45.273 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T17:19:45.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.392+0000 7f5f9624f640 1 Processor -- start 2024-09-13T17:19:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.392+0000 7f5f9624f640 1 -- start start 2024-09-13T17:19:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.392+0000 7f5f9624f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f9015a2b0 0x7f5f900cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.392+0000 7f5f9624f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f900aeb10 0x7f5f900aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f9624f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900af4b0 con 0x7f5f900af890 2024-09-13T17:19:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f9624f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900b0860 con 0x7f5f900aeb10 2024-09-13T17:19:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f9624f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900cc390 con 0x7f5f9015a2b0 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f900aeb10 0x7f5f900aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f900aeb10 0x7f5f900aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35712/0 (socket says 172.21.15.5:35712) 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 -- 172.21.15.5:0/3466928024 learned_addr learned my addr 172.21.15.5:0/3466928024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f9015a2b0 0x7f5f900cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 -- 172.21.15.5:0/3466928024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f9015a2b0 msgr2=0x7f5f900cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f9015a2b0 0x7f5f900cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 -- 172.21.15.5:0/3466928024 >> v1:172.21.15.179:6789/0 conn(0x7f5f900af890 legacy=0x7f5f900afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.393+0000 7f5f8effd640 1 -- 172.21.15.5:0/3466928024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900b0580 con 0x7f5f900aeb10 2024-09-13T17:19:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.394+0000 7f5f8effd640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900aeb10 0x7f5f900aef70 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009870 tx=0x7f5f8402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e12dcd65aeb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.394+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/3466928024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84032440 con 0x7f5f900aeb10 2024-09-13T17:19:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.394+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/3466928024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f840325a0 con 0x7f5f900aeb10 2024-09-13T17:19:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.394+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/3466928024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84032930 con 0x7f5f900aeb10 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 -- 172.21.15.5:0/3466928024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900aeb10 msgr2=0x7f5f900aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900aeb10 0x7f5f900aef70 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009870 tx=0x7f5f8402a1c0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 -- 172.21.15.5:0/3466928024 shutdown_connections 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900aeb10 0x7f5f900aef70 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 --2- 172.21.15.5:0/3466928024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f9015a2b0 0x7f5f900cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 -- 172.21.15.5:0/3466928024 >> 172.21.15.5:0/3466928024 conn(0x7f5f90071970 msgr2=0x7f5f90098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 -- 172.21.15.5:0/3466928024 shutdown_connections 2024-09-13T17:19:45.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.395+0000 7f5f9624f640 1 -- 172.21.15.5:0/3466928024 wait complete. 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.396+0000 7f5f9624f640 1 Processor -- start 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.396+0000 7f5f9624f640 1 -- start start 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb10 0x7f5f9014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900af890 0x7f5f90151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 0x7f5f901582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9014f440 con 0x7f5f9015a2b0 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90150660 con 0x7f5f900af890 2024-09-13T17:19:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f9624f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90150940 con 0x7f5f900aeb10 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 0x7f5f901582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 0x7f5f901582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35726/0 (socket says 172.21.15.5:35726) 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 -- 172.21.15.5:0/574301686 learned_addr learned my addr 172.21.15.5:0/574301686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb10 0x7f5f9014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8effd640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900af890 0x7f5f90151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 -- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb10 msgr2=0x7f5f9014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f900aeb10 0x7f5f9014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 -- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900af890 msgr2=0x7f5f90151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f900af890 0x7f5f90151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.397+0000 7f5f8ffff640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840094d0 con 0x7f5f9015a2b0 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 0x7f5f901582c0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c730 tx=0x7f5f8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88003b90 con 0x7f5f9015a2b0 2024-09-13T17:19:45.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88003cf0 con 0x7f5f9015a2b0 2024-09-13T17:19:45.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800aa90 con 0x7f5f9015a2b0 2024-09-13T17:19:45.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90150c20 con 0x7f5f9015a2b0 2024-09-13T17:19:45.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.398+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901f0230 con 0x7f5f9015a2b0 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.399+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f900cc570 con 0x7f5f9015a2b0 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.399+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f8800abf0 con 0x7f5f9015a2b0 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f77fff640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f7c06ac30 0x7f5f7c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f5f88088eb0 con 0x7f5f9015a2b0 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f7c06ac30 0x7f5f7c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f77fff640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f5f7c071110 0x7f5f7c073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f7c073c20 con 0x7f5f7c071110 2024-09-13T17:19:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f8808b570 con 0x7f5f9015a2b0 2024-09-13T17:19:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.400+0000 7f5f8effd640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f5f7c071110 0x7f5f7c073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.401+0000 7f5f8effd640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f5f7c071110 0x7f5f7c073550 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.401+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f7c06ac30 0x7f5f7c06d0f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009b40 tx=0x7f5f80009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.401+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== osd.0 v2:172.21.15.5:6817/2570471928 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5f7c073c20 con 0x7f5f7c071110 2024-09-13T17:19:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 --> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f900b02c0 con 0x7f5f7c071110 2024-09-13T17:19:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f77fff640 1 -- 172.21.15.5:0/574301686 <== osd.0 v2:172.21.15.5:6817/2570471928 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f900b02c0 con 0x7f5f7c071110 2024-09-13T17:19:45.415 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:45.415 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:45.415 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f5f7c071110 msgr2=0x7f5f7c073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:6817/2570471928,v1:172.21.15.5:6819/2570471928] conn(0x7f5f7c071110 0x7f5f7c073550 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f7c06ac30 msgr2=0x7f5f7c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f5f7c06ac30 0x7f5f7c06d0f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009b40 tx=0x7f5f80009190 comp rx=0 tx=0).stop 2024-09-13T17:19:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 msgr2=0x7f5f901582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 --2- 172.21.15.5:0/574301686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015a2b0 0x7f5f901582c0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c730 tx=0x7f5f8800cbf0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f8ffff640 1 -- 172.21.15.5:0/574301686 reap_dead start 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 shutdown_connections 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 >> 172.21.15.5:0/574301686 conn(0x7f5f90071970 msgr2=0x7f5f90098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 shutdown_connections 2024-09-13T17:19:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.414+0000 7f5f9624f640 1 -- 172.21.15.5:0/574301686 wait complete. 2024-09-13T17:19:45.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T17:19:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.528+0000 7fb4c1b33640 1 Processor -- start 2024-09-13T17:19:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.528+0000 7fb4c1b33640 1 -- start start 2024-09-13T17:19:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4c1b33640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb4bc06e440 0x7fb4bc0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4c1b33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4bc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4c1b33640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0b3240 con 0x7fb4bc159520 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4c1b33640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b1590 con 0x7fb4bc06e440 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4c1b33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b3490 con 0x7fb4bc0cb8e0 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4bb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4bc159520 0x7fb4bc06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58110/0 (socket says 172.21.15.5:58110) 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4bb7fe640 1 -- 172.21.15.5:0/3017761146 learned_addr learned my addr 172.21.15.5:0/3017761146 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4bbfff640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4bc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711476034 0 0) 0x7fb4bc0b3240 con 0x7fb4bc159520 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4baffd640 1 --2- 172.21.15.5:0/3017761146 >> v2:172.21.15.179:3300/0 conn(0x7fb4bc06e440 0x7fb4bc0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.529+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a4003520 con 0x7fb4bc159520 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 888859554 0 0) 0x7fb4a4003520 con 0x7fb4bc159520 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 msgr2=0x7fb4bc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4bc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 >> v2:172.21.15.179:3300/0 conn(0x7fb4bc06e440 msgr2=0x7fb4bc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 --2- 172.21.15.5:0/3017761146 >> v2:172.21.15.179:3300/0 conn(0x7fb4bc06e440 0x7fb4bc0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0b1830 con 0x7fb4bc159520 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7fb4ac001670 con 0x7fb4bc159520 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 >> v1:172.21.15.5:6789/0 conn(0x7fb4bc159520 legacy=0x7fb4bc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4a4003970 0x7fb4a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4a40047c0 0x7fb4a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b1590 con 0x7fb4a4003970 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0b3490 con 0x7fb4a40047c0 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a400b980 con 0x7fb4bc0cb8e0 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4a4003970 0x7fb4a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bbfff640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4baffd640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4a40047c0 0x7fb4a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 -- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 msgr2=0x7fb4a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4bc0cb8e0 0x7fb4a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 -- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4a40047c0 msgr2=0x7fb4a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4a40047c0 0x7fb4a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.530+0000 7fb4bb7fe640 1 -- 172.21.15.5:0/3017761146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4003520 con 0x7fb4a4003970 2024-09-13T17:19:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.531+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4a4003970 0x7fb4a4003d90 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac007f90 tx=0x7fb4a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18393bee4a6d99c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.531+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac005ad0 con 0x7fb4a4003970 2024-09-13T17:19:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.531+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac005c30 con 0x7fb4a4003970 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.531+0000 7fb4ba7fc640 1 -- 172.21.15.5:0/3017761146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac007070 con 0x7fb4a4003970 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 -- 172.21.15.5:0/3017761146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4a4003970 msgr2=0x7fb4a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/3017761146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4a4003970 0x7fb4a4003d90 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac007f90 tx=0x7fb4a40057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4bbfff640 1 -- 172.21.15.5:0/3017761146 reap_dead start 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 -- 172.21.15.5:0/3017761146 shutdown_connections 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 -- 172.21.15.5:0/3017761146 >> 172.21.15.5:0/3017761146 conn(0x7fb4bc069ed0 msgr2=0x7fb4bc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 -- 172.21.15.5:0/3017761146 shutdown_connections 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.532+0000 7fb4c1b33640 1 -- 172.21.15.5:0/3017761146 wait complete. 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.533+0000 7fb4c1b33640 1 Processor -- start 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.533+0000 7fb4c1b33640 1 -- start start 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4a4003970 0x7fb4bc0adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4bc0afad0 0x7fb4bc148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc154290 con 0x7fb4bc1538d0 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0aeeb0 con 0x7fb4bc0afad0 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4c1b33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ae2a0 con 0x7fb4a4003970 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35738/0 (socket says 172.21.15.5:35738) 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 -- 172.21.15.5:0/4150427261 learned_addr learned my addr 172.21.15.5:0/4150427261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4baffd640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4bc0afad0 0x7fb4bc148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4a4003970 0x7fb4bc0adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 -- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4a4003970 msgr2=0x7fb4bc0adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4a4003970 0x7fb4bc0adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 -- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4bc0afad0 msgr2=0x7fb4bc148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4bc0afad0 0x7fb4bc148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.534+0000 7fb4bbfff640 1 -- 172.21.15.5:0/4150427261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0ae580 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4bbfff640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc071bb0 tx=0x7fb4b400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400e040 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400f040 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0ae860 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4015670 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.535+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0aff50 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.536+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0af020 con 0x7fb4bc1538d0 2024-09-13T17:19:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.536+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb4b40157d0 con 0x7fb4bc1538d0 2024-09-13T17:19:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.537+0000 7fb4a3fff640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 0x7fb4a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.537+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fb4b4089920 con 0x7fb4bc1538d0 2024-09-13T17:19:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.537+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 0x7fb4a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.538+0000 7fb4bb7fe640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 0x7fb4a806d0f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac035000 tx=0x7fb4ac009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.541+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb4b4054bb0 con 0x7fb4bc1538d0 2024-09-13T17:19:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.711+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4bc0b3770 con 0x7fb4a806ac30 2024-09-13T17:19:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.712+0000 7fb4a3fff640 1 -- 172.21.15.5:0/4150427261 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb4ac005e20 con 0x7fb4a806ac30 2024-09-13T17:19:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 msgr2=0x7fb4a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 0x7fb4a806d0f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac035000 tx=0x7fb4ac009030 comp rx=0 tx=0).stop 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 msgr2=0x7fb4bc153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc071bb0 tx=0x7fb4b400f580 comp rx=0 tx=0).stop 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 shutdown_connections 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb4a806ac30 0x7fb4a806d0f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4bc1538d0 0x7fb4bc153d50 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4bc0afad0 0x7fb4bc148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 --2- 172.21.15.5:0/4150427261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4a4003970 0x7fb4bc0adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 >> 172.21.15.5:0/4150427261 conn(0x7fb4bc069ed0 msgr2=0x7fb4bc0cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 shutdown_connections 2024-09-13T17:19:45.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.714+0000 7fb4c1b33640 1 -- 172.21.15.5:0/4150427261 wait complete. 2024-09-13T17:19:45.726 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T17:19:45.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.830+0000 7fb80b032640 1 Processor -- start 2024-09-13T17:19:45.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.830+0000 7fb80b032640 1 -- start start 2024-09-13T17:19:45.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb80b032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb804153190 0x7fb804159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb80b032640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8040b3240 0x7fb8040cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb80b032640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb804153570 con 0x7fb80415c640 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb80b032640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80406ad10 con 0x7fb8040b3240 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb80b032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80415a010 con 0x7fb804153190 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb8095cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8040b3240 0x7fb8040cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb803fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb80415c640 0x7fb8040b2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58124/0 (socket says 172.21.15.5:58124) 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.831+0000 7fb803fff640 1 -- 172.21.15.5:0/3148915099 learned_addr learned my addr 172.21.15.5:0/3148915099 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb808dce640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb804153190 0x7fb804159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb8095cf640 1 -- 172.21.15.5:0/3148915099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb804153190 msgr2=0x7fb804159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb8095cf640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb804153190 0x7fb804159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb8095cf640 1 -- 172.21.15.5:0/3148915099 >> v1:172.21.15.5:6789/0 conn(0x7fb80415c640 legacy=0x7fb8040b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb8095cf640 1 -- 172.21.15.5:0/3148915099 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80415cb30 con 0x7fb8040b3240 2024-09-13T17:19:45.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.832+0000 7fb8095cf640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8040b3240 0x7fb8040cceb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00ba40 tx=0x7fb7fc02c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b546e983b006fae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb8037fe640 1 -- 172.21.15.5:0/3148915099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc032480 con 0x7fb8040b3240 2024-09-13T17:19:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb8037fe640 1 -- 172.21.15.5:0/3148915099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc02f030 con 0x7fb8040b3240 2024-09-13T17:19:45.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb8037fe640 1 -- 172.21.15.5:0/3148915099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc032800 con 0x7fb8040b3240 2024-09-13T17:19:45.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 -- 172.21.15.5:0/3148915099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8040b3240 msgr2=0x7fb8040cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8040b3240 0x7fb8040cceb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00ba40 tx=0x7fb7fc02c530 comp rx=0 tx=0).stop 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 -- 172.21.15.5:0/3148915099 shutdown_connections 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8040b3240 0x7fb8040cceb0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 --2- 172.21.15.5:0/3148915099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb804153190 0x7fb804159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 -- 172.21.15.5:0/3148915099 >> 172.21.15.5:0/3148915099 conn(0x7fb804069ed0 msgr2=0x7fb80406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 -- 172.21.15.5:0/3148915099 shutdown_connections 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.833+0000 7fb80b032640 1 -- 172.21.15.5:0/3148915099 wait complete. 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.834+0000 7fb80b032640 1 Processor -- start 2024-09-13T17:19:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.834+0000 7fb80b032640 1 -- start start 2024-09-13T17:19:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8040b3240 0x7fb804158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 0x7fb80413eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb80415c640 0x7fb804155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041586b0 con 0x7fb804153190 2024-09-13T17:19:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80413f2e0 con 0x7fb8040b3240 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb80b032640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041565e0 con 0x7fb80415c640 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb803fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 0x7fb80413eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb803fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 0x7fb80413eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35752/0 (socket says 172.21.15.5:35752) 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.835+0000 7fb803fff640 1 -- 172.21.15.5:0/357765009 learned_addr learned my addr 172.21.15.5:0/357765009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb8095cf640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb80415c640 0x7fb804155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb808dce640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8040b3240 0x7fb804158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 -- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb80415c640 msgr2=0x7fb804155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb80415c640 0x7fb804155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 -- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8040b3240 msgr2=0x7fb804158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8040b3240 0x7fb804158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc00b6a0 con 0x7fb804153190 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb803fff640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 0x7fb80413eda0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cb60 tx=0x7fb7ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec004d60 con 0x7fb804153190 2024-09-13T17:19:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ab40 con 0x7fb804153190 2024-09-13T17:19:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0070d0 con 0x7fb804153190 2024-09-13T17:19:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb804157ff0 con 0x7fb804153190 2024-09-13T17:19:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.836+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041ef000 con 0x7fb804153190 2024-09-13T17:19:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.837+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8040cc4b0 con 0x7fb804153190 2024-09-13T17:19:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7ec007230 con 0x7fb804153190 2024-09-13T17:19:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb7e406ac00 0x7fb7e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fb7ec088960 con 0x7fb804153190 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7fb7e40710e0 0x7fb7e4073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7e4073bf0 con 0x7fb7e40710e0 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ec08d2c0 con 0x7fb804153190 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.838+0000 7fb808dce640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb7e406ac00 0x7fb7e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.839+0000 7fb8095cf640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7fb7e40710e0 0x7fb7e4073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.839+0000 7fb8095cf640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7fb7e40710e0 0x7fb7e4073520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.839+0000 7fb808dce640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb7e406ac00 0x7fb7e406d0c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40079a0 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.839+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== osd.1 v2:172.21.15.5:6800/1152985231 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb7e4073bf0 con 0x7fb7e40710e0 2024-09-13T17:19:45.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.851+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 --> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb80415d3d0 con 0x7fb7e40710e0 2024-09-13T17:19:45.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb8017fa640 1 -- 172.21.15.5:0/357765009 <== osd.1 v2:172.21.15.5:6800/1152985231 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb7fc032070 con 0x7fb7e40710e0 2024-09-13T17:19:45.853 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:45.853 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:45.853 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7fb7e40710e0 msgr2=0x7fb7e4073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:6800/1152985231,v1:172.21.15.5:6801/1152985231] conn(0x7fb7e40710e0 0x7fb7e4073520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb7e406ac00 msgr2=0x7fb7e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fb7e406ac00 0x7fb7e406d0c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40079a0 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 msgr2=0x7fb80413eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 --2- 172.21.15.5:0/357765009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804153190 0x7fb80413eda0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cb60 tx=0x7fb7ec00a430 comp rx=0 tx=0).stop 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb8095cf640 1 -- 172.21.15.5:0/357765009 reap_dead start 2024-09-13T17:19:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 shutdown_connections 2024-09-13T17:19:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 >> 172.21.15.5:0/357765009 conn(0x7fb804069ed0 msgr2=0x7fb8040afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 shutdown_connections 2024-09-13T17:19:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.852+0000 7fb80b032640 1 -- 172.21.15.5:0/357765009 wait complete. 2024-09-13T17:19:45.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T17:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.964+0000 7f3c5f726640 1 Processor -- start 2024-09-13T17:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.964+0000 7f3c5f726640 1 -- start start 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5f726640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c5806e0c0 0x7f3c580acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5f726640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c58070e60 0x7f3c5806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5f726640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c580addf0 con 0x7f3c58160be0 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5f726640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580ad1e0 con 0x7f3c5806e0c0 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5f726640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580ad4c0 con 0x7f3c58070e60 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5d4c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c5806e0c0 0x7f3c580acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5d4c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c5806e0c0 0x7f3c580acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35768/0 (socket says 172.21.15.5:35768) 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5ccc1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c58160be0 0x7f3c58070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58138/0 (socket says 172.21.15.5:58138) 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.965+0000 7f3c5d4c2640 1 -- 172.21.15.5:0/3703754205 learned_addr learned my addr 172.21.15.5:0/3703754205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5d4c2640 1 -- 172.21.15.5:0/3703754205 >> v2:172.21.15.179:3300/0 conn(0x7f3c58070e60 msgr2=0x7f3c5806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5dcc3640 1 --2- 172.21.15.5:0/3703754205 >> v2:172.21.15.179:3300/0 conn(0x7f3c58070e60 0x7f3c5806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/3703754205 >> v2:172.21.15.179:3300/0 conn(0x7f3c58070e60 0x7f3c5806c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c57fff640 1 -- 172.21.15.5:0/3703754205 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143906500 0 0) 0x7f3c580addf0 con 0x7f3c58160be0 2024-09-13T17:19:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5d4c2640 1 -- 172.21.15.5:0/3703754205 >> v1:172.21.15.5:6789/0 conn(0x7f3c58160be0 legacy=0x7f3c58070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5d4c2640 1 -- 172.21.15.5:0/3703754205 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580ad7a0 con 0x7f3c5806e0c0 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/3703754205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5806e0c0 0x7f3c580acb40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f3c58071ba0 tx=0x7f3c4802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b25f494c54ef50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.966+0000 7f3c57fff640 1 -- 172.21.15.5:0/3703754205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031600 con 0x7f3c5806e0c0 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c57fff640 1 -- 172.21.15.5:0/3703754205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4802d050 con 0x7f3c5806e0c0 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c57fff640 1 -- 172.21.15.5:0/3703754205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031980 con 0x7f3c5806e0c0 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 -- 172.21.15.5:0/3703754205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5806e0c0 msgr2=0x7f3c580acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 --2- 172.21.15.5:0/3703754205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5806e0c0 0x7f3c580acb40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f3c58071ba0 tx=0x7f3c4802a730 comp rx=0 tx=0).stop 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 -- 172.21.15.5:0/3703754205 shutdown_connections 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 --2- 172.21.15.5:0/3703754205 >> v2:172.21.15.179:3300/0 conn(0x7f3c58070e60 0x7f3c5806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 --2- 172.21.15.5:0/3703754205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5806e0c0 0x7f3c580acb40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 -- 172.21.15.5:0/3703754205 >> 172.21.15.5:0/3703754205 conn(0x7f3c580b0650 msgr2=0x7f3c580b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 -- 172.21.15.5:0/3703754205 shutdown_connections 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.967+0000 7f3c5f726640 1 -- 172.21.15.5:0/3703754205 wait complete. 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.968+0000 7f3c5f726640 1 Processor -- start 2024-09-13T17:19:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.968+0000 7f3c5f726640 1 -- start start 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 0x7f3c580cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c58070e60 0x7f3c580cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580cdc70 con 0x7f3c58160be0 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58135070 con 0x7f3c5806e0c0 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5f726640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580cd940 con 0x7f3c58070e60 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5dcc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5dcc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35782/0 (socket says 172.21.15.5:35782) 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5dcc3640 1 -- 172.21.15.5:0/2337698313 learned_addr learned my addr 172.21.15.5:0/2337698313 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 0x7f3c580cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5ccc1640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c58070e60 0x7f3c580cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.969+0000 7f3c5dcc3640 1 -- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c58070e60 msgr2=0x7f3c580cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5dcc3640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c58070e60 0x7f3c580cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5dcc3640 1 -- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 msgr2=0x7f3c580cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5dcc3640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 0x7f3c580cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5dcc3640 1 -- 172.21.15.5:0/2337698313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009b30 con 0x7f3c58160be0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 0x7f3c580cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5dcc3640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c7c0 tx=0x7f3c5000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50004220 con 0x7f3c58160be0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50004380 con 0x7f3c58160be0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c580ae400 con 0x7f3c58160be0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50007840 con 0x7f3c58160be0 2024-09-13T17:19:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.970+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c58134ab0 con 0x7f3c58160be0 2024-09-13T17:19:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.971+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c580ae260 con 0x7f3c58160be0 2024-09-13T17:19:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.972+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c500079a0 con 0x7f3c58160be0 2024-09-13T17:19:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.972+0000 7f3c55ffb640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 0x7f3c4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.972+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f3c50088f10 con 0x7f3c58160be0 2024-09-13T17:19:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.972+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 0x7f3c4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.973+0000 7f3c5d4c2640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 0x7f3c4406d0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3c48033000 tx=0x7f3c48009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:45.977+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c580ae260 con 0x7f3c58160be0 2024-09-13T17:19:46.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.147+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c580ae260 con 0x7f3c4406ac30 2024-09-13T17:19:46.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.148+0000 7f3c55ffb640 1 -- 172.21.15.5:0/2337698313 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c580ae260 con 0x7f3c4406ac30 2024-09-13T17:19:46.149 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T17:19:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 msgr2=0x7f3c4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 0x7f3c4406d0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3c48033000 tx=0x7f3c48009000 comp rx=0 tx=0).stop 2024-09-13T17:19:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 msgr2=0x7f3c5815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c7c0 tx=0x7f3c5000cc80 comp rx=0 tx=0).stop 2024-09-13T17:19:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 shutdown_connections 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f3c4406ac30 0x7f3c4406d0f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c58160be0 0x7f3c5815b930 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c58070e60 0x7f3c580cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 --2- 172.21.15.5:0/2337698313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c5806e0c0 0x7f3c580cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 >> 172.21.15.5:0/2337698313 conn(0x7f3c580b0650 msgr2=0x7f3c580b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 shutdown_connections 2024-09-13T17:19:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.150+0000 7f3c5f726640 1 -- 172.21.15.5:0/2337698313 wait complete. 2024-09-13T17:19:46.162 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T17:19:46.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.267+0000 7f938d9e2640 1 Processor -- start 2024-09-13T17:19:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 -- start start 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938815ccf0 0x7f93880ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93881606e0 0x7f938815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938815d0d0 con 0x7f938815dde0 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9388160df0 con 0x7f93881606e0 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.268+0000 7f938d9e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93881610b0 con 0x7f938815ccf0 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93881606e0 0x7f938815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93881606e0 0x7f938815d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35784/0 (socket says 172.21.15.5:35784) 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 -- 172.21.15.5:0/1863167861 learned_addr learned my addr 172.21.15.5:0/1863167861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f9386ffd640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938815ccf0 0x7f93880ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 -- 172.21.15.5:0/1863167861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938815ccf0 msgr2=0x7f93880ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938815ccf0 0x7f93880ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 -- 172.21.15.5:0/1863167861 >> v1:172.21.15.179:6789/0 conn(0x7f938815dde0 legacy=0x7f93880b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.269+0000 7f93867fc640 1 -- 172.21.15.5:0/1863167861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388161390 con 0x7f93881606e0 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f93867fc640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93881606e0 0x7f938815d8a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f9370009870 tx=0x7f937002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57af587e12f96ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f9385ffb640 1 -- 172.21.15.5:0/1863167861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370032440 con 0x7f93881606e0 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f9385ffb640 1 -- 172.21.15.5:0/1863167861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93700325a0 con 0x7f93881606e0 2024-09-13T17:19:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f9385ffb640 1 -- 172.21.15.5:0/1863167861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370032930 con 0x7f93881606e0 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 -- 172.21.15.5:0/1863167861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93881606e0 msgr2=0x7f938815d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93881606e0 0x7f938815d8a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f9370009870 tx=0x7f937002a270 comp rx=0 tx=0).stop 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 -- 172.21.15.5:0/1863167861 shutdown_connections 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93881606e0 0x7f938815d8a0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 --2- 172.21.15.5:0/1863167861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f938815ccf0 0x7f93880ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 -- 172.21.15.5:0/1863167861 >> 172.21.15.5:0/1863167861 conn(0x7f938806b590 msgr2=0x7f938806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 -- 172.21.15.5:0/1863167861 shutdown_connections 2024-09-13T17:19:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.270+0000 7f938d9e2640 1 -- 172.21.15.5:0/1863167861 wait complete. 2024-09-13T17:19:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.272+0000 7f938d9e2640 1 Processor -- start 2024-09-13T17:19:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.272+0000 7f938d9e2640 1 -- start start 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 0x7f93881f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938815dde0 0x7f9388151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93881606e0 0x7f93880d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93881f7040 con 0x7f938815ccf0 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93880c97f0 con 0x7f938815dde0 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93881586f0 con 0x7f93881606e0 2024-09-13T17:19:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 0x7f93881f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 0x7f93881f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35786/0 (socket says 172.21.15.5:35786) 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 -- 172.21.15.5:0/882057092 learned_addr learned my addr 172.21.15.5:0/882057092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f93867fc640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938815dde0 0x7f9388151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f93877fe640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93881606e0 0x7f93880d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 -- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93881606e0 msgr2=0x7f93880d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93881606e0 0x7f93880d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 -- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938815dde0 msgr2=0x7f9388151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938815dde0 0x7f9388151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700094d0 con 0x7f938815ccf0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f93867fc640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f938815dde0 0x7f9388151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f9386ffd640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 0x7f93881f6b00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f937800efc0 tx=0x7f937800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378014480 con 0x7f938815ccf0 2024-09-13T17:19:46.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937800f040 con 0x7f938815ccf0 2024-09-13T17:19:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93881589d0 con 0x7f938815ccf0 2024-09-13T17:19:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378014820 con 0x7f938815ccf0 2024-09-13T17:19:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.273+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93880c9d20 con 0x7f938815ccf0 2024-09-13T17:19:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.274+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9388160ae0 con 0x7f938815ccf0 2024-09-13T17:19:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.275+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9378014980 con 0x7f938815ccf0 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.275+0000 7f937ffff640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f936806ac00 0x7f936806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f937808a130 con 0x7f938815ccf0 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f937ffff640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7f93680710e0 0x7f9368073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9368073bf0 con 0x7f93680710e0 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937808c7f0 con 0x7f938815ccf0 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f93877fe640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7f93680710e0 0x7f9368073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f93867fc640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f936806ac00 0x7f936806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f93877fe640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7f93680710e0 0x7f9368073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.276+0000 7f93867fc640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f936806ac00 0x7f936806d0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9370034000 tx=0x7f937002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.277+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== osd.2 v2:172.21.15.5:6816/2157447166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9368073bf0 con 0x7f93680710e0 2024-09-13T17:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.289+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 --> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93880ccad0 con 0x7f93680710e0 2024-09-13T17:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.289+0000 7f937ffff640 1 -- 172.21.15.5:0/882057092 <== osd.2 v2:172.21.15.5:6816/2157447166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f93880ccad0 con 0x7f93680710e0 2024-09-13T17:19:46.290 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:46.291 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:46.291 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.289+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7f93680710e0 msgr2=0x7f9368073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.289+0000 7f938d9e2640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:6816/2157447166,v1:172.21.15.5:6818/2157447166] conn(0x7f93680710e0 0x7f9368073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f936806ac00 msgr2=0x7f936806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f936806ac00 0x7f936806d0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9370034000 tx=0x7f937002e000 comp rx=0 tx=0).stop 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 msgr2=0x7f93881f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 --2- 172.21.15.5:0/882057092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f938815ccf0 0x7f93881f6b00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f937800efc0 tx=0x7f937800c490 comp rx=0 tx=0).stop 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f93877fe640 1 -- 172.21.15.5:0/882057092 reap_dead start 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 shutdown_connections 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 >> 172.21.15.5:0/882057092 conn(0x7f938806b590 msgr2=0x7f938815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 shutdown_connections 2024-09-13T17:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.290+0000 7f938d9e2640 1 -- 172.21.15.5:0/882057092 wait complete. 2024-09-13T17:19:46.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T17:19:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 Processor -- start 2024-09-13T17:19:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 -- start start 2024-09-13T17:19:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f406e0c0 0x7f40f40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 0x7f40f406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40addf0 con 0x7f40f4160be0 2024-09-13T17:19:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f40ad1e0 con 0x7f40f406e0c0 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.403+0000 7f40fae5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40ad4c0 con 0x7f40f4070e60 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f8bf6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f406e0c0 0x7f40f40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40f4160be0 0x7f40f4070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58140/0 (socket says 172.21.15.5:58140) 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f3fff640 1 -- 172.21.15.5:0/3735548506 learned_addr learned my addr 172.21.15.5:0/3735548506 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f93f7640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 0x7f40f406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f8bf6640 1 -- 172.21.15.5:0/3735548506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 msgr2=0x7f40f406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f8bf6640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 0x7f40f406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f8bf6640 1 -- 172.21.15.5:0/3735548506 >> v1:172.21.15.5:6789/0 conn(0x7f40f4160be0 legacy=0x7f40f4070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f8bf6640 1 -- 172.21.15.5:0/3735548506 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40ad7a0 con 0x7f40f406e0c0 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f37fe640 1 -- 172.21.15.5:0/3735548506 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586650953 0 0) 0x7f40f40addf0 con 0x7f40f4160be0 2024-09-13T17:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.404+0000 7f40f93f7640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 0x7f40f406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40f8bf6640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f406e0c0 0x7f40f40acb40 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097a0 tx=0x7f40e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f24595c5a5f4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40f37fe640 1 -- 172.21.15.5:0/3735548506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8032440 con 0x7f40f406e0c0 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40f37fe640 1 -- 172.21.15.5:0/3735548506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80325a0 con 0x7f40f406e0c0 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40f37fe640 1 -- 172.21.15.5:0/3735548506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8032930 con 0x7f40f406e0c0 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40fae5a640 1 -- 172.21.15.5:0/3735548506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f406e0c0 msgr2=0x7f40f40acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40fae5a640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f406e0c0 0x7f40f40acb40 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f40e80097a0 tx=0x7f40e802a180 comp rx=0 tx=0).stop 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40fae5a640 1 -- 172.21.15.5:0/3735548506 shutdown_connections 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40fae5a640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f4070e60 0x7f40f406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.405+0000 7f40fae5a640 1 --2- 172.21.15.5:0/3735548506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f406e0c0 0x7f40f40acb40 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.406+0000 7f40fae5a640 1 -- 172.21.15.5:0/3735548506 >> 172.21.15.5:0/3735548506 conn(0x7f40f40b0650 msgr2=0x7f40f40b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.406+0000 7f40fae5a640 1 -- 172.21.15.5:0/3735548506 shutdown_connections 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.406+0000 7f40fae5a640 1 -- 172.21.15.5:0/3735548506 wait complete. 2024-09-13T17:19:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.407+0000 7f40fae5a640 1 Processor -- start 2024-09-13T17:19:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.407+0000 7f40fae5a640 1 -- start start 2024-09-13T17:19:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f406e0c0 0x7f40f415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 0x7f40f415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f415ea30 con 0x7f40f4070e60 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f415c4c0 con 0x7f40f4160be0 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40fae5a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f4145e10 con 0x7f40f406e0c0 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35802/0 (socket says 172.21.15.5:35802) 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 -- 172.21.15.5:0/2447372160 learned_addr learned my addr 172.21.15.5:0/2447372160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f8bf6640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f406e0c0 0x7f40f415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f93f7640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 0x7f40f415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 -- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f406e0c0 msgr2=0x7f40f415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f406e0c0 0x7f40f415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 -- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 msgr2=0x7f40f415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 0x7f40f415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 -- 172.21.15.5:0/2447372160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009400 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f93f7640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 0x7f40f415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f3fff640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c430 tx=0x7f40e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.408+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00074e0 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.409+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0007660 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.409+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f40ae400 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.409+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0004a20 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.409+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f40cc610 con 0x7f40f4070e60 2024-09-13T17:19:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.410+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f40cb1a0 con 0x7f40f4070e60 2024-09-13T17:19:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.410+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40e0004b80 con 0x7f40f4070e60 2024-09-13T17:19:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.411+0000 7f40f17fa640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.411+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f40e0089010 con 0x7f40f4070e60 2024-09-13T17:19:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.411+0000 7f40f8bf6640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.411+0000 7f40f8bf6640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f40e8034000 tx=0x7f40e802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.415+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40e00542a0 con 0x7f40f4070e60 2024-09-13T17:19:46.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.586+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f40f4161050 con 0x7f40d806ac00 2024-09-13T17:19:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.587+0000 7f40f17fa640 1 -- 172.21.15.5:0/2447372160 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f40e8032a80 con 0x7f40d806ac00 2024-09-13T17:19:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 msgr2=0x7f40d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f40e8034000 tx=0x7f40e802e000 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 msgr2=0x7f40f413fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c430 tx=0x7f40e000c8f0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 shutdown_connections 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40f4160be0 0x7f40f415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f40d806ac00 0x7f40d806d0c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f4070e60 0x7f40f413fc80 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 --2- 172.21.15.5:0/2447372160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40f406e0c0 0x7f40f415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 >> 172.21.15.5:0/2447372160 conn(0x7f40f40b0650 msgr2=0x7f40f40b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 shutdown_connections 2024-09-13T17:19:46.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.589+0000 7f40fae5a640 1 -- 172.21.15.5:0/2447372160 wait complete. 2024-09-13T17:19:46.601 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T17:19:46.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.705+0000 7f2feed95640 1 Processor -- start 2024-09-13T17:19:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.705+0000 7f2feed95640 1 -- start start 2024-09-13T17:19:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2feed95640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe8143ea0 0x7f2fe815a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2feed95640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2fe80cc840 0x7f2fe806c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2feed95640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80cae40 con 0x7f2fe80adb60 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2feed95640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80cbca0 con 0x7f2fe8143ea0 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2feed95640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80adfa0 con 0x7f2fe80cc840 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe8143ea0 0x7f2fe815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe8143ea0 0x7f2fe815a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35808/0 (socket says 172.21.15.5:35808) 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 -- 172.21.15.5:0/935988346 learned_addr learned my addr 172.21.15.5:0/935988346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fe7fff640 1 --1- 172.21.15.5:0/935988346 >> v1:172.21.15.5:6789/0 conn(0x7f2fe80adb60 0x7f2fe80cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58148/0 (socket says 172.21.15.5:58148) 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 -- 172.21.15.5:0/935988346 >> v2:172.21.15.179:3300/0 conn(0x7f2fe80cc840 msgr2=0x7f2fe806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fed332640 1 --2- 172.21.15.5:0/935988346 >> v2:172.21.15.179:3300/0 conn(0x7f2fe80cc840 0x7f2fe806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fe77fe640 1 -- 172.21.15.5:0/935988346 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383969504 0 0) 0x7f2fe80cae40 con 0x7f2fe80adb60 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 --2- 172.21.15.5:0/935988346 >> v2:172.21.15.179:3300/0 conn(0x7f2fe80cc840 0x7f2fe806c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 -- 172.21.15.5:0/935988346 >> v1:172.21.15.5:6789/0 conn(0x7f2fe80adb60 legacy=0x7f2fe80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.706+0000 7f2fecb31640 1 -- 172.21.15.5:0/935988346 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8144280 con 0x7f2fe8143ea0 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.707+0000 7f2fecb31640 1 --2- 172.21.15.5:0/935988346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe8143ea0 0x7f2fe815a910 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80717e0 tx=0x7f2fdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0648e47121c3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.707+0000 7f2fe77fe640 1 -- 172.21.15.5:0/935988346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc032440 con 0x7f2fe8143ea0 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.707+0000 7f2fe77fe640 1 -- 172.21.15.5:0/935988346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0325a0 con 0x7f2fe8143ea0 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.707+0000 7f2fe77fe640 1 -- 172.21.15.5:0/935988346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc032930 con 0x7f2fe8143ea0 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 -- 172.21.15.5:0/935988346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe8143ea0 msgr2=0x7f2fe815a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 --2- 172.21.15.5:0/935988346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe8143ea0 0x7f2fe815a910 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80717e0 tx=0x7f2fdc02a1e0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 -- 172.21.15.5:0/935988346 shutdown_connections 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 --2- 172.21.15.5:0/935988346 >> v2:172.21.15.179:3300/0 conn(0x7f2fe80cc840 0x7f2fe806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 --2- 172.21.15.5:0/935988346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe8143ea0 0x7f2fe815a910 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 -- 172.21.15.5:0/935988346 >> 172.21.15.5:0/935988346 conn(0x7f2fe8069ed0 msgr2=0x7f2fe806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 -- 172.21.15.5:0/935988346 shutdown_connections 2024-09-13T17:19:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.708+0000 7f2feed95640 1 -- 172.21.15.5:0/935988346 wait complete. 2024-09-13T17:19:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.709+0000 7f2feed95640 1 Processor -- start 2024-09-13T17:19:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.709+0000 7f2feed95640 1 -- start start 2024-09-13T17:19:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fe80adb60 0x7f2fe813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 0x7f2fe80a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fe8143ea0 0x7f2fe813eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe813e090 con 0x7f2fe80cc840 2024-09-13T17:19:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe813d510 con 0x7f2fe80adb60 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2feed95640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe813d7f0 con 0x7f2fe8143ea0 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 0x7f2fe80a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 0x7f2fe80a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35816/0 (socket says 172.21.15.5:35816) 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 -- 172.21.15.5:0/513067343 learned_addr learned my addr 172.21.15.5:0/513067343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fecb31640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fe80adb60 0x7f2fe813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fed332640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fe8143ea0 0x7f2fe813eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 -- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fe8143ea0 msgr2=0x7f2fe813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fe8143ea0 0x7f2fe813eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 -- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fe80adb60 msgr2=0x7f2fe813bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fe80adb60 0x7f2fe813bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fe7fff640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0094d0 con 0x7f2fe80cc840 2024-09-13T17:19:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.710+0000 7f2fed332640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fe8143ea0 0x7f2fe813eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2fe7fff640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 0x7f2fe80a9510 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c430 tx=0x7f2fd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40074e0 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4007660 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe813dad0 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4004a20 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.711+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80a9a50 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.712+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fe80cb650 con 0x7f2fe80cc840 2024-09-13T17:19:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.712+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fd4004b80 con 0x7f2fe80cc840 2024-09-13T17:19:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fe57fa640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fcc06ac00 0x7f2fcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f2fd4089050 con 0x7f2fe80cc840 2024-09-13T17:19:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fe57fa640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7f2fcc0710e0 0x7f2fcc073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fcc073bf0 con 0x7f2fcc0710e0 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd408b710 con 0x7f2fe80cc840 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fecb31640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fcc06ac00 0x7f2fcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fed332640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7f2fcc0710e0 0x7f2fcc073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.713+0000 7f2fed332640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7f2fcc0710e0 0x7f2fcc073520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.714+0000 7f2fecb31640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fcc06ac00 0x7f2fcc06d0c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.714+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== osd.3 v2:172.21.15.5:6808/3301555269 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2fcc073bf0 con 0x7f2fcc0710e0 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.726+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 --> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2fe80cb370 con 0x7f2fcc0710e0 2024-09-13T17:19:46.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.726+0000 7f2fe57fa640 1 -- 172.21.15.5:0/513067343 <== osd.3 v2:172.21.15.5:6808/3301555269 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2fe0007a20 con 0x7f2fcc0710e0 2024-09-13T17:19:46.728 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:46.728 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:46.728 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7f2fcc0710e0 msgr2=0x7f2fcc073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:6808/3301555269,v1:172.21.15.5:6809/3301555269] conn(0x7f2fcc0710e0 0x7f2fcc073520 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fcc06ac00 msgr2=0x7f2fcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f2fcc06ac00 0x7f2fcc06d0c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc02e000 comp rx=0 tx=0).stop 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 msgr2=0x7f2fe80a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 --2- 172.21.15.5:0/513067343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe80cc840 0x7f2fe80a9510 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c430 tx=0x7f2fd400c8f0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2fed332640 1 -- 172.21.15.5:0/513067343 reap_dead start 2024-09-13T17:19:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 shutdown_connections 2024-09-13T17:19:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 >> 172.21.15.5:0/513067343 conn(0x7f2fe8069ed0 msgr2=0x7f2fe8070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 shutdown_connections 2024-09-13T17:19:46.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.727+0000 7f2feed95640 1 -- 172.21.15.5:0/513067343 wait complete. 2024-09-13T17:19:46.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.839+0000 7f8dddaa3640 1 Processor -- start 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.839+0000 7f8dddaa3640 1 -- start start 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dddaa3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8dd815c800 0x7f8dd80d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dddaa3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dd80cd940 0x7f8dd80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dddaa3640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd80cf990 con 0x7f8dd80cf520 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dddaa3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd815cbe0 con 0x7f8dd80cd940 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dddaa3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80b5860 con 0x7f8dd815c800 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dd6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dd80cd940 0x7f8dd80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dd6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dd80cd940 0x7f8dd80cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35818/0 (socket says 172.21.15.5:35818) 2024-09-13T17:19:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.840+0000 7f8dd6ffd640 1 -- 172.21.15.5:0/593891774 learned_addr learned my addr 172.21.15.5:0/593891774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.841+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/593891774 >> v2:172.21.15.179:3300/0 conn(0x7f8dd815c800 0x7f8dd80d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.841+0000 7f8dd6ffd640 1 -- 172.21.15.5:0/593891774 >> v2:172.21.15.179:3300/0 conn(0x7f8dd815c800 msgr2=0x7f8dd80d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.841+0000 7f8dd6ffd640 1 --2- 172.21.15.5:0/593891774 >> v2:172.21.15.179:3300/0 conn(0x7f8dd815c800 0x7f8dd80d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.841+0000 7f8dd6ffd640 1 -- 172.21.15.5:0/593891774 >> v1:172.21.15.179:6789/0 conn(0x7f8dd80cf520 legacy=0x7f8dd80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.841+0000 7f8dd6ffd640 1 -- 172.21.15.5:0/593891774 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80b59f0 con 0x7f8dd80cd940 2024-09-13T17:19:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dd6ffd640 1 --2- 172.21.15.5:0/593891774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd80cd940 0x7f8dd80cefe0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b5230 tx=0x7f8dcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e983263da36f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dd67fc640 1 -- 172.21.15.5:0/593891774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc032440 con 0x7f8dd80cd940 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dd67fc640 1 -- 172.21.15.5:0/593891774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc0325a0 con 0x7f8dd80cd940 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dd67fc640 1 -- 172.21.15.5:0/593891774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc032930 con 0x7f8dd80cd940 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 -- 172.21.15.5:0/593891774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd80cd940 msgr2=0x7f8dd80cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/593891774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd80cd940 0x7f8dd80cefe0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80b5230 tx=0x7f8dcc02a270 comp rx=0 tx=0).stop 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 -- 172.21.15.5:0/593891774 shutdown_connections 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/593891774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd80cd940 0x7f8dd80cefe0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/593891774 >> v2:172.21.15.179:3300/0 conn(0x7f8dd815c800 0x7f8dd80d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 -- 172.21.15.5:0/593891774 >> 172.21.15.5:0/593891774 conn(0x7f8dd806b110 msgr2=0x7f8dd806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 -- 172.21.15.5:0/593891774 shutdown_connections 2024-09-13T17:19:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.842+0000 7f8dddaa3640 1 -- 172.21.15.5:0/593891774 wait complete. 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.843+0000 7f8dddaa3640 1 Processor -- start 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 -- start start 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 0x7f8dd815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 0x7f8dd8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8153040 con 0x7f8dd815c800 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815d6a0 con 0x7f8dd80cf520 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.844+0000 7f8dddaa3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815d980 con 0x7f8dd80cd940 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35820/0 (socket says 172.21.15.5:35820) 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 -- 172.21.15.5:0/1473596067 learned_addr learned my addr 172.21.15.5:0/1473596067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 0x7f8dd815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd6ffd640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 0x7f8dd8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 -- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 msgr2=0x7f8dd815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 0x7f8dd815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 -- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 msgr2=0x7f8dd8152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 0x7f8dd8152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 -- 172.21.15.5:0/1473596067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0094d0 con 0x7f8dd815c800 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 0x7f8dd815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd6ffd640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 0x7f8dd8152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dd7fff640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0001eb0 tx=0x7f8dd000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00052d0 con 0x7f8dd815c800 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0005430 con 0x7f8dd815c800 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd815dc60 con 0x7f8dd815c800 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0003810 con 0x7f8dd815c800 2024-09-13T17:19:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.845+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd815e220 con 0x7f8dd815c800 2024-09-13T17:19:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.846+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd80672f0 con 0x7f8dd815c800 2024-09-13T17:19:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.847+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8dd0003970 con 0x7f8dd815c800 2024-09-13T17:19:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.847+0000 7f8dbffff640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 0x7f8dc406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.847+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f8dd00886b0 con 0x7f8dd815c800 2024-09-13T17:19:46.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.848+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 0x7f8dc406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:46.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.848+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 0x7f8dc406d0f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009fd0 tx=0x7f8dc800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:46.852+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8dd0053930 con 0x7f8dd815c800 2024-09-13T17:19:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.021+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dd80c95c0 con 0x7f8dc406ac30 2024-09-13T17:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.022+0000 7f8dbffff640 1 -- 172.21.15.5:0/1473596067 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8dd80c95c0 con 0x7f8dc406ac30 2024-09-13T17:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 msgr2=0x7f8dc406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 0x7f8dc406d0f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009fd0 tx=0x7f8dc800b040 comp rx=0 tx=0).stop 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 msgr2=0x7f8dd81f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0001eb0 tx=0x7f8dd000c890 comp rx=0 tx=0).stop 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 shutdown_connections 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f8dc406ac30 0x7f8dc406d0f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dd815c800 0x7f8dd81f3120 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd80cf520 0x7f8dd8152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 --2- 172.21.15.5:0/1473596067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dd80cd940 0x7f8dd815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.023+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 >> 172.21.15.5:0/1473596067 conn(0x7f8dd806b110 msgr2=0x7f8dd815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.024+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 shutdown_connections 2024-09-13T17:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.024+0000 7f8dddaa3640 1 -- 172.21.15.5:0/1473596067 wait complete. 2024-09-13T17:19:47.035 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T17:19:47.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:47.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.140+0000 7f65757a3640 1 Processor -- start 2024-09-13T17:19:47.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.140+0000 7f65757a3640 1 -- start start 2024-09-13T17:19:47.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f657015c470 0x7f65700b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65700acda0 0x7f6570069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f657006a410 0x7f65700aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657006a8a0 con 0x7f657015c470 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700ad2b0 con 0x7f657006a410 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f65757a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700ad590 con 0x7f65700acda0 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f656effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f657015c470 0x7f65700b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f656effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f657015c470 0x7f65700b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35824/0 (socket says 172.21.15.5:35824) 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f656effd640 1 -- 172.21.15.5:0/1236313388 learned_addr learned my addr 172.21.15.5:0/1236313388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f656e7fc640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65700acda0 0x7f6570069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.141+0000 7f656f7fe640 1 --2- 172.21.15.5:0/1236313388 >> v2:172.21.15.179:3300/0 conn(0x7f657006a410 0x7f65700aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 -- 172.21.15.5:0/1236313388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65700acda0 msgr2=0x7f6570069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:47.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65700acda0 0x7f6570069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 -- 172.21.15.5:0/1236313388 >> v2:172.21.15.179:3300/0 conn(0x7f657006a410 msgr2=0x7f65700aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 --2- 172.21.15.5:0/1236313388 >> v2:172.21.15.179:3300/0 conn(0x7f657006a410 0x7f65700aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 -- 172.21.15.5:0/1236313388 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700ad870 con 0x7f657015c470 2024-09-13T17:19:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656effd640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657015c470 0x7f65700b0340 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f657006cde0 tx=0x7f656802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f35f40ec17db202 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656dffb640 1 -- 172.21.15.5:0/1236313388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f657015c470 2024-09-13T17:19:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656dffb640 1 -- 172.21.15.5:0/1236313388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680325a0 con 0x7f657015c470 2024-09-13T17:19:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.142+0000 7f656dffb640 1 -- 172.21.15.5:0/1236313388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568032930 con 0x7f657015c470 2024-09-13T17:19:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 -- 172.21.15.5:0/1236313388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657015c470 msgr2=0x7f65700b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657015c470 0x7f65700b0340 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f657006cde0 tx=0x7f656802a1e0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 -- 172.21.15.5:0/1236313388 shutdown_connections 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 --2- 172.21.15.5:0/1236313388 >> v2:172.21.15.179:3300/0 conn(0x7f657006a410 0x7f65700aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65700acda0 0x7f6570069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 --2- 172.21.15.5:0/1236313388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657015c470 0x7f65700b0340 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 -- 172.21.15.5:0/1236313388 >> 172.21.15.5:0/1236313388 conn(0x7f6570071970 msgr2=0x7f6570098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 -- 172.21.15.5:0/1236313388 shutdown_connections 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.143+0000 7f65757a3640 1 -- 172.21.15.5:0/1236313388 wait complete. 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.144+0000 7f65757a3640 1 Processor -- start 2024-09-13T17:19:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.144+0000 7f65757a3640 1 -- start start 2024-09-13T17:19:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 0x7f657015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65700acda0 0x7f65701e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657015c470 0x7f657014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015e7a0 con 0x7f657006a410 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015d910 con 0x7f65700acda0 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f65757a3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657015db90 con 0x7f657015c470 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f656effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 0x7f657015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f656effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 0x7f657015d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35830/0 (socket says 172.21.15.5:35830) 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f656effd640 1 -- 172.21.15.5:0/944892106 learned_addr learned my addr 172.21.15.5:0/944892106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f656f7fe640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657015c470 0x7f657014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.145+0000 7f656effd640 1 -- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657015c470 msgr2=0x7f657014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f656effd640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f657015c470 0x7f657014f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f656effd640 1 -- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65700acda0 msgr2=0x7f65701e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f656effd640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65700acda0 0x7f65701e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f656effd640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680094d0 con 0x7f657006a410 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f656effd640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 0x7f657015d3d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f656802a220 tx=0x7f65680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568030b80 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656803d440 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657015de70 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.146+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657015e430 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.147+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65700b0880 con 0x7f657006a410 2024-09-13T17:19:47.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.147+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6568039040 con 0x7f657006a410 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f65677fe640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f655006ac00 0x7f655006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f65680a9f30 con 0x7f657006a410 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f65677fe640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f65500710e0 0x7f6550073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6550073bf0 con 0x7f65500710e0 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65680ac510 con 0x7f657006a410 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f656e7fc640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f655006ac00 0x7f655006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.148+0000 7f656f7fe640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f65500710e0 0x7f6550073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.149+0000 7f656e7fc640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f655006ac00 0x7f655006d0c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f657015fc40 tx=0x7f6558008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.149+0000 7f656f7fe640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f65500710e0 0x7f6550073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.150+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== osd.4 v2:172.21.15.179:6800/1714873642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6550073bf0 con 0x7f65500710e0 2024-09-13T17:19:47.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.162+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 --> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65700ade30 con 0x7f65500710e0 2024-09-13T17:19:47.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.162+0000 7f65677fe640 1 -- 172.21.15.5:0/944892106 <== osd.4 v2:172.21.15.179:6800/1714873642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6560014380 con 0x7f65500710e0 2024-09-13T17:19:47.164 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:47.164 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:47.164 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f65500710e0 msgr2=0x7f6550073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6800/1714873642,v1:172.21.15.179:6801/1714873642] conn(0x7f65500710e0 0x7f6550073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f655006ac00 msgr2=0x7f655006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f655006ac00 0x7f655006d0c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f657015fc40 tx=0x7f6558008040 comp rx=0 tx=0).stop 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 msgr2=0x7f657015d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 --2- 172.21.15.5:0/944892106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f657006a410 0x7f657015d3d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f656802a220 tx=0x7f65680046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f656f7fe640 1 -- 172.21.15.5:0/944892106 reap_dead start 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 shutdown_connections 2024-09-13T17:19:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 >> 172.21.15.5:0/944892106 conn(0x7f6570071970 msgr2=0x7f65700b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 shutdown_connections 2024-09-13T17:19:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.163+0000 7f65757a3640 1 -- 172.21.15.5:0/944892106 wait complete. 2024-09-13T17:19:47.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T17:19:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.275+0000 7f4a66f76640 1 Processor -- start 2024-09-13T17:19:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.275+0000 7f4a66f76640 1 -- start start 2024-09-13T17:19:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a66f76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a66f76640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a600cb030 0x7f4a600acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a66f76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60157000 con 0x7f4a600b3160 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a66f76640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6015d950 con 0x7f4a600cb030 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a66f76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600b1db0 con 0x7f4a6006b5f0 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a65513640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a600cb030 0x7f4a600acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:52900/0 (socket says 172.21.15.5:52900) 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a57fff640 1 -- 172.21.15.5:0/703933819 learned_addr learned my addr 172.21.15.5:0/703933819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.276+0000 7f4a64d12640 1 --1- 172.21.15.5:0/703933819 >> v1:172.21.15.179:6789/0 conn(0x7f4a600b3160 0x7f4a600b3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.5:54020/0 (socket says 172.21.15.5:54020) 2024-09-13T17:19:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.277+0000 7f4a57fff640 1 -- 172.21.15.5:0/703933819 >> v2:172.21.15.179:3300/0 conn(0x7f4a600cb030 msgr2=0x7f4a600acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.277+0000 7f4a57fff640 1 --2- 172.21.15.5:0/703933819 >> v2:172.21.15.179:3300/0 conn(0x7f4a600cb030 0x7f4a600acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.277+0000 7f4a57fff640 1 -- 172.21.15.5:0/703933819 >> v1:172.21.15.179:6789/0 conn(0x7f4a600b3160 legacy=0x7f4a600b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.277+0000 7f4a57fff640 1 -- 172.21.15.5:0/703933819 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600b2090 con 0x7f4a6006b5f0 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.277+0000 7f4a57fff640 1 --2- 172.21.15.5:0/703933819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098a0 tx=0x7f4a5002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847adefc2ba1bc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a577fe640 1 -- 172.21.15.5:0/703933819 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50032440 con 0x7f4a6006b5f0 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a577fe640 1 -- 172.21.15.5:0/703933819 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500325a0 con 0x7f4a6006b5f0 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a577fe640 1 -- 172.21.15.5:0/703933819 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50032930 con 0x7f4a6006b5f0 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 -- 172.21.15.5:0/703933819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 msgr2=0x7f4a600b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 --2- 172.21.15.5:0/703933819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098a0 tx=0x7f4a5002a290 comp rx=0 tx=0).stop 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 -- 172.21.15.5:0/703933819 shutdown_connections 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 --2- 172.21.15.5:0/703933819 >> v2:172.21.15.179:3300/0 conn(0x7f4a600cb030 0x7f4a600acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 --2- 172.21.15.5:0/703933819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a6006b5f0 0x7f4a600b2b70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 -- 172.21.15.5:0/703933819 >> 172.21.15.5:0/703933819 conn(0x7f4a60071980 msgr2=0x7f4a60069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 -- 172.21.15.5:0/703933819 shutdown_connections 2024-09-13T17:19:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.278+0000 7f4a66f76640 1 -- 172.21.15.5:0/703933819 wait complete. 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.279+0000 7f4a66f76640 1 Processor -- start 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.279+0000 7f4a66f76640 1 -- start start 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6006b5f0 0x7f4a6015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a600b3160 0x7f4a60158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60159bb0 con 0x7f4a600cb030 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60158fa0 con 0x7f4a6006b5f0 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a66f76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60159280 con 0x7f4a600b3160 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a65513640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a65513640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35844/0 (socket says 172.21.15.5:35844) 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.280+0000 7f4a65513640 1 -- 172.21.15.5:0/3335948310 learned_addr learned my addr 172.21.15.5:0/3335948310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a64d12640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6006b5f0 0x7f4a6015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a57fff640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a600b3160 0x7f4a60158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 -- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a600b3160 msgr2=0x7f4a60158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a600b3160 0x7f4a60158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 -- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6006b5f0 msgr2=0x7f4a6015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6006b5f0 0x7f4a6015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 -- 172.21.15.5:0/3335948310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094d0 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a65513640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800efc0 tx=0x7f4a5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58009b20 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5800f040 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580146c0 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a60159560 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.281+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60158cb0 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.282+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a600b2b70 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.283+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4a58014820 con 0x7f4a600cb030 2024-09-13T17:19:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.283+0000 7f4a557fa640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 0x7f4a4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.283+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f4a58089f80 con 0x7f4a600cb030 2024-09-13T17:19:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.283+0000 7f4a64d12640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 0x7f4a4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.284+0000 7f4a64d12640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 0x7f4a4c06d0c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c007fd0 tx=0x7f4a5c007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.287+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4a580bd9c0 con 0x7f4a600cb030 2024-09-13T17:19:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.458+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a600b2650 con 0x7f4a4c06ac00 2024-09-13T17:19:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.459+0000 7f4a557fa640 1 -- 172.21.15.5:0/3335948310 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4a5c004aa0 con 0x7f4a4c06ac00 2024-09-13T17:19:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 msgr2=0x7f4a4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 0x7f4a4c06d0c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c007fd0 tx=0x7f4a5c007e80 comp rx=0 tx=0).stop 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 msgr2=0x7f4a60158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800efc0 tx=0x7f4a5800c490 comp rx=0 tx=0).stop 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 shutdown_connections 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4a4c06ac00 0x7f4a4c06d0c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a600cb030 0x7f4a60158770 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a600b3160 0x7f4a60158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 --2- 172.21.15.5:0/3335948310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6006b5f0 0x7f4a6015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 >> 172.21.15.5:0/3335948310 conn(0x7f4a60071980 msgr2=0x7f4a600b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 shutdown_connections 2024-09-13T17:19:47.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.461+0000 7f4a66f76640 1 -- 172.21.15.5:0/3335948310 wait complete. 2024-09-13T17:19:47.473 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T17:19:47.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.578+0000 7fa209f25640 1 Processor -- start 2024-09-13T17:19:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.578+0000 7fa209f25640 1 -- start start 2024-09-13T17:19:47.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa209f25640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa204153190 0x7fa204159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa209f25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa20415c640 0x7fa2040b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa209f25640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa204153570 con 0x7fa2040b3070 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa209f25640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2040b3520 con 0x7fa204153190 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa209f25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20406ad10 con 0x7fa20415c640 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa2037fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa204153190 0x7fa204159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa2037fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa204153190 0x7fa204159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35852/0 (socket says 172.21.15.5:35852) 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa2037fe640 1 -- 172.21.15.5:0/1106920996 learned_addr learned my addr 172.21.15.5:0/1106920996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.579+0000 7fa203fff640 1 --1- 172.21.15.5:0/1106920996 >> v1:172.21.15.5:6789/0 conn(0x7fa2040b3070 0x7fa2040b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58162/0 (socket says 172.21.15.5:58162) 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa202ffd640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa20415c640 0x7fa2040b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2037fe640 1 -- 172.21.15.5:0/1106920996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa20415c640 msgr2=0x7fa2040b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2037fe640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa20415c640 0x7fa2040b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2037fe640 1 -- 172.21.15.5:0/1106920996 >> v1:172.21.15.5:6789/0 conn(0x7fa2040b3070 legacy=0x7fa2040b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2027fc640 1 -- 172.21.15.5:0/1106920996 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574077902 0 0) 0x7fa1fc001490 con 0x7fa2040b3070 2024-09-13T17:19:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2037fe640 1 -- 172.21.15.5:0/1106920996 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20415a010 con 0x7fa204153190 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.580+0000 7fa2037fe640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa204153190 0x7fa204159ad0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b784f25c1481349 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa2027fc640 1 -- 172.21.15.5:0/1106920996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4032440 con 0x7fa204153190 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa2027fc640 1 -- 172.21.15.5:0/1106920996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40325a0 con 0x7fa204153190 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa2027fc640 1 -- 172.21.15.5:0/1106920996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4032930 con 0x7fa204153190 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 -- 172.21.15.5:0/1106920996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa204153190 msgr2=0x7fa204159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa204153190 0x7fa204159ad0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f402a270 comp rx=0 tx=0).stop 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 -- 172.21.15.5:0/1106920996 shutdown_connections 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa20415c640 0x7fa2040b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 --2- 172.21.15.5:0/1106920996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa204153190 0x7fa204159ad0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 -- 172.21.15.5:0/1106920996 >> 172.21.15.5:0/1106920996 conn(0x7fa204069ed0 msgr2=0x7fa20406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 -- 172.21.15.5:0/1106920996 shutdown_connections 2024-09-13T17:19:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.581+0000 7fa209f25640 1 -- 172.21.15.5:0/1106920996 wait complete. 2024-09-13T17:19:47.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.582+0000 7fa209f25640 1 Processor -- start 2024-09-13T17:19:47.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 -- start start 2024-09-13T17:19:47.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2040b3070 0x7fa2041517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa204153190 0x7fa2041eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 0x7fa2041eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041f1a80 con 0x7fa20415c640 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041f1d60 con 0x7fa204153190 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa209f25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041f2040 con 0x7fa2040b3070 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa203fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 0x7fa2041eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa203fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 0x7fa2041eeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35868/0 (socket says 172.21.15.5:35868) 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.583+0000 7fa203fff640 1 -- 172.21.15.5:0/3465406160 learned_addr learned my addr 172.21.15.5:0/3465406160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa2037fe640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2040b3070 0x7fa2041517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa202ffd640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa204153190 0x7fa2041eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 -- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2040b3070 msgr2=0x7fa2041517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2040b3070 0x7fa2041517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 -- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa204153190 msgr2=0x7fa2041eeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa204153190 0x7fa2041eeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40094d0 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa203fff640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 0x7fa2041eeff0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c780 tx=0x7fa1fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00ce90 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00a640 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2041f2320 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00a9d0 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.584+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa204149c90 con 0x7fa20415c640 2024-09-13T17:19:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.585+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa20415d0f0 con 0x7fa20415c640 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa1fc00ab30 con 0x7fa20415c640 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa1f006ac00 0x7fa1f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fa1fc0887b0 con 0x7fa20415c640 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7fa1f0070f70 0x7fa1f00733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1f0073a80 con 0x7fa1f0070f70 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1fc08ae70 con 0x7fa20415c640 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.586+0000 7fa2037fe640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa1f006ac00 0x7fa1f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.587+0000 7fa202ffd640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7fa1f0070f70 0x7fa1f00733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.587+0000 7fa2037fe640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa1f006ac00 0x7fa1f006d0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4034000 tx=0x7fa1f402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.587+0000 7fa202ffd640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7fa1f0070f70 0x7fa1f00733b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.588+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== osd.5 v2:172.21.15.179:6820/2660134855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa1f0073a80 con 0x7fa1f0070f70 2024-09-13T17:19:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.600+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 --> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa20415ce10 con 0x7fa1f0070f70 2024-09-13T17:19:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.600+0000 7fa1ebfff640 1 -- 172.21.15.5:0/3465406160 <== osd.5 v2:172.21.15.179:6820/2660134855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa1f80075f0 con 0x7fa1f0070f70 2024-09-13T17:19:47.601 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:47.602 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:47.602 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7fa1f0070f70 msgr2=0x7fa1f00733b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6820/2660134855,v1:172.21.15.179:6822/2660134855] conn(0x7fa1f0070f70 0x7fa1f00733b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa1f006ac00 msgr2=0x7fa1f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fa1f006ac00 0x7fa1f006d0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4034000 tx=0x7fa1f402e000 comp rx=0 tx=0).stop 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 msgr2=0x7fa2041eeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 --2- 172.21.15.5:0/3465406160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa20415c640 0x7fa2041eeff0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c780 tx=0x7fa1fc00cc40 comp rx=0 tx=0).stop 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa203fff640 1 -- 172.21.15.5:0/3465406160 reap_dead start 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 shutdown_connections 2024-09-13T17:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 >> 172.21.15.5:0/3465406160 conn(0x7fa204069ed0 msgr2=0x7fa204152350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 shutdown_connections 2024-09-13T17:19:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.601+0000 7fa209f25640 1 -- 172.21.15.5:0/3465406160 wait complete. 2024-09-13T17:19:47.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T17:19:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.713+0000 7f51ad7bc640 1 Processor -- start 2024-09-13T17:19:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 -- start start 2024-09-13T17:19:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51a80b3570 0x7f51a80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a80b24b0 con 0x7f51a814f9f0 2024-09-13T17:19:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a814fdd0 con 0x7f51a80b3570 2024-09-13T17:19:47.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.714+0000 7f51ad7bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b18c0 con 0x7f51a80caed0 2024-09-13T17:19:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a67fc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51a80b3570 0x7f51a80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.5:52930/0 (socket says 172.21.15.5:52930) 2024-09-13T17:19:47.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 -- 172.21.15.5:0/1369486305 learned_addr learned my addr 172.21.15.5:0/1369486305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 -- 172.21.15.5:0/1369486305 >> v2:172.21.15.179:3300/0 conn(0x7f51a80b3570 msgr2=0x7f51a80ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 --2- 172.21.15.5:0/1369486305 >> v2:172.21.15.179:3300/0 conn(0x7f51a80b3570 0x7f51a80ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 -- 172.21.15.5:0/1369486305 >> v1:172.21.15.179:6789/0 conn(0x7f51a814f9f0 legacy=0x7f51a80b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.715+0000 7f51a77fe640 1 -- 172.21.15.5:0/1369486305 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80b1b80 con 0x7f51a80caed0 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.716+0000 7f51a77fe640 1 --2- 172.21.15.5:0/1369486305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009e50 tx=0x7f51a002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431d2e5b552accb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.716+0000 7f51a5ffb640 1 -- 172.21.15.5:0/1369486305 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a002aea0 con 0x7f51a80caed0 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.716+0000 7f51a5ffb640 1 -- 172.21.15.5:0/1369486305 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a002d050 con 0x7f51a80caed0 2024-09-13T17:19:47.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.716+0000 7f51a5ffb640 1 -- 172.21.15.5:0/1369486305 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0031820 con 0x7f51a80caed0 2024-09-13T17:19:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 -- 172.21.15.5:0/1369486305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 msgr2=0x7f51a80cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/1369486305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009e50 tx=0x7f51a002a680 comp rx=0 tx=0).stop 2024-09-13T17:19:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 -- 172.21.15.5:0/1369486305 shutdown_connections 2024-09-13T17:19:47.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/1369486305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80caed0 0x7f51a80cd020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/1369486305 >> v2:172.21.15.179:3300/0 conn(0x7f51a80b3570 0x7f51a80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 -- 172.21.15.5:0/1369486305 >> 172.21.15.5:0/1369486305 conn(0x7f51a8069ed0 msgr2=0x7f51a806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 -- 172.21.15.5:0/1369486305 shutdown_connections 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.717+0000 7f51ad7bc640 1 -- 172.21.15.5:0/1369486305 wait complete. 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.718+0000 7f51ad7bc640 1 Processor -- start 2024-09-13T17:19:47.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.718+0000 7f51ad7bc640 1 -- start start 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80b3570 0x7f51a8146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a814f9f0 0x7f51a80c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c8a20 con 0x7f51a80caed0 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c8d00 con 0x7f51a814f9f0 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51ad7bc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c8fe0 con 0x7f51a80b3570 2024-09-13T17:19:47.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35870/0 (socket says 172.21.15.5:35870) 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 -- 172.21.15.5:0/900981067 learned_addr learned my addr 172.21.15.5:0/900981067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a6ffd640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80b3570 0x7f51a8146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a77fe640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a814f9f0 0x7f51a80c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 -- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80b3570 msgr2=0x7f51a8146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80b3570 0x7f51a8146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 -- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a814f9f0 msgr2=0x7f51a80c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a814f9f0 0x7f51a80c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 -- 172.21.15.5:0/900981067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0009b30 con 0x7f51a80caed0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.719+0000 7f51a67fc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e910 tx=0x7f519c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.720+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00cc40 con 0x7f51a80caed0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.720+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00cda0 con 0x7f51a80caed0 2024-09-13T17:19:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.720+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80b2ac0 con 0x7f51a80caed0 2024-09-13T17:19:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.720+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c011610 con 0x7f51a80caed0 2024-09-13T17:19:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.720+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80c95a0 con 0x7f51a80caed0 2024-09-13T17:19:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.721+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a80b2e60 con 0x7f51a80caed0 2024-09-13T17:19:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.721+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f519c011770 con 0x7f51a80caed0 2024-09-13T17:19:47.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.721+0000 7f518f7fe640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.722+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f519c089390 con 0x7f51a80caed0 2024-09-13T17:19:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.722+0000 7f51a6ffd640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.722+0000 7f51a6ffd640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 0x7f519406d0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5198000f60 tx=0x7f5198009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.726+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f519c0546d0 con 0x7f51a80caed0 2024-09-13T17:19:47.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.898+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f51a80c8e70 con 0x7f519406ac00 2024-09-13T17:19:47.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.899+0000 7f518f7fe640 1 -- 172.21.15.5:0/900981067 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f51a80c8e70 con 0x7f519406ac00 2024-09-13T17:19:47.900 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T17:19:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 msgr2=0x7f519406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 0x7f519406d0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5198000f60 tx=0x7f5198009040 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 msgr2=0x7f51a80c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e910 tx=0x7f519c00edd0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 shutdown_connections 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51a814f9f0 0x7f51a80c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51a80caed0 0x7f51a80c80d0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 --2- 172.21.15.5:0/900981067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51a80b3570 0x7f51a8146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 >> 172.21.15.5:0/900981067 conn(0x7f51a8069ed0 msgr2=0x7f51a806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 shutdown_connections 2024-09-13T17:19:47.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:47.901+0000 7f51ad7bc640 1 -- 172.21.15.5:0/900981067 wait complete. 2024-09-13T17:19:47.913 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T17:19:47.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:48.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.017+0000 7f3843f25640 1 Processor -- start 2024-09-13T17:19:48.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.017+0000 7f3843f25640 1 -- start start 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3843f25640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f383c143ea0 0x7f383c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3843f25640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0cae40 con 0x7f383c0cc840 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3843f25640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0cbca0 con 0x7f383c0adb60 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3843f25640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c0adfa0 con 0x7f383c143ea0 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f38424c2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f383c0cc840 0x7f383c06c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58178/0 (socket says 172.21.15.5:58178) 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f38424c2640 1 -- 172.21.15.5:0/1057393304 learned_addr learned my addr 172.21.15.5:0/1057393304 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419358830 0 0) 0x7f383c0cae40 con 0x7f383c0cc840 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3841cc1640 1 --2- 172.21.15.5:0/1057393304 >> v2:172.21.15.179:3300/0 conn(0x7f383c143ea0 0x7f383c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3828003520 con 0x7f383c0cc840 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178112189 0 0) 0x7f3828003520 con 0x7f383c0cc840 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.018+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 >> v2:172.21.15.179:3300/0 conn(0x7f383c143ea0 msgr2=0x7f383c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 --2- 172.21.15.5:0/1057393304 >> v2:172.21.15.179:3300/0 conn(0x7f383c143ea0 0x7f383c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 >> v1:172.21.15.179:6789/0 conn(0x7f383c0adb60 legacy=0x7f383c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c144280 con 0x7f383c0cc840 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 582430354 0 0) 0x7f38340019f0 con 0x7f383c0cc840 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 >> v1:172.21.15.5:6789/0 conn(0x7f383c0cc840 legacy=0x7f383c06c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3828003970 0x7f3828003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 0x7f3828004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3828005180 0x7f382800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0adfa0 con 0x7f38280047c0 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382800c120 con 0x7f3828005180 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382800c2e0 con 0x7f3828003970 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 0x7f3828004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f3841cc1640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3828003970 0x7f3828003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38424c2640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3828005180 0x7f382800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 -- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3828003970 msgr2=0x7f3828003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3828003970 0x7f3828003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 -- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3828005180 msgr2=0x7f382800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3828005180 0x7f382800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38424c2640 1 -- 172.21.15.5:0/1057393304 reap_dead start 2024-09-13T17:19:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.019+0000 7f38414c0640 1 -- 172.21.15.5:0/1057393304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828003520 con 0x7f38280047c0 2024-09-13T17:19:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f38414c0640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 0x7f3828004c40 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f382c001750 tx=0x7f38280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae91daaf1916146 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0052d0 con 0x7f38280047c0 2024-09-13T17:19:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c005430 con 0x7f38280047c0 2024-09-13T17:19:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f3840cbf640 1 -- 172.21.15.5:0/1057393304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c02abc0 con 0x7f38280047c0 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f3843f25640 1 -- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 msgr2=0x7f3828004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.020+0000 7f3843f25640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 0x7f3828004c40 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f382c001750 tx=0x7f38280057f0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.021+0000 7f3843f25640 1 -- 172.21.15.5:0/1057393304 shutdown_connections 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.021+0000 7f3843f25640 1 --2- 172.21.15.5:0/1057393304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38280047c0 0x7f3828004c40 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.021+0000 7f3843f25640 1 -- 172.21.15.5:0/1057393304 >> 172.21.15.5:0/1057393304 conn(0x7f383c069ed0 msgr2=0x7f383c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.021+0000 7f3843f25640 1 -- 172.21.15.5:0/1057393304 shutdown_connections 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.021+0000 7f3843f25640 1 -- 172.21.15.5:0/1057393304 wait complete. 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.022+0000 7f3843f25640 1 Processor -- start 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.022+0000 7f3843f25640 1 -- start start 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38280047c0 0x7f383c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f383c13ed10 0x7f383c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 0x7f383c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c13d7f0 con 0x7f383c13ce30 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c13f6b0 con 0x7f383c13ed10 2024-09-13T17:19:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0b1690 con 0x7f38280047c0 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 0x7f383c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 0x7f383c13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35892/0 (socket says 172.21.15.5:35892) 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 -- 172.21.15.5:0/3960243691 learned_addr learned my addr 172.21.15.5:0/3960243691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3841cc1640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38280047c0 0x7f383c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38414c0640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f383c13ed10 0x7f383c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 -- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38280047c0 msgr2=0x7f383c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38280047c0 0x7f383c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 -- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f383c13ed10 msgr2=0x7f383c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f383c13ed10 0x7f383c13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0b1970 con 0x7f383c13ce30 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38424c2640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 0x7f383c13d2b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f383c06e800 tx=0x7f3834007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400a9f0 con 0x7f383c13ce30 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400ab50 con 0x7f383c13ce30 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340133f0 con 0x7f383c13ce30 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c0b1c50 con 0x7f383c13ce30 2024-09-13T17:19:48.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.023+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c13c220 con 0x7f383c13ce30 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.024+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f383c0b1800 con 0x7f383c13ce30 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3834013550 con 0x7f383c13ce30 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f382006ac00 0x7f382006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f38340898a0 con 0x7f383c13ce30 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f38200710e0 0x7f3820073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3820073bf0 con 0x7f38200710e0 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.025+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f383408e2a0 con 0x7f383c13ce30 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.026+0000 7f3841cc1640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f382006ac00 0x7f382006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.026+0000 7f38414c0640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f38200710e0 0x7f3820073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.026+0000 7f3841cc1640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f382006ac00 0x7f382006d0c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3838009bc0 tx=0x7f3838009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.026+0000 7f38414c0640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f38200710e0 0x7f3820073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.027+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== osd.6 v2:172.21.15.179:6808/3336213944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3820073bf0 con 0x7f38200710e0 2024-09-13T17:19:48.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.039+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 --> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f383c0cb650 con 0x7f38200710e0 2024-09-13T17:19:48.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.039+0000 7f38327fc640 1 -- 172.21.15.5:0/3960243691 <== osd.6 v2:172.21.15.179:6808/3336213944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f382c02a980 con 0x7f38200710e0 2024-09-13T17:19:48.041 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:48.041 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:48.041 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f38200710e0 msgr2=0x7f3820073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6808/3336213944,v1:172.21.15.179:6809/3336213944] conn(0x7f38200710e0 0x7f3820073520 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f382006ac00 msgr2=0x7f382006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f382006ac00 0x7f382006d0c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3838009bc0 tx=0x7f3838009190 comp rx=0 tx=0).stop 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 msgr2=0x7f383c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 --2- 172.21.15.5:0/3960243691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f383c13ce30 0x7f383c13d2b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f383c06e800 tx=0x7f3834007a20 comp rx=0 tx=0).stop 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f38424c2640 1 -- 172.21.15.5:0/3960243691 reap_dead start 2024-09-13T17:19:48.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 shutdown_connections 2024-09-13T17:19:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 >> 172.21.15.5:0/3960243691 conn(0x7f383c069ed0 msgr2=0x7f383c0af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 shutdown_connections 2024-09-13T17:19:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.040+0000 7f3843f25640 1 -- 172.21.15.5:0/3960243691 wait complete. 2024-09-13T17:19:48.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T17:19:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.154+0000 7fe33e59d640 1 Processor -- start 2024-09-13T17:19:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.154+0000 7fe33e59d640 1 -- start start 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33e59d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3380d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33e59d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3380d1230 0x7fe3380cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33e59d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3380d2f90 con 0x7fe3380ceeb0 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33e59d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3380d3270 con 0x7fe3380d1230 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33e59d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380d0210 con 0x7fe33815d580 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33d59b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe3380ceeb0 0x7fe3380cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58194/0 (socket says 172.21.15.5:58194) 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33dd9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe3380d1230 0x7fe3380cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33d59b640 1 -- 172.21.15.5:0/3762515181 learned_addr learned my addr 172.21.15.5:0/3762515181 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-13T17:19:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.155+0000 7fe33cd9a640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3380d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe33dd9c640 1 -- 172.21.15.5:0/3762515181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 msgr2=0x7fe3380d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe33dd9c640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3380d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe33dd9c640 1 -- 172.21.15.5:0/3762515181 >> v1:172.21.15.5:6789/0 conn(0x7fe3380ceeb0 legacy=0x7fe3380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe33dd9c640 1 -- 172.21.15.5:0/3762515181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3380d04f0 con 0x7fe3380d1230 2024-09-13T17:19:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe32ffff640 1 -- 172.21.15.5:0/3762515181 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225265585 0 0) 0x7fe3380d2f90 con 0x7fe3380ceeb0 2024-09-13T17:19:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe33dd9c640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380d1230 0x7fe3380cd0b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe330009d90 tx=0x7fe33002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8709243cb631c50b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.156+0000 7fe32ffff640 1 -- 172.21.15.5:0/3762515181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330007740 con 0x7fe3380d1230 2024-09-13T17:19:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe32ffff640 1 -- 172.21.15.5:0/3762515181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33002d050 con 0x7fe3380d1230 2024-09-13T17:19:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe32ffff640 1 -- 172.21.15.5:0/3762515181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330007ac0 con 0x7fe3380d1230 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 -- 172.21.15.5:0/3762515181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380d1230 msgr2=0x7fe3380cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380d1230 0x7fe3380cd0b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe330009d90 tx=0x7fe33002a660 comp rx=0 tx=0).stop 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 -- 172.21.15.5:0/3762515181 shutdown_connections 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380d1230 0x7fe3380cd0b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 --2- 172.21.15.5:0/3762515181 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3380d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 -- 172.21.15.5:0/3762515181 >> 172.21.15.5:0/3762515181 conn(0x7fe338089fe0 msgr2=0x7fe3380d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 -- 172.21.15.5:0/3762515181 shutdown_connections 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.157+0000 7fe33e59d640 1 -- 172.21.15.5:0/3762515181 wait complete. 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.158+0000 7fe33e59d640 1 Processor -- start 2024-09-13T17:19:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.158+0000 7fe33e59d640 1 -- start start 2024-09-13T17:19:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380ceeb0 0x7fe3380b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3381f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3381f1e60 con 0x7fe3380b2810 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380b3060 con 0x7fe3380ceeb0 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33e59d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380b3340 con 0x7fe33815d580 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33dd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33dd9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35900/0 (socket says 172.21.15.5:35900) 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33dd9c640 1 -- 172.21.15.5:0/626099335 learned_addr learned my addr 172.21.15.5:0/626099335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33cd9a640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3381f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.159+0000 7fe33d59b640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380ceeb0 0x7fe3380b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 -- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 msgr2=0x7fe3381f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3381f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 -- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380ceeb0 msgr2=0x7fe3380b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380ceeb0 0x7fe3380b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 -- 172.21.15.5:0/626099335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009a70 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33dd9c640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe330009eb0 tx=0x7fe330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330031890 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3300319f0 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330031d60 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3380b3620 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.160+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3380b3be0 con 0x7fe3380b2810 2024-09-13T17:19:48.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.161+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3380d2bb0 con 0x7fe3380b2810 2024-09-13T17:19:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.162+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe33003b410 con 0x7fe3380b2810 2024-09-13T17:19:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.162+0000 7fe32dffb640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.162+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fe3300aaa80 con 0x7fe3380b2810 2024-09-13T17:19:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.163+0000 7fe33d59b640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.163+0000 7fe33d59b640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 0x7fe31c06d0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe334007fd0 tx=0x7fe334007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.167+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe330075dc0 con 0x7fe3380b2810 2024-09-13T17:19:48.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.339+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3380b1790 con 0x7fe31c06ac00 2024-09-13T17:19:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.340+0000 7fe32dffb640 1 -- 172.21.15.5:0/626099335 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe334004c70 con 0x7fe31c06ac00 2024-09-13T17:19:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T17:19:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 msgr2=0x7fe31c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 0x7fe31c06d0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe334007fd0 tx=0x7fe334007de0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 msgr2=0x7fe3380b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe330009eb0 tx=0x7fe330004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 shutdown_connections 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3380b2810 0x7fe3380b0980 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815d580 0x7fe3381f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 --2- 172.21.15.5:0/626099335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380ceeb0 0x7fe3380b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 >> 172.21.15.5:0/626099335 conn(0x7fe338089fe0 msgr2=0x7fe33806adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 shutdown_connections 2024-09-13T17:19:48.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.342+0000 7fe33e59d640 1 -- 172.21.15.5:0/626099335 wait complete. 2024-09-13T17:19:48.353 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T17:19:48.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:19:48.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.458+0000 7f4fed126640 1 Processor -- start 2024-09-13T17:19:48.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.458+0000 7f4fed126640 1 -- start start 2024-09-13T17:19:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4fe8143ea0 0x7f4fe815a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe80cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fe80cc670 0x7f4fe80ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80cae40 con 0x7f4fe80cc670 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80cbca0 con 0x7f4fe8143ea0 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fed126640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80adfa0 con 0x7f4fe80adb60 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fe80cc670 0x7f4fe80ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fe80cc670 0x7f4fe80ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35914/0 (socket says 172.21.15.5:35914) 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 -- 172.21.15.5:0/2884101624 learned_addr learned my addr 172.21.15.5:0/2884101624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fdffff640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe80cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 -- 172.21.15.5:0/2884101624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 msgr2=0x7f4fe80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe80cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 -- 172.21.15.5:0/2884101624 >> v2:172.21.15.179:3300/0 conn(0x7f4fe8143ea0 msgr2=0x7f4fe815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe6d9d640 1 --2- 172.21.15.5:0/2884101624 >> v2:172.21.15.179:3300/0 conn(0x7f4fe8143ea0 0x7f4fe815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2884101624 >> v2:172.21.15.179:3300/0 conn(0x7f4fe8143ea0 0x7f4fe815a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.459+0000 7f4fe759e640 1 -- 172.21.15.5:0/2884101624 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8144280 con 0x7f4fe80cc670 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.460+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80ccb20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4fe806c1e0 tx=0x7f4fe002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f64323d18be32c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.460+0000 7f4fe659c640 1 -- 172.21.15.5:0/2884101624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0031600 con 0x7f4fe80cc670 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.460+0000 7f4fe659c640 1 -- 172.21.15.5:0/2884101624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe002d050 con 0x7f4fe80cc670 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.460+0000 7f4fe659c640 1 -- 172.21.15.5:0/2884101624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0031980 con 0x7f4fe80cc670 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 -- 172.21.15.5:0/2884101624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 msgr2=0x7f4fe80ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80ccb20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4fe806c1e0 tx=0x7f4fe002a610 comp rx=0 tx=0).stop 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 -- 172.21.15.5:0/2884101624 shutdown_connections 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80ccb20 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 --2- 172.21.15.5:0/2884101624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe80cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 --2- 172.21.15.5:0/2884101624 >> v2:172.21.15.179:3300/0 conn(0x7f4fe8143ea0 0x7f4fe815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 -- 172.21.15.5:0/2884101624 >> 172.21.15.5:0/2884101624 conn(0x7f4fe8069ed0 msgr2=0x7f4fe806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 -- 172.21.15.5:0/2884101624 shutdown_connections 2024-09-13T17:19:48.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.461+0000 7f4fed126640 1 -- 172.21.15.5:0/2884101624 wait complete. 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.462+0000 7f4fed126640 1 Processor -- start 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.462+0000 7f4fed126640 1 -- start start 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe8156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe8143ea0 0x7f4fe81f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8155b80 con 0x7f4fe80cc670 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8155e60 con 0x7f4fe8143ea0 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fed126640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8156140 con 0x7f4fe80adb60 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35916/0 (socket says 172.21.15.5:35916) 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fdffff640 1 -- 172.21.15.5:0/2721428863 learned_addr learned my addr 172.21.15.5:0/2721428863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fe6d9d640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe8156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.463+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe8143ea0 0x7f4fe81f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 -- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 msgr2=0x7f4fe8156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe80adb60 0x7f4fe8156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 -- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe8143ea0 msgr2=0x7f4fe81f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe8143ea0 0x7f4fe81f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009b30 con 0x7f4fe80cc670 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe8143ea0 0x7f4fe81f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdffff640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80b2f40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c7f0 tx=0x7f4fd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0004230 con 0x7f4fe80cc670 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0004390 con 0x7f4fe80cc670 2024-09-13T17:19:48.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0007860 con 0x7f4fe80cc670 2024-09-13T17:19:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe8156420 con 0x7f4fe80cc670 2024-09-13T17:19:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.464+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe80b3480 con 0x7f4fe80cc670 2024-09-13T17:19:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.465+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fe8155fd0 con 0x7f4fe80cc670 2024-09-13T17:19:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4fd0007bd0 con 0x7f4fe80cc670 2024-09-13T17:19:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fc806ac00 0x7f4fc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f4fd00892d0 con 0x7f4fe80cc670 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f4fc80710e0 0x7f4fc8073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fc8073bf0 con 0x7f4fc80710e0 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fd008b990 con 0x7f4fe80cc670 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fe6d9d640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fc806ac00 0x7f4fc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.466+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f4fc80710e0 0x7f4fc8073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.467+0000 7f4fe6d9d640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fc806ac00 0x7f4fc806d0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80b1b70 tx=0x7f4fd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.467+0000 7f4fe759e640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f4fc80710e0 0x7f4fc8073520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.468+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== osd.7 v2:172.21.15.179:6816/1963856475 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4fc8073bf0 con 0x7f4fc80710e0 2024-09-13T17:19:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.480+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 --> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4fe81562b0 con 0x7f4fc80710e0 2024-09-13T17:19:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.480+0000 7f4fdf7fe640 1 -- 172.21.15.5:0/2721428863 <== osd.7 v2:172.21.15.179:6816/1963856475 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4fe81562b0 con 0x7f4fc80710e0 2024-09-13T17:19:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-13T17:19:48.482 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:19:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f4fc80710e0 msgr2=0x7f4fc8073520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6816/1963856475,v1:172.21.15.179:6817/1963856475] conn(0x7f4fc80710e0 0x7f4fc8073520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fc806ac00 msgr2=0x7f4fc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f4fc806ac00 0x7f4fc806d0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4fe80b1b70 tx=0x7f4fd8008040 comp rx=0 tx=0).stop 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 msgr2=0x7f4fe80b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 --2- 172.21.15.5:0/2721428863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fe80cc670 0x7f4fe80b2f40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c7f0 tx=0x7f4fd000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fe759e640 1 -- 172.21.15.5:0/2721428863 reap_dead start 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 shutdown_connections 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 >> 172.21.15.5:0/2721428863 conn(0x7f4fe8069ed0 msgr2=0x7f4fe8141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 shutdown_connections 2024-09-13T17:19:48.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.481+0000 7f4fed126640 1 -- 172.21.15.5:0/2721428863 wait complete. 2024-09-13T17:19:48.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T17:19:48.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.594+0000 7ffacd45a640 1 Processor -- start 2024-09-13T17:19:48.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.594+0000 7ffacd45a640 1 -- start start 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffacd45a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffac815c6b0 0x7ffac80cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffacd45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac80b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffacd45a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80d2210 con 0x7ffac80b5c50 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffacd45a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac815ca90 con 0x7ffac815c6b0 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffacd45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80d1600 con 0x7ffac80cdb60 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.595+0000 7ffac6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffac815c6b0 0x7ffac80cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffac815c6b0 0x7ffac80cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35926/0 (socket says 172.21.15.5:35926) 2024-09-13T17:19:48.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 -- 172.21.15.5:0/2280403962 learned_addr learned my addr 172.21.15.5:0/2280403962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac67fc640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac80b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 -- 172.21.15.5:0/2280403962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 msgr2=0x7ffac80b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac80b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 -- 172.21.15.5:0/2280403962 >> v1:172.21.15.179:6789/0 conn(0x7ffac80b5c50 legacy=0x7ffac80b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 -- 172.21.15.5:0/2280403962 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80d18e0 con 0x7ffac815c6b0 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.596+0000 7ffac6ffd640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac815c6b0 0x7ffac80cd620 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009e50 tx=0x7ffab802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65861f22fab59980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffac5ffb640 1 -- 172.21.15.5:0/2280403962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8031600 con 0x7ffac815c6b0 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffac5ffb640 1 -- 172.21.15.5:0/2280403962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab802d050 con 0x7ffac815c6b0 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffac5ffb640 1 -- 172.21.15.5:0/2280403962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8031980 con 0x7ffac815c6b0 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 -- 172.21.15.5:0/2280403962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac815c6b0 msgr2=0x7ffac80cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac815c6b0 0x7ffac80cd620 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009e50 tx=0x7ffab802a750 comp rx=0 tx=0).stop 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 -- 172.21.15.5:0/2280403962 shutdown_connections 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac80b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 --2- 172.21.15.5:0/2280403962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac815c6b0 0x7ffac80cd620 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 -- 172.21.15.5:0/2280403962 >> 172.21.15.5:0/2280403962 conn(0x7ffac8071a20 msgr2=0x7ffac8071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 -- 172.21.15.5:0/2280403962 shutdown_connections 2024-09-13T17:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.597+0000 7ffacd45a640 1 -- 172.21.15.5:0/2280403962 wait complete. 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 Processor -- start 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 -- start start 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac8153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac815c6b0 0x7ffac80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8153550 con 0x7ffac80b5c50 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c6490 con 0x7ffac815c6b0 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.599+0000 7ffacd45a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80ca720 con 0x7ffac80cdb60 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35932/0 (socket says 172.21.15.5:35932) 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 -- 172.21.15.5:0/1950362648 learned_addr learned my addr 172.21.15.5:0/1950362648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac67fc640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac77fe640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac815c6b0 0x7ffac80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 -- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 msgr2=0x7ffac8153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac8153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 -- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac815c6b0 msgr2=0x7ffac80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac815c6b0 0x7ffac80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 -- 172.21.15.5:0/1950362648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8009b30 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffac6ffd640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009e50 tx=0x7ffab8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab803d860 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab803d9e0 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80ca9a0 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab803dd90 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.600+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac80caf60 con 0x7ffac80b5c50 2024-09-13T17:19:48.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.601+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac80b5710 con 0x7ffac80b5c50 2024-09-13T17:19:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.602+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffab803b400 con 0x7ffac80b5c50 2024-09-13T17:19:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.602+0000 7ffabf7fe640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.602+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7ffab80aa120 con 0x7ffac80b5c50 2024-09-13T17:19:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.602+0000 7ffac67fc640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.603+0000 7ffac67fc640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 0x7ffaa806d0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffac8066df0 tx=0x7ffab0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.606+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffab80753e0 con 0x7ffac80b5c50 2024-09-13T17:19:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.777+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ffac80b4f20 con 0x7ffaa806ac00 2024-09-13T17:19:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.777+0000 7ffabf7fe640 1 -- 172.21.15.5:0/1950362648 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffab0004020 con 0x7ffaa806ac00 2024-09-13T17:19:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 msgr2=0x7ffaa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 0x7ffaa806d0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffac8066df0 tx=0x7ffab0008040 comp rx=0 tx=0).stop 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 msgr2=0x7ffac81e6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009e50 tx=0x7ffab8004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 shutdown_connections 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac815c6b0 0x7ffac80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffac80cdb60 0x7ffac8153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 --2- 172.21.15.5:0/1950362648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffac80b5c50 0x7ffac81e6b60 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 >> 172.21.15.5:0/1950362648 conn(0x7ffac8071a20 msgr2=0x7ffac815ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 shutdown_connections 2024-09-13T17:19:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.779+0000 7ffacd45a640 1 -- 172.21.15.5:0/1950362648 wait complete. 2024-09-13T17:19:48.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:19:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.891+0000 7ff90f09c640 1 Processor -- start 2024-09-13T17:19:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.891+0000 7ff90f09c640 1 -- start start 2024-09-13T17:19:48.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90f09c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff90806e370 0x7ff90815d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90f09c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080b3150 con 0x7ff9081592d0 2024-09-13T17:19:48.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90f09c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080b3430 con 0x7ff9080cb7b0 2024-09-13T17:19:48.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90f09c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90815cf00 con 0x7ff90806e370 2024-09-13T17:19:48.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90d639640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff90806e370 0x7ff90815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90d639640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff90806e370 0x7ff90815d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35946/0 (socket says 172.21.15.5:35946) 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90ce38640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff9081592d0 0x7ff90806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58202/0 (socket says 172.21.15.5:58202) 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.892+0000 7ff90d639640 1 -- 172.21.15.5:0/4132717412 learned_addr learned my addr 172.21.15.5:0/4132717412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.893+0000 7ff90d639640 1 -- 172.21.15.5:0/4132717412 >> v1:172.21.15.179:6789/0 conn(0x7ff9080cb7b0 legacy=0x7ff90806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.893+0000 7ff90d639640 1 -- 172.21.15.5:0/4132717412 >> v1:172.21.15.5:6789/0 conn(0x7ff9081592d0 legacy=0x7ff90806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.893+0000 7ff90d639640 1 -- 172.21.15.5:0/4132717412 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080b3710 con 0x7ff90806e370 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.893+0000 7ff9077fe640 1 -- 172.21.15.5:0/4132717412 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148190691 0 0) 0x7ff9080b3150 con 0x7ff9081592d0 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.893+0000 7ff90d639640 1 --2- 172.21.15.5:0/4132717412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff90806e370 0x7ff90815d350 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7ff90000bb10 tx=0x7ff90002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bd8884f3a6ef46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff9077fe640 1 -- 172.21.15.5:0/4132717412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900032640 con 0x7ff90806e370 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff9077fe640 1 -- 172.21.15.5:0/4132717412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9000327a0 con 0x7ff90806e370 2024-09-13T17:19:48.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff9077fe640 1 -- 172.21.15.5:0/4132717412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900032b30 con 0x7ff90806e370 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 -- 172.21.15.5:0/4132717412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff90806e370 msgr2=0x7ff90815d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 --2- 172.21.15.5:0/4132717412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff90806e370 0x7ff90815d350 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7ff90000bb10 tx=0x7ff90002c940 comp rx=0 tx=0).stop 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 -- 172.21.15.5:0/4132717412 shutdown_connections 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 --2- 172.21.15.5:0/4132717412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff90806e370 0x7ff90815d350 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 -- 172.21.15.5:0/4132717412 >> 172.21.15.5:0/4132717412 conn(0x7ff908066200 msgr2=0x7ff908069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 -- 172.21.15.5:0/4132717412 shutdown_connections 2024-09-13T17:19:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.894+0000 7ff90f09c640 1 -- 172.21.15.5:0/4132717412 wait complete. 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.895+0000 7ff90f09c640 1 Processor -- start 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 -- start start 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff90806e370 0x7ff908157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9080cb7b0 0x7ff90814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff908155b40 con 0x7ff9081592d0 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081551a0 con 0x7ff90806e370 2024-09-13T17:19:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.896+0000 7ff90f09c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff908155480 con 0x7ff9080cb7b0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35956/0 (socket says 172.21.15.5:35956) 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 -- 172.21.15.5:0/1219813699 learned_addr learned my addr 172.21.15.5:0/1219813699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff907fff640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9080cb7b0 0x7ff90814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90ce38640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff90806e370 0x7ff908157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 -- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9080cb7b0 msgr2=0x7ff90814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9080cb7b0 0x7ff90814b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 -- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff90806e370 msgr2=0x7ff908157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff90806e370 0x7ff908157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 -- 172.21.15.5:0/1219813699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90000b770 con 0x7ff9081592d0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90d639640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff90002c980 tx=0x7ff9000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900040070 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff900032e60 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff908155760 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000443f0 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.897+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90814bf20 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.898+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9080672f0 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.899+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff900044550 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.899+0000 7ff9057fa640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 0x7ff8e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.900+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7ff9000ac8d0 con 0x7ff9081592d0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.900+0000 7ff90ce38640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 0x7ff8e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.900+0000 7ff90ce38640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 0x7ff8e806d0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8000f60 tx=0x7ff8f8007e60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:48.904+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff900077c10 con 0x7ff9081592d0 2024-09-13T17:19:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.071+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff908066770 con 0x7ff8e806ac00 2024-09-13T17:19:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.074+0000 7ff9057fa640 1 -- 172.21.15.5:0/1219813699 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51014 (secure 0 0 0) 0x7ff908066770 con 0x7ff8e806ac00 2024-09-13T17:19:49.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:19:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:19:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 msgr2=0x7ff8e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 0x7ff8e806d0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8000f60 tx=0x7ff8f8007e60 comp rx=0 tx=0).stop 2024-09-13T17:19:49.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 msgr2=0x7ff908151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff90002c980 tx=0x7ff9000046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 shutdown_connections 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff8e806ac00 0x7ff8e806d0c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9081592d0 0x7ff908151cc0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9080cb7b0 0x7ff90814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 --2- 172.21.15.5:0/1219813699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff90806e370 0x7ff908157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 >> 172.21.15.5:0/1219813699 conn(0x7ff908066200 msgr2=0x7ff9081585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 shutdown_connections 2024-09-13T17:19:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:19:49.076+0000 7ff90f09c640 1 -- 172.21.15.5:0/1219813699 wait complete. 2024-09-13T17:19:49.089 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-13T17:19:47.351332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261408,"kb_used_data":12456,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713312,"statfs":{"total":773094113280,"available":772826431488,"internally_reserved":0,"allocated":12754944,"data_stored":6497552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":254791225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27738,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-95,"num_read_kb":-89,"num_write":-165,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001467"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":250,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-13T17:19:42.104607+0000","last_change":"2024-09-13T17:13:05.064016+0000","last_active":"2024-09-13T17:19:42.104607+0000","last_peered":"2024-09-13T17:19:42.104607+0000","last_clean":"2024-09-13T17:19:42.104607+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:19:42.104607+0000","last_undegraded":"2024-09-13T17:19:42.104607+0000","last_fullsized":"2024-09-13T17:19:42.104607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:13:03.687327+0000","last_clean_scrub_stamp":"2024-09-13T17:13:03.687327+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:50.034184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":2039808,"data_stored":1254970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78100000000000003,"5min":1.165,"15min":1.165},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":1.216,"15min":1.216},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61399999999999999,"5min":1.234,"15min":1.234},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57999999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.625,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.044,"15min":1.044},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":0.878,"15min":0.878},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.627,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.503},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":0.90800000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67500000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65600000000000003,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.86299999999999999,"15min":0.88},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.173,"15min":1.173},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.36699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":1.008,"15min":1.008},"last":0.313}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.085,"15min":1.085},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.379}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.36099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.95699999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":0.85299999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.372,"15min":0.371},"max":{"1min":0.745,"5min":0.80400000000000005,"15min":1.034},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.80900000000000005,"15min":0.91300000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":0.873,"15min":0.873},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.77700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42599999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.503,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57699999999999996},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.76900000000000002,"15min":0.80900000000000005},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.33600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.76600000000000001,"15min":0.77400000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79100000000000004},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.36199999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.91600000000000004},"last":0.249},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47599999999999998,"5min":0.63400000000000001,"15min":0.85199999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":0.67000000000000004,"15min":1.458},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.433},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":1.3560000000000001},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.374,"15min":0.40699999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":1.4239999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":1.3899999999999999},"last":0.31}]},{"osd":4,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":1.0069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.5},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.226},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.68899999999999995},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.378,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.28599999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.376}]},{"osd":3,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.73399999999999999},"last":0.311}]},{"osd":4,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.42799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88600000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.97799999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.622,"5min":0.622,"15min":1.159},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.307},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":1.081},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":1.1200000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.286},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.878,"15min":1.046},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":1.1919999999999999},"last":0.443},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2230000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":1.254},"last":0.50800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":2039808,"data_stored":1254970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.47499999999999998,"15min":0.41099999999999998},"min":{"1min":0.217,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51900000000000002,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.498,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54800000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":14.262,"15min":14.262},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.52800000000000002,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":0.63200000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.38200000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":3.956,"15min":3.956},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":4.069,"15min":4.069},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89900000000000002,"5min":4.04,"15min":4.04},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.505}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.375},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:19:49.093 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T17:13:03.687327+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=13, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=19, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:19:49.093 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:20:09.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:20:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.211+0000 7f5854395640 1 Processor -- start 2024-09-13T17:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.211+0000 7f5854395640 1 -- start start 2024-09-13T17:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5854395640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f584c1592d0 0x7f584c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5854395640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f584c06e370 0x7f584c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5854395640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0b3150 con 0x7f584c0cb7b0 2024-09-13T17:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5854395640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c15cf00 con 0x7f584c1592d0 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5854395640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0b3430 con 0x7f584c06e370 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5852131640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f584c1592d0 0x7f584c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5852131640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f584c1592d0 0x7f584c06c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52348/0 (socket says 172.21.15.5:52348) 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5852131640 1 -- 172.21.15.5:0/4010698177 learned_addr learned my addr 172.21.15.5:0/4010698177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.212+0000 7f5852932640 1 --2- 172.21.15.5:0/4010698177 >> v2:172.21.15.179:3300/0 conn(0x7f584c06e370 0x7f584c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.213+0000 7f5852131640 1 -- 172.21.15.5:0/4010698177 >> v2:172.21.15.179:3300/0 conn(0x7f584c06e370 msgr2=0x7f584c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.213+0000 7f5852131640 1 --2- 172.21.15.5:0/4010698177 >> v2:172.21.15.179:3300/0 conn(0x7f584c06e370 0x7f584c15d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.213+0000 7f5852131640 1 -- 172.21.15.5:0/4010698177 >> v1:172.21.15.179:6789/0 conn(0x7f584c0cb7b0 legacy=0x7f584c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.213+0000 7f5852131640 1 -- 172.21.15.5:0/4010698177 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0b3710 con 0x7f584c1592d0 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.213+0000 7f5852131640 1 --2- 172.21.15.5:0/4010698177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c1592d0 0x7f584c06c440 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ce560 tx=0x7f584802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c140f83c1c0286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f585112f640 1 -- 172.21.15.5:0/4010698177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848032440 con 0x7f584c1592d0 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f585112f640 1 -- 172.21.15.5:0/4010698177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58480325a0 con 0x7f584c1592d0 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f585112f640 1 -- 172.21.15.5:0/4010698177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848032930 con 0x7f584c1592d0 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 -- 172.21.15.5:0/4010698177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c1592d0 msgr2=0x7f584c06c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 --2- 172.21.15.5:0/4010698177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c1592d0 0x7f584c06c440 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ce560 tx=0x7f584802a1f0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 -- 172.21.15.5:0/4010698177 shutdown_connections 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 --2- 172.21.15.5:0/4010698177 >> v2:172.21.15.179:3300/0 conn(0x7f584c06e370 0x7f584c15d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 --2- 172.21.15.5:0/4010698177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c1592d0 0x7f584c06c440 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 -- 172.21.15.5:0/4010698177 >> 172.21.15.5:0/4010698177 conn(0x7f584c066200 msgr2=0x7f584c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 -- 172.21.15.5:0/4010698177 shutdown_connections 2024-09-13T17:20:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.214+0000 7f5854395640 1 -- 172.21.15.5:0/4010698177 wait complete. 2024-09-13T17:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.215+0000 7f5854395640 1 Processor -- start 2024-09-13T17:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 -- start start 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c06e370 0x7f584c148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c1592d0 0x7f584c1475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c149420 con 0x7f584c0cb7b0 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c14ad60 con 0x7f584c06e370 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5854395640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c14b040 con 0x7f584c1592d0 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5851930640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5851930640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52352/0 (socket says 172.21.15.5:52352) 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5851930640 1 -- 172.21.15.5:0/2082801771 learned_addr learned my addr 172.21.15.5:0/2082801771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5852131640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c06e370 0x7f584c148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.216+0000 7f5852932640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c1592d0 0x7f584c1475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 -- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c1592d0 msgr2=0x7f584c1475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c1592d0 0x7f584c1475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 -- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c06e370 msgr2=0x7f584c148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c06e370 0x7f584c148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 -- 172.21.15.5:0/2082801771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480094d0 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5851930640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c4d0 tx=0x7f583c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0052d0 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c005430 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c14b320 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c012850 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.217+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c149060 con 0x7f584c0cb7b0 2024-09-13T17:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.218+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c0672f0 con 0x7f584c0cb7b0 2024-09-13T17:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.219+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f583c0129b0 con 0x7f584c0cb7b0 2024-09-13T17:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.219+0000 7f5842ffd640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 0x7f583006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.219+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f583c088c80 con 0x7f584c0cb7b0 2024-09-13T17:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.220+0000 7f5852131640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 0x7f583006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.220+0000 7f5852131640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 0x7f583006d0c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5848034000 tx=0x7f584802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.224+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f583c053fc0 con 0x7f584c0cb7b0 2024-09-13T17:20:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.391+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 --> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f584c1596b0 con 0x7f583006ac00 2024-09-13T17:20:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.393+0000 7f5842ffd640 1 -- 172.21.15.5:0/2082801771 <== mgr.4099 v2:172.21.15.179:6832/1099835240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51041 (secure 0 0 0) 0x7f58480329c0 con 0x7f583006ac00 2024-09-13T17:20:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:20:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 msgr2=0x7f583006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 0x7f583006d0c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5848034000 tx=0x7f584802e000 comp rx=0 tx=0).stop 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 msgr2=0x7f584c14e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c4d0 tx=0x7f583c00c990 comp rx=0 tx=0).stop 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 shutdown_connections 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c1592d0 0x7f584c1475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.395+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f583006ac00 0x7f583006d0c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.396+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cb7b0 0x7f584c14e5f0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.396+0000 7f5854395640 1 --2- 172.21.15.5:0/2082801771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c06e370 0x7f584c148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.396+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 >> 172.21.15.5:0/2082801771 conn(0x7f584c066200 msgr2=0x7f584c0703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.396+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 shutdown_connections 2024-09-13T17:20:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.396+0000 7f5854395640 1 -- 172.21.15.5:0/2082801771 wait complete. 2024-09-13T17:20:09.408 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-13T17:20:09.356130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261392,"kb_used_data":12456,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713328,"statfs":{"total":773094113280,"available":772826447872,"internally_reserved":0,"allocated":12754944,"data_stored":6497552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":254791225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002382"},"pg_stats":[{"pgid":"1.0","version":"116'119","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-13T17:19:50.641961+0000","last_change":"2024-09-13T17:19:50.642076+0000","last_active":"2024-09-13T17:19:50.641961+0000","last_peered":"2024-09-13T17:19:50.641961+0000","last_clean":"2024-09-13T17:19:50.641961+0000","last_became_active":"2024-09-13T17:13:05.063072+0000","last_became_peered":"2024-09-13T17:13:05.063072+0000","last_unstale":"2024-09-13T17:19:50.641961+0000","last_undegraded":"2024-09-13T17:19:50.641961+0000","last_fullsized":"2024-09-13T17:19:50.641961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'119","last_scrub_stamp":"2024-09-13T17:19:50.641938+0000","last_deep_scrub":"116'119","last_deep_scrub_stamp":"2024-09-13T17:19:50.641938+0000","last_clean_scrub_stamp":"2024-09-13T17:19:50.641938+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:31.115859+0000","scrub_duration":0.0049133240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":2039808,"data_stored":1254970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73799999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78100000000000003,"5min":1.165,"15min":1.165},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.33200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":1.216,"15min":1.216},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45500000000000002,"15min":0.45600000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61399999999999999,"5min":1.234,"15min":1.234},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.438,"5min":0.48099999999999998,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57999999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.625,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67800000000000005,"5min":1.044,"15min":1.044},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":0.878,"15min":0.878},"last":0.56699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.627,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.436},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79100000000000004,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.40999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.503},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":0.90800000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70499999999999996,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.40200000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67500000000000004,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.311,"15min":0.311},"max":{"1min":0.61299999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.505},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.40999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65600000000000003,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.86299999999999999,"15min":0.88},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.173,"15min":1.173},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.435},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.36699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77900000000000003,"5min":1.008,"15min":1.008},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":1.085,"15min":1.085},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72799999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32200000000000001},"max":{"1min":0.76200000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.95699999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":0.77000000000000002,"15min":0.85299999999999998},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.372,"15min":0.371},"max":{"1min":0.745,"5min":0.80400000000000005,"15min":1.034},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.80900000000000005,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80900000000000005,"5min":0.873,"15min":0.873},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.77700000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.496,"15min":0.51700000000000002},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63}]},{"osd":6,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.503,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57699999999999996},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65600000000000003,"5min":0.76900000000000002,"15min":0.80900000000000005},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.33600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.76600000000000001,"15min":0.77400000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79100000000000004},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.36199999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.91600000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.246,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47599999999999998,"5min":0.63400000000000001,"15min":0.85199999999999998},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.54900000000000004,"5min":0.67000000000000004,"15min":1.458},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.433},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":1.3560000000000001},"last":0.432}]},{"osd":2,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.374,"15min":0.40699999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":1.4239999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.42799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":1.3899999999999999},"last":0.376}]},{"osd":4,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.97999999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80600000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":1.0069999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.94199999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:19:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.226},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32532,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23200000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.68899999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.378,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.28599999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.44}]},{"osd":3,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.73399999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.627}]},{"osd":6,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.42799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88600000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.61099999999999999},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32528,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1445888,"data_stored":664602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.97799999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.622,"5min":0.622,"15min":1.159},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.374},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":1.081},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.29899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":1.1200000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.41499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28000000000000003,"15min":0.26500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.286},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.878,"15min":1.046},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":1.1919999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.64700000000000002},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.2230000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81799999999999995,"5min":0.89000000000000001,"15min":1.254},"last":0.627}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33104,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338736,"statfs":{"total":96636764160,"available":96602865664,"internally_reserved":0,"allocated":2039808,"data_stored":1254970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.47499999999999998,"15min":0.41099999999999998},"min":{"1min":0.217,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51900000000000002,"5min":14.106999999999999,"15min":14.106999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59199999999999997,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.498,"15min":0.438},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.56200000000000006,"5min":12.606999999999999,"15min":12.606999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54800000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.51900000000000002,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.63300000000000001,"5min":14.262,"15min":14.262},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.52800000000000002,"15min":0.45200000000000001},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.26400000000000001},"max":{"1min":0.63200000000000001,"5min":12.574999999999999,"15min":12.574999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.38200000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96199999999999997,"5min":3.956,"15min":3.956},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":4.069,"15min":4.069},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89900000000000002,"5min":4.04,"15min":4.04},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.65900000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":12.518000000000001,"15min":12.518000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.375},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:20:09.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T17:20:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.510+0000 7ff9999ce640 1 Processor -- start 2024-09-13T17:20:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.510+0000 7ff9999ce640 1 -- start start 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff9999ce640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff99415c940 0x7ff9940d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff9999ce640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff9940b4150 0x7ff9940b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff9999ce640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940d2520 con 0x7ff9940d1390 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff9999ce640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99415cd20 con 0x7ff99415c940 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff9999ce640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940b4b20 con 0x7ff9940b4150 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff992ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff99415c940 0x7ff9940d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff992ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff99415c940 0x7ff9940d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52358/0 (socket says 172.21.15.5:52358) 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.511+0000 7ff992ffd640 1 -- 172.21.15.5:0/450636234 learned_addr learned my addr 172.21.15.5:0/450636234 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.512+0000 7ff9937fe640 1 --2- 172.21.15.5:0/450636234 >> v2:172.21.15.179:3300/0 conn(0x7ff9940b4150 0x7ff9940b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.512+0000 7ff992ffd640 1 -- 172.21.15.5:0/450636234 >> v2:172.21.15.179:3300/0 conn(0x7ff9940b4150 msgr2=0x7ff9940b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.512+0000 7ff992ffd640 1 --2- 172.21.15.5:0/450636234 >> v2:172.21.15.179:3300/0 conn(0x7ff9940b4150 0x7ff9940b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.512+0000 7ff992ffd640 1 -- 172.21.15.5:0/450636234 >> v1:172.21.15.179:6789/0 conn(0x7ff9940d1390 legacy=0x7ff9940cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.512+0000 7ff992ffd640 1 -- 172.21.15.5:0/450636234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940cdd90 con 0x7ff99415c940 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff992ffd640 1 --2- 172.21.15.5:0/450636234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99415c940 0x7ff9940d29b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff9940c6000 tx=0x7ff98402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd181e2c0081966 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff991ffb640 1 -- 172.21.15.5:0/450636234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984032640 con 0x7ff99415c940 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff991ffb640 1 -- 172.21.15.5:0/450636234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9840327a0 con 0x7ff99415c940 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff991ffb640 1 -- 172.21.15.5:0/450636234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984032b30 con 0x7ff99415c940 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 -- 172.21.15.5:0/450636234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99415c940 msgr2=0x7ff9940d29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 --2- 172.21.15.5:0/450636234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99415c940 0x7ff9940d29b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff9940c6000 tx=0x7ff98402a300 comp rx=0 tx=0).stop 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 -- 172.21.15.5:0/450636234 shutdown_connections 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 --2- 172.21.15.5:0/450636234 >> v2:172.21.15.179:3300/0 conn(0x7ff9940b4150 0x7ff9940b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 --2- 172.21.15.5:0/450636234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99415c940 0x7ff9940d29b0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 -- 172.21.15.5:0/450636234 >> 172.21.15.5:0/450636234 conn(0x7ff99406b6f0 msgr2=0x7ff99406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:09.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 -- 172.21.15.5:0/450636234 shutdown_connections 2024-09-13T17:20:09.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.513+0000 7ff9999ce640 1 -- 172.21.15.5:0/450636234 wait complete. 2024-09-13T17:20:09.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.514+0000 7ff9999ce640 1 Processor -- start 2024-09-13T17:20:09.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 -- start start 2024-09-13T17:20:09.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9940d1390 0x7ff994158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99415c940 0x7ff9940cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99415df40 con 0x7ff9940b4150 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940c6ea0 con 0x7ff99415c940 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.515+0000 7ff9999ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99415d8f0 con 0x7ff9940d1390 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52374/0 (socket says 172.21.15.5:52374) 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 -- 172.21.15.5:0/3729391361 learned_addr learned my addr 172.21.15.5:0/3729391361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff9937fe640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99415c940 0x7ff9940cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff9927fc640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9940d1390 0x7ff994158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 -- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9940d1390 msgr2=0x7ff994158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9940d1390 0x7ff994158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 -- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99415c940 msgr2=0x7ff9940cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99415c940 0x7ff9940cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 -- 172.21.15.5:0/3729391361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840094d0 con 0x7ff9940b4150 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff992ffd640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff984000c00 tx=0x7ff9840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984030850 con 0x7ff9940b4150 2024-09-13T17:20:09.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9840309b0 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99415dbd0 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984030d40 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.516+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940cbcc0 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.517+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99415d750 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.518+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff984039040 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.518+0000 7ff97bfff640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 0x7ff98006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.518+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7ff9840a9a50 con 0x7ff9940b4150 2024-09-13T17:20:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.518+0000 7ff9927fc640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 0x7ff98006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.519+0000 7ff9927fc640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 0x7ff98006d0c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b1a30 tx=0x7ff988009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.523+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff99415d750 con 0x7ff9940b4150 2024-09-13T17:20:09.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.692+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff99415d750 con 0x7ff9940b4150 2024-09-13T17:20:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.696+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff984074d90 con 0x7ff9940b4150 2024-09-13T17:20:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.697+0000 7ff97bfff640 1 -- 172.21.15.5:0/3729391361 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff99415d750 con 0x7ff9940b4150 2024-09-13T17:20:09.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 msgr2=0x7ff98006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 0x7ff98006d0c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff9940b1a30 tx=0x7ff988009040 comp rx=0 tx=0).stop 2024-09-13T17:20:09.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 msgr2=0x7ff99415e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff984000c00 tx=0x7ff9840046c0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 shutdown_connections 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99415c940 0x7ff9940cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9940d1390 0x7ff994158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7ff98006ac00 0x7ff98006d0c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 --2- 172.21.15.5:0/3729391361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9940b4150 0x7ff99415e3d0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 >> 172.21.15.5:0/3729391361 conn(0x7ff99406b6f0 msgr2=0x7ff9940b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 shutdown_connections 2024-09-13T17:20:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.699+0000 7ff9999ce640 1 -- 172.21.15.5:0/3729391361 wait complete. 2024-09-13T17:20:09.711 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:20:09.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.812+0000 7f35bf39d640 1 Processor -- start 2024-09-13T17:20:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.812+0000 7f35bf39d640 1 -- start start 2024-09-13T17:20:09.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bf39d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35b8145e30 0x7f35b80ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bf39d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b806faa0 0x7f35b80c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bf39d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b8070460 con 0x7f35b806fec0 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bf39d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b80cf0e0 con 0x7f35b8145e30 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bf39d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80ce690 con 0x7f35b806faa0 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35b8145e30 0x7f35b80ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35b8145e30 0x7f35b80ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52386/0 (socket says 172.21.15.5:52386) 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 -- 172.21.15.5:0/197728953 learned_addr learned my addr 172.21.15.5:0/197728953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35bdb9a640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b806faa0 0x7f35b80c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 -- 172.21.15.5:0/197728953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b806faa0 msgr2=0x7f35b80c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b806faa0 0x7f35b80c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 -- 172.21.15.5:0/197728953 >> v1:172.21.15.179:6789/0 conn(0x7f35b806fec0 legacy=0x7f35b80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.813+0000 7f35be39b640 1 -- 172.21.15.5:0/197728953 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8070740 con 0x7f35b8145e30 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.814+0000 7f35be39b640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b8145e30 0x7f35b80ca990 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009e50 tx=0x7f35a802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6a01f0a1a3a1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.814+0000 7f35bd399640 1 -- 172.21.15.5:0/197728953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8031600 con 0x7f35b8145e30 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.814+0000 7f35bd399640 1 -- 172.21.15.5:0/197728953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f35a802d050 con 0x7f35b8145e30 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.814+0000 7f35bd399640 1 -- 172.21.15.5:0/197728953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80319a0 con 0x7f35b8145e30 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 -- 172.21.15.5:0/197728953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b8145e30 msgr2=0x7f35b80ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b8145e30 0x7f35b80ca990 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009e50 tx=0x7f35a802a710 comp rx=0 tx=0).stop 2024-09-13T17:20:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 -- 172.21.15.5:0/197728953 shutdown_connections 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b806faa0 0x7f35b80c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 --2- 172.21.15.5:0/197728953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b8145e30 0x7f35b80ca990 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 -- 172.21.15.5:0/197728953 >> 172.21.15.5:0/197728953 conn(0x7f35b80d0340 msgr2=0x7f35b80d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 -- 172.21.15.5:0/197728953 shutdown_connections 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.815+0000 7f35bf39d640 1 -- 172.21.15.5:0/197728953 wait complete. 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.816+0000 7f35bf39d640 1 Processor -- start 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.816+0000 7f35bf39d640 1 -- start start 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b806fec0 0x7f35b81f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b8145e30 0x7f35b815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b815e670 con 0x7f35b806faa0 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b81436d0 con 0x7f35b806fec0 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bf39d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b81f1d20 con 0x7f35b8145e30 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52388/0 (socket says 172.21.15.5:52388) 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 -- 172.21.15.5:0/3972001284 learned_addr learned my addr 172.21.15.5:0/3972001284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35beb9c640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b8145e30 0x7f35b815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 -- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b8145e30 msgr2=0x7f35b815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35bdb9a640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b806fec0 0x7f35b81f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b8145e30 0x7f35b815ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 -- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b806fec0 msgr2=0x7f35b81f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b806fec0 0x7f35b81f17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 -- 172.21.15.5:0/3972001284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8009b30 con 0x7f35b806faa0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35be39b640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f35a8000f80 tx=0x7f35a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.817+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a803d860 con 0x7f35b806faa0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.818+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f35a803d9e0 con 0x7f35b806faa0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.818+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b815daf0 con 0x7f35b806faa0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.818+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a803ddb0 con 0x7f35b806faa0 2024-09-13T17:20:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.818+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b815e0b0 con 0x7f35b806faa0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.819+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b806bbd0 con 0x7f35b806faa0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.819+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35a803b400 con 0x7f35b806faa0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.820+0000 7f35b6ffd640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 0x7f35a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.820+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f35a80aa320 con 0x7f35b806faa0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.820+0000 7f35bdb9a640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 0x7f35a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.820+0000 7f35bdb9a640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 0x7f35a406d0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f35b80b6230 tx=0x7f35ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:09.824+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f35a8079040 con 0x7f35b806faa0 2024-09-13T17:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.032+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b80cb130 con 0x7f35b806faa0 2024-09-13T17:20:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.032+0000 7f35b6ffd640 1 -- 172.21.15.5:0/3972001284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f35a8036de0 con 0x7f35b806faa0 2024-09-13T17:20:10.034 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-13T17:20:10.034 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7016,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1369036914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1369036914},{"type":"v1","addr":"172.21.15.179:6835","nonce":1369036914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1006183890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1006183890},{"type":"v1","addr":"172.21.15.5:6835","nonce":1006183890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/688226647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":688226647},{"type":"v1","addr":"172.21.15.179:6837","nonce":688226647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8976,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1597042536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1597042536},{"type":"v1","addr":"172.21.15.5:6833","nonce":1597042536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2024-09-13T17:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 62 2024-09-13T17:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 msgr2=0x7f35a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 0x7f35a406d0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f35b80b6230 tx=0x7f35ac008040 comp rx=0 tx=0).stop 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 msgr2=0x7f35b815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f35a8000f80 tx=0x7f35a8004a40 comp rx=0 tx=0).stop 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 shutdown_connections 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35b8145e30 0x7f35b815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b806fec0 0x7f35b81f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.179:6832/1099835240,v1:172.21.15.179:6833/1099835240] conn(0x7f35a406ac00 0x7f35a406d0c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 --2- 172.21.15.5:0/3972001284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35b806faa0 0x7f35b815d510 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 >> 172.21.15.5:0/3972001284 conn(0x7f35b80d0340 msgr2=0x7f35b80afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 shutdown_connections 2024-09-13T17:20:10.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-13T17:20:10.034+0000 7f35bf39d640 1 -- 172.21.15.5:0/3972001284 wait complete. 2024-09-13T17:20:10.047 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T17:20:10.047 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T17:20:10.047 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:20:10.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.057 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:20:10.057 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:20:10.057 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.108 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:20:10.109 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:20:10.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.121 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:20:10.121 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:20:10.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.173 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:20:10.173 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T17:20:10.174 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T17:20:10.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.203 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T17:20:10.204 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T17:20:10.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.272 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T17:20:10.272 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T17:20:10.273 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.347 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T17:20:10.347 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T17:20:10.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.416 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T17:20:10.416 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T17:20:10.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.443 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T17:20:10.443 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T17:20:10.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.509 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T17:20:10.509 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T17:20:10.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.581 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T17:20:10.581 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T17:20:10.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.648 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T17:20:10.648 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T17:20:10.649 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T17:20:10.649 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.674 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T17:20:10.674 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T17:20:10.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.719 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T17:20:10.719 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T17:20:10.719 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T17:20:10.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.730 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T17:20:10.731 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T17:20:10.731 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.771 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T17:20:10.771 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T17:20:10.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:20:10.823 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T17:20:10.823 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T17:20:10.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'client session with non-allowable root' | head -n 1 2024-09-13T17:20:10.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:20:10.862 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T17:20:11.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:20:11.053 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T17:20:11.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:20:11.169 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T17:20:11.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:20:11.225 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T17:20:11.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:20:11.284 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T17:20:11.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:20:11.435 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T17:20:11.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:20:11.513 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T17:20:11.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:20:11.561 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T17:20:11.611 INFO:tasks.ceph:Archiving mon data... 2024-09-13T17:20:11.612 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/data/mon.a.tgz 2024-09-13T17:20:11.612 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-13T17:20:11.628 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.eEXHr9oKmI 2024-09-13T17:20:11.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eEXHr9oKmI 2024-09-13T17:20:11.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.eEXHr9oKmI 2024-09-13T17:20:11.873 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.eEXHr9oKmI is 407KB 2024-09-13T17:20:11.975 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.eEXHr9oKmI 2024-09-13T17:20:11.990 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/data/mon.b.tgz 2024-09-13T17:20:11.991 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-13T17:20:12.009 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.MYYYWh51AR 2024-09-13T17:20:12.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MYYYWh51AR 2024-09-13T17:20:12.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.MYYYWh51AR 2024-09-13T17:20:12.251 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.MYYYWh51AR is 409KB 2024-09-13T17:20:12.320 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.MYYYWh51AR 2024-09-13T17:20:12.335 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/data/mon.c.tgz 2024-09-13T17:20:12.335 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-13T17:20:12.389 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.Ft4fnnImaP 2024-09-13T17:20:12.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ft4fnnImaP 2024-09-13T17:20:12.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.Ft4fnnImaP 2024-09-13T17:20:12.613 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.Ft4fnnImaP is 409KB 2024-09-13T17:20:12.709 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.Ft4fnnImaP 2024-09-13T17:20:12.723 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T17:20:12.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:20:12.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:20:12.788 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T17:20:12.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:20:12.795 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:20:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:20:12.854 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:20:12.861 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T17:20:12.862 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi005/crash 2024-09-13T17:20:12.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:20:12.895 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi179/crash 2024-09-13T17:20:12.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:20:12.925 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T17:20:12.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:12.940 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:13.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:13.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:20:13.068 INFO:tasks.ceph:Compressing logs... 2024-09-13T17:20:13.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:20:13.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:20:19.128 INFO:tasks.ceph:Archiving logs... 2024-09-13T17:20:19.129 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi005/log 2024-09-13T17:20:19.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:20:20.351 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi179/log 2024-09-13T17:20:20.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:20:21.038 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:20:21.048 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:20:21.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:20:21.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:20:21.162 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:20:21.171 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:20:21.172 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:20:21.174 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:20:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:20:21.192 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:20:21.195 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:20:21.196 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-13T17:20:21.196 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -125us[ -127us] +/- 49ms 2024-09-13T17:20:21.196 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +873us[ +871us] +/- 66ms 2024-09-13T17:20:21.196 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -721us[ -721us] +/- 64ms 2024-09-13T17:20:21.196 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:20:21.197 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:20:21.197 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-13T17:20:21.197 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -98us[ -95us] +/- 49ms 2024-09-13T17:20:21.197 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +885us[ +885us] +/- 66ms 2024-09-13T17:20:21.198 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -689us[ -689us] +/- 64ms 2024-09-13T17:20:21.198 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:20:21.198 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:20:21.207 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:20:21.208 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:20:21.218 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:20:21.333 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:20:21.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:20:21.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:21.443 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T17:20:21.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:21.473 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:20:21.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:20:21.515 INFO:teuthology.task.internal:Duration was 810.152327 seconds 2024-09-13T17:20:21.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:20:21.523 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:20:21.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:20:21.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:20:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:20:21.567 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:20:21.857 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:20:21.857 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-09-13T17:20:21.857 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:20:21.880 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-13T17:20:21.880 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:20:21.922 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:20:21.922 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:20:21.925 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:20:21.990 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:20:21.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:20:21.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:20:22.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:20:22.166 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:20:22.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:20:22.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:20:22.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:20:22.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:20:22.234 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:20:22.255 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-09-13T17:20:22.281 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-13T17:20:22.294 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:20:22.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:22.325 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:20:22.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:20:22.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:20:22.359 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:20:22.360 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi005 2024-09-13T17:20:22.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:20:22.403 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903874/remote/smithi179 2024-09-13T17:20:22.403 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:20:22.437 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:20:22.437 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:20:22.439 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:20:22.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:20:22.500 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:20:22.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:20:22.514 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:20:22.514 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:20:22.516 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:20:22.529 INFO:teuthology.orchestra.run.smithi005.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:20 /home/ubuntu/cephtest 2024-09-13T17:20:22.540 INFO:teuthology.orchestra.run.smithi179.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:20 /home/ubuntu/cephtest 2024-09-13T17:20:22.541 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:20:22.550 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:20:22.572 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/sessionmap} duration: 810.152327299118 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:20:22.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:20:22.687 INFO:teuthology.run:pass